27 results (7ms)
2017-01-25 §
10:21 <zhuyifei1999_> `$ sudo apt update && sudo apt dist-upgrade` on all hosts [video]
07:48 <zhuyifei1999_> repooling encoding02 [video]
2017-01-24 §
21:33 <zhuyifei1999_> depooling encoding02 & 03, repooling encoding01 [video]
21:30 <zhuyifei1999_> git pulling v2c code to 8cf788e across all encoding hosts [video]
18:27 <zhuyifei1999_> repooling encoding02 & encoding03, depooling encoding01 T155455 [video]
18:23 <zhuyifei1999_> killed the rest of tasks on encoding02 & encoding03, they are gonna fail anyways [video]
16:17 <zhuyifei1999_> encoding03 free disk space < 10G, renicing PID 9136 (50c81becdbd5a1c5) & 3499 (a32b3fa5dc0e2123) & 3611 (0e73d27e7cb00284) to niceness of 1, so these near-complete tasks can finish early and clear some disk space [video]
15:32 <zhuyifei1999_> git pulling v2c code to b2d6e84 across all encoding hosts T155455 [video]
14:58 <zhuyifei1999_> killing the rest of the tasks on encoding01 because they aren't going to succeed anyways; depooling encoding03; reloading encoding01 T155455 [video]
14:19 <zhuyifei1999_> depooling encoding01 & 02 and waiting for tasks to finish before restarting (reload the code) T155455 [video]
14:15 <zhuyifei1999_> git pulling v2c code to 31479a4 across all encoding hosts T155455 [video]
14:10 <zhuyifei1999_> pip installing pywikibot at 7ac0142 across all encoding hosts T155455 [video]
2017-01-23 §
12:10 <zhuyifei1999_> starting v2c worker at encoding03 due to flooding [video]
2017-01-20 §
12:01 <zhuyifei1999_> restarting all currently running v2c workers (celery{1,2}@encoding0{1,2}) and web frontend due to NFS outage, and we aren't very sure which component is erroring (T155803) [video]
2017-01-15 §
09:28 <zhuyifei1999_> pooled encoding02 [video]
2017-01-12 §
09:12 <zhuyifei1999_> depooling encoding02 + pooling encoding01 + restarting frontend, to upgrade youtube_dl [video]
2017-01-11 §
05:46 <zhuyifei1999_> re-enabling v2c frontend & pooling worker at encoding02; transcode queue is < 500 now, and mostly containing relatively small files (T153488) [video]
2016-12-29 §
08:57 <zhuyifei1999_> depooled encoding02 per request from operations [video]
2016-12-28 §
10:58 <zhuyifei1999_> pooling encoding02, depooling encoding01&03 to update its code [video]
2016-12-27 §
19:20 <zhuyifei1999_> depooling encoding02 since the flood is under control [video]
15:56 <zhuyifei1999_> starting the two other workers because of flood, trying to restore the system to a "ready for new tasks" state [video]
2016-12-22 §
12:10 <zhuyifei1999_> depooling v2c workers at encoding02 and encoding03 in order to make transcoding slower and have production videoscalers catch up (T153488) [video]
2016-12-11 §
15:36 <zhuyifei1999_> depooling encoding02, less than 5G of disk space left [video]
2016-07-13 §
15:02 <andrewbogott> deleting/recreating encoding01 [video]
2016-07-11 §
21:22 <andrewbogott> deleting instances encoding02 and encoding03, soon to recreate [video]
2016-03-22 §
14:53 <andrewbogott> rebooting encoding3 because it's mostly broken [video]
2015-07-31 §
19:39 <andrewbogott> migrating encoding01 to a new virt host. [video]