401-450 of 1944 results (14ms)
2018-10-04 §
17:20 <elukey> bounce druid-brokers on druid100[4-6] after network maintenance [analytics]
2018-10-01 §
12:56 <fdans> reverting to last version of wikistats [analytics]
2018-09-27 §
06:44 <elukey> rolling restart of Druid coordinators and historicals on the Druid public cluster to pick up new Hadoop masters (one at the time, very gently) [analytics]
2018-09-26 §
20:39 <elukey> rolling restart of all the druid historicals on Druid private/analytics [analytics]
20:00 <ottomata> rolling restart of druid coordinators to hopefully pick up hadoop master config change [analytics]
17:49 <joal> Deploy AQS from scap [analytics]
08:22 <elukey> start mysql consumers on eventlog1002 after maintenance [analytics]
07:51 <elukey> stop mysql consumers on eventlog1002 as prep step for db maintenance [analytics]
2018-09-25 §
20:21 <joal> Webrequest warning for upload-2018-09-25-13 were all false positives [analytics]
17:36 <ottomata> stopping refine jobs and deploying refinery source 0.0.75 - T203804 [analytics]
12:37 <joal> Rerun webrequest-load-wf-text-2018-9-25-6 and webrequest-load-wf-text-2018-9-25-7 after SLA failure due to hadoop master swaps [analytics]
11:55 <joal> Rerun webrequest-load-wf-upload-2018-9-25-6 after failed SLA during hadoop master swap [analytics]
11:53 <joal> rerun as you prefer dcausse :) [analytics]
08:02 <joal> Killing discovery transfer job to drain cluster before master replacement (application_1536592725821_38136) [analytics]
06:24 <elukey> stop camus crons on an1003 and report updater on stat1005 as prep step for cluster shutdown [analytics]
2018-09-20 §
16:04 <joal> webrequest-load-check_sequence_statistics-wf-text-2018-9-19-20 have been checked as false-positive [analytics]
2018-09-15 §
12:22 <joal> Restart webrequest-druid-[hourly|daily] coordinators [analytics]
12:20 <joal> Kill wikidata-wdqs coordinator [analytics]
12:11 <joal> Killing and restarting webrequest-load-bundle [analytics]
12:00 <joal> Deploying refinery onto hadoop :) [analytics]
11:39 <joal> Deploying refinery with scap [analytics]
2018-09-12 §
17:34 <ottomata> deploying new version of refinery-source, and then refinery for properties based RefineMonitor job - https://phabricator.wikimedia.org/T203804 [analytics]
13:11 <ottomata> otto@deploy1001 Started deploy [eventlogging/analytics@5c6fab6]: Support loading plugins in eventlogging-processor - T203596 [analytics]
06:21 <elukey> re-run webrequest-load-wf-text-2018-9-12-4, failed due to sql exceptions/timeouts to the database [analytics]
2018-09-10 §
16:26 <ottomata> restarting eventlogging-processors to pick up blacklist of WebClientError schema for MySQL - T203814 [analytics]
12:49 <elukey> disable camus as prep step for analytics100[1-3] reboots [analytics]
07:54 <joal> Manually restarting mediawiki-reduced oozie with manual addition of missing parameter [analytics]
2018-09-07 §
18:18 <joal> Manually downoad namespaces for 2018-08 [analytics]
17:32 <joal> Manually rerun download-project-namespace-map on analytics1003 after cron's failure [analytics]
2018-09-06 §
13:03 <fdans> restarted virtualpageview_hourly coordinator [analytics]
2018-09-05 §
18:18 <ottomata> restarted eventlogging processors blacklisting CentralNoticeImpression - T203592 [analytics]
16:56 <ottomata> restarting eventlogging processors to blacklist CitationUsage - T191086 [analytics]
14:42 <elukey> deploying refinery (pageview whitelist and cron script change) [analytics]
13:40 <ottomata> reimaging thorium to debian stretch (this will cause an announced {stats,analytics}.wm.org downtime!) - T192641 [analytics]
13:21 <fdans> restarting webrequest load bundle, start time 11:00Z [analytics]
09:12 <elukey> re-run webrequest-druid-hourly-wf-2018-9-5-7 - failed due to rebooting druid1001 [analytics]
07:02 <elukey> restart oozie on analytics1003 to pick up new smtp settings [analytics]
06:37 <elukey> re-run webrequest-load-wf-misc-2018-9-5-2 and webrequest-load-wf-upload-2018-9-4-19 via Hue [analytics]
06:35 <elukey> upload new pageview whitelist to hdfs [analytics]
2018-09-04 §
19:05 <joal> Restart cassandra-hourly-wf-local_group_default_T_pageviews_per_project_v2-2018-9-4-14 [analytics]
16:37 <fdans> restarting webrequest-load bundle [analytics]
16:07 <fdans> beginning refinery deployment [analytics]
14:28 <fdans> deployed refinery source using jenkins [analytics]
2018-09-03 §
08:07 <joal> Delete /wmf/data/raw/mediawiki_private/tables/cu_changes/month=2018-05 folder and relaunch mediawiki-geoeditors-load-wf-2018-08 [analytics]
06:05 <elukey> re-run virtualpageview-hourly-wf-2018-9-2-1 via Hue (failed oozie job to inspect: 0082016-180705103628398-oozie-oozi-W) [analytics]
2018-08-31 §
14:31 <elukey> re-run webrequest-load-wf-upload-2018-8-31-11, failed due to hadoop workers reboots [analytics]
10:05 <elukey> re-run webrequest-load-wf-upload-2018-8-31-7, failed due to hadoop workers reboots [analytics]
09:15 <elukey> re-run webrequest-load-wf-upload-2018-8-31-[7,8], failed due to hadoop workers reboots [analytics]
07:26 <elukey> re-run webrequest-load-wf-text-2018-8-31-4, failed due to hadoop workers reboots [analytics]
06:20 <elukey> re-run webrequest-load-wf-text-2018-8-31-4, failed for hadoop workers reboots [analytics]