5201-5250 of 5971 results (33ms)
2017-06-20 §
16:18 <joal> Rererun pageview-druid-hourly-wf-2017-6-20-14 (failed due to druid reboots) [analytics]
16:04 <elukey> re-run pageview-druid-hourly-wf-2017-6-20-14 (failed due to druid reboots) [analytics]
14:46 <elukey> re-run failed webrequest-load-text/upload jobs due to reboots [analytics]
13:29 <elukey> restart webrequest-load-coord-text and webrequest-load-coord-upload failed jobs due to reboots [analytics]
13:14 <elukey> re-run wikidata-wdqs_extract-wf-2017-6-20-11 (failed for connection issues, likely due to reboots) [analytics]
11:54 <joal> Deleting old unique_devices data (renamed to unique_devices_per_domain) [analytics]
10:27 <elukey> reboot kafka1012, analytics1028, aqs1004 for kernel upgrades (canary hosts) [analytics]
08:51 <elukey> manually added the user 'hdfs' to the 'hive' group to be able to run refinery-drop-webrequest-partitions [analytics]
08:49 <elukey> manually running /srv/deployment/analytics/refinery/bin/refinery-drop-webrequest-partitions on an1003 to free hdfs space [analytics]
2017-06-19 §
12:10 <elukey> disable BBU auto learn on all the hadoop workers [analytics]
2017-06-13 §
10:10 <elukey> merged big zookeeper refactoring https://gerrit.wikimedia.org/r/#/c/354449 - Druid's Hadoop client config now correctly points to conf1* and not drud1* [analytics]
2017-06-12 §
17:21 <joal> Last deploy of the day for uniques patch [analytics]
13:26 <joal> redeploying refinery after bug patch [analytics]
11:32 <joal> Change production last_access_uniques dataset to unique_devices/per_domain [analytics]
11:11 <joal> Deploy refinery onto HDFS [analytics]
11:03 <joal> Regular weekly deploy of refinery (mostly unique_devices patches) [analytics]
10:54 <joal> Refinery-source deployed to archiva [analytics]
2017-06-08 §
16:41 <nuria_> deploying refinery to cluster [analytics]
13:44 <elukey> AQS cluster in beta wiped and re-bootstrapped due to T167222 [analytics]
12:54 <elukey> run megacli -LDSetProp ADRA -LALL -aALL on analytics1047 to set ReadAheadAdaptive on analytics[1042-1046,1048-1057].eqiad.wmnet - T166140 [analytics]
12:16 <elukey> run megacli -LDSetProp ADRA -LALL -aALL on analytics1047 to set ReadAheadAdaptive - T166140 [analytics]
10:35 <elukey> executed megacli -LDSetProp NoCachedBadBBU -LALL -aALL on analytics1049/45 [analytics]
10:28 <elukey> executed megacli -LDSetProp NoCachedBadBBU -LALL -aALL on analytics1032 as test - T166140 [analytics]
07:25 <elukey> kill maps webrequest load coordinator as temporary measure to avoid oozie spamming [analytics]
07:21 <elukey> suspended cache maps as temporary measure to avoid oozie spamming [analytics]
2017-06-07 §
06:50 <elukey> restarted mediacounts-archive-wf-2017-06-06 in Hue (Java OOMs) [analytics]
2017-06-06 §
15:44 <ottomata> restarting eventlogging mysql consumer to allow is_mediawiki events through is_not_bot filter [analytics]
15:24 <ottomata> restarting eventlogging processor to bring in is_mediawiki ua classification [analytics]
2017-06-02 §
14:48 <mforns> Restarted webrequest-load-bundle after deploy [analytics]
08:41 <joal> Restarted last_access_uniques-monthly-coord after bug correction and deploy [analytics]
04:42 <elukey> removed some old scap revs for the Analytics refinery on stat1002 to free space [analytics]
2017-06-01 §
14:29 <mforns> Deployed refinery using scap, then deployed onto hdfs [analytics]
12:47 <mforns> Deployed refinery-source v0.0.46 using jenkins [analytics]
2017-05-29 §
09:45 <joal> Restarted wikidata-articleplaceholder_metrics-wf-2017-5-27 [analytics]
2017-05-26 §
12:54 <elukey> restarted master Hadoop daemons for jvm upgrade [analytics]
12:39 <elukey> re-added analytics1030 to the hadoop workers [analytics]
2017-05-25 §
10:11 <elukey> removed /usr/share/druid/extensions/druid-hdfs-storage-cdh/druid-hdfs-storage-0.10.0.jar from all druid nodes [analytics]
07:23 <joal> Restart pageview-druid-hourly-wf-2017-5-24-19 [analytics]
2017-05-24 §
21:09 <ottomata> pausing all druid oozie coordinators until hadoop loading is fixed [analytics]
15:27 <joal> Resume pageview-druid-hourly-coord after druid upgrade [analytics]
13:07 <joal> Suspend pageview-druid-hourly-coord for druid upgrade [analytics]
09:06 <joal> Restart oozie mediawiki_history denormalize/metrics job after bug fixing deploy [analytics]
09:04 <joal> Restart oozie last_accesst_uniques daily/monthly job after bug fixing deploy [analytics]
09:01 <joal> Restart oozie restbase job after bug fixing deploy [analytics]
08:52 <joal> Deploy refinery to HDFS [analytics]
08:48 <joal> Deploying refine [analytics]
2017-05-23 §
14:32 <joal> Start 1-off oozie jobs adding underestimate and offset values in historical archived uniques datasets [analytics]
13:50 <joal> Restarted oozie last_access_uniques jobs (daily + monthly) after deploy [analytics]
13:47 <joal> Restarted oozie druid hourly pageview job after deploy [analytics]
13:46 <joal> Restarted oozie druid uniques job after deploy [analytics]