4051-4100 of 5349 results (33ms)
2018-04-30 §
14:23 <joal> Suspend webrequest-druid-hourly-coord and pageview-druid-hourly-coord before druid upgrade [analytics]
14:23 <elukey> disabled cron/check on analytics1003 to respawn banner impressions if needed [analytics]
14:21 <joal> Kill BannerImpressionStream job before upgrading druid [analytics]
2018-04-25 §
14:39 <elukey> re-enable camus after maintenance [analytics]
14:37 <elukey> restart hive-server2 on analytics1003 to pick up settings in https://gerrit.wikimedia.org/r/428919 [analytics]
13:40 <elukey> stop camus on an1003 as prep step to gracefully restart hive server [analytics]
12:24 <joal> Only false positive for Data Loss Warning - Workflow webrequest-load-check_sequence_statistics-wf-upload-2018-4-25-10 [analytics]
2018-04-24 §
16:30 <elukey> restart hadoop hdfs journalnode on analytics1035/52 to pick up prometheus jmx settings [analytics]
14:41 <elukey> restart hadoop hdfs journalnode on analytics1028 to pick up jmx settings [analytics]
12:08 <elukey> restart webrequest-load-wf-text-2018-4-24-9 via Hue (failed due to reimages) [analytics]
06:57 <joal> correct reindextion job: https://hue.wikimedia.org/oozie/list_oozie_coordinator/0033859-180330093100664-oozie-oozi-C/ [analytics]
06:55 <joal> Reindextion job: https://hue.wikimedia.org/oozie/list_oozie_coordinator/0033855-180330093100664-oozie-oozi-C/ [analytics]
06:54 <joal> Manually reindexing all of mediawiki-history for snapshot 2018-03 after having messed it with job testing [analytics]
2018-04-23 §
20:41 <milimetric> deployed a version of wikistats with all but reading metrics disabled to stop showing bad data [analytics]
19:34 <elukey> deploy https://gerrit.wikimedia.org/r/428331 for Pivot [analytics]
14:10 <ottomata> switching main -> analytics MirrorMaker to --new.consumer (temporarily stopping puppet on kafka101[234]) https://phabricator.wikimedia.org/T192387 [analytics]
13:54 <elukey> reimage analytics1067 to debian stretch [analytics]
2018-04-20 §
18:23 <joal> Drop/recreate wmf.mediawiki_user_history andwmf.mediawiki_page_history for T188669 [analytics]
14:17 <elukey> d-[1,2,3] hosts in the analytics labs project upgraded to druid 0.10 [analytics]
11:37 <fdans> manually uploaded refinery whitelist to hdfs [analytics]
11:33 <elukey> reimage analytics1068 do Debian stretch [analytics]
2018-04-19 §
20:39 <milimetric> launched virtual pageviews job, it has id 0026169-180330093100664-oozie-oozi-C [analytics]
20:36 <milimetric> Synced latest refinery version to HDFS [analytics]
17:35 <fdans> refinery deployment - sync to hdfs finished [analytics]
16:27 <elukey> analytics1069 reimaged to Debian stretch [analytics]
15:40 <fdans> deploying refinery [analytics]
14:30 <elukey> disabled druid1001's middlemanager, restarted 1002's [analytics]
14:19 <elukey> add 60G /srv partition to hadoop-coordinator-1 in analytics labs [analytics]
14:04 <elukey> disabled druid1002's worker as prep step for restart - jvms with a old version running realtime indexation [analytics]
2018-04-16 §
10:04 <joal> Restart metrics job after table update [analytics]
09:54 <joal> Update wmf.mediawiki_metrics table for T190058 [analytics]
08:41 <joal> Restart Mediawiki-history job after new patches [analytics]
08:35 <joal> Restarting wikidata-articleplaceholder oozie job after last week's failures [analytics]
08:29 <joal> Deploying refnery onto HDFS [analytics]
08:22 <joal> Deploying refinery from tin [analytics]
08:03 <joal> Correction - Deploying refinery-source v0.0.62 using Jenkins ! [analytics]
08:03 <joal> Deploying refinery source v0.0.62 from tin [analytics]
2018-04-12 §
20:34 <ottomata> replacing references to dataset1001.wikimedia.org:: with /srv/dumps in stat1005:~ezachte/wikistats/dammit.lt/bash: for f in $(sudo grep -l dataset1001.wikimedia.org *); do sudo sed -i 's@dataset1001.wikimedia.org::@/srv/dumps/@g' $f; done T189283 [analytics]
2018-04-11 §
16:48 <elukey> restart hadoop namenodes to pick up HDFS trash settings [analytics]
2018-04-10 §
22:43 <joal> Deploying refinery with scap [analytics]
22:42 <joal> Refinery-source 0.0.61 deployed on archiva [analytics]
20:43 <ottomata> bouncing main -> jumbo mirrormakers to blacklist job topics until we have time to investigate more [analytics]
20:38 <ottomata> restarted event* camus and refine cron jobs, puppet is reenabled on analytics1003 [analytics]
20:14 <ottomata> restart mirrormakers main -> jumbo (AGAIN) [analytics]
19:26 <ottomata> restarted camus-webrequest and camus-mediawiki (avro) camus jobs [analytics]
18:18 <ottomata> restarting all hadoop nodemanagers, 3 at a time to pick up spark2-yarn-shuffle.jar T159962 [analytics]
18:06 <joal> EDeploy refinery to HDFS [analytics]
17:46 <joal> Refinery source 0.0.60 deployed to archiva [analytics]
15:42 <ottomata> disable puppet on analytics1003 and stop camus crons in preperation for spark 2 upgrade [analytics]
14:25 <ottomata> bouncing all main -> jumob mirror makers, they look stuck! [analytics]