3201-3250 of 4116 results (18ms)
2017-10-09 §
18:28 <ottomata> resuming oozie druid indexing jobs, 1004-1006 are offline [analytics]
16:34 <ottomata> stopping druid services on druid1006 [analytics]
16:05 <ottomata> pausing all druid oozie coordinators in preperation for druid public separation [analytics]
12:47 <joal> Kill restart oozie job lading mediawiki-history into druid [analytics]
12:14 <joal> Kill-Restart oozie jobs loading banner data into druid [analytics]
12:04 <joal> Deploy refinery onto HDFS [analytics]
11:47 <joal> Deploying refinery from scap [analytics]
08:53 <joal> Rerunning wikidata-articleplaceholder_metrics-wf-2017-10-7 after failure [analytics]
2017-10-06 §
11:10 <elukey> restart all druid daemons to pick up new logging changes [analytics]
11:08 <joal> Rerun pageview-druid-hourly-wf-2017-10-6-9 [analytics]
09:31 <elukey> restart all the druid daemons on druid1005 to apply the new logging rules [analytics]
08:49 <elukey> restarted all the druid broker daemons to pick up the new logging changes [analytics]
2017-10-05 §
13:48 <milimetric> restarted banner_activity-druid-monthly for September again [analytics]
2017-10-04 §
18:39 <ottomata> druid-analytics.svc.eqiad.wmnet:8082 should only be accessible to analytics networks [analytics]
17:32 <ottomata> deploying new LVS service for druid-analytics-broker [analytics]
2017-10-03 §
14:50 <milimetric> restarted failed workflow 0057215-170829140538136-oozie-oozi-W (druid monthly banner activity) [analytics]
2017-09-28 §
10:02 <elukey> renabled camus after maintenance [analytics]
09:51 <elukey> restart mapreduce history server on an1001 to apply new heap settings (Xmx/s to 4g) [analytics]
2017-09-27 §
15:18 <joal> Kill/restart stuck jobs [analytics]
14:45 <elukey> rolling restart of all the Yarn nodemanager daemons on analytics1028-1068 (ease heap consumption pressure, seamless restart) [analytics]
13:40 <elukey> manual failover of HDFS namenode from an1002 to an1001 [analytics]
13:17 <elukey> manual failover of HDFS namenode from an1001 to an1002 to test 6G max heap size [analytics]
13:14 <elukey> restart mapreduce history server on analytics1001 after crash (java.lang.OutOfMemoryError: GC overhead limit exceeded) [analytics]
2017-09-26 §
14:49 <joal> restart mobile_apps session_metrics bundle [analytics]
14:49 <joal> restart [analytics]
11:01 <joal> Restart mediawiki-history-denormalize and mediawiki-history-druid jobs after deploy [analytics]
10:58 <joal> Restart webrequest load job after deploy [analytics]
10:35 <joal> Deploying refinery onto HDFS [analytics]
10:25 <joal> Deploy Refinery with scap [analytics]
09:33 <joal> Releasing refinery-source v0.0.53 with Jenskins [analytics]
2017-09-25 §
08:41 <joal> Rerun mobile_apps-session_metrics-wf- 2017-9-17 after failure [analytics]
2017-09-19 §
19:24 <joal> Rerun pageview-druid-hourly-wf-2017-9-19-17 failed during druid restart [analytics]
19:19 <ottomata> restarting druid broker and historical processes with druid.processing.numMergeBuffers=10 [analytics]
2017-09-14 §
17:35 <ottomata> restaring eventlogging processor(s) with MySQL blacklist of PageCreation schema [analytics]
2017-09-13 §
16:08 <ottomata> restarting druid-brokers with increase in query cache size [analytics]
11:15 <joal> Kill-Restart mediawiki-history-denormalize-coord and launch new coords mediawiki-history-load and mediawiki-history-reduced [analytics]
11:11 <joal> Kill-Restart oozie pageview druid loading jobs (hourly, daily, monthly) [analytics]
11:03 <joal> Deploy refinery onto HDFS [analytics]
10:57 <joal> Deploy refinery from scap [analytics]
10:08 <joal> Deploying refinery-source using Jenkins [analytics]
2017-09-07 §
08:41 <joal> Rerun Workflow banner_activity-druid-daily-wf-2017-9-6 [analytics]
2017-09-04 §
08:55 <joal> Kill - Restart mediawiki-history-druid-coord to pick last update [analytics]
2017-09-01 §
18:30 <joal> Rerun Workflow webrequest-load-wf-misc-2017-9-1-16 after very weird failure [analytics]
10:06 <elukey> killed root rsyncs on thorium, disabled puppet [analytics]
01:31 <ottomata> restarted hue (a few minutes ago) not totally sure why it died [analytics]
2017-08-30 §
15:54 <elukey> re-added analytics1055 among the hdfs/yarn worker after maintenance [analytics]
14:07 <elukey> restart java daemons on druid100[456] for jvm security updates [analytics]
09:07 <elukey> restart all jvm daemons on druid100[123] for security updates [analytics]
09:07 <elukey> restart pageview-druid-hourly-wf-2017-8-30-7 in Hue after druid1001 daemons restart [analytics]
2017-08-29 §
19:36 <ottomata> restarting all kafka brokers and mirror maker processes to apply https://gerrit.wikimedia.org/r/#/c/374610/ [analytics]