751-800 of 1809 results (14ms)
2018-01-11 §
13:23 <joal> Killing banner-streaming job to have it auto-restarted from cron [analytics]
11:45 <elukey> re-run webrequest-load-wf-text-2018-1-11-8 (failed due to reboots) [analytics]
11:39 <joal> rerun mediacounts-load-wf-2018-1-11-8 [analytics]
10:48 <joal> Restarting banner-streaming job after hadoop nodes reboot [analytics]
10:01 <elukey> reboot analytics1059-61 for kernel updates [analytics]
09:34 <elukey> reboot analytics1055->1058 for kernel updates [analytics]
09:04 <elukey> reboot analytics1051->1054 for kernel updates [analytics]
2018-01-10 §
16:56 <elukey> reboot analytics1048->50 for kernel updates [analytics]
16:23 <ottomata> restarting kafka jumbo brokers to apply java.security certpath restrictions [analytics]
11:51 <elukey> re-run webrequest-load-wf-upload-2018-1-10-10 (failed due to reboots) [analytics]
11:27 <elukey> re-run webrequest-load-wf-text-2018-1-10-10 (failed due to reboots) [analytics]
11:26 <elukey> reboot analytics1044->47 for kernel updates [analytics]
11:03 <elukey> reboot analytics1040->43 for kernel updates [analytics]
2018-01-09 §
16:53 <joal> Rerun pageview-druid-hourly-wf-2018-1-9-13 [analytics]
15:33 <elukey> stop mysql on dbstore1002 as prep step for shutdown (stop all slaves, mysql stop) [analytics]
15:10 <elukey> reboot analytics1028 (hadoop worker and hdfs journal node) for kernel updates [analytics]
15:00 <elukey> reboot kafka-jumbo1006 for kernel updates [analytics]
14:41 <elukey> reboot kafka-jumbo1005 for kernel updates [analytics]
14:33 <elukey> reboot kafka1023 for kernel updates [analytics]
14:04 <elukey> reboot kafka1022 for kernel updates [analytics]
13:51 <elukey> reboot kafka-jumbo1003 for kernel updates [analytics]
10:08 <elukey> reboot kafka-jumbo1002 for kernel updates [analytics]
09:35 <elukey> reboot kafka1014 for kernel updates [analytics]
2018-01-08 §
19:07 <milimetric> Deployed refinery and synced to hdfs [analytics]
15:23 <elukey> reboot kafka1013 for kernel updates [analytics]
13:40 <elukey> reboot analytics10[36-39] for kernel updates [analytics]
12:59 <elukey> reboot kafka1012 for kernel updates [analytics]
12:43 <joal> Deploy AQS from tin [analytics]
12:36 <fdans> Deploying AQS [analytics]
12:33 <joal> Update fake-data in cassandra adiing top-by-country needed row [analytics]
11:07 <elukey> re-run webrequest-load-wf-text-2018-1-8-8 (failed after some reboots due to kernel updates) [analytics]
10:07 <elukey> drain + reboot analytics1029,1031->1034 for kernel updates [analytics]
2018-01-07 §
09:01 <elukey> re-enabled puppet on db110[78] - eventlogging_sync restarted on db1108 (analytics-slave) [analytics]
2018-01-06 §
08:09 <elukey> re-enable eventlogging mysql consumers after database maintenance [analytics]
2018-01-05 §
13:18 <fdans> deploying AQS [analytics]
2018-01-04 §
19:54 <joal> Deploying refinery onto hadoop [analytics]
19:45 <joal> Deploy refinery using scap [analytics]
19:38 <joal> Deploy refinery-source using jenkins [analytics]
16:01 <ottomata> killing json_refine_eventlogging_analytics job that started yesterday and has not completed (has no executors running?) application_1512469367986_81514. I think the cluster is just too busy? mw-history job running... [analytics]
10:34 <elukey> re-run mediacounts-archive-wf-2018-01-03 [analytics]
2018-01-03 §
15:00 <ottomata> restarting kafka-jumbo brokers to enable tls version and cipher suite restrictions [analytics]
2018-01-02 §
11:13 <joal> Kill and restart cassandra loading oozie bundle to pick new pageview_top_bycountry job [analytics]
08:22 <elukey> restart druid coordinators to pick up new jvm settings (freeing up 6GB of used memory) [analytics]
2017-12-21 §
15:54 <joal> Start backfilling monthly pageview-by-country [analytics]
15:45 <joal> deploy refinery onto HDFSb [analytics]
15:38 <joal> Deploying refinery with Scap [analytics]
2017-12-20 §
15:40 <ottomata> removing some old webrequest data from hdfs [analytics]
14:56 <ottomata> dropping some old wmf.webrequest partitions and data [analytics]
2017-12-19 §
17:28 <elukey> re-enabled superset [analytics]
17:16 <joal> Initilizaing new cassandra keyspace for pageviews/top-by-country [analytics]