2751-2800 of 4272 results (23ms)
2018-09-12 §
13:11 <ottomata> otto@deploy1001 Started deploy [eventlogging/analytics@5c6fab6]: Support loading plugins in eventlogging-processor - T203596 [analytics]
06:21 <elukey> re-run webrequest-load-wf-text-2018-9-12-4, failed due to sql exceptions/timeouts to the database [analytics]
2018-09-10 §
16:26 <ottomata> restarting eventlogging-processors to pick up blacklist of WebClientError schema for MySQL - T203814 [analytics]
12:49 <elukey> disable camus as prep step for analytics100[1-3] reboots [analytics]
07:54 <joal> Manually restarting mediawiki-reduced oozie with manual addition of missing parameter [analytics]
2018-09-07 §
18:18 <joal> Manually downoad namespaces for 2018-08 [analytics]
17:32 <joal> Manually rerun download-project-namespace-map on analytics1003 after cron's failure [analytics]
2018-09-06 §
13:03 <fdans> restarted virtualpageview_hourly coordinator [analytics]
2018-09-05 §
18:18 <ottomata> restarted eventlogging processors blacklisting CentralNoticeImpression - T203592 [analytics]
16:56 <ottomata> restarting eventlogging processors to blacklist CitationUsage - T191086 [analytics]
14:42 <elukey> deploying refinery (pageview whitelist and cron script change) [analytics]
13:40 <ottomata> reimaging thorium to debian stretch (this will cause an announced {stats,analytics}.wm.org downtime!) - T192641 [analytics]
13:21 <fdans> restarting webrequest load bundle, start time 11:00Z [analytics]
09:12 <elukey> re-run webrequest-druid-hourly-wf-2018-9-5-7 - failed due to rebooting druid1001 [analytics]
07:02 <elukey> restart oozie on analytics1003 to pick up new smtp settings [analytics]
06:37 <elukey> re-run webrequest-load-wf-misc-2018-9-5-2 and webrequest-load-wf-upload-2018-9-4-19 via Hue [analytics]
06:35 <elukey> upload new pageview whitelist to hdfs [analytics]
2018-09-04 §
19:05 <joal> Restart cassandra-hourly-wf-local_group_default_T_pageviews_per_project_v2-2018-9-4-14 [analytics]
16:37 <fdans> restarting webrequest-load bundle [analytics]
16:07 <fdans> beginning refinery deployment [analytics]
14:28 <fdans> deployed refinery source using jenkins [analytics]
2018-09-03 §
08:07 <joal> Delete /wmf/data/raw/mediawiki_private/tables/cu_changes/month=2018-05 folder and relaunch mediawiki-geoeditors-load-wf-2018-08 [analytics]
06:05 <elukey> re-run virtualpageview-hourly-wf-2018-9-2-1 via Hue (failed oozie job to inspect: 0082016-180705103628398-oozie-oozi-W) [analytics]
2018-08-31 §
14:31 <elukey> re-run webrequest-load-wf-upload-2018-8-31-11, failed due to hadoop workers reboots [analytics]
10:05 <elukey> re-run webrequest-load-wf-upload-2018-8-31-7, failed due to hadoop workers reboots [analytics]
09:15 <elukey> re-run webrequest-load-wf-upload-2018-8-31-[7,8], failed due to hadoop workers reboots [analytics]
07:26 <elukey> re-run webrequest-load-wf-text-2018-8-31-4, failed due to hadoop workers reboots [analytics]
06:20 <elukey> re-run webrequest-load-wf-text-2018-8-31-4, failed for hadoop workers reboots [analytics]
2018-08-30 §
15:59 <elukey> rerun of pageview-druid-hourly-wf-2018-8-30-13, hadoop worker reboots in progress [analytics]
15:23 <elukey> re-run webrequest-load-wf-upload-2018-8-30-13, failed due to hadoop worker reboots [analytics]
14:49 <elukey> re-run webrequest-load-wf-text-2018-8-30-12, failed due to worker nodes reboots [analytics]
2018-08-29 §
15:27 <joal> Deploy AQS with scap [analytics]
13:59 <ottomata> upgrading spark2 package with pyarrow dependency and default pyspark to python3 [analytics]
11:39 <joal> Restart mediwiki-history-reduced oozie job after deploy [analytics]
10:41 <elukey> nuked /srv/deployment/analytics/refinery on stat1005 after errors with archiva/git-fat (stat1005 is the canary) [analytics]
10:34 <joal> Deploying refinery onto HDFS [analytics]
08:53 <joal> Deploying refinery using scap [analytics]
08:30 <joal> Deploying refinery using jenkins [analytics]
2018-08-28 §
14:19 <joal> Restart Workflow pageview-druid-hourly-wf-2018-8-28-11 [analytics]
13:00 <joal> Restart mediawiki-history and mediawiki-history-druid jobs [analytics]
10:59 <joal> deploying refinery onto HDFS [analytics]
10:44 <joal> Deploying refinery from scap [analytics]
10:22 <joal> Refinery-source v0.0.71 deployed onto archiva [analytics]
08:14 <joal> Restart virtualpageview-hourly-wf-2018-8-27-21 [analytics]
2018-08-20 §
21:28 <fdans> restarting virtualpageview-hourly-coord [analytics]
21:21 <fdans> refinery deployment succeeded [analytics]
20:55 <fdans> deploying analytics refinery [analytics]
18:18 <ottomata> restaring eventlogging client side processes using librdkafka1 0.11.x - https://phabricator.wikimedia.org/T200769 [analytics]
2018-08-14 §
23:07 <fdans> starting deployment of refinery via scap [analytics]
19:35 <mforns> Finished deployment of refinery using scap and refinery-deploy-to-hdfs [analytics]