|
2019-05-07
§
|
| 11:23 |
<joal> |
Updating /wmf/data/raw/mediawiki_private/tables to be owned by analytics:analytics |
[analytics] |
| 11:19 |
<joal> |
Updating /wmf/data/raw/mediawiki/xmldumps to be owned by analytics:analytics |
[analytics] |
| 11:19 |
<joal> |
Updating /wmf/data/raw/mediawiki/project_namespace_map to be owned by analytics:analytics |
[analytics] |
| 11:19 |
<joal> |
Updating /wmf/data/raw/mediawiki/tables to be owned by analytics:analytics |
[analytics] |
| 09:38 |
<elukey> |
kill clickstream-coord, chown /wmf/data/archive/clickstream to analytics:analytics, restart the job with the analytics user override |
[analytics] |
| 09:24 |
<elukey> |
kill ores-revision-scores-public-coord via hue (not used anymore) |
[analytics] |
| 07:46 |
<elukey> |
temporary override of oozie/util/druid/load/workflow.xml in HDFS's refinery to allow the analytics user to push data to druid from oozie |
[analytics] |
|
2019-05-06
§
|
| 14:22 |
<elukey> |
kill apis-coord and relaunch it with user analytics |
[analytics] |
| 13:51 |
<elukey> |
kill mediacounts-load-coor, chown analytics:analytics /wmf/data/wmf/mediacounts, restart coordinator with user 'analytics' |
[analytics] |
| 12:52 |
<elukey> |
kill interlanguage-coord, chown analytics:analytics /wmf/data/wmf/interlanguage, restart coordinator with user 'analytics' |
[analytics] |
| 12:15 |
<elukey> |
kill browser-general-coor, chown analytics:analytics /wmf/data/wmf/browser, restart coordinator with user 'analytics' |
[analytics] |
| 09:32 |
<joal> |
manually touching success files to start banner_activity-druid-monthly-coord between 2018-06-01/2018-12-31 |
[analytics] |
| 09:28 |
<joal> |
Launch new banner_activity-druid-monthly-coord between 2018-06-01/2018-12-31 to cover for timedout past actions |
[analytics] |
| 09:13 |
<elukey> |
kill banner impression coordinators, chown /wmf/data/wmf/banner_impressions to analyits:analytics and start coordinators again |
[analytics] |
| 07:42 |
<elukey> |
chown -R /wmf/data/wmf/aqs/* to analytics:analytics (was: analytics:hdfs) |
[analytics] |
|
2019-05-01
§
|
| 20:02 |
<ottomata> |
sudo systemctl stop refinery-sqoop-mediawiki-production |
[analytics] |
| 19:58 |
<ottomata> |
sudo systemctl disable refinery-sqoop-mediawiki-production |
[analytics] |
| 18:25 |
<joal> |
restarted oozie jobs mediawiki-history-denormalize-coord, mediawiki-history-check_denormalize-coord and mediawiki-history-reduced-coord |
[analytics] |
| 18:22 |
<joal> |
Confirming that sqoop-private (cu_changes) will run automatically tonight (2nd of the month at 00:00) - nothing needed |
[analytics] |
| 18:08 |
<joal> |
Manually killed sqoop-production (comment and actor) to have it done after the current manual labs run |
[analytics] |
| 17:59 |
<joal> |
Starting a manual run of sqoop |
[analytics] |
| 17:55 |
<joal> |
deploying refinery onto HDFS |
[analytics] |
| 17:40 |
<joal> |
deploy refinery using scap after failed attemp |
[analytics] |
| 17:37 |
<joal> |
Recreate wmf.mediawiki_history (+page and user) and wmf.mediawiki_history_archive (with old data) |
[analytics] |
| 17:12 |
<joal> |
Moving exisiting mediawiki-history to /wmf/data/wmf/mediawiki/archive folder |
[analytics] |
| 17:08 |
<joal> |
Killing oozie jobs for new deploy: mediawiki-history-denormalize-coord, mediawiki-history-check_denormalize-coord, mediawiki-history-reduced-coord |
[analytics] |
| 17:02 |
<joal> |
Deploying refinery using scap |
[analytics] |
| 16:48 |
<joal> |
Kill oozie mediawiki-history-druid-coord for true (replaced by edit_hourly job) |
[analytics] |
| 16:08 |
<joal> |
refinery-source v0.0.88 released on archiva |
[analytics] |