2019-11-05
§
|
21:04 |
<ottomata> |
re-enabling refine jobs after spark 2.4.4 upgrade |
[analytics] |
20:57 |
<joal> |
Starting denoramlize-check one month in advance to enforce a running job with new spark |
[analytics] |
20:37 |
<ottomata> |
roll restarting hadoop-yarn-nodemanagers to pick up spark 2.4.4 shuffle lib |
[analytics] |
20:21 |
<ottomata> |
install spark 2.4.4-bin-hadoop2.6-1 cluster wide using debdeploy - T222253 |
[analytics] |
20:18 |
<joal> |
Deploying refinery onto HDFS |
[analytics] |
20:12 |
<ottomata> |
stopped refine jobs for Spark 2.4 upgrade - T222253 |
[analytics] |
20:09 |
<joal> |
Deploying refinery using scap with missing patch |
[analytics] |
20:00 |
<joal> |
Deploying refinery using scap |
[analytics] |
18:49 |
<joal> |
Make Jenkins release refinery-source v0.0.105 to archiva |
[analytics] |
17:12 |
<ottomata> |
2019-11-05T17:11:50.239 INFO HDFSCleaner Deleted 872360 files and directories in tmp |
[analytics] |
17:01 |
<ottomata> |
first run of HDFSCleaner on /tmp, should delete files older than 31 days |
[analytics] |
11:00 |
<fdans> |
testing load of top metric from mediarequests with corrected quotemarks escaping |
[analytics] |
2019-10-31
§
|
19:45 |
<fdans> |
(actually no, no need) |
[analytics] |
19:43 |
<fdans> |
(changing jar version first) |
[analytics] |
19:43 |
<fdans> |
restarting mediawiki-history-wikitext |
[analytics] |
19:42 |
<fdans> |
refinery deployment complete |
[analytics] |
19:17 |
<fdans> |
updating jar symlinks to 0.0.104 |
[analytics] |
17:59 |
<fdans> |
deploying refinery |
[analytics] |
17:49 |
<fdans> |
deplying refinery-source 0.0.104 |
[analytics] |
16:36 |
<elukey> |
restart oozie and hive-server2 on an-coord1001 to pick up new new TLS mapreduce settings |
[analytics] |
15:31 |
<joal> |
Rerun webrequest jobs for hour 2019-10-31T14:00 after failure |
[analytics] |
14:53 |
<elukey> |
enabled encrypted shuffle option in all Hadoop Analytics Yarn Node Managers |
[analytics] |
10:17 |
<elukey> |
deploy TLS certificates for MapReduce Shufflers on Hadoop worker nodes (no-op change, no yarn-site config) |
[analytics] |