|
2026-07-14
ยง
|
| 21:29 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7014.magru.wmnet |
[production] |
| 21:23 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7006.magru.wmnet |
[production] |
| 21:13 |
<dzahn@cumin2002> |
DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:15:00 on gerrit.wikimedia.org with reason: reboot |
[production] |
| 21:11 |
<mutante> |
gerrit2003 (gerrit.wikimedia.org) - reboot for maintenance |
[production] |
| 21:11 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit2003.wikimedia.org with reason: reboot |
[production] |
| 20:56 |
<arlolra@deploy2003> |
helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply |
[production] |
| 20:56 |
<arlolra@deploy2003> |
helmfile [codfw] START helmfile.d/services/mw-parsoid: apply |
[production] |
| 20:56 |
<arlolra@deploy2003> |
helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply |
[production] |
| 20:55 |
<arlolra@deploy2003> |
helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply |
[production] |
| 20:48 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7013.magru.wmnet |
[production] |
| 20:42 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7005.magru.wmnet |
[production] |
| 20:41 |
<aokoth@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host phab1005.eqiad.wmnet with OS trixie |
[production] |
| 20:28 |
<sbassett@deploy2003> |
Finished scap sync-world: Backport for [[gerrit:1310625|Add logging for various re-authentication methods (T432042)]] (duration: 06m 47s) |
[production] |
| 20:24 |
<sbassett@deploy2003> |
sbassett: Continuing with deployment |
[production] |
| 20:23 |
<sbassett@deploy2003> |
sbassett: Backport for [[gerrit:1310625|Add logging for various re-authentication methods (T432042)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:23 |
<aokoth@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on phab1005.eqiad.wmnet with reason: host reimage |
[production] |
| 20:21 |
<sbassett@deploy2003> |
Started scap sync-world: Backport for [[gerrit:1310625|Add logging for various re-authentication methods (T432042)]] |
[production] |
| 20:20 |
<aokoth@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on phab1005.eqiad.wmnet with reason: host reimage |
[production] |
| 20:11 |
<jhuneidi@deploy2003> |
Finished scap sync-world: Backport for [[gerrit:1309865|thwiki: Change to Wikipedia 25 logo (T431094)]] (duration: 07m 42s) |
[production] |
| 20:07 |
<jhuneidi@deploy2003> |
jhuneidi, priyankar22: Continuing with deployment |
[production] |
| 20:06 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7012.magru.wmnet |
[production] |
| 20:06 |
<jhuneidi@deploy2003> |
jhuneidi, priyankar22: Backport for [[gerrit:1309865|thwiki: Change to Wikipedia 25 logo (T431094)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:04 |
<jhuneidi@deploy2003> |
Started scap sync-world: Backport for [[gerrit:1309865|thwiki: Change to Wikipedia 25 logo (T431094)]] |
[production] |
| 20:02 |
<aokoth@cumin1003> |
START - Cookbook sre.hosts.reimage for host phab1005.eqiad.wmnet with OS trixie |
[production] |
| 20:00 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7004.magru.wmnet |
[production] |
| 20:00 |
<aokoth@cumin1003> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1004.eqiad.wmnet |
[production] |
| 19:57 |
<aokoth@cumin1003> |
START - Cookbook sre.hosts.reboot-single for host vrts1004.eqiad.wmnet |
[production] |
| 19:24 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7011.magru.wmnet |
[production] |
| 19:19 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7003.magru.wmnet |
[production] |
| 19:11 |
<jforrester@deploy2003> |
Finished scap sync-world: Backport for [[gerrit:1310634|wikifunctions: Define the virtual-wikifunctions-usage table (T390557)]] (duration: 08m 33s) |
[production] |
| 19:07 |
<jforrester@deploy2003> |
jforrester: Continuing with deployment |
[production] |
| 19:04 |
<jforrester@deploy2003> |
jforrester: Backport for [[gerrit:1310634|wikifunctions: Define the virtual-wikifunctions-usage table (T390557)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 19:02 |
<jforrester@deploy2003> |
Started scap sync-world: Backport for [[gerrit:1310634|wikifunctions: Define the virtual-wikifunctions-usage table (T390557)]] |
[production] |
| 18:43 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7010.magru.wmnet |
[production] |
| 18:38 |
<mutante> |
rotating phabricator-gerrit bot token (its-phabricator) |
[production] |
| 18:18 |
<jhuneidi@deploy2003> |
rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.11 refs T430830 |
[production] |
| 17:44 |
<swfrench@deploy2003> |
Finished scap sync-world: Deployment to pick up new production image (duration: 31m 44s) |
[production] |
| 17:42 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7002.magru.wmnet |
[production] |
| 17:33 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7009.magru.wmnet |
[production] |
| 17:32 |
<swfrench@deploy2003> |
swfrench: Continuing with deployment |
[production] |
| 17:29 |
<swfrench@deploy2003> |
swfrench: Deployment to pick up new production image synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 17:17 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2035: repooling after rack b5 maintenance |
[production] |
| 17:16 |
<cmooney@cumin1003> |
START - Cookbook sre.mysql.pool pool es2035: repooling after rack b5 maintenance |
[production] |
| 17:16 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2188: repooling after rack b5 maintenance |
[production] |
| 17:12 |
<swfrench@deploy2003> |
Started scap sync-world: Deployment to pick up new production image |
[production] |
| 17:01 |
<sukhe@cumin1003> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7001.magru.wmnet |
[production] |
| 16:57 |
<swfrench-wmf> |
reprepro include php8.3_8.3.32-1+wmf12u2 into component/php83 for bookworm-wikimedia |
[production] |
| 16:50 |
<sukhe> |
pool cp2046 |
[production] |
| 16:47 |
<sukhe@puppetserver1001> |
conftool action : set/pooled=yes; selector: name=cp4039.ulsfo.wmnet |
[production] |
| 16:44 |
<sukhe> |
sudo cumin -b31 "A:cp" "run-puppet-agent" |
[production] |