|
2025-03-17
ยง
|
| 10:55 |
<ladsgroup@deploy2002> |
ladsgroup: Backport for [[gerrit:1128366|findBadBlobs: Allow for timestamp based search via --scan-to (T351953)]], [[gerrit:1128365|media: Make SvgHandler respect physicalWidth when building URL for thumb (T360589)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 10:50 |
<ladsgroup@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1128366|findBadBlobs: Allow for timestamp based search via --scan-to (T351953)]], [[gerrit:1128365|media: Make SvgHandler respect physicalWidth when building URL for thumb (T360589)]] |
[production] |
| 10:43 |
<jynus> |
restarting dbprov2005 T389052 |
[production] |
| 10:38 |
<vgutierrez@cumin1002> |
START - Cookbook sre.hosts.reimage for host lvs3010.esams.wmnet with OS bookworm |
[production] |
| 10:37 |
<vgutierrez@cumin1002> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs3010.esams.wmnet with OS bookworm |
[production] |
| 10:21 |
<marostegui@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1128356|Revert "db-production.php: Disable writes on es6"]] (duration: 14m 41s) |
[production] |
| 10:21 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s1 |
[production] |
| 10:19 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s1 |
[production] |
| 10:18 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s2 |
[production] |
| 10:17 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s2 |
[production] |
| 10:17 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s3 |
[production] |
| 10:16 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s3 |
[production] |
| 10:15 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s4 |
[production] |
| 10:14 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s4 |
[production] |
| 10:14 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s5 |
[production] |
| 10:13 |
<marostegui@deploy2002> |
marostegui: Continuing with sync |
[production] |
| 10:12 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s5 |
[production] |
| 10:12 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s8 |
[production] |
| 10:11 |
<marostegui@deploy2002> |
marostegui: Backport for [[gerrit:1128356|Revert "db-production.php: Disable writes on es6"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 10:10 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s8 |
[production] |
| 10:10 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s7 |
[production] |
| 10:09 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s7 |
[production] |
| 10:09 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s6 |
[production] |
| 10:07 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s6 |
[production] |
| 10:07 |
<marostegui@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1128356|Revert "db-production.php: Disable writes on es6"]] |
[production] |
| 10:07 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section x1 |
[production] |
| 10:06 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section x1 |
[production] |
| 10:06 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section es7 |
[production] |
| 10:05 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section es7 |
[production] |
| 10:02 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section es6 |
[production] |
| 10:01 |
<marostegui@cumin1002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section es6 |
[production] |
| 10:00 |
<marostegui@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1128351|db-production.php: Disable writes on es6 (T388626)]] (duration: 23m 25s) |
[production] |
| 09:56 |
<vgutierrez@cumin1002> |
END (FAIL) - Cookbook sre.loadbalancer.upgrade (exit_code=1) upgradeing P{lvs4010.ulsfo.wmnet} and A:liberica |
[production] |
| 09:55 |
<vgutierrez@cumin1002> |
START - Cookbook sre.loadbalancer.upgrade upgradeing P{lvs4010.ulsfo.wmnet} and A:liberica |
[production] |
| 09:50 |
<marostegui@deploy2002> |
marostegui: Continuing with sync |
[production] |
| 09:50 |
<marostegui@deploy2002> |
marostegui: Backport for [[gerrit:1128351|db-production.php: Disable writes on es6 (T388626)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 09:45 |
<vgutierrez@cumin1002> |
START - Cookbook sre.hosts.reimage for host lvs3010.esams.wmnet with OS bookworm |
[production] |
| 09:37 |
<marostegui@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1128351|db-production.php: Disable writes on es6 (T388626)]] |
[production] |
| 09:25 |
<moritzm> |
installing intel-microcode security updates |
[production] |
| 09:19 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1002.eqiad.wmnet |
[production] |
| 09:14 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host sretest1002.eqiad.wmnet |
[production] |
| 08:46 |
<moritzm> |
freed 28G of disk space on maps1009 |
[production] |
| 08:30 |
<moritzm> |
updated bookworm installer image to Bookworm 12.10 T389034 |
[production] |
| 08:23 |
<elukey@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 08:23 |
<elukey@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop-jobqueue: sync |
[production] |
| 08:23 |
<elukey@deploy2002> |
helmfile [staging] DONE helmfile.d/services/changeprop: sync |
[production] |
| 08:23 |
<elukey@deploy2002> |
helmfile [staging] START helmfile.d/services/changeprop: sync |
[production] |
| 07:29 |
<marostegui@cumin2002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section x1 |
[production] |
| 07:28 |
<marostegui@cumin2002> |
START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section x1 |
[production] |
| 07:17 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section x1 |
[production] |