|
2026-11-05
§
|
| 02:01 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97332 and previous config saved to /var/cache/conftool/dbconfig/20261105-020155-ladsgroup.json |
[production] |
| 02:01 |
<mwpresync@deploy2003> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 02:01 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1025.eqiad.wmnet |
[production] |
| 01:51 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97331 and previous config saved to /var/cache/conftool/dbconfig/20261105-015153-ladsgroup.json |
[production] |
| 01:31 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1025.eqiad.wmnet |
[production] |
| 01:31 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1024.eqiad.wmnet |
[production] |
| 01:31 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1024.eqiad.wmnet |
[production] |
| 01:22 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1024.eqiad.wmnet |
[production] |
| 00:52 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1024.eqiad.wmnet |
[production] |
| 00:52 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1023.eqiad.wmnet |
[production] |
| 00:52 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1023.eqiad.wmnet |
[production] |
| 00:51 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Depooling db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97330 and previous config saved to /var/cache/conftool/dbconfig/20261105-005129-ladsgroup.json |
[production] |
| 00:51 |
<ladsgroup@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2228.codfw.wmnet with reason: Maintenance |
[production] |
| 00:51 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97329 and previous config saved to /var/cache/conftool/dbconfig/20261105-005107-ladsgroup.json |
[production] |
| 00:41 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1023.eqiad.wmnet |
[production] |
| 00:41 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97328 and previous config saved to /var/cache/conftool/dbconfig/20261105-004105-ladsgroup.json |
[production] |
| 00:31 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97327 and previous config saved to /var/cache/conftool/dbconfig/20261105-003103-ladsgroup.json |
[production] |
| 00:21 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97326 and previous config saved to /var/cache/conftool/dbconfig/20261105-002101-ladsgroup.json |
[production] |
| 00:13 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Depooling db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97325 and previous config saved to /var/cache/conftool/dbconfig/20261105-001358-ladsgroup.json |
[production] |
| 00:13 |
<ladsgroup@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2222.codfw.wmnet with reason: Maintenance |
[production] |
| 00:13 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97324 and previous config saved to /var/cache/conftool/dbconfig/20261105-001336-ladsgroup.json |
[production] |
| 00:11 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1023.eqiad.wmnet |
[production] |
| 00:11 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1022.eqiad.wmnet |
[production] |
| 00:11 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1022.eqiad.wmnet |
[production] |
| 00:05 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1022.eqiad.wmnet |
[production] |
| 00:04 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet |
[production] |
| 00:04 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet |
[production] |
| 00:04 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet |
[production] |
| 00:03 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97323 and previous config saved to /var/cache/conftool/dbconfig/20261105-000334-ladsgroup.json |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [staging] START helmfile.d/services/shellbox-timeline: sync |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [staging] DONE helmfile.d/services/shellbox: sync |
[production] |
| 00:00 |
<root@deploy2003> |
helmfile [staging] START helmfile.d/services/shellbox: sync |
[production] |
|
2026-11-04
§
|
| 23:57 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1021.eqiad.wmnet |
[production] |
| 23:53 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97322 and previous config saved to /var/cache/conftool/dbconfig/20261104-235332-ladsgroup.json |
[production] |
| 23:43 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97321 and previous config saved to /var/cache/conftool/dbconfig/20261104-234330-ladsgroup.json |
[production] |
| 23:36 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Depooling db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97320 and previous config saved to /var/cache/conftool/dbconfig/20261104-233620-ladsgroup.json |
[production] |
| 23:36 |
<ladsgroup@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2221.codfw.wmnet with reason: Maintenance |
[production] |
| 23:36 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2220 (T441633)', diff saved to https://phabricator.wikimedia.org/P97319 and previous config saved to /var/cache/conftool/dbconfig/20261104-233559-ladsgroup.json |
[production] |
| 23:27 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1021.eqiad.wmnet |
[production] |
| 23:27 |
<btullis@cumin1004> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1020.eqiad.wmnet |
[production] |
| 23:27 |
<btullis@cumin1004> |
START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1020.eqiad.wmnet |
[production] |
| 23:25 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2220', diff saved to https://phabricator.wikimedia.org/P97318 and previous config saved to /var/cache/conftool/dbconfig/20261104-232557-ladsgroup.json |
[production] |
| 23:24 |
<jdlrobson@deploy2003> |
Finished scap sync-world: Backport for [[gerrit:1363460|UnsaveDialog: Don't render in place in bottom sheet mode (T443481)]] (1.48.0-wmf.3) (duration: 16m 34s) |
[production] |
| 23:16 |
<jdlrobson@deploy2003> |
jdlrobson: Continuing with deployment |
[production] |
| 23:15 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db2220', diff saved to https://phabricator.wikimedia.org/P97317 and previous config saved to /var/cache/conftool/dbconfig/20261104-231555-ladsgroup.json |
[production] |
| 23:15 |
<jdlrobson@deploy2003> |
jdlrobson: Backport for [[gerrit:1363460|UnsaveDialog: Don't render in place in bottom sheet mode (T443481)]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 23:08 |
<btullis@cumin1004> |
END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1020.eqiad.wmnet |
[production] |