|
2026-04-12
§
|
| 20:34 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P90457 and previous config saved to /var/cache/conftool/dbconfig/20260412-203443-ladsgroup.json |
[production] |
| 20:24 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90456 and previous config saved to /var/cache/conftool/dbconfig/20260412-202435-ladsgroup.json |
[production] |
| 14:32 |
<cgoubert@dns2004> |
START - running authdns-update |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90452 and previous config saved to /var/cache/conftool/dbconfig/20260412-115148-ladsgroup.json |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1191.eqiad.wmnet with reason: Maintenance |
[production] |
| 11:51 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90451 and previous config saved to /var/cache/conftool/dbconfig/20260412-115124-ladsgroup.json |
[production] |
| 11:41 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P90450 and previous config saved to /var/cache/conftool/dbconfig/20260412-114116-ladsgroup.json |
[production] |
| 11:31 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P90449 and previous config saved to /var/cache/conftool/dbconfig/20260412-113108-ladsgroup.json |
[production] |
| 11:21 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90448 and previous config saved to /var/cache/conftool/dbconfig/20260412-112100-ladsgroup.json |
[production] |
| 07:06 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90447 and previous config saved to /var/cache/conftool/dbconfig/20260412-070649-ladsgroup.json |
[production] |
| 07:06 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2182.codfw.wmnet with reason: Maintenance |
[production] |
| 07:06 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90446 and previous config saved to /var/cache/conftool/dbconfig/20260412-070624-ladsgroup.json |
[production] |
| 06:56 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90445 and previous config saved to /var/cache/conftool/dbconfig/20260412-065616-ladsgroup.json |
[production] |
| 06:46 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90444 and previous config saved to /var/cache/conftool/dbconfig/20260412-064608-ladsgroup.json |
[production] |
| 06:36 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90443 and previous config saved to /var/cache/conftool/dbconfig/20260412-063600-ladsgroup.json |
[production] |
| 02:44 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1174 (T410589)', diff saved to https://phabricator.wikimedia.org/P90442 and previous config saved to /var/cache/conftool/dbconfig/20260412-024415-ladsgroup.json |
[production] |
| 02:44 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1174.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:07 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 06m 19s) |
[production] |
| 02:01 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-04-11
§
|
| 22:40 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 16735 |
[production] |
| 22:38 |
<cmooney@cumin1003> |
START - Cookbook sre.network.peering with action 'configure' for AS: 16735 |
[production] |
| 22:38 |
<cmooney@cumin1003> |
END (FAIL) - Cookbook sre.network.peering (exit_code=99) with action 'configure' for AS: 16735 |
[production] |
| 22:37 |
<cmooney@cumin1003> |
START - Cookbook sre.network.peering with action 'configure' for AS: 16735 |
[production] |
| 18:50 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90441 and previous config saved to /var/cache/conftool/dbconfig/20260411-185048-fceratto.json |
[production] |
| 18:40 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248', diff saved to https://phabricator.wikimedia.org/P90440 and previous config saved to /var/cache/conftool/dbconfig/20260411-184000-fceratto.json |
[production] |
| 18:29 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248', diff saved to https://phabricator.wikimedia.org/P90439 and previous config saved to /var/cache/conftool/dbconfig/20260411-182912-fceratto.json |
[production] |
| 18:18 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90438 and previous config saved to /var/cache/conftool/dbconfig/20260411-181823-fceratto.json |
[production] |
| 17:23 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db2168 (T410589)', diff saved to https://phabricator.wikimedia.org/P90437 and previous config saved to /var/cache/conftool/dbconfig/20260411-172321-ladsgroup.json |
[production] |
| 17:23 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2168.codfw.wmnet with reason: Maintenance |
[production] |
| 17:22 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410589)', diff saved to https://phabricator.wikimedia.org/P90436 and previous config saved to /var/cache/conftool/dbconfig/20260411-172257-ladsgroup.json |
[production] |
| 17:12 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90435 and previous config saved to /var/cache/conftool/dbconfig/20260411-171248-ladsgroup.json |
[production] |
| 17:02 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90434 and previous config saved to /var/cache/conftool/dbconfig/20260411-170240-ladsgroup.json |
[production] |
| 17:02 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Depooling db2248 (T419635)', diff saved to https://phabricator.wikimedia.org/P90433 and previous config saved to /var/cache/conftool/dbconfig/20260411-170233-fceratto.json |
[production] |
| 17:01 |
<fceratto@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2248.codfw.wmnet with reason: Maintenance |
[production] |
| 17:01 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247 (T419635)', diff saved to https://phabricator.wikimedia.org/P90432 and previous config saved to /var/cache/conftool/dbconfig/20260411-170138-fceratto.json |
[production] |
| 16:52 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2159 (T410589)', diff saved to https://phabricator.wikimedia.org/P90431 and previous config saved to /var/cache/conftool/dbconfig/20260411-165232-ladsgroup.json |
[production] |
| 16:50 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247', diff saved to https://phabricator.wikimedia.org/P90430 and previous config saved to /var/cache/conftool/dbconfig/20260411-165049-fceratto.json |
[production] |
| 16:40 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247', diff saved to https://phabricator.wikimedia.org/P90429 and previous config saved to /var/cache/conftool/dbconfig/20260411-164000-fceratto.json |
[production] |
| 16:29 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2247 (T419635)', diff saved to https://phabricator.wikimedia.org/P90428 and previous config saved to /var/cache/conftool/dbconfig/20260411-162912-fceratto.json |
[production] |
| 14:40 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Depooling db2247 (T419635)', diff saved to https://phabricator.wikimedia.org/P90427 and previous config saved to /var/cache/conftool/dbconfig/20260411-144002-fceratto.json |
[production] |
| 14:39 |
<fceratto@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2247.codfw.wmnet with reason: Maintenance |
[production] |
| 14:38 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2246 (T419635)', diff saved to https://phabricator.wikimedia.org/P90426 and previous config saved to /var/cache/conftool/dbconfig/20260411-143854-fceratto.json |
[production] |
| 14:28 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2246', diff saved to https://phabricator.wikimedia.org/P90425 and previous config saved to /var/cache/conftool/dbconfig/20260411-142805-fceratto.json |
[production] |
| 14:17 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2246', diff saved to https://phabricator.wikimedia.org/P90424 and previous config saved to /var/cache/conftool/dbconfig/20260411-141717-fceratto.json |
[production] |
| 14:06 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Repooling after maintenance db2246 (T419635)', diff saved to https://phabricator.wikimedia.org/P90423 and previous config saved to /var/cache/conftool/dbconfig/20260411-140628-fceratto.json |
[production] |
| 12:43 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1171.eqiad.wmnet with reason: Maintenance |
[production] |
| 12:42 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1170 (T410589)', diff saved to https://phabricator.wikimedia.org/P90422 and previous config saved to /var/cache/conftool/dbconfig/20260411-124244-ladsgroup.json |
[production] |
| 12:32 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1170', diff saved to https://phabricator.wikimedia.org/P90421 and previous config saved to /var/cache/conftool/dbconfig/20260411-123235-ladsgroup.json |
[production] |
| 12:22 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1170', diff saved to https://phabricator.wikimedia.org/P90420 and previous config saved to /var/cache/conftool/dbconfig/20260411-122226-ladsgroup.json |
[production] |
| 12:14 |
<fceratto@cumin2002> |
dbctl commit (dc=all): 'Depooling db2246 (T419635)', diff saved to https://phabricator.wikimedia.org/P90419 and previous config saved to /var/cache/conftool/dbconfig/20260411-121410-fceratto.json |
[production] |