|
2026-11-17
ยง
|
| 22:12 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 22:12 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 22:03 |
<cdanis@cumin1004> |
END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit1003 |
[production] |
| 22:00 |
<cdanis@cumin1004> |
START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit1003 |
[production] |
| 22:00 |
<cdanis@cumin1004> |
END (ERROR) - Cookbook sre.gerrit.restart-gerrit (exit_code=97) Restarting Gerrit on gerrit2003 |
[production] |
| 21:58 |
<cdanis@cumin1004> |
START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2003 |
[production] |
| 21:58 |
<cdanis@cumin1004> |
END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit2002 |
[production] |
| 21:57 |
<cdanis@cumin1004> |
START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2002 |
[production] |
| 21:53 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply |
[production] |
| 21:42 |
<bd808@deploy2003> |
Finished scap sync-world: Backport for [[gerrit:1367522|VisualEditor: add image for Suggestion Mode welcome dialog (T442024)]] (duration: 11m 05s) |
[production] |
| 21:35 |
<bd808@deploy2003> |
caro, bd808: Continuing with deployment |
[production] |
| 21:33 |
<bd808@deploy2003> |
caro, bd808: Backport for [[gerrit:1367522|VisualEditor: add image for Suggestion Mode welcome dialog (T442024)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:31 |
<bd808@deploy2003> |
Started scap sync-world: Backport for [[gerrit:1367522|VisualEditor: add image for Suggestion Mode welcome dialog (T442024)]] |
[production] |
| 20:57 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:48 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:47 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:47 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:41 |
<thcipriani@deploy2003> |
rebuilt and synchronized wikiversions files: group0 to 1.48.0-wmf.5 refs T442223 |
[production] |
| 20:41 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:40 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:36 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:35 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:33 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:32 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:31 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:30 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:30 |
<gmodena@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:24 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 20:24 |
<btullis@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on dbstore1010.eqiad.wmnet with reason: Restoring analytics replica instances |
[production] |
| 20:20 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply |
[production] |
| 20:18 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply |
[production] |
| 20:18 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply |
[production] |
| 20:12 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply |
[production] |
| 20:12 |
<lerickson@deploy2003> |
helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply |
[production] |
| 18:58 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply |
[production] |
| 18:57 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply |
[production] |
| 18:53 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply |
[production] |
| 18:52 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply |
[production] |
| 18:37 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 18:37 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 18:28 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply |
[production] |
| 18:23 |
<lerickson@deploy2003> |
helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply |
[production] |
| 16:16 |
<Amir1> |
root@thanos-fe1004:~# swift delete elasticsearch-snapshot (T309648) |
[production] |
| 16:12 |
<ladsgroup@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 16:12 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1252 (T441633)', diff saved to https://phabricator.wikimedia.org/P97486 and previous config saved to /var/cache/conftool/dbconfig/20261117-161208-ladsgroup.json |
[production] |
| 16:02 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P97485 and previous config saved to /var/cache/conftool/dbconfig/20261117-160206-ladsgroup.json |
[production] |
| 15:56 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply |
[production] |
| 15:55 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply |
[production] |
| 15:52 |
<ladsgroup@cumin1004> |
dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P97484 and previous config saved to /var/cache/conftool/dbconfig/20261117-155204-ladsgroup.json |
[production] |
| 15:50 |
<atsuko@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply |
[production] |