1-50 of 10000 results (108ms)
2025-12-03 ยง
17:46 <sukhe@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
17:46 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
17:46 <sukhe@cumin1003> END (FAIL) - Cookbook sre.network.cf (exit_code=1) [production]
17:46 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
17:46 <sukhe@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
17:46 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
17:46 <sukhe@cumin1003> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
17:45 <sukhe@cumin1003> START - Cookbook sre.network.cf [production]
17:40 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudvirtlocal1001.eqiad.wmnet with OS trixie [production]
17:40 <sbisson@deploy2002> Finished scap sync-world: Backport for [[gerrit:1214580|CX3 Build 1.0.0+20251126 (T384485)]] (duration: 09m 07s) [production]
17:36 <sbisson@deploy2002> sbisson: Continuing with sync [production]
17:34 <sbisson@deploy2002> sbisson: Backport for [[gerrit:1214580|CX3 Build 1.0.0+20251126 (T384485)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:31 <sbisson@deploy2002> Started scap sync-world: Backport for [[gerrit:1214580|CX3 Build 1.0.0+20251126 (T384485)]] [production]
17:11 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db1229.eqiad.wmnet with reason: crashed [production]
17:07 <jynus@cumin1003> dbctl commit (dc=all): 'Depooldb1229', diff saved to https://phabricator.wikimedia.org/P86383 and previous config saved to /var/cache/conftool/dbconfig/20251203-170745-jynus.json [production]
17:02 <bd808@deploy2002> Finished scap sync-world: Backport for [[gerrit:1214529|robots.php: Fix undefined index 'enabled' on Wikinews and closed wikis (T411632)]] (duration: 07m 40s) [production]
16:58 <bd808@deploy2002> bd808, krinkle: Continuing with sync [production]
16:57 <bd808@deploy2002> bd808, krinkle: Backport for [[gerrit:1214529|robots.php: Fix undefined index 'enabled' on Wikinews and closed wikis (T411632)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:54 <bd808@deploy2002> Started scap sync-world: Backport for [[gerrit:1214529|robots.php: Fix undefined index 'enabled' on Wikinews and closed wikis (T411632)]] [production]
16:49 <bd808@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211191|officewiki: Put indicators in title with vector-2022]], [[gerrit:1211192|officewiki: Enable page protection indicators]] (duration: 07m 47s) [production]
16:45 <bd808@deploy2002> bd808: Continuing with sync [production]
16:44 <bd808@deploy2002> bd808: Backport for [[gerrit:1211191|officewiki: Put indicators in title with vector-2022]], [[gerrit:1211192|officewiki: Enable page protection indicators]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:41 <bd808@deploy2002> Started scap sync-world: Backport for [[gerrit:1211191|officewiki: Put indicators in title with vector-2022]], [[gerrit:1211192|officewiki: Enable page protection indicators]] [production]
16:15 <topranks> disabling unused former cloudcephosd hosts on cloud switches T410989 [production]
16:13 <dancy@deploy2002> Installation of scap version "4.229.0" completed for 164 hosts [production]
16:09 <dancy@deploy2002> Installing scap version "4.229.0" for 164 host(s) [production]
15:32 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host conf2006.codfw.wmnet [production]
15:28 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:27 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
15:27 <jforrester@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:27 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211664|Clean up db groups config (T411088)]] (duration: 07m 48s) [production]
15:27 <jforrester@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:26 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host conf2006.codfw.wmnet [production]
15:26 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
15:26 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
15:23 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
15:23 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:22 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
15:21 <jforrester@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:21 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1211664|Clean up db groups config (T411088)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:21 <jforrester@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:20 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
15:20 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
15:19 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1211664|Clean up db groups config (T411088)]] [production]
15:16 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: sync [production]
15:16 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: sync [production]
15:15 <jforrester@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:15 <jforrester@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:14 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:13 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]