1-50 of 10000 results (103ms)
2026-03-23 ยง
18:36 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on hcaptcha-proxy4002.wikimedia.org with reason: depooled host (soon to be decomed) [production]
18:35 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on hcaptcha-proxy4001.wikimedia.org with reason: depooled host (soon to be decomed) [production]
18:10 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp1115.eqiad.wmnet with OS trixie [production]
18:10 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp1115.eqiad.wmnet with OS trixie [production]
18:05 <eevans@cumin1003> START - Cookbook sre.cassandra.roll-reboot rolling reboot on P{aqs[1011,1014,1016-1022]*} and P{P:Cassandra} [production]
17:54 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp1115.eqiad.wmnet with OS trixie [production]
17:54 <brett@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp1115.eqiad.wmnet with OS trixie [production]
17:53 <eevans@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-reboot (exit_code=0) rolling reboot on A:restbase-eqiad [production]
17:49 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1259136|EventStreamConfig: Document not adding performer attributes to SI interaction v2 stream (T418740)]] (duration: 06m 28s) [production]
17:45 <dreamyjazz@deploy2002> kharlan, dreamyjazz: Continuing with sync [production]
17:45 <dreamyjazz@deploy2002> kharlan, dreamyjazz: Backport for [[gerrit:1259136|EventStreamConfig: Document not adding performer attributes to SI interaction v2 stream (T418740)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
17:43 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1259136|EventStreamConfig: Document not adding performer attributes to SI interaction v2 stream (T418740)]] [production]
17:35 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
17:34 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp1101.eqiad.wmnet with OS trixie [production]
17:34 <cdobbins@cumin2002> conftool action : set/pooled=no; selector: name=cp1101.eqiad.wmnet [reason: trixie reimaging] [production]
17:33 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
17:31 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp1100.eqiad.wmnet with OS trixie [production]
17:30 <cdobbins@cumin2002> conftool action : set/pooled=no; selector: name=cp1100.eqiad.wmnet [reason: trixie reimaging] [production]
17:27 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
17:26 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
17:24 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
17:23 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
17:22 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
17:21 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aux-k8s-worker1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
17:21 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
17:20 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp1115.eqiad.wmnet with OS trixie [production]
17:20 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
17:18 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
17:17 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
17:17 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
17:16 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host aux-k8s-worker1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
17:13 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
17:13 <bd808@deploy2002> Finished deploy [releng/jenkins-deploy@f47af21] (releasing): jobs: Use TZ=UTC in branchMWSingleVersion.groovy trigger (T404399) (duration: 01m 36s) [production]
17:12 <bd808@deploy2002> Started deploy [releng/jenkins-deploy@f47af21] (releasing): jobs: Use TZ=UTC in branchMWSingleVersion.groovy trigger (T404399) [production]
17:12 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
17:09 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
17:08 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
17:08 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
17:08 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
17:07 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
17:06 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
17:04 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
17:04 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
17:03 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
17:02 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aux-k8s-worker1008.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
17:00 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-ctrl1001.eqiad.wmnet [production]
16:56 <elukey@cumin1003> START - Cookbook sre.hosts.provision for host aux-k8s-worker1008.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:56 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 14 hosts [production]
16:55 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aux-k8s-worker1007.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:55 <sukhe@cumin1003> START - Cookbook sre.hosts.remove-downtime for 14 hosts [production]