501-550 of 10000 results (99ms)
2025-04-09 ยง
14:29 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cirrussearch2088.codfw.wmnet with OS bullseye [production]
14:28 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1135084|Move to new async Parsoid fragment provision (T373253 T388546)]], [[gerrit:1135410|Switch out various old PHP aliases to the current class names]] [production]
14:28 <jforrester@deploy1003> sync-world aborted: Backport for [[gerrit:1135084|Move to new async Parsoid fragment provision (T373253 T388546)]], [[gerrit:1135410|Switch out various old PHP aliases to the current class names]] (duration: 08m 48s) [production]
14:19 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1135084|Move to new async Parsoid fragment provision (T373253 T388546)]], [[gerrit:1135410|Switch out various old PHP aliases to the current class names]] [production]
14:18 <jforrester@deploy1003> sync-world aborted: Backport for [[gerrit:1135084|Move to new async Parsoid fragment provision (T373253 T388546)]], [[gerrit:1135410|Switch out various old PHP aliases to the current class names]] (duration: 07m 47s) [production]
14:11 <jforrester@deploy1003> Started scap sync-world: Backport for [[gerrit:1135084|Move to new async Parsoid fragment provision (T373253 T388546)]], [[gerrit:1135410|Switch out various old PHP aliases to the current class names]] [production]
14:09 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:09 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:08 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:08 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:08 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:07 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:07 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:07 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:05 <jforrester@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
14:04 <jforrester@deploy1003> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
14:04 <jforrester@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:04 <jforrester@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:03 <jforrester@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:03 <jforrester@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
13:38 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch2088 [production]
13:38 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch2088 [production]
13:38 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch2088.codfw.wmnet with OS bullseye [production]
13:23 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mwdebug1002.eqiad.wmnet with OS bullseye [production]
13:23 <samtar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1135035|madwiktionary: add logo, icon, wordmark and tagline (T391318)]], [[gerrit:1135036|arywiki: enable wgMinervaEnableSiteNotice]] (duration: 16m 14s) [production]
13:17 <samtar@deploy1003> samtar, anzx: Continuing with sync [production]
13:15 <samtar@deploy1003> samtar, anzx: Backport for [[gerrit:1135035|madwiktionary: add logo, icon, wordmark and tagline (T391318)]], [[gerrit:1135036|arywiki: enable wgMinervaEnableSiteNotice]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:07 <samtar@deploy1003> Started scap sync-world: Backport for [[gerrit:1135035|madwiktionary: add logo, icon, wordmark and tagline (T391318)]], [[gerrit:1135036|arywiki: enable wgMinervaEnableSiteNotice]] [production]
13:00 <awight> special window completed [production]
12:47 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mwdebug1002.eqiad.wmnet with reason: host reimage [production]
12:43 <jiji@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on mwdebug1002.eqiad.wmnet with reason: host reimage [production]
12:27 <jiji@cumin1002> START - Cookbook sre.hosts.reimage for host mwdebug1002.eqiad.wmnet with OS bullseye [production]
12:10 <effie> mwdebug1002 has been depooled and removed from scap dsh [production]
12:09 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2052.codfw.wmnet [production]
12:09 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1052.eqiad.wmnet [production]
12:06 <effie> prepping mwdebug1002 for reimage [production]
12:03 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2052.codfw.wmnet [production]
12:03 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1052.eqiad.wmnet [production]
11:41 <mvolz@deploy1003> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
11:41 <mvolz@deploy1003> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
11:38 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:37 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:32 <mvolz@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
11:30 <mvolz@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
11:29 <mvolz@deploy1003> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
11:28 <mvolz@deploy1003> helmfile [staging] START helmfile.d/services/citoid: apply [production]
11:22 <hnowlan@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1407.eqiad.wmnet [production]
11:22 <hnowlan@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:22 <hnowlan@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mw1407.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - hnowlan@cumin1002" [production]
11:21 <hnowlan@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mw1407.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - hnowlan@cumin1002" [production]