651-700 of 10000 results (118ms)
2025-04-01 §
20:29 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:27 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:21 <taavi@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] (duration: 14m 18s) [production]
20:20 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:14 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:14 <taavi@deploy1003> superpes, taavi: Continuing with sync [production]
20:13 <taavi@deploy1003> superpes, taavi: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:11 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2006.codfw.wmnet with reason: host reimage [production]
20:07 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-fe2016.codfw.wmnet with reason: host reimage [production]
20:07 <taavi@deploy1003> Started scap sync-world: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] [production]
20:04 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-fe2015.codfw.wmnet with reason: host reimage [production]
20:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2007.codfw.wmnet with reason: host reimage [production]
19:58 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2005.codfw.wmnet with reason: host reimage [production]
19:56 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-fe2016.codfw.wmnet with reason: host reimage [production]
19:56 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2007.codfw.wmnet with reason: host reimage [production]
19:55 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-fe2015.codfw.wmnet with reason: host reimage [production]
19:54 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2006.codfw.wmnet with reason: host reimage [production]
19:54 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2005.codfw.wmnet with reason: host reimage [production]
19:41 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host apus-fe2003.codfw.wmnet with OS bookworm [production]
19:41 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host ms-fe2016.codfw.wmnet with OS bullseye [production]
19:40 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host thanos-fe2007.codfw.wmnet with OS bullseye [production]
19:40 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host ms-fe2015.codfw.wmnet with OS bullseye [production]
19:39 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host thanos-fe2006.codfw.wmnet with OS bullseye [production]
19:39 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host thanos-fe2005.codfw.wmnet with OS bullseye [production]
19:38 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['apus-fe2003'] [production]
19:38 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ms-fe2016'] [production]
19:38 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ms-fe2015'] [production]
19:38 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2007'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2007'] [production]
19:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2006'] [production]
19:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2005'] [production]
19:37 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['thanos-fe2007'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe2015'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe2016'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['apus-fe2003'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2006'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2007'] [production]
19:37 <jhancock@cumin2002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2005'] [production]
19:36 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:35 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host apus-fe2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:35 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:35 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2016.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:35 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:35 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:33 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host thanos-fe2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:32 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host apus-fe2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:32 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-fe2016.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:31 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ms-fe2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:31 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host thanos-fe2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:31 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host thanos-fe2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]