2025-04-01
§
|
20:29 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
20:27 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
20:21 |
<taavi@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] (duration: 14m 18s) |
[production] |
20:20 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
20:14 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
20:14 |
<taavi@deploy1003> |
superpes, taavi: Continuing with sync |
[production] |
20:13 |
<taavi@deploy1003> |
superpes, taavi: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
20:11 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2006.codfw.wmnet with reason: host reimage |
[production] |
20:07 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-fe2016.codfw.wmnet with reason: host reimage |
[production] |
20:07 |
<taavi@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132196|[plwiki] Allow bureaucrats to remove users from sysop usergroup (T389829)]], [[gerrit:1133164|Close pihwiki (T390732)]] |
[production] |
20:04 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-fe2015.codfw.wmnet with reason: host reimage |
[production] |
20:01 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2007.codfw.wmnet with reason: host reimage |
[production] |
19:58 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe2005.codfw.wmnet with reason: host reimage |
[production] |
19:56 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on ms-fe2016.codfw.wmnet with reason: host reimage |
[production] |
19:56 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2007.codfw.wmnet with reason: host reimage |
[production] |
19:55 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on ms-fe2015.codfw.wmnet with reason: host reimage |
[production] |
19:54 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2006.codfw.wmnet with reason: host reimage |
[production] |
19:54 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe2005.codfw.wmnet with reason: host reimage |
[production] |
19:41 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host apus-fe2003.codfw.wmnet with OS bookworm |
[production] |
19:41 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host ms-fe2016.codfw.wmnet with OS bullseye |
[production] |
19:40 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host thanos-fe2007.codfw.wmnet with OS bullseye |
[production] |
19:40 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host ms-fe2015.codfw.wmnet with OS bullseye |
[production] |
19:39 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host thanos-fe2006.codfw.wmnet with OS bullseye |
[production] |
19:39 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host thanos-fe2005.codfw.wmnet with OS bullseye |
[production] |
19:38 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['apus-fe2003'] |
[production] |
19:38 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ms-fe2016'] |
[production] |
19:38 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ms-fe2015'] |
[production] |
19:38 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2007'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2007'] |
[production] |
19:37 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2006'] |
[production] |
19:37 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['thanos-fe2005'] |
[production] |
19:37 |
<jhancock@cumin2002> |
END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['thanos-fe2007'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe2015'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe2016'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['apus-fe2003'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2006'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2007'] |
[production] |
19:37 |
<jhancock@cumin2002> |
START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe2005'] |
[production] |
19:36 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:35 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host apus-fe2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:35 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:35 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2016.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:35 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-fe2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:35 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-fe2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:33 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host thanos-fe2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:32 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host apus-fe2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:32 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-fe2016.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:31 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ms-fe2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:31 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host thanos-fe2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
19:31 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host thanos-fe2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |