451-500 of 10000 results (27ms)
2025-06-27 ยง
16:33 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:32 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2003.codfw.wmnet with reason: host reimage [production]
16:27 <ayounsi@cumin2002> START - Cookbook sre.hosts.reimage for host sretest2009.codfw.wmnet with OS bookworm [production]
16:27 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2003.codfw.wmnet with reason: host reimage [production]
16:11 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:09 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host sretest2003.codfw.wmnet with OS bookworm [production]
16:09 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:05 <stevemunene@cumin1003> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-conf1003.eqiad.wmnet [production]
16:05 <stevemunene@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:05 <stevemunene@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-conf1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1003" [production]
16:05 <stevemunene@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-conf1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1003" [production]
16:04 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:02 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cp2055.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
16:02 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
16:02 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
16:01 <stevemunene@cumin1003> START - Cookbook sre.dns.netbox [production]
16:01 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cp2055.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
16:00 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:00 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:58 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
15:57 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:57 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:56 <stevemunene@cumin1003> START - Cookbook sre.hosts.decommission for hosts an-conf1003.eqiad.wmnet [production]
15:55 <stevemunene@cumin1003> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-conf1002.eqiad.wmnet [production]
15:55 <stevemunene@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:55 <stevemunene@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-conf1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1003" [production]
15:55 <stevemunene@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: an-conf1002.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - stevemunene@cumin1003" [production]
15:51 <stevemunene@cumin1003> START - Cookbook sre.dns.netbox [production]
15:45 <stevemunene@cumin1003> START - Cookbook sre.hosts.decommission for hosts an-conf1002.eqiad.wmnet [production]
15:45 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:45 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:42 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:41 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:39 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:37 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:37 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:36 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:36 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2009.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
15:36 <dwisehaupt@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:36 <dwisehaupt@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: decommissioning of frack hosts. - dwisehaupt@cumin1002" [production]
15:35 <jhancock@cumin1003> END (ERROR) - Cookbook sre.hosts.provision (exit_code=97) for host sretest2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
15:35 <dwisehaupt@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: decommissioning of frack hosts. - dwisehaupt@cumin1002" [production]
15:31 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host sretest2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
15:31 <dwisehaupt@cumin1002> START - Cookbook sre.dns.netbox [production]
15:23 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:18 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:11 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:10 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
14:58 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7007.magru.wmnet [production]