| 2024-09-30
      
      ยง | 
    
  | 15:56 | <jclark@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd1005.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:56 | <jclark@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 15:55 | <jclark@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 15:52 | <jclark@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logging-hd1004.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:52 | <jclark@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 15:51 | <jclark@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 15:49 | <ayounsi@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:45 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mc-misc1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 15:42 | <jclark@cumin1002> | START - Cookbook sre.hosts.provision for host mc-misc1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 15:41 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mc-misc1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 15:41 | <jclark@cumin1002> | START - Cookbook sre.hosts.provision for host mc-misc1001.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 15:41 | <jclark@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 15:40 | <jclark@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1002 | [production] | 
            
  | 15:39 | <jclark@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1002 | [production] | 
            
  | 15:39 | <jclark@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1001 | [production] | 
            
  | 15:39 | <jclark@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1001 | [production] | 
            
  | 15:39 | <jclark@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 15:35 | <jclark@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd1005.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:32 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:32 | <jclark@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logging-hd1004.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:31 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 15:29 | <jclark@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 15:28 | <jclark@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt mc-misc  - jclark@cumin1002" | [production] | 
            
  | 15:28 | <jclark@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt mc-misc  - jclark@cumin1002" | [production] | 
            
  | 15:27 | <jclark@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1002 | [production] | 
            
  | 15:27 | <jclark@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1002 | [production] | 
            
  | 15:27 | <jclark@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-misc1001 | [production] | 
            
  | 15:27 | <jclark@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on logging-hd1005.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:26 | <jclark@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host mc-misc1001 | [production] | 
            
  | 15:26 | <jclark@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on logging-hd1004.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 15:25 | <jclark@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 15:12 | <volans> | upgraded spicerack to 8.14.0 on cumin1002 | [production] | 
            
  | 15:11 | <marostegui@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dbproxy2005.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:08 | <mforns@deploy2002> | helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply | [production] | 
            
  | 15:08 | <mforns@deploy2002> | helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply | [production] | 
            
  | 14:55 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host logging-hd1005.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:55 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host logging-hd1004.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:51 | <swfrench@cumin2002> | conftool action : set/pooled=true; selector: dnsdisc=shellbox-video,name=codfw [reason: Pooling shellbox-video in codfw before (re)pooling eqiad on Wednesday - T370962] | [production] | 
            
  | 14:45 | <elukey> | force a run of upload_puppet_facts.service on puppetserver1001 to pick up new facts/hosts | [production] | 
            
  | 14:41 | <_joe_> | updating conftool to 3.3.0 | [production] | 
            
  | 14:39 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host logging-hd2005 | [production] | 
            
  | 14:39 | <jhancock@cumin2002> | START - Cookbook sre.network.configure-switch-interfaces for host logging-hd2005 | [production] | 
            
  | 14:38 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host logging-hd2004 | [production] | 
            
  | 14:38 | <jhancock@cumin2002> | START - Cookbook sre.network.configure-switch-interfaces for host logging-hd2004 | [production] | 
            
  | 14:36 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 14:36 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd1004.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 14:36 | <jclark@cumin1002> | START - Cookbook sre.hosts.provision for host logging-hd1005.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 14:36 | <jclark@cumin1002> | START - Cookbook sre.hosts.provision for host logging-hd1004.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 14:35 | <_joe_> | running requestctl --debug upgrade-schema | [production] | 
            
  | 14:35 | <jclark@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] |