| 
      
        2024-09-03
      
      §
     | 
  
    
  | 22:04 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host phab1005.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 21:42 | 
  <swfrench-wmf> | 
  running homer 'cr*codfw*' commit 'T372878' | 
  [production] | 
            
  | 21:34 | 
  <swfrench@cumin2002> | 
  END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2080.codfw.wmnet | 
  [production] | 
            
  | 21:34 | 
  <swfrench@cumin2002> | 
  START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2080.codfw.wmnet | 
  [production] | 
            
  | 21:31 | 
  <swfrench-wmf> | 
  running homer 'lsw1-b3-codfw*' commit 'T372878' | 
  [production] | 
            
  | 21:13 | 
  <jdrewniak@deploy1003> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:1046698| Bumping portals to master (T128546)]] (duration: 02m 18s) | 
  [production] | 
            
  | 21:10 | 
  <jdrewniak@deploy1003> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:1046698| Bumping portals to master (T128546)]] (duration: 06m 25s) | 
  [production] | 
            
  | 20:59 | 
  <jdrewniak@deploy1003> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:1070336| Bumping portals to master (T128546)]] (duration: 02m 19s) | 
  [production] | 
            
  | 20:56 | 
  <jdrewniak@deploy1003> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:1070336| Bumping portals to master (T128546)]] (duration: 02m 21s) | 
  [production] | 
            
  | 20:56 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host phab1005 | 
  [production] | 
            
  | 20:56 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.network.configure-switch-interfaces for host phab1005 | 
  [production] | 
            
  | 20:45 | 
  <toyofuku@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1069334|Turn on donate link in beta (T372757)]], [[gerrit:1070310|Disable lead paragraph transform on Wikivoyages]] (duration: 09m 43s) | 
  [production] | 
            
  | 20:44 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host phab1005.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 20:44 | 
  <swfrench-wmf> | 
  running homer 'lsw1-b3-codfw*' commit 'T372878' | 
  [production] | 
            
  | 20:44 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 20:41 | 
  <toyofuku@deploy1003> | 
  jdlrobson, toyofuku: Continuing with sync | 
  [production] | 
            
  | 20:39 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 20:38 | 
  <toyofuku@deploy1003> | 
  jdlrobson, toyofuku: Backport for [[gerrit:1069334|Turn on donate link in beta (T372757)]], [[gerrit:1070310|Disable lead paragraph transform on Wikivoyages]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 20:37 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 20:36 | 
  <toyofuku@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1069334|Turn on donate link in beta (T372757)]], [[gerrit:1070310|Disable lead paragraph transform on Wikivoyages]] | 
  [production] | 
            
  | 20:31 | 
  <cjming@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1070281|cirrus: Introduce an expensive query pool counter (T369808)]] (duration: 06m 47s) | 
  [production] | 
            
  | 20:26 | 
  <cjming@deploy1003> | 
  ebernhardson, cjming: Continuing with sync | 
  [production] | 
            
  | 20:26 | 
  <cjming@deploy1003> | 
  ebernhardson, cjming: Backport for [[gerrit:1070281|cirrus: Introduce an expensive query pool counter (T369808)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 20:24 | 
  <swfrench@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2080.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 20:24 | 
  <cjming@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1070281|cirrus: Introduce an expensive query pool counter (T369808)]] | 
  [production] | 
            
  | 20:19 | 
  <wmbot~raymond@ubuntu> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission | 
  [tools] | 
            
  | 20:16 | 
  <jeena> | 
  Updating development images on contint primary for https://phabricator.wikimedia.org/T373721 | 
  [releng] | 
            
  | 20:08 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 20:07 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host phab1005 | 
  [production] | 
            
  | 20:07 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.network.configure-switch-interfaces for host phab1005 | 
  [production] | 
            
  | 20:07 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:07 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt phab1005 - jclark@cumin1002" | 
  [production] | 
            
  | 20:07 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt phab1005 - jclark@cumin1002" | 
  [production] | 
            
  | 20:04 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:03 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 20:01 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:01 | 
  <wmbot~raymond@ubuntu> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component ingress-admission | 
  [toolsbeta] | 
            
  | 19:58 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 19:57 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host phab1005.mgmt.eqiad.wmnet with reboot policy FORCED | 
  [production] | 
            
  | 19:56 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 19:56 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt phab1005 - jclark@cumin1002" | 
  [production] | 
            
  | 19:56 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added network and mgmt phab1005 - jclark@cumin1002" | 
  [production] | 
            
  | 19:56 | 
  <wmbot~raymond@ubuntu> | 
  START - Cookbook wmcs.toolforge.component.deploy for component ingress-admission | 
  [toolsbeta] | 
            
  | 19:55 | 
  <swfrench@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2080.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:53 | 
  <wmbot~raymond@ubuntu> | 
  END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer | 
  [tools] | 
            
  | 19:53 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] |