| 
      
        2024-11-14
      
      §
     | 
  
    
  | 08:35 | 
  <ayounsi@cumin1002> | 
  START - Cookbook sre.network.peering with action 'email' for AS: 141082 | 
  [production] | 
            
  | 08:34 | 
  <ayounsi@cumin1002> | 
  END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9299 | 
  [production] | 
            
  | 08:33 | 
  <ayounsi@cumin1002> | 
  START - Cookbook sre.network.peering with action 'email' for AS: 9299 | 
  [production] | 
            
  | 08:33 | 
  <ayounsi@cumin1002> | 
  END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 140407 | 
  [production] | 
            
  | 08:33 | 
  <ayounsi@cumin1002> | 
  START - Cookbook sre.network.peering with action 'email' for AS: 140407 | 
  [production] | 
            
  | 08:28 | 
  <kartik@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1084704|Update stream registration and config for MinT for Readers (T378565)]] (duration: 24m 50s) | 
  [production] | 
            
  | 08:23 | 
  <kartik@deploy2002> | 
  kcvelaga, kartik: Continuing with sync | 
  [production] | 
            
  | 08:08 | 
  <kartik@deploy2002> | 
  kcvelaga, kartik: Backport for [[gerrit:1084704|Update stream registration and config for MinT for Readers (T378565)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 08:03 | 
  <kartik@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1084704|Update stream registration and config for MinT for Readers (T378565)]] | 
  [production] | 
            
  | 07:42 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2017.codfw.wmnet | 
  [production] | 
            
  | 07:41 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2017.codfw.wmnet | 
  [production] | 
            
  | 07:34 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2017.codfw.wmnet | 
  [production] | 
            
  | 07:34 | 
  <ayounsi@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 07:34 | 
  <ayounsi@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove office link dns records - ayounsi@cumin1002" | 
  [production] | 
            
  | 07:34 | 
  <ayounsi@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove office link dns records - ayounsi@cumin1002" | 
  [production] | 
            
  | 07:30 | 
  <ayounsi@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 07:06 | 
  <XioNoX> | 
  delete office interco IP/prefixes/vlan in ulsfo - T379778 | 
  [production] | 
            
  | 04:34 | 
  <jhathaway@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 04:11 | 
  <jhathaway@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 04:09 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 03:56 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 02:32 | 
  <eileen> | 
  config revision changed from 7af5769b to fbddc1f5 | 
  [production] | 
            
  | 02:29 | 
  <eileen> | 
  civicrm upgraded from 7b300007 to 2ab8334a | 
  [production] | 
            
  | 00:14 | 
  <eileen> | 
  config revision changed from 2b08b881 to 7af5769b | 
  [production] | 
            
  | 00:13 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1046.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 00:13 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 00:12 | 
  <eileen> | 
  civicrm upgraded from 23e08fc2 to 7b300007 | 
  [production] | 
            
  | 00:05 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1043.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 00:05 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 00:05 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1045.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 00:05 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host es1041.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  
    | 
      
        2024-11-13
      
      §
     | 
  
    
  | 23:45 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:43 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:43 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host es1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:43 | 
  <jclark@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host es1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1046.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1045.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1043.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:42 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.hosts.provision for host es1041.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:41 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 23:41 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for es104  - jclark@cumin1002" | 
  [production] | 
            
  | 23:41 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for es104  - jclark@cumin1002" | 
  [production] | 
            
  | 23:40 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1027.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:40 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1026.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:40 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wdqs1025.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | 
  [production] | 
            
  | 23:37 | 
  <jclark@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 23:20 | 
  <jhathaway@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bookworm | 
  [production] | 
            
  | 23:04 | 
  <jclark@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] |