| 
      
        2024-09-17
      
      §
     | 
  
    
  | 08:48 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2125.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 08:45 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 08:40 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'T374848', diff saved to https://phabricator.wikimedia.org/P69203 and previous config saved to /var/cache/conftool/dbconfig/20240917-084036-arnaudb.json | 
  [production] | 
            
  | 08:40 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.decommission for hosts db2125.codfw.wmnet | 
  [production] | 
            
  | 08:36 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2125 T374848', diff saved to https://phabricator.wikimedia.org/P69202 and previous config saved to /var/cache/conftool/dbconfig/20240917-083652-arnaudb.json | 
  [production] | 
            
  | 08:31 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2124.codfw.wmnet | 
  [production] | 
            
  | 08:31 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 08:31 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2124.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 08:31 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2124.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 08:26 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 08:18 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.decommission for hosts db2124.codfw.wmnet | 
  [production] | 
            
  | 08:16 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2124 T374847', diff saved to https://phabricator.wikimedia.org/P69201 and previous config saved to /var/cache/conftool/dbconfig/20240917-081642-arnaudb.json | 
  [production] | 
            
  | 08:12 | 
  <jnuche@deploy1003> | 
  rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.23  refs T373642 | 
  [production] | 
            
  | 08:04 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2121 T374846', diff saved to https://phabricator.wikimedia.org/P69200 and previous config saved to /var/cache/conftool/dbconfig/20240917-080453-arnaudb.json | 
  [production] | 
            
  | 08:04 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2122.codfw.wmnet | 
  [production] | 
            
  | 08:04 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 08:04 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2122.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 08:02 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2122.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 07:58 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 07:54 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.decommission for hosts db2122.codfw.wmnet | 
  [production] | 
            
  | 07:49 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'db2121 T374846', diff saved to https://phabricator.wikimedia.org/P69199 and previous config saved to /var/cache/conftool/dbconfig/20240917-074918-arnaudb.json | 
  [production] | 
            
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2121.codfw.wmnet | 
  [production] | 
            
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 07:42 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 07:38 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | 
  [production] | 
            
  | 07:35 | 
  <hashar@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] (duration: 15m 36s) | 
  [production] | 
            
  | 07:33 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 07:29 | 
  <hashar@deploy1003> | 
  hashar: Continuing with sync | 
  [production] | 
            
  | 07:29 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.decommission for hosts db2121.codfw.wmnet | 
  [production] | 
            
  | 07:28 | 
  <hashar@deploy1003> | 
  hashar: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 07:26 | 
  <vgutierrez> | 
  testing purged 0.23 in cp4038 - T334078 | 
  [production] | 
            
  | 07:20 | 
  <hashar@deploy1003> | 
  Started scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] | 
  [production] | 
            
  | 07:11 | 
  <arnaudb@cumin1002> | 
  dbctl commit (dc=all): 'depool db2121 T374845', diff saved to https://phabricator.wikimedia.org/P69198 and previous config saved to /var/cache/conftool/dbconfig/20240917-071120-arnaudb.json | 
  [production] | 
            
  | 04:00 | 
  <mwpresync@deploy1003> | 
  Pruned MediaWiki: 1.43.0-wmf.20 (duration: 00m 58s) | 
  [production] | 
            
  | 03:53 | 
  <mwpresync@deploy1003> | 
  Finished scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 (duration: 50m 47s) | 
  [production] | 
            
  | 03:02 | 
  <mwpresync@deploy1003> | 
  Started scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 | 
  [production] | 
            
  
    | 
      
        2024-09-16
      
      §
     | 
  
    
  | 22:49 | 
  <Dreamy_Jazz> | 
  Restarting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration | 
  [production] | 
            
  | 20:53 | 
  <jhathaway> | 
  reloading puppetserver to enable strict mode | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:47 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:42 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:28 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | 
  [production] | 
            
  | 20:25 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:25 | 
  <toyofuku@deploy1003> | 
  Finished scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] (duration: 08m 53s) | 
  [production] | 
            
  | 20:24 | 
  <pt1979@cumin2002> | 
  END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | 
  [production] | 
            
  | 20:21 | 
  <pt1979@cumin2002> | 
  START - Cookbook sre.dns.netbox | 
  [production] | 
            
  | 20:20 | 
  <toyofuku@deploy1003> | 
  jdlrobson, toyofuku: Continuing with sync | 
  [production] |