| 2024-09-17
      
      § | 
    
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2121.codfw.wmnet | [production] | 
            
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 07:42 | <arnaudb@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 07:38 | <arnaudb@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2121.codfw.wmnet decommissioned, removing all IPs except the asset tag one - arnaudb@cumin1002" | [production] | 
            
  | 07:35 | <hashar@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] (duration: 15m 36s) | [production] | 
            
  | 07:33 | <arnaudb@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 07:29 | <hashar@deploy1003> | hashar: Continuing with sync | [production] | 
            
  | 07:29 | <arnaudb@cumin1002> | START - Cookbook sre.hosts.decommission for hosts db2121.codfw.wmnet | [production] | 
            
  | 07:28 | <hashar@deploy1003> | hashar: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:26 | <vgutierrez> | testing purged 0.23 in cp4038 - T334078 | [production] | 
            
  | 07:20 | <hashar@deploy1003> | Started scap sync-world: Backport for [[gerrit:1073232|logging: Default to log any error (on group1) (T228838)]] | [production] | 
            
  | 07:11 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'depool db2121 T374845', diff saved to https://phabricator.wikimedia.org/P69198 and previous config saved to /var/cache/conftool/dbconfig/20240917-071120-arnaudb.json | [production] | 
            
  | 04:00 | <mwpresync@deploy1003> | Pruned MediaWiki: 1.43.0-wmf.20 (duration: 00m 58s) | [production] | 
            
  | 03:53 | <mwpresync@deploy1003> | Finished scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 (duration: 50m 47s) | [production] | 
            
  | 03:02 | <mwpresync@deploy1003> | Started scap sync-world: testwikis to 1.43.0-wmf.23  refs T373642 | [production] | 
            
  
    | 2024-09-16
      
      § | 
    
  | 22:49 | <Dreamy_Jazz> | Restarting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration | [production] | 
            
  | 20:53 | <jhathaway> | reloading puppetserver to enable strict mode | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:47 | <pt1979@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:42 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:28 | <pt1979@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add  frack new switches - pt1979@cumin2002" | [production] | 
            
  | 20:25 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:25 | <toyofuku@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] (duration: 08m 53s) | [production] | 
            
  | 20:24 | <pt1979@cumin2002> | END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | [production] | 
            
  | 20:21 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:20 | <toyofuku@deploy1003> | jdlrobson, toyofuku: Continuing with sync | [production] | 
            
  | 20:18 | <toyofuku@deploy1003> | jdlrobson, toyofuku: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:16 | <toyofuku@deploy1003> | Started scap sync-world: Backport for [[gerrit:1073277|Deploy Vector 2022 on small wikis (T374255)]], [[gerrit:1073279|Disable quick surveys (T374743)]] | [production] | 
            
  | 18:27 | <dancy@deploy1003> | Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 06s) | [production] | 
            
  | 18:27 | <dancy@deploy1003> | Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | [production] | 
            
  | 18:27 | <dancy@deploy1003> | Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 04s) | [production] | 
            
  | 18:27 | <dancy@deploy1003> | Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | [production] | 
            
  | 18:24 | <rzl> | rzl@cumin1002:~$ sudo cumin O:logging::opensearch::collector 'chown -R opensearch-dashboards: /usr/share/opensearch-dashboards/plugins/phatality' | [production] | 
            
  | 18:07 | <dancy@deploy1003> | Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 04s) | [production] | 
            
  | 18:06 | <dancy@deploy1003> | Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | [production] | 
            
  | 18:06 | <dancy@deploy1003> | Finished deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 (duration: 00m 46s) | [production] | 
            
  | 18:05 | <dancy@deploy1003> | Started deploy [releng/phatality@c2cb594]: Deploying https://gerrit.wikimedia.org/r/c/releng/phatality/+/1071836 | [production] | 
            
  | 17:27 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2238 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69196 and previous config saved to /var/cache/conftool/dbconfig/20240916-172712-arnaudb.json | [production] | 
            
  | 17:27 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2237 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69195 and previous config saved to /var/cache/conftool/dbconfig/20240916-172706-arnaudb.json | [production] | 
            
  | 17:27 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2227 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69194 and previous config saved to /var/cache/conftool/dbconfig/20240916-172701-arnaudb.json | [production] | 
            
  | 17:26 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2225 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69193 and previous config saved to /var/cache/conftool/dbconfig/20240916-172656-arnaudb.json | [production] | 
            
  | 17:26 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2224 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69192 and previous config saved to /var/cache/conftool/dbconfig/20240916-172651-arnaudb.json | [production] | 
            
  | 17:26 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2222 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69191 and previous config saved to /var/cache/conftool/dbconfig/20240916-172646-arnaudb.json | [production] | 
            
  | 17:26 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2221 (re)pooling @ 100%: T374623', diff saved to https://phabricator.wikimedia.org/P69190 and previous config saved to /var/cache/conftool/dbconfig/20240916-172641-arnaudb.json | [production] | 
            
  | 17:22 | <mfossati@deploy1003> | Finished deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) (duration: 00m 44s) | [production] | 
            
  | 17:21 | <mfossati@deploy1003> | Started deploy [airflow-dags/platform_eng@5ad6710]: (no justification provided) | [production] | 
            
  | 17:16 | <dancy@deploy1003> | Finished deploy [releng/phatality@b1a2a70]: testing (duration: 00m 05s) | [production] |