| 2024-09-20
      
      ยง | 
    
  | 17:29 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2005 to codfw - jhancock@cumin2002" | [production] | 
            
  | 17:25 | <jhancock@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:23 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 17:20 | <jhancock@cumin2002> | START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 17:18 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:18 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2004 to codfw - jhancock@cumin2002" | [production] | 
            
  | 17:18 | <jhancock@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2004 to codfw - jhancock@cumin2002" | [production] | 
            
  | 17:13 | <jhancock@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:03 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=wikidatawiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 16:02 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=metawiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 16:02 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=loginwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 16:02 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=frwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 16:01 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 16:01 | <xSavitar> | T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' | [production] | 
            
  | 14:20 | <Dreamy_Jazz> | Finished running`foreachwiki maintenance/fixAutoblockLogTitles.php` on a tmux session for T373929 | [production] | 
            
  | 14:08 | <Dreamy_Jazz> | Running `foreachwiki maintenance/fixAutoblockLogTitles.php` on a tmux session for T373929 | [production] | 
            
  | 14:04 | <kcvelaga@deploy1003> | Finished deploy [airflow-dags/analytics_product@6010568]: automoderator config dag T375062 (duration: 01m 47s) | [production] | 
            
  | 14:03 | <kcvelaga@deploy1003> | Started deploy [airflow-dags/analytics_product@6010568]: automoderator config dag T375062 | [production] | 
            
  | 13:20 | <moritzm> | uploaded debmonitor-client 0.4.0-3 for buster/bullseye/bookworm to apt.wikimedia.org T216832 | [production] | 
            
  | 13:09 | <jiji@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 13:09 | <jiji@cumin1002> | START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 12:45 | <jiji@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:38 | <jiji@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 12:37 | <jiji@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 12:36 | <jiji@cumin1002> | START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:24 | <jiji@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:18 | <jiji@cumin1002> | START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:16 | <jiji@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:11 | <jiji@cumin1002> | START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 12:07 | <jiji@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 12:07 | <jiji@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2425.codfw.wmnet with reason: reimage | [production] | 
            
  | 11:58 | <jiji@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2424.codfw.wmnet | [production] | 
            
  | 11:57 | <jiji@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host mw2424.codfw.wmnet | [production] | 
            
  | 11:46 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on wikikube-worker2092.codfw.wmnet with reason: Degraded RAID | [production] | 
            
  | 11:46 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on wikikube-worker2092.codfw.wmnet with reason: Degraded RAID | [production] | 
            
  | 11:18 | <moritzm> | installing links2 updates from Bullseye point release | [production] | 
            
  | 11:11 | <moritzm> | installing nano updates from Bullseye point update | [production] | 
            
  | 10:11 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f3-eqiad | [production] | 
            
  | 10:11 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device lsw1-f3-eqiad | [production] | 
            
  | 10:08 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f2-eqiad | [production] | 
            
  | 10:08 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device lsw1-f2-eqiad | [production] | 
            
  | 10:08 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e3-eqiad | [production] | 
            
  | 10:07 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device lsw1-e3-eqiad | [production] | 
            
  | 10:07 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e2-eqiad | [production] | 
            
  | 10:07 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device lsw1-e2-eqiad | [production] | 
            
  | 10:03 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e1-eqiad | [production] | 
            
  | 10:03 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device lsw1-e1-eqiad | [production] | 
            
  | 09:42 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device cloudsw1-f4-eqiad | [production] | 
            
  | 09:40 | <ayounsi@cumin1002> | START - Cookbook sre.network.tls for network device cloudsw1-f4-eqiad | [production] | 
            
  | 09:38 | <ayounsi@cumin1002> | END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device cloudsw1-e4-eqiad | [production] |