| 2024-11-26
      
      ยง | 
    
  | 16:49 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1327.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:49 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1326.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:49 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1325.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:48 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1324.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:48 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1322.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:46 | <andrew@cloudcumin1001> | START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1062.eqiad.wmnet}' (T380731) | [admin] | 
            
  | 16:46 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1321.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:45 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1323.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:45 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:42 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1321.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:42 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:41 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1323.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 16:40 | <urbanecm> | `mwscript-k8s -f userOptions.php -- --wiki=enwiki --old=control --delete 'growthexperiments-homepage-variant'` # T379146, T377631 | [production] | 
            
  | 16:30 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1327.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:30 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1326.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:30 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1325.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:29 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1324.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:29 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1322.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:29 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1321.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:28 | <cgoubert@cumin1002> | END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host wikikube-worker1321.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:28 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1327.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:27 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1326.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:27 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1325.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:27 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1324.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:26 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1322.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:22 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1323.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:20 | <cgoubert@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker1323.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:52 | <moritzm> | installing intel-microcode security updates | [production] | 
            
  | 15:49 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1327.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:49 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1326.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:48 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1325.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:48 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1324.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:47 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1323.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:46 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1322.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:45 | <cgoubert@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1321.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:42 | <fabfur@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns7001.wikimedia.org with OS bookworm | [production] | 
            
  | 15:41 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2042.codfw.wmnet | [production] | 
            
  | 15:39 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 15:39 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1025.eqiad.wmnet with OS bullseye | [production] | 
            
  | 15:39 | <jclark@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wdqs1026.eqiad.wmnet with OS bullseye | [production] | 
            
  | 15:35 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti2042.codfw.wmnet | [production] | 
            
  | 15:34 | <moritzm> | installing wireshark security updates | [production] | 
            
  | 15:33 | <ladsgroup@cumin1002> | END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) db2215 gradually with 4 steps - Maint over | [production] | 
            
  | 15:33 | <ladsgroup@cumin1002> | START - Cookbook sre.mysql.pool db2215 gradually with 4 steps - Maint over | [production] | 
            
  | 15:27 | <dcausse@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:25 | <dcausse@deploy2002> | helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 15:24 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1020.eqiad.wmnet | [production] | 
            
  | 15:22 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet | [production] | 
            
  | 15:21 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1020.eqiad.wmnet | [production] | 
            
  | 15:19 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet | [production] |