| 2025-09-29
      
      ยง | 
    
  | 16:11 | <elukey@cumin1003> | END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:11 | <elukey@cumin1003> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:09 | <elukey@cumin1003> | END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:09 | <elukey@cumin1003> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:07 | <elukey@cumin1003> | END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:07 | <elukey@cumin1003> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2048'] | [production] | 
            
  | 16:05 | <jhancock@cumin1002> | START - Cookbook sre.hosts.reimage for host dse-k8s-worker2003.codfw.wmnet with OS bookworm | [production] | 
            
  | 15:58 | <fabfur@cumin1002> | conftool action : set/pooled=yes; selector: name=cp5021.eqsin.wmnet | [production] | 
            
  | 15:56 | <dancy@deploy2002> | Finished scap sync-world: Testing gitinfo fix (T405738) (duration: 11m 16s) | [production] | 
            
  | 15:56 | <ejegg> | donorwiki upgraded from 52104fab to 41b5ac89 | [production] | 
            
  | 15:55 | <fabfur@cumin1002> | conftool action : set/pooled=no; selector: name=cp5021.eqsin.wmnet | [production] | 
            
  | 15:54 | <fabfur> | restart haproxy on cp5021 to test utf8ps converter | [production] | 
            
  | 15:52 | <tappof@deploy2002> | Started restart [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:51 | <tappof@deploy2002> | Finished deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:51 | <tappof@deploy2002> | Started deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:46 | <tappof@deploy2002> | Finished deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values (duration: 00m 15s) | [production] | 
            
  | 15:46 | <tappof@deploy2002> | Started deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:45 | <dancy@deploy2002> | Started scap sync-world: Testing gitinfo fix (T405738) | [production] | 
            
  | 15:45 | <tappof@deploy2002> | Finished deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:45 | <tappof@deploy2002> | Started deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:44 | <dancy@deploy2002> | Installation of scap version "4.211.0" completed for 168 hosts | [production] | 
            
  | 15:44 | <tappof@deploy2002> | Started restart [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:43 | <tappof@deploy2002> | Finished deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:43 | <tappof@deploy2002> | Started deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:42 | <tappof@deploy2002> | Finished deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:41 | <tappof@deploy2002> | Started deploy [performance/navtiming@578b1d3]: Add authenticated mw_context values | [production] | 
            
  | 15:40 | <dancy@deploy2002> | Installing scap version "4.211.0" for 168 host(s) | [production] | 
            
  | 15:39 | <ejegg> | fundraising civicrm upgraded from 3771abe2 to 0c89cc9f | [production] | 
            
  | 15:36 | <tappof@deploy2002> | Finished deploy [performance/navtiming@94fa387]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:36 | <tappof@deploy2002> | Started deploy [performance/navtiming@94fa387]: Add authenticated mw_context values | [production] | 
            
  | 15:33 | <tappof@deploy2002> | Finished deploy [performance/navtiming@94fa387]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:33 | <tappof@deploy2002> | Started deploy [performance/navtiming@94fa387]: Add authenticated mw_context values | [production] | 
            
  | 15:33 | <ejegg> | payments-wiki upgraded from bf2864e9 to bb9fdfdb | [production] | 
            
  | 15:32 | <ejegg> | standalone SmashPig upgraded from 96afe81c to dc03e91b | [production] | 
            
  | 15:26 | <tappof@deploy2002> | Started restart [performance/navtiming@94fa387]: Add authenticated mw_context values | [production] | 
            
  | 15:26 | <tappof@deploy2002> | Finished deploy [performance/navtiming@94fa387]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:26 | <tappof@deploy2002> | Started deploy [performance/navtiming@94fa387]: Add authenticated mw_context values | [production] | 
            
  | 15:24 | <tappof@deploy2002> | Finished deploy [performance/navtiming@94fa387]: Add authenticated mw_context values (duration: 00m 02s) | [production] | 
            
  | 15:24 | <tappof@deploy2002> | Started deploy [performance/navtiming@94fa387]: Add authenticated mw_context values | [production] | 
            
  | 15:02 | <stevemunene@puppetserver1001> | conftool action : set/pooled=no; selector: service=(druid-public-broker),name=druid1008.eqiad.wmnet | [production] | 
            
  | 15:02 | <stevemunene@puppetserver1001> | conftool action : set/pooled=no; selector: service=(druid-public-broker),name=druid1007.eqiad.wmnet | [production] | 
            
  | 14:46 | <btullis@cumin1003> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" | [production] | 
            
  | 14:34 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Deploy haproxy acl naming refactor and minor UI improvements - swfrench@cumin2002" | [production] | 
            
  | 14:34 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Deploy haproxy acl naming refactor and minor UI improvements - swfrench@cumin2002 | [production] | 
            
  | 14:33 | <swfrench@cumin2002> | START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Deploy haproxy acl naming refactor and minor UI improvements - swfrench@cumin2002 | [production] | 
            
  | 14:33 | <swfrench@cumin2002> | START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Deploy haproxy acl naming refactor and minor UI improvements - swfrench@cumin2002" | [production] | 
            
  | 14:24 | <btullis@cumin1003> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1236.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:23 | <cgoubert@cumin1003> | END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) check toolhub: maintenance | [production] | 
            
  | 14:23 | <cgoubert@cumin1003> | START - Cookbook sre.discovery.service-route check toolhub: maintenance | [production] | 
            
  | 14:21 | <btullis@cumin1003> | START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1236.eqiad.wmnet with reason: host reimage | [production] |