| 2025-10-27
      
      ยง | 
    
  | 20:48 | <aaron@deploy2002> | Started scap sync-world: Backport for [[gerrit:1198405|Move rest_v1-wikimedia.json under the wwwportal directory (T396805)]] | [production] | 
            
  | 20:46 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host tcp-proxy6001.drmrs.wmnet | [production] | 
            
  | 20:46 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host tcp-proxy6001.drmrs.wmnet with OS trixie | [production] | 
            
  | 20:44 | <kemayo@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1199027|Edit check: instrument when pastes happen with known sources (T407302)]] (duration: 10m 16s) | [production] | 
            
  | 20:38 | <kemayo@deploy2002> | kemayo: Continuing with sync | [production] | 
            
  | 20:36 | <kemayo@deploy2002> | kemayo: Backport for [[gerrit:1199027|Edit check: instrument when pastes happen with known sources (T407302)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:36 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on tcp-proxy4002.ulsfo.wmnet with reason: host reimage | [production] | 
            
  | 20:34 | <kemayo@deploy2002> | Started scap sync-world: Backport for [[gerrit:1199027|Edit check: instrument when pastes happen with known sources (T407302)]] | [production] | 
            
  | 20:32 | <cmooney@cumin1003> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 20:29 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on tcp-proxy6001.drmrs.wmnet with reason: host reimage | [production] | 
            
  | 20:29 | <cmooney@cumin1003> | START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 20:28 | <dzahn@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on tcp-proxy4002.ulsfo.wmnet with reason: host reimage | [production] | 
            
  | 20:23 | <dzahn@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on tcp-proxy6001.drmrs.wmnet with reason: host reimage | [production] | 
            
  | 20:21 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1198591|Add config for xLab MW Module experiment (T401705)]], [[gerrit:1198949|hCaptcha: Define HCaptchaSiteKey in CommonSettings.php (T405586)]] (duration: 15m 31s) | [production] | 
            
  | 20:11 | <cjming@deploy2002> | kharlan, cjming: Continuing with sync | [production] | 
            
  | 20:10 | <cjming@deploy2002> | kharlan, cjming: Backport for [[gerrit:1198591|Add config for xLab MW Module experiment (T401705)]], [[gerrit:1198949|hCaptcha: Define HCaptchaSiteKey in CommonSettings.php (T405586)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. | [production] | 
            
  | 20:06 | <dzahn@cumin2002> | START - Cookbook sre.hosts.reimage for host tcp-proxy4002.ulsfo.wmnet with OS trixie | [production] | 
            
  | 20:06 | <cmooney@cumin1003> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:06 | <cmooney@cumin1003> | START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie | [production] | 
            
  | 20:06 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy4002.ulsfo.wmnet - dzahn@cumin2002" | [production] | 
            
  | 20:06 | <dzahn@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy4002.ulsfo.wmnet - dzahn@cumin2002" | [production] | 
            
  | 20:05 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1198591|Add config for xLab MW Module experiment (T401705)]], [[gerrit:1198949|hCaptcha: Define HCaptchaSiteKey in CommonSettings.php (T405586)]] | [production] | 
            
  | 20:05 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) tcp-proxy4002.ulsfo.wmnet on all recursors | [production] | 
            
  | 20:05 | <dzahn@cumin2002> | START - Cookbook sre.dns.wipe-cache tcp-proxy4002.ulsfo.wmnet on all recursors | [production] | 
            
  | 20:05 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 20:05 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy4002.ulsfo.wmnet - dzahn@cumin2002" | [production] | 
            
  | 20:05 | <dzahn@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy4002.ulsfo.wmnet - dzahn@cumin2002" | [production] | 
            
  | 20:04 | <cmooney@cumin1003> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:03 | <andrew@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudrabbit2002-dev.codfw.wmnet with OS trixie | [production] | 
            
  | 19:58 | <dzahn@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 19:58 | <dzahn@cumin2002> | START - Cookbook sre.ganeti.makevm for new host tcp-proxy4002.ulsfo.wmnet | [production] | 
            
  | 19:52 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host tcp-proxy5002.eqsin.wmnet | [production] | 
            
  | 19:52 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host tcp-proxy5002.eqsin.wmnet with OS trixie | [production] | 
            
  | 19:47 | <andrew@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudrabbit2001-dev.codfw.wmnet with OS trixie | [production] | 
            
  | 19:44 | <andrew@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudrabbit2002-dev.codfw.wmnet with reason: host reimage | [production] | 
            
  | 19:43 | <dzahn@cumin2002> | START - Cookbook sre.hosts.reimage for host tcp-proxy6001.drmrs.wmnet with OS trixie | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy6001.drmrs.wmnet - dzahn@cumin2002" | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy6001.drmrs.wmnet - dzahn@cumin2002" | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) tcp-proxy6001.drmrs.wmnet on all recursors | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | START - Cookbook sre.dns.wipe-cache tcp-proxy6001.drmrs.wmnet on all recursors | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 19:41 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy6001.drmrs.wmnet - dzahn@cumin2002" | [production] | 
            
  | 19:39 | <dzahn@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy6001.drmrs.wmnet - dzahn@cumin2002" | [production] | 
            
  | 19:37 | <andrew@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudrabbit2002-dev.codfw.wmnet with reason: host reimage | [production] | 
            
  | 19:34 | <dzahn@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 19:34 | <dzahn@cumin2002> | START - Cookbook sre.ganeti.makevm for new host tcp-proxy6001.drmrs.wmnet | [production] | 
            
  | 19:31 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on tcp-proxy5002.eqsin.wmnet with reason: host reimage | [production] | 
            
  | 19:27 | <andrew@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudrabbit2001-dev.codfw.wmnet with reason: host reimage | [production] | 
            
  | 19:25 | <dzahn@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on tcp-proxy5002.eqsin.wmnet with reason: host reimage | [production] | 
            
  | 19:24 | <andrew@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudrabbit2001-dev.codfw.wmnet with reason: host reimage | [production] |