| 2024-12-04
      
      ยง | 
    
  | 14:50 | <jayme@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2445.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 14:49 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1025.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:49 | <andrew@cloudcumin1001> | START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1035.eqiad.wmnet}' (T380731) | [admin] | 
            
  | 14:48 | <samtar@deploy2002> | Started scap sync-world: Backport for [[gerrit:1090502|Add new namespaces to hsb wiktionary (T373634)]] | [production] | 
            
  | 14:48 | <andrew@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1035.eqiad.wmnet' (T380893) | [admin] | 
            
  | 14:47 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [toolsbeta] | 
            
  | 14:47 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1037.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:46 | <sstefanova@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [tools] | 
            
  | 14:46 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1172 (T371742)', diff saved to https://phabricator.wikimedia.org/P71540 and previous config saved to /var/cache/conftool/dbconfig/20241204-144651-ladsgroup.json | [production] | 
            
  | 14:46 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1036.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:46 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1025.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:45 | <andrew@cloudcumin1001> | START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1035.eqiad.wmnet' (T380893) | [admin] | 
            
  | 14:45 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [tools] | 
            
  | 14:31 | <Lucas_WMDE> | UTC afternoon backport+config window done | [production] | 
            
  | 14:29 | <lucaswerkmeister-wmde@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] (duration: 18m 12s) | [production] | 
            
  | 14:27 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1036.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:26 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api | [toolsbeta] | 
            
  | 14:23 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1036.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 14:22 | <lucaswerkmeister-wmde@deploy2002> | abi, lucaswerkmeister-wmde: Continuing with sync | [production] | 
            
  | 14:20 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [toolsbeta] | 
            
  | 14:20 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [toolsbeta] | 
            
  | 14:20 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api | [toolsbeta] | 
            
  | 14:20 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [toolsbeta] | 
            
  | 14:19 | <bking@cumin2002> | START - Cookbook sre.hosts.reimage for host wdqs1025.eqiad.wmnet with OS bullseye | [production] | 
            
  | 14:18 | <jayme@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2015.codfw.wmnet with OS bookworm | [production] | 
            
  | 14:17 | <lucaswerkmeister-wmde@deploy2002> | abi, lucaswerkmeister-wmde: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 14:14 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 14:13 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [toolsbeta] | 
            
  | 14:11 | <lucaswerkmeister-wmde@deploy2002> | Started scap sync-world: Backport for [[gerrit:1100352|Translate: Enable message group subscription for 6 wikis (T372386)]] | [production] | 
            
  | 14:10 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 14:07 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1036.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:05 | <jelto@cumin1002> | END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1036.eqiad.wmnet wikikube-worker1037.eqiad.wmnet on all recursors | [production] | 
            
  | 14:05 | <jelto@cumin1002> | START - Cookbook sre.dns.wipe-cache wikikube-worker1036.eqiad.wmnet wikikube-worker1037.eqiad.wmnet on all recursors | [production] | 
            
  | 14:01 | <jayme@cumin2002> | START - Cookbook sre.hosts.provision for host mw2446.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 14:01 | <jayme@cumin2002> | START - Cookbook sre.hosts.provision for host mw2447.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 14:01 | <jayme@cumin2002> | START - Cookbook sre.hosts.provision for host mw2445.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 14:00 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host es1045.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:00 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host es1044.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:00 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host es1043.eqiad.wmnet with OS bookworm | [production] | 
            
  | 14:00 | <dreamyjazz@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1100150|Ensure IP reveal buttons are not shown on Special:MassGlobalBlock (T124607)]] (duration: 13m 08s) | [production] | 
            
  | 13:59 | <sstefanova@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-api | [toolsbeta] | 
            
  | 13:59 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-api | [toolsbeta] | 
            
  | 13:58 | <jayme@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2015.codfw.wmnet with reason: host reimage | [production] | 
            
  | 13:58 | <jayme@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mw[2445-2447].codfw.wmnet with reason: reimage | [production] | 
            
  | 13:57 | <jayme@cumin2002> | START - Cookbook sre.hosts.downtime for 4:00:00 on mw[2445-2447].codfw.wmnet with reason: reimage | [production] | 
            
  | 13:56 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1024 to wikikube-worker1037 | [production] | 
            
  | 13:55 | <jelto@cumin1002> | END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1037 | [production] | 
            
  | 13:54 | <jayme@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2015.codfw.wmnet with reason: host reimage | [production] | 
            
  | 13:54 | <jelto@cumin1002> | START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1037 | [production] | 
            
  | 13:54 | <jelto@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] |