| 2024-11-04
      
      ยง | 
    
  | 10:32 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission | [tools] | 
            
  | 10:31 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1045.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:31 | <moritzm> | installing libseccomp updates from Bookworm point release | [production] | 
            
  | 10:31 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1043.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2194', diff saved to https://phabricator.wikimedia.org/P70852 and previous config saved to /var/cache/conftool/dbconfig/20241104-103059-ladsgroup.json | [production] | 
            
  | 10:25 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission | [tools] | 
            
  | 10:24 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission | [toolsbeta] | 
            
  | 10:20 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1043.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:19 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission | [toolsbeta] | 
            
  | 10:17 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1042.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:15 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission | [tools] | 
            
  | 10:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2194 (T376905)', diff saved to https://phabricator.wikimedia.org/P70851 and previous config saved to /var/cache/conftool/dbconfig/20241104-101552-ladsgroup.json | [production] | 
            
  | 10:12 | <wmbot~lucaswerkmeister@tools-bastion-13> | deployed 8f3649ddc9 (Codex 1.15.0) | [tools.codex-playground] | 
            
  | 10:11 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [tools] | 
            
  | 10:08 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2194 (T376905)', diff saved to https://phabricator.wikimedia.org/P70850 and previous config saved to /var/cache/conftool/dbconfig/20241104-100813-ladsgroup.json | [production] | 
            
  | 10:08 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2194.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 10:07 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2194.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 10:06 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1042.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:05 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 10:03 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 10:02 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1041.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2139.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 10:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2139.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 09:59 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 09:59 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 09:57 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1041.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 09:56 | <volans> | deploying spicerack v8.15.2 to cumin[12]002 | [production] | 
            
  | 09:56 | <sstefanova@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component registry-admission | [tools] | 
            
  | 09:55 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1040.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 09:55 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [tools] | 
            
  | 09:51 | <sstefanova@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component registry-admission | [tools] | 
            
  | 09:50 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1040.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 09:48 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [tools] | 
            
  | 09:47 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission | [toolsbeta] | 
            
  | 09:42 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1039.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 09:42 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [toolsbeta] | 
            
  | 09:37 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1039.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 09:28 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway | [tools] | 
            
  | 09:23 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component api-gateway | [tools] | 
            
  | 09:21 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway | [toolsbeta] | 
            
  | 09:16 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component api-gateway | [toolsbeta] | 
            
  | 09:07 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 13 hosts with reason: reboots for nftables | [production] | 
            
  | 09:06 | <jmm@cumin2002> | START - Cookbook sre.hosts.downtime for 1:00:00 on 13 hosts with reason: reboots for nftables | [production] | 
            
  | 09:06 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ganeti1045.eqiad.wmnet with reason: reboots for nftables | [production] | 
            
  | 09:06 | <jmm@cumin2002> | START - Cookbook sre.hosts.downtime for 1:00:00 on ganeti1045.eqiad.wmnet with reason: reboots for nftables | [production] | 
            
  | 09:04 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1039.eqiad.wmnet | [production] | 
            
  | 08:59 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host ganeti1039.eqiad.wmnet | [production] | 
            
  | 08:57 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:57 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:51 | <elukey@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] |