| 2024-10-09
      
      ยง | 
    
  | 10:34 | <fnegri@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for main branch | [admin] | 
            
  | 10:33 | <fnegri@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan for main branch | [admin] | 
            
  | 10:28 | <elukey> | roll restart swift-proxy on ms-fe* to pick up https://gerrit.wikimedia.org/r/c/operations/puppet/+/1078380 | [production] | 
            
  | 10:27 | <jmm@cumin2002> | START - Cookbook sre.puppet.migrate-host for host cloudcephosd1027.eqiad.wmnet | [production] | 
            
  | 10:26 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'db2220 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P69506 and previous config saved to /var/cache/conftool/dbconfig/20241009-102636-ladsgroup.json | [production] | 
            
  | 10:16 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1026.eqiad.wmnet | [production] | 
            
  | 10:11 | <stevemunene@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1176.eqiad.wmnet with OS bullseye | [production] | 
            
  | 09:42 | <Dreamy_Jazz> | Started time limited MediaModertation scan on enwiki for 16hrs to catchup with monthly request limit - https://wikitech.wikimedia.org/wiki/MediaModeration | [production] | 
            
  | 09:40 | <jmm@cumin2002> | START - Cookbook sre.puppet.migrate-host for host cloudcephosd1026.eqiad.wmnet | [production] | 
            
  | 09:27 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers | [tools] | 
            
  | 09:24 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers | [toolsbeta] | 
            
  | 09:20 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers | [tools] | 
            
  | 09:20 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers | [toolsbeta] | 
            
  | 09:17 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers | [tools] | 
            
  | 09:16 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers | [toolsbeta] | 
            
  | 09:11 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers | [tools] | 
            
  | 09:11 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers | [toolsbeta] | 
            
  | 08:54 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:53 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:51 | <stevemunene@cumin1002> | START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye | [production] | 
            
  | 08:49 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] | 
            
  | 08:49 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] | 
            
  | 08:48 | <stevemunene@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1176.eqiad.wmnet with OS bullseye | [production] | 
            
  | 08:46 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:46 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:41 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:37 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:37 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:36 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 08:23 | <jmm@cumin2002> | END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host cloudcephmon1005.eqiad.wmnet | [production] | 
            
  | 08:18 | <jmm@cumin2002> | START - Cookbook sre.puppet.migrate-host for host cloudcephmon1005.eqiad.wmnet | [production] | 
            
  | 08:12 | <aklapper@deploy2002> | rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.26  refs T375657 | [production] | 
            
  | 08:11 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1021.eqiad.wmnet | [production] | 
            
  | 08:02 | <jmm@cumin2002> | START - Cookbook sre.puppet.migrate-host for host cloudcephosd1021.eqiad.wmnet | [production] | 
            
  | 08:02 | <jmm@cumin2002> | END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host cloudcephosd1011.eqiad.wmnet | [production] | 
            
  | 07:48 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:47 | <jmm@cumin2002> | START - Cookbook sre.puppet.migrate-host for host cloudcephosd1011.eqiad.wmnet | [production] | 
            
  | 07:45 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:43 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:43 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:26 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:26 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host mc-misc2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:22 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:22 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:20 | <elukey@cumin2002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:20 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host backup1012.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 07:13 | <moritzm> | remove ganeti2010 from active nodes T376594 | [production] | 
            
  | 06:37 | <eileen> | civicrm upgraded from 251e958f to ae54bd5e | [production] | 
            
  | 06:08 | <jelto@deploy2002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 06:06 | <jelto@deploy2002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] |