| 2024-09-05
      
      ยง | 
    
  | 17:18 | <wmbot~dcaro@urcuchillay> | END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=99) for host toolsbeta-test-k8s-control-8 | [toolsbeta] | 
            
  | 17:18 | <wmbot~dcaro@urcuchillay> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-control-8 | [toolsbeta] | 
            
  | 17:18 | <wmbot~dcaro@urcuchillay> | END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-control-7 | [toolsbeta] | 
            
  | 17:16 | <wmbot~dcaro@urcuchillay> | START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-control-7 | [toolsbeta] | 
            
  | 17:10 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2019.codfw.wmnet | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2019.codfw.wmnet | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2419.codfw.wmnet | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2419.codfw.wmnet | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2418.codfw.wmnet | [production] | 
            
  | 17:10 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2418.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2417.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2417.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2416.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2416.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2415.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2415.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2414.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2414.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2413.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2413.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2412.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2412.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2338.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2338.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2337.codfw.wmnet | [production] | 
            
  | 17:09 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2337.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2336.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2336.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2335.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2335.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2039.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2039.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2038.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2038.codfw.wmnet | [production] | 
            
  | 17:08 | <andrew@cloudcumin1001> | START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1033.eqiad.wmnet' (T374043) | [admin] | 
            
  | 17:08 | <claime> | Repooling kubernetes nodes after T373096 - kubernetes2017 kubernetes2021 kubernetes2038 kubernetes2039 mw2335 mw2336 mw2337 mw2338 mw2412 mw2413 mw2414 mw2415 mw2416 mw2417 mw2418 mw2419 wikikube-worker2019 | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2021.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2021.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubernetes2017.codfw.wmnet | [production] | 
            
  | 17:08 | <cgoubert@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host kubernetes2017.codfw.wmnet | [production] | 
            
  | 17:08 | <andrew@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) on host 'cloudvirt1032.eqiad.wmnet' (T374043) | [admin] | 
            
  | 17:08 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2169 (re)pooling @ 25%: T370852', diff saved to https://phabricator.wikimedia.org/P68717 and previous config saved to /var/cache/conftool/dbconfig/20240905-170801-arnaudb.json | [production] | 
            
  | 17:08 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2191 (re)pooling @ 25%: T370852', diff saved to https://phabricator.wikimedia.org/P68716 and previous config saved to /var/cache/conftool/dbconfig/20240905-170800-arnaudb.json | [production] | 
            
  | 17:08 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2150 (re)pooling @ 25%: T370852', diff saved to https://phabricator.wikimedia.org/P68715 and previous config saved to /var/cache/conftool/dbconfig/20240905-170800-arnaudb.json | [production] | 
            
  | 17:06 | <fabfur@cumin1002> | conftool action : set/pooled=yes; selector: name=cp2036.ulsfo.wmnet | [production] | 
            
  | 17:06 | <fabfur@cumin1002> | conftool action : set/pooled=yes; selector: name=cp2035.ulsfo.wmnet | [production] | 
            
  | 17:05 | <Emperor> | pool moss-fe2001 ms-fe2011 T373096 | [production] | 
            
  | 17:04 | <Emperor> | moss-be2003 exit maintenance mode T373096 | [production] | 
            
  | 17:03 | <fabfur@cumin1002> | END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2036.codfw.wmnet | [production] | 
            
  | 17:03 | <fabfur@cumin1002> | START - Cookbook sre.hosts.remove-downtime for cp2036.codfw.wmnet | [production] |