| 2024-10-01
      
      ยง | 
    
  | 12:36 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 12:28 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077006|wikitech: Allow 'crats to rename local users (T161859)]] (duration: 07m 51s) | [production] | 
            
  | 12:23 | <ladsgroup@deploy2002> | ladsgroup: Continuing with sync | [production] | 
            
  | 12:23 | <Amir1> | mwscript maintenance/storage/moveToExternal.php --wiki=labswiki --undo /home/ladsgroup/T376129.undo.sql DB cluster31 (T376129) | [production] | 
            
  | 12:22 | <ladsgroup@deploy2002> | ladsgroup: Backport for [[gerrit:1077006|wikitech: Allow 'crats to rename local users (T161859)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 12:20 | <joal> | Delete HDFS webrequest staging data used for the haproxy log migration | [analytics] | 
            
  | 12:20 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077006|wikitech: Allow 'crats to rename local users (T161859)]] | [production] | 
            
  | 12:17 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077000|Wikitech: Connect wikitech to external storage (T376129)]] (duration: 09m 53s) | [production] | 
            
  | 12:12 | <ladsgroup@deploy2002> | ladsgroup: Continuing with sync | [production] | 
            
  | 12:09 | <ladsgroup@deploy2002> | ladsgroup: Backport for [[gerrit:1077000|Wikitech: Connect wikitech to external storage (T376129)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 12:07 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077000|Wikitech: Connect wikitech to external storage (T376129)]] | [production] | 
            
  | 12:02 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 12:01 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1076992|wikitech: Soft connect wikitech to SUL (T161859)]] (duration: 09m 53s) | [production] | 
            
  | 12:00 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 11:57 | <ladsgroup@deploy2002> | ladsgroup: Continuing with sync | [production] | 
            
  | 11:54 | <ladsgroup@deploy2002> | ladsgroup: Backport for [[gerrit:1076992|wikitech: Soft connect wikitech to SUL (T161859)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 11:52 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1076992|wikitech: Soft connect wikitech to SUL (T161859)]] | [production] | 
            
  | 11:51 | <stevemunene@cumin1002> | START - Cookbook sre.hadoop.roll-restart-masters restart masters for Hadoop analytics cluster: Restart of jvm daemons. | [production] | 
            
  | 11:50 | <stevemunene> | roll restart hadoop analytics master to pick up new hosts T353788 | [analytics] | 
            
  | 11:49 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1076995|Drop wikitech.php (T371592 T371374)]] (duration: 07m 32s) | [production] | 
            
  | 11:45 | <ladsgroup@deploy2002> | ladsgroup: Continuing with sync | [production] | 
            
  | 11:44 | <ladsgroup@deploy2002> | ladsgroup: Backport for [[gerrit:1076995|Drop wikitech.php (T371592 T371374)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 11:42 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1076995|Drop wikitech.php (T371592 T371374)]] | [production] | 
            
  | 11:28 | <elukey@cumin1002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host irc2003.wikimedia.org | [production] | 
            
  | 11:28 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host irc2003.wikimedia.org with OS bookworm | [production] | 
            
  | 11:16 | <effie> | Switching wikitech to k8s - T292707 | [production] | 
            
  | 11:12 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on irc2003.wikimedia.org with reason: host reimage | [production] | 
            
  | 11:09 | <elukey@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on irc2003.wikimedia.org with reason: host reimage | [production] | 
            
  | 11:01 | <jiji@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1059339|wikitech: de-wikitech mediawiki-config (T371537 T371592 T371374 T371359)]] (duration: 08m 23s) | [production] | 
            
  | 10:56 | <jiji@deploy2002> | jiji: Continuing with sync | [production] | 
            
  | 10:55 | <jiji@deploy2002> | jiji: Backport for [[gerrit:1059339|wikitech: de-wikitech mediawiki-config (T371537 T371592 T371374 T371359)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 10:52 | <jiji@deploy2002> | Started scap sync-world: Backport for [[gerrit:1059339|wikitech: de-wikitech mediawiki-config (T371537 T371592 T371374 T371359)]] | [production] | 
            
  | 10:52 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | [tools] | 
            
  | 10:48 | <jiji@deploy2002> | Sync cancelled. | [production] | 
            
  | 10:46 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component components-api | [tools] | 
            
  | 10:45 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api | [toolsbeta] | 
            
  | 10:44 | <jiji@deploy2002> | jiji: Backport for [[gerrit:1059339|wikitech: de-wikitech mediawiki-config (T371537 T371592 T371374 T371359)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 10:44 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-staging2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:44 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host ml-staging2003.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:42 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve2011.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:42 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host ml-serve2011.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:42 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve2010.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:41 | <jiji@deploy2002> | Started scap sync-world: Backport for [[gerrit:1059339|wikitech: de-wikitech mediawiki-config (T371537 T371592 T371374 T371359)]] | [production] | 
            
  | 10:41 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host ml-serve2010.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:41 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve2009.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:40 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component components-api | [toolsbeta] | 
            
  | 10:40 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host ml-serve2009.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:38 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host parsoidtest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:38 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host parsoidtest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 10:36 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host deploy1003.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART | [production] |