| 2024-10-01
      
      ยง | 
    
  | 17:50 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077079|Allow storing of passwords for local users in wikitech (T376140)]] | [production] | 
            
  | 17:50 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudlb2004-dev.codfw.wmnet with OS bookworm | [production] | 
            
  | 17:44 | <wmbot~bd808@tools-bastion-12> | Switched OAuth credentials in the proper config file this time (T376176) | [tools.stashbot] | 
            
  | 17:41 | <bd808> | test | [tools.stashbot] | 
            
  | 17:35 | <bd808> | test | [tools.stashbot] | 
            
  | 17:26 | <wmbot~bd808@tools-bastion-12> | Switched OAuth credentials (T376176) | [tools.stashbot] | 
            
  | 17:13 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [tools] | 
            
  | 17:07 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [tools] | 
            
  | 17:07 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api | [toolsbeta] | 
            
  | 17:06 | <mutante> | welcome new deployment user zoe T373666 | [production] | 
            
  | 17:06 | <jhathaway@cumin1002> | START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm | [production] | 
            
  | 17:03 | <aikochou@deploy2002> | helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revision-models' for release 'main' . | [production] | 
            
  | 17:03 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 17:02 | <taavi> | run extensions/CentralAuth/maintenance/migratePass0 on wikitech | [production] | 
            
  | 16:54 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission | [tools] | 
            
  | 16:48 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component volume-admission | [tools] | 
            
  | 16:46 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission | [toolsbeta] | 
            
  | 16:44 | <fnegri@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T375977) | [mwoffliner] | 
            
  | 16:44 | <fnegri@cloudcumin1001> | START - Cookbook wmcs.openstack.quota_increase (T375977) | [mwoffliner] | 
            
  | 16:42 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component volume-admission | [toolsbeta] | 
            
  | 16:41 | <ayounsi@cumin1002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1002.eqiad.wmnet with OS bookworm | [production] | 
            
  | 16:38 | <gmodena> | deployed refinery source v0.2.51 | [analytics] | 
            
  | 16:32 | <aikochou@deploy2002> | helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revision-models' for release 'main' . | [production] | 
            
  | 16:30 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host cloudlb2004-dev.codfw.wmnet with OS bookworm | [production] | 
            
  | 16:28 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission | [tools] | 
            
  | 16:23 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [tools] | 
            
  | 16:23 | <dcaro@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission | [toolsbeta] | 
            
  | 16:17 | <dcaro@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component registry-admission | [toolsbeta] | 
            
  | 16:16 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T364077, test out new flag) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards | [production] | 
            
  | 16:11 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T364077, test out new flag) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards | [production] | 
            
  | 16:06 | <aikochou@deploy2002> | helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revision-models' for release 'main' . | [production] | 
            
  | 16:04 | <ladsgroup@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] (duration: 09m 36s) | [production] | 
            
  | 16:03 | <aikochou@deploy2002> | helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . | [production] | 
            
  | 16:00 | <ladsgroup@deploy2002> | taavi, ladsgroup: Continuing with sync | [production] | 
            
  | 15:59 | <ryankemper@cumin2002> | END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T364077, this test transfer should succeed) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards | [production] | 
            
  | 15:58 | <ladsgroup@deploy2002> | taavi, ladsgroup: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 15:56 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T364077, this test transfer should succeed) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs2021.codfw.wmnet, repooling both afterwards | [production] | 
            
  | 15:55 | <ladsgroup@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077046|Make Wikitech behave a bit more like a SUL wiki (T371374)]] | [production] | 
            
  | 15:54 | <ryankemper@cumin2002> | END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) (T364077, this test transfer should fail) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1023.eqiad.wmnet, repooling both afterwards | [production] | 
            
  | 15:53 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T364077, this test transfer should fail) xfer wikidata_main from wdqs1021.eqiad.wmnet -> wdqs1023.eqiad.wmnet, repooling both afterwards | [production] | 
            
  | 15:50 | <gmodena> | releasing refinery source v0.2.51 | [analytics] | 
            
  | 15:44 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 15:40 | <wmbot~dcaro@urcuchillay> | END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) (T372814) | [admin] | 
            
  | 15:39 | <ayounsi@cumin1002> | START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS bookworm | [production] | 
            
  | 15:36 | <jhancock@cumin2002> | START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 15:07 | <elukey@puppetserver1001> | conftool action : set/pooled=yes; selector: name=aux-k8s-ctrl1003.eqiad.wmnet | [production] | 
            
  | 15:07 | <elukey@puppetserver1001> | conftool action : set/pooled=yes; selector: name=aux-k8s-worker1003.eqiad.wmnet | [production] | 
            
  | 15:05 | <brennen@deploy2002> | Finished deploy [phabricator/deployment@33a2c8d]: deploy phab1004 for T376149 (duration: 01m 07s) | [production] | 
            
  | 15:04 | <brennen@deploy2002> | Started deploy [phabricator/deployment@33a2c8d]: deploy phab1004 for T376149 | [production] | 
            
  | 15:03 | <brennen@deploy2002> | Finished deploy [phabricator/deployment@33a2c8d]: test deploy phab2002 for T376149 (duration: 00m 30s) | [production] |