| 2024-11-27
      
      ยง | 
    
  | 15:04 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ml-etcd1003.eqiad.wmnet to plain | [production] | 
            
  | 15:03 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of ml-etcd1003.eqiad.wmnet to plain | [production] | 
            
  | 15:02 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1022.eqiad.wmnet | [production] | 
            
  | 15:02 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1022.eqiad.wmnet | [production] | 
            
  | 15:01 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ml-etcd1003.eqiad.wmnet to drbd | [production] | 
            
  | 14:59 | <kartik@deploy2002> | helmfile [ml-serve-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . | [production] | 
            
  | 14:58 | <kartik@deploy2002> | helmfile [ml-serve-eqiad] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . | [production] | 
            
  | 14:51 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of ml-etcd1003.eqiad.wmnet to drbd | [production] | 
            
  | 14:48 | <kartik@deploy2002> | helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . | [production] | 
            
  | 14:43 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1022.eqiad.wmnet | [production] | 
            
  | 14:39 | <jmm@cumin2002> | START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1022.eqiad.wmnet | [production] | 
            
  | 14:35 | <moritzm> | rebalance magru01 following switch of VMs back to DRBD T376737 | [production] | 
            
  | 14:33 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on doh[7001-7002].wikimedia.org with reason: site is depooled, maintenance | [production] | 
            
  | 14:33 | <sukhe@cumin1002> | START - Cookbook sre.hosts.downtime for 6:00:00 on doh[7001-7002].wikimedia.org with reason: site is depooled, maintenance | [production] | 
            
  | 14:33 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1097309|[GrowthExperiments] Undefine wgGEDatabaseCluster (T354939)]] (duration: 12m 21s) | [production] | 
            
  | 14:30 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of doh7001.wikimedia.org to drbd | [production] | 
            
  | 14:26 | <urbanecm@deploy2002> | urbanecm: Continuing with sync | [production] | 
            
  | 14:26 | <urbanecm@deploy2002> | urbanecm: Backport for [[gerrit:1097309|[GrowthExperiments] Undefine wgGEDatabaseCluster (T354939)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 14:25 | <fnegri@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on cloudvirt1061.eqiad.wmnet with reason: cloudvirt1061 needs maintenance T380673 | [production] | 
            
  | 14:25 | <fnegri@cumin1002> | START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on cloudvirt1061.eqiad.wmnet with reason: cloudvirt1061 needs maintenance T380673 | [production] | 
            
  | 14:24 | <urbanecm> | Purge https://en.wikipedia.org/static/images/mobile/copyright/wikiquote-wordmark-az.svg (T380974) | [production] | 
            
  | 14:21 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host wdqs1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 14:21 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host wdqs1026.eqiad.wmnet with OS bullseye | [production] | 
            
  | 14:20 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1097309|[GrowthExperiments] Undefine wgGEDatabaseCluster (T354939)]] | [production] | 
            
  | 14:20 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1098076|Enable ParserMigration compact indicator on all wikis (T363484)]], [[gerrit:1093405|Deploy Parsoid Read Views to de/ru wikivoyage and dagwiki (T375394 T380401)]], [[gerrit:1098019|Updated wordmark for Azerbaijani Wikiquote (T380974)]] (duration: 17m 20s) | [production] | 
            
  | 14:20 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of doh7001.wikimedia.org to drbd | [production] | 
            
  | 14:19 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum7001.magru.wmnet to drbd | [production] | 
            
  | 14:13 | <urbanecm@deploy2002> | urbanecm, cscott, nmw03: Continuing with sync | [production] | 
            
  | 14:09 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of durum7001.magru.wmnet to drbd | [production] | 
            
  | 14:08 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir7001.magru.wmnet to drbd | [production] | 
            
  | 14:08 | <urbanecm@deploy2002> | urbanecm, cscott, nmw03: Backport for [[gerrit:1098076|Enable ParserMigration compact indicator on all wikis (T363484)]], [[gerrit:1093405|Deploy Parsoid Read Views to de/ru wikivoyage and dagwiki (T375394 T380401)]], [[gerrit:1098019|Updated wordmark for Azerbaijani Wikiquote (T380974)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 14:03 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1098076|Enable ParserMigration compact indicator on all wikis (T363484)]], [[gerrit:1093405|Deploy Parsoid Read Views to de/ru wikivoyage and dagwiki (T375394 T380401)]], [[gerrit:1098019|Updated wordmark for Azerbaijani Wikiquote (T380974)]] | [production] | 
            
  | 13:59 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir7001.magru.wmnet to drbd | [production] | 
            
  | 13:55 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of install7001.wikimedia.org to drbd | [production] | 
            
  | 13:45 | <moritzm> | installing php8.2 security updates | [production] | 
            
  | 13:40 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of install7001.wikimedia.org to drbd | [production] | 
            
  | 13:40 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1061.eqiad.wmnet' | [admin] | 
            
  | 13:39 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of netflow7001.magru.wmnet to drbd | [production] | 
            
  | 13:38 | <mszabo@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1098506|private: Add stub for wgReportIncidentZendeskSubjectLine (T380868)]], [[gerrit:1098480|Configure IRS Zendesk integration (T380908)]], [[gerrit:1093389|Configure instrument for the Incident Reporting System (T372823)]] (duration: 13m 53s) | [production] | 
            
  | 13:31 | <mszabo@deploy2002> | mszabo: Continuing with sync | [production] | 
            
  | 13:30 | <mszabo@deploy2002> | mszabo: Backport for [[gerrit:1098506|private: Add stub for wgReportIncidentZendeskSubjectLine (T380868)]], [[gerrit:1098480|Configure IRS Zendesk integration (T380908)]], [[gerrit:1093389|Configure instrument for the Incident Reporting System (T372823)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 13:28 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of netflow7001.magru.wmnet to drbd | [production] | 
            
  | 13:27 | <moritzm> | rebalance magru02 following switch of VMs back to DRBD T376737 | [production] | 
            
  | 13:26 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum7002.magru.wmnet to drbd | [production] | 
            
  | 13:26 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1061.eqiad.wmnet' | [admin] | 
            
  | 13:24 | <mszabo@deploy2002> | Started scap sync-world: Backport for [[gerrit:1098506|private: Add stub for wgReportIncidentZendeskSubjectLine (T380868)]], [[gerrit:1098480|Configure IRS Zendesk integration (T380908)]], [[gerrit:1093389|Configure instrument for the Incident Reporting System (T372823)]] | [production] | 
            
  | 13:20 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host wdqs1026.eqiad.wmnet with OS bullseye | [production] | 
            
  | 13:20 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host wdqs1025.eqiad.wmnet with OS bullseye | [production] | 
            
  | 13:20 | <jclark@cumin1002> | START - Cookbook sre.hosts.reimage for host wdqs1027.eqiad.wmnet with OS bullseye | [production] | 
            
  | 13:16 | <jmm@cumin2002> | START - Cookbook sre.ganeti.changedisk for changing disk type of durum7002.magru.wmnet to drbd | [production] |