| 2024-11-20
      
      ยง | 
    
  | 22:40 | <cjming@deploy2002> | trainbranchbot, cjming: Continuing with sync | [production] | 
            
  | 22:40 | <cjming@deploy2002> | trainbranchbot, cjming: Backport for [[gerrit:1093446|Revert "Add contact form for U4C"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:39 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:39 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:34 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093446|Revert "Add contact form for U4C"]] | [production] | 
            
  | 22:31 | <cjming@deploy2002> | Sync cancelled. | [production] | 
            
  | 22:28 | <cjming@deploy2002> | nmw03, cjming: Backport for [[gerrit:1091868|Add contact form for U4C (T379317)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:27 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 22:24 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 22:23 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:22 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1091868|Add contact form for U4C (T379317)]] | [production] | 
            
  | 22:21 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:20 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093358|Bump wikimedia/parsoid to 0.21.0-a7 (T373776 T380333)]], [[gerrit:1093359|Bump wikimedia/parsoid to 0.21.0-a7 (T380333)]] (duration: 17m 11s) | [production] | 
            
  | 22:18 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:16 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:13 | <cjming@deploy2002> | arlolra, cjming: Continuing with sync | [production] | 
            
  | 22:12 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 22:11 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 22:11 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhathaway@cumin2002" | [production] | 
            
  | 22:09 | <jhathaway@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhathaway@cumin2002" | [production] | 
            
  | 22:08 | <cjming@deploy2002> | arlolra, cjming: Backport for [[gerrit:1093358|Bump wikimedia/parsoid to 0.21.0-a7 (T373776 T380333)]], [[gerrit:1093359|Bump wikimedia/parsoid to 0.21.0-a7 (T380333)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:06 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:03 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093358|Bump wikimedia/parsoid to 0.21.0-a7 (T373776 T380333)]], [[gerrit:1093359|Bump wikimedia/parsoid to 0.21.0-a7 (T380333)]] | [production] | 
            
  | 22:02 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:52 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:50 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:47 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 21:43 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 21:40 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:32 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 21:31 | <jhathaway@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 21:28 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1091810|[ptwiki] Enable the CampaignEvents extension (T380090)]] (duration: 15m 04s) | [production] | 
            
  | 21:23 | <eileen> | * civicrm upgraded from e29243f0 to 7c940d6f | [production] | 
            
  | 21:20 | <cjming@deploy2002> | cjming, albertoleoncio: Continuing with sync | [production] | 
            
  | 21:19 | <cjming@deploy2002> | cjming, albertoleoncio: Backport for [[gerrit:1091810|[ptwiki] Enable the CampaignEvents extension (T380090)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:13 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1091810|[ptwiki] Enable the CampaignEvents extension (T380090)]] | [production] | 
            
  | 21:08 | <dancy@deploy2002> | Installing scap version "4.124.0" for 209 hosts | [production] | 
            
  | 21:06 | <dancy@deploy2002> | Installing scap version "4.124.0" for 209 hosts | [production] | 
            
  | 21:05 | <herron@cumin1002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-ctrl2003.codfw.wmnet | [production] | 
            
  | 21:05 | <herron@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-ctrl2003.codfw.wmnet with OS bookworm | [production] | 
            
  | 21:03 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 21:00 | <jhathaway@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 20:51 | <herron@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-ctrl2003.codfw.wmnet with reason: host reimage | [production] | 
            
  | 20:48 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 20:48 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 20:48 | <herron@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-ctrl2003.codfw.wmnet with reason: host reimage | [production] | 
            
  | 20:48 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 20:47 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2041.codfw.wmnet with OS bookworm | [production] | 
            
  | 20:44 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 20:40 | <dancy@deploy2002> | Installation of scap version "4.126.0" completed for 1 hosts | [production] |