| 2024-11-21
      
      § | 
    
  | 00:42 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2023.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:42 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2023.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:42 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2022.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:42 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2022.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:42 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2021.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:42 | <eevans@cumin1002> | START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2021.codfw.wmnet with reason: Decommissioning — T380236 | [production] | 
            
  | 00:40 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase2038.codfw.wmnet | [production] | 
            
  | 00:40 | <eevans@cumin1002> | START - Cookbook sre.hosts.remove-downtime for restbase2038.codfw.wmnet | [production] | 
            
  | 00:40 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase2037.codfw.wmnet | [production] | 
            
  | 00:40 | <eevans@cumin1002> | START - Cookbook sre.hosts.remove-downtime for restbase2037.codfw.wmnet | [production] | 
            
  | 00:40 | <eevans@cumin1002> | END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase2036.codfw.wmnet | [production] | 
            
  | 00:40 | <eevans@cumin1002> | START - Cookbook sre.hosts.remove-downtime for restbase2036.codfw.wmnet | [production] | 
            
  | 00:15 | <urbanecm> | [urbanecm@deploy2002 ~]$ mwscript-k8s -- extensions/GrowthExperiments/maintenance/revalidateLinkRecommendations.php --wiki=azwiki --all --verbose # T380329 | [production] | 
            
  
    | 2024-11-20
      
      § | 
    
  | 23:22 | <cjming> | end of UTC late backport window | [production] | 
            
  | 23:20 | <eileen> | civicrm upgraded from 7c940d6f to 3311520a | [production] | 
            
  | 23:17 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093408|Temporarily disable dark mode for anonymous users (T379765)]] (duration: 13m 06s) | [production] | 
            
  | 23:10 | <cjming@deploy2002> | jdlrobson, cjming: Continuing with sync | [production] | 
            
  | 23:08 | <cjming@deploy2002> | jdlrobson, cjming: Backport for [[gerrit:1093408|Temporarily disable dark mode for anonymous users (T379765)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 23:04 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093408|Temporarily disable dark mode for anonymous users (T379765)]] | [production] | 
            
  | 23:03 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093328|knwiki: update portal namespace (T380366)]] (duration: 12m 17s) | [production] | 
            
  | 22:56 | <cjming@deploy2002> | cjming, anzx: Continuing with sync | [production] | 
            
  | 22:55 | <cjming@deploy2002> | cjming, anzx: Backport for [[gerrit:1093328|knwiki: update portal namespace (T380366)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:52 | <brett> | Import libvmod-querysort 0.4-3 into varnish-staging apt component | [production] | 
            
  | 22:51 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093328|knwiki: update portal namespace (T380366)]] | [production] | 
            
  | 22:49 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093446|Revert "Add contact form for U4C"]] (duration: 14m 22s) | [production] | 
            
  | 22:49 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 22:41 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:41 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:40 | <cjming@deploy2002> | trainbranchbot, cjming: Continuing with sync | [production] | 
            
  | 22:40 | <cjming@deploy2002> | trainbranchbot, cjming: Backport for [[gerrit:1093446|Revert "Add contact form for U4C"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:39 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:39 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:34 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093446|Revert "Add contact form for U4C"]] | [production] | 
            
  | 22:31 | <cjming@deploy2002> | Sync cancelled. | [production] | 
            
  | 22:28 | <cjming@deploy2002> | nmw03, cjming: Backport for [[gerrit:1091868|Add contact form for U4C (T379317)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:27 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 22:24 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-be2005.codfw.wmnet with reason: host reimage | [production] | 
            
  | 22:23 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:22 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1091868|Add contact form for U4C (T379317)]] | [production] | 
            
  | 22:21 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:20 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093358|Bump wikimedia/parsoid to 0.21.0-a7 (T373776 T380333)]], [[gerrit:1093359|Bump wikimedia/parsoid to 0.21.0-a7 (T380333)]] (duration: 17m 11s) | [production] | 
            
  | 22:18 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:16 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 22:13 | <cjming@deploy2002> | arlolra, cjming: Continuing with sync | [production] | 
            
  | 22:12 | <jhathaway@cumin2002> | START - Cookbook sre.hosts.reimage for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 22:11 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be2005.codfw.wmnet with OS bullseye | [production] | 
            
  | 22:11 | <jhathaway@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhathaway@cumin2002" | [production] | 
            
  | 22:09 | <jhathaway@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhathaway@cumin2002" | [production] | 
            
  | 22:08 | <cjming@deploy2002> | arlolra, cjming: Backport for [[gerrit:1093358|Bump wikimedia/parsoid to 0.21.0-a7 (T373776 T380333)]], [[gerrit:1093359|Bump wikimedia/parsoid to 0.21.0-a7 (T380333)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:06 | <bking@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] |