| 2024-12-17
      
      § | 
    
  | 08:00 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2093.codfw.wmnet | [production] | 
            
  | 08:00 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2093.codfw.wmnet | [production] | 
            
  | 07:53 | <moritzm> | installing expat security updates | [production] | 
            
  | 04:03 | <mwpresync@deploy2002> | Started scap sync-world: testwikis to 1.44.0-wmf.8  refs T375667 | [production] | 
            
  | 01:33 | <swfrench-wmf> | deployed shellbox-video to pick up config change for T292322 | [production] | 
            
  | 01:30 | <swfrench@deploy2002> | helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 01:30 | <swfrench@deploy2002> | helmfile [codfw] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 01:27 | <swfrench@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 01:27 | <swfrench@deploy2002> | helmfile [eqiad] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 01:23 | <swfrench@deploy2002> | helmfile [staging] DONE helmfile.d/services/shellbox-video: apply | [production] | 
            
  | 01:23 | <swfrench@deploy2002> | helmfile [staging] START helmfile.d/services/shellbox-video: apply | [production] | 
            
  
    | 2024-12-16
      
      § | 
    
  | 23:29 | <tstarling@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] (duration: 12m 00s) | [production] | 
            
  | 23:24 | <tstarling@deploy2002> | tstarling: Continuing with sync | [production] | 
            
  | 23:23 | <tstarling@deploy2002> | tstarling: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 23:17 | <tstarling@deploy2002> | Started scap sync-world: Backport for [[gerrit:1104398|Enable canShellboxGetTempUrl on testwiki (T292322)]] | [production] | 
            
  | 22:31 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-parsoid14.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 22:22 | <ryankemper@cumin2002> | conftool action : set/pooled=yes:weight=10; selector: cluster=wdqs-internal-main,service=wdqs-main | [production] | 
            
  | 21:36 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudelastic1012.eqiad.wmnet with OS bullseye | [production] | 
            
  | 21:36 | <bking@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2002" | [production] | 
            
  | 21:33 | <bking@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2002" | [production] | 
            
  | 21:24 | <cjming> | end of UTC late backport window | [production] | 
            
  | 21:23 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] (duration: 11m 56s) | [production] | 
            
  | 21:19 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudelastic1012.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 21:17 | <cjming@deploy2002> | cjming, pppery: Continuing with sync | [production] | 
            
  | 21:16 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 2:00:00 on cloudelastic1012.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 21:15 | <cjming@deploy2002> | cjming, pppery: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:11 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101158|Update VisualEditor config to drop exclusions based on Flow (T224851)]] | [production] | 
            
  | 21:06 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-snapshot05.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 21:05 | <bking@cumin2002> | START - Cookbook sre.hosts.reimage for host cloudelastic1012.eqiad.wmnet with OS bullseye | [production] | 
            
  | 20:42 | <wmbot~lucaswerkmeister@tools-bastion-13> | deployed 5bea039bac (l10n updates: bbc-latn, lb) | [tools.wd-image-positions] | 
            
  | 20:38 | <wmbot~lucaswerkmeister@tools-bastion-13> | deployed fa4f0b15c3 (cache db connection in application context [i.e. only for the duration of one web request]) | [tools.quickcategories] | 
            
  | 20:29 | <brennen> | Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69 (T381728) | [releng] | 
            
  | 19:36 | <joal@deploy2002> | Finished deploy [airflow-dags/analytics@afda9d9]: Airflow analytics backfill deploy [airflow-dags/analytics@afda9d9a] (duration: 02m 58s) | [production] | 
            
  | 19:33 | <joal@deploy2002> | Started deploy [airflow-dags/analytics@afda9d9]: Airflow analytics backfill deploy [airflow-dags/analytics@afda9d9a] | [production] | 
            
  | 19:31 | <joal> | Deploy analytics-airflow for pageview-hourly backfill | [analytics] | 
            
  | 19:16 | <eevans@cumin1002> | END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching restbase1028.eqiad.wmnet: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002 | [production] | 
            
  | 19:07 | <eevans@cumin1002> | START - Cookbook sre.cassandra.roll-restart for nodes matching restbase1028.eqiad.wmnet: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002 | [production] | 
            
  | 19:05 | <swfrench@deploy2002> | Finished scap sync-world: T353817 - Additional deployment to clear remaining diffs (duration: 02m 51s) | [production] | 
            
  | 19:03 | <swfrench@deploy2002> | Started scap sync-world: T353817 - Additional deployment to clear remaining diffs | [production] | 
            
  | 18:37 | <otto@deploy2002> | otto: Continuing with sync | [production] | 
            
  | 18:35 | <otto@deploy2002> | otto: T353817 - Apache rewrite mediawiki.org/beacon/event to /beacon/event/index.php synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 18:31 | <otto@deploy2002> | Started scap sync-world: T353817 - Apache rewrite mediawiki.org/beacon/event to /beacon/event/index.php | [production] | 
            
  | 18:04 | <James_F> | Zuul: [mediawiki/libs/ParamValidator] Add mediawiki-php-library CI, for T382170 | [releng] | 
            
  | 17:46 | <dancy@deploy2002> | Installation of scap version "4.133.0" completed for 1 hosts | [production] | 
            
  | 17:45 | <dancy@deploy2002> | Installing scap version "4.133.0" for 1 host(s) | [production] | 
            
  | 17:41 | <dancy@deploy2002> | Installing scap version "4.133.0" for 213 host(s) | [production] | 
            
  | 17:22 | <swfrench@deploy2002> | Finished scap sync-world: Deployment to pick up debug image changes - T381473 (duration: 06m 49s) | [production] | 
            
  | 17:21 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:21 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:15 | <swfrench@deploy2002> | Started scap sync-world: Deployment to pick up debug image changes - T381473 | [production] |