| 2024-12-10
      
      § | 
    
  | 08:36 | <jelto@cumin1002> | START - Cookbook sre.hosts.rename from kubernetes1051 to wikikube-worker1076 | [production] | 
            
  | 08:34 | <gmodena@deploy2002> | gmodena: Continuing with sync | [production] | 
            
  | 08:34 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes[1051-1054].eqiad.wmnet | [production] | 
            
  | 08:31 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes[1051-1054].eqiad.wmnet | [production] | 
            
  | 08:26 | <gmodena@deploy2002> | gmodena: Backport for [[gerrit:1100417|EventStreamConfig: add content_history streams. (T381322)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 08:22 | <gmodena@deploy2002> | Started scap sync-world: Backport for [[gerrit:1100417|EventStreamConfig: add content_history streams. (T381322)]] | [production] | 
            
  | 08:22 | <marostegui@cumin1002> | dbctl commit (dc=all): 'db1159 (re)pooling @ 10%: 5', diff saved to https://phabricator.wikimedia.org/P71650 and previous config saved to /var/cache/conftool/dbconfig/20241210-082221-root.json | [production] | 
            
  | 08:22 | <marostegui@cumin1002> | dbctl commit (dc=all): 'db1210 (re)pooling @ 25%: Repooling cloning', diff saved to https://phabricator.wikimedia.org/P71649 and previous config saved to /var/cache/conftool/dbconfig/20241210-082216-root.json | [production] | 
            
  | 08:20 | <marostegui@cumin1002> | dbctl commit (dc=all): 'Add db1159 to dbctl depooled T381550', diff saved to https://phabricator.wikimedia.org/P71648 and previous config saved to /var/cache/conftool/dbconfig/20241210-082020-marostegui.json | [production] | 
            
  | 08:07 | <marostegui@cumin1002> | dbctl commit (dc=all): 'db1210 (re)pooling @ 10%: Repooling cloning', diff saved to https://phabricator.wikimedia.org/P71647 and previous config saved to /var/cache/conftool/dbconfig/20241210-080710-root.json | [production] | 
            
  | 05:01 | <mwpresync@deploy2002> | Pruned MediaWiki: 1.44.0-wmf.4 (duration: 01m 25s) | [production] | 
            
  
    | 2024-12-09
      
      § | 
    
  | 22:29 | <ryankemper> | [wdqs-internal graph split] Cleared away old categories units on 5 hosts (`wdqs20[18-20],wdqs202[6-7]`) | [production] | 
            
  | 22:28 | <cjming> | end of UTC late backport window | [production] | 
            
  | 22:23 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101185|idwikivoyage: add timezone, sitename and project namespace (T381080)]] (duration: 10m 46s) | [production] | 
            
  | 22:17 | <cjming@deploy2002> | cjming, anzx: Continuing with sync | [production] | 
            
  | 22:16 | <cjming@deploy2002> | cjming, anzx: Backport for [[gerrit:1101185|idwikivoyage: add timezone, sitename and project namespace (T381080)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:12 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101185|idwikivoyage: add timezone, sitename and project namespace (T381080)]] | [production] | 
            
  | 22:10 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101231|jawiki: lift IP cap on 2024-12-17 and 2025-01-14 for Edit-a-ton (T381729)]] (duration: 10m 02s) | [production] | 
            
  | 22:05 | <cjming@deploy2002> | cjming, anzx: Continuing with sync | [production] | 
            
  | 22:05 | <cjming@deploy2002> | cjming, anzx: Backport for [[gerrit:1101231|jawiki: lift IP cap on 2024-12-17 and 2025-01-14 for Edit-a-ton (T381729)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:00 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101231|jawiki: lift IP cap on 2024-12-17 and 2025-01-14 for Edit-a-ton (T381729)]] | [production] | 
            
  | 21:57 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]] (duration: 10m 15s) | [production] | 
            
  | 21:52 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:51 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:51 | <cjming@deploy2002> | cjming, jdlrobson: Continuing with sync | [production] | 
            
  | 21:51 | <cjming@deploy2002> | cjming, jdlrobson: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:47 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]] | [production] | 
            
  | 21:46 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:46 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101573|Expand support for dark mode for anonymous users (itwiki, enwikivoyage) (T379352)]] (duration: 11m 08s) | [production] | 
            
  | 21:44 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:40 | <cjming@deploy2002> | jdlrobson, cjming: Continuing with sync | [production] | 
            
  | 21:39 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:39 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:38 | <cjming@deploy2002> | jdlrobson, cjming: Backport for [[gerrit:1101573|Expand support for dark mode for anonymous users (itwiki, enwikivoyage) (T379352)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:34 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101573|Expand support for dark mode for anonymous users (itwiki, enwikivoyage) (T379352)]] | [production] | 
            
  | 21:34 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:33 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1100158|cirrus: Enable mlr-2024 for select wikis (T377128)]] (duration: 10m 28s) | [production] | 
            
  | 21:32 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:29 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:28 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:27 | <cjming@deploy2002> | cjming, ebernhardson: Continuing with sync | [production] | 
            
  | 21:27 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 21:27 | <cjming@deploy2002> | cjming, ebernhardson: Backport for [[gerrit:1100158|cirrus: Enable mlr-2024 for select wikis (T377128)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:22 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1100158|cirrus: Enable mlr-2024 for select wikis (T377128)]] | [production] | 
            
  | 21:21 | <cjming@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1101541|Actually load IRS in production (T374105)]] (duration: 12m 29s) | [production] | 
            
  | 21:14 | <cjming@deploy2002> | cjming, mszabo: Continuing with sync | [production] | 
            
  | 21:13 | <cjming@deploy2002> | cjming, mszabo: Backport for [[gerrit:1101541|Actually load IRS in production (T374105)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:08 | <cjming@deploy2002> | Started scap sync-world: Backport for [[gerrit:1101541|Actually load IRS in production (T374105)]] | [production] | 
            
  | 20:25 | <aqu@deploy2002> | Finished deploy [airflow-dags/analytics@1d9b4b5]: Canary events generation: pooling (duration: 01m 46s) | [production] | 
            
  | 20:23 | <aqu@deploy2002> | Started deploy [airflow-dags/analytics@1d9b4b5]: Canary events generation: pooling | [production] |