| 2024-09-17
      
      ยง | 
    
  | 20:17 | <hashar@deploy1003> | ejegg, hashar: Backport for [[gerrit:649942|Assign the API portal to the Wikimedia group for CentralNotice (T270308)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:14 | <hashar@deploy1003> | Started scap sync-world: Backport for [[gerrit:649942|Assign the API portal to the Wikimedia group for CentralNotice (T270308)]] | [production] | 
            
  | 20:07 | <dcausse@deploy1003> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 20:07 | <dcausse@deploy1003> | helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 20:07 | <dcausse@deploy1003> | helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply | [production] | 
            
  | 20:00 | <wmbot~lucaswerkmeister@tools-bastion-13> | deployed 4cfe24a186 (fix background runner database config) | [tools.quickcategories] | 
            
  | 19:58 | <wmbot~lucaswerkmeister@tools-bastion-13> | kubectl delete deployment background-runner && kubectl create -f deployment.yaml # recreate background runner, seemed to be running old code version? idk | [tools.quickcategories] | 
            
  | 19:54 | <wmbot~lucaswerkmeister@tools-bastion-13> | deployed 0be765159c (editgroups from envvars) | [tools.quickcategories] | 
            
  | 19:53 | <wmbot~lucaswerkmeister@tools-bastion-13> | toolforge envvars create TOOL_EDITGROUPS__COMMONSWIKI__SINCE 2021-09-14T00:00:00Z | [tools.quickcategories] | 
            
  | 19:52 | <wmbot~lucaswerkmeister@tools-bastion-13> | toolforge envvars create TOOL_EDITGROUPS__COMMONSWIKI__URL "'https://editgroups-commons.toolforge.org/b/QC/{0}/'" | [tools.quickcategories] | 
            
  | 19:52 | <wmbot~lucaswerkmeister@tools-bastion-13> | toolforge envvars create TOOL_EDITGROUPS__COMMONSWIKI__DOMAIN commons.wikimedia.org | [tools.quickcategories] | 
            
  | 19:49 | <herron> | pyrra upgraded to 0.7.7-1 | [production] | 
            
  | 18:27 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 18:16 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs1024.eqiad.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 18:16 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs1023.eqiad.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 18:05 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs1023.eqiad.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 18:04 | <ryankemper@cumin2002> | END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 17:56 | <dzahn@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on gerrit2003.wikimedia.org with reason: in setup | [production] | 
            
  | 17:56 | <dzahn@cumin2002> | START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on gerrit2003.wikimedia.org with reason: in setup | [production] | 
            
  | 17:54 | <ryankemper@cumin2002> | START - Cookbook sre.wdqs.data-transfer (T370754, transfer categories jnl) xfer categories from wdqs2023.codfw.wmnet -> wdqs2024.codfw.wmnet w/ force delete existing files, repooling both afterwards | [production] | 
            
  | 17:53 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2209 (re)pooling @ 100%: T373103', diff saved to https://phabricator.wikimedia.org/P69237 and previous config saved to /var/cache/conftool/dbconfig/20240917-175321-arnaudb.json | [production] | 
            
  | 17:53 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'es2023 (re)pooling @ 100%: T373103', diff saved to https://phabricator.wikimedia.org/P69236 and previous config saved to /var/cache/conftool/dbconfig/20240917-175311-arnaudb.json | [production] | 
            
  | 17:53 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2214 (re)pooling @ 100%: T373103', diff saved to https://phabricator.wikimedia.org/P69235 and previous config saved to /var/cache/conftool/dbconfig/20240917-175306-arnaudb.json | [production] | 
            
  | 17:53 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2213 (re)pooling @ 100%: T373103', diff saved to https://phabricator.wikimedia.org/P69234 and previous config saved to /var/cache/conftool/dbconfig/20240917-175302-arnaudb.json | [production] | 
            
  | 17:44 | <dduvall@deploy1003> | Finished deploy [releng/jenkins-deploy@d93f2c7] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/83 (duration: 01m 13s) | [production] | 
            
  | 17:43 | <dduvall@deploy1003> | Started deploy [releng/jenkins-deploy@d93f2c7] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/83 | [production] | 
            
  | 17:39 | <elukey@cumin1002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host registry2005.codfw.wmnet | [production] | 
            
  | 17:39 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host registry2005.codfw.wmnet with OS bookworm | [production] | 
            
  | 17:38 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2209 (re)pooling @ 75%: T373103', diff saved to https://phabricator.wikimedia.org/P69233 and previous config saved to /var/cache/conftool/dbconfig/20240917-173816-arnaudb.json | [production] | 
            
  | 17:38 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'es2023 (re)pooling @ 75%: T373103', diff saved to https://phabricator.wikimedia.org/P69232 and previous config saved to /var/cache/conftool/dbconfig/20240917-173806-arnaudb.json | [production] | 
            
  | 17:38 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2214 (re)pooling @ 75%: T373103', diff saved to https://phabricator.wikimedia.org/P69231 and previous config saved to /var/cache/conftool/dbconfig/20240917-173801-arnaudb.json | [production] | 
            
  | 17:37 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2213 (re)pooling @ 75%: T373103', diff saved to https://phabricator.wikimedia.org/P69230 and previous config saved to /var/cache/conftool/dbconfig/20240917-173756-arnaudb.json | [production] | 
            
  | 17:23 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2209 (re)pooling @ 50%: T373103', diff saved to https://phabricator.wikimedia.org/P69229 and previous config saved to /var/cache/conftool/dbconfig/20240917-172310-arnaudb.json | [production] | 
            
  | 17:23 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'es2023 (re)pooling @ 50%: T373103', diff saved to https://phabricator.wikimedia.org/P69228 and previous config saved to /var/cache/conftool/dbconfig/20240917-172300-arnaudb.json | [production] | 
            
  | 17:22 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2214 (re)pooling @ 50%: T373103', diff saved to https://phabricator.wikimedia.org/P69227 and previous config saved to /var/cache/conftool/dbconfig/20240917-172255-arnaudb.json | [production] | 
            
  | 17:22 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2213 (re)pooling @ 50%: T373103', diff saved to https://phabricator.wikimedia.org/P69226 and previous config saved to /var/cache/conftool/dbconfig/20240917-172250-arnaudb.json | [production] | 
            
  | 17:22 | <dduvall@deploy1003> | Installation of scap version "4.103.0" completed for 211 hosts | [production] | 
            
  | 17:18 | <dduvall@deploy1003> | Installing scap version "4.103.0" for 211 hosts | [production] | 
            
  | 17:10 | <sukhe@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=(cp2039|cp2040).codfw.wmnet [reason: [maint done] depool for T373103] | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2376.codfw.wmnet | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2376.codfw.wmnet | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2375.codfw.wmnet | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2375.codfw.wmnet | [production] | 
            
  | 17:08 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2209 (re)pooling @ 25%: T373103', diff saved to https://phabricator.wikimedia.org/P69225 and previous config saved to /var/cache/conftool/dbconfig/20240917-170805-arnaudb.json | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2374.codfw.wmnet | [production] | 
            
  | 17:08 | <swfrench@cumin2002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2374.codfw.wmnet | [production] | 
            
  | 17:07 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'es2023 (re)pooling @ 25%: T373103', diff saved to https://phabricator.wikimedia.org/P69224 and previous config saved to /var/cache/conftool/dbconfig/20240917-170755-arnaudb.json | [production] | 
            
  | 17:07 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host mw2373.codfw.wmnet | [production] | 
            
  | 17:07 | <swfrench@cumin2002> | START - Cookbook sre.k8s.pool-depool-node pool for host mw2373.codfw.wmnet | [production] | 
            
  | 17:07 | <arnaudb@cumin1002> | dbctl commit (dc=all): 'db2214 (re)pooling @ 25%: T373103', diff saved to https://phabricator.wikimedia.org/P69223 and previous config saved to /var/cache/conftool/dbconfig/20240917-170749-arnaudb.json | [production] |