| 2024-11-28
      
      § | 
    
  | 04:03 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2164.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:02 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2164.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71291 and previous config saved to /var/cache/conftool/dbconfig/20241128-040248-ladsgroup.json | [production] | 
            
  | 03:47 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P71290 and previous config saved to /var/cache/conftool/dbconfig/20241128-034741-ladsgroup.json | [production] | 
            
  | 03:32 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P71289 and previous config saved to /var/cache/conftool/dbconfig/20241128-033234-ladsgroup.json | [production] | 
            
  | 03:22 | <eileen> | config revision changed from f284fd46 to a3175f86 (like for real this time) | [production] | 
            
  | 03:17 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71288 and previous config saved to /var/cache/conftool/dbconfig/20241128-031726-ladsgroup.json | [production] | 
            
  | 03:14 | <eileen> | onfig revision changed from f284fd46 to a3175f86 | [production] | 
            
  | 03:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71287 and previous config saved to /var/cache/conftool/dbconfig/20241128-030213-ladsgroup.json | [production] | 
            
  | 03:02 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2163.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 03:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2163.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 03:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71286 and previous config saved to /var/cache/conftool/dbconfig/20241128-030151-ladsgroup.json | [production] | 
            
  | 02:53 | <eileen> | civicrm upgraded from c8c461b9 to 7ade5fd7 | [production] | 
            
  | 02:46 | <eileen> | * civicrm upgraded from 80f03357 to c8c461b9 | [production] | 
            
  | 02:46 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P71285 and previous config saved to /var/cache/conftool/dbconfig/20241128-024644-ladsgroup.json | [production] | 
            
  | 02:31 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P71284 and previous config saved to /var/cache/conftool/dbconfig/20241128-023136-ladsgroup.json | [production] | 
            
  | 02:16 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71283 and previous config saved to /var/cache/conftool/dbconfig/20241128-021629-ladsgroup.json | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71282 and previous config saved to /var/cache/conftool/dbconfig/20241128-020143-ladsgroup.json | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2162.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2162.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71281 and previous config saved to /var/cache/conftool/dbconfig/20241128-020120-ladsgroup.json | [production] | 
            
  | 01:46 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P71280 and previous config saved to /var/cache/conftool/dbconfig/20241128-014613-ladsgroup.json | [production] | 
            
  | 01:38 | <eileen> | civicrm upgraded from 3b1ed162 to 80f03357 | [production] | 
            
  | 01:31 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P71279 and previous config saved to /var/cache/conftool/dbconfig/20241128-013106-ladsgroup.json | [production] | 
            
  | 01:16 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71278 and previous config saved to /var/cache/conftool/dbconfig/20241128-011559-ladsgroup.json | [production] | 
            
  | 01:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71277 and previous config saved to /var/cache/conftool/dbconfig/20241128-010112-ladsgroup.json | [production] | 
            
  | 01:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2161.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 01:00 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2161.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 01:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154 (T370903)', diff saved to https://phabricator.wikimedia.org/P71276 and previous config saved to /var/cache/conftool/dbconfig/20241128-010049-ladsgroup.json | [production] | 
            
  | 00:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P71275 and previous config saved to /var/cache/conftool/dbconfig/20241128-004542-ladsgroup.json | [production] | 
            
  | 00:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P71274 and previous config saved to /var/cache/conftool/dbconfig/20241128-003035-ladsgroup.json | [production] | 
            
  | 00:16 | <tstarling@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1094126|Move default main page text for new wikis to config (T352113)]], [[gerrit:1096839|Introduce preinstall.dblist for wikis that haven't been installed yet (T352113)]] (duration: 14m 42s) | [production] | 
            
  | 00:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154 (T370903)', diff saved to https://phabricator.wikimedia.org/P71273 and previous config saved to /var/cache/conftool/dbconfig/20241128-001528-ladsgroup.json | [production] | 
            
  | 00:09 | <tstarling@deploy2002> | tstarling: Continuing with sync | [production] | 
            
  | 00:07 | <tstarling@deploy2002> | tstarling: Backport for [[gerrit:1094126|Move default main page text for new wikis to config (T352113)]], [[gerrit:1096839|Introduce preinstall.dblist for wikis that haven't been installed yet (T352113)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 00:01 | <tstarling@deploy2002> | Started scap sync-world: Backport for [[gerrit:1094126|Move default main page text for new wikis to config (T352113)]], [[gerrit:1096839|Introduce preinstall.dblist for wikis that haven't been installed yet (T352113)]] | [production] | 
            
  | 00:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2154 (T370903)', diff saved to https://phabricator.wikimedia.org/P71272 and previous config saved to /var/cache/conftool/dbconfig/20241128-000046-ladsgroup.json | [production] | 
            
  | 00:00 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2154.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 00:00 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2154.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 00:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2152 (T370903)', diff saved to https://phabricator.wikimedia.org/P71271 and previous config saved to /var/cache/conftool/dbconfig/20241128-000023-ladsgroup.json | [production] | 
            
  
    | 2024-11-27
      
      § | 
    
  | 23:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P71270 and previous config saved to /var/cache/conftool/dbconfig/20241127-234518-ladsgroup.json | [production] | 
            
  | 23:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P71269 and previous config saved to /var/cache/conftool/dbconfig/20241127-233011-ladsgroup.json | [production] | 
            
  | 23:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2152 (T370903)', diff saved to https://phabricator.wikimedia.org/P71267 and previous config saved to /var/cache/conftool/dbconfig/20241127-231504-ladsgroup.json | [production] | 
            
  | 23:09 | <tgr@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1098633|Fix mobile domain logic for login.wikimedia.org (T380646)]] (duration: 18m 07s) | [production] | 
            
  | 23:02 | <tgr@deploy2002> | tgr: Continuing with sync | [production] | 
            
  | 23:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2152 (T370903)', diff saved to https://phabricator.wikimedia.org/P71264 and previous config saved to /var/cache/conftool/dbconfig/20241127-230159-ladsgroup.json | [production] | 
            
  | 23:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2152.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 23:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2152.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 22:56 | <tgr@deploy2002> | tgr: Backport for [[gerrit:1098633|Fix mobile domain logic for login.wikimedia.org (T380646)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:52 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance | [production] |