| 2024-10-29
      
      ยง | 
    
  | 23:46 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2216.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 23:45 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2216.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 23:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212 (T376905)', diff saved to https://phabricator.wikimedia.org/P70667 and previous config saved to /var/cache/conftool/dbconfig/20241029-234541-ladsgroup.json | [production] | 
            
  | 23:41 | <zabe@deploy2002> | Started scap sync-world: Creating tcywiktionary (T377922) | [production] | 
            
  | 23:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P70666 and previous config saved to /var/cache/conftool/dbconfig/20241029-233034-ladsgroup.json | [production] | 
            
  | 23:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P70665 and previous config saved to /var/cache/conftool/dbconfig/20241029-231527-ladsgroup.json | [production] | 
            
  | 23:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2212 (T376905)', diff saved to https://phabricator.wikimedia.org/P70664 and previous config saved to /var/cache/conftool/dbconfig/20241029-230020-ladsgroup.json | [production] | 
            
  | 22:47 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2202.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 22:47 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2202.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 22:47 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2188 (T376905)', diff saved to https://phabricator.wikimedia.org/P70662 and previous config saved to /var/cache/conftool/dbconfig/20241029-224717-ladsgroup.json | [production] | 
            
  | 22:32 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2188', diff saved to https://phabricator.wikimedia.org/P70661 and previous config saved to /var/cache/conftool/dbconfig/20241029-223210-ladsgroup.json | [production] | 
            
  | 22:17 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2188', diff saved to https://phabricator.wikimedia.org/P70660 and previous config saved to /var/cache/conftool/dbconfig/20241029-221703-ladsgroup.json | [production] | 
            
  | 22:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2188 (T376905)', diff saved to https://phabricator.wikimedia.org/P70659 and previous config saved to /var/cache/conftool/dbconfig/20241029-220156-ladsgroup.json | [production] | 
            
  | 21:54 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2188 (T376905)', diff saved to https://phabricator.wikimedia.org/P70658 and previous config saved to /var/cache/conftool/dbconfig/20241029-215443-ladsgroup.json | [production] | 
            
  | 21:54 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2188.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 21:54 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2188.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 21:54 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2176 (T376905)', diff saved to https://phabricator.wikimedia.org/P70657 and previous config saved to /var/cache/conftool/dbconfig/20241029-215417-ladsgroup.json | [production] | 
            
  | 21:39 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2176', diff saved to https://phabricator.wikimedia.org/P70656 and previous config saved to /var/cache/conftool/dbconfig/20241029-213910-ladsgroup.json | [production] | 
            
  | 21:24 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2176', diff saved to https://phabricator.wikimedia.org/P70655 and previous config saved to /var/cache/conftool/dbconfig/20241029-212402-ladsgroup.json | [production] | 
            
  | 21:09 | <eileen> | civicrm upgraded from 0b7f3b47 to 0eb881ca | [production] | 
            
  | 21:08 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2176 (T376905)', diff saved to https://phabricator.wikimedia.org/P70654 and previous config saved to /var/cache/conftool/dbconfig/20241029-210855-ladsgroup.json | [production] | 
            
  | 20:57 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2176 (T376905)', diff saved to https://phabricator.wikimedia.org/P70653 and previous config saved to /var/cache/conftool/dbconfig/20241029-205718-ladsgroup.json | [production] | 
            
  | 20:57 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2176.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 20:57 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2176.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 20:56 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174 (T376905)', diff saved to https://phabricator.wikimedia.org/P70652 and previous config saved to /var/cache/conftool/dbconfig/20241029-205652-ladsgroup.json | [production] | 
            
  | 20:41 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P70651 and previous config saved to /var/cache/conftool/dbconfig/20241029-204145-ladsgroup.json | [production] | 
            
  | 20:26 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174', diff saved to https://phabricator.wikimedia.org/P70650 and previous config saved to /var/cache/conftool/dbconfig/20241029-202638-ladsgroup.json | [production] | 
            
  | 20:14 | <kostajh> | UTC late deploys done | [production] | 
            
  | 20:12 | <kharlan@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1084183|QuickSurveys: Undeploy safety survey (T376517)]], [[gerrit:1082875|Missing.php: redirect wikisources to localized main page]] (duration: 09m 16s) | [production] | 
            
  | 20:11 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2174 (T376905)', diff saved to https://phabricator.wikimedia.org/P70649 and previous config saved to /var/cache/conftool/dbconfig/20241029-201131-ladsgroup.json | [production] | 
            
  | 20:08 | <kharlan@deploy2002> | pppery, kharlan: Continuing with sync | [production] | 
            
  | 20:05 | <kharlan@deploy2002> | pppery, kharlan: Backport for [[gerrit:1084183|QuickSurveys: Undeploy safety survey (T376517)]], [[gerrit:1082875|Missing.php: redirect wikisources to localized main page]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:03 | <kharlan@deploy2002> | Started scap sync-world: Backport for [[gerrit:1084183|QuickSurveys: Undeploy safety survey (T376517)]], [[gerrit:1082875|Missing.php: redirect wikisources to localized main page]] | [production] | 
            
  | 20:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2174 (T376905)', diff saved to https://phabricator.wikimedia.org/P70648 and previous config saved to /var/cache/conftool/dbconfig/20241029-200056-ladsgroup.json | [production] | 
            
  | 20:00 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2174.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 20:00 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2174.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 20:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2173 (T376905)', diff saved to https://phabricator.wikimedia.org/P70647 and previous config saved to /var/cache/conftool/dbconfig/20241029-200029-ladsgroup.json | [production] | 
            
  | 19:56 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6 days, 0:00:00 on an-worker1165.eqiad.wmnet with reason: T378454 | [production] | 
            
  | 19:55 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 6 days, 0:00:00 on an-worker1165.eqiad.wmnet with reason: T378454 | [production] | 
            
  | 19:48 | <eileen> | civicrm upgraded from 8f5c8b33 to 0b7f3b47 | [production] | 
            
  | 19:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P70646 and previous config saved to /var/cache/conftool/dbconfig/20241029-194522-ladsgroup.json | [production] | 
            
  | 19:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2173', diff saved to https://phabricator.wikimedia.org/P70645 and previous config saved to /var/cache/conftool/dbconfig/20241029-193015-ladsgroup.json | [production] | 
            
  | 19:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2173 (T376905)', diff saved to https://phabricator.wikimedia.org/P70644 and previous config saved to /var/cache/conftool/dbconfig/20241029-191508-ladsgroup.json | [production] | 
            
  | 19:05 | <eileen> | civicrm upgraded from 1c6c4e08 to 8f5c8b33 | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2173 (T376905)', diff saved to https://phabricator.wikimedia.org/P70643 and previous config saved to /var/cache/conftool/dbconfig/20241029-190442-ladsgroup.json | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2186.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db2186.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2173.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2173.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 19:04 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2170 (T376905)', diff saved to https://phabricator.wikimedia.org/P70642 and previous config saved to /var/cache/conftool/dbconfig/20241029-190359-ladsgroup.json | [production] |