| 2024-11-28
      
      ยง | 
    
  | 05:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P71301 and previous config saved to /var/cache/conftool/dbconfig/20241128-053340-ladsgroup.json | [production] | 
            
  | 05:29 | <tstarling@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1098652|Add frwiki on labs for new addWiki.php test]] (duration: 13m 41s) | [production] | 
            
  | 05:23 | <tstarling@deploy2002> | tstarling: Continuing with sync | [production] | 
            
  | 05:22 | <tstarling@deploy2002> | tstarling: Backport for [[gerrit:1098652|Add frwiki on labs for new addWiki.php test]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 05:18 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2166 (T370903)', diff saved to https://phabricator.wikimedia.org/P71300 and previous config saved to /var/cache/conftool/dbconfig/20241128-051833-ladsgroup.json | [production] | 
            
  | 05:16 | <tstarling@deploy2002> | Started scap sync-world: Backport for [[gerrit:1098652|Add frwiki on labs for new addWiki.php test]] | [production] | 
            
  | 05:06 | <kartik@deploy2002> | helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . | [production] | 
            
  | 05:03 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2166 (T370903)', diff saved to https://phabricator.wikimedia.org/P71299 and previous config saved to /var/cache/conftool/dbconfig/20241128-050352-ladsgroup.json | [production] | 
            
  | 05:03 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2166.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 05:03 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2166.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 05:03 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71298 and previous config saved to /var/cache/conftool/dbconfig/20241128-050329-ladsgroup.json | [production] | 
            
  | 04:48 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P71297 and previous config saved to /var/cache/conftool/dbconfig/20241128-044822-ladsgroup.json | [production] | 
            
  | 04:41 | <eileen> | civicrm upgraded from ed67a1b2 to be7e5d33 | [production] | 
            
  | 04:36 | <eileen> | * civicrm upgraded from 40f4f1a3 to ed67a1b2 | [production] | 
            
  | 04:33 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P71296 and previous config saved to /var/cache/conftool/dbconfig/20241128-043314-ladsgroup.json | [production] | 
            
  | 04:26 | <eileen> | * civicrm upgraded from 7ade5fd7 to 40f4f1a3 | [production] | 
            
  | 04:18 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71294 and previous config saved to /var/cache/conftool/dbconfig/20241128-041807-ladsgroup.json | [production] | 
            
  | 04:03 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2164 (T370903)', diff saved to https://phabricator.wikimedia.org/P71292 and previous config saved to /var/cache/conftool/dbconfig/20241128-040326-ladsgroup.json | [production] | 
            
  | 04:03 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on db2186.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:03 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 16:00:00 on db2186.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:03 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2164.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:02 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2164.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 04:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71291 and previous config saved to /var/cache/conftool/dbconfig/20241128-040248-ladsgroup.json | [production] | 
            
  | 03:47 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P71290 and previous config saved to /var/cache/conftool/dbconfig/20241128-034741-ladsgroup.json | [production] | 
            
  | 03:32 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P71289 and previous config saved to /var/cache/conftool/dbconfig/20241128-033234-ladsgroup.json | [production] | 
            
  | 03:22 | <eileen> | config revision changed from f284fd46 to a3175f86 (like for real this time) | [production] | 
            
  | 03:17 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71288 and previous config saved to /var/cache/conftool/dbconfig/20241128-031726-ladsgroup.json | [production] | 
            
  | 03:14 | <eileen> | onfig revision changed from f284fd46 to a3175f86 | [production] | 
            
  | 03:02 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2163 (T370903)', diff saved to https://phabricator.wikimedia.org/P71287 and previous config saved to /var/cache/conftool/dbconfig/20241128-030213-ladsgroup.json | [production] | 
            
  | 03:02 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2163.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 03:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2163.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 03:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71286 and previous config saved to /var/cache/conftool/dbconfig/20241128-030151-ladsgroup.json | [production] | 
            
  | 02:53 | <eileen> | civicrm upgraded from c8c461b9 to 7ade5fd7 | [production] | 
            
  | 02:46 | <eileen> | * civicrm upgraded from 80f03357 to c8c461b9 | [production] | 
            
  | 02:46 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P71285 and previous config saved to /var/cache/conftool/dbconfig/20241128-024644-ladsgroup.json | [production] | 
            
  | 02:31 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P71284 and previous config saved to /var/cache/conftool/dbconfig/20241128-023136-ladsgroup.json | [production] | 
            
  | 02:16 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71283 and previous config saved to /var/cache/conftool/dbconfig/20241128-021629-ladsgroup.json | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2162 (T370903)', diff saved to https://phabricator.wikimedia.org/P71282 and previous config saved to /var/cache/conftool/dbconfig/20241128-020143-ladsgroup.json | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2162.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2162.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 02:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71281 and previous config saved to /var/cache/conftool/dbconfig/20241128-020120-ladsgroup.json | [production] | 
            
  | 01:46 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P71280 and previous config saved to /var/cache/conftool/dbconfig/20241128-014613-ladsgroup.json | [production] | 
            
  | 01:38 | <eileen> | civicrm upgraded from 3b1ed162 to 80f03357 | [production] | 
            
  | 01:31 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P71279 and previous config saved to /var/cache/conftool/dbconfig/20241128-013106-ladsgroup.json | [production] | 
            
  | 01:16 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71278 and previous config saved to /var/cache/conftool/dbconfig/20241128-011559-ladsgroup.json | [production] | 
            
  | 01:01 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db2161 (T370903)', diff saved to https://phabricator.wikimedia.org/P71277 and previous config saved to /var/cache/conftool/dbconfig/20241128-010112-ladsgroup.json | [production] | 
            
  | 01:01 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2161.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 01:00 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 8:00:00 on db2161.codfw.wmnet with reason: Maintenance | [production] | 
            
  | 01:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154 (T370903)', diff saved to https://phabricator.wikimedia.org/P71276 and previous config saved to /var/cache/conftool/dbconfig/20241128-010049-ladsgroup.json | [production] | 
            
  | 00:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P71275 and previous config saved to /var/cache/conftool/dbconfig/20241128-004542-ladsgroup.json | [production] |