| 2024-09-10
      
      ยง | 
    
  | 20:30 | <kindrobot@deploy1003> | gergesshamon, kindrobot: Backport for [[gerrit:1071842|[arwiki] Change the wordmark and the tagline (T374430)]], [[gerrit:1071888|[arwiki] change Wikipedia logo (T374430)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:28 | <kindrobot@deploy1003> | Started scap sync-world: Backport for [[gerrit:1071842|[arwiki] Change the wordmark and the tagline (T374430)]], [[gerrit:1071888|[arwiki] change Wikipedia logo (T374430)]] | [production] | 
            
  | 20:23 | <kindrobot@deploy1003> | Finished scap sync-world: Backport for [[gerrit:1071037|Enable native MathML by default on group0 (T373703)]], [[gerrit:1071890|Configure QuickSurvey for Web empty search state experiments (T373039)]] (duration: 09m 37s) | [production] | 
            
  | 20:22 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db1206 (T371742)', diff saved to https://phabricator.wikimedia.org/P68855 and previous config saved to /var/cache/conftool/dbconfig/20240910-202207-ladsgroup.json | [production] | 
            
  | 20:22 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1206.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 20:21 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 12:00:00 on db1206.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 20:21 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1196 (T371742)', diff saved to https://phabricator.wikimedia.org/P68854 and previous config saved to /var/cache/conftool/dbconfig/20240910-202145-ladsgroup.json | [production] | 
            
  | 20:18 | <kindrobot@deploy1003> | kindrobot, jdrewniak, physikerwelt: Continuing with sync | [production] | 
            
  | 20:15 | <kindrobot@deploy1003> | kindrobot, jdrewniak, physikerwelt: Backport for [[gerrit:1071037|Enable native MathML by default on group0 (T373703)]], [[gerrit:1071890|Configure QuickSurvey for Web empty search state experiments (T373039)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 20:13 | <kindrobot@deploy1003> | Started scap sync-world: Backport for [[gerrit:1071037|Enable native MathML by default on group0 (T373703)]], [[gerrit:1071890|Configure QuickSurvey for Web empty search state experiments (T373039)]] | [production] | 
            
  | 20:06 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P68853 and previous config saved to /var/cache/conftool/dbconfig/20240910-200637-ladsgroup.json | [production] | 
            
  | 19:54 | <tzatziki> | removing 6 files for legal compliance | [production] | 
            
  | 19:51 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:51 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P68852 and previous config saved to /var/cache/conftool/dbconfig/20240910-195130-ladsgroup.json | [production] | 
            
  | 19:51 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:50 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:50 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:47 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:47 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:36 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1196 (T371742)', diff saved to https://phabricator.wikimedia.org/P68851 and previous config saved to /var/cache/conftool/dbconfig/20240910-193622-ladsgroup.json | [production] | 
            
  | 19:20 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:20 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:12 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:12 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:09 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:09 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:01 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 19:00 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 18:57 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 18:56 | <bking@deploy1003> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 18:56 | <bking@deploy1003> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 18:47 | <dduvall@deploy1003> | Finished deploy [releng/jenkins-deploy@71141b8] (releasing): (no justification provided) (duration: 00m 35s) | [production] | 
            
  | 18:47 | <dduvall@deploy1003> | Started deploy [releng/jenkins-deploy@71141b8] (releasing): (no justification provided) | [production] | 
            
  | 18:38 | <swfrench-wmf> | ran authdns-update on dns1004 (18:25 UTC) for T372604 | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db1196 (T371742)', diff saved to https://phabricator.wikimedia.org/P68849 and previous config saved to /var/cache/conftool/dbconfig/20240910-183055-ladsgroup.json | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1196.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 12:00:00 on db1196.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 18:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1195 (T371742)', diff saved to https://phabricator.wikimedia.org/P68848 and previous config saved to /var/cache/conftool/dbconfig/20240910-183016-ladsgroup.json | [production] | 
            
  | 18:26 | <dduvall@deploy1003> | Finished deploy [releng/jenkins-deploy@8be3b36] (releasing): (no justification provided) (duration: 05m 43s) | [production] | 
            
  | 18:20 | <dduvall@deploy1003> | Started deploy [releng/jenkins-deploy@8be3b36] (releasing): (no justification provided) | [production] | 
            
  | 18:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P68847 and previous config saved to /var/cache/conftool/dbconfig/20240910-181508-ladsgroup.json | [production] | 
            
  | 18:14 | <dduvall@deploy1003> | rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.22  refs T373641 | [production] | 
            
  | 18:04 | <swfrench-wmf> | ran sre.dns.netbox after adding mwdebug-next LVS VIPs for T372604 | [production] | 
            
  | 18:02 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 18:01 | <swfrench@cumin2002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add newly allocated LVS VIPs for mwdebug-next - swfrench@cumin2002" | [production] | 
            
  | 18:01 | <swfrench@cumin2002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add newly allocated LVS VIPs for mwdebug-next - swfrench@cumin2002" | [production] | 
            
  | 18:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P68846 and previous config saved to /var/cache/conftool/dbconfig/20240910-180001-ladsgroup.json | [production] | 
            
  | 17:57 | <swfrench@cumin2002> | START - Cookbook sre.dns.netbox | [production] |