|
2026-05-28
ยง
|
| 09:00 |
<joal@deploy1003> |
Finished deploy [analytics/refinery@878cb24] (thin): Regular analytics weekly train THIN - 2[analytics/refinery@878cb24a] (duration: 02m 08s) |
[production] |
| 08:59 |
<jnuche@deploy1003> |
Started deploy [releng/jenkins-deploy@6200ab1] (releasing): T427406 Deploying to prod |
[production] |
| 08:58 |
<joal@deploy1003> |
Started deploy [analytics/refinery@878cb24] (thin): Regular analytics weekly train THIN - 2[analytics/refinery@878cb24a] |
[production] |
| 08:57 |
<jnuche@deploy1003> |
Finished deploy [releng/jenkins-deploy@6200ab1] (releasing): T427406 Testing on backup host (duration: 00m 53s) |
[production] |
| 08:56 |
<jnuche@deploy1003> |
Started deploy [releng/jenkins-deploy@6200ab1] (releasing): T427406 Testing on backup host |
[production] |
| 08:56 |
<joal@deploy1003> |
Finished deploy [analytics/refinery@878cb24]: Regular analytics weekly train - 2 [analytics/refinery@878cb24a] (duration: 06m 54s) |
[production] |
| 08:52 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1209 (T419635)', diff saved to https://phabricator.wikimedia.org/P93327 and previous config saved to /var/cache/conftool/dbconfig/20260528-085216-fceratto.json |
[production] |
| 08:50 |
<XioNoX> |
cr1-codfw# delete protocols bgp group fundraising family inet6 - T423384 |
[production] |
| 08:49 |
<joal@deploy1003> |
Started deploy [analytics/refinery@878cb24]: Regular analytics weekly train - 2 [analytics/refinery@878cb24a] |
[production] |
| 08:49 |
<dreamyjazz@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1294925|hCaptcha: Regenerate VisualEditor captcha token per save attempt (T427334)]] (duration: 09m 20s) |
[production] |
| 08:49 |
<joal@deploy1003> |
Finished deploy [analytics/refinery@878cb24] (hadoop-test): Regular analytics weekly train TEST -2 [analytics/refinery@878cb24a] (duration: 02m 00s) |
[production] |
| 08:49 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1209 (T419635)', diff saved to https://phabricator.wikimedia.org/P93326 and previous config saved to /var/cache/conftool/dbconfig/20260528-084906-fceratto.json |
[production] |
| 08:48 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1209.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:48 |
<slyngshede@dns1004> |
END - running authdns-update |
[production] |
| 08:47 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool pool db1165: Reboot completed |
[production] |
| 08:47 |
<joal@deploy1003> |
Started deploy [analytics/refinery@878cb24] (hadoop-test): Regular analytics weekly train TEST -2 [analytics/refinery@878cb24a] |
[production] |
| 08:47 |
<slyngs> |
Upgrade IDP to CAS 7.3.7.1 |
[production] |
| 08:46 |
<slyngshede@dns1004> |
START - running authdns-update |
[production] |
| 08:45 |
<dreamyjazz@deploy1003> |
dreamyjazz: Continuing with deployment |
[production] |
| 08:41 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1165 (T426633)', diff saved to https://phabricator.wikimedia.org/P93324 and previous config saved to /var/cache/conftool/dbconfig/20260528-084149-fceratto.json |
[production] |
| 08:41 |
<dreamyjazz@deploy1003> |
dreamyjazz: Backport for [[gerrit:1294925|hCaptcha: Regenerate VisualEditor captcha token per save attempt (T427334)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 08:40 |
<dreamyjazz@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1294925|hCaptcha: Regenerate VisualEditor captcha token per save attempt (T427334)]] |
[production] |
| 08:39 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rpki2003.codfw.wmnet |
[production] |
| 08:37 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host rpki2003.codfw.wmnet |
[production] |
| 08:35 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1165 (T426633)', diff saved to https://phabricator.wikimedia.org/P93323 and previous config saved to /var/cache/conftool/dbconfig/20260528-083504-fceratto.json |
[production] |
| 08:34 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1025].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:34 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1165.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:33 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93322 and previous config saved to /var/cache/conftool/dbconfig/20260528-083331-fceratto.json |
[production] |
| 08:24 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1209: Test |
[production] |
| 08:23 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P93320 and previous config saved to /var/cache/conftool/dbconfig/20260528-082324-fceratto.json |
[production] |
| 08:23 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2189: repool after crash |
[production] |
| 08:17 |
<slyngshede@dns1004> |
END - running authdns-update |
[production] |
| 08:16 |
<slyngshede@dns1004> |
START - running authdns-update |
[production] |
| 08:13 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P93318 and previous config saved to /var/cache/conftool/dbconfig/20260528-081316-fceratto.json |
[production] |
| 08:10 |
<jnuche@deploy1003> |
rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.4 refs T423913 |
[production] |
| 08:09 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.pool pool db1209: Test |
[production] |
| 08:05 |
<hashar@deploy1003> |
Finished deploy [integration/docroot@2a51016]: build: update dependencies + eslint fix in comment. f021d3f..2a51016 (duration: 00m 13s) |
[production] |
| 08:05 |
<hashar@deploy1003> |
Started deploy [integration/docroot@2a51016]: build: update dependencies + eslint fix in comment. f021d3f..2a51016 |
[production] |
| 08:03 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93315 and previous config saved to /var/cache/conftool/dbconfig/20260528-080309-fceratto.json |
[production] |
| 07:56 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93314 and previous config saved to /var/cache/conftool/dbconfig/20260528-075631-fceratto.json |
[production] |
| 07:56 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1016,1020,1022-1023].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:56 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1211.eqiad.wmnet with reason: Maintenance |
[production] |
| 07:55 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1264 (T426633)', diff saved to https://phabricator.wikimedia.org/P93313 and previous config saved to /var/cache/conftool/dbconfig/20260528-075521-fceratto.json |
[production] |
| 07:47 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:45 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1264', diff saved to https://phabricator.wikimedia.org/P93311 and previous config saved to /var/cache/conftool/dbconfig/20260528-074513-fceratto.json |
[production] |
| 07:37 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.pool pool db2189: repool after crash |
[production] |
| 07:36 |
<jelto@cumin1003> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:35 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1264', diff saved to https://phabricator.wikimedia.org/P93309 and previous config saved to /var/cache/conftool/dbconfig/20260528-073506-fceratto.json |
[production] |
| 07:34 |
<jelto@cumin1003> |
END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica |
[production] |
| 07:29 |
<wmde-fisch@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1294808|Don't run the click intent experiment on mobile (T426743)]] (duration: 06m 29s) |
[production] |