801-850 of 10000 results (28ms)
2024-10-28 ยง
23:01 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
22:28 <ebernhardson@deploy2002> Finished deploy [airflow-dags/search@d85a93c]: add missing comma (duration: 00m 36s) [production]
22:27 <ebernhardson@deploy2002> Started deploy [airflow-dags/search@d85a93c]: add missing comma [production]
22:10 <ebernhardson@deploy2002> Finished deploy [airflow-dags/search@99eb6f3]: T375387: update discolytics to 0.27.0 (duration: 00m 50s) [production]
22:09 <ebernhardson@deploy2002> Started deploy [airflow-dags/search@99eb6f3]: T375387: update discolytics to 0.27.0 [production]
22:00 <ryankemper> T372074 `sudo requestctl delete ipblock abuse/wdqs` && `sudo requestctl delete pattern ua/wdqs_sparql` to clean up objects removed in commit `d26fc1e910579d33d33ec3d5a192d137045eba4b` ( <-- this occurred before the requestctl commit; i just missed making the irc log) [production]
21:48 <ryankemper> T372074 `sudo requestctl commit` [production]
21:29 <kostajh> UTC late deploys done, for real [production]
21:26 <ryankemper> T372074 `sudo requestctl delete action cache-text/T372074` && `sudo requestctl delete action cache-text/T372074_wdqs_codfw_flap` [production]
21:26 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1083902|GlobalContributionsPager: Make article link redirect to the page (T378155)]] (duration: 09m 01s) [production]
21:21 <kharlan@deploy2002> kharlan: Continuing with sync [production]
21:19 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1083902|GlobalContributionsPager: Make article link redirect to the page (T378155)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:17 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1083902|GlobalContributionsPager: Make article link redirect to the page (T378155)]] [production]
20:44 <kostajh> UTC late deploys done [production]
20:42 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1083874|Partial Revert "Make sure contributor's name is on its line" (T378142)]], [[gerrit:1083877|Restore missing second argument to "mapState" in QuickView.vue (T378204)]], [[gerrit:1083853|GlobalContributionsPager: Use Special:PermanentLink to construct link (T378155)]], [[gerrit:1083886|GlobalContributionsPager: Don't display external namespace in [production]
20:37 <kharlan@deploy2002> jdlrobson, kharlan: Continuing with sync [production]
20:33 <kharlan@deploy2002> jdlrobson, kharlan: Backport for [[gerrit:1083874|Partial Revert "Make sure contributor's name is on its line" (T378142)]], [[gerrit:1083877|Restore missing second argument to "mapState" in QuickView.vue (T378204)]], [[gerrit:1083853|GlobalContributionsPager: Use Special:PermanentLink to construct link (T378155)]], [[gerrit:1083886|GlobalContributionsPager: Don't display external namespace in artic [production]
20:31 <wmbot~bd808@tools-bastion-12> Restart to pick up new container image (T378379, T378412) [tools.schedule-deployment]
20:30 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1083874|Partial Revert "Make sure contributor's name is on its line" (T378142)]], [[gerrit:1083877|Restore missing second argument to "mapState" in QuickView.vue (T378204)]], [[gerrit:1083853|GlobalContributionsPager: Use Special:PermanentLink to construct link (T378155)]], [[gerrit:1083886|GlobalContributionsPager: Don't display external namespace in [production]
20:19 <wmbot~bd808@tools-bastion-12> Built new image from 9b970a84 (T378379, T378412) [tools.schedule-deployment]
19:52 <brett> Removed RSA certificate support from tlsproxy (T375569) [production]
19:33 <brett> Removed RSA certificate support from mirrors, dumps (T375569) [production]
19:27 <gmodena@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:26 <gmodena@deploy2002> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:24 <gmodena@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:24 <gmodena@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:23 <brett> Removed RSA certificate support from ldap, archiva, durum [production]
19:21 <gmodena@deploy2002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:21 <gmodena@deploy2002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
19:18 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:17 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:15 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:15 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich: apply [production]
19:14 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
19:13 <gmodena@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-dump-rev-content-reconcile-enrich-next: apply [production]
17:43 <jiawang@deploy2002> Finished deploy [airflow-dags/analytics_product@a7456f9]: deploy tsp pipelines (duration: 01m 33s) [production]
17:42 <jiawang@deploy2002> Started deploy [airflow-dags/analytics_product@a7456f9]: deploy tsp pipelines [production]
17:04 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on cloudvirt1063.eqiad.wmnet with reason: cloudvirt1063 needs maintenance T375223 [production]
17:03 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on cloudvirt1063.eqiad.wmnet with reason: cloudvirt1063 needs maintenance T375223 [production]
17:01 <aborrero@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
17:00 <arturo> [codfw1dev] restarting rabbitmq, misbehaving [admin]
17:00 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
16:55 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1013.eqiad.wmnet [production]
16:54 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
16:54 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
16:53 <aborrero@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
16:53 <aborrero@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
16:50 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1013.eqiad.wmnet [production]
16:50 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1014.eqiad.wmnet [production]
16:44 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1014.eqiad.wmnet [production]