301-350 of 10000 results (20ms)
2026-11-17 ยง
10:56 <ladsgroup@deploy2003> ladsgroup: Continuing with deployment [production]
10:55 <ladsgroup@deploy2003> ladsgroup: Backport for [[gerrit:1370451|Flip the condition on DASH (T357184)]] (1.48.0-wmf.5) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
10:54 <trueg@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply [production]
10:52 <marostegui@cumin1004> START - Cookbook sre.hosts.decommission for hosts dborch1003.eqiad.wmnet [production]
10:52 <trueg@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply [production]
10:51 <ladsgroup@deploy2003> Started scap sync-world: Backport for [[gerrit:1370451|Flip the condition on DASH (T357184)]] (1.48.0-wmf.5) [production]
10:48 <trueg@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply [production]
10:48 <marostegui@cumin1004> END (ERROR) - Cookbook sre.mysql.decommission (exit_code=1) [production]
10:48 <marostegui@cumin1004> START - Cookbook sre.mysql.decommission [production]
10:47 <btullis@cumin1004> START - Cookbook sre.hosts.reboot-single for host clouddumps1002.wikimedia.org [production]
10:46 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: cluster=dumps,dc=eqiad,name=clouddumps1002.wikimedia.org [production]
10:36 <vgutierrez@cumin1004> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) rebooting A:liberica-magru (T444802) [production]
10:33 <trueg@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply [production]
10:31 <brouberol@cumin1004> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host archiva1002.wikimedia.org [production]
10:31 <arnaudb@cumin1004> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: upgrade [production]
10:30 <arnaudb@cumin1004> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: upgrade [production]
10:27 <brouberol@cumin1004> START - Cookbook sre.hosts.reboot-single for host archiva1002.wikimedia.org [production]
10:24 <vgutierrez@cumin1004> START - Cookbook sre.loadbalancer.admin rebooting A:liberica-magru (T444802) [production]
10:20 <arnaudb@cumin1004> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: upgrade [production]
10:18 <arnaudb@cumin1004> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: upgrade [production]
10:15 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install2005.wikimedia.org [production]
10:09 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install2005.wikimedia.org [production]
10:08 <arnaudb@cumin1004> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: upgrade [production]
10:06 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install3004.wikimedia.org [production]
10:01 <XioNoX> un-drain magru-codfw HE transport link [production]
09:59 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install3004.wikimedia.org [production]
09:53 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install4004.wikimedia.org [production]
09:52 <chlod@deploy2003> Finished scap sync-world: Backport for [[gerrit:1370436|Lift IP cap for UKM workshop (T445180)]] (duration: 18m 49s) [production]
09:49 <trueg@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
09:47 <moritzm> installing libdbi-perl security updates [production]
09:46 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install4004.wikimedia.org [production]
09:46 <trueg@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
09:42 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install5004.wikimedia.org [production]
09:41 <chlod@deploy2003> chlod: Continuing with deployment [production]
09:40 <chlod@deploy2003> chlod: Backport for [[gerrit:1370436|Lift IP cap for UKM workshop (T445180)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
09:36 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org [production]
09:33 <chlod@deploy2003> Started scap sync-world: Backport for [[gerrit:1370436|Lift IP cap for UKM workshop (T445180)]] [production]
09:32 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install5004.wikimedia.org [production]
09:32 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org [production]
09:31 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install6003.wikimedia.org [production]
09:31 <moritzm> installing vim security updates [production]
09:27 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dborch1002.wikimedia.org [production]
09:25 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install6003.wikimedia.org [production]
09:23 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host dborch1002.wikimedia.org [production]
09:22 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install7002.wikimedia.org [production]
09:16 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install7002.wikimedia.org [production]
09:15 <jelto@cumin1004> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host contint2003.wikimedia.org [production]
09:09 <jelto@cumin1004> START - Cookbook sre.hosts.reboot-single for host contint2003.wikimedia.org [production]
09:08 <jelto@cumin1004> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host contint1003.wikimedia.org [production]
09:07 <marostegui> Stop mariadb on clouddb1017 https://phabricator.wikimedia.org/T445177 [production]