801-850 of 10000 results (15ms)
2025-11-18 ยง
15:21 <hashar> Reloaded Zuul for "add option to opt out recursive dependencies" | https://gerrit.wikimedia.org/r/c/integration/config/+/1202059 . That is a noop. [releng]
15:16 <sgimeno@deploy2002> novemlinguae, sgimeno: Continuing with sync [production]
15:13 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [admin]
15:12 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
15:11 <sgimeno@deploy2002> novemlinguae, sgimeno: Backport for [[gerrit:1206851|undeploy Extension:Capiunto (T410172)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:06 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:05 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:03 <btullis@dns1004> END - running authdns-update [production]
15:03 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1059.eqiad.wmnet with reason: host reimage [production]
15:02 <btullis@dns1004> START - running authdns-update [production]
14:59 <taavi> $ toolforge jobs restart irc # to get it to join channels after the bouncer pod was moved to a different node [tools.wikibugs]
14:57 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1059.eqiad.wmnet with reason: host reimage [production]
14:48 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm enc-4 (cluster eqiad1) [cloudinfra]
14:48 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1076-1 (cluster eqiad1) [cloudvirt-canary]
14:48 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm enc-4 (cluster eqiad1) [cloudinfra]
14:48 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1076-1 (cluster eqiad1) [cloudvirt-canary]
14:48 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1075-1 (cluster eqiad1) [cloudvirt-canary]
14:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm enc-3 (cluster eqiad1) [cloudinfra]
14:47 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1075-1 (cluster eqiad1) [cloudvirt-canary]
14:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1074-1 (cluster eqiad1) [cloudvirt-canary]
14:47 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm enc-3 (cluster eqiad1) [cloudinfra]
14:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm docker-registry-01 (cluster eqiad1) [cloudinfra]
14:47 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1074-1 (cluster eqiad1) [cloudvirt-canary]
14:47 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1073-1 (cluster eqiad1) [cloudvirt-canary]
14:46 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm docker-registry-01 (cluster eqiad1) [cloudinfra]
14:46 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1073-1 (cluster eqiad1) [cloudvirt-canary]
14:46 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1072-1 (cluster eqiad1) [cloudvirt-canary]
14:46 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm chartmuseum-2 (cluster eqiad1) [cloudinfra]
14:45 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm chartmuseum-2 (cluster eqiad1) [cloudinfra]
14:45 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1072-1 (cluster eqiad1) [cloudvirt-canary]
14:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1071-1 (cluster eqiad1) [cloudvirt-canary]
14:45 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1071-1 (cluster eqiad1) [cloudvirt-canary]
14:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1070-1 (cluster eqiad1) [cloudvirt-canary]
14:45 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance abogott-testvm [wikicommunityhealth]
14:45 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance abogott-testvm [wikicommunityhealth]
14:44 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1070-1 (cluster eqiad1) [cloudvirt-canary]
14:44 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1069-1 (cluster eqiad1) [cloudvirt-canary]
14:44 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance abogott-test-instance [account-creation-assistance]
14:44 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance abogott-test-instance [account-creation-assistance]
14:44 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1069-1 (cluster eqiad1) [cloudvirt-canary]
14:44 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm canary1068-1 (cluster eqiad1) [cloudvirt-canary]
14:44 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1060.eqiad.wmnet' [admin]
14:43 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm canary1068-1 (cluster eqiad1) [cloudvirt-canary]
14:43 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1206851|undeploy Extension:Capiunto (T410172)]] [production]
14:41 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm metricsinfra-thanos-fe-2 (cluster eqiad1) [metricsinfra]
14:41 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudvirt1059.eqiad.wmnet with OS trixie [production]
14:41 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm metricsinfra-thanos-fe-2 (cluster eqiad1) [metricsinfra]
14:40 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1203812|EventStreamConfig: add stream for Growth and Editing team edit rates (T405177)]] (duration: 10m 05s) [production]
14:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm metricsinfra-grafana-2 (cluster eqiad1) [metricsinfra]
14:39 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm metricsinfra-grafana-2 (cluster eqiad1) [metricsinfra]