2601-2650 of 10000 results (21ms)
2025-11-13 ยง
12:33 <moritzm> installing bind security updates (client-side tools/libs only) [production]
12:31 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm toolsbeta-bastion-7 (cluster eqiad1) [toolsbeta]
12:30 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm toolsbeta-bastion-7 (cluster eqiad1) [toolsbeta]
12:28 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm proxy-6 (cluster eqiad1) [project-proxy]
12:28 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm proxy-6 (cluster eqiad1) [project-proxy]
12:27 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm proxy-5 (cluster eqiad1) [project-proxy]
12:27 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm proxy-5 (cluster eqiad1) [project-proxy]
12:26 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm tools-k8s-haproxy-7 (cluster eqiad1) [tools]
12:25 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm tools-k8s-haproxy-7 (cluster eqiad1) [tools]
12:25 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm tools-k8s-haproxy-8 (cluster eqiad1) [tools]
12:25 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
12:25 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1264 slowly with 10 steps - Pooling for the first time [production]
12:24 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm tools-k8s-haproxy-8 (cluster eqiad1) [tools]
12:24 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm toolsbeta-test-k8s-haproxy-8 (cluster eqiad1) [toolsbeta]
12:24 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
12:24 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm toolsbeta-test-k8s-haproxy-8 (cluster eqiad1) [toolsbeta]
12:24 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
12:23 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
12:23 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
12:22 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
12:21 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:20 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm toolsbeta-test-k8s-haproxy-7 (cluster eqiad1) [toolsbeta]
12:20 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm toolsbeta-test-k8s-haproxy-7 (cluster eqiad1) [toolsbeta]
12:18 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:18 <cgoubert@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
12:17 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
12:17 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
12:17 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
12:17 <cgoubert@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
12:16 <cgoubert@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
12:16 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
12:15 <cgoubert@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
12:12 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.roll_reboot_cloudnets (exit_code=0) [admin]
12:07 <moritzm> uploaded wmf-laptop 1.0.4 to apt.wikimedia.org [production]
12:04 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.roll_reboot_cloudnets [admin]
12:04 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for service: project,neutron [admin]
11:55 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:52 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,neutron [admin]
11:47 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:45 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:44 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:32 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:32 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:30 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:30 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:29 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:28 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db2230.codfw.wmnet onto db-test1001.eqiad.wmnet [production]
11:08 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1003.eqiad.wmnet with OS bookworm [production]
10:59 <moritzm> upgrade Envoy on idm* T405808 [production]
10:59 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/282 [admin]