901-950 of 10000 results (31ms)
2025-04-29 ยง
12:05 <moritzm> imported python3-flask-sqlalchemy 2.1-4 to main component of wikimedia-bullseye (imported from bullseye-backports which will be archived soon) and removed the previously, erronously import into bookworm-wikimedia T383557 [production]
12:01 <filippo@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host titan2001.codfw.wmnet [production]
11:53 <filippo@cumin1002> START - Cookbook sre.hosts.reboot-single for host titan2001.codfw.wmnet [production]
11:53 <marostegui@cumin1002> dbctl commit (dc=all): 'db1246 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P75617 and previous config saved to /var/cache/conftool/dbconfig/20250429-115325-root.json [production]
11:49 <suzannewoodWMDE2> suzannewood@deploy1003:~$ foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https [production]
11:48 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
11:47 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:42 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4005.ulsfo.wmnet [production]
11:42 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti4005.ulsfo.wmnet [production]
11:39 <moritzm> installing curl security updates [production]
11:38 <marostegui@cumin1002> dbctl commit (dc=all): 'db1246 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P75616 and previous config saved to /var/cache/conftool/dbconfig/20250429-113820-root.json [production]
11:36 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti4005.ulsfo.wmnet [production]
11:35 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=99) with prefix 'proxy' [project-proxy]
11:34 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4005.ulsfo.wmnet [production]
11:32 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw2001.wikimedia.org [production]
11:32 <marostegui@dns1006> END - running authdns-update [production]
11:30 <marostegui> Failover m2 master from dbproxy1023 to dbproxy1025 [production]
11:30 <marostegui@dns1006> START - running authdns-update [production]
11:28 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ldap-rw2001.wikimedia.org [production]
11:28 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw1001.wikimedia.org [production]
11:28 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'proxy' (T379175) [project-proxy]
11:28 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance maps-proxy-04 [project-proxy]
11:27 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance maps-proxy-04 [project-proxy]
11:27 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance maps-proxy-03 [project-proxy]
11:26 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance maps-proxy-03 [project-proxy]
11:26 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=99) with prefix 'proxy' (T379175) [project-proxy]
11:26 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'proxy' (T379175) [project-proxy]
11:25 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on proxy-5.project-proxy.eqiad1.wikimedia.cloud [project-proxy]
11:24 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ldap-rw1001.wikimedia.org [production]
11:23 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on proxy-5.project-proxy.eqiad1.wikimedia.cloud [project-proxy]
11:23 <marostegui@cumin1002> dbctl commit (dc=all): 'db1246 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P75615 and previous config saved to /var/cache/conftool/dbconfig/20250429-112314-root.json [production]
11:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host krb1002.eqiad.wmnet [production]
11:16 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host krb1002.eqiad.wmnet [production]
11:15 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:14 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:13 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:13 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-maint1001.eqiad.wmnet [production]
11:11 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:11 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:10 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:10 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:10 <godog> bounce prometheus-statsd-exporter on stat1011 - T389344 [production]
11:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4008.ulsfo.wmnet [production]
11:09 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:09 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti4008.ulsfo.wmnet [production]
11:09 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/224 [admin]
11:08 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ldap-maint1001.eqiad.wmnet [production]
11:08 <marostegui@cumin1002> dbctl commit (dc=all): 'db1246 (re)pooling @ 20%: Repooling', diff saved to https://phabricator.wikimedia.org/P75614 and previous config saved to /var/cache/conftool/dbconfig/20250429-110809-root.json [production]
11:06 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs4008.ulsfo.wmnet [production]