51-100 of 10000 results (26ms)
2025-12-02 ยง
21:26 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1050.eqiad.wmnet with OS trixie [production]
21:20 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1061.eqiad.wmnet with reason: host reimage [production]
21:17 <kharlan@deploy2002> kharlan: Continuing with sync [production]
21:16 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1061.eqiad.wmnet with reason: host reimage [production]
21:15 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1214101|Refactor: Move editing session ID logic into service (T406865)]], [[gerrit:1214102|hCaptcha: Log diff when challenge is presented (T406865)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:14 <dzahn@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:14 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for ulsfo and magru T365259 - dzahn@cumin2002" [production]
21:14 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for ulsfo and magru T365259 - dzahn@cumin2002" [production]
21:10 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
21:04 <dzahn@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:03 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for drmrs, eqsin and esams T365259 - dzahn@cumin2002" [production]
21:03 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for drmrs, eqsin and esams T365259 - dzahn@cumin2002" [production]
21:00 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudvirt1061.eqiad.wmnet with OS trixie [production]
21:00 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1046.eqiad.wmnet with OS trixie [production]
20:58 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
20:53 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:52 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm 1797e3a3-f04a-4cb0-9102-79f1d0079d57 (cluster eqiad1) [admin]
20:52 <dzahn@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:52 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for codfw and eqiad T365259 - dzahn@cumin2002" [production]
20:52 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP - IPv6 - for codfw and eqiad T365259 - dzahn@cumin2002" [production]
20:51 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:51 <andrew@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm 1797e3a3-f04a-4cb0-9102-79f1d0079d57 (cluster eqiad1) [admin]
20:51 <andrewbogott> stop/starting zuul-k8s-v128-qnv6fefra4wd-node-0 to fix mtu mismatch [zuul]
20:51 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm 592754fe-dd64-463f-ab33-d51a4108cec0 (cluster eqiad1) [admin]
20:50 <andrew@cloudcumin1001> START - Cookbook wmcs.vps.instance.stop_start vm 592754fe-dd64-463f-ab33-d51a4108cec0 (cluster eqiad1) [admin]
20:50 <andrewbogott> stop/starting paws-127b-rpchztfjt2jb-node-1 to fix mtu mismatch [paws]
20:48 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1054.eqiad.wmnet with reason: host reimage [production]
20:48 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
20:47 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:44 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1054.eqiad.wmnet with reason: host reimage [production]
20:44 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:43 <eileen> civicrm upgraded from c90bd037 to 8d8400e1 [production]
20:38 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1050.eqiad.wmnet with reason: host reimage [production]
20:37 <dzahn@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:37 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP for magru and eqiad T365259 - dzahn@cumin2002" [production]
20:37 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP for magru and eqiad T365259 - dzahn@cumin2002" [production]
20:34 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: host reimage [production]
20:33 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
20:32 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:31 <dzahn@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:31 <dzahn@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP for drmrs and eqsin T365259 - dzahn@cumin2002" [production]
20:31 <dzahn@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added gerrit-lb VIP for drmrs and eqsin T365259 - dzahn@cumin2002" [production]
20:30 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1214101|Refactor: Move editing session ID logic into service (T406865)]], [[gerrit:1214102|hCaptcha: Log diff when challenge is presented (T406865)]] [production]
20:29 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1050.eqiad.wmnet with reason: host reimage [production]
20:29 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1061.eqiad.wmnet' [admin]
20:28 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudvirt1054.eqiad.wmnet with OS trixie [production]
20:26 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
20:26 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1046.eqiad.wmnet with reason: host reimage [production]
20:26 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1054.eqiad.wmnet' [admin]
20:25 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1054.eqiad.wmnet' [admin]