1-50 of 10000 results (110ms)
2026-08-13 ยง
23:01 <sbassett> Deployed security updates for T430596, T120386 [production]
22:55 <bking@cumin2003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host kubestagemaster2005.codfw.wmnet [production]
22:55 <bking@cumin2003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubestagemaster2005.codfw.wmnet with OS bookworm [production]
22:54 <ryankemper@cumin2003> START - Cookbook sre.dns.netbox [production]
22:53 <ryankemper@cumin2003> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
22:49 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestagemaster2005.codfw.wmnet with reason: host reimage [production]
22:49 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1222.eqiad.wmnet with OS bookworm [production]
22:42 <bking@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on kubestagemaster2005.codfw.wmnet with reason: host reimage [production]
22:29 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1222.eqiad.wmnet with reason: host reimage [production]
22:26 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1222.eqiad.wmnet with reason: host reimage [production]
22:23 <bking@cumin2003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-etcd2003.codfw.wmnet [production]
22:23 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-etcd2003.codfw.wmnet with OS bookworm [production]
22:23 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host kubestagemaster2005.codfw.wmnet with OS bookworm [production]
22:23 <bking@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM kubestagemaster2005.codfw.wmnet - bking@cumin2003" [production]
22:23 <bking@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM kubestagemaster2005.codfw.wmnet - bking@cumin2003" [production]
22:22 <bking@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) kubestagemaster2005.codfw.wmnet on all recursors [production]
22:22 <bking@cumin2003> START - Cookbook sre.dns.wipe-cache kubestagemaster2005.codfw.wmnet on all recursors [production]
22:22 <bking@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:22 <bking@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM kubestagemaster2005.codfw.wmnet - bking@cumin2003" [production]
22:22 <bking@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM kubestagemaster2005.codfw.wmnet - bking@cumin2003" [production]
22:17 <ryankemper@cumin2003> START - Cookbook sre.dns.netbox [production]
22:13 <ryankemper@cumin2003> START - Cookbook sre.hosts.move-vlan for host an-worker1223 [production]
22:12 <bking@cumin2003> START - Cookbook sre.dns.netbox [production]
22:12 <bking@cumin2003> START - Cookbook sre.ganeti.makevm for new host kubestagemaster2005.codfw.wmnet [production]
22:12 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host an-worker1222 [production]
22:12 <ryankemper@cumin2003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-worker1222 [production]
22:11 <sbassett> Deployed security updates for T429244, T434039 [production]
22:11 <ryankemper@cumin2003> START - Cookbook sre.network.configure-switch-interfaces for host an-worker1222 [production]
22:11 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) an-worker1222.eqiad.wmnet 19.36.64.10.in-addr.arpa 9.1.0.0.6.3.0.0.4.6.0.0.0.1.0.0.6.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
22:11 <ryankemper@cumin2003> START - Cookbook sre.dns.wipe-cache an-worker1222.eqiad.wmnet 19.36.64.10.in-addr.arpa 9.1.0.0.6.3.0.0.4.6.0.0.0.1.0.0.6.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors [production]
22:11 <ryankemper@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:11 <ryankemper@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1222 - ryankemper@cumin2003" [production]
22:07 <ryankemper@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-worker1222 - ryankemper@cumin2003" [production]
22:05 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-wdqs2001.codfw.wmnet with reason: updating firmware [production]
22:01 <ryankemper@cumin2003> START - Cookbook sre.dns.netbox [production]
22:01 <ryankemper@cumin2003> START - Cookbook sre.hosts.reimage for host an-worker1223.eqiad.wmnet with OS bookworm [production]
22:01 <ryankemper@cumin2003> START - Cookbook sre.hosts.move-vlan for host an-worker1222 [production]
22:01 <ryankemper@cumin2003> START - Cookbook sre.hosts.reimage for host an-worker1222.eqiad.wmnet with OS bookworm [production]
22:00 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1212.eqiad.wmnet with OS bookworm [production]
21:54 <sbassett@deploy1003> Finished scap sync-world: Backport for [[gerrit:1324295|Revert "Lazily reject pre-fix parser-cache entries for noreferrer/noopener links" (T429090)]] (duration: 06m 42s) [production]
21:53 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-etcd2003.codfw.wmnet with reason: host reimage [production]
21:53 <bking@cumin2003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host dse-k8s-etcd2001.codfw.wmnet [production]
21:53 <bking@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-etcd2001.codfw.wmnet with OS bookworm [production]
21:50 <sbassett@deploy1003> sbassett, kharlan: Continuing with deployment [production]
21:49 <sbassett@deploy1003> sbassett, kharlan: Backport for [[gerrit:1324295|Revert "Lazily reject pre-fix parser-cache entries for noreferrer/noopener links" (T429090)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:48 <bking@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-etcd2003.codfw.wmnet with reason: host reimage [production]
21:47 <sbassett@deploy1003> Started scap sync-world: Backport for [[gerrit:1324295|Revert "Lazily reject pre-fix parser-cache entries for noreferrer/noopener links" (T429090)]] [production]
21:42 <maryum> Deployed security patch for T434549 [production]
21:39 <ryankemper@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1212.eqiad.wmnet with reason: host reimage [production]
21:34 <ryankemper@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1212.eqiad.wmnet with reason: host reimage [production]