351-400 of 10000 results (15ms)
2025-05-07 ยง
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1116 on all recursors [production]
13:33 <bking@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1116 on all recursors [production]
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1116 to cirrussearch1116 - bking@cumin2002" [production]
13:33 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
13:32 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1116 to cirrussearch1116 - bking@cumin2002" [production]
13:31 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1117 to cirrussearch1117 [production]
13:30 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-fe1015.eqiad.wmnet [production]
13:30 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1046.eqiad.wmnet [production]
13:30 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1046.eqiad.wmnet [production]
13:28 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
13:27 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1116 to cirrussearch1116 [production]
13:25 <jmm@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
13:24 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1046.eqiad.wmnet [production]
13:24 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,neutron [admin]
13:21 <jmm@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
13:21 <jmm@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
13:19 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1046.eqiad.wmnet [production]
13:15 <jmm@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
13:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for service: project,neutron [admin]
13:13 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for service: project,neutron [admin]
13:12 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1045.eqiad.wmnet [production]
13:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1045.eqiad.wmnet [production]
13:07 <moritzm> installing poppler security updates [production]
13:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1045.eqiad.wmnet [production]
13:07 <jmm@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
13:07 <hashar> Restarted Apache httpd server on Gerrit server [production]
13:07 <jmm@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
13:00 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1045.eqiad.wmnet [production]
12:58 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component volume-admission [tools]
12:58 <Amir1> [wikishared]> CREATE INDEX translation_last_updated_timestamp ON cx_translations (translation_last_updated_timestamp); (T392839) [production]
12:51 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet [production]
12:51 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1044.eqiad.wmnet [production]
12:48 <taavi> updating all security group rules referencing old 172.16.0.0/21 subnet to reference new ip space instead (T379175) [admin]
12:48 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [tools]
12:47 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [toolsbeta]
12:46 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1044.eqiad.wmnet [production]
12:38 <moritzm> installing imagemagick security updates [production]
12:35 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1044.eqiad.wmnet [production]
12:35 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [toolsbeta]
12:18 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1043.eqiad.wmnet [production]
12:17 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1043.eqiad.wmnet [production]
12:12 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1043.eqiad.wmnet [production]
12:10 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-api [tools]
12:05 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1043.eqiad.wmnet [production]
12:00 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1042.eqiad.wmnet [production]
12:00 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1042.eqiad.wmnet [production]
11:57 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-api [tools]
11:55 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1042.eqiad.wmnet [production]
11:43 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1042.eqiad.wmnet [production]