651-700 of 10000 results (102ms)
2025-05-07 ยง
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1116 on all recursors [production]
13:33 <bking@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1116 on all recursors [production]
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:33 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1116 to cirrussearch1116 - bking@cumin2002" [production]
13:33 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
13:32 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1116 to cirrussearch1116 - bking@cumin2002" [production]
13:31 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1117 to cirrussearch1117 [production]
13:30 <mvernon@cumin1002> START - Cookbook sre.hosts.reboot-single for host ms-fe1015.eqiad.wmnet [production]
13:30 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1046.eqiad.wmnet [production]
13:30 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1046.eqiad.wmnet [production]
13:28 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
13:27 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1116 to cirrussearch1116 [production]
13:25 <jmm@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
13:24 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1046.eqiad.wmnet [production]
13:21 <jmm@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
13:21 <jmm@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
13:19 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1046.eqiad.wmnet [production]
13:15 <jmm@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
13:12 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1045.eqiad.wmnet [production]
13:12 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1045.eqiad.wmnet [production]
13:07 <moritzm> installing poppler security updates [production]
13:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1045.eqiad.wmnet [production]
13:07 <jmm@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
13:07 <hashar> Restarted Apache httpd server on Gerrit server [production]
13:07 <jmm@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
13:00 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1045.eqiad.wmnet [production]
12:58 <Amir1> [wikishared]> CREATE INDEX translation_last_updated_timestamp ON cx_translations (translation_last_updated_timestamp); (T392839) [production]
12:51 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet [production]
12:51 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1044.eqiad.wmnet [production]
12:46 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1044.eqiad.wmnet [production]
12:38 <moritzm> installing imagemagick security updates [production]
12:35 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1044.eqiad.wmnet [production]
12:18 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1043.eqiad.wmnet [production]
12:17 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1043.eqiad.wmnet [production]
12:12 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1043.eqiad.wmnet [production]
12:05 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1043.eqiad.wmnet [production]
12:00 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1042.eqiad.wmnet [production]
12:00 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1042.eqiad.wmnet [production]
11:55 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1042.eqiad.wmnet [production]
11:43 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1042.eqiad.wmnet [production]
11:12 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2203.codfw.wmnet with reason: Maintenance [production]
11:12 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1163.eqiad.wmnet with reason: Maintenance [production]
11:07 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1041.eqiad.wmnet [production]
11:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1041.eqiad.wmnet [production]
11:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host krb2002.codfw.wmnet [production]
11:01 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1041.eqiad.wmnet [production]
11:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host krb2002.codfw.wmnet [production]
10:57 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1041.eqiad.wmnet [production]
10:51 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1040.eqiad.wmnet [production]
10:51 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1040.eqiad.wmnet [production]