101-150 of 10000 results (26ms)
2025-05-08 ยง
17:21 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host apus-fe1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
17:13 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [toolsbeta]
17:13 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host apus-fe1003.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
17:13 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti2047.codfw.wmnet with OS bookworm [production]
17:12 <bking@cumin2002> conftool action : set/pooled=yes:weight=10; selector: name=cirrussearch1112.eqiad.wmnet|cirrussearch1113.eqiad.wmnet|cirrussearch1114.eqiad.wmnet|cirrussearch1115.eqiad.wmnet|cirrussearch1116.eqiad.wmnet|cirrussearch1117.eqiad.wmnet|cirrussearch1118.eqiad.wmnet|cirrussearch1119.eqiad.wmnet|cirrussearch1120.eqiad.wmnet|cirrussearch1121.eqiad.wmnet|cirrussearch1122.eqiad.wmnet|cirrussearch1123.eqiad.wmn [production]
17:10 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-emailer [toolsbeta]
17:09 <bking@cumin2002> conftool action : set/pooled=yes:weight=10; selector: name=cirrussearch1111.eqiad.wmnet|name=cirrussearch1112.eqiad.wmnet|name=cirrussearch1113.eqiad.wmnet|name=cirrussearch1114.eqiad.wmnet|name=cirrussearch1115.eqiad.wmnet|name=cirrussearch1116.eqiad.wmnet|name=cirrussearch1117.eqiad.wmnet|name=cirrussearch1118.eqiad.wmnet|name=cirrussearch1119.eqiad.wmnet|name=cirrussearch1120.eqiad.wmnet|name=cirru [production]
17:08 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [toolsbeta]
17:06 <bd808@deploy1003> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:05 <bd808@deploy1003> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:05 <bd808@deploy1003> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:05 <bd808@deploy1003> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:05 <bd808@deploy1003> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:05 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [tools]
17:04 <bd808@deploy1003> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
16:54 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [toolsbeta]
16:54 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [tools]
16:50 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-upload_eqsin [production]
16:50 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-text_eqsin [production]
16:49 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7001.magru.wmnet [production]
16:48 <fabfur> repooling cp7001 (T393671) [production]
16:48 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:48 <fabfur@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp7001.magru.wmnet [production]
16:48 <fabfur@cumin1002> START - Cookbook sre.hosts.remove-downtime for cp7001.magru.wmnet [production]
16:48 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [tools]
16:47 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [tools]
16:47 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [tools]
16:46 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [tools]
16:46 <raymond-ndibe@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component envvars-admission [tools]
16:38 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [tools]
16:33 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [toolsbeta]
16:30 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2048.codfw.wmnet with OS bookworm [production]
16:29 <brett@dns1005> END - running authdns-update [production]
16:28 <brett@dns1005> START - running authdns-update [production]
16:27 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host apus-fe1003.eqiad.wmnet with OS bookworm [production]
16:26 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:25 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission [toolsbeta]
16:22 <swfrench@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1246.eqiad.wmnet with reason: Host has crashed - T393296 [production]
16:21 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2048.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:19 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:16 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [toolsbeta]
16:15 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ganeti2048.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:15 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:13 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [toolsbeta]
16:13 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti2048 [production]
16:13 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:13 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host ganeti2048 [production]
16:11 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [toolsbeta]
16:11 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
16:11 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]