201-250 of 10000 results (99ms)
2025-01-16 ยง
20:59 <catrope@deploy2002> helmfile [codfw] DONE helmfile.d/services/chart-renderer: apply [production]
20:58 <catrope@deploy2002> helmfile [codfw] START helmfile.d/services/chart-renderer: apply [production]
20:58 <catrope@deploy2002> helmfile [eqiad] DONE helmfile.d/services/chart-renderer: apply [production]
20:57 <catrope@deploy2002> helmfile [eqiad] START helmfile.d/services/chart-renderer: apply [production]
20:51 <catrope@deploy2002> helmfile [staging] DONE helmfile.d/services/chart-renderer: apply [production]
20:50 <catrope@deploy2002> helmfile [staging] START helmfile.d/services/chart-renderer: apply [production]
20:28 <kamila@cumin1002> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker[1111-1116].eqiad.wmnet [production]
20:28 <kamila@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1111-1116].eqiad.wmnet [production]
20:27 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1114.eqiad.wmnet with OS bookworm [production]
20:08 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1114.eqiad.wmnet with reason: host reimage [production]
20:04 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1114.eqiad.wmnet with reason: host reimage [production]
19:48 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1114 [production]
19:48 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1114 [production]
19:48 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1114.eqiad.wmnet with OS bookworm [production]
19:19 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.12 refs T382363 [production]
19:06 <brennen> 1.44.0-wmf.12 train (T382363): no current blockers and logs calm, rolling to all wikis. [production]
18:40 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
18:39 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
18:38 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
18:38 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
18:37 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
18:37 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
18:28 <swfrench@deploy2002> Finished scap sync-world: Deployment to switch next release files to 8.1 - T377040 (duration: 03m 50s) [production]
18:24 <swfrench@deploy2002> Started scap sync-world: Deployment to switch next release files to 8.1 - T377040 [production]
18:22 <cmooney@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 138398 [production]
18:22 <cmooney@cumin1002> START - Cookbook sre.network.peering with action 'configure' for AS: 138398 [production]
17:54 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1113.eqiad.wmnet with OS bookworm [production]
17:50 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1112.eqiad.wmnet with OS bookworm [production]
17:47 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1116.eqiad.wmnet with OS bookworm [production]
17:44 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1115.eqiad.wmnet with OS bookworm [production]
17:40 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1111.eqiad.wmnet with OS bookworm [production]
17:35 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1113.eqiad.wmnet with reason: host reimage [production]
17:34 <zabe@deploy2002> Finished scap sync-world: T380119 (duration: 10m 59s) [production]
17:31 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1112.eqiad.wmnet with reason: host reimage [production]
17:28 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1116.eqiad.wmnet with reason: host reimage [production]
17:25 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1115.eqiad.wmnet with reason: host reimage [production]
17:23 <zabe@deploy2002> Started scap sync-world: T380119 [production]
17:23 <zabe@deploy2002> sync-world aborted: T380119 (duration: 01m 16s) [production]
17:22 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1111.eqiad.wmnet with reason: host reimage [production]
17:22 <zabe@deploy2002> Started scap sync-world: T380119 [production]
17:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1116.eqiad.wmnet with reason: host reimage [production]
17:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1113.eqiad.wmnet with reason: host reimage [production]
17:19 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1115.eqiad.wmnet with reason: host reimage [production]
17:18 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1112.eqiad.wmnet with reason: host reimage [production]
17:18 <kamila@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1111.eqiad.wmnet with reason: host reimage [production]
17:14 <kamila@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1114.eqiad.wmnet on all recursors [production]
17:14 <kamila@cumin1002> START - Cookbook sre.dns.wipe-cache wikikube-worker1114.eqiad.wmnet on all recursors [production]
17:03 <kamila@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1116 [production]
17:03 <kamila@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker1116 [production]
17:03 <kamila@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1116.eqiad.wmnet with OS bookworm [production]