51-100 of 10000 results (102ms)
2026-03-27 ยง
12:11 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
12:10 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
12:08 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
12:06 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
11:53 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
11:51 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
11:50 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
11:48 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
11:30 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:27 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
11:15 <elukey@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host kafka-test1006.eqiad.wmnet with OS trixie [production]
11:15 <taavi@cumin1003> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database abstractwiki (T420637) [production]
11:02 <blake@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host deploy2002.codfw.wmnet [production]
10:54 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host poolcounter2006.codfw.wmnet [production]
10:51 <blake@cumin1003> START - Cookbook sre.hosts.reboot-single for host deploy2002.codfw.wmnet [production]
10:50 <jayme@cumin1003> START - Cookbook sre.hosts.reboot-single for host poolcounter2006.codfw.wmnet [production]
10:46 <jayme@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host poolcounter2005.codfw.wmnet [production]
10:43 <jayme@cumin1003> START - Cookbook sre.hosts.reboot-single for host poolcounter2005.codfw.wmnet [production]
10:33 <elukey@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-test1006.eqiad.wmnet with reason: host reimage [production]
10:27 <elukey@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-test1006.eqiad.wmnet with reason: host reimage [production]
10:18 <taavi@cumin1003> START - Cookbook sre.wikireplicas.add-wiki for database abstractwiki (T420637) [production]
10:12 <elukey@cumin1003> START - Cookbook sre.hosts.reimage for host kafka-test1006.eqiad.wmnet with OS trixie [production]
10:04 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
10:03 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
10:01 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
10:00 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
09:58 <dpogorzelski@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:57 <elukey@cumin1003> END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-test-eqiad [production]
09:37 <elukey@cumin1003> START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling restart_daemons on A:kafka-test-eqiad [production]
09:06 <elukey@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
09:05 <elukey@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
09:04 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
09:03 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
08:32 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
08:31 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
08:30 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:28 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
08:05 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
08:04 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
08:02 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
07:46 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
03:06 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
02:32 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
02:12 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
02:07 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 06m 07s) [production]
02:01 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
01:30 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on zuul1002.eqiad.wmnet with reason: T421330 [production]
01:30 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on zuul1001.eqiad.wmnet with reason: T421330 [production]
01:30 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on zuul2001.codfw.wmnet with reason: T421330 [production]
01:29 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on zuul2002.codfw.wmnet with reason: T421330 [production]