1-50 of 10000 results (106ms)
2026-07-01 ยง
16:58 <pt1979@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 30 hosts [production]
16:57 <pt1979@cumin1003> START - Cookbook sre.hosts.remove-downtime for 30 hosts [production]
16:52 <pt1979@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db2202.codfw.wmnet [production]
16:52 <pt1979@cumin1003> START - Cookbook sre.hosts.remove-downtime for db2202.codfw.wmnet [production]
16:51 <pt1979@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lsw1-b2-codfw,lsw1-b2-codfw IPv6,lsw1-b2-codfw.mgmt [production]
16:51 <pt1979@cumin1003> START - Cookbook sre.hosts.remove-downtime for lsw1-b2-codfw,lsw1-b2-codfw IPv6,lsw1-b2-codfw.mgmt [production]
16:51 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs2012.codfw.wmnet [production]
16:51 <brett@cumin2002> START - Cookbook sre.hosts.remove-downtime for lvs2012.codfw.wmnet [production]
16:49 <atsuko@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch2076.codfw.wmnet with OS trixie [production]
16:49 <brett> Start pybal on lvs2012 - T429861 [production]
16:49 <pt1979@cumin1003> END (ERROR) - Cookbook sre.hosts.remove-downtime (exit_code=97) for 59 hosts [production]
16:48 <pt1979@cumin1003> START - Cookbook sre.hosts.remove-downtime for 59 hosts [production]
16:42 <atsuko@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch2061.codfw.wmnet with OS trixie [production]
16:30 <dancy@deploy1003> Installation of scap version "4.271.0" completed for 2 hosts [production]
16:28 <dancy@deploy1003> Installing scap version "4.271.0" for 2 host(s) [production]
16:23 <atsuko@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch2076.codfw.wmnet with reason: host reimage [production]
16:19 <atsuko@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch2061.codfw.wmnet with reason: host reimage [production]
16:18 <atsuko@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch2076.codfw.wmnet with reason: host reimage [production]
16:18 <jasmine@dns1004> END - running authdns-update [production]
16:16 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase2039.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host restbase2039.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:16 <atsuko@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch2061.codfw.wmnet with reason: host reimage [production]
16:15 <jasmine@dns1004> START - running authdns-update [production]
16:14 <jasmine@dns1004> END - running authdns-update [production]
16:12 <jasmine@dns1004> START - running authdns-update [production]
16:07 <pt1979@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2202.codfw.wmnet with reason: maintenance [production]
16:06 <pt1979@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lsw1-b2-codfw,lsw1-b2-codfw IPv6,lsw1-b2-codfw.mgmt with reason: Junos upograde [production]
16:00 <papaul> ongoing maintenance on lsw1-b2-codfw [production]
16:00 <atsuko@cumin2003> START - Cookbook sre.hosts.reimage for host cirrussearch2076.codfw.wmnet with OS trixie [production]
15:59 <pt1979@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lsw1-a8-codfw,lsw1-a8-codfw IPv6,lsw1-a8-codfw.mgmt [production]
15:59 <pt1979@cumin1003> START - Cookbook sre.hosts.remove-downtime for lsw1-a8-codfw,lsw1-a8-codfw IPv6,lsw1-a8-codfw.mgmt [production]
15:57 <atsuko@cumin2003> START - Cookbook sre.hosts.reimage for host cirrussearch2061.codfw.wmnet with OS trixie [production]
15:55 <pt1979@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2042,2046].codfw.wmnet [production]
15:55 <pt1979@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2042,2046].codfw.wmnet [production]
15:51 <ozge@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
15:51 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2220: Repooling after switchover [production]
15:50 <ozge@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
15:50 <fceratto@cumin1003> START - Cookbook sre.mysql.pool pool db2220: Repooling after switchover [production]
15:48 <atsuko@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch2092.codfw.wmnet with OS trixie [production]
15:41 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:40 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:38 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply [production]
15:37 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply [production]
15:35 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply [production]
15:35 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
15:32 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-fr-tech: apply [production]
15:32 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-fr-tech: apply [production]
15:30 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
15:29 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
15:26 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]