2301-2350 of 10000 results (146ms)
2024-10-17 ยง
16:41 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:40 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:38 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:33 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70281 and previous config saved to /var/cache/conftool/dbconfig/20241017-163324-ladsgroup.json [production]
16:28 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
16:27 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70280 and previous config saved to /var/cache/conftool/dbconfig/20241017-162749-arnaudb.json [production]
16:12 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T367781)', diff saved to https://phabricator.wikimedia.org/P70279 and previous config saved to /var/cache/conftool/dbconfig/20241017-161242-arnaudb.json [production]
16:02 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/page-analytics: apply [production]
16:01 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/page-analytics: apply [production]
16:00 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/media-analytics: apply [production]
16:00 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/media-analytics: apply [production]
15:59 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:59 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/geo-analytics: apply [production]
15:59 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:58 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/geo-analytics: apply [production]
15:58 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:58 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:57 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/editor-analytics: apply [production]
15:57 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/editor-analytics: apply [production]
15:56 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
15:56 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
15:52 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/device-analytics: apply [production]
15:51 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/device-analytics: apply [production]
15:51 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
15:50 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
15:48 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/device-analytics: apply [production]
15:48 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/device-analytics: apply [production]
15:47 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply [production]
15:47 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply [production]
15:45 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
15:45 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
15:44 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
15:44 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
15:41 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
15:40 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
15:39 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestagemaster2005.codfw.wmnet with OS bookworm [production]
15:35 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Maint over', diff saved to https://phabricator.wikimedia.org/P70278 and previous config saved to /var/cache/conftool/dbconfig/20241017-153546-ladsgroup.json [production]
15:34 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2219 (T376905)', diff saved to https://phabricator.wikimedia.org/P70277 and previous config saved to /var/cache/conftool/dbconfig/20241017-153257-ladsgroup.json [production]
15:33 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
15:33 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2219.codfw.wmnet with reason: Maintenance [production]
15:32 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T376905)', diff saved to https://phabricator.wikimedia.org/P70276 and previous config saved to /var/cache/conftool/dbconfig/20241017-153238-ladsgroup.json [production]
15:20 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Maint over', diff saved to https://phabricator.wikimedia.org/P70275 and previous config saved to /var/cache/conftool/dbconfig/20241017-152040-ladsgroup.json [production]
15:17 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P70274 and previous config saved to /var/cache/conftool/dbconfig/20241017-151731-ladsgroup.json [production]
15:14 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db2172 (T367781)', diff saved to https://phabricator.wikimedia.org/P70273 and previous config saved to /var/cache/conftool/dbconfig/20241017-151216-arnaudb.json [production]
15:13 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
15:12 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
15:12 <arnaudb@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T367781)', diff saved to https://phabricator.wikimedia.org/P70272 and previous config saved to /var/cache/conftool/dbconfig/20241017-151204-arnaudb.json [production]
15:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db1166 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P70271 and previous config saved to /var/cache/conftool/dbconfig/20241017-150535-ladsgroup.json [production]
15:05 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:05 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]