3501-3550 of 10000 results (26ms)
2024-10-23 ยง
17:01 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
17:00 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:58 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:57 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:52 <sukhe> restart ircecho on alerting hosts [production]
16:35 <sukhe> sudo cumin 'O:alerting_host or O:dnsbox' 'run-puppet-agent' [production]
16:32 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:31 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:30 <hnowlan@cumin1002> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) pool sessionstore in codfw: sessionstore mesh migration T363996 [production]
16:25 <hnowlan@cumin1002> START - Cookbook sre.discovery.service-route pool sessionstore in codfw: sessionstore mesh migration T363996 [production]
16:22 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/sessionstore: apply [production]
16:22 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/sessionstore: apply [production]
16:21 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/sessionstore: apply [production]
16:20 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/sessionstore: apply [production]
16:19 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:18 <hashar> deployment-prep: sudo rm /var/lock/scap* [releng]
16:18 <hashar> deployment-prep: scap lock --unlock-all "Release all locks after Jenkins got restarted and SIGKILL deployment" [releng]
16:17 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:17 <hashar> deployment-prep: sudo rm /var/lock/scap-global-lock # it is an empty file, scap now expects a json payload [releng]
16:15 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:15 <hnowlan@cumin1002> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool sessionstore in codfw: sessionstore mesh migration T363996 [production]
16:14 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:09 <hnowlan@cumin1002> START - Cookbook sre.discovery.service-route depool sessionstore in codfw: sessionstore mesh migration T363996 [production]
15:57 <btullis@deploy2002> Finished deploy [airflow-dags/analytics_product@ba61f77]: T351388 (duration: 01m 15s) [production]
15:55 <btullis@deploy2002> Started deploy [airflow-dags/analytics_product@ba61f77]: T351388 [production]
15:55 <btullis@deploy2002> Finished deploy [airflow-dags/platform_eng@ba61f77]: T351388 (duration: 00m 31s) [production]
15:55 <btullis@deploy2002> Started deploy [airflow-dags/platform_eng@ba61f77]: T351388 [production]
15:55 <btullis@deploy2002> Finished deploy [airflow-dags/research@ba61f77]: T351388 (duration: 00m 45s) [production]
15:54 <btullis@deploy2002> Started deploy [airflow-dags/research@ba61f77]: T351388 [production]
15:54 <btullis> deploying all airflow instances to pick up changes in T351388 [analytics]
15:53 <btullis@deploy2002> Finished deploy [airflow-dags/search@ba61f77]: T351388 (duration: 00m 29s) [production]
15:53 <btullis@deploy2002> Started deploy [airflow-dags/search@ba61f77]: T351388 [production]
15:52 <btullis@deploy2002> Finished deploy [airflow-dags/analytics@ba61f77]: T351388 (duration: 01m 08s) [production]
15:51 <btullis@deploy2002> Started deploy [airflow-dags/analytics@ba61f77]: T351388 [production]
15:51 <btullis@deploy2002> Finished deploy [airflow-dags/analytics_test@ba61f77]: T351388 (duration: 00m 31s) [production]
15:51 <btullis@deploy2002> Started deploy [airflow-dags/analytics_test@ba61f77]: T351388 [production]
15:42 <dduvall@deploy2002> Finished deploy [releng/jenkins-deploy@e1c56d1] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/95 (duration: 00m 53s) [production]
15:42 <dduvall@deploy2002> Started deploy [releng/jenkins-deploy@e1c56d1] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/95 [production]
15:35 <hashar> Restarted CI Jenkins [production]
15:28 <moritzm> uploaded openjdk-8 8u422-b05-1~deb12u0 for component/jdk for bookworm-wikimedia (bootstrap build since openjdk-8 needs openjdk-8 to build) [production]
15:20 <dduvall@deploy2002> Finished deploy [releng/jenkins-deploy@d8e345f] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/94 (duration: 01m 05s) [production]
15:19 <dduvall@deploy2002> Started deploy [releng/jenkins-deploy@d8e345f] (releasing): Deploying https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/94 [production]
15:17 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:15 <logmsgbot> lucaswerkmeister-wmde Deployed security patch for T377912 [production]
15:10 <volans> uploaded spicerack_8.15.1 to apt.wikimedia.org bullseye-wikimedia [production]
15:04 <stran@deploy2002> Finished scap sync-world: Backport for [[gerrit:1082203|Support template overrides in ContributionsPager (T356292)]], [[gerrit:1082328|Add source wiki to contributions on Special:GlobalContributions (T356292)]] (duration: 10m 53s) [production]
14:59 <stran@deploy2002> stran: Continuing with sync [production]
14:55 <stran@deploy2002> stran: Backport for [[gerrit:1082203|Support template overrides in ContributionsPager (T356292)]], [[gerrit:1082328|Add source wiki to contributions on Special:GlobalContributions (T356292)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:53 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on rdb1014.eqiad.wmnet with reason: Hardware issue [production]
14:53 <cgoubert@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on rdb1014.eqiad.wmnet with reason: Hardware issue [production]