151-200 of 10000 results (15ms)
2025-03-28 ยง
15:18 <moritzm> uploaded wmf-laptop 1.0.1 to apt.wikimedia.org [production]
15:17 <fabfur@dns1004> END - running authdns-update [production]
15:14 <fabfur@dns1004> START - running authdns-update [production]
15:09 <fabfur@dns1004> END - running authdns-update [production]
15:07 <fabfur@dns1004> START - running authdns-update [production]
15:06 <fabfur@dns1004> END - running authdns-update [production]
15:04 <fabfur@dns1004> START - running authdns-update [production]
14:58 <fab@deploy1003> Finished deploy [airflow-dags/research@b5ce354]: (no justification provided) (duration: 00m 39s) [production]
14:58 <fab@deploy1003> Started deploy [airflow-dags/research@b5ce354]: (no justification provided) [production]
13:58 <taavi> reboot tools-static-15 due to stuck nginx worker processes [tools]
13:48 <reedy@deploy1003> Synchronized wmf-config/CommonSettings.php: Disable CAPTCHA on Special:UserLogin (duration: 11m 52s) [production]
13:47 <wmbot~lucaswerkmeister@tools-bastion-13> deployed d95b93c7b8 (l10n updates: mk) [tools.ranker]
13:23 <hashar> Restarted CI Jenkins [production]
12:04 <mfossati@deploy1003> Finished deploy [airflow-dags/platform_eng@a233b0d]: bump SEAL to v0.5.0 (duration: 01m 14s) [production]
12:02 <mfossati@deploy1003> Started deploy [airflow-dags/platform_eng@a233b0d]: bump SEAL to v0.5.0 [production]
11:20 <jelto@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
11:19 <jelto@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. [production]
11:19 <jelto@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:19 <jelto@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
11:12 <jnuche@deploy1003> Installation of scap version "4.147.0" completed for 2 hosts [production]
11:11 <jnuche@deploy1003> Installing scap version "4.147.0" for 2 host(s) [production]
10:43 <jelto@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
10:43 <jelto@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
10:41 <jelto@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
10:41 <jelto@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
10:41 <jelto> apply admin_ng external-services to add puppetdb endpoints - T350794 [production]
10:39 <jelto@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
10:38 <jelto@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
10:36 <jelto@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
10:35 <jelto@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
10:10 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers (T389733) [tools]
10:00 <fnegri@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers (T389733) [tools]
09:55 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
09:55 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
09:55 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
09:54 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
09:54 <cgoubert@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
09:54 <cgoubert@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
09:53 <cgoubert@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
09:53 <elukey> benthos-webrequest_live back working with two instances [production]
09:52 <cgoubert@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
09:42 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor (T389733) [tools]
09:37 <dcausse> repooling wdqs1020 [production]
09:30 <fnegri@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor (T389733) [tools]
09:21 <dcausse> restarting blazegraph on wdqs1020 (deadlocked) [production]
09:20 <fabfur@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on cp4047.ulsfo.wmnet with reason: HW errors [production]
08:39 <godog> bounce mtail on centrallog1002 - stuck on cpu [production]
08:38 <elukey> stop benthos-webrequest_live on centrallog2002.codfw.wmnet to test handling load/traffic with one instance - T390029 [production]
08:37 <elukey@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on centrallog2002.codfw.wmnet with reason: Test stopping benthos webrequest-live [production]
07:22 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2243.codfw.wmnet with reason: Maintenance [production]