301-350 of 10000 results (121ms)
2026-03-05 ยง
09:32 <javiermonton@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
09:32 <javiermonton@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply [production]
09:28 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1221.eqiad.wmnet [production]
09:27 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1220.eqiad.wmnet [production]
09:20 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1220.eqiad.wmnet [production]
09:02 <ayounsi@cumin1003> START - Cookbook sre.dns.netbox [production]
08:40 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
08:38 <mszwarc@deploy2002> Finished scap sync-world: Backport for [[gerrit:1247990|Drop 'centralnoticeadmin' from $wgOATHRequiredForGroups (T418580)]] (duration: 07m 07s) [production]
08:35 <brouberol@deploy2002> helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
08:35 <brouberol@deploy2002> helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
08:34 <mszwarc@deploy2002> mszwarc: Continuing with sync [production]
08:33 <mszwarc@deploy2002> mszwarc: Backport for [[gerrit:1247990|Drop 'centralnoticeadmin' from $wgOATHRequiredForGroups (T418580)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
08:30 <mszwarc@deploy2002> Started scap sync-world: Backport for [[gerrit:1247990|Drop 'centralnoticeadmin' from $wgOATHRequiredForGroups (T418580)]] [production]
08:29 <gehel@dns1004> END - running authdns-update [production]
08:28 <gehel@dns1004> START - running authdns-update [production]
08:27 <moritzm> installing mbedtls security updates [production]
08:23 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
08:23 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
08:15 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248314|Revert "zhwiki: Add 2026 CNY celebration logos"]] (duration: 09m 19s) [production]
08:11 <hashar@deploy2002> hashar, stang: Continuing with sync [production]
08:08 <hashar@deploy2002> hashar, stang: Backport for [[gerrit:1248314|Revert "zhwiki: Add 2026 CNY celebration logos"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
08:06 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1248314|Revert "zhwiki: Add 2026 CNY celebration logos"]] [production]
08:02 <moritzm> uploaded openjdk-8 8u482-ga-1~deb11u1 to component/jdk8 of bullseye-wikimedia [production]
07:56 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts bast4005.wikimedia.org [production]
07:56 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
07:56 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: bast4005.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
07:55 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: bast4005.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" [production]
07:48 <moritzm> uploaded bird2 2.18-1~wmf13u2 to the main component of trixie-wikimedia T413740 [production]
07:47 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
07:47 <kevinbazira@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
07:42 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts bast4005.wikimedia.org [production]
06:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Remove es1033 T408772', diff saved to https://phabricator.wikimedia.org/P89804 and previous config saved to /var/cache/conftool/dbconfig/20260305-063548-marostegui.json [production]
02:10 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 07m 55s) [production]
02:02 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
02:01 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248163|Stop writing to il_to on medium size wikis (T415787)]] (duration: 06m 14s) [production]
01:58 <zabe@deploy2002> zabe: Continuing with sync [production]
01:57 <zabe@deploy2002> zabe: Backport for [[gerrit:1248163|Stop writing to il_to on medium size wikis (T415787)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:55 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1248163|Stop writing to il_to on medium size wikis (T415787)]] [production]
01:40 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1246099|Start reading from new file tables on medium wikis (T416548)]] (duration: 06m 15s) [production]
01:36 <zabe@deploy2002> zabe: Continuing with sync [production]
01:36 <zabe@deploy2002> zabe: Backport for [[gerrit:1246099|Start reading from new file tables on medium wikis (T416548)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:34 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1246099|Start reading from new file tables on medium wikis (T416548)]] [production]
01:29 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248154|ImageListPager: Use correct name field for batch lookups (T418327)]], [[gerrit:1248153|Revert^2 "ImageListPager: Properly support file schema migration read new"]] (duration: 07m 21s) [production]
01:25 <zabe@deploy2002> zabe: Continuing with sync [production]
01:23 <zabe@deploy2002> zabe: Backport for [[gerrit:1248154|ImageListPager: Use correct name field for batch lookups (T418327)]], [[gerrit:1248153|Revert^2 "ImageListPager: Properly support file schema migration read new"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
01:21 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1248154|ImageListPager: Use correct name field for batch lookups (T418327)]], [[gerrit:1248153|Revert^2 "ImageListPager: Properly support file schema migration read new"]] [production]
00:55 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248021|Stop writing to il_to on small wikis (T415787)]] (duration: 06m 49s) [production]
00:51 <zabe@deploy2002> zabe: Continuing with sync [production]
00:50 <zabe@deploy2002> zabe: Backport for [[gerrit:1248021|Stop writing to il_to on small wikis (T415787)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
00:48 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1248021|Stop writing to il_to on small wikis (T415787)]] [production]