1-50 of 10000 results (21ms)
2025-06-03 ยง
23:59 <James_F> Zuul: [mediawiki/services/<some>] Upgrade test suite to Node 24 & 22, for T395926 [releng]
23:56 <James_F> Zuul: [wikimedia/portals] Upgrade test suite to Node 24 and Node 22, for T395926 [releng]
23:56 <James_F> Zuul: [wikipeg] Upgrade test suite to Node 24 and Node 22, for T395926 [releng]
23:55 <James_F> Zuul: [oojs/*i] Upgrade test suite to Node 24 and Node 22, for T395926 [releng]
23:53 <James_F> Zuul: [wikimedia/portals/deploy] Drop tests, this repo isn't testable [releng]
23:20 <James_F> Zuul: Provide experimental Node 24 jobs where Node 22 ones exist, for T395926 [releng]
22:42 <andrew@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:39 <andrew@cumin1002> START - Cookbook sre.dns.netbox [production]
22:10 <eileen> civicrm upgraded from 3b59e784 to 8eb67a94 [production]
22:09 <sbassett@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
22:08 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
22:07 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
22:07 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/244 [admin]
22:07 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/244 [admin]
22:07 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/244 [admin]
22:06 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/244 [admin]
21:59 <sbassett@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
21:53 <tzatziki> removing 4 files for legal compliance [production]
21:48 <sbassett@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
21:41 <tzatziki> removing 2 files for legal compliance [production]
21:38 <sbassett@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
21:38 <sbassett@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
21:28 <sbassett@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
21:21 <mstyles@deploy1003> Finished scap sync-world: Backport for [[gerrit:1153351|Revert^2 "OATHAuth: Mark checkuser and suppress as requiring 2FA" (T150898)]] (duration: 11m 31s) [production]
21:18 <bvibber@deploy1003> helmfile [codfw] DONE helmfile.d/services/chart-renderer: apply [production]
21:14 <mstyles@deploy1003> mstyles, sbassett: Continuing with sync [production]
21:11 <mstyles@deploy1003> mstyles, sbassett: Backport for [[gerrit:1153351|Revert^2 "OATHAuth: Mark checkuser and suppress as requiring 2FA" (T150898)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:09 <mstyles@deploy1003> Started scap sync-world: Backport for [[gerrit:1153351|Revert^2 "OATHAuth: Mark checkuser and suppress as requiring 2FA" (T150898)]] [production]
21:03 <cjming@deploy1003> Finished scap sync-world: Backport for [[gerrit:1153350|Use default preference if no client preference in auth request (T395957)]] (duration: 09m 49s) [production]
20:56 <cjming@deploy1003> matmarex, cjming: Continuing with sync [production]
20:55 <cjming@deploy1003> matmarex, cjming: Backport for [[gerrit:1153350|Use default preference if no client preference in auth request (T395957)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:53 <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1153350|Use default preference if no client preference in auth request (T395957)]] [production]
20:46 <marostegui@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of es2040.codfw.wmnet onto es2048.codfw.wmnet [production]
20:46 <marostegui@cumin1002> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) es2048 gradually with 4 steps - Pool es2048.codfw.wmnet in after cloning [production]
20:37 <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1153341|Use ::getContentId() and ::clearContentId() from the Parsoid extension API]] (duration: 12m 41s) [production]
20:31 <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_main on wdqs1022.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250526/wiki=wikidata/scope=wikidata_main/ using stat1009.eqiad.wmnet) [production]
20:30 <cscott@deploy1003> cscott: Continuing with sync [production]
20:27 <cscott@deploy1003> cscott: Backport for [[gerrit:1153341|Use ::getContentId() and ::clearContentId() from the Parsoid extension API]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:25 <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1153341|Use ::getContentId() and ::clearContentId() from the Parsoid extension API]] [production]
20:18 <cjming@deploy1003> Finished scap sync-world: Backport for [[gerrit:1152860|Deploy survey to en at twenty percent (T389393)]] (duration: 11m 18s) [production]
20:12 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) [admin]
20:11 <cjming@deploy1003> ksarabia, cjming: Continuing with sync [production]
20:09 <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading scholarly_articles on wdqs1023.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf_subgraphs/snapshot=20250526/wiki=wikidata/scope=scholarly_articles/ using stat1011.eqiad.wmnet) [production]
20:08 <cjming@deploy1003> ksarabia, cjming: Backport for [[gerrit:1152860|Deploy survey to en at twenty percent (T389393)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:08 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
20:06 <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1152860|Deploy survey to en at twenty percent (T389393)]] [production]
19:41 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) [admin]
19:37 <ryankemper@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) reloading wikidata_full on wdqs1020.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf/date=20250526/wiki=wikidata/ using stat1008.eqiad.wmnet) [production]
19:37 <ryankemper@cumin2002> START - Cookbook sre.wdqs.data-reload reloading wikidata_full on wdqs1020.eqiad.wmnet from DumpsSource.HDFS (hdfs:///wmf/data/discovery/wikidata/rdf/date=20250526/wiki=wikidata/ using stat1008.eqiad.wmnet) [production]
19:36 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]