1751-1800 of 10000 results (126ms)
2025-03-17 ยง
11:23 <Dreamy_Jazz> Ran `mwscript migrateUserGroup.php --wiki=testwiki checkuser-temporary-account-viewer temporary-account-viewer` [production]
11:22 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
11:22 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs3010.esams.wmnet with OS bookworm [production]
11:21 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:21 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
11:20 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. [production]
11:20 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
11:20 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. [production]
11:19 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
11:19 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. [production]
11:19 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
11:19 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'sync'. [production]
11:19 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing P{lvs[4008-4009].ulsfo.wmnet,lvs5004.eqsin.wmnet} and A:liberica [production]
11:18 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128375|Re-enable the 'temporary-account-viewer' group for migration (T387205)]], [[gerrit:1127894|Remove obsolete $wgParserCacheNewKeySchemaRatio (T373037)]] (duration: 12m 32s) [production]
11:16 <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.upgrade upgradeing P{lvs[4008-4009].ulsfo.wmnet,lvs5004.eqsin.wmnet} and A:liberica [production]
11:14 <kamila@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:14 <kamila@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
11:13 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing A:liberica-magru [production]
11:11 <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.upgrade upgradeing A:liberica-magru [production]
11:10 <dreamyjazz@deploy2002> dreamyjazz, hashar: Continuing with sync [production]
11:10 <dreamyjazz@deploy2002> dreamyjazz, hashar: Backport for [[gerrit:1128375|Re-enable the 'temporary-account-viewer' group for migration (T387205)]], [[gerrit:1127894|Remove obsolete $wgParserCacheNewKeySchemaRatio (T373037)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:07 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing P{lvs[5005-5006].eqsin.wmnet} and A:liberica [production]
11:06 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1128375|Re-enable the 'temporary-account-viewer' group for migration (T387205)]], [[gerrit:1127894|Remove obsolete $wgParserCacheNewKeySchemaRatio (T373037)]] [production]
11:04 <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.upgrade upgradeing P{lvs[5005-5006].eqsin.wmnet} and A:liberica [production]
11:04 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128366|findBadBlobs: Allow for timestamp based search via --scan-to (T351953)]], [[gerrit:1128365|media: Make SvgHandler respect physicalWidth when building URL for thumb (T360589)]] (duration: 14m 09s) [production]
11:02 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs3010.esams.wmnet with reason: host reimage [production]
10:59 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing P{lvs5006.eqsin.wmnet} and A:liberica [production]
10:58 <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.upgrade upgradeing P{lvs5006.eqsin.wmnet} and A:liberica [production]
10:57 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
10:57 <vgutierrez@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs3010.esams.wmnet with reason: host reimage [production]
10:55 <kamila@cumin1002> START - Cookbook sre.k8s.wipe-cluster Wipe the K8s cluster staging-eqiad: k8s upgrade [production]
10:55 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1128366|findBadBlobs: Allow for timestamp based search via --scan-to (T351953)]], [[gerrit:1128365|media: Make SvgHandler respect physicalWidth when building URL for thumb (T360589)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
10:50 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1128366|findBadBlobs: Allow for timestamp based search via --scan-to (T351953)]], [[gerrit:1128365|media: Make SvgHandler respect physicalWidth when building URL for thumb (T360589)]] [production]
10:43 <jynus> restarting dbprov2005 T389052 [production]
10:38 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reimage for host lvs3010.esams.wmnet with OS bookworm [production]
10:37 <vgutierrez@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs3010.esams.wmnet with OS bookworm [production]
10:21 <marostegui@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128356|Revert "db-production.php: Disable writes on es6"]] (duration: 14m 41s) [production]
10:21 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s1 [production]
10:19 <marostegui@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s1 [production]
10:18 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s2 [production]
10:17 <marostegui@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s2 [production]
10:17 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s3 [production]
10:16 <marostegui@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s3 [production]
10:15 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s4 [production]
10:14 <marostegui@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s4 [production]
10:14 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s5 [production]
10:13 <marostegui@deploy2002> marostegui: Continuing with sync [production]
10:12 <marostegui@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad for section s5 [production]
10:12 <marostegui@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad for section s8 [production]
10:11 <marostegui@deploy2002> marostegui: Backport for [[gerrit:1128356|Revert "db-production.php: Disable writes on es6"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]