801-850 of 10000 results (32ms)
2024-11-19 ยง
09:55 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw [production]
09:52 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw [production]
09:51 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:51 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:49 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw [production]
09:49 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw [production]
09:42 <fabfur> upgrade haproxy on cp-text|upload_eqsin (T379891) [production]
09:42 <fabfur@cumin1002> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_eqsin [production]
09:41 <fabfur@cumin1002> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_eqsin [production]
09:39 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from codfw to eqiad [production]
09:39 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:39 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:39 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.finalize for the switch from codfw to eqiad [production]
09:39 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:38 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad [production]
09:38 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:35 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad [production]
09:33 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:32 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:19 <aklapper@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.4 refs T375663 [production]
09:18 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad [production]
09:18 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad [production]
08:59 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1092752|Add + to nowiki in core-Permissions.php (T380252)]] (duration: 10m 17s) [production]
08:54 <urbanecm@deploy2002> urbanecm, jhsoby: Continuing with sync [production]
08:54 <urbanecm@deploy2002> urbanecm, jhsoby: Backport for [[gerrit:1092752|Add + to nowiki in core-Permissions.php (T380252)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:49 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1092752|Add + to nowiki in core-Permissions.php (T380252)]] [production]
08:48 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1092741|fix tours by finishing partial variable rename (T380071)]], [[gerrit:1092364|affcom contactpages: Fix Letter of intent and logo field labels (T375392)]], [[gerrit:1092743|Add nowiki to commonsuploads dblist (T380252)]] (duration: 14m 29s) [production]
08:43 <urbanecm@deploy2002> ammarpad, migr, jhsoby, urbanecm: Continuing with sync [production]
08:39 <urbanecm@deploy2002> ammarpad, migr, jhsoby, urbanecm: Backport for [[gerrit:1092741|fix tours by finishing partial variable rename (T380071)]], [[gerrit:1092364|affcom contactpages: Fix Letter of intent and logo field labels (T375392)]], [[gerrit:1092743|Add nowiki to commonsuploads dblist (T380252)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:34 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1092741|fix tours by finishing partial variable rename (T380071)]], [[gerrit:1092364|affcom contactpages: Fix Letter of intent and logo field labels (T375392)]], [[gerrit:1092743|Add nowiki to commonsuploads dblist (T380252)]] [production]
08:29 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1082726|Translate Event Logging: Enable using $wgTranslateEnableEventLogging (T364460)]], [[gerrit:1092258|CirrusSearch: enable offloading weighted tags via EventBus (T378983 T377150)]], [[gerrit:1091197|[GrowthExperiments] Add virtual domain config (T354939)]] (duration: 24m 42s) [production]
08:22 <urbanecm@deploy2002> urbanecm, wangombe, pfischer: Continuing with sync [production]
08:12 <urbanecm@deploy2002> urbanecm, wangombe, pfischer: Backport for [[gerrit:1082726|Translate Event Logging: Enable using $wgTranslateEnableEventLogging (T364460)]], [[gerrit:1092258|CirrusSearch: enable offloading weighted tags via EventBus (T378983 T377150)]], [[gerrit:1091197|[GrowthExperiments] Add virtual domain config (T354939)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:04 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1082726|Translate Event Logging: Enable using $wgTranslateEnableEventLogging (T364460)]], [[gerrit:1092258|CirrusSearch: enable offloading weighted tags via EventBus (T378983 T377150)]], [[gerrit:1091197|[GrowthExperiments] Add virtual domain config (T354939)]] [production]
07:45 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2202.codfw.wmnet with reason: sad [production]
07:45 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2202.codfw.wmnet with reason: sad [production]
07:41 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1246.eqiad.wmnet with reason: T374215 - hw maintenance [production]
07:40 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on db1246.eqiad.wmnet with reason: T374215 - hw maintenance [production]
07:32 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1016.eqiad.wmnet [production]
07:31 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1016.eqiad.wmnet [production]
07:24 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1016.eqiad.wmnet [production]
05:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.44.0-wmf.1 (duration: 01m 18s) [production]
04:52 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.44.0-wmf.4 refs T375663 (duration: 49m 01s) [production]
04:27 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1062'] [cloudvirt-canary]
04:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1062'] [cloudvirt-canary]
04:16 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1062.eqiad.wmnet with OS bookworm [production]
04:15 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1062'] [cloudvirt-canary]
04:15 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1062'] [cloudvirt-canary]
04:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.4 refs T375663 [production]
04:00 <ejegg> fundraising civicrm upgraded from 463a12c5 to e29243f0 [production]