4651-4700 of 10000 results (138ms)
2025-03-17 ยง
13:38 <vgutierrez@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on lvs3009.esams.wmnet with reason: host reimage [production]
13:31 <vgutierrez> uploaded HAProxy 3.1.5 to apt.wm.o (bullseye-wikimedia) component thirdparty/haproxy31 - T386796 [production]
13:27 <tgr@deploy2002> tgr: Backport for [[gerrit:1127965|Enable credentials change special pages on SUL3 shared domain (T362715)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:25 <mvernon@cumin1002> START - Cookbook sre.hosts.reimage for host ms-be2075.codfw.wmnet with OS bullseye [production]
13:25 <vgutierrez> upgrading HAProxy to version 3.1 in cp5032 (upload) - T386796 [production]
13:23 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1127965|Enable credentials change special pages on SUL3 shared domain (T362715)]] [production]
13:19 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1128403|Revert "Disable new WebAuthn credentials creation" (T378402 T389064)]], [[gerrit:1128032|sqwiktionary: update logo, wordmark, tagline and icon (T342172)]], [[gerrit:1126533|Growth: eswiki+cswiki - enable new way of refreshing LinkRecommendations (T386250)]] (duration: 13m 27s) [production]
13:18 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reimage for host lvs3009.esams.wmnet with OS bookworm [production]
13:14 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.network.debug (exit_code=99) for Netbox interface ID 20595 [production]
13:14 <ayounsi@cumin1002> START - Cookbook sre.network.debug for Netbox interface ID 20595 [production]
13:11 <tgr@deploy2002> tgr, migr, anzx: Continuing with sync [production]
13:10 <tgr@deploy2002> tgr, migr, anzx: Backport for [[gerrit:1128403|Revert "Disable new WebAuthn credentials creation" (T378402 T389064)]], [[gerrit:1128032|sqwiktionary: update logo, wordmark, tagline and icon (T342172)]], [[gerrit:1126533|Growth: eswiki+cswiki - enable new way of refreshing LinkRecommendations (T386250)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:08 <vgutierrez> depooling lvs3009 before being reimaged - T384477 [production]
13:08 <vgutierrez@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs3009.esams.wmnet with reason: depooled before reimage [production]
13:06 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1128403|Revert "Disable new WebAuthn credentials creation" (T378402 T389064)]], [[gerrit:1128032|sqwiktionary: update logo, wordmark, tagline and icon (T342172)]], [[gerrit:1126533|Growth: eswiki+cswiki - enable new way of refreshing LinkRecommendations (T386250)]] [production]
12:59 <kevinbazira@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
12:54 <jgiannelos@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
12:53 <jgiannelos@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]
12:53 <jgiannelos@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop: apply [production]
12:52 <jgiannelos@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop: apply [production]
12:51 <jgiannelos@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
12:50 <jgiannelos@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
12:38 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
12:38 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
12:27 <kamila@deploy2002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
12:27 <kamila@deploy2002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
12:25 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/zotero: apply [production]
12:25 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/wikifunctions: apply [production]
12:24 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/wikifeeds: apply [production]
12:24 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/wikidata-query-gui: apply [production]
12:23 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/toolhub: apply [production]
12:23 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/thumbor: apply [production]
12:23 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/termbox: apply [production]
12:22 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox-video: apply [production]
12:22 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox-timeline: apply [production]
12:21 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox-syntaxhighlight: apply [production]
12:21 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox-media: apply [production]
12:20 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox-constraints: apply [production]
12:20 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/shellbox: apply [production]
12:20 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/sessionstore: apply [production]
12:19 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/rest-gateway: apply [production]
12:19 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/recommendation-api: apply [production]
12:19 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/rdf-streaming-updater: apply [production]
12:18 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/ratelimit: apply [production]
12:18 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/push-notifications: apply [production]
12:18 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/proton: apply [production]
12:17 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/page-analytics: apply [production]
12:17 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/mobileapps: apply [production]
12:17 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/miscweb: apply [production]
12:16 <kamila@deploy2002> helmfile [staging] OK helmfile.d/services/media-analytics: apply [production]