1151-1200 of 10000 results (100ms)
2025-04-08 ยง
17:29 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1211 (T391056)', diff saved to https://phabricator.wikimedia.org/P74738 and previous config saved to /var/cache/conftool/dbconfig/20250408-172929-fceratto.json [production]
17:29 <jgiannelos@deploy1003> helmfile [eqiad] START helmfile.d/services/proton: apply [production]
17:22 <cmooney@cumin1002> END (FAIL) - Cookbook sre.hosts.dhcp (exit_code=99) for host nokiatest2001.codfw.wmnet [production]
17:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1211 (T391056)', diff saved to https://phabricator.wikimedia.org/P74737 and previous config saved to /var/cache/conftool/dbconfig/20250408-171753-fceratto.json [production]
17:17 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1211.eqiad.wmnet with reason: Maintenance [production]
17:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T391056)', diff saved to https://phabricator.wikimedia.org/P74736 and previous config saved to /var/cache/conftool/dbconfig/20250408-171731-fceratto.json [production]
17:15 <swfrench@deploy1003> Stopping before sync operations [production]
17:14 <swfrench@deploy1003> Started scap sync-world: Pilot stop-before-sync scap run using PHP 8.1 container image for maintenance scripts - T390225 [production]
17:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P74735 and previous config saved to /var/cache/conftool/dbconfig/20250408-170224-fceratto.json [production]
16:51 <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1135066|Revert "Temporarily enable mobile sitenotice for fawiki"]] (duration: 20m 49s) [production]
16:50 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:50 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:50 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:50 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:50 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:50 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:47 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P74734 and previous config saved to /var/cache/conftool/dbconfig/20250408-164717-fceratto.json [production]
16:45 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/proton: apply [production]
16:45 <ladsgroup@deploy1003> ladsgroup: Continuing with sync [production]
16:44 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/proton: apply [production]
16:41 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:38 <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1135066|Revert "Temporarily enable mobile sitenotice for fawiki"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:32 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T391056)', diff saved to https://phabricator.wikimedia.org/P74733 and previous config saved to /var/cache/conftool/dbconfig/20250408-163210-fceratto.json [production]
16:31 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1135066|Revert "Temporarily enable mobile sitenotice for fawiki"]] [production]
16:24 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:24 <hnowlan> running 'ipvsadm --delete-service --tcp-service 10.2.2.26:443 && ipvsadm --delete-service --tcp-service 10.2.2.5:443' on eqiad lvs to remove videoscaler and jobrunner services [production]
16:24 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:23 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:22 <hnowlan> running 'ipvsadm --delete-service --tcp-service 10.2.2.26:443 && ipvsadm --delete-service --tcp-service 10.2.2.5:443' on codfw lvs to remove videoscaler and jobrunner services [production]
16:21 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:20 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1209 (T391056)', diff saved to https://phabricator.wikimedia.org/P74732 and previous config saved to /var/cache/conftool/dbconfig/20250408-162029-fceratto.json [production]