1-50 of 10000 results (20ms)
2026-10-29 §
04:14 <herron@cumin1004> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1262: depooling replica after host flap [production]
04:11 <herron@cumin1004> START - Cookbook sre.mysql.depool depool db1262: depooling replica after host flap [production]
00:00 <root@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox: sync [production]
00:00 <root@deploy1003> helmfile [staging] START helmfile.d/services/shellbox: sync [production]
2026-10-28 §
23:11 <egardner@deploy1003> Finished scap sync-world: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) (duration: 36m 58s) [production]
23:00 <egardner@deploy1003> sbassett, egardner: Continuing with deployment [production]
22:56 <egardner@deploy1003> sbassett, egardner: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) synced to the testservers (see https://wikitech.wikimedia.org/ [production]
22:34 <egardner@deploy1003> Started scap sync-world: Backport for [[gerrit:1359934|ShareCard: Show page views as a monthly rate (T439164)]] (1.48.0-wmf.1), [[gerrit:1359937|ShareCard: Hide images on the bad image list (T439161)]] (1.48.0-wmf.1), Bump symfony/mailer and symfony/mime to 7.4.22 (T442768) ([[gerrit:1359972|1.47.0-wmf.24]], [[gerrit:1359974|1.48.0-wmf.1]]) [production]
22:30 <egardner@deploy1003> Finished scap sync-world: Backport for [[gerrit:1357787|Disable Discord QuickSurvey]] (duration: 10m 41s) [production]
22:25 <egardner@deploy1003> derenrich, egardner: Continuing with deployment [production]
22:24 <egardner@deploy1003> derenrich, egardner: Backport for [[gerrit:1357787|Disable Discord QuickSurvey]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:20 <egardner@deploy1003> Started scap sync-world: Backport for [[gerrit:1357787|Disable Discord QuickSurvey]] [production]
22:17 <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1359380|Enable Vector ReadingList CTA on group 1 wikipedias+mw+wikitech (T441705)]] (duration: 12m 13s) [production]
22:11 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
22:09 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1359380|Enable Vector ReadingList CTA on group 1 wikipedias+mw+wikitech (T441705)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:05 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1359380|Enable Vector ReadingList CTA on group 1 wikipedias+mw+wikitech (T441705)]] [production]
21:51 <ammarpad@deploy1003> mwscript-k8s job started: extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=wikimania2007wiki --logwiki=metawiki MogosCZ Mogoskii # T442713 [production]
21:47 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-worker-eqiad [production]
21:47 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker-exp1001.eqiad.wmnet [production]
21:46 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker-exp1001.eqiad.wmnet [production]
21:42 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker-exp1001.eqiad.wmnet [production]
21:42 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker-exp1001.eqiad.wmnet [production]
21:42 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1371-1384].eqiad.wmnet [production]
21:42 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1371-1384].eqiad.wmnet [production]
21:34 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1371-1384].eqiad.wmnet [production]
21:33 <mutante> deploy1003 - sudo find . -path '*/.git/DEPLOY_HEAD' -exec sed -i -E '/^git_(server|scheme|deploy_dir):/d' {} + (backup in /root/DEPLOY_HEAD-backup.tgz) - T197470 [production]
21:26 <pt1979@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (live debug) [production]
21:25 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1371-1384].eqiad.wmnet [production]
21:25 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1357-1370].eqiad.wmnet [production]
21:24 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1357-1370].eqiad.wmnet [production]
21:22 <akhatun@deploy1003> helmfile [codfw] DONE helmfile.d/services/lac-lambdas: apply [production]
21:21 <akhatun@deploy1003> helmfile [codfw] START helmfile.d/services/lac-lambdas: apply [production]
21:21 <akhatun@deploy1003> helmfile [eqiad] DONE helmfile.d/services/lac-lambdas: apply [production]
21:21 <akhatun@deploy1003> helmfile [eqiad] START helmfile.d/services/lac-lambdas: apply [production]
21:20 <akhatun@deploy1003> helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply [production]
21:20 <akhatun@deploy1003> helmfile [staging] START helmfile.d/services/lac-lambdas: apply [production]
21:19 <akhatun@deploy1003> helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply [production]
21:18 <akhatun@deploy1003> helmfile [staging] START helmfile.d/services/lac-lambdas: apply [production]
21:16 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1357-1370].eqiad.wmnet [production]
21:14 <jforrester@deploy1003> Finished scap deploy-service wikifunctions: Weekly f-o service deploy (duration: 01m 47s) [production]
21:14 <jforrester@deploy1003> scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions [production]
21:13 <jforrester@deploy1003> scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions [production]
21:12 <jforrester@deploy1003> scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions [production]
21:12 <jforrester@deploy1003> Started scap deploy-service wikifunctions: Weekly f-o service deploy [production]
21:08 <jforrester@deploy1003> Finished scap deploy-service wikifunctions: Weekly f-e service deploy, this time with a bump commit (duration: 02m 11s) [production]
21:07 <jforrester@deploy1003> scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions [production]
21:07 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1357-1370].eqiad.wmnet [production]
21:07 <jforrester@deploy1003> scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions [production]
21:06 <jasmine@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1343-1356].eqiad.wmnet [production]
21:06 <jasmine@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1343-1356].eqiad.wmnet [production]