401-450 of 10000 results (118ms)
2026-06-10 ยง
10:21 <brouberol@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
10:21 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
10:21 <blake@deploy1003> Started scap sync-world: Backport for [[gerrit:1300072|ProductionServices: reboot poolcounter1007 (T426736)]] [production]
10:21 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
10:21 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
10:21 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
10:21 <cgoubert@deploy1003> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:20 <cgoubert@deploy1003> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:16 <blake@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host poolcounter1006.eqiad.wmnet [production]
10:14 <root@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1152: Security updates [production]
10:14 <root@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
10:14 <root@cumin1003> START - Cookbook sre.mysql.parsercache [production]
10:14 <root@cumin1003> START - Cookbook sre.mysql.depool depool db1152: Security updates [production]
10:13 <blake@cumin1003> START - Cookbook sre.hosts.reboot-single for host poolcounter1006.eqiad.wmnet [production]
10:12 <blake@deploy1003> Finished scap sync-world: Backport for [[gerrit:1300064|ProductionServices: reboot poolcounter1006.eqiad (T426736)]] (duration: 07m 46s) [production]
10:07 <blake@deploy1003> blake: Continuing with deployment [production]
10:06 <blake@deploy1003> blake: Backport for [[gerrit:1300064|ProductionServices: reboot poolcounter1006.eqiad (T426736)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
10:04 <blake@deploy1003> Started scap sync-world: Backport for [[gerrit:1300064|ProductionServices: reboot poolcounter1006.eqiad (T426736)]] [production]
09:57 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1300058|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]], [[gerrit:1300059|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]] (duration: 09m 32s) [production]
09:52 <kharlan@deploy1003> kharlan: Continuing with deployment [production]
09:49 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1300058|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]], [[gerrit:1300059|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
09:47 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1300058|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]], [[gerrit:1300059|SourceEditorOverlay: Show CAPTCHA panel when AF challenge closed (T425929)]] [production]
09:35 <cmooney@cumin1003> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
09:34 <cmooney@cumin1003> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
09:32 <cmooney@cumin1003> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
09:32 <cmooney@cumin1003> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
09:26 <moritzm> upgrade routinator in eqiad to 0.15.2 T428456 [production]
09:23 <ayounsi@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply [production]
09:23 <ayounsi@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply [production]
09:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5004.eqsin.wmnet [production]
09:20 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of prometheus5003.eqsin.wmnet to plain [production]
09:18 <jmm@cumin2002> START - Cookbook sre.ganeti.changedisk for changing disk type of prometheus5003.eqsin.wmnet to plain [production]
09:15 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:05 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:05 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:05 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:05 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:04 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:03 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:03 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:02 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:02 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
09:00 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
09:00 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
08:55 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
08:54 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
08:30 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
08:29 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
08:29 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
08:20 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]