|
2026-10-28
ยง
|
| 21:34 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1371-1384].eqiad.wmnet |
[production] |
| 21:33 |
<mutante> |
deploy1003 - sudo find . -path '*/.git/DEPLOY_HEAD' -exec sed -i -E '/^git_(server|scheme|deploy_dir):/d' {} + (backup in /root/DEPLOY_HEAD-backup.tgz) - T197470 |
[production] |
| 21:26 |
<pt1979@cumin1004> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (live debug) |
[production] |
| 21:25 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1371-1384].eqiad.wmnet |
[production] |
| 21:25 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1357-1370].eqiad.wmnet |
[production] |
| 21:24 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1357-1370].eqiad.wmnet |
[production] |
| 21:22 |
<akhatun@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:21 |
<akhatun@deploy1003> |
helmfile [codfw] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:21 |
<akhatun@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:21 |
<akhatun@deploy1003> |
helmfile [eqiad] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:20 |
<akhatun@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:20 |
<akhatun@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:19 |
<akhatun@deploy1003> |
helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:18 |
<akhatun@deploy1003> |
helmfile [staging] START helmfile.d/services/lac-lambdas: apply |
[production] |
| 21:16 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1357-1370].eqiad.wmnet |
[production] |
| 21:14 |
<jforrester@deploy1003> |
Finished scap deploy-service wikifunctions: Weekly f-o service deploy (duration: 01m 47s) |
[production] |
| 21:14 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions |
[production] |
| 21:13 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions |
[production] |
| 21:12 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions |
[production] |
| 21:12 |
<jforrester@deploy1003> |
Started scap deploy-service wikifunctions: Weekly f-o service deploy |
[production] |
| 21:08 |
<jforrester@deploy1003> |
Finished scap deploy-service wikifunctions: Weekly f-e service deploy, this time with a bump commit (duration: 02m 11s) |
[production] |
| 21:07 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions |
[production] |
| 21:07 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1357-1370].eqiad.wmnet |
[production] |
| 21:07 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions |
[production] |
| 21:06 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1343-1356].eqiad.wmnet |
[production] |
| 21:06 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1343-1356].eqiad.wmnet |
[production] |
| 21:06 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions |
[production] |
| 21:06 |
<jforrester@deploy1003> |
Started scap deploy-service wikifunctions: Weekly f-e service deploy, this time with a bump commit |
[production] |
| 21:02 |
<jforrester@deploy1003> |
Finished scap deploy-service wikifunctions: Weekly function-evaluator service deploy (duration: 01m 29s) |
[production] |
| 21:01 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions |
[production] |
| 21:01 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions |
[production] |
| 21:00 |
<jforrester@deploy1003> |
scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions |
[production] |
| 21:00 |
<jforrester@deploy1003> |
Started scap deploy-service wikifunctions: Weekly function-evaluator service deploy |
[production] |
| 20:59 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1343-1356].eqiad.wmnet |
[production] |
| 20:50 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1343-1356].eqiad.wmnet |
[production] |
| 20:50 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1329-1342].eqiad.wmnet |
[production] |
| 20:50 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1329-1342].eqiad.wmnet |
[production] |
| 20:42 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1329-1342].eqiad.wmnet |
[production] |
| 20:40 |
<sbassett> |
Deployed security mitigations for T435455, T439844, T442538 |
[production] |
| 20:29 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1329-1342].eqiad.wmnet |
[production] |
| 20:29 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1315-1328].eqiad.wmnet |
[production] |
| 20:29 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1315-1328].eqiad.wmnet |
[production] |
| 20:20 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1315-1328].eqiad.wmnet |
[production] |
| 20:19 |
<mutante> |
etherpad1004 - apache httpd disabled by puppet - etherpad running normally |
[production] |
| 20:17 |
<arlolra@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1358832|Turn off "report a visual" bug on wikipedias (T430970)]] (duration: 11m 26s) |
[production] |
| 20:14 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:14 |
<cmooney@cumin1004> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update last few IPs that got awawy - cmooney@cumin1004" |
[production] |
| 20:14 |
<cmooney@cumin1004> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update last few IPs that got awawy - cmooney@cumin1004" |
[production] |
| 20:12 |
<jasmine@cumin2003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1315-1328].eqiad.wmnet |
[production] |
| 20:12 |
<jasmine@cumin2003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1301-1314].eqiad.wmnet |
[production] |