201-250 of 10000 results (126ms)
2026-06-29 ยง
10:02 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db2247: Migration of db2247.codfw.wmnet completed [production]
09:54 <moritzm> installing libssh2 security updates [production]
09:49 <cwilliams@cumin1003> START - Cookbook sre.mysql.pool pool db1249: Migration of db1249.eqiad.wmnet completed [production]
09:46 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2247.codfw.wmnet with OS trixie [production]
09:39 <btullis@puppetserver1001> conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=codfw [production]
09:36 <marostegui> drop database apiportalwiki T418494 [production]
09:35 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1249.eqiad.wmnet with OS trixie [production]
09:29 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2247.codfw.wmnet with reason: host reimage [production]
09:25 <cwilliams@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2247.codfw.wmnet with reason: host reimage [production]
09:22 <dcausse> T418494 delete apiportalwiki cirrussearch indices [production]
09:19 <moritzm> installing librabbitmq security updates [production]
09:19 <cwilliams@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1249.eqiad.wmnet with reason: host reimage [production]
09:13 <ihurbain@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
09:12 <cwilliams@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db1249.eqiad.wmnet with reason: host reimage [production]
09:12 <ihurbain@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
09:12 <ihurbain@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
09:10 <cwilliams@cumin1003> START - Cookbook sre.hosts.reimage for host db2247.codfw.wmnet with OS trixie [production]
09:09 <ihurbain@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
09:00 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=codfw,name=dse-k8s-wdqs-test2001.codfw.wmnet [production]
08:59 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=codfw,name=dse-k8s-test-wdqs2001.codfw.wmnet [production]
08:59 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1080.eqiad.wmnet [production]
08:59 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=codfw,name=dse-k8s-test-wdqs2001.codfw.wmnet [production]
08:58 <btullis@puppetserver1001> conftool action : set/pooled=no; selector: service=kubesvc,cluster=dse-k8s,dc=codfw,name=dse-k8s-wdqs2003.codfw.wmnet [production]
08:55 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2247: Upgrading db2247.codfw.wmnet [production]
08:55 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2247: Upgrading db2247.codfw.wmnet [production]
08:55 <cwilliams@cumin1003> dbmaint on s4@codfw T429893 [production]
08:54 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
08:54 <cwilliams@cumin1003> START - Cookbook sre.hosts.reimage for host db1249.eqiad.wmnet with OS trixie [production]
08:52 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1249: Upgrading db1249.eqiad.wmnet [production]
08:51 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1249: Upgrading db1249.eqiad.wmnet [production]
08:51 <Tran> Deployed patch for T427287 [production]
08:51 <cwilliams@cumin1003> dbmaint on s4@eqiad T429893 [production]
08:51 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
08:47 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1079.eqiad.wmnet [production]
08:43 <filippo@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1078.eqiad.wmnet [production]
08:40 <ozge@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
08:34 <filippo@cumin1003> START - Cookbook sre.hosts.reboot-single for host cloudvirt1080.eqiad.wmnet [production]
08:34 <filippo@cumin1003> START - Cookbook sre.hosts.reboot-single for host cloudvirt1079.eqiad.wmnet [production]
08:33 <filippo@cumin1003> START - Cookbook sre.hosts.reboot-single for host cloudvirt1078.eqiad.wmnet [production]
08:32 <moritzm> installing libxslt bugfix updates [production]
08:25 <gkyziridis@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
08:09 <moritzm> installing lcms2 security updates [production]
08:07 <jmm@deploy1003> helmfile [eqiad] DONE helmfile.d/services/proton: apply [production]
08:06 <jmm@deploy1003> helmfile [eqiad] START helmfile.d/services/proton: apply [production]
08:05 <jmm@deploy1003> helmfile [codfw] DONE helmfile.d/services/proton: apply [production]
08:04 <jmm@deploy1003> helmfile [codfw] START helmfile.d/services/proton: apply [production]
08:01 <jmm@deploy1003> helmfile [staging] DONE helmfile.d/services/proton: apply [production]
08:00 <jmm@deploy1003> helmfile [staging] START helmfile.d/services/proton: apply [production]
07:45 <marostegui@cumin1003> conftool action : set/weight=100; selector: name=clouddb1026.eqiad.wmnet [production]
07:23 <jmm@cumin2003> END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) [production]