201-250 of 10000 results (122ms)
2026-04-07 ยง
08:52 <Amir1> tightening the rate limit for non-standard thumbnails (T402792 T414805) [production]
08:42 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:40 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:38 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:38 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:37 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:25 <ayounsi@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 42 [production]
08:22 <ayounsi@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 42 [production]
08:18 <XioNoX> update pfw1-eqiad NAT - T422380 [production]
08:05 <hashar> Moved Debian Glue jobs to Jenkins agents running Bookworm (integration-agent-pkgbuilder-1005 and integration-agent-pkgbuilder-1006)| T421114 [production]
08:00 <marostegui> Upgrade clouddb1017 to mariadb 10.11.16 (v3) T420177 [production]
07:59 <XioNoX> push pfw policies - T422204 [production]
07:59 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1017.eqiad.wmnet with reason: Maintenance [production]
07:54 <hashar> Moved `operations-puppet-tests-bullseye` job from a Jenkins agent running Bullseye to one running Bookworm. The image is still on Bullseye! | T421114 [production]
07:44 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
07:14 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2157: after upgrade [production]
07:14 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1159: after upgrade [production]
06:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2142: Upgrade package [production]
06:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
06:32 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
06:32 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2142: Upgrade package [production]
06:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2248: Upgrade package [production]
06:29 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2157: after upgrade [production]
06:28 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1159: after upgrade [production]
06:16 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2248: Upgrade package [production]
06:16 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2249: Upgrade package [production]
06:02 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc1011: after upgrade [production]
06:02 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
06:02 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool pc1011: after upgrade [production]
06:02 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
06:01 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2249: Upgrade package [production]
06:01 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1169: Upgrade package [production]
05:45 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db1169: Upgrade package [production]
05:37 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1169: Upgrade package [production]
05:37 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1169: Upgrade package [production]
05:37 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2142: Upgrade package [production]
05:36 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
05:36 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
05:36 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2142: Upgrade package [production]
05:35 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2248: Upgrade package [production]
05:35 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2248: Upgrade package [production]
05:33 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2248: Upgrade package [production]
05:33 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2248: Upgrade package [production]
05:31 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249.codfw.wmnet: Upgrade package [production]
05:31 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249.codfw.wmnet: Upgrade package [production]
05:31 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249: Upgrade package [production]
05:31 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249: Upgrade package [production]
05:30 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249: Upgrade package [production]
05:30 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249: Upgrade package [production]
05:29 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db[2142,2248-2249].codfw.wmnet,db1169.eqiad.wmnet with reason: Upgrade to 10.11.16.v3 [production]