|
2026-10-29
ยง
|
| 09:28 |
<jiji@cumin2003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1228: Depooling replica - T442815 |
[production] |
| 09:27 |
<jiji@cumin2003> |
START - Cookbook sre.mysql.depool depool db1228: Depooling replica - T442815 |
[production] |
| 09:25 |
<bwojtowicz@deploy1003> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . |
[production] |
| 09:23 |
<bwojtowicz@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . |
[production] |
| 09:17 |
<moritzm> |
installing ca-certificates updates on Bookworm |
[production] |
| 09:16 |
<vgutierrez@cumin1004> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs6003.drmrs.wmnet with OS trixie |
[production] |
| 08:56 |
<vgutierrez@cumin1004> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs6003.drmrs.wmnet with reason: host reimage |
[production] |
| 08:51 |
<vgutierrez@cumin1004> |
START - Cookbook sre.hosts.downtime for 2:00:00 on lvs6003.drmrs.wmnet with reason: host reimage |
[production] |
| 08:49 |
<vgutierrez@cumin1004> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs6003.drmrs.wmnet (remove config only) |
[production] |
| 08:48 |
<vgutierrez@cumin1004> |
START - Cookbook sre.hosts.dhcp for host lvs6003.drmrs.wmnet (remove config only) |
[production] |
| 08:42 |
<hashar> |
restarting Gerrit |
[production] |
| 08:38 |
<jelto@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 14 hosts with reason: Java upgrade |
[production] |
| 08:38 |
<jelto@cumin1004> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit1003.wikimedia.org with reason: Java upgrade |
[production] |
| 08:35 |
<vgutierrez@cumin1004> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs6003.drmrs.wmnet (push config only) |
[production] |
| 08:35 |
<vgutierrez@cumin1004> |
START - Cookbook sre.hosts.dhcp for host lvs6003.drmrs.wmnet (push config only) |
[production] |
| 08:34 |
<vgutierrez@cumin1004> |
START - Cookbook sre.hosts.reimage for host lvs6003.drmrs.wmnet with OS trixie |
[production] |
| 08:30 |
<hashar> |
Restarted Gerrit on gerrit2002/gerrit2003 (spare/replica) to switch to Java 21 | T392465 |
[production] |
| 08:30 |
<moritzm> |
imported Jenkins 2.580.2 to thirdparty/jenkins for trixie-wikimedia T442030 |
[production] |
| 07:43 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . |
[production] |
| 07:43 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |
| 06:56 |
<marostegui> |
DB circular replication has been disabled everywhere T436501 |
[production] |
| 06:56 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s1 |
[production] |
| 06:55 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s1 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s4 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s4 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s8 |
[production] |
| 06:53 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s8 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s7 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s7 |
[production] |
| 06:52 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s3 |
[production] |
| 06:51 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s3 |
[production] |
| 06:51 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s2 |
[production] |
| 06:50 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s2 |
[production] |
| 06:49 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s5 |
[production] |
| 06:49 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s5 |
[production] |
| 06:47 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section s6 |
[production] |
| 06:47 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section s6 |
[production] |
| 06:46 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section es7 |
[production] |
| 06:46 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section es7 |
[production] |
| 06:43 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section es6 |
[production] |
| 06:43 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section es6 |
[production] |
| 06:40 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x4 |
[production] |
| 06:40 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x4 |
[production] |
| 06:38 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x3 |
[production] |
| 06:37 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x3 |
[production] |
| 06:36 |
<marostegui@cumin1004> |
END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw for section x1 |
[production] |
| 06:35 |
<marostegui@cumin1004> |
START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw for section x1 |
[production] |
| 06:10 |
<kartik@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 06:03 |
<kartik@deploy1003> |
helmfile [eqiad] START helmfile.d/services/machinetranslation: apply |
[production] |
| 06:00 |
<kevinbazira@deploy1003> |
helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . |
[production] |