|
2026-02-18
ยง
|
| 20:50 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on backup2017.codfw.wmnet with reason: host reimage |
[production] |
| 20:46 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2179 (T415786)', diff saved to https://phabricator.wikimedia.org/P88883 and previous config saved to /var/cache/conftool/dbconfig/20260218-204624-marostegui.json |
[production] |
| 20:35 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host backup2018.codfw.wmnet with OS trixie |
[production] |
| 20:34 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:34 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host backup2017.codfw.wmnet with OS trixie |
[production] |
| 20:29 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host backup2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 20:20 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2015.codfw.wmnet with OS trixie |
[production] |
| 20:20 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 20:20 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 20:19 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2016.codfw.wmnet with OS trixie |
[production] |
| 20:19 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 20:15 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 20:04 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2015.codfw.wmnet with reason: host reimage |
[production] |
| 20:01 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on backup2015.codfw.wmnet with reason: host reimage |
[production] |
| 19:53 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2016.codfw.wmnet with reason: host reimage |
[production] |
| 19:48 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on backup2016.codfw.wmnet with reason: host reimage |
[production] |
| 19:45 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host backup2015.codfw.wmnet with OS trixie |
[production] |
| 19:40 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 19:32 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.reimage for host backup2016.codfw.wmnet with OS trixie |
[production] |
| 19:30 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host backup2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 19:30 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db1221 (T415786)', diff saved to https://phabricator.wikimedia.org/P88882 and previous config saved to /var/cache/conftool/dbconfig/20260218-193017-marostegui.json |
[production] |
| 19:30 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 6 hosts with reason: Maintenance |
[production] |
| 19:29 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1221.eqiad.wmnet with reason: Maintenance |
[production] |
| 19:29 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1199 (T415786)', diff saved to https://phabricator.wikimedia.org/P88881 and previous config saved to /var/cache/conftool/dbconfig/20260218-192929-marostegui.json |
[production] |
| 19:28 |
<dancy@deploy2002> |
rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.16 refs T413807 |
[production] |
| 19:14 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P88880 and previous config saved to /var/cache/conftool/dbconfig/20260218-191420-marostegui.json |
[production] |
| 19:05 |
<brett> |
import haproxykafka 0.3.16+deb13u1 into trixie-wikimedia (T401832) |
[production] |
| 18:59 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P88879 and previous config saved to /var/cache/conftool/dbconfig/20260218-185912-marostegui.json |
[production] |
| 18:50 |
<ladsgroup@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] (duration: 07m 43s) |
[production] |
| 18:46 |
<ladsgroup@deploy2002> |
ladsgroup: Continuing with sync |
[production] |
| 18:44 |
<ladsgroup@deploy2002> |
ladsgroup: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 18:44 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1199 (T415786)', diff saved to https://phabricator.wikimedia.org/P88878 and previous config saved to /var/cache/conftool/dbconfig/20260218-184405-marostegui.json |
[production] |
| 18:42 |
<ladsgroup@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] |
[production] |
| 18:04 |
<reedy@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1240340|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240343|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240345|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240346|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240347|Upgrading firebase/php-jwt (v6.11.1 => |
[production] |
| 18:00 |
<reedy@deploy2002> |
reedy: Continuing with sync |
[production] |
| 18:00 |
<reedy@deploy2002> |
reedy: Backport for [[gerrit:1240340|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240343|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240345|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240346|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240347|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]] |
[production] |
| 17:58 |
<reedy@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1240340|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240343|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240345|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240346|Upgrading firebase/php-jwt (v6.11.1 => v7.0.2) (T417722)]], [[gerrit:1240347|Upgrading firebase/php-jwt (v6.11.1 => v |
[production] |
| 17:12 |
<jnuche@deploy2002> |
Finished deploy [releng/jenkins-deploy@863e5c2] (releasing): Jenkins security updates (duration: 01m 32s) |
[production] |
| 17:10 |
<jnuche@deploy2002> |
Started deploy [releng/jenkins-deploy@863e5c2] (releasing): Jenkins security updates |
[production] |
| 16:53 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host gerrit1003.wikimedia.org with OS bookworm |
[production] |
| 16:48 |
<vgutierrez@cumin1003> |
END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing A:liberica AND NOT P{lvs7003.magru.wmnet} and A:liberica (T417306) |
[production] |
| 16:34 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gerrit1003.wikimedia.org with reason: host reimage |
[production] |
| 16:30 |
<arnaudb@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on gerrit1003.wikimedia.org with reason: host reimage |
[production] |
| 16:30 |
<jnuche@deploy2002> |
Finished deploy [releng/jenkins-deploy@863e5c2] (releasing): Jenkins update test on backup host (duration: 01m 48s) |
[production] |
| 16:29 |
<jnuche@deploy2002> |
Started deploy [releng/jenkins-deploy@863e5c2] (releasing): Jenkins update test on backup host |
[production] |
| 16:22 |
<vgutierrez@cumin1003> |
START - Cookbook sre.loadbalancer.upgrade upgradeing A:liberica AND NOT P{lvs7003.magru.wmnet} and A:liberica (T417306) |
[production] |
| 16:19 |
<vgutierrez@cumin1003> |
END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) upgradeing P{lvs7003.magru.wmnet} and A:liberica (T417306) |
[production] |
| 16:18 |
<vgutierrez@cumin1003> |
START - Cookbook sre.loadbalancer.upgrade upgradeing P{lvs7003.magru.wmnet} and A:liberica (T417306) |
[production] |
| 16:18 |
<vgutierrez> |
upload liberica 0.24 to bookworm-wikimedia (apt.wm.o) - T417306 |
[production] |
| 16:14 |
<moritzm> |
upgrade codfw1dev instances of cloudlb and cloudservices* to Bird 2.18 T413740 |
[production] |