1-50 of 10000 results (19ms)
2026-11-05 ยง
14:44 <dbrant@deploy2003> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
14:44 <dbrant@deploy2003> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
14:41 <mlitn@deploy2003> mlitn: Continuing with deployment [production]
14:38 <mlitn@deploy2003> mlitn: Backport for [[gerrit:1364301|Squashed diff to master]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:34 <mlitn@deploy2003> Started scap sync-world: Backport for [[gerrit:1364301|Squashed diff to master]] (1.48.0-wmf.3) [production]
14:32 <Tran> Deployed patch for T443598 [production]
14:17 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
14:16 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97374 and previous config saved to /var/cache/conftool/dbconfig/20261105-141655-ladsgroup.json [production]
14:15 <stran@deploy2003> Finished scap sync-world: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] (duration: 11m 34s) [production]
14:11 <cmooney@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1006.eqiad.wmnet with OS trixie [production]
14:09 <stran@deploy2003> stran: Continuing with deployment [production]
14:08 <stran@deploy2003> stran: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:06 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1286', diff saved to https://phabricator.wikimedia.org/P97373 and previous config saved to /var/cache/conftool/dbconfig/20261105-140653-ladsgroup.json [production]
14:03 <stran@deploy2003> Started scap sync-world: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] [production]
13:56 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1286', diff saved to https://phabricator.wikimedia.org/P97372 and previous config saved to /var/cache/conftool/dbconfig/20261105-135651-ladsgroup.json [production]
13:53 <cmooney@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage [production]
13:48 <cmooney@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage [production]
13:46 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97371 and previous config saved to /var/cache/conftool/dbconfig/20261105-134649-ladsgroup.json [production]
13:45 <cmooney@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (remove config only) [production]
13:45 <cmooney@cumin1004> START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (remove config only) [production]
13:41 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Depooling db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97370 and previous config saved to /var/cache/conftool/dbconfig/20261105-134145-ladsgroup.json [production]
13:41 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1286.eqiad.wmnet with reason: Maintenance [production]
13:41 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97369 and previous config saved to /var/cache/conftool/dbconfig/20261105-134125-ladsgroup.json [production]
13:35 <eevans@deploy2003> helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply [production]
13:35 <eevans@deploy2003> helmfile [codfw] START helmfile.d/services/linked-artifacts: apply [production]
13:35 <eevans@deploy2003> helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply [production]
13:35 <eevans@deploy2003> helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply [production]
13:35 <eevans@deploy2003> helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply [production]
13:34 <eevans@deploy2003> helmfile [staging] START helmfile.d/services/linked-artifacts: apply [production]
13:33 <cmooney@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
13:31 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1281', diff saved to https://phabricator.wikimedia.org/P97368 and previous config saved to /var/cache/conftool/dbconfig/20261105-133123-ladsgroup.json [production]
13:26 <cmooney@cumin1004> START - Cookbook sre.hosts.provision for host sretest1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
13:21 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1281', diff saved to https://phabricator.wikimedia.org/P97367 and previous config saved to /var/cache/conftool/dbconfig/20261105-132122-ladsgroup.json [production]
13:20 <cmooney@cumin1004> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.eqiad.wmnet on all recursors [production]
13:19 <cmooney@cumin1004> START - Cookbook sre.dns.wipe-cache sretest1006.eqiad.wmnet on all recursors [production]
13:19 <cmooney@cumin1004> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (push config only) [production]
13:19 <cmooney@cumin1004> START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (push config only) [production]
13:19 <cmooney@cumin1004> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:19 <cmooney@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" [production]
13:19 <cmooney@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" [production]
13:18 <cmooney@cumin1004> START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie [production]
13:14 <cmooney@cumin1004> START - Cookbook sre.dns.netbox [production]
13:11 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97366 and previous config saved to /var/cache/conftool/dbconfig/20261105-131120-ladsgroup.json [production]
13:06 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Depooling db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97365 and previous config saved to /var/cache/conftool/dbconfig/20261105-130607-ladsgroup.json [production]
13:06 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 7 hosts with reason: Maintenance [production]
13:05 <ladsgroup@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1281.eqiad.wmnet with reason: Maintenance [production]
13:05 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97364 and previous config saved to /var/cache/conftool/dbconfig/20261105-130524-ladsgroup.json [production]
12:55 <ladsgroup@cumin1004> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P97363 and previous config saved to /var/cache/conftool/dbconfig/20261105-125522-ladsgroup.json [production]
12:52 <kamila@deploy2003> Finished scap sync-world: Backport for [[gerrit:1364180|Enroll 5% of client sessions in PHP 8.5 (T441689)]] (duration: 10m 50s) [production]
12:46 <kamila@deploy2003> kamila: Continuing with deployment [production]