1401-1450 of 10000 results (47ms)
2025-06-25 ยง
13:12 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.86 [production]
13:12 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.85 [production]
13:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Set db2165 with weight 0 T397164', diff saved to https://phabricator.wikimedia.org/P78679 and previous config saved to /var/cache/conftool/dbconfig/20250625-130835-fceratto.json [production]
13:08 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 27 hosts with reason: Primary switchover s8 T397164 [production]
12:58 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.85 [production]
12:58 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.84 [production]
12:47 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1175.eqiad.wmnet [production]
12:46 <root@cumin1002> DONE (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for backup1008.eqiad.wmnet: Renew puppet certificate - root@cumin1002 [production]
12:43 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.84 [production]
12:43 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.83 [production]
12:39 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1175.eqiad.wmnet [production]
12:39 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1153.eqiad.wmnet [production]
12:32 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1153.eqiad.wmnet [production]
12:31 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1152.eqiad.wmnet [production]
12:30 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
12:30 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
12:29 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.83 [production]
12:29 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.82 [production]
12:24 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1152.eqiad.wmnet [production]
12:14 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.82 [production]
12:14 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.81 [production]
12:04 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
12:04 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
12:04 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
12:03 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
12:03 <cgoubert@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
12:03 <cgoubert@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
11:57 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.81 [production]
11:57 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.80 [production]
11:54 <jakob@deploy1003> helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply [production]
11:54 <jakob@deploy1003> helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply [production]
11:54 <jakob@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply [production]
11:54 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:54 <jakob@deploy1003> helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply [production]
11:53 <jakob@deploy1003> helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply [production]
11:53 <jakob@deploy1003> helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply [production]
11:51 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
11:49 <klausman@deploy1003> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
11:49 <klausman@deploy1003> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
11:49 <klausman@deploy1003> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
11:48 <klausman@deploy1003> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
11:48 <klausman@deploy1003> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
11:46 <klausman@deploy1003> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
11:46 <klausman@deploy1003> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
11:45 <klausman@deploy1003> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
11:45 <klausman@deploy1003> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
11:44 <klausman@deploy1003> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
11:44 <klausman@deploy1003> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
11:44 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.80 [production]
11:44 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.7f [production]