1-50 of 10000 results (28ms)
2025-06-25 §
23:46 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.b2 [production]
23:46 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.b1 [production]
23:31 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.b1 [production]
23:31 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.b0 [production]
23:16 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.b0 [production]
23:16 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.af [production]
23:08 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
23:03 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd2006-dev.codfw.wmnet with OS bullseye [production]
23:02 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.af [production]
23:02 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.ae [production]
22:51 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
22:47 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd2006-dev.codfw.wmnet with reason: host reimage [production]
22:46 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.ae [production]
22:46 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.ad [production]
22:43 <andrew@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
22:43 <andrew@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd2006-dev.codfw.wmnet with reason: host reimage [production]
22:40 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1003.eqiad.wmnet with OS bookworm [production]
22:32 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.ad [production]
22:32 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.ac [production]
22:27 <andrew@cumin1003> START - Cookbook sre.hosts.reimage for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
22:27 <andrew@cumin1003> START - Cookbook sre.hosts.reimage for host cloudcephosd2006-dev.codfw.wmnet with OS bullseye [production]
22:24 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1003.eqiad.wmnet with reason: host reimage [production]
22:21 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd2005-dev.codfw.wmnet with OS bullseye [production]
22:20 <jhathaway@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1003.eqiad.wmnet with reason: host reimage [production]
22:18 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.ac [production]
22:18 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.ab [production]
22:03 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.ab [production]
22:03 <andrew@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd2005-dev.codfw.wmnet with reason: host reimage [production]
22:03 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.aa [production]
22:03 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host sretest1003.eqiad.wmnet with OS bookworm [production]
21:57 <andrew@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd2005-dev.codfw.wmnet with reason: host reimage [production]
21:47 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.aa [production]
21:47 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.a9 [production]
21:41 <andrew@cumin1003> START - Cookbook sre.hosts.reimage for host cloudcephosd2005-dev.codfw.wmnet with OS bullseye [production]
21:31 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.a9 [production]
21:31 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.a8 [production]
21:22 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=97) [admin]
21:17 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
21:16 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.a8 [production]
21:16 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.a7 [production]
21:16 <bd808> Cherry-picked https://gerrit.wikimedia.org/r/c/operations/puppet/+/1163883/1 to deployment-puppetserver-1 (T397877) [releng]
21:16 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) [admin]
21:10 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
21:10 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=97) [admin]
21:10 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add [admin]
21:07 <jgreen@dns1004> END - running authdns-update [production]
21:07 <kemayo@deploy1003> Finished scap sync-world: Backport for [[gerrit:1139470|Enable VE in Project (Wikipedia/Վիքիպեդիա) namespace at hywiki (T359815)]], [[gerrit:1161937|Deploy EditCheck's multi-check mode everywhere (T395519)]] (duration: 13m 38s) [production]
21:06 <jgreen@dns1004> START - running authdns-update [production]
21:03 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.a7 [production]
21:03 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.a6 [production]