751-800 of 10000 results (100ms)
2025-03-31 §
07:34 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7012.magru.wmnet [production]
07:34 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7004.magru.wmnet [production]
07:33 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7003.magru.wmnet [production]
07:33 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7011.magru.wmnet [production]
07:32 <dcausse@deploy1003> Started scap sync-world: Backport for [[gerrit:1132423|Translate: fix elasticsearch cluster setup (T390244)]] [production]
07:32 <brouberol@deploy1003> Finished scap build-images: T390059 - Prevent stub provider from going in an infinite loop (duration: 10m 57s) [production]
07:28 <kevinbazira@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:27 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7011.magru.wmnet [production]
07:27 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7003.magru.wmnet [production]
07:24 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7010.magru.wmnet [production]
07:24 <fabfur@cumin1002> conftool action : set/pooled=yes; selector: name=cp7002.magru.wmnet [production]
07:21 <brouberol@deploy1003> Started scap build-images: T390059 - Prevent stub provider from going in an infinite loop [production]
07:19 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7010.magru.wmnet [production]
07:19 <volans> upgrade python3-wmflib to v1.3.1 fleetwide [production]
07:18 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:17 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7002.magru.wmnet [production]
07:12 <volans> upgraded python3-wmflib to v1.3.1 on cumin[12]002 [production]
07:08 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . [production]
07:06 <fabfur> deploying https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131705 on A:cp-magru (T384227) [production]
2025-03-29 §
17:00 <isaranto@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revision-models' for release 'main' . [production]
15:51 <oblivian@cumin1002> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) pool swift in eqiad: maintenance [production]
15:47 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad [production]
15:46 <oblivian@cumin1002> START - Cookbook sre.discovery.service-route pool swift in eqiad: maintenance [production]
15:44 <mvernon@cumin1002> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad [production]
15:42 <oblivian@cumin1002> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) depool swift in eqiad: maintenance [production]
15:37 <oblivian@cumin1002> START - Cookbook sre.discovery.service-route depool swift in eqiad: maintenance [production]
2025-03-28 §
23:27 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2330.codfw.wmnet with OS bookworm [production]
23:27 <jhancock@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:27 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2328.codfw.wmnet with OS bookworm [production]
23:27 <jhancock@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:27 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2327.codfw.wmnet with OS bookworm [production]
23:27 <jhancock@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2329.codfw.wmnet with OS bookworm [production]
23:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:23 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2326.codfw.wmnet with OS bookworm [production]
23:22 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:20 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:15 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:10 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:05 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
23:00 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2326.codfw.wmnet with reason: host reimage [production]
22:57 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2328.codfw.wmnet with reason: host reimage [production]
22:54 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2329.codfw.wmnet with reason: host reimage [production]
22:51 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2330.codfw.wmnet with reason: host reimage [production]
22:49 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2327.codfw.wmnet with reason: host reimage [production]
22:47 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2330.codfw.wmnet with reason: host reimage [production]
22:46 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2329.codfw.wmnet with reason: host reimage [production]
22:46 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2328.codfw.wmnet with reason: host reimage [production]
22:46 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2326.codfw.wmnet with reason: host reimage [production]