1-50 of 10000 results (19ms)
2025-07-21 §
20:08 <dcaro@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
20:07 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
20:07 <dcaro@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
20:07 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
20:07 <dcaro@cloudcumin1001> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
20:03 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
20:02 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
19:44 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=97) (T399858) [admin]
17:05 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
17:05 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
17:04 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
17:03 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
17:02 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]
17:01 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
16:47 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]
16:47 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
16:44 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]
16:38 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
16:37 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]
16:36 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
16:25 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet1006.eqiad.wmnet' (T395255) [admin]
16:16 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet1006.eqiad.wmnet' (T395255) [admin]
16:11 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet1005.eqiad.wmnet' (T395255) [admin]
16:02 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet1005.eqiad.wmnet' (T395255) [admin]
15:56 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add (T399858) [admin]
15:53 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) (T399858) [admin]
15:53 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add (T399858) [admin]
15:51 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=99) (T399858) [admin]
15:51 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.bootstrap_and_add (T399858) [admin]
15:07 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T399858) [admin]
15:07 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy (T399858) [admin]
15:04 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T399858) [admin]
13:59 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy (T399858) [admin]
2025-07-20 §
10:44 <andrewbogott> rebooting cloudcephosd1006 to give us another few days before the memory runs out. T399858 [admin]
2025-07-19 §
13:05 <andrewbogott> restarted neutron-metadata-agent on cloudnet100[56], again [admin]
2025-07-17 §
16:02 <dcaro> restart cloudcephosd1006 osd 45 for the memory limit take effect [admin]
15:57 <dcaro> lowered memory target for cloudcephosd1006 to 5G [admin]
2025-07-16 §
18:44 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
18:33 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
18:32 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]
18:32 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
15:59 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
15:59 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
09:47 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1073.eqiad.wmnet}' (T399212) [admin]
09:44 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1073.eqiad.wmnet}' (T399212) [admin]
2025-07-15 §
23:51 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
23:51 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
2025-07-11 §
18:38 <andrewbogott> it didn't [admin]
18:32 <andrewbogott> rebooting cloudceph1013 to see if its missing OSD drive reappears [admin]
18:25 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]