7951-8000 of 10000 results (46ms)
2022-08-24 §
10:33 <wm-bot2> Adding new OSDs ['cloudcephosd1028.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
2022-08-23 §
13:46 <wm-bot2> Added 1 new OSDs ['cloudcephosd1027.eqiad.wmnet'] (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:46 <wm-bot2> Added OSD cloudcephosd1027.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:27 <wm-bot2> Finished rebooting node cloudcephosd1027.eqiad.wmnet (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:24 <wm-bot2> Rebooting node cloudcephosd1027.eqiad.wmnet (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:22 <wm-bot2> Adding OSD cloudcephosd1027.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:22 <wm-bot2> Adding new OSDs ['cloudcephosd1027.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
2022-08-21 §
21:12 <andrewbogott> restarted neutron-dhcp-agent on cloudnet1003. it was claiming to be unable to contact Rabbit but seems happy after a restart [admin]
2022-08-20 §
07:39 <dcaro_away> cloudvirt1023 is back up, VMs are starting to recover (T315718) [admin]
07:23 <dcaro_away> cloudvirt1023 seems to have gotten some hardware issue from racadm lclog view "System CPU Resetting.", rebooting and doing memory checks (T315718) [admin]
2022-08-19 §
17:06 <taavi> [codfw1dev] restart mariadb on clouddb2002-dev to pick up certificate config changes T310795 [admin]
2022-08-18 §
13:25 <wm-bot2> Added 1 new OSDs ['cloudcephosd1026.eqiad.wmnet'] (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:25 <wm-bot2> Added OSD cloudcephosd1026.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:15 <wm-bot2> Finished rebooting node cloudcephosd1026.eqiad.wmnet (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:12 <wm-bot2> Rebooting node cloudcephosd1026.eqiad.wmnet (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:10 <wm-bot2> Adding OSD cloudcephosd1026.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
13:10 <wm-bot2> Adding new OSDs ['cloudcephosd1026.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
07:29 <dcaro> Starting up all the osd daemons on cloudcephosd1025 (T314870) [admin]
2022-08-17 §
10:50 <wm-bot2> Added 1 new OSDs ['cloudcephosd1025.eqiad.wmnet'] (T314870) - cookbook ran by fran@foz [admin]
10:49 <wm-bot2> Added OSD cloudcephosd1025.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@foz [admin]
10:40 <wm-bot2> Finished rebooting node cloudcephosd1025.eqiad.wmnet (T314870) - cookbook ran by fran@foz [admin]
10:37 <wm-bot2> Rebooting node cloudcephosd1025.eqiad.wmnet (T314870) - cookbook ran by fran@foz [admin]
10:37 <wm-bot2> Adding OSD cloudcephosd1025.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@foz [admin]
10:37 <wm-bot2> Adding new OSDs ['cloudcephosd1025.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@foz [admin]
09:50 <wm-bot2> Rebooting node cloudcephosd1025.eqiad.wmnet (T314870) - cookbook ran by fran@foz [admin]
09:49 <wm-bot2> Adding OSD cloudcephosd1025.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@foz [admin]
09:49 <wm-bot2> Adding new OSDs ['cloudcephosd1025.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@foz [admin]
09:16 <wm-bot2> Rebooting node cloudcephosd1025.eqiad.wmnet (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
09:16 <wm-bot2> Adding OSD cloudcephosd1025.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
09:16 <wm-bot2> Adding new OSDs ['cloudcephosd1025.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@Francesco’s-MacBook-Pro [admin]
2022-08-16 §
22:39 <andrewbogott> replacing the now-rebuilt cloudvirt1025 in 'ceph' aggregate and removing it from the 'maintenance' aggregate [admin]
17:41 <andrewbogott> removing cloudvirt1025 from the 'ceph' aggregate and adding it to the 'maintenance' aggregate [admin]
17:40 <andrewbogott> reimaging cloudvirt1025 after I accidentally deleted the hw raid [admin]
17:38 <andrewbogott> root@cloudcontrol1005:~# cinder-manage volume update_host --currenthost cloudcontrol1003@rbd#RBD --newhost cloudcontrol1005@rbd#RBD [admin]
17:37 <andrewbogott> root@cloudcontrol1005:~# cinder-manage volume update_host --currenthost cloudcontrol1004@rbd#RBD --newhost cloudcontrol1006@rbd#RBD [admin]
16:26 <wm-bot2> Ceph cluster at eqiad1 set out of maintenance. - cookbook ran by dcaro@vulcanus [admin]
15:43 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd1001,cloudcephosd1002,cloudcephosd1003,cloudcephosd1004,cloudcephosd1005,cloudcephosd1006,cloudcephosd1007,cloudcephosd1008,cloudcephosd1009,cloudcephosd1010,cloudcephosd1011,cloudcephosd1012,cloudcephosd1013,cloudcephosd1014,cloudcephosd1015,cloudcephosd1016,cloudcephosd1017,cloudcephosd1018,cloudcephosd1019,cloudcephosd1020,cloudcephosd1021,cloudcephosd1022,cloudcephosd1023,c [admin]
15:42 <wm-bot2> Finished restarting all the OSD daemons from the nodes ['cloudcephosd2001-dev', 'cloudcephosd2002-dev', 'cloudcephosd2003-dev'] - cookbook ran by dcaro@vulcanus [admin]
15:38 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
13:08 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
13:07 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
13:02 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
13:01 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
12:59 <wm-bot2> Restarting the osd daemons from nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
2022-08-14 §
18:36 <taavi> deleted the http keystone endpoints from the keystone service catalog [admin]
2022-08-11 §
13:57 <andrewbogott> decommissioning cloudcontrol1003 + cloudcontrl1004. I backed up $home in case anyone needs their files. [admin]
08:42 <wm-bot2> The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1025.eqiad.wmnet'] (T314870) - cookbook ran by fran@MacBook-Pro.station [admin]
08:42 <wm-bot2> Added 1 new OSDs ['cloudcephosd1025.eqiad.wmnet'] (T314870) - cookbook ran by fran@MacBook-Pro.station [admin]
08:42 <wm-bot2> Added OSD cloudcephosd1025.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@MacBook-Pro.station [admin]
08:40 <wm-bot2> Finished rebooting node cloudcephosd1025.eqiad.wmnet (T314870) - cookbook ran by fran@MacBook-Pro.station [admin]