1001-1050 of 4096 results (29ms)
2022-10-07 §
13:40 <andrewbogott> dhinus is resetting rabbitmq cluster in an attempt to resolve a suspected (by Andrew) split-brain [admin]
11:33 <arturo> rabbitmq-server.service @ cloudrabbit1002 is again up and running (T320232) [admin]
10:24 <arturo> stopping rabbitmq-server.service @ cloudrabbit1002 (T320232) [admin]
10:19 <arturo> restarting nova-conductor in all 3 cloudcontrols (T320232) [admin]
09:45 <arturo> restarting rabbitmq-server.service @ cloudrabbit1002 (T320232) [admin]
2022-10-06 §
15:55 <arturo> cloudnet1005 & cloudnet1006 now in service. Secom cloudnet1003 & cloudnet1004. Drop neutron agents, etc. (T316284) [admin]
11:54 <arturo> rebooting cloudnet1005/1006 to see if they have the right network config (T316284) [admin]
11:50 <arturo> set neutron l3 agents on cloudnet1005/1006 as down `root@cloudcontrol1005:~# neutron agent-update --admin-state-down <uuid>` (T316284) [admin]
11:40 <arturo> [codfw1dev] rebooting both network nodes to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/839492 [admin]
10:14 <arturo> [codfw1dev] restart neutron-l3-agent on cloudnet2006-dev, it was dead [admin]
2022-10-05 §
14:40 <wm-bot2> Adding OSD cloudcephosd1021.eqiad.wmnet... (1/1) (T319418) - cookbook ran by fran@wmf3169 [admin]
14:40 <wm-bot2> Adding new OSDs ['cloudcephosd1021.eqiad.wmnet'] to the cluster (T319418) - cookbook ran by fran@wmf3169 [admin]
14:28 <arturo> adding cloudinstances2b-gw router to l3 agents on cloudnet1005/1006 (T316284) [admin]
13:11 <wm-bot2> Added 1 new OSDs ['cloudcephosd1034.eqiad.wmnet'] (T314870) - cookbook ran by fran@wmf3169 [admin]
13:11 <wm-bot2> Added OSD cloudcephosd1034.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
13:02 <wm-bot2> Finished rebooting node cloudcephosd1034.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Rebooting node cloudcephosd1034.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Adding OSD cloudcephosd1034.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Adding new OSDs ['cloudcephosd1034.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@wmf3169 [admin]
2022-10-04 §
16:40 <wm-bot2> Added 1 new OSDs ['cloudcephosd1033.eqiad.wmnet'] (T314870) - cookbook ran by fran@wmf3169 [admin]
16:40 <wm-bot2> Added OSD cloudcephosd1033.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
14:34 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@wmf3169 [admin]
14:20 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
14:17 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
10:59 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
10:56 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
10:55 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
10:55 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
2022-09-30 §
14:52 <wm-bot2> Added 1 new OSDs ['cloudcephosd1031.eqiad.wmnet'] - cookbook ran by fran@wmf3169 [admin]
14:52 <wm-bot2> Added OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:48 <wm-bot2> Adding OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:48 <wm-bot2> Adding new OSDs ['cloudcephosd1031.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Drained 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Set cloudvirt 'cloudvirt1023.eqiad.wmnet' maintenance (downtime id: 64eac5c6-4b1d-4269-98fd-8e5bed42ce40, use this to unset). (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Draining 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Safe rebooting 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:09 <wm-bot2> Drained 'cloudvirt1023.eqiad.wmnet'. - cookbook ran by andrew@buster [admin]
14:05 <wm-bot2> Set cloudvirt 'cloudvirt1023.eqiad.wmnet' maintenance (downtime id: fb99c967-b974-4314-a2fa-31ed0e883dd3, use this to unset). - cookbook ran by andrew@buster [admin]
14:04 <wm-bot2> Draining 'cloudvirt1023.eqiad.wmnet'. - cookbook ran by andrew@buster [admin]
13:30 <wm-bot2> Added 1 new OSDs ['cloudcephosd1031.eqiad.wmnet'] - cookbook ran by fran@wmf3169 [admin]
13:30 <wm-bot2> Added OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
13:26 <wm-bot2> Adding OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
13:26 <wm-bot2> Adding new OSDs ['cloudcephosd1031.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
13:16 <wm-bot2> Adding OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
13:16 <wm-bot2> Adding new OSDs ['cloudcephosd1031.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]