7101-7150 of 8640 results (41ms)
2022-04-27 §
12:50 <wm-bot> Finished rebooting node cloudcephosd1001.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:46 <wm-bot> Rebooting node cloudcephosd1001.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:46 <wm-bot> Rebooting the nodes cloudcephosd1001,cloudcephosd1002,cloudcephosd1003,cloudcephosd1004,cloudcephosd1005,cloudcephosd1006,cloudcephosd1007,cloudcephosd1008,cloudcephosd1009,cloudcephosd1010,cloudcephosd1011,cloudcephosd1012,cloudcephosd1013,cloudcephosd1014,cloudcephosd1015,cloudcephosd1016,cloudcephosd1017,cloudcephosd1018,cloudcephosd1019,cloudcephosd1020,cloudcephosd1021,cloudcephosd1022,cloudcephosd1023,cloudcephosd1024 - cookbo [admin]
12:15 <wm-bot> Finished rebooting the nodes ['cloudcephmon1001', 'cloudcephmon1002', 'cloudcephmon1003'] - cookbook ran by dcaro@vulcanus [admin]
12:15 <wm-bot> Finished rebooting node cloudcephmon1003.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:12 <wm-bot> Rebooting node cloudcephmon1003.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:12 <wm-bot> Finished rebooting node cloudcephmon1002.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:09 <wm-bot> Rebooting node cloudcephmon1002.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:09 <wm-bot> Finished rebooting node cloudcephmon1001.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:07 <wm-bot> Rebooting node cloudcephmon1001.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:07 <wm-bot> Rebooting the nodes cloudcephmon1001,cloudcephmon1002,cloudcephmon1003 - cookbook ran by dcaro@vulcanus [admin]
12:05 <wm-bot> Finished rebooting the nodes ['cloudcephosd2001-dev', 'cloudcephosd2002-dev', 'cloudcephosd2003-dev'] - cookbook ran by dcaro@vulcanus [admin]
12:05 <wm-bot> Finished rebooting node cloudcephosd2003-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:02 <wm-bot> Rebooting node cloudcephosd2003-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
12:02 <wm-bot> Finished rebooting node cloudcephosd2002-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:59 <wm-bot> Rebooting node cloudcephosd2002-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:59 <wm-bot> Finished rebooting node cloudcephosd2001-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:56 <wm-bot> Rebooting node cloudcephosd2001-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:56 <wm-bot> Rebooting the nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev - cookbook ran by dcaro@vulcanus [admin]
11:55 <wm-bot> Finished rebooting the nodes ['cloudcephmon2004-dev', 'cloudcephmon2005-dev', 'cloudcephmon2006-dev'] - cookbook ran by dcaro@vulcanus [admin]
11:55 <wm-bot> Finished rebooting node cloudcephmon2006-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:52 <wm-bot> Rebooting node cloudcephmon2006-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:52 <wm-bot> Finished rebooting node cloudcephmon2005-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:47 <wm-bot> Rebooting node cloudcephmon2005-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:47 <wm-bot> Finished rebooting node cloudcephmon2004-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:43 <wm-bot> Rebooting node cloudcephmon2004-dev.codfw.wmnet - cookbook ran by dcaro@vulcanus [admin]
11:43 <wm-bot> Rebooting the nodes cloudcephmon2004-dev,cloudcephmon2005-dev,cloudcephmon2006-dev - cookbook ran by dcaro@vulcanus [admin]
2022-04-26 §
10:36 <taavi> [codfw1dev] updated designate pool to 2004/2005-dev according to the instructions on https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Initial_designate/pdns_node_setup [admin]
2022-04-22 §
10:33 <taavi> [codfw1dev] restart designate-sink on both new cloudservices host to fix rabbitmq connectivity [admin]
2022-04-21 §
05:38 <andrewbogott> replaced cloudservices200[2,3] with cloudservices200[4,5] [admin]
2022-04-19 §
15:29 <andrewbogott> stopping all VMs on cloudvirt1019, reimaging host [admin]
2022-04-18 §
15:23 <andrewbogott> reimaging cloudvirt1020, leaving VMs in place [admin]
13:40 <andrewbogott> shutting down many codfdfw1dev servers (including network infra!) for T305469 [admin]
2022-04-14 §
20:14 <andrewbogott> restarting nova-api and nova-conductor services in a superstitious attempt to reduce open DB connections [admin]
2022-04-13 §
22:01 <andrewbogott> restarting galera on cloudcontrols (one by one) to clear open connections [admin]
2022-04-11 §
15:59 <taavi> created cloudinfra.wmcloud.org zone [admin]
2022-04-09 §
19:55 <andrewbogott> reimaging cloudbackup1001-dev to bullseye [admin]
19:37 <taavi> add 'puppet-enc' service & endpoint to keystone T274666 [admin]
19:25 <andrewbogott> reimaging cloudbackup1002-dev to bullseye [admin]
2022-04-07 §
12:51 <wm-bot> Set cloudvirt 'cloudvirt1016.eqiad.wmnet' maintenance. (T305631) - cookbook ran by arturo@nostromo [admin]
2022-04-06 §
09:12 <arturo> [codf1dev] installing python3-eventlet 0.30.2-5~bpo11+1 on all required servers (cloudvirt, cloudnet, cloudcontrol) (T305157) [admin]
08:45 <arturo> [codfw1dev] trying with python3-eventlet 0.30.2-5 installed by hand on cloudvirt2003-dev (T305157) [admin]
08:42 <arturo> [codfw1dev] trying with python3-eventlet 0.30.2-5 installed by hand on cloudcontrol servers (T305157) [admin]
08:24 <arturo> [codfw1dev] trying with python3-dnspython 2.2.0-2 installed by hand on cloudvirt2003-dev (T305157) [admin]
08:20 <arturo> [codfw1dev] trying with python3-dnspython 2.2.0-2 installed by hand on cloudcontrol servers (T305157) [admin]
2022-03-30 §
11:20 <arturo> apply urpf strict filter to eqiad cloud-hosts vlan - T285461 [admin]
2022-03-29 §
10:02 <dcaro> restarting keystone (T304918) [admin]
2022-03-23 §
22:53 <wm-bot> Drained 'cloudvirt1045.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
22:38 <wm-bot> Drained 'cloudvirt1044.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
22:12 <wm-bot> Set cloudvirt 'cloudvirt1045.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]