151-200 of 3912 results (29ms)
2023-04-06 §
17:03 <andrewbogott> running wmcs-wikireplica-dns on cloudcontrol1005 to update tools-db dns entries [admin]
2023-04-04 §
17:23 <andrewbogott> resetting all three rabbitmq nodes and restarting all openstack services as per https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Rabbitmq#Resetting_the_HA_setup [admin]
2023-03-30 §
12:46 <andrewbogott> stopping nutcracker on labweb100[34] to ensure that it's not actually doing anything [admin]
2023-03-28 §
13:56 <andrewbogott> depooling cloudweb1003 before switch upgrade [admin]
10:58 <dhinus> disabled tool "wb" by clicking the disable button at https://toolsadmin.wikimedia.org/tools/id/wb T328693 [admin]
08:34 <arturo> cleanup neutron agents for cloudvirt1021/1022 (decom) [admin]
08:32 <arturo> cleanup neutron agents for cloudvirt1017 (decom) [admin]
2023-03-27 §
14:30 <wm-bot2> Drained cloudvirt1024.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
14:19 <wm-bot2> Set cloudvirt cloudvirt1024.eqiad.wmnet maintenance (downtime id: 3f43d3ca-696c-4d3c-8d5b-e57984f0eb86, use this to unset) - cookbook ran by andrew@bullseye [admin]
14:18 <wm-bot2> Draining cloudvirt1024.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
14:17 <wm-bot2> Drained cloudvirt1023.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
14:08 <wm-bot2> Set cloudvirt cloudvirt1023.eqiad.wmnet maintenance (downtime id: f4767781-ea26-453b-9521-847a8340a249, use this to unset) - cookbook ran by andrew@bullseye [admin]
14:07 <wm-bot2> Draining cloudvirt1023.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
14:04 <wm-bot2> Drained cloudvirt1022.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
13:55 <wm-bot2> Set cloudvirt cloudvirt1022.eqiad.wmnet maintenance (downtime id: 0e794cfe-5896-46c1-842d-c34719140d4f, use this to unset) - cookbook ran by andrew@bullseye [admin]
13:54 <wm-bot2> Draining cloudvirt1022.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
13:54 <wm-bot2> Drained cloudvirt1021.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
13:48 <wm-bot2> Set cloudvirt cloudvirt1021.eqiad.wmnet maintenance (downtime id: e7a904ca-003d-450a-ad85-886fb80dfc41, use this to unset) - cookbook ran by andrew@bullseye [admin]
13:47 <wm-bot2> Draining cloudvirt1021.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
13:46 <wm-bot2> Drained cloudvirt1017.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
13:36 <wm-bot2> Set cloudvirt cloudvirt1017.eqiad.wmnet maintenance (downtime id: 0ff0090f-26c3-4278-a9c9-cce518559408, use this to unset) - cookbook ran by andrew@bullseye [admin]
13:35 <wm-bot2> Draining cloudvirt1017.eqiad.wmnet - cookbook ran by andrew@bullseye [admin]
2023-03-22 §
12:40 <taavi> delete wmde-templates-alpha project T332773 [admin]
2023-03-08 §
21:45 <bd808> maintain-kubeusers container in CrashLoopBackoff, investigating [admin]
13:49 <dcaro> stopping puppet on labostre1004 to debug maintain-dbusers [admin]
2023-03-07 §
16:06 <andrewbogott> updated application credential roles, replacing 'user' with 'reader' and 'projectadmin' with 'member': update application_credential_role set role_id='f75a3c410bca4e96a1cf6ac103b0ccaf' where role_id='f473273fac7146b3bdbf22e5d4504f95' and update application_credential_role set role_id='38676f30eaeb44518bf7e144a73c8da6' where role_id='4d8cad783d6342efa8414d7d36fbc034' [admin]
10:11 <dcaro> there was a little unavailability for some VMs while ceph was starting to rebalance things, but it seems stable and moving data around (T331141) [admin]
09:37 <dcaro> Changing ceph crush map to allow rack HA on eqiad1 cluster (T331141) [admin]
2023-03-03 §
12:12 <arturo> installing haproxy updates (T331119) [admin]
2023-03-02 §
16:17 <wm-bot2> The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1010.eqiad.wmnet'] (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:21 <wm-bot2> Added 1 new OSDs ['cloudcephosd1010.eqiad.wmnet'] (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:21 <wm-bot2> Added OSD cloudcephosd1010.eqiad.wmnet... (1/1) (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:13 <wm-bot2> Finished rebooting node cloudcephosd1010.eqiad.wmnet (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:10 <wm-bot2> Rebooting node cloudcephosd1010.eqiad.wmnet (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:09 <wm-bot2> Adding OSD cloudcephosd1010.eqiad.wmnet... (1/1) (T329504) - cookbook ran by dcaro@vulcanus [admin]
14:09 <wm-bot2> Adding new OSDs ['cloudcephosd1010.eqiad.wmnet'] to the cluster (T329504) - cookbook ran by dcaro@vulcanus [admin]
10:43 <wm-bot2> The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1005.eqiad.wmnet'] (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:44 <wm-bot2> Added 1 new OSDs ['cloudcephosd1005.eqiad.wmnet'] (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:44 <wm-bot2> Added OSD cloudcephosd1005.eqiad.wmnet... (1/1) (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:36 <wm-bot2> Finished rebooting node cloudcephosd1005.eqiad.wmnet (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:33 <wm-bot2> Rebooting node cloudcephosd1005.eqiad.wmnet (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:32 <wm-bot2> Adding OSD cloudcephosd1005.eqiad.wmnet... (1/1) (T329504) - cookbook ran by dcaro@vulcanus [admin]
08:32 <wm-bot2> Adding new OSDs ['cloudcephosd1005.eqiad.wmnet'] to the cluster (T329504) - cookbook ran by dcaro@vulcanus [admin]
2023-02-28 §
22:47 <andrewbogott> adding new 'member' role assignment to every user/project pair that currently has the 'user' assignment. T330759 [admin]
09:47 <wm-bot2> Depooled and destroyed OSD daemons [79, 78, 77, 76, 75, 74, 73, 72] and removed the OSD host cloudcephosd1010 from the CRUSH map. (T329504) - cookbook ran by dcaro@vulcanus [admin]
09:46 <wm-bot2> Destroying OSDs with ids in [79, 78, 77, 76, 75, 74, 73, 72] on cloudcephosd1010 from eqiad1 (T329504) - cookbook ran by dcaro@vulcanus [admin]
09:28 <wm-bot2> Depooling OSDs with ids in [79, 78, 77, 76, 75, 74, 73, 72] on cloudcephosd1010 from eqiad1 (T329504) - cookbook ran by dcaro@vulcanus [admin]
09:13 <wm-bot2> Depooling OSDs with ids in [79, 78, 77, 76, 75, 74, 73, 72] on cloudcephosd1010 from eqiad1 (T329504) - cookbook ran by dcaro@vulcanus [admin]
09:12 <wm-bot2> Depooled and destroyed OSD daemons [39, 38, 37, 36, 35, 34, 33, 32] and removed the OSD host cloudcephosd1005 from the CRUSH map. (T329504) - cookbook ran by dcaro@vulcanus [admin]
09:11 <wm-bot2> Destroying OSDs with ids in [39, 38, 37, 36, 35, 34, 33, 32] on cloudcephosd1005 from eqiad1 (T329504) - cookbook ran by dcaro@vulcanus [admin]