41 results (35ms)
2025-07-28 §
12:52 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [admin-monitoring]
09:51 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
09:51 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [admin-monitoring]
09:51 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
09:44 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [admin-monitoring]
09:41 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
09:41 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [admin-monitoring]
09:41 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
09:39 <wmbot~dcaro@acme> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255) [admin-monitoring]
09:34 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
09:33 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=99) [admin-monitoring]
09:33 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.cloudvirt.vm_console [admin-monitoring]
2025-03-05 §
00:42 <andrewbogott> clearing broken fullstackd VMs [admin-monitoring]
2025-03-04 §
15:30 <arturo> manually cleaning up list of fullstackd VMs [admin-monitoring]
2024-11-15 §
12:51 <arturo> deployed new version of nova-fullstack, with IPv6 support (T379356) [admin-monitoring]
2024-07-05 §
15:49 <arturo> deleted a bunch of leaked VMs -- timeout waiting for A record [admin-monitoring]
2024-02-13 §
09:41 <arturo> deleting all leaked instances by hand (11 VMs) [admin-monitoring]
2023-01-26 §
09:26 <taavi> deleting instances leaked by T327980 [admin-monitoring]
2023-01-10 §
12:39 <arturo> delete all VMs and restart the fullstack service on cloudcontrol1005 - T326626 [admin-monitoring]
2022-10-26 §
07:41 <taavi> deleted leaked nova-fullstack VMs [admin-monitoring]
2022-10-07 §
09:03 <arturo> restarted nova-fullstack.service on cloudcontrol1005 (T320232) [admin-monitoring]
08:49 <arturo> cleaning up a bunch of leaked VMs on "BUILD" status (T320232) [admin-monitoring]
2022-06-22 §
16:52 <taavi> remove some failed nova-fullstack instances now that DNS problems are hopefully fixed [admin-monitoring]
2022-05-10 §
20:57 <balloons> cleanup fullstack test instances after cloudcontrol reboots [admin-monitoring]
2022-05-06 §
13:27 <andrewbogott> removed a few leaked VMs to forestall a weekend page [admin-monitoring]
2021-07-15 §
20:09 <balloons> remove stale/errored fullstack tests [admin-monitoring]
2021-06-10 §
16:11 <dcaro> cleaning up the nova-fullstack VMs after merging puppet fix https://gerrit.wikimedia.org/r/c/operations/puppet/+/699237 [admin-monitoring]
15:08 <dcaro> stopping the nova-fullstack service to allow troubleshooting the current VMs [admin-monitoring]
2021-06-08 §
09:36 <dcaro> actually, there's several different errors, will open tasks for each of them [admin-monitoring]
09:31 <dcaro> there's a bunch of novafullstack vms in error because it timed out when trying to allocate network, though there's a "successfully plugged vif" message from neutron, cleaning up for now [admin-monitoring]
2021-04-24 §
16:19 <arturo> deleting 2 leaked VMs by hand: 6aefef6f-0723-499d-895f-314f4804c377 | fullstackd-20210424153344 and af8bc9bd-ea0a-4789-b8dd-cf5cf96c31cc | fullstackd-20210424074938 (puppet check step timed out) [admin-monitoring]
2019-10-17 §
14:30 <jeh> cleaning up failed nova fullstack vms related to puppet ca T234332 [admin-monitoring]
2019-07-02 §
07:27 <jeh> clearing out leaked instances that are active and accessible [admin-monitoring]
2019-03-19 §
19:05 <gtirloni> deleted iostat metrics from tools-workers servers (polutted by docker devicemapper data) [admin-monitoring]
19:03 <gtirloni> deleted archived metrics from toolsbeta project [admin-monitoring]
2019-03-14 §
17:05 <gtirloni> Updated fullstackd to use debian-9.8 [admin-monitoring]
2018-02-09 §
00:53 <bd808> Added Arturo Borrero Gonzalez, BryanDavis, and Bstorm as admins [admin-monitoring]
00:50 <bd808> Removed Yuvipanda at user request (T186289) [admin-monitoring]
2017-09-27 §
05:36 <madhuvishy> Clear all fullstackd instances because the project is full and the fullstack tests are failing [admin-monitoring]
2017-06-07 §
16:20 <andrewbogott> clearing out leaked instances — most are up and accessible and fine — this seems to be a timing issue of some sort [admin-monitoring]
2017-03-29 §
19:03 <andrewbogott> updated image, cleared out old stuck instances [admin-monitoring]