8751-8800 of 10000 results (41ms)
2021-12-15 §
12:44 <dcaro> Downtiming cloudvirt-wdqs1001 as it has no VMs running until disk space is fixed (T297454) [admin]
2021-12-14 §
10:26 <dcaro> Moved the nova cache (/var/lib/nova/instances/_base) and the canary image local data (/var/lib/nova/instance/<canary_image_id>) to the root disk on cloudvirt-wdqs1001 to temporary free some space (T297454) [admin]
2021-12-13 §
18:08 <wm-bot> Drained 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:50 <wm-bot> Set cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Setting cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Draining 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:44 <wm-bot> Drained 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Set cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Setting cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Draining 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:13 <wm-bot> Drained 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:50 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Draining 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:44 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:43 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
2021-12-03 §
18:56 <andrewbogott> maintain-views and maintain-meta-p on clouddb1013-1020 [admin]
10:49 <majavah> deleting dbbackups-dashboard project T296992 [admin]
2021-12-02 §
01:17 <wm-bot> Drained 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Set cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Setting cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Draining 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Set cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Setting cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Draining 'cloudvirt1026.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:28 <wm-bot> Drained 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:03 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:02 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:02 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
2021-12-01 §
23:59 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
23:59 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
23:54 <andrewbogott> *correction* adding spare cloudvirts 1044 and 1045 to the 'ceph' pool in order to make space for future juggling around T296790 and T296792 [admin]
23:53 <andrewbogott> adding spare cloudvirts 1044 and 1055 to the 'ceph' pool in order to make space for future juggling around T296790 and T296792 [admin]
2021-11-28 §
17:48 <andrewbogott> moved cloudvirt1018 out of the 'localstorage' aggregate and into 'maintenance' for T296592. It will need to be moved back after the raid is rebuilt. [admin]
2021-11-21 §
07:19 <dcaro_away> restarting designate-sink with some extra logs in it (T296144) [admin]
2021-11-17 §
15:48 <andrewbogott> upgrading mariadb packages on eqiad1 cloudcontrols [admin]
15:39 <andrewbogott> sudo cumin "cloud*" 'apt-get update -y --allow-releaseinfo-change' [admin]
15:26 <andrewbogott> updated mariadb packages on codfw1dev cloudcontrols to 1:10.3.31-0+deb10u1 [admin]
2021-11-12 §
13:31 <arturo> restarting glance-api services to make sure they work with new ceph auth creds (T293752) [admin]
2021-11-08 §
21:50 <andrewbogott> returned clouddb pools back to normal after maintain_views run: https://gerrit.wikimedia.org/r/c/operations/puppet/+/737505 T216481 [admin]
20:07 <andrewbogott> depooling clouddb1013 for maintain_views attempt [admin]
10:54 <arturo> [codfw1dev] create service account `srv-networktests` following https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts for T294955 [admin]
10:34 <arturo> create service account `srv-networktests` following https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Service_accounts for T294955 [admin]
2021-11-05 §
11:18 <wm-bot> Added 1 new OSDs ['cloudcephosd1024.eqiad.wmnet'] (T295012) - cookbook ran by arturo@endurance [admin]
11:17 <wm-bot> Added OSD cloudcephosd1024.eqiad.wmnet... (1/1) (T295012) - cookbook ran by arturo@endurance [admin]
11:15 <wm-bot> Finished rebooting node cloudcephosd1024.eqiad.wmnet - cookbook ran by arturo@endurance [admin]
11:12 <wm-bot> Rebooting node cloudcephosd1024.eqiad.wmnet - cookbook ran by arturo@endurance [admin]
11:12 <wm-bot> Adding OSD cloudcephosd1024.eqiad.wmnet... (1/1) (T295012) - cookbook ran by arturo@endurance [admin]
11:12 <wm-bot> Adding new OSDs ['cloudcephosd1024.eqiad.wmnet'] to the cluster (T295012) - cookbook ran by arturo@endurance [admin]
2021-11-04 §
16:39 <wm-bot> Added 1 new OSDs ['cloudcephosd1023.eqiad.wmnet'] (T295012) - cookbook ran by arturo@endurance [admin]