9251-9300 of 10000 results (45ms)
2021-09-20 §
22:48 <andrewbogott> stopped puppet & mariadb on cloudcontrol1004; it was flapping [admin]
22:44 <andrewbogott> sudo touch /tmp/galera.disabled on cloudcontrol1004, the service seems troubled there [admin]
21:57 <andrewbogott> moving cloudvirt1043 into the 'nfs' aggregate for T291405 [admin]
2021-09-17 §
11:35 <arturo> [codfw1dev] install manila on cloudcontrol2001-dev (T291257) [admin]
2021-09-16 §
15:56 <bstorm> removing downtime for labstore1005 so we'll know if it has another issue T290318 [admin]
2021-09-09 §
22:03 <bstorm> restarted the prometheus-mysqld-exporter@s1 service as it was not working T290630 [admin]
03:15 <bstorm> resetting swap on clouddb1017 T290630 [admin]
03:08 <andrewbogott> stopping maintain-dbusers on labstore1004 for help diagnosing T290630 [admin]
2021-09-03 §
15:34 <bstorm> rebooting labstore1005 to disconnect the drives from labstore1004 T290318 [admin]
15:24 <bstorm> stopping puppet and disabling backup syncs to labstore1005 on cloudbackup2002 T290318 [admin]
15:20 <bstorm> stopping puppet and disabling backup syncs to labstore1005 on cloudbackup2001 T290318 [admin]
2021-08-30 §
16:16 <wm-bot> Added 1 new OSDs ['cloudcephosd1018.eqiad.wmnet'] - cookbook ran by andrew@buster [admin]
16:16 <wm-bot> Added OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [admin]
16:13 <wm-bot> Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [admin]
16:13 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
16:10 <wm-bot> Finished rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [admin]
16:07 <wm-bot> Rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [admin]
16:07 <wm-bot> Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [admin]
16:07 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
2021-08-27 §
18:57 <andrewbogott> raising toolsbeta ram/core/instances quotas so majavah can experiment with bullseye [admin]
2021-08-25 §
14:45 <wm-bot> Finished rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [admin]
14:42 <wm-bot> Rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [admin]
14:42 <wm-bot> Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [admin]
14:42 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
14:41 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
2021-08-19 §
17:39 <bstorm> restarting glance image backup to try and clear the page [admin]
2021-08-18 §
16:21 <wm-bot> Rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [admin]
16:21 <wm-bot> Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [admin]
16:21 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
16:17 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
16:16 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
16:15 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
16:13 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [admin]
14:47 <andrewbogott> adding clouvirt1038 to the ceph aggregate, removing from the maintenance aggregate T276922 [admin]
2021-08-17 §
15:11 <andrewbogott> rebooting cloudcephosd1008 to force raid rebuild -- T287838 [admin]
2021-08-11 §
13:51 <wm-bot> Finished rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
13:48 <wm-bot> Rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by dcaro@vulcanus [admin]
13:47 <wm-bot> Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) (T285858) - cookbook ran by dcaro@vulcanus [admin]
13:47 <wm-bot> Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster (T285858) - cookbook ran by dcaro@vulcanus [admin]
2021-08-10 §
15:15 <andrewbogott> restarting all designate services in eqiad1 [admin]
15:04 <andrewbogott> restarting designate-sink in eqiad1; it's complaining about rabbit but I don't want to restart rabbit yet [admin]
2021-08-05 §
09:37 <dcaro> Taking one osd daemon down ot codfw cluster (T288203) [admin]
2021-08-04 §
19:20 <bd808> Running deleteBatch.php on cloudweb2001-dev to remove legacy Heira: pages from labtestwiki [admin]
2021-08-03 §
17:40 <bstorm> rerunning the glance backup script after failure [admin]
2021-07-31 §
00:10 <andrewbogott> "systemctl reset-failed cloud-init.service" on all VMs for T287309 [admin]
00:08 <andrewbogott> "systemctl reset-failed cloud-final.service" on all VMs for T287309 [admin]
2021-07-27 §
21:32 <andrewbogott> putting cloudvirt1012 back into service T286748 [admin]
20:52 <andrewbogott> draining VMs off of cloudvirt1012 so we can replace the battery for T286748 [admin]
15:15 <andrewbogott> "rm /etc/apt/sources.list.d/openstack-mitaka-jessie.list" cloud-wide [admin]
2021-07-23 §
15:22 <bstorm> update wikireplicas-dns for s7 fix for web replicas [admin]