801-850 of 1932 results (10ms)
2021-06-25 §
09:16 <arturo> icinga downtime cloudcontrols for 2h [admin]
08:20 <dcaro> restarting rabbitmq on cloudcontrol100{3,4} [admin]
2021-06-21 §
13:54 <dcaro> puppet fix merged and deployed, servers are back to normal [admin]
13:20 <dcaro> merged broken puppet patch, downtimed all cloudvirts for 2h while fixing (nothing big, just added a bad systemd timer) [admin]
2021-06-20 §
22:21 <andrewbogott> clearing admin-monitoring VMs; puppet has been failing lately due to a full drive on the puppetmaster [admin]
2021-06-15 §
01:18 <bstorm> running a modified version of the prometheus dir size cron in screen T284964 [admin]
2021-06-14 §
10:13 <dcaro> setting ssd to debug mode on tools-sgeexec-0917 (T284130) [admin]
2021-06-10 §
10:58 <wm-bot> Finished rebooting the nodes ['cloudcephmon2002-dev', 'cloudcephmon2003-dev', 'cloudcephmon2004-dev'] (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:58 <wm-bot> Finished rebooting node cloudcephmon2004-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:55 <wm-bot> Rebooting node cloudcephmon2004-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:55 <wm-bot> Finished rebooting node cloudcephmon2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:52 <wm-bot> Rebooting node cloudcephmon2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:52 <wm-bot> Finished rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:49 <wm-bot> Rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:49 <wm-bot> Rebooting the nodes cloudcephmon2002-dev,cloudcephmon2003-dev,cloudcephmon2004-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:48 <wm-bot> Finished rebooting the nodes ['cloudcephosd2001-dev', 'cloudcephosd2002-dev', 'cloudcephosd2003-dev'] (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:48 <wm-bot> Finished rebooting node cloudcephosd2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:45 <wm-bot> Rebooting node cloudcephosd2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:45 <wm-bot> Finished rebooting node cloudcephosd2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:42 <wm-bot> Rebooting node cloudcephosd2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:42 <wm-bot> Finished rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:39 <wm-bot> Rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
10:39 <wm-bot> Rebooting the nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:39 <wm-bot> Finished rebooting the nodes ['cloudcephosd2001-dev', 'cloudcephosd2002-dev', 'cloudcephosd2003-dev'] (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:38 <wm-bot> Finished rebooting node cloudcephosd2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:35 <wm-bot> Rebooting node cloudcephosd2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:35 <wm-bot> Finished rebooting node cloudcephosd2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:32 <wm-bot> Rebooting node cloudcephosd2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:32 <wm-bot> Finished rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:29 <wm-bot> Rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:29 <wm-bot> Rebooting the nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:26 <wm-bot> Rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:26 <wm-bot> Rebooting the nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:24 <wm-bot> Rebooting node cloudcephosd2001-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
09:24 <wm-bot> Rebooting the nodes cloudcephosd2001-dev,cloudcephosd2002-dev,cloudcephosd2003-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
2021-06-09 §
17:33 <arturo> removed icinga downtime for cloudmetrics1002 -- to see if hardware is healthy (T281881) [admin]
13:30 <wm-bot> Finished rebooting the nodes ['cloudcephmon2002-dev', 'cloudcephmon2003-dev', 'cloudcephmon2004-dev'] (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:30 <wm-bot> Finished rebooting node cloudcephmon2004-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:27 <wm-bot> Rebooting node cloudcephmon2004-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:27 <wm-bot> Finished rebooting node cloudcephmon2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:24 <wm-bot> Rebooting node cloudcephmon2003-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:24 <wm-bot> Finished rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:21 <wm-bot> Rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:21 <wm-bot> Rebooting the nodes cloudcephmon2002-dev,cloudcephmon2003-dev,cloudcephmon2004-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:01 <wm-bot> Rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
13:01 <wm-bot> Rebooting the nodes cloudcephmon2002-dev,cloudcephmon2003-dev,cloudcephmon2004-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
12:53 <wm-bot> Rebooting node cloudcephmon2002-dev.codfw.wmnet (T281248) - cookbook ran by dcaro@vulcanus [admin]
12:53 <wm-bot> Rebooting the nodes cloudcephmon2002-dev,cloudcephmon2003-dev,cloudcephmon2004-dev (T281248) - cookbook ran by dcaro@vulcanus [admin]
2021-06-08 §
23:19 <bd808> Downtimed cloudmetrics1002 in icinga until 2021-06-30 23:59:01 (T281881) [admin]
21:08 <bstorm> downtiming grafana-labs for maintenance [admin]