| 
      
        2016-11-30
      
      §
     | 
  
    
  | 05:12 | 
  <bd808> | 
  drained tools-exec-1207 (T151980) | 
  [tools] | 
            
  | 05:10 | 
  <bd808> | 
  drained tools-exec-1206 (T151980) | 
  [tools] | 
            
  | 05:07 | 
  <bd808> | 
  drained tools-exec-1205 (T151980) | 
  [tools] | 
            
  | 05:04 | 
  <bd808> | 
  drained tools-exec-1204 (T151980) | 
  [tools] | 
            
  | 05:00 | 
  <bd808> | 
  drained tools-exec-1203 (T151980) | 
  [tools] | 
            
  | 05:00 | 
  <bd808> | 
  drained tools-exec-1202 (T151980) | 
  [tools] | 
            
  | 04:58 | 
  <bd808> | 
  disabled queues on tools-exec-1211 (T151980) | 
  [tools] | 
            
  | 04:58 | 
  <bd808> | 
  disabled queues on tools-exec-1210 (T151980) | 
  [tools] | 
            
  | 04:58 | 
  <bd808> | 
  disabled queues on tools-exec-1209 (T151980) | 
  [tools] | 
            
  | 04:57 | 
  <bd808> | 
  disabled queues on tools-exec-1208 (T151980) | 
  [tools] | 
            
  | 04:57 | 
  <bd808> | 
  disabled queues on tools-exec-1207 (T151980) | 
  [tools] | 
            
  | 04:57 | 
  <bd808> | 
  disabled queues on tools-exec-1206 (T151980) | 
  [tools] | 
            
  | 04:56 | 
  <bd808> | 
  disabled queues on tools-exec-1205 (T151980) | 
  [tools] | 
            
  | 04:56 | 
  <bd808> | 
  disabled queues on tools-exec-1204 (T151980) | 
  [tools] | 
            
  | 04:56 | 
  <bd808> | 
  disabled queues on tools-exec-1203 (T151980) | 
  [tools] | 
            
  | 04:55 | 
  <bd808> | 
  disabled queues on tools-exec-1202 (T151980) | 
  [tools] | 
            
  | 04:52 | 
  <bd808> | 
  drained tools-exec-1201 (T151980) | 
  [tools] | 
            
  | 04:48 | 
  <bd808> | 
  draining tools-exec-1201 | 
  [tools] | 
            
  
    | 
      
        2016-11-14
      
      §
     | 
  
    
  | 22:51 | 
  <chasemp> | 
  shut down bastion 02 and 05 and make 03 root only | 
  [tools] | 
            
  | 19:35 | 
  <madhuvishy> | 
  Stopped cron on tools-cron-01 (T146154) | 
  [tools] | 
            
  | 18:24 | 
  <madhuvishy> | 
  Tools NFS is read-only. /data/project and /home across tools are ro T146154 | 
  [tools] | 
            
  | 16:57 | 
  <yuvipanda> | 
  stopped gridengine master | 
  [tools] | 
            
  | 16:47 | 
  <yuvipanda> | 
  start restarting kubernetes webservice pods | 
  [tools] | 
            
  | 16:30 | 
  <madhuvishy> | 
  Unmounted all nfs shares from tools-k8s-master-01 (sudo /usr/local/sbin/nfs-mount-manager clean) T146154 | 
  [tools] | 
            
  | 16:22 | 
  <yuvipanda> | 
  kill maintain-kubeusers on tools-k8s-master-01, sole process touching NFS | 
  [tools] | 
            
  | 16:22 | 
  <chasemp> | 
  enable puppet and run on tools-services-01 | 
  [tools] | 
            
  | 16:21 | 
  <yuvipanda> | 
  restarting all webservice jobs, watching webservicewatcher logs on tools-services-02 | 
  [tools] | 
            
  | 16:14 | 
  <madhuvishy> | 
  Disabling puppet across tools T146154 | 
  [tools] |