| 
      
        2014-10-21
      
      §
     | 
  
    
  | 21:10 | 
  <hashar> | 
  contint: refreshed slave-scripts 0b85d48..8c3f228   sqlite files will be cleared out after 20 minutes (instead of 60 minutes)  {{bug|71128}} | 
  [releng] | 
            
  | 20:51 | 
  <cscott> | 
  deployment-prep _joe_ promises to fix this properly tomorrow am | 
  [releng] | 
            
  | 20:51 | 
  <cscott> | 
  deployment-prep turned off puppet on deployment-pdf01, manually fixed broken /etc/ocg/mw-ocg-service.js | 
  [releng] | 
            
  | 20:50 | 
  <cscott> | 
  deployment-prep updated OCG to version 523c8123cd826c75240837c42aff6301032d8ff1 | 
  [releng] | 
            
  | 10:55 | 
  <hashar> | 
  deleted salt master key on deployment-elastic{06,07}, restarted salt-minion and reran puppet.  It is now passing on both instances \\O/ | 
  [releng] | 
            
  | 10:48 | 
  <hashar> | 
  rerunning puppet manually on deployment-elastic{06,07} | 
  [releng] | 
            
  | 10:48 | 
  <hashar> | 
  beta: signing puppet cert for deployment-elastic{06,07}.  On deployment-salt ran:  puppet ca sign   i-000006b6.eqiad.wmflabs; puppet ca sign i-000006b7.eqiad.wmflabs | 
  [releng] | 
            
  | 09:29 | 
  <hashar> | 
  forget me  deployment-logstash1 has a puppet agent error but it is simply because the agent is disabled "'debugging logstash config'" | 
  [releng] | 
            
  | 09:28 | 
  <hashar> | 
  deployment-logstash1 disk full | 
  [releng] | 
            
  
    | 
      
        2014-10-14
      
      §
     | 
  
    
  | 21:00 | 
  <JohnLewis> | 
  icinga says deployment-sca01 is good (yay) | 
  [releng] | 
            
  | 20:42 | 
  <JohnLewis> | 
  deleted and recreated deployment-sca01 (still needs puppet set up) | 
  [releng] | 
            
  | 20:24 | 
  <JohnLewis> | 
  rebooted deployment-sca01 | 
  [releng] | 
            
  | 09:26 | 
  <hashar> | 
  renamed deployment-cxserver02 node slaves to 03 and updated the ip address | 
  [releng] | 
            
  | 06:49 | 
  <Krinkle> | 
  Did a slow-rotating graceful depool/reboot/repool of all integration-slave's over the past hour to debug problems whilst waiting for puppet to unblock and set up new slaves. | 
  [releng] | 
            
  | 06:43 | 
  <Krinkle> | 
  Keeping the new integration-slave1009 unpooled because setup could not be completed due to {{bug|72014}}. | 
  [releng] | 
            
  | 06:43 | 
  <Krinkle> | 
  Pooled integration-slave1004 | 
  [releng] | 
            
  | 05:40 | 
  <Krinkle> | 
  Setting up integration-slave1004 and integration-slave1009 ({{bug|71873}} fixed) | 
  [releng] |