| 
      
        2013-02-04
      
      §
     | 
  
    
  | 14:24 | 
  <hashar> | 
  Started the over long l10n cache rebuild in a screen on deployment-bastion | 
  [releng] | 
            
  | 14:09 | 
  <hashar> | 
  -bastion applying misc::deployment::scap_scripts | 
  [releng] | 
            
  | 14:07 | 
  <hashar> | 
  -bastion removing role::deployment::deployment_servers::labs | 
  [releng] | 
            
  | 13:35 | 
  <hashar> | 
  Applying role::memcached to apache32 and apache33 | 
  [releng] | 
            
  | 13:24 | 
  <hashar> | 
  manually updating extensions to make sure the beta autoupdater works properly | 
  [releng] | 
            
  | 13:19 | 
  <hashar> | 
  the infamous beta auto updater is back in action on deployment-bastion | 
  [releng] | 
            
  | 13:07 | 
  <hashar> | 
  starting apache2 on apache32 and apache33 | 
  [releng] | 
            
  | 13:06 | 
  <hashar> | 
  multiversion/refreshWikiversionsCDB | 
  [releng] | 
            
  | 13:05 | 
  <hashar> | 
  refreshing /home/wikipedia/common from latest master (no more newdeploy branch) | 
  [releng] | 
            
  | 13:04 | 
  <hashar> | 
  REVERTED GIT-DEPLOY!!!!!  rm /data/project/apache/common-local (symlink) and restored backup:  mv /data/project/apache/common-local.pre-git-deploy /data/project/apache/common-local | 
  [releng] | 
            
  | 13:00 | 
  <hashar> | 
  rebooting apache32 (locked / can't login) | 
  [releng] | 
            
  | 12:53 | 
  <hashar> | 
  rebasing /srv/deployment/mediawiki/common | 
  [releng] | 
            
  | 12:41 | 
  <hashar> | 
  -dbdump : stopping udp2log, starting udp2log-mw | 
  [releng] | 
            
  | 09:24 | 
  <hashar> | 
  upgrading / rebooting all instances | 
  [releng] | 
            
  | 09:18 | 
  <hashar> | 
  Beta is broken in some random and creative ways AGAIN.  /home on bastion is corrupted, some instances do not let us connect anymore, apache docroot disappeared. | 
  [releng] | 
            
  
    | 
      
        2013-01-21
      
      §
     | 
  
    
  | 12:42 | 
  <hashar> | 
  -varnish-t3 : removing /dev/sda* entries from /etc/fstab , applying {{gerrit|44709}} ps 6 and rerunning puppet | 
  [releng] | 
            
  | 12:28 | 
  <hashar> | 
  applying role::cache::mobile on deployment-varnish-t3 | 
  [releng] | 
            
  | 11:27 | 
  <hashar> | 
  created  deployment-varnish-t3  , deleted deployment-varnish-t2 | 
  [releng] | 
            
  | 10:48 | 
  <hashar> | 
  moved 208.80.153.143 from deployment-varnish-t to deployment-varnish-t2 (IP is in DNS as *.m.beta.wmflabs.org  ) | 
  [releng] | 
            
  | 10:38 | 
  <hashar> | 
  creating deployment-varnish-t2 to replace broken deployment-varnish-t | 
  [releng] | 
            
  | 10:26 | 
  <hashar> | 
  re rebooting dpeloyment-varnish-t | 
  [releng] | 
            
  | 09:58 | 
  <hashar> | 
  Rebooting deployment-varnish-t from labsconsole.  I guess there is a mount for  /dev/sda* :( | 
  [releng] | 
            
  | 09:51 | 
  <hashar> | 
  rebooting  deployment-varnish-t to find out how well it goes on restart :-] | 
  [releng] |