| 
      
        2013-05-14
      
      §
     | 
  
    
  | 12:53 | 
  <hashar> | 
  deleting deployment-lucene, we are using search01 and searchidx01 | 
  [releng] | 
            
  | 12:49 | 
  <hashar> | 
  rebooting -cache-upload03 for kernel upgrade | 
  [releng] | 
            
  | 12:49 | 
  <hashar> | 
  rebooting -sql for kernel / mysql upgrade | 
  [releng] | 
            
  | 12:47 | 
  <hashar> | 
  rebooting -squid for kernel upgrade | 
  [releng] | 
            
  | 12:46 | 
  <hashar> | 
  upgrading bunch of boxes. | 
  [releng] | 
            
  | 12:28 | 
  <hashar> | 
  refreshing l10n cache | 
  [releng] | 
            
  | 12:28 | 
  <hashar> | 
  fixed l10n cache ownership: chown -R l10nupdate:l10nupdate /data/project/apache/common-local/php-master/cache/l10n/ | 
  [releng] | 
            
  | 11:58 | 
  <hashar> | 
  l10n cache is broken since Apr 30th 15:21 utC | 
  [releng] | 
            
  | 11:44 | 
  <hashar> | 
  We somehow have HTTPS on beta now! https://en.wikipedia.beta.wmflabs.org/wiki/Main_Page  still have to fix up the cert names though. | 
  [releng] | 
            
  | 11:20 | 
  <hashar> | 
  deployment-squid applying role::protoproxy::ssl::beta | 
  [releng] | 
            
  | 11:15 | 
  <hashar> | 
  deployment-varnish-t3 applying role::protoproxy::ssl::beta | 
  [releng] | 
            
  | 11:14 | 
  <hashar> | 
  deployment-varnish-t3 : updating local puppet repo | 
  [releng] | 
            
  | 10:43 | 
  <hashar> | 
  deployment-cache-bits03 + role::protoproxy::ssl::beta  (should give us https on bits.beta.wmflabs.org | 
  [releng] | 
            
  
    | 
      
        2013-04-30
      
      §
     | 
  
    
  | 21:35 | 
  <hashar> | 
  Fixed the git path in mediawiki/extensions.git local copy of -bastion | 
  [releng] | 
            
  | 21:04 | 
  <hashar> | 
  both apaches are now serving content from the NFS cluster. | 
  [releng] | 
            
  | 20:58 | 
  <hashar> | 
  Migrating apache-33 to use the new NFS server  | 
  [releng] | 
            
  | 20:58 | 
  <hashar> | 
  apache-32 running with NFS went from 560ms to 260ms when serving pages \\O/ | 
  [releng] | 
            
  | 20:49 | 
  <hashar> | 
  Recreated wikiversions.cdb on bastion for the new NFS home dir | 
  [releng] | 
            
  | 20:08 | 
  <hashar> | 
  migrating apache32 to new NFS server | 
  [releng] | 
            
  | 20:06 | 
  <hashar> | 
  root@deployment-bastion:~# /etc/init.d/udp2log stop && /etc/init.d/udp2log-mw start | 
  [releng] | 
            
  | 20:01 | 
  <hashar> | 
  applying role::labsnfs::client  on -bastion | 
  [releng] | 
            
  | 19:45 | 
  <hashar> | 
  applying the very recent `role::labsnfs::client` class on deployment-integration | 
  [releng] | 
            
  | 19:43 | 
  <hashar> | 
  Upgraded puppet manifests on deployment-integration and running puppet. | 
  [releng] | 
            
  | 19:21 | 
  <hashar> | 
  Migrating homes to the new NFS server | 
  [releng] | 
            
  | 18:27 | 
  <hashar> | 
  rsync to the NFS server are completed. There are most probably still some tiny files than need to be copied though | 
  [releng] | 
            
  | 16:46 | 
  <hashar> | 
  Mounted new NFS server on /srv/project on instances: apache32, apache33, video05 and jobrunner08 | 
  [releng] | 
            
  | 16:01 | 
  <hashar> | 
  Clearing out years old backup from /data/project such as copy of extensions, databases dumps and some old instances backups. | 
  [releng] | 
            
  | 15:28 | 
  <hashar> | 
  Copying l10n cache to the new NFS server: rsync -av /home/wikipedia/common/php-master/cache /srv/project/apache/common/php-master | 
  [releng] | 
            
  | 15:11 | 
  <hashar> | 
  syncing upload data from the Gluster share to labnfs server: rsync -avv /data/project/upload7 /srv/project | 
  [releng] | 
            
  | 13:59 | 
  <hashar> | 
  bastion: created NFS mount point thanks to Coren. echo 1 >/sys/module/nfs/parameters/nfs4_disable_idmapping   ; mount -t nfs -o nfsvers=4,port=0,hard,rsize=65535,wsize=65536 labnfs.pmtpa.wmnet:/deployment-prep/project /srv/project | 
  [releng] | 
            
  | 12:41 | 
  <hashar> | 
  Refreshed most extensions and running mw-update-l10n | 
  [releng] |