| 2013-05-14
      
      § | 
    
  | 12:53 | <hashar> | deleting deployment-lucene, we are using search01 and searchidx01 | [releng] | 
            
  | 12:49 | <hashar> | rebooting -cache-upload03 for kernel upgrade | [releng] | 
            
  | 12:49 | <hashar> | rebooting -sql for kernel / mysql upgrade | [releng] | 
            
  | 12:47 | <hashar> | rebooting -squid for kernel upgrade | [releng] | 
            
  | 12:46 | <hashar> | upgrading bunch of boxes. | [releng] | 
            
  | 12:28 | <hashar> | refreshing l10n cache | [releng] | 
            
  | 12:28 | <hashar> | fixed l10n cache ownership: chown -R l10nupdate:l10nupdate /data/project/apache/common-local/php-master/cache/l10n/ | [releng] | 
            
  | 11:58 | <hashar> | l10n cache is broken since Apr 30th 15:21 utC | [releng] | 
            
  | 11:44 | <hashar> | We somehow have HTTPS on beta now! https://en.wikipedia.beta.wmflabs.org/wiki/Main_Page  still have to fix up the cert names though. | [releng] | 
            
  | 11:20 | <hashar> | deployment-squid applying role::protoproxy::ssl::beta | [releng] | 
            
  | 11:15 | <hashar> | deployment-varnish-t3 applying role::protoproxy::ssl::beta | [releng] | 
            
  | 11:14 | <hashar> | deployment-varnish-t3 : updating local puppet repo | [releng] | 
            
  | 10:43 | <hashar> | deployment-cache-bits03 + role::protoproxy::ssl::beta  (should give us https on bits.beta.wmflabs.org | [releng] | 
            
  
    | 2013-04-30
      
      § | 
    
  | 21:35 | <hashar> | Fixed the git path in mediawiki/extensions.git local copy of -bastion | [releng] | 
            
  | 21:04 | <hashar> | both apaches are now serving content from the NFS cluster. | [releng] | 
            
  | 20:58 | <hashar> | Migrating apache-33 to use the new NFS server | [releng] | 
            
  | 20:58 | <hashar> | apache-32 running with NFS went from 560ms to 260ms when serving pages \\O/ | [releng] | 
            
  | 20:49 | <hashar> | Recreated wikiversions.cdb on bastion for the new NFS home dir | [releng] | 
            
  | 20:08 | <hashar> | migrating apache32 to new NFS server | [releng] | 
            
  | 20:06 | <hashar> | root@deployment-bastion:~# /etc/init.d/udp2log stop && /etc/init.d/udp2log-mw start | [releng] | 
            
  | 20:01 | <hashar> | applying role::labsnfs::client  on -bastion | [releng] | 
            
  | 19:45 | <hashar> | applying the very recent `role::labsnfs::client` class on deployment-integration | [releng] | 
            
  | 19:43 | <hashar> | Upgraded puppet manifests on deployment-integration and running puppet. | [releng] | 
            
  | 19:21 | <hashar> | Migrating homes to the new NFS server | [releng] | 
            
  | 18:27 | <hashar> | rsync to the NFS server are completed. There are most probably still some tiny files than need to be copied though | [releng] | 
            
  | 16:46 | <hashar> | Mounted new NFS server on /srv/project on instances: apache32, apache33, video05 and jobrunner08 | [releng] | 
            
  | 16:01 | <hashar> | Clearing out years old backup from /data/project such as copy of extensions, databases dumps and some old instances backups. | [releng] | 
            
  | 15:28 | <hashar> | Copying l10n cache to the new NFS server: rsync -av /home/wikipedia/common/php-master/cache /srv/project/apache/common/php-master | [releng] | 
            
  | 15:11 | <hashar> | syncing upload data from the Gluster share to labnfs server: rsync -avv /data/project/upload7 /srv/project | [releng] | 
            
  | 13:59 | <hashar> | bastion: created NFS mount point thanks to Coren. echo 1 >/sys/module/nfs/parameters/nfs4_disable_idmapping   ; mount -t nfs -o nfsvers=4,port=0,hard,rsize=65535,wsize=65536 labnfs.pmtpa.wmnet:/deployment-prep/project /srv/project | [releng] | 
            
  | 12:41 | <hashar> | Refreshed most extensions and running mw-update-l10n | [releng] |