| 2016-01-22
      
      § | 
    
  | 23:58 | <legoktm> | removed skins from mwext-qunit workspace on trusty-1013 slave | [releng] | 
            
  | 23:34 | <legoktm> | rm -rf /mnt/jenkins-workspace/workspace/mediawiki-phpunit-php53 on slave precise 1012 | [releng] | 
            
  | 22:45 | <legoktm> | deploying https://gerrit.wikimedia.org/r/265864 | [releng] | 
            
  | 22:27 | <hashar> | rebooted all CI slaves using OpenStackManager | [releng] | 
            
  | 22:09 | <hashar> | rebooting deployment-redis01 (kernel upgrade) | [releng] | 
            
  | 21:22 | <hashar> | Image ci-jessie-wikimedia-1453497269 in wmflabs-eqiad is ready (with node 4.2 for https://phabricator.wikimedia.org/T119143 ) | [releng] | 
            
  | 21:14 | <hashar> | updating nodepool snapshot based on new image | [releng] | 
            
  | 21:12 | <hashar> | rebuilding nodepool reference image | [releng] | 
            
  | 20:04 | <hashar> | Image ci-jessie-wikimedia-1453492820 in wmflabs-eqiad is ready | [releng] | 
            
  | 20:00 | <hashar> | Refreshing nodepool image to hopefully get Nodejs 4.2.4 https://phabricator.wikimedia.org/T124447  https://gerrit.wikimedia.org/r/#/c/265802/ | [releng] | 
            
  | 16:32 | <hashar> | Nuked corrupted git repo on integration-slave-precise-1012 /mnt/jenkins-workspace/workspace/mediawiki-extensions-php53 | [releng] | 
            
  | 12:23 | <hashar> | beta: reinitialized keyholder on deployment-bastion.  The proxy apparently  had no identity | [releng] | 
            
  | 09:32 | <hashar> | beta cluster Jenkins job have been stalled for 9hours and 25 minutes. Disabling/reenabling the Gearman plugin to remove the deadlock | [releng] | 
            
  
    | 2016-01-21
      
      § | 
    
  | 21:41 | <hashar> | restored role::mail::mx on deployment-mx | [releng] | 
            
  | 21:36 | <hashar> | dropping role::mail::mx from deployment-mx  to let  puppet  run | [releng] | 
            
  | 21:33 | <hashar> | rebooting deployment-jobrunner01  / kernel upgrade /  /tmp is only 1MBytes | [releng] | 
            
  | 21:19 | <hashar> | fixing up deployment-jobrunner01  /tmp and / disks are full | [releng] | 
            
  | 19:48 | <legoktm> | deploying https://gerrit.wikimedia.org/r/265552 | [releng] | 
            
  | 19:39 | <legoktm> | deploying jjb changes for https://gerrit.wikimedia.org/r/264990 | [releng] | 
            
  | 19:25 | <legoktm> | deploying https://gerrit.wikimedia.org/r/265546 | [releng] | 
            
  | 01:59 | <jzerebecki> | jenkins-deploy@deployment-bastion:/srv/mediawiki-staging/php-master/extensions/SpellingDictionary$ rm -r modules/jquery.uls && git rm modules/jquery.uls | [releng] | 
            
  | 01:00 | <jzerebecki> | jenkins-deploy@deployment-bastion:/srv/mediawiki-staging/php-master/extensions$ git pull && git submodule update --init --recursive | [releng] | 
            
  | 00:57 | <jzerebecki> | jenkins-deploy@deployment-bastion:/srv/mediawiki-staging/php-master/extensions$ git reset HEAD SpellingDictionary | [releng] | 
            
  
    | 2016-01-20
      
      § | 
    
  | 20:05 | <hashar> | beta sudo find /data/project/upload7/math -type f -delete  (probably some old left over) | [releng] | 
            
  | 19:50 | <hashar> | beta: on commons ran deleteArchivedFile.php : Nuked 7130 files | [releng] | 
            
  | 19:49 | <hashar> | beta : foreachwiki deleteArchivedRevisions.php -delete | [releng] | 
            
  | 19:26 | <hasharAway> | Nuked all files from http://commons.wikimedia.beta.wmflabs.org/wiki/Category:GWToolset_Batch_Upload | [releng] | 
            
  | 19:19 | <hasharAway> | beta: sudo find /data/project/upload7/*/*/temp -type f -delete | [releng] | 
            
  | 19:14 | <hasharAway> | beta: sudo rm /data/project/upload7/*/*/lockdir/* | [releng] | 
            
  | 18:56 | <hasharAway> | beta cluster code has been stalled for roughly 2h30 | [releng] | 
            
  | 18:55 | <hasharAway> | disconnecting Gearman plugin to remove deadlock for beta cluster rjobs | [releng] | 
            
  | 17:06 | <hashar> | clearing files from beta-cluster to prepare for Swift migration.  python pwb.py delete.py -family:betacommons -lang:en -cat:'GWToolset Batch Upload' -verbose -putthrottle:0 -summary:'Clearing out old batched upload to save up disk space for Swift migration' | [releng] |