| 2016-02-25
      
      § | 
    
  | 22:23 | <hashar> | beta: jobrunner01  had apache/hhvm killed somehow .... Blame me | [releng] | 
            
  | 21:56 | <hashar> | beta: stopped jobchron / jobrunner on deployment-jobrunner01  and restarting them by running puppet | [releng] | 
            
  | 21:49 | <hashar> | beta did a git-deploy of jobrunner/jobrunner hoping to fix puppet run on deployment-jobrunner01 and apparently it did! T126846 | [releng] | 
            
  | 11:21 | <hashar> | deleting workspace /mnt/jenkins-workspace/workspace/browsertests-Wikidata-WikidataTests-linux-firefox-sauce on slave-trusty-1015 | [releng] | 
            
  | 10:08 | <hashar> | Jenkins upgraded T128006 | [releng] | 
            
  | 01:44 | <legoktm> | deploying https://gerrit.wikimedia.org/r/273170 | [releng] | 
            
  | 01:39 | <legoktm> | deploying https://gerrit.wikimedia.org/r/272955 (undeployed) and https://gerrit.wikimedia.org/r/273136 | [releng] | 
            
  | 01:37 | <legoktm> | deploying https://gerrit.wikimedia.org/r/273136 | [releng] | 
            
  | 00:31 | <thcipriani> | running puppet on beta to update scap to latest packaged version: sudo salt -b '10%' -G 'deployment_target:scap/scap' cmd.run 'puppet agent -t' | [releng] | 
            
  | 00:20 | <thcipriani> | deployment-tin not accepting jobs for some time, ran through https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update, is back now | [releng] | 
            
  
    | 2016-02-16
      
      § | 
    
  | 23:22 | <yuvipanda> | new instances on deployment-prep no longer get NFS because of https://wikitech.wikimedia.org/w/index.php?title=Hiera%3ADeployment-prep&type=revision&diff=311783&oldid=311781 | [releng] | 
            
  | 23:18 | <hashar> | jenkins@gallium find /var/lib/jenkins/config-history/nodes -maxdepth 1 -type d -name 'ci-jessie*' -exec rm -vfR {} \; | [releng] | 
            
  | 23:17 | <hashar> | Jenkins accepting slave creations again. Root cause is /var/lib/jenkins/config-history/nodes/ has reached the 32k inode limit. | [releng] | 
            
  | 23:14 | <hashar> | Jenkins: Could not create rootDir /var/lib/jenkins/config-history/nodes/ci-jessie-wikimedia-34969/2016-02-16_22-40-23 | [releng] | 
            
  | 23:02 | <hashar> | Nodepool can not authenticate with Jenkins anymore. Thus it can not add slaves it spawned. | [releng] | 
            
  | 22:56 | <hashar> | contint: Nodepool instances pool exhausted | [releng] | 
            
  | 21:14 | <andrewbogott> | deployment-logstash2 migration finished | [releng] | 
            
  | 20:49 | <jzerebecki> | reloading zuul for 3bf7584..67fec7b | [releng] | 
            
  | 19:58 | <andrewbogott> | migrating deployment-logstash2 to labvirt1010 | [releng] | 
            
  | 19:00 | <hashar> | tin: checking out mw 1.27.0-wmf.14 | [releng] | 
            
  | 15:23 | <hashar> | integration-make-wmfbranch : /mnt/make-wmf-branch  mount now has gid=wikidev and group setuid (i.e. mode 2775) | [releng] | 
            
  | 15:20 | <hashar> | integration-make-wmfbranch : change tmpfs to /mnt/make-wmf-branch  (from /var/make-wmf-branch ) | [releng] | 
            
  | 11:30 | <jzerebecki> | T117710 integration-saltmaster:~# salt -v '*slave-trusty*' cmd.run 'rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm-composer/src/skins/BlueSky' | [releng] | 
            
  | 09:52 | <hashar> | will cut the wmf branches this afternoon starting around 14:00 CET | [releng] |