| 
      
        2016-05-02
      
      §
     | 
  
    
  | 21:27 | 
  <cscott> | 
  updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 | 
  [releng] | 
            
  | 21:26 | 
  <hashar> | 
  Nodepool is acting just fine: Demand from gearman: ci-trusty-wikimedia: 457  | <AllocationRequest for 455.0 of ci-trusty-wikimedia> | 
  [releng] | 
            
  | 21:25 | 
  <hashar> | 
  restarted qa-morebots "2016-05-02 21:22:23,599 ERROR: Died in main event loop" | 
  [releng] | 
            
  | 21:23 | 
  <hashar> | 
  gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log  | 
  [releng] | 
            
  | 21:20 | 
  <hashar> | 
  gallium: enqueued 488 jobs directly in Gearman. That is to test https://gerrit.wikimedia.org/r/#/c/286462/ ( mediawiki/extensions to hhvm/zend5.5 on Nodepool). Progress /home/hashar/gerrit-286462.log  | 
  [releng] | 
            
  | 21:19 | 
  <cscott> | 
  updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 | 
  [releng] | 
            
  | 20:14 | 
  <hashar> | 
  MediaWiki phpunit jobs to run on Nodepool instances \O/ | 
  [releng] | 
            
  | 16:41 | 
  <urandom> | 
  Forcing puppet run and restarting Cassandra on deployment-restbase0[1-2] : T126629 | 
  [releng] | 
            
  | 16:40 | 
  <urandom> | 
  Cherry-picking https://gerrit.wikimedia.org/r/operations/puppet refs/changes/78/284078/12 to deployment-puppetmaster : T126629 | 
  [releng] | 
            
  | 16:24 | 
  <urandom> | 
  Restarat Cassandra on deployment-restbase0[1-2] : T126629 | 
  [releng] | 
            
  | 16:21 | 
  <urandom> | 
  forcing puppet run on deployment-restbase0[1-2] : T126629 | 
  [releng] | 
            
  | 16:20 | 
  <urandom> | 
  cherry-picking latest refs/changes/78/284078/11 onto deployment-puppetmaster : T126629 | 
  [releng] | 
            
  | 09:44 | 
  <hashar> | 
  On zuul-merger instances (gallium / scandium), cleared out pywikibot/core working copy ( rm -fR /srv/ssd/zuul/git/pywikibot/core/ ) T134062 | 
  [releng] | 
            
  
    | 
      
        2016-04-28
      
      §
     | 
  
    
  | 22:03 | 
  <urandom> | 
  deployment-restbase01 upgrade to 2.2.6 complete : T126629 | 
  [releng] | 
            
  | 21:56 | 
  <urandom> | 
  Stopping Cassandra on deployment-restbase01, upgrading package to 2.2.6, and forcing puppet run : T126629 | 
  [releng] | 
            
  | 21:55 | 
  <urandom> | 
  Snapshotting Cassandra tables on deployment-restbase01 (name = 1461880519833) : T126629 | 
  [releng] | 
            
  | 21:55 | 
  <urandom> | 
  Snapshotting Cassandra tables on deployment-restbase01 : T126629 | 
  [releng] | 
            
  | 21:52 | 
  <urandom> | 
  Forcing puppet run on deployment-restbase02 : T126629 | 
  [releng] | 
            
  | 21:51 | 
  <urandom> | 
  Cherry picking operations/puppet refs/changes/78/284078/10 to puppmaster : T126629 | 
  [releng] | 
            
  | 20:46 | 
  <urandom> | 
  Starting Cassandra on deployment-restbase02 (now v2.2.6) : T126629 | 
  [releng] | 
            
  | 20:41 | 
  <urandom> | 
  Re-enable puppet and force run on deployment-restbase02 : T126629 | 
  [releng] | 
            
  | 20:38 | 
  <urandom> | 
  Halting Cassandra on deployment-restbase02, masking systemd unit, and upgrading package(s) to 2.2.6 : T126629 | 
  [releng] | 
            
  | 20:37 | 
  <urandom> | 
  Snapshotting Cassandra tables on deployment-restbase02 (snapshot name = 1461875833996) : T126629 | 
  [releng] | 
            
  | 20:37 | 
  <urandom> | 
  Snapshotting Cassandra tables on deployment-restbase02 : T126629 | 
  [releng] | 
            
  | 20:33 | 
  <urandom> | 
  Cassandra on deployment-restbase01.deployment-prep started : T126629 | 
  [releng] | 
            
  | 20:25 | 
  <urandom> | 
  Restarting Cassandra on deployment-restbase01.deployment-prep : T126629 | 
  [releng] | 
            
  | 20:14 | 
  <urandom> | 
  Re-enable puppet on deployment-restbase01.deployment-prep, and force a run : T126629 | 
  [releng] | 
            
  | 20:12 | 
  <urandom> | 
  cherry-picking https://gerrit.wikimedia.org/r/#/c/284078/ to deployment-puppetmaster : T126629 | 
  [releng] | 
            
  | 20:06 | 
  <urandom> | 
  Disabling puppet on deployment-restbase0[1-2].deployment-prep : T126629 | 
  [releng] | 
            
  | 14:43 | 
  <hashar> | 
  Rebuild Nodepool Jessie image. Comes with hhvm | 
  [releng] | 
            
  | 12:52 | 
  <hashar> | 
  Puppet is happy on deployment-changeprop | 
  [releng] | 
            
  | 12:47 | 
  <hashar> | 
  apt-get upgrade deployment-changeprop   (outdated exim package) | 
  [releng] | 
            
  | 12:42 | 
  <hashar> | 
  Rebuild Nodepool Trusty instance to include the PHP wrapper script T126211 | 
  [releng] | 
            
  
    | 
      
        2016-04-27
      
      §
     | 
  
    
  | 23:57 | 
  <thcipriani> | 
  nodepool instances running again after an openstack rabbitmq restart by andrewbogott  | 
  [releng] | 
            
  | 22:51 | 
  <duploktm> | 
  also ran openstack server delete ci-jessie-wikimedia-85342 | 
  [releng] | 
            
  | 22:42 | 
  <legoktm> | 
  nodepool delete 85342 | 
  [releng] | 
            
  | 22:41 | 
  <matt_flaschen> | 
  Deployed https://gerrit.wikimedia.org/r/#/c/285765/ to enable External Store everywhere on Beta Cluster | 
  [releng] | 
            
  | 22:38 | 
  <legoktm> | 
  stop/started nodepool | 
  [releng] | 
            
  | 22:36 | 
  <thcipriani> | 
  I don't have permission to restart nodepool | 
  [releng] | 
            
  | 22:35 | 
  <thcipriani> | 
  restarting nodepool | 
  [releng] | 
            
  | 22:18 | 
  <matt_flaschen> | 
  Deployed https://gerrit.wikimedia.org/r/#/c/282440/ to switch Beta Cluster to use External Store for new testwiki writes | 
  [releng] | 
            
  | 20:59 | 
  <hashar> | 
  thcipriani downgraded git plugins successfully (we wanted to rule out their upgrade  for some weird issue) | 
  [releng] | 
            
  | 20:13 | 
  <cscott> | 
  updated OCG to version e39e06570083877d5498da577758cf8d162c1af4 | 
  [releng] | 
            
  | 14:10 | 
  <hashar> | 
  restarting Jenkins | 
  [releng] | 
            
  | 14:09 | 
  <hashar> | 
  Jenkins upgrading credential plugin 1.24 > 1.27  And Credentials binding plugin 1.6 > 1.7 | 
  [releng] | 
            
  | 14:07 | 
  <hashar> | 
  Jenkins upgrading git plugin 2.4.1 > 2.4.4 | 
  [releng] |