| 
      
        2017-06-21
      
      §
     | 
  
    
  | 19:54 | 
  <hashar> | 
  deployment-tin stopped keyholder and armed it | 
  [releng] | 
            
  | 19:25 | 
  <hashar> | 
  hard rebooting deployment-db04 | 
  [releng] | 
            
  | 19:20 | 
  <hashar> | 
  hard rebooting deployment-db03 | 
  [releng] | 
            
  | 18:52 | 
  <hashar> | 
  Removing /etc/apt/sources.list.d/wikimedia_mariadb.list  (content: deb http://apt.wikimedia.org/wikimedia precise-wikimedia mariadb  ) | 
  [releng] | 
            
  | 18:51 | 
  <hashar> | 
  fixing up apt config on deployment-db03 and deployment-db04 /  upgrade packages and kernel / reboot | 
  [releng] | 
            
  | 17:02 | 
  <hashar> | 
  upgrading kernel and puppet on deployment-mcs01 deployment-restbase01 and deployment-restbase02 - T168541 | 
  [releng] | 
            
  | 16:59 | 
  <hashar> | 
  upgrading kernel and puppet on deployment-changeprop and deployment-conf03 - T168541 | 
  [releng] | 
            
  | 16:56 | 
  <hashar> | 
  upgrading kernel and puppet on deployment-aqs01 deployment-aqs02 and deployment-aqs03 - T168541 | 
  [releng] | 
            
  | 16:38 | 
  <hashar> | 
  rebooting deployment-cache-upload04 and deployment-cache-text-04 - T168541 | 
  [releng] | 
            
  | 16:29 | 
  <hashar> | 
  upgrading deployment-apertium02 and deployment-eventlogging04  - T168541 | 
  [releng] | 
            
  | 16:23 | 
  <hashar> | 
  upgrade and reboot deployment-prometheus01 | 
  [releng] | 
            
  | 16:11 | 
  <hashar> | 
  rebooting deployment-ms-fe02 | 
  [releng] | 
            
  | 16:11 | 
  <hashar> | 
  rebooting deployment-ms-be04 | 
  [releng] | 
            
  | 16:09 | 
  <hashar> | 
  rebooting deployment-ms-be03 | 
  [releng] | 
            
  | 16:03 | 
  <hashar> | 
  upgrading deployment-ms-fe02  deployment-ms-be03 and deployment-ms-be04 | 
  [releng] | 
            
  | 15:57 | 
  <hashar> | 
  apt-get upgrade and reboot of deployment-memc04 and deployment-memc05 | 
  [releng] | 
            
  | 15:52 | 
  <hashar> | 
  rebooting deployment-etcd-01 | 
  [releng] | 
            
  | 15:48 | 
  <hashar> | 
  apt-get upgrade deployment-etcd-01 | 
  [releng] | 
            
  | 15:35 | 
  <hashar> | 
  deployment-prep changing Varnish director for citoid from citoid.wmflabs.org to citoid-beta.wmflabs.org  ( via https://horizon.wikimedia.org/project/prefixpuppet/ ) - T168519 | 
  [releng] | 
            
  | 14:41 | 
  <hashar> | 
  deployment-tmh01 is down for some reason | 
  [releng] | 
            
  | 14:21 | 
  <hashar> | 
  deployment-prep: force running puppet on all instances | 
  [releng] | 
            
  | 14:17 | 
  <hashar> | 
  finally fixed puppet on deployment-prep ! | 
  [releng] | 
            
  | 14:02 | 
  <hashar> | 
  deployment-puppmaster (cd /etc/puppet && ln -s /var/lib/git/operations/puppet/manifests && ln -s /var/lib/git/operations/puppet/modules) | 
  [releng] | 
            
  | 13:26 | 
  <hashar> | 
  deployment-prep: puppet master got erroneously upgrade to puppet* 4.8.  Roll it back to 3.8 which fail, and then back to 3.7! | 
  [releng] | 
            
  | 12:47 | 
  <hashar> | 
  broke deployment-prep puppet master while upgrading it :( | 
  [releng] | 
            
  | 12:28 | 
  <hashar> | 
  deployment-imagescaler01 removed puppetmaster and puppetmaster-common packages | 
  [releng] | 
            
  | 12:04 | 
  <hashar> | 
  apt-get dist-upgrade on deployment-mediawiki hosts | 
  [releng] | 
            
  | 11:59 | 
  <hashar> | 
  armed keyholder on deployment-tin and deployment-mira | 
  [releng] | 
            
  | 11:15 | 
  <hashar> | 
  deployment-cache-text04 : apt-get dist-upgrade | 
  [releng] | 
            
  | 11:12 | 
  <hashar> | 
  varnish fails on deployment-cache-text04 | 
  [releng] | 
            
  | 11:08 | 
  <hashar> | 
  deployment-prep : rebooting deployment-tin deployment-mira deployment-cache-text04 deployment-cache-upload04 | 
  [releng] | 
            
  | 11:00 | 
  <hashar> | 
  deployment-prep apt-get upgrade and reboot all hosts | 
  [releng] | 
            
  | 10:21 | 
  <hashar> | 
  deployment-zotero01  apt-get upgrade and rebooted | 
  [releng] | 
            
  | 09:59 | 
  <hashar> | 
  integration: removing swift / python-swift from integration-puppetmaster01 | 
  [releng] | 
            
  | 09:57 | 
  <hashar> | 
  Upgrading puppet 3.7.2 .. 3.8.5 on integration-slave-docker-1001 and integration-slave-docker-1002 | 
  [releng] | 
            
  | 09:39 | 
  <hashar> | 
  integration: deleting swift and and swift-storage-01  unused | 
  [releng] | 
            
  | 09:38 | 
  <hashar> | 
  upgrading/Rebooting all instances from integration project to catch up with Linux kernel upgrades | 
  [releng] |