| 
      
        2018-04-20
      
      §
     | 
  
    
  | 21:32 | 
  <eddiegp> | 
  deployment-kafka04: full disk, deleted /var/log/syslog.1 (3G) to make interactive sessions work again | 
  [releng] | 
            
  | 17:30 | 
  <thcipriani> | 
  rebase integration-puppetmaster01:/var/lib/puppet/git conflicting on https://gerrit.wikimedia.org/r/#/c/348236/ | 
  [releng] | 
            
  | 08:38 | 
  <hashar> | 
  Cleaned integration-slave-docker-1005  disk (deleting workspace and all docker images) | 
  [releng] | 
            
  | 08:27 | 
  <hashar> | 
  Created integration-slave-docker-1016 and integration-slave-docker-1017 (2G RAM / 2 executors ) | 
  [releng] | 
            
  | 08:26 | 
  <hashar> | 
  replaced integration-slave-docker-1010 and integration-slave-docker-1011 with bigger instances (4GB RAM) | 
  [releng] | 
            
  | 07:03 | 
  <hashar> | 
  Replaced integration-slave-docker-1001 to get 4GB of RAM | 
  [releng] | 
            
  | 00:46 | 
  <awight> | 
  roll back ORES beta to master | 
  [releng] | 
            
  | 00:08 | 
  <awight> | 
  Push ORES git-lfs to look at stuff | 
  [releng] | 
            
  
    | 
      
        2018-04-19
      
      §
     | 
  
    
  | 21:23 | 
  <hashar> | 
  Pooling in the new integration-slave-docker-1002 and integration-slave-docker-1003 | 
  [releng] | 
            
  | 21:08 | 
  <hashar> | 
  rebuilding integration-slave-docker-1002 and integration-slave-docker-1003 ci1.medium > m1.medium (+2G RAM) | 
  [releng] | 
            
  | 21:01 | 
  <hashar> | 
  Bringing back quibble (0.0.9), this time with COMPOSER_PROCESS_TIMEOUT=600 | T192576 | 
  [releng] | 
            
  | 19:22 | 
  <hashar> | 
  integration-slave-docker-1004 : wiping all jenkins workspace and all docker images | 
  [releng] | 
            
  | 18:00 | 
  <thcipriani> | 
  cleared a bunch of old docker images from integration-slave-docker-1004, freed 4.4GB of space | 
  [releng] | 
            
  | 17:43 | 
  <thcipriani> | 
  Reloading Zuul to deploy https://gerrit.wikimedia.org/r/#/c/427717/ | 
  [releng] | 
            
  | 10:34 | 
  <Hauskatze> | 
  fixStuckGlobalRename.php ran to unblock rename jobs never arriving to jobqueue | 
  [releng] | 
            
  | 09:41 | 
  <hashar> | 
  building releng/quibble-stretch:0.0.8-2 | 
  [releng] | 
            
  | 08:19 | 
  <eddiegp> | 
  eddie@deployment-tin:~$ for wiki in deploymentwiki enwiki enwikinews loginwiki metawiki simplewiki; do mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=$wiki --logwiki=loginwiki 'Samtar' "There'sNoTime"; done T192476 | 
  [releng] | 
            
  
    | 
      
        2018-04-18
      
      §
     | 
  
    
  | 22:53 | 
  <eddiegp> | 
  started nutcracker on deployment-jobrunner03 | 
  [releng] | 
            
  | 22:53 | 
  <eddiegp> | 
  root@deployment-jobrunner03:/var/run# mkdir nutcracker && chown nutcracker.nutcracker nutcracker ref T178457 | 
  [releng] | 
            
  | 21:16 | 
  <Hauskatze> | 
  (addition to previous message) Cmd ran on deployment-jobrunner03; zillions of messages complaining nutcracker was down | 
  [releng] | 
            
  | 21:15 | 
  <Hauskatze> | 
  Ran sudo puppet agent -tv to restart nutcracker, which was "Notice: /Stage[main]/Nutcracker/Service[nutcracker]/ensure: ensure changed 'stopped' to 'running'" | 
  [releng] | 
            
  | 20:32 | 
  <hashar> | 
  reloaded zuul for https://gerrit.wikimedia.org/r/427534 | 
  [releng] | 
            
  | 20:29 | 
  <Reedy> | 
  reloaded zuul for 427469 | 
  [releng] | 
            
  | 20:11 | 
  <mdholloway> | 
  deployed to BC: [mobileapps/deploy@9328a7d]: Update mobileapps to fb161d7 | 
  [releng] | 
            
  | 18:03 | 
  <hauskatze> | 
  maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=wikidatawiki --logwiki=loginwiki 'Artix Kreiger 2' 'Artix Krieger 2' - T192471 | 
  [releng] | 
            
  | 17:34 | 
  <legoktm> | 
  deployed https://gerrit.wikimedia.org/r/427421 https://gerrit.wikimedia.org/r/427422 https://gerrit.wikimedia.org/r/427423 a while back | 
  [releng] | 
            
  | 13:23 | 
  <addshore> | 
  added Thiemo Kreuz (WMDE) to deployment-prep | 
  [releng] | 
            
  | 13:18 | 
  <addshore> | 
  added WMDE-Fisch to deployment-prep | 
  [releng] | 
            
  | 09:41 | 
  <hashar> | 
  Triggered https://integration.wikimedia.org/ci/job/quibble-integration/ for REL1_31 | 
  [releng] | 
            
  | 09:40 | 
  <hashar> | 
  Buiding quibble jobs with (master, mysql, php5.5) https://integration.wikimedia.org/ci/job/quibble-integration/7/  T192432 | 
  [releng] | 
            
  | 07:17 | 
  <legoktm> | 
  deploying https://gerrit.wikimedia.org/r/426115 | 
  [releng] | 
            
  | 04:52 | 
  <legoktm> | 
  live hacked /etc/nodepool/wikimedia, trying some things to get rid of mod_php5 | 
  [releng] |