5751-5800 of 10000 results (28ms)
2017-06-13 §
20:37 <hashar> Restarting Nodepool. apparently confused in pool tracking and spawning to many Trusty nodes (7 instead of 4) [releng]
20:31 <hashar> Nodepool: deleted a bunch of Trusty instances. It scheduled lot of them that are taking slots in the pool. Better have jessie nodes to be spawned instead since there is high demand for them [releng]
20:19 <hashar> deployment-prep: added Polishdeveloper to the "importer" global group. https://deployment.wikimedia.beta.wmflabs.org/wiki/Special:GlobalUserRights/Polishdeveloper - T167823 [releng]
18:47 <andrewbogott> root@deployment-salt02:~# salt "*" cmd.run "apt-get -y install facter" [releng]
18:46 <andrewbogott> using salt to "apt-get -y install facter" on all deployment-prep instances [releng]
18:38 <andrewbogott> restarting apache2 on deployment-puppetmaster02 [releng]
18:37 <andrewbogott> doing a git fetch and rebase for deployment-puppetmaster02 [releng]
17:00 <elukey> hacking apache on mediawiki05 to test rewrite rules [releng]
16:04 <Amir1> cherry-picked 357985/4 on puppetmaster [releng]
15:59 <halfak> deployed ores-prod-deploy:862aea9 [releng]
13:47 <hashar> nodepool force running puppet for: lower min-ready for trusty [puppet] - https://gerrit.wikimedia.org/r/356466 [releng]
10:53 <elukey> rolling restart of all kafka brokers to pick up the new zookeper change (only deployment-zookeeper02 available) [releng]
10:36 <elukey> delete deployment-zookeeper01 (old trusty instance, replaced with a jessie one) [releng]
09:50 <elukey> big refactoring for zookeeper merged in operations/puppet - https://gerrit.wikimedia.org/r/#/c/354449 - ping the Analytics team for any issue [releng]
2017-06-12 §
14:22 <hashar> Image snapshot-ci-trusty-1497276913 in wmflabs-eqiad is ready [releng]
14:15 <hashar> Nodepool: regenerating Trusty images to confirm that removal of keystone admin_token is a noop for nodepool - T165211 [releng]
12:44 <hashar> Image snapshot-ci-jessie-1497270581 in wmflabs-eqiad is ready [releng]
12:30 <hashar> nodepool: refreshing Jessie snapshot to upgrade HHVM from 3.12 to 3.18 - T167493 T165074 [releng]
08:47 <hashar> deployment-prep : salt -v '*' cmd.run 'apt-get clean' [releng]
2017-06-09 §
20:30 <thcipriani> reloading zuul to deploy https://gerrit.wikimedia.org/r/#/c/358092/1 [releng]
18:50 <thcipriani> reloading zuul to deploy https://gerrit.wikimedia.org/r/#/c/358067/3 [releng]
2017-06-07 §
17:49 <elukey> forced /usr/local/bin/git-sync-upstream manually on puppetmaster02 [releng]
17:30 <elukey> manually fixed rebase issue for operations/puppet on puppetmaster02 (empty commit due to the change for scap3 and jobrunners) [releng]
09:33 <elukey> restart kafka brokers to pick up the new zookeeper settings [releng]
09:00 <elukey> adding deployment-zookeeper02.eqiad.wmflabs to Hiera:deployment-prep [releng]
08:43 <gehel> upgrading kibana to v5.3.3 on deployment-logstash2 [releng]
08:35 <gehel> rolling back to kibana 5.3.2, incompatible elasticsearch version [releng]
08:28 <gehel> upgrading kibana to v5.4.1 on deployment-logstash2 [releng]
2017-06-06 §
14:34 <hashar> deleting buildlog.integration.eqiad.wmflabs was mean to receive Jenkins logs in ElasticSearch. We are experimenting with relforge1001.eqiad.wmnet now - T78705 [releng]
12:37 <hashar> Removing HHVM from permanent Trusty slaves [releng]
10:44 <elukey> running eventlogging_cleaner.py (https://gerrit.wikimedia.org/r/#/c/356383/) on eventlogging to test the cleaning of old events [releng]
09:24 <hashar> Deleting deployment-phab02 instance. Has been shut off since April 23rd - T167090 [releng]
07:51 <hashar_> Fixed puppet on deployment-aqs instances [releng]
2017-06-05 §
15:38 <elukey> manually hacking deployment-jobrunner02.deployment-prep.eqiad.wmflabs to test a new config [releng]
2017-06-02 §
19:51 <hashar> integration: granted ebernhardson sudo [releng]
12:12 <hashar> jenkins: rebuild logstash plugin from HEAD of master for jenkins 2 back compat. logstash-1.2.0-4-gbcbc19e - T78705 [releng]
2017-06-01 §
20:14 <bearND> Update mobileapps to c4dc72d [releng]
20:12 <mdholloway> killed the running emulator processes on integration-slave-jessie-android to get it booting again following yesterday's gerrit outage [releng]
13:39 <hashar> Gerrit: change integration.git project to "Rebase if Necessary" with "Allow content merges" - T131008 [releng]
13:10 <hashar> Gerrit allow content merge for integration/config ( https://gerrit.wikimedia.org/r/#/admin/projects/integration/config ) - T131008 [releng]
08:03 <hashar> Purged all mysql bin files from deployment-db03 ( rm -fR /srv/sqldata/T166060 ) - T166060 [releng]
2017-05-31 §
20:21 <hashar> Jenkins: upgrading git-client-plugin 2.4.5..2.4.6 T166557 [releng]
07:50 <hashar> deployment-db04: mysql> set global expire_logs_days = 7 - to expire bin logs faster (instead of 30 days) - T166060 [releng]
07:49 <hashar> deployment-db03: mysql> set global expire_logs_days = 7 - to expire bin logs faster (instead of 30 days) - T166060 [releng]
2017-05-30 §
22:08 <hasharAway> Changed integration/config.git submit type from "Fast forward only" to "Rebase if Necessary" T131008 [releng]
2017-05-29 §
14:44 <elukey> reverted previous config on redis01 [releng]
14:36 <elukey> set redis-cli -a "$(sudo grep -Po '(?<=masterauth ).*' /etc/redis/tcp_6379.conf)" -p 6381 config set tcp-keepalive 300 on redis01 as test (rollback: redis-cli -a "$(sudo grep -Po '(?<=masterauth ).*' /etc/redis/tcp_6379.conf)" -p 6381 config set tcp-keepalive 0) [releng]
10:22 <hashar> force refreshed Nodepool Trusty images. Was stuck somehow [releng]
10:06 <hashar> deployment-tin rm -fR /usr/src/hhvm T166492 [releng]
09:51 <hashar> deployment-tin: rm /var/lib/l10nupdate/caches/cache-master/*.json T166492 [releng]