901-950 of 4957 results (17ms)
2016-01-28 §
15:09 <hashar> fixing puppet.conf hostname on deployment-upload deployment-conftool deployment-tmh01 deployment-zookeeper01 and deployment-urldownloader [releng]
15:06 <hashar> fixing puppet.con hostname on deployment-upload.deployment-prep.eqiad.wmflabs and running puppet [releng]
15:00 <hashar> Running puppet on deployment-memc02 and deployment-elastic07 . It is catching up with lot of changes [releng]
14:59 <hashar> fixing puppet hostnames on deployment-elastic07 [releng]
14:59 <hashar> fixing puppet hostnames on deployment-memc02 [releng]
14:55 <hashar> Deleted salt keys deployment-pdf01.eqiad.wmflabs and deployment-memc04.eqiad.wmflabs (obsolete, entries with '.deployment-prep.' are already there) [releng]
07:38 <jzerebecki> reload zuul for 4951444..43a030b [releng]
05:55 <jzerebecki> doing https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update [releng]
03:49 <mobrovac> deployment-prep re-enabled puppet on deployment-restbase0x [releng]
02:49 <mobrovac> deployment-prep deployment-restbase01 disabled puppet to set up cassandra for [releng]
02:27 <mobrovac> deployment-prep recreating deployment-restbase01 for T125003 [releng]
02:23 <mobrovac> deployment-prep deployment-restbase02 disabled puppet to recreate deployment-restbase01 for T125003 [releng]
01:42 <mobrovac> deployment-prep recreating deployment-sca02 for T125003 [releng]
01:28 <mobrovac> deployment-prep recreating deployment-sca01 for T125003 [releng]
00:36 <mobrovac> deployment-prep re-imaging deployment-mathoid for T125003 [releng]
00:02 <jzerebecki> integration-slave-trusty-1016:~$ sudo -i rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm/src/skins/Donate [releng]
2016-01-27 §
23:49 <jzerebecki> integration-slave-precise-1011:~$ sudo -i /etc/init.d/salt-minion restart [releng]
23:46 <jzerebecki> work around https://phabricator.wikimedia.org/T117710 : salt --show-timeout '*slave*' cmd.run 'rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm/src/skins/BlueSky' [releng]
21:19 <cscott> updated OCG to version 64050af0456a43344b32e3e93561a79207565eaf (should be no-op after yesterday's deploy) [releng]
10:29 <hashar> triggered bunch of browser tests, deployment-redis01 was dead/faulty [releng]
10:08 <hashar> mass restarting redis-server process on deployment-redis01 (for https://phabricator.wikimedia.org/T124677 ) [releng]
10:07 <hashar> mass restarting redis-server process on deployment-redis01 [releng]
09:00 <hashar> beta: commenting out "latency-monitor-threshold 100" parameter from any /etc/redis/redis.conf we have ( https://phabricator.wikimedia.org/T124677 ). Puppet will not reapply it unless distribution is Jessie [releng]
2016-01-26 §
16:51 <cscott> updated OCG to version 64050af0456a43344b32e3e93561a79207565eaf [releng]
12:14 <hashar> Added Jenkins IRC bot (wmf-insecte) to #wikimedia-perf for https://gerrit.wikimedia.org/r/#/c/265631/ [releng]
09:30 <hashar> restarting Jenkins to upgrade the gearman plugin with https://review.openstack.org/#/c/271543/ [releng]
04:18 <bd808> integration-slave-jessie-1001:/mnt full; cleaned up 15G of files in /mnt/pbuilder/build (27 hours after the last time I did that) [releng]
2016-01-25 §
18:59 <twentyafterfour> started redis-server on deployment-redis01 by commenting out latency-monitor-threshold from the redis.conf [releng]
15:22 <hashar> CI: fixing kernels not upgrading via: rm /boot/grub/menu.lst ; update-grub -y (i.e.: regenerate the Grub menu from scratch) [releng]
14:21 <hashar> integration-slave-trusty-1015.integration.eqiad.wmflabs is gone. I have failed the kernel upgrade / grub update [releng]
01:35 <bd808> integration-slave-jessie-1001:/mnt full; cleaned up 15G of files in /mnt/pbuilder/build [releng]
2016-01-24 §
06:45 <legoktm> deploying https://gerrit.wikimedia.org/r/266039 [releng]
06:13 <legoktm> deploying https://gerrit.wikimedia.org/r/266041 [releng]
2016-01-22 §
23:58 <legoktm> removed skins from mwext-qunit workspace on trusty-1013 slave [releng]
23:34 <legoktm> rm -rf /mnt/jenkins-workspace/workspace/mediawiki-phpunit-php53 on slave precise 1012 [releng]
22:45 <legoktm> deploying https://gerrit.wikimedia.org/r/265864 [releng]
22:27 <hashar> rebooted all CI slaves using OpenStackManager [releng]
22:09 <hashar> rebooting deployment-redis01 (kernel upgrade) [releng]
21:22 <hashar> Image ci-jessie-wikimedia-1453497269 in wmflabs-eqiad is ready (with node 4.2 for https://phabricator.wikimedia.org/T119143 ) [releng]
21:14 <hashar> updating nodepool snapshot based on new image [releng]
21:12 <hashar> rebuilding nodepool reference image [releng]
20:04 <hashar> Image ci-jessie-wikimedia-1453492820 in wmflabs-eqiad is ready [releng]
20:00 <hashar> Refreshing nodepool image to hopefully get Nodejs 4.2.4 https://phabricator.wikimedia.org/T124447 https://gerrit.wikimedia.org/r/#/c/265802/ [releng]
16:32 <hashar> Nuked corrupted git repo on integration-slave-precise-1012 /mnt/jenkins-workspace/workspace/mediawiki-extensions-php53 [releng]
12:23 <hashar> beta: reinitialized keyholder on deployment-bastion. The proxy apparently had no identity [releng]
09:32 <hashar> beta cluster Jenkins job have been stalled for 9hours and 25 minutes. Disabling/reenabling the Gearman plugin to remove the deadlock [releng]
2016-01-21 §
21:41 <hashar> restored role::mail::mx on deployment-mx [releng]
21:36 <hashar> dropping role::mail::mx from deployment-mx to let puppet run [releng]
21:33 <hashar> rebooting deployment-jobrunner01 / kernel upgrade / /tmp is only 1MBytes [releng]
21:19 <hashar> fixing up deployment-jobrunner01 /tmp and / disks are full [releng]