2451-2500 of 4511 results (18ms)
2014-12-12 §
18:35 <bd808> Added puppet config to record !log messages in logstash [releng]
17:32 <bd808> forcing puppet runs on deployment-mediawiki0[12]; hiera settings specific to beta were not applied on the hosts leading to all kinds of problems [releng]
17:13 <bd808> restarted hhvm on deployment-mediawiki0[12] and purged hhbc database [releng]
17:00 <bd808> restarted apache2 on deployment-mediawiki01 [releng]
16:59 <bd808> restarted apache2 on deployment-mediawiki02 [releng]
2014-12-11 §
22:47 <cscott> updated OCG to version bfc3812ef346c9f767135b339cedd123a1bcac98 [releng]
22:13 <hashar> Adding chrismcmahon to the 'integration' Gerrit group so he can +2 changes made to integration/config.git [releng]
21:47 <hashar> Jenkins re adding [https://integration.wikimedia.org/ci/computer/integration-slave1009/ integration-slave1009] to the pool of slaves [releng]
19:45 <bd808|LUNCH> I got nerd snipped into looking at beta. Major personal productivity failure. [releng]
19:43 <bd808|LUNCH> nslcd log noise is probably a red herring -- https://access.redhat.com/solutions/58684 [releng]
19:39 <bd808|LUNCH> lots of nslcd errors in syslog on deployment-rsync01 which may be causing scap failures [releng]
07:45 <YuviPanda> shut up shinken-wm [releng]
2014-12-10 §
22:17 <bd808> restarted logstash on logstash1001. redis event queue not being processed [releng]
10:30 <hashar> Adding hhvm on Trusty slaves, using depooled integration-slave1009 as the main work area [releng]
2014-12-09 §
16:33 <bd808> restarted puppetmaster to pick up changes to custom functions [releng]
16:19 <bd808> forced install of sudo-ldap across beta with: salt '*' cmd.run 'env SUDO_FORCE_REMOVE=yes DEBIAN_FRONTEND=noninteractive apt-get -y install sudo-ldap' [releng]
2014-12-08 §
23:45 <bd808> deleted hhvm core on mediawiki01 [releng]
23:43 <bd808> Ran `apt-get clean` on deployment-mediawiki01 [releng]
2014-12-06 §
05:05 <ori> upgrade hhvm-tidy to 0.1-2 [releng]
2014-12-05 §
22:21 <bd808> 1.1G free on deployment-mediawiki02:/var after removing a lot of crap form logs and /var/tmp/cores [releng]
22:06 <bd808> /var full on deployment-mediawiki02 again :((( [releng]
10:50 <hashar> applying mediawiki::multimedia class on contint slaves ( https://phabricator.wikimedia.org/T76661 | https://gerrit.wikimedia.org/r/#/c/177770/ ) [releng]
01:01 <bd808> Deleted a ton of jeprof.*.heap files from deployment-mediawiki02:/ [releng]
00:54 <YuviPanda> cleared out pngs from mediawiki02 to kill low space warning [releng]
00:53 <YuviPanda> mediawiki02 instance is low on space, /tmp has lots of... pngs? [releng]
2014-12-04 §
22:48 <YuviPanda> manually rebased puppet on deployment-prep [releng]
00:29 <bd808> deleted instance "udplog" [releng]
2014-12-03 §
21:33 <cscott> updated OCG to version 08e94b19c3f17e699d7e53d9605f65c58e17ea0e [releng]
19:11 <bd808> Cleaned up legacy jobrunner scripts on deployment-jobrunner01 (/etc/default/mw-job-runner /etc/init.d/mw-job-runner /usr/local/bin/jobs-loop.sh) [releng]
2014-12-02 §
23:39 <bd808> Cause of full disk on deployment-mediawiki01 was an hhvm core file; fixed now [releng]
23:35 <bd808> /var full on deployment-mediawiki01 [releng]
17:09 <_joe_> upgrading HHVM to its latest version [releng]
17:08 <andrewbogott> this is a test message [releng]
11:27 <hashar> deleting /srv/vdb/varnish* files on all varnish instances ( https://phabricator.wikimedia.org/T76091 ) [releng]
10:23 <hashar> restarted parsoid on deployment-parsoid05 [releng]
05:26 <Krinkle> integration-slave1001 has been down since the failed reboot on 28 November 2014. Still unreachable over ssh and no Jenkins slave agent. [releng]
2014-12-01 §
21:50 <cscott-split> updated OCG to version a06e7c186796a6ee5d5af81e93688520abdf2596 [releng]
18:54 <bd808> Got jenkins updates working again by taking deployment-bastion node offline, killing waiting jobs and bringing it back online again. [releng]
18:51 <bd808> updates in beta suck with the "Waiting for next available executor" deadlock again [releng]
17:59 <bd808> Testing rsyslog event forwarding to logstash via puppet cherry-pick [releng]
2014-11-27 §
12:28 <hashar> enabled puppet master autoupdate by setting <tt>puppetmaster_autoupdate: true</tt> in [[Hiera:Integration]] . https://phabricator.wikimedia.org/T75878 [releng]
12:28 <hashar> rebased integration puppetmaster : 5d35de4..1a5ebee [releng]
00:32 <bd808> Testing local hack on deployment-salt to switch order of heira backends [releng]
00:16 <bd808> Testing a proposed puppet patch to allow pointing hhvm logs back to deploment-bastion [releng]
2014-11-26 §
20:47 <cscott> updated OCG to version 7d8f2b8bd496464041e3ef9c092732457cc8f7ef [releng]
00:51 <bd808> cherry-picked patch for redis logstash input from MW {{gerrit|175896}} [releng]
00:50 <bd808> Restored puppet cherry-picks from reflog [phab:T75947] [releng]
2014-11-25 §
23:45 <hashar> Fixed upload cache on beta cluster, the Varnish backend had a mmap SILO error that prevented the backend from starting. https://phabricator.wikimedia.org/T75922 [releng]
21:05 <bd808> Running `sudo find . -type d ! -perm -o=w -exec chmod 0777 {} +` to fix upload permissions [releng]
18:01 <legoktm> cleared out renameuser_status table (old broken global merges) [releng]