851-900 of 1359 results (12ms)
2012-07-17 §
13:29 <hashar> err: /Stage[main]/Mediawiki::Sync/Exec[mw-sync]: Failed to call refresh: Command exceeded timeout at /etc/puppet/manifests/mediawiki.pp:24 [releng]
13:28 <hashar> All apaches are dead :/ [releng]
09:26 <hashar> Adding class role::applicationserver::jobrunner [releng]
09:20 <hashar> sync upload6 dirs again. root@deployment-nfs-memc:$ rsync -a --progress --inplace /mnt/export/upload6 /data/project/upload6 [releng]
2012-07-16 §
19:36 <hashar> rebuilding localisation cache [releng]
15:55 <hashar> Updated ArticleFeedbackv5 778f089..ccbc585 [releng]
2012-07-11 §
16:04 <hashar> Created upload.beta.wmflabs.org to points to deployment-cache-upload01 ( 208.80.153.242 ) [releng]
15:46 <hashar> just logging the rsync command: root@deployment-nfs-memc:/data/project/upload6# rsync -a --progress --inplace /mnt/export/upload6 /data/project/upload6 [releng]
15:41 <hashar> started rsync of /mnt/export/upload6 to /data/project/upload6 [releng]
14:55 <hashar> deployment-cache-bits02 now serves bits.beta.wmflabs.org using pending gerrit changes {{gerrit|15445}} and {{gerrit|13304}} (using varnish configuration from production) [releng]
12:51 <hashar> created deployment-cache-upload01 a Lucid instane to serve http://upload.beta.wmflabs.org/ [releng]
12:49 <hashar> deleting cache-upload2 , need a Lucid instance. [releng]
12:48 <hashar> cache-upload2 set squid_coss_disks to vdb [releng]
12:44 <hashar> applying role::cache::upload to deployment-cache-upload02 [releng]
12:27 <hashar> Creating deployment-cache-upload02 to replace deployment-cache-upload and serves http://upload.beta.wmflabs.org/ [releng]
12:21 <hashar> Deleting deployment-cache-bits which was corrupted and replaced it by deployment-cache-bits02 [releng]
12:18 <hashar> moved bits.beta.wmflabs.org from deployment-cache-bits to deployment-cache-bits02 [releng]
12:09 <hashar> Enabling puppetmaster::self on deployment-cache-bits02 to get Varnish config ({{gerrit|13304}}) [releng]
09:55 <hashar> Applying role::cache::bits::labs to deployment-cache-bits02 [releng]
09:42 <hashar> Manually started mw-job-runner on jobrunner06 [releng]
09:41 <hashar> pointed common/php from 'php-1.20wmf6' to 'php-master' [releng]
09:25 <hashar> updated mediawiki-config on dbdump to latest version [releng]
08:55 <hashar> add applicationserver::homeless to jobrunner06 [releng]
08:16 <hashar> Squid updated to uses apache 32 and 33. Deleted Apaches 30 & 31 [releng]
08:01 <hashar> Despooling apaches 30 and 31, spooling apaches 32 and 33 [releng]
2012-07-10 §
19:22 <hashar> rebooting apache32 and apache33 (puppet run finished) [releng]
19:02 <hashar> running puppets -tv on apache32 and apache33. Should make them able to serve Apache traffic after reboot. [releng]
17:32 <hashar> creating apache32 and apache33 to replace the corrupted apache30 and apache31 instances [releng]
2012-07-05 §
12:15 <hashar> Did some documentation work on [[Deployment/Overview]] [releng]
11:20 <hashar> added a bunch of spamers in /home/wikipedia/common/wmf-config/mwblocker.log which would block them [releng]
2012-07-03 §
19:43 <hashar> {{bug|38118}} fixed http://deployment.wikimedia.beta.wmflabs.org/ (was missing the docroot, submitted to gerrit https://gerrit.wikimedia.org/r/14099 [releng]
19:15 <hashar> touched wmf-config/mwblocker.log [releng]
19:05 <hashar> no machine send their syslog anywhere, some change got lost during the merge. See https://gerrit.wikimedia.org/r/14090 [releng]
18:44 <hashar> Successfully deleted instance deployment-deb, but failed to remove deployment-deb DNS entry. ohno [releng]
09:56 <hashar> Asked reboot for deployment-transcoding through labsconsole [releng]
2012-07-02 §
20:50 <hashar> restarting squid to purge whole cache (yeah I know that is lame) [releng]
20:47 <hashar> Removed Hydriz from deployment-prep. Messed up the whole dblist files :-D Contact me! ;) [releng]
20:46 <hashar> set back robots.txt to disallow / [releng]
20:28 <hashar> deployed a hack in mw config using https://gerrit.wikimedia.org/r/#/c/13932/ . That is a simply git fetch, pending review. [releng]
19:47 <hashar> hacking to get files on bits.beta [releng]
10:19 <hashar> Easy fix for the leap second bug: /etc/init.d/ntp stop; date `date +"%m%d%H%M%C%y.%S"`; /etc/init.d/ntp start [releng]
10:06 <Hydriz> ukwiki was giving errors regarding flaggedrevs's flaggedpages table not existing. Fixed it by running mwscript update.php ukwiki. [releng]
07:50 <hashar> Gave access to the cluster to Hydriz [releng]
2012-07-01 §
17:43 <hashar> manually rebooted most servers [releng]
10:00 <hashar> rebooted apache31 due to leap second bug. Stopped mysql on apache30 which was using 100%CPU [releng]
06:59 <hashar> rebooting all boxes [releng]
2012-06-29 §
15:07 <hashar> Removing thumbnails that not have been access for the last 15 days : sudo find . -atime +15 -wholename '*/thumb/*' -exec rm {} \\; [releng]
15:02 <hashar> deleted .nfs** files in /mnt/export/upload6/ [releng]
08:58 <hashar> restarted jobrunner service (had a wrong path pointing to common-backup) [releng]
2012-06-28 §
16:07 <hashar> apache conf uses site.conf :-(((( need to puppetize that one day [releng]