[02:17] <TimR> is anybody here?
[02:19] <RoyK> somewhat
[04:41] <TimR> can anybody tell me how I can make a user go into home/user/public_html when using sftp? Also how can I make sure that user can only see his directory?
[04:42] <failover> TimR, set his home to /home/user/public_html
[04:43] <TimR> well see im using webmin to control everything
[04:44] <failover> dunno webmin, but it should have a way to customize user homedir !
[04:47] <failover> TimR,  http://library.linode.com/security/sftp-jails
[04:48] <TimR> well see only group setup I have is users
[04:48] <TimR> can i change that from filetransfers to users?
[05:22] <hdale85> For some reason my server is loading extremely slow. Swapped out some ram and the CPU and even grub sits there for a while before it starts booting.
[05:28] <hdale85> It does eventually boot though, and for some reason its still not mounting my array......
[05:35] <harold_> oh well still working for now at least lol
[05:38] <harold_> just annoying that I have to go manually mount that drive everytime I reboot
[06:49] <rained23> HI I have problems with my apache, I installed it using tasksel for lamp-server . It seems searching a non existent .htaccess
[06:49] <rained23> (13)Permission denied: /home/user/belajar/.htaccess pcfg_openfile: unable to check htaccess file, ensure it is readable
[07:56] <awanti> i need u r help to setup local repository in our office. We are recently migrated to Ubuntu 10.04. Currently every pc is updating from internet. (we are having 10 pc's in our office)
[08:39] <bennym> I want my Ubu Server 10.4.03 machine to act as a router/firewall between the internet on eth2 and the switch (and attatched machines) on eth1. What do I need to look up?
[10:16] <ElizabethKelley1> Hey im trying to join ##Security on Xchat on windows but it does not add it to my chennel list does any one know why that might be?
[10:45] <neotyk> Good morning Everyone!
[10:47] <neotyk> is it possible to install JDK in EC2 while running from Natty image?
[10:48] <neotyk> my instance hangs when I try to do so
[10:48] <neotyk> both natty and Oneiric
[10:48] <neotyk> please advice
[11:06] <CrazyGir> hello! I have a server randomly rebooting on me, and while I am looking into what is going on, I noticed I have a 'kworker' process eating up quite a lot of resource. how can I find out what this process is doing, and why it is running so much on an otherwise idle server?
[11:06] <CrazyGir> eg:  183 root      20   0     0    0    0 S   22  0.0 184:07.69 kworker/6:1
[11:06] <CrazyGir> 27003 root      20   0     0    0    0 D    3  0.0   1:15.80 kworker/u:2
[11:25] <CrazyGir> is drdb capable of rebooting a server when it should not, if it is misconfigured?
[12:23] <jMCg> CrazyGir: maybe that's a feature of the cluster to stabelize the system when it's unclear who's the master and who's the slave.
[12:24] <jMCg> (n.b.: I'm pulling this out of my ass from peripheral experience with Oracle and Sun clusters, I've never worked with drdb)
[13:18] <CrazyGir> yea, I think you might be right
[13:18] <CrazyGir> any thoughts on the first question RE kworker
[13:55] <SockPants> Hi all
[13:55] <SockPants> quick question: i'm wiping drives real quick, so i'm using dd if=/dev/random of=/dev/xxx. does this command end when it reaches the end of the drive, or does it continue forever?
[14:01] <User488> hello
[14:02] <User488> can anyone help me with a bind problem?
[14:02] <RoyK> !ask
[14:02] <User488> ok thanks
[14:04] <User488> when I do nslookup ubuntu.com the query reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (my server name)
[14:13] <ljaclark> When I do nslookup ubuntu.com my bind server reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (server name ) instead of the ip address
[14:17] <patdk-lap> ljaclark, do you know what nslookup does?
[14:17] <patdk-lap> it converts name to ip address
[14:21] <ljaclark> yes. I have asked the question because I have to setup bind for a uni project. The lecturer wants me to have the DNS server show the server name instaed of the ip address. in the first line of the nslookup command
[14:22] <ljaclark> root@group2:/etc/bind# nslookup www.howtoforge.org
[14:22] <ljaclark> Server:         10.61.3.245
[14:22] <ljaclark> Address:        10.61.3.245#53
[14:22] <ljaclark> Non-authoritative answer:
[14:22] <ljaclark> Name:   www.howtoforge.org
[14:22] <ljaclark> Address: 188.40.16.205
[14:25] <onre> ljaclark, your server does not have proper reverse DNS entry for itself and that's why you see ip address instead of server name.
[14:30] <ljaclark> Thank you do you know of a guide that can help me as I used the one on the ubuntu forum to setup bind?
[14:40] <RoyK> any idea how I can check which PCI Express version my mobo supports?
[14:45] <patdk-lap> get the model number from lshw and check it on their website?
[14:46] <RoyK> patdk-lap: couldn't find anything there - http://www.asrock.com/mb/overview.asp?Model=M3A%20UCC&cat=Specifications
[14:46] <RoyK> just says PCI Ex
[14:47] <patdk-lap> AMD 480X
[14:49] <patdk-lap> pcie 1.1
[14:49] <RoyK> thanks
[14:49] <patdk-lap> annoying when they dont say
[14:49] <patdk-lap> then you have to check the northbridge chipset against it's manual :)
[16:47] <thesheff17> anyone know why I get Hash sum mismatch on a local apt-mirror?
[16:49] <qman__> probably a misconfigured proxy
[16:49] <qman__> or a problem with that local mirror
[16:50] <thesheff17> qman__, yea I see a forum post about a wrong security mirror
[16:51] <thesheff17> ah I know....I had to restore the box...and prob had a different mirror.list
[16:57] <i3luefire> last night i spent 5 hours trying to install ubuntu-server 11.10 and ended up failing
[16:58] <i3luefire> right now i am at the installing base system phase on a new start today
[16:59] <thesheff17> what was the issue you ran into?
[16:59] <i3luefire> it failed at the software selection step every time and also was unable to install grub
[17:00] <i3luefire> i have pdfs of all the log files
[17:01] <i3luefire> i wish they were txt files but i had to pull them up on my phone
[17:01] <i3luefire> so the only way to save them was pdf
[17:07] <qman__> for the software selection bit
[17:07] <qman__> try installing without a network connection
[17:07] <qman__> sometimes that messes things up
[17:07] <qman__> for grub, what is your hard drive configuration?
[17:09] <i3luefire> i was using 1gb ext4 for /boot , 20gb btrfs / , and 3.7tb lvm ext4 /home
[17:10] <qman__> 3.7tb? what's the physical setup? mdadm, hardware, or fakeraid
[17:10] <qman__> btrfs could be a problem too, I don't know enough about it
[17:11] <i3luefire> 1tb sdb1 + 3tb sda1 + 125gb sdc2
[17:12] <i3luefire> with lvm
[17:12] <qman__> that's really complex, and probably the reason grub isn't working
[17:12] <qman__> it has to be able to determine where the system boots to, and install there
[17:13] <i3luefire> grub should only care about the /boot partition right?
[17:13] <qman__> no
[17:13] <qman__> grub cares about all of your hard drives and partitions
[17:13] <qman__> it has to determine which drive the bios boots, then install the boot record there
[17:13] <qman__> and then point to /boot from it
[17:14] <i3luefire> hmm
[17:14] <i3luefire> http://www.filedropper.com/logs_5
[17:17] <RoyK> i3luefire: using a pastebin is a bit easier :P
[17:17] <RoyK> !pastebin
[17:18] <i3luefire> RoyK: those pdfs were made last night when i was in ambien land and i thought the only way to get the log files was on my phone
[17:19] <i3luefire> but thanks
[17:19] <qman__> in any case
[17:19] <qman__> while grub supports /boot on lvm, I don't do it, because it's still far from perfect
[17:19] <qman__> I also disconnect any drives that are not used during the install, and try to make things as simple as is possible for my application
[17:19] <i3luefire> the boot is not lvm
[17:20] <i3luefire> the boot is a regular partition
[17:20] <i3luefire> 1gb
[17:20] <thesheff17> 1gb for boot?
[17:20] <qman__> and I don't know about btrfs and lvm
[17:20] <i3luefire> 1gb for boot
[17:20] <thesheff17> try smaller
[17:20] <qman__> better too big than too small
[17:20] <qman__> no
[17:21] <qman__> ubuntu is not intelligent about kernel updates and simply doesn't remove old kernels
[17:21] <qman__> and if /boot fills up you run into problems installing software
[17:21] <qman__> I usually do 512MB, but 1GB is fine
[17:21] <thesheff17> qman__, same...
[17:23] <i3luefire> it looks like from the logs that grub-pc failed to install or something
[17:24] <thesheff17> I would try ext4 for this partition and see if it works 20gb btrfs /
[17:24] <i3luefire> who would have thought that a version of bsd (freeNAS) would be easier to install than a version of linux (ubuntu)
[17:25] <i3luefire> i did ext3 on boot this time and ext4 for root
[17:25] <thesheff17> same problem?
[17:25] <i3luefire> boot and root and swap are all simple partitions too
[17:25] <i3luefire> it is now installing base again
[17:26] <i3luefire> and the network cable is unplugged
[17:26] <qman__> well, ubuntu is on the so-called 'bleeding edge'
[17:26] <i3luefire> lol
[17:26] <qman__> pushes new software in spite of the problems
[17:26] <i3luefire> i guess
[17:27] <qman__> if you want a stable, always easy experience, go with LTS releases or something even more stagnant
[17:27] <thesheff17> yea I only use LTS for prod
[17:27] <qman__> and wait until .1
[17:29] <i3luefire> well my wonderful friend who suggested i use ubuntu server for the easy pkg management of it decided to abandon me during the install last night and he is the one who suggested the 11.10
[17:29] <qman__> unless you need some of the new features, I'd use 10.04
[17:30] <thesheff17> i3luefire, what qman__ said :)
[17:30] <qman__> all my servers are 10.04, except the one still on 8.04
[17:30] <i3luefire> should i tell it to install security updates automaticlly
[17:30] <thesheff17> I don't
[17:30] <qman__> I do
[17:30] <qman__> personal preference
[17:30] <i3luefire> this is a home server that will be on the net at all times
[17:30] <i3luefire> ok
[17:30] <i3luefire> i am enabling it then
[17:31] <i3luefire> i have made it passed the places where it failed last night
[17:32] <RoyK> http://i.imgur.com/thEKg.jpg
[17:32] <i3luefire> but i changed too many variables so im going back to the start with the fs choice as they were last night and the network unplugged
[17:33] <qman__> the deal with the network is, it tries to update during the install on the fly, so you don't have to later
[17:33] <qman__> but sometimes that messes up, and then apt is broken
[17:33] <qman__> and it can't properly install
[17:34] <i3luefire> that may have been the entire problem
[17:34] <i3luefire> judging by the log files
[17:35] <i3luefire> we shall see
[17:39] <i3luefire> my friend says "rtfm" so i say to him "there isnt a manual on 11.10 server yet and you are the one who suggested it so you are the fu**ing manual"
[17:40] <qman__> heh
[17:40] <qman__> https://help.ubuntu.com/11.10/serverguide/C/  FYI, but yeah
[17:40] <thesheff17> i3luefire, https://help.ubuntu.com/11.10/serverguide/C/index.html
[17:40] <thesheff17> hah
[17:40] <qman__> it's still early, it's probably not complete
[17:41] <thesheff17> RoyK, wtf is that cable?
[17:41] <i3luefire> i blame google for my lack of knowledge. lol
[17:41] <qman__> when we switched to upstart the server guide still had tons of incorrect references to /etc/init.d
[17:41] <qman__> thesheff17, it's a euro AC outlet to cat5
[17:41] <thesheff17> haha...that is what I thought....
[17:42] <thesheff17> does that even work?
[17:42] <qman__> it blows up whatever's on the cat5 end
[17:42] <thesheff17> lol
[17:42] <qman__> not how you do power over ethernet
[17:42] <i3luefire> thanks for the manual link tho guys
[17:44] <RoyK> :)
[17:44] <RoyK> 230VoE
[17:47] <air_> RoyK: yay, ethernet killer. :)
[17:48] <i3luefire> fail
[17:48] <i3luefire> ok. so it must be the partition setup then
[17:48] <thesheff17> can you purchase that? I would love to send that to some old bosses.
[17:48] <air_> "here's some extra power for your network"
[17:48] <thesheff17> I would need 110VoE
[17:49] <air_> would this do? http://pixdaus.com/pics/HfxKm41AwpIFQRbFXK.jpg
[17:50] <thesheff17> yes
[17:50] <thesheff17> i3luefire, I was just reading about btrfs and there is a conversion tool from ext3/4 to btrfs may break your system though
[17:52] <i3luefire> should i leave the boot at ext3 too?
[17:52] <i3luefire> instead of ext4
[17:54] <qman__> shouldn't matter
[17:54] <qman__> I've done both
[17:54] <qman__> I'm almost positive it's the btrfs /, or the LVM that grub is choking on
[17:55] <i3luefire> well its not the lvm because i left that the same
[17:56] <qman__> btrfs is definitely still unstable, experimental software
[17:56] <RoyK> i3luefire: I usually use ext2 on /boot
[17:56] <RoyK> no need for a journal there
[17:56] <i3luefire> hmm
[17:56] <RoyK> some distros even mount /boot ro by default
[17:57] <qman__> it would make sense now with grub2, since you don't manually edit anything there anymore
[17:57] <i3luefire> well i put it on ext3 bc that is what worked earlier and i had it selected already
[17:57] <qman__> remount rw and remount ro could be scripted into update-grub
[17:57] <RoyK> IIRC I saw that on SuSE some 5+ years ago, and by then it was a PITA
[17:58] <qman__> back with gentoo 2004, the guide said to simply not mount /boot by default
[17:58] <i3luefire> grub2 is supposed to support btrfs too
[17:58] <i3luefire> even on the /boot
[17:59] <i3luefire> but it cant even do it on the root aparently
[17:59] <RoyK> i3luefire: but btrfs is still missing fsck :P
[17:59] <i3luefire> tru
[17:59] <RoyK> something that's been 'in the works' for >2 years
[17:59] <qman__> well, being able to boot btrfs, and being able to figure out and set it up in the installer are two different things
[17:59] <lenios> you don't really need fsck though
[18:00] <RoyK> lenios: when the shit hits the fan, you do
[18:00] <i3luefire> qman__: tru
[18:01] <qman__> ubuntu jumped on ext4 by default a bit early too
[18:01] <qman__> a couple data mangling bugs popped up post release
[18:02] <qman__> new filesystems are just inherently risky
[18:02] <RoyK> qman__: ubuntu should be a bit more conservative imho
[18:02] <i3luefire> but they are so cool tho. lol if they worked... and i guess they do if you know enough about them
[18:03] <qman__> well, it's two goals of ubuntu at odds
[18:03] <thesheff17> I do have some prod servers with ReiserFS
[18:03] <qman__> making it easy for everyone, and providing the latest and greatest
[18:04] <i3luefire> those 2 goals are at odds for sure
[18:04] <i3luefire> good thing im not trying zfs or something
[18:04] <i3luefire> it chomps thru the ram like crazy from my experience with freeNAS
[18:05] <qman__> I agree that they're just a little too ambitious
[18:05] <qman__> too many show stopping bugs are in release
[18:06] <i3luefire> yep the release defaults should work 95% of the time not 60% of the time
[18:06] <qman__> that's why I stick to LTS and wait for .1 when it's important
[18:06] <i3luefire> thats why i dont like fedora
[18:07] <i3luefire> by default it fails on my desktop hardware. ati opensourse drivers are not set up right or something
[18:08] <qman__> desktops are different, though
[18:08] <qman__> new features are more important than in servers
[18:08] <i3luefire> my desktop has ati onboard graphics.(no card)
[18:08] <i3luefire> and hdmi output
[18:09] <qman__> so does mine, still dealing with a number of bugs
[18:09] <qman__> OS drivers have graphical glitches and sometimes hard lock the system, proprietary don't work at all
[18:10] <i3luefire> isntalling grub failed again at a different step
[18:11] <i3luefire> but i recovered it
[18:11] <i3luefire> it just needed me to tell it which drives mbr was available
[18:11] <qman__> yeah, that's been a problem since forever
[18:12] <qman__> even with grub1, as long as I can remember
[18:12] <qman__> once you get more than a couple disks and throw some LVM or raid in, it gets confused
[18:12] <i3luefire> ok looks like it is booting
[18:13] <i3luefire> cool
[18:13] <thesheff17> yea I'm trying 512MB /boot/, 1GB swap, 7GB btrfs /
[18:13] <thesheff17> w/ ubuntu 11.10
[18:13] <i3luefire> server login prompt
[18:15] <i3luefire> thanks everyone
[18:17] <lenios> do you really need 1GB swap?
[18:17] <thesheff17> prob not
[18:17] <i3luefire> the only features i want from btrfs are cow and lzma compression
[18:17] <thesheff17> I try never to use swap
[18:17] <lenios> i usually use not more than 128M
[18:17] <thesheff17> it is just a virtual machine
[18:18] <thesheff17> yea old habbits of 2*ram size
[18:18] <i3luefire> i have a 6gb swap for my 4gb ram machine
[18:18] <qman__> my desktops generally have no swap
[18:18] <qman__> servers have a little just because
[18:18] <qman__> but it's really not needed if you put in enough RAM
[18:19] <qman__> instead of caching my RAM on disk, I cache my disk in RAM
[18:22] <i3luefire> i still dont understand why most oses dont let you load the entire os files to ram on systems with 8-16gb ram
[18:22] <thesheff17> is there an easy way I can get a script to just run once the first time the virtual machine boots?
[18:22] <qman__>  /etc/rc.local
[18:22] <i3luefire> make the script disable itself as the last step
[18:22] <qman__> yep
[18:23] <i3luefire> i have no idea how to do that tho
[18:23] <i3luefire> lol
[18:23] <thesheff17> cool
[18:23] <thesheff17> very easy with python
[18:24] <qman__> make a script, add it to rc.local, make the script edit rc.local at the end
[18:24] <qman__> then you don't run into self-manipulation issues
[18:24] <i3luefire> qman__: yeah
[18:24] <i3luefire> that sounds like a good solution
[18:24] <thesheff17> says in cat /etc/rc.local that I can just do chmod +x chmod -x and it will start/stop
[18:24] <thesheff17> not cat...
[18:25] <i3luefire> man
[18:27] <i3luefire> no its time to setup transmission, sab, upnp...
[18:27] <i3luefire> *now its time
[18:28] <pukeko> howdy al, i am wanting to migrate the OS (Lucid) of a physical file-server with soft-raid /dev/md0 /dev/md1 etc to a VM on another box -- i was thinking about using Clonezilla but from memory last time i tried to clone partitions of a soft raid i ran into problems ... any advice ?
[18:29] <qman__> instead of cloning partitions, just copy files
[18:29] <qman__> then edit fstab and install grub
[18:33] <qman__> linux is reasonably hardware-agnostic like that
[18:33] <qman__> as long as it can use all the hardware, and knows where its kernel and partitions are, it's good
[18:35] <qman__> probably want to rm /etc/udev/rules.d/70-persistent-net while you're at it
[18:54] <pukeko> qman__: ...thanks.. so  i would need to remove all the mdadm.conf stuff as well change the UUID's in fstab etc ?
[18:54] <RoyK> qman__: IIRC I had an issue with grub last time I tried to duplicate a setup
[18:55] <RoyK> pukeko: yes, and the UUID(s) in the grub setup
[18:55] <RoyK> pukeko: mdadm.conf can be generated quite easily
[18:56] <RoyK> pukeko: mdadm --detail --scan
[18:56] <pukeko> Royk: i'm going from soft raid to a VM on a hard-raid
[18:56] <RoyK> ok, no need for mdadm, then ...
[19:15] <thesheff17> yea my ubuntu 11.10 using a root file system of btrfs failed
[19:19] <RoyK> thesheff17: did anyone tell you btrfs is experimental?
[19:19] <thesheff17> yea I was just testing to see if it failed
[19:21] <RoyK> worked for me last time I tested it...
[19:21] <RoyK> but then, its tools make it rather crappy when being used to zfs :P
[19:22] <guntbert> RoyK: did you succeed with raid6->raid5 ?
[19:23] <thesheff17> yea I tested it on a virtual machine...it was complaining about unmet dependencies with the linux 3.0 kernel
[19:25] <RoyK> guntbert: it was just a question - I haven't made the move to raid6 yet
[19:25] <guntbert> RoyK: I see - just curious myself :)
[19:25] <RoyK> :)
[19:27] <RoyK> btw, anyone that knows if it's possible to upgrade the metadata version after creating an md device?
[19:28] <RoyK> I have v0.9, being the default, on my home sever, and I see now it doesn't support >2TB drives
[19:32] <patdk-lap> don't think so, to some extent
[19:32] <patdk-lap> I think the metadata locations changed too much between some versions
[19:50] <RoyK> patdk-lap: they have, according to the manual, but still, having to recreate your average 10TB md device to use 3TB drives seems a waste
[19:51] <RoyK> patdk-lap: and with linux md being one of the more flexible raid solutions out there, adding metadata upgrades would be another fine thing...
[19:59] <qman__> just be aware that raid 6 is _really_ slow
[19:59] <qman__> was saturating gigabit with raid 5, struggling to do 35MB/s with raid 6, and I have pretty good hardware
[20:01] <RoyK> wtf?
[20:01] <RoyK> how's the CPU load?
[20:03] <RoyK> qman__: there's usually a bottleneck somewhere - either that or latency somewhere
[20:04] <patdk-lap> qman, what cpu?
[20:12] <jeeves_moss> how would I go about writing a script to move files one by one from one partition to a temp drive, then back to another directory while preserving the structure, etc?
[20:14] <RoyK> jeeves_moss: can't you just rsync the bunch?
[20:15] <jeeves_moss> RoyK,  the "issue" is that I only have a 160Gb "temp" drive. I forgot to turn dedup on when I set up my ZFS drives, so I have to physically move the data off the cluster, then back again.  So, I can't just copy everything to another drive, and back.  The only way I can take advantage of the dedup is to move the data off of the cluster drives, then back
[20:16] <RoyK> jeeves_moss: thank gods you didn't turn on dedup on ZFS
[20:16] <RoyK> it's NOT stable
[20:16] <jeeves_moss> ??
[20:17] <RoyK> jeeves_moss: I even have a dedicated test machine with some 10TB storage, some SSDs for caching etc, and zfs dedup sucks rather badly
[20:17] <jeeves_moss> it is on now.  I wanted to run dedup on the data on there right now.  hence the request for ideas!
[20:17] <RoyK> jeeves_moss: see the mailing lists for more ino
[20:17] <RoyK> jeeves_moss: see the mailing lists for more info
[20:17] <jeeves_moss> ahhhh.  I know it's a new FS, so, I'm testing it on a RAIDZ2 pool.
[20:18] <RoyK> jeeves_moss: how much memory/l2arc do you have on the machine?
[20:18] <RoyK> jeeves_moss: and what is the pool size?
[20:20] <jeeves_moss> RoyK, it's got a gb of RAM (this was a temp soulition untill I get my external deticated NAS box), and the pool is 4.8Tb
[20:20] <RoyK> jeeves_moss: then DO NOT USE DEDUP
[20:20] <RoyK> jeeves_moss: beleive me on this
[20:21] <jeeves_moss> RoyK, is it just not the best preformance, or does it eat your data?
[20:21] <RoyK> jeeves_moss: if you have 2GB RAM per terabyte stored and mostly 128kB records, it might work somewhat ok
[20:21] <RoyK> jeeves_moss: it'll be dead slow and removing a deduped dataset may take hours or even days
[20:22] <jeeves_moss> RoyK, the "plan" is to build this into a 2U box with 8 2.6Ghz cores, and 32Gb of RAM, then exapnd out to ~32Tb of storage
[20:22] <jeeves_moss> RoyK, lol, I don't care if it takes days.  it's taken almost a month to move all the data off of other boxes!
[20:22] <RoyK> I had a server with dedup at a point and removing a dataset took three days, and during that time, it wasn't available for other use
[20:23] <RoyK> jeeves_moss: no, it's like it blocks other services
[20:23] <jeeves_moss> RoyK, how did you dedup the data though?
[20:24] <jeeves_moss> RoyK, I just enabled it, so I was thinking of moving files one by one off to a temp drive, then back again
[20:24] <RoyK> jeeves_moss: beleive me - I've done a LOT of testing of dedup, I've read other tests done by people in the opensolaris/openindiana society, and it's not stable, not for production, hardly for testing
[20:25] <jeeves_moss> lol, fun!
[20:25] <RoyK> jeeves_moss: beleive me on this - I've spent a long time on this, and ended up buying more drives instead
[20:26] <patdk-lap> heh, nothing I have ever done could benifit from dedup
[20:26] <patdk-lap> except work samba shares for their documents
[20:26] <patdk-lap> but that is small enough it doesn't matter
[20:26] <jeeves_moss> ahhh, well, the end "goal" of this unit is to be the SAN for a VMWare setup to host a lot of on-line video
[20:28] <patdk-lap> heh?
[20:28] <patdk-lap> san ofr vmware or for videos?
[20:28] <jeeves_moss> patdk-lap, if I could "dedup" my wife's bitching, I'd benifit!
[20:28] <patdk-lap> seem two different things
[20:28] <jeeves_moss> patdk-lap, it's house both
[20:28] <patdk-lap> heh
[20:28] <patdk-lap> I would do something like I am then
[20:29] <RoyK> jeeves_moss: just forget about dedup on zfs for now
[20:29] <patdk-lap> run iscsi/fc/srp/... for vmware using enough space as you need for the vm's
[20:29] <patdk-lap> and just nfs share the videos
[20:29] <RoyK> jeeves_moss: or use it if you want to be a crash test dummy of sorts
[20:29] <patdk-lap> could even do vm's on nfs too, makes is easier to backup and stuff, but alittle more annoying otherwise
[20:30] <jeeves_moss> patdk-lap, NFS was the plan for the videos.  Haven't decided on the proper way to do the iSCSI
[20:30] <patdk-lap> how many esx servers?
[20:30] <patdk-lap> and do you want failover HA?
[20:30] <RoyK> jeeves_moss: you're not doing zfs fuse on this?
[20:31] <jeeves_moss> on the NAS box right now. I haven't decided for the production box.
[20:32] <RoyK> patdk-lap: do you know anything like failover for oi?
[20:32] <patdk-lap> royk, not really
[20:32] <patdk-lap> luckily I don't have to have extreemly fast failover, so manual is perferred
[20:33] <patdk-lap> but for those wanting seemless, clean, auto, nope, don't know anything
[20:35]  * RoyK just got a message from icinga about a drive failing its SMART tests, and then got another message from a scientist that everything on that server was dead slow - iostat -xdn showed 99% load on that drive alone ... zpool offline ...
[20:38] <patdk-lap> strange, my oi box is rejecting my ssh connections
[20:40] <RoyK> what did you do to the poor box?
[20:40] <patdk-lap> I disconnecting it's IB link :)
[20:40] <patdk-lap> everything is fine on it, except ssh
[20:41] <patdk-lap> iscsi, mysql, nfs, samba, all find
[20:41] <RoyK> why would ssh depend on ib?
[20:41] <patdk-lap> who said that?
[20:41] <patdk-lap> oyu asked what I did, I disconnected ib
[20:42] <patdk-lap> hmm, ssh service keeps going into mantance mode
[20:42] <RoyK> well, reboot the beast :P
[20:42] <patdk-lap> guess I'm going have to get a screen/keyboard on it, and check logs
[20:46] <patdk-lap> fixed ssh
[20:49] <RoyK> patdk-lap: what was it?
[20:49] <patdk-lap> bad sshd_config value
[20:50] <RoyK> lol
[20:50] <RoyK> so not really related  to IB?
[20:50] <patdk-lap> na
[20:52]  * RoyK can only conclude that a backup of 1,5TB over WAN takes its time even with a 60Mbps link
[20:54] <patdk-lap> yep
[20:54] <patdk-lap> my friend attempted a 4tb backup over wan, on a 10mbit link
[20:54] <patdk-lap> he gave up after 3 days
[20:55] <air_> :)
[20:55] <patdk-lap> some things, sneakernet is still excellent at, or pidgonnet
[20:57] <RoyK> patdk-lap: it's only been running for a day or so, and after I offlined that deadish drive, it's running rather quickly
[21:02] <air_> what's the recommended filesystem to run on ubuntu these days? ext4 is still teh shit and btrfs is not really ready? or?
[21:02] <air_> I suppose zfs + ubuntu might not be the way to go either. (I'm considering what to use for file storage, software raid)
[21:03] <air_> today I got 3 drives in software raid-5 running ext4.
[21:04] <air_> it's only my home server, but I'd prefer not to loose my wedding photos, etc, so at least some parts of the storage should be "safe".
[21:04] <air_> for now I handle that by rsyncing the important parts to an usb drive every now and then. to give me at least some extra security.
[21:06] <patdk-lap> is there any other way to be secure?
[21:07] <patdk-lap> all it takes is one lightening strike, and all your disks are dead
[21:07] <air_> well. yeah, youre right.
[21:08] <air_> so I should look into remote syncing my wedding photos somewhere else.
[21:08] <air_> or use two different usb drives and have one of them offline at all times.
[21:34] <air_> so, any comments on zfs or btrfs? know issues with running any of them on ubuntu?
[21:37] <stlsaint> air_: i run it fine (btrfs)
[21:37] <stlsaint> air_: but thats on my laptop
[21:44] <qman__> RoyK, Patrickdk, phenom II x4 CPU ~3.2GHz, CPU load is all iowait, have a PCIe x8 card known to be able to saturate all 8 channels, two on a PCI controller I was using before, and two on the onboard
[21:46] <RoyK> air_: zfs fuse is a no go performance-wise, btrfs is a no go safety-wise, ext4 works well, and with regular scrubbing of the md device, it should be safe enough
[21:47] <RoyK> qman__: then md must be doing some rather heavy amounts of random i/o
[21:48] <patdk-lap> qman, odd, you shouldn't have any issues with that
[21:48] <patdk-lap> unless your doing random writes, and made a large block size
[21:48] <RoyK> patdk-lap: with md-based raid6?
[21:48] <patdk-lap> yep
[21:48] <patdk-lap> he should be able to substain >4GB/sec with his cpu
[21:49] <qman__> wonder if my filesystem is fragmented
[21:49] <qman__> using ext3
[21:49] <RoyK> patdk-lap: you'll need a rather large amount of drives for that...
[21:49] <qman__> and it was >90% before I added the last four disks
[21:49] <air_> RoyK: thanks. and in this case, what does regular scrubbing mean? :)
[21:49] <patdk-lap> royk, therefor raid6 hsouldn't be his issue :)
[21:49] <qman__> but even before that it was not that great
[21:49] <patdk-lap> oh, ext* with >85% is slow as hell
[21:50] <RoyK> air_: echo check >> /sys/block/mdX/md/sync_action
[21:50] <patdk-lap> it takes longer and longer for it to locate a free block
[21:50] <patdk-lap> I have had ext3 wait several minutes to locate a free block before, when I was at 99%
[21:50] <qman__> it's 57% now
[21:50] <RoyK> patdk-lap: heh - ever tried zfs with 95% full VDEVs?
[21:50] <patdk-lap> royk, nope, only been to 76% so far :)
[21:51] <RoyK> at > 90% full VDEVs, ZFS is dead slow
[21:51] <qman__> when I have some spare cash I'll get more disks and redo it, but until then I can't touch it because I don't have anywhere to back up all my data
[21:51] <patdk-lap> but if you used a 256k stripe size, raid6 would have to read that 256k from each drive, then write out atleast 3 drives
[21:51] <patdk-lap> if you only write 4k :(
[21:52] <qman__> 64k chunk
[21:52] <patdk-lap> that shouldn't be too bad
[21:52] <RoyK> qman__: what sort of i/o pattern?
[21:52] <qman__> well, mostly large files just being placed
[21:53] <qman__> but I also run torrentflux, so when that's downloading I'd understand
[21:53] <qman__> but when it's just seeding it doesn't make much sense
[21:53] <qman__> or not running at all
[21:54] <RoyK> seeding torrents means large number of random i/o
[21:55] <patdk-lap> ya, not as bad as downloading, but still lots of random reads
[22:01]  * RoyK wonders when linux will get something like l2arc
[22:03] <patdk-lap> thought it did
[22:03] <patdk-lap> flashcache
[22:03] <patdk-lap> works for both l2arc and zil
[22:06] <RoyK> all google can tell me about flashcache is something mysql centric
[22:06] <patdk-lap> well, it was originally designed to maky facebook mysql faster
[22:06] <qman__> future plans have the torrents staged on a separate file system, probably a single disk, to alleviate that problem
[22:07] <patdk-lap> qman, I did that
[22:07] <patdk-lap> that drive couldn't substain >4MB/sec transfers cause of that
[22:07] <qman__> maybe a raid 0 then
[22:08] <qman__> but either way, get them off the main data storage to speed it up
[22:08] <RoyK> qman__: or a nice set of striped mirrors on zfs :P
[22:08] <qman__> I also want something with checksums, I've had video files get some corruption a number of times
[22:08] <qman__> disks are so unreliable these days
[22:09] <patdk-lap> heh, checksums don't help unreliable disks
[22:09] <patdk-lap> they can only say, you have an issue
[22:09] <RoyK> patdk-lap: it helps you detect the problem and with sufficient redundancy, to fix it
[22:09] <patdk-lap> and disks are suppost to have ecc data, rs code
[22:09] <qman__> I mean in the filesystem, to detect when a file gets written wrong
[22:09] <patdk-lap> but seems mostly useless
[22:10] <RoyK> patdk-lap: they have ECC all the way, but with the amount of data available today, those ECC algorithms, or sizes, aren't good enough
[22:11] <patdk-lap> https://wiki.archlinux.org/index.php/Flashcache
[22:11] <patdk-lap> royk, well it more that
[22:11] <patdk-lap> when they went to 4k disks, they used a crapload less ecc data
[22:11] <patdk-lap> and also, those sectors are so small, the ecc data is also getting destroyed too
[22:11] <patdk-lap> the physical size of the sector on disk
[22:12] <RoyK> thus, use a filesystem with checksumming :P
[22:12]  * patdk-lap would gladdly replace checksumming with ecc data :)
[22:13] <patdk-lap> hmm, normal 512bytes sector has 40bytes ecc
[22:14] <patdk-lap> a 4k sector has 100bytes
[22:15] <patdk-lap> wish I had the 4k sector with full 320bytes ecc
[22:15] <patdk-lap> but guess they said, it wasn't needed
[22:15] <RoyK> seems flashcache isn't in oneiric
[22:16] <patdk-lap> nope
[22:16] <RoyK> perhaps in debian sid :P
[22:16] <RoyK> but sid is the kid that tend to break toys....