/srv/irclogs.ubuntu.com/2011/10/30/#ubuntu-server.txt

TimRis anybody here?02:17
RoyKsomewhat02:19
=== RudyValencia- is now known as RudyValencia
TimRcan anybody tell me how I can make a user go into home/user/public_html when using sftp? Also how can I make sure that user can only see his directory?04:41
failoverTimR, set his home to /home/user/public_html04:42
TimRwell see im using webmin to control everything04:43
failoverdunno webmin, but it should have a way to customize user homedir !04:44
failoverTimR,  http://library.linode.com/security/sftp-jails04:47
TimRwell see only group setup I have is users04:48
TimRcan i change that from filetransfers to users?04:48
hdale85For some reason my server is loading extremely slow. Swapped out some ram and the CPU and even grub sits there for a while before it starts booting.05:22
hdale85It does eventually boot though, and for some reason its still not mounting my array......05:28
=== iggi__ is now known as iggi_
harold_oh well still working for now at least lol05:35
harold_just annoying that I have to go manually mount that drive everytime I reboot05:38
rained23HI I have problems with my apache, I installed it using tasksel for lamp-server . It seems searching a non existent .htaccess06:49
rained23(13)Permission denied: /home/user/belajar/.htaccess pcfg_openfile: unable to check htaccess file, ensure it is readable06:49
=== Major_Tom is now known as Omega42
awantii need u r help to setup local repository in our office. We are recently migrated to Ubuntu 10.04. Currently every pc is updating from internet. (we are having 10 pc's in our office)07:56
bennymI want my Ubu Server 10.4.03 machine to act as a router/firewall between the internet on eth2 and the switch (and attatched machines) on eth1. What do I need to look up?08:39
=== bennym_ is now known as bennym
=== bennym is now known as bennymAFK
ElizabethKelley1Hey im trying to join ##Security on Xchat on windows but it does not add it to my chennel list does any one know why that might be?10:16
neotykGood morning Everyone!10:45
neotykis it possible to install JDK in EC2 while running from Natty image?10:47
neotykmy instance hangs when I try to do so10:48
neotykboth natty and Oneiric10:48
neotykplease advice10:48
CrazyGirhello! I have a server randomly rebooting on me, and while I am looking into what is going on, I noticed I have a 'kworker' process eating up quite a lot of resource. how can I find out what this process is doing, and why it is running so much on an otherwise idle server?11:06
CrazyGireg:  183 root      20   0     0    0    0 S   22  0.0 184:07.69 kworker/6:111:06
CrazyGir27003 root      20   0     0    0    0 D    3  0.0   1:15.80 kworker/u:211:06
CrazyGiris drdb capable of rebooting a server when it should not, if it is misconfigured?11:25
jMCgCrazyGir: maybe that's a feature of the cluster to stabelize the system when it's unclear who's the master and who's the slave.12:23
jMCg(n.b.: I'm pulling this out of my ass from peripheral experience with Oracle and Sun clusters, I've never worked with drdb)12:24
CrazyGiryea, I think you might be right13:18
CrazyGirany thoughts on the first question RE kworker13:18
SockPantsHi all13:55
SockPantsquick question: i'm wiping drives real quick, so i'm using dd if=/dev/random of=/dev/xxx. does this command end when it reaches the end of the drive, or does it continue forever?13:55
User488hello14:01
User488can anyone help me with a bind problem?14:02
RoyK!ask14:02
ubottuPlease don't ask to ask a question, simply ask the question (all on ONE line and in the channel, so that others can read and follow it easily). If anyone knows the answer they will most likely reply. :-) See also !patience14:02
User488ok thanks14:02
User488when I do nslookup ubuntu.com the query reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (my server name)14:04
ljaclarkWhen I do nslookup ubuntu.com my bind server reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (server name ) instead of the ip address14:13
patdk-lapljaclark, do you know what nslookup does?14:17
patdk-lapit converts name to ip address14:17
ljaclarkyes. I have asked the question because I have to setup bind for a uni project. The lecturer wants me to have the DNS server show the server name instaed of the ip address. in the first line of the nslookup command14:21
ljaclarkroot@group2:/etc/bind# nslookup www.howtoforge.org14:22
ljaclarkServer:         10.61.3.24514:22
ljaclarkAddress:        10.61.3.245#5314:22
ljaclarkNon-authoritative answer:14:22
ljaclarkName:   www.howtoforge.org14:22
ljaclarkAddress: 188.40.16.20514:22
onreljaclark, your server does not have proper reverse DNS entry for itself and that's why you see ip address instead of server name.14:25
ljaclarkThank you do you know of a guide that can help me as I used the one on the ubuntu forum to setup bind?14:30
RoyKany idea how I can check which PCI Express version my mobo supports?14:40
patdk-lapget the model number from lshw and check it on their website?14:45
RoyKpatdk-lap: couldn't find anything there - http://www.asrock.com/mb/overview.asp?Model=M3A%20UCC&cat=Specifications14:46
RoyKjust says PCI Ex14:46
patdk-lapAMD 480X14:47
patdk-lappcie 1.114:49
RoyKthanks14:49
patdk-lapannoying when they dont say14:49
patdk-lapthen you have to check the northbridge chipset against it's manual :)14:49
thesheff17anyone know why I get Hash sum mismatch on a local apt-mirror?16:47
qman__probably a misconfigured proxy16:49
qman__or a problem with that local mirror16:49
thesheff17qman__, yea I see a forum post about a wrong security mirror16:50
thesheff17ah I know....I had to restore the box...and prob had a different mirror.list16:51
i3luefirelast night i spent 5 hours trying to install ubuntu-server 11.10 and ended up failing16:57
i3luefireright now i am at the installing base system phase on a new start today16:58
thesheff17what was the issue you ran into?16:59
i3luefireit failed at the software selection step every time and also was unable to install grub16:59
i3luefirei have pdfs of all the log files17:00
i3luefirei wish they were txt files but i had to pull them up on my phone17:01
i3luefireso the only way to save them was pdf17:01
qman__for the software selection bit17:07
qman__try installing without a network connection17:07
qman__sometimes that messes things up17:07
qman__for grub, what is your hard drive configuration?17:07
i3luefirei was using 1gb ext4 for /boot , 20gb btrfs / , and 3.7tb lvm ext4 /home17:09
qman__3.7tb? what's the physical setup? mdadm, hardware, or fakeraid17:10
qman__btrfs could be a problem too, I don't know enough about it17:10
i3luefire1tb sdb1 + 3tb sda1 + 125gb sdc217:11
i3luefirewith lvm17:12
qman__that's really complex, and probably the reason grub isn't working17:12
qman__it has to be able to determine where the system boots to, and install there17:12
i3luefiregrub should only care about the /boot partition right?17:13
qman__no17:13
qman__grub cares about all of your hard drives and partitions17:13
qman__it has to determine which drive the bios boots, then install the boot record there17:13
qman__and then point to /boot from it17:13
i3luefirehmm17:14
i3luefirehttp://www.filedropper.com/logs_517:14
RoyKi3luefire: using a pastebin is a bit easier :P17:17
RoyK!pastebin17:17
ubottuFor posting multi-line texts into the channel, please use http://paste.ubuntu.com | To post !screenshots use http://imagebin.org/?page=add | !pastebinit to paste directly from command line | Make sure you give us the URL for your paste - see also the channel topic.17:17
i3luefireRoyK: those pdfs were made last night when i was in ambien land and i thought the only way to get the log files was on my phone17:18
i3luefirebut thanks17:19
qman__in any case17:19
qman__while grub supports /boot on lvm, I don't do it, because it's still far from perfect17:19
qman__I also disconnect any drives that are not used during the install, and try to make things as simple as is possible for my application17:19
i3luefirethe boot is not lvm17:19
i3luefirethe boot is a regular partition17:20
i3luefire1gb17:20
thesheff171gb for boot?17:20
qman__and I don't know about btrfs and lvm17:20
i3luefire1gb for boot17:20
thesheff17try smaller17:20
qman__better too big than too small17:20
qman__no17:20
qman__ubuntu is not intelligent about kernel updates and simply doesn't remove old kernels17:21
qman__and if /boot fills up you run into problems installing software17:21
qman__I usually do 512MB, but 1GB is fine17:21
thesheff17qman__, same...17:21
i3luefireit looks like from the logs that grub-pc failed to install or something17:23
thesheff17I would try ext4 for this partition and see if it works 20gb btrfs /17:24
i3luefirewho would have thought that a version of bsd (freeNAS) would be easier to install than a version of linux (ubuntu)17:24
i3luefirei did ext3 on boot this time and ext4 for root17:25
thesheff17same problem?17:25
i3luefireboot and root and swap are all simple partitions too17:25
i3luefireit is now installing base again17:25
i3luefireand the network cable is unplugged17:26
qman__well, ubuntu is on the so-called 'bleeding edge'17:26
i3luefirelol17:26
qman__pushes new software in spite of the problems17:26
i3luefirei guess17:26
qman__if you want a stable, always easy experience, go with LTS releases or something even more stagnant17:27
thesheff17yea I only use LTS for prod17:27
qman__and wait until .117:27
i3luefirewell my wonderful friend who suggested i use ubuntu server for the easy pkg management of it decided to abandon me during the install last night and he is the one who suggested the 11.1017:29
qman__unless you need some of the new features, I'd use 10.0417:29
thesheff17i3luefire, what qman__ said :)17:30
qman__all my servers are 10.04, except the one still on 8.0417:30
i3luefireshould i tell it to install security updates automaticlly17:30
thesheff17I don't17:30
qman__I do17:30
qman__personal preference17:30
i3luefirethis is a home server that will be on the net at all times17:30
i3luefireok17:30
i3luefirei am enabling it then17:30
i3luefirei have made it passed the places where it failed last night17:31
RoyKhttp://i.imgur.com/thEKg.jpg17:32
i3luefirebut i changed too many variables so im going back to the start with the fs choice as they were last night and the network unplugged17:32
qman__the deal with the network is, it tries to update during the install on the fly, so you don't have to later17:33
qman__but sometimes that messes up, and then apt is broken17:33
qman__and it can't properly install17:33
i3luefirethat may have been the entire problem17:34
i3luefirejudging by the log files17:34
i3luefirewe shall see17:35
i3luefiremy friend says "rtfm" so i say to him "there isnt a manual on 11.10 server yet and you are the one who suggested it so you are the fu**ing manual"17:39
qman__heh17:40
qman__https://help.ubuntu.com/11.10/serverguide/C/  FYI, but yeah17:40
thesheff17i3luefire, https://help.ubuntu.com/11.10/serverguide/C/index.html17:40
thesheff17hah17:40
qman__it's still early, it's probably not complete17:40
thesheff17RoyK, wtf is that cable?17:41
i3luefirei blame google for my lack of knowledge. lol17:41
qman__when we switched to upstart the server guide still had tons of incorrect references to /etc/init.d17:41
qman__thesheff17, it's a euro AC outlet to cat517:41
thesheff17haha...that is what I thought....17:41
thesheff17does that even work?17:42
qman__it blows up whatever's on the cat5 end17:42
thesheff17lol17:42
qman__not how you do power over ethernet17:42
i3luefirethanks for the manual link tho guys17:42
RoyK:)17:44
RoyK230VoE17:44
air_RoyK: yay, ethernet killer. :)17:47
i3luefirefail17:48
i3luefireok. so it must be the partition setup then17:48
thesheff17can you purchase that? I would love to send that to some old bosses.17:48
air_"here's some extra power for your network"17:48
thesheff17I would need 110VoE17:48
air_would this do? http://pixdaus.com/pics/HfxKm41AwpIFQRbFXK.jpg17:49
thesheff17yes17:50
thesheff17i3luefire, I was just reading about btrfs and there is a conversion tool from ext3/4 to btrfs may break your system though17:50
i3luefireshould i leave the boot at ext3 too?17:52
i3luefireinstead of ext417:52
qman__shouldn't matter17:54
qman__I've done both17:54
qman__I'm almost positive it's the btrfs /, or the LVM that grub is choking on17:54
i3luefirewell its not the lvm because i left that the same17:55
qman__btrfs is definitely still unstable, experimental software17:56
RoyKi3luefire: I usually use ext2 on /boot17:56
RoyKno need for a journal there17:56
i3luefirehmm17:56
RoyKsome distros even mount /boot ro by default17:56
qman__it would make sense now with grub2, since you don't manually edit anything there anymore17:57
i3luefirewell i put it on ext3 bc that is what worked earlier and i had it selected already17:57
qman__remount rw and remount ro could be scripted into update-grub17:57
RoyKIIRC I saw that on SuSE some 5+ years ago, and by then it was a PITA17:57
qman__back with gentoo 2004, the guide said to simply not mount /boot by default17:58
i3luefiregrub2 is supposed to support btrfs too17:58
i3luefireeven on the /boot17:58
i3luefirebut it cant even do it on the root aparently17:59
RoyKi3luefire: but btrfs is still missing fsck :P17:59
i3luefiretru17:59
RoyKsomething that's been 'in the works' for >2 years17:59
qman__well, being able to boot btrfs, and being able to figure out and set it up in the installer are two different things17:59
leniosyou don't really need fsck though17:59
RoyKlenios: when the shit hits the fan, you do18:00
i3luefireqman__: tru18:00
qman__ubuntu jumped on ext4 by default a bit early too18:01
qman__a couple data mangling bugs popped up post release18:01
qman__new filesystems are just inherently risky18:02
RoyKqman__: ubuntu should be a bit more conservative imho18:02
i3luefirebut they are so cool tho. lol if they worked... and i guess they do if you know enough about them18:02
qman__well, it's two goals of ubuntu at odds18:03
thesheff17I do have some prod servers with ReiserFS18:03
qman__making it easy for everyone, and providing the latest and greatest18:03
i3luefirethose 2 goals are at odds for sure18:04
i3luefiregood thing im not trying zfs or something18:04
i3luefireit chomps thru the ram like crazy from my experience with freeNAS18:04
qman__I agree that they're just a little too ambitious18:05
qman__too many show stopping bugs are in release18:05
i3luefireyep the release defaults should work 95% of the time not 60% of the time18:06
qman__that's why I stick to LTS and wait for .1 when it's important18:06
i3luefirethats why i dont like fedora18:06
i3luefireby default it fails on my desktop hardware. ati opensourse drivers are not set up right or something18:07
qman__desktops are different, though18:08
qman__new features are more important than in servers18:08
i3luefiremy desktop has ati onboard graphics.(no card)18:08
i3luefireand hdmi output18:08
qman__so does mine, still dealing with a number of bugs18:09
qman__OS drivers have graphical glitches and sometimes hard lock the system, proprietary don't work at all18:09
i3luefireisntalling grub failed again at a different step18:10
i3luefirebut i recovered it18:11
i3luefireit just needed me to tell it which drives mbr was available18:11
qman__yeah, that's been a problem since forever18:11
qman__even with grub1, as long as I can remember18:12
qman__once you get more than a couple disks and throw some LVM or raid in, it gets confused18:12
i3luefireok looks like it is booting18:12
i3luefirecool18:13
thesheff17yea I'm trying 512MB /boot/, 1GB swap, 7GB btrfs /18:13
thesheff17w/ ubuntu 11.1018:13
i3luefireserver login prompt18:13
i3luefirethanks everyone18:15
leniosdo you really need 1GB swap?18:17
thesheff17prob not18:17
i3luefirethe only features i want from btrfs are cow and lzma compression18:17
thesheff17I try never to use swap18:17
leniosi usually use not more than 128M18:17
thesheff17it is just a virtual machine18:17
thesheff17yea old habbits of 2*ram size18:18
i3luefirei have a 6gb swap for my 4gb ram machine18:18
qman__my desktops generally have no swap18:18
qman__servers have a little just because18:18
qman__but it's really not needed if you put in enough RAM18:18
qman__instead of caching my RAM on disk, I cache my disk in RAM18:19
i3luefirei still dont understand why most oses dont let you load the entire os files to ram on systems with 8-16gb ram18:22
thesheff17is there an easy way I can get a script to just run once the first time the virtual machine boots?18:22
qman__ /etc/rc.local18:22
i3luefiremake the script disable itself as the last step18:22
qman__yep18:22
i3luefirei have no idea how to do that tho18:23
i3luefirelol18:23
thesheff17cool18:23
thesheff17very easy with python18:23
qman__make a script, add it to rc.local, make the script edit rc.local at the end18:24
qman__then you don't run into self-manipulation issues18:24
i3luefireqman__: yeah18:24
i3luefirethat sounds like a good solution18:24
thesheff17says in cat /etc/rc.local that I can just do chmod +x chmod -x and it will start/stop18:24
thesheff17not cat...18:24
i3luefireman18:25
i3luefireno its time to setup transmission, sab, upnp...18:27
i3luefire*now its time18:27
pukekohowdy al, i am wanting to migrate the OS (Lucid) of a physical file-server with soft-raid /dev/md0 /dev/md1 etc to a VM on another box -- i was thinking about using Clonezilla but from memory last time i tried to clone partitions of a soft raid i ran into problems ... any advice ?18:28
qman__instead of cloning partitions, just copy files18:29
qman__then edit fstab and install grub18:29
qman__linux is reasonably hardware-agnostic like that18:33
qman__as long as it can use all the hardware, and knows where its kernel and partitions are, it's good18:33
qman__probably want to rm /etc/udev/rules.d/70-persistent-net while you're at it18:35
pukekoqman__: ...thanks.. so  i would need to remove all the mdadm.conf stuff as well change the UUID's in fstab etc ?18:54
RoyKqman__: IIRC I had an issue with grub last time I tried to duplicate a setup18:54
RoyKpukeko: yes, and the UUID(s) in the grub setup18:55
RoyKpukeko: mdadm.conf can be generated quite easily18:55
RoyKpukeko: mdadm --detail --scan18:56
pukekoRoyk: i'm going from soft raid to a VM on a hard-raid18:56
RoyKok, no need for mdadm, then ...18:56
thesheff17yea my ubuntu 11.10 using a root file system of btrfs failed19:15
RoyKthesheff17: did anyone tell you btrfs is experimental?19:19
thesheff17yea I was just testing to see if it failed19:19
RoyKworked for me last time I tested it...19:21
RoyKbut then, its tools make it rather crappy when being used to zfs :P19:21
guntbertRoyK: did you succeed with raid6->raid5 ?19:22
thesheff17yea I tested it on a virtual machine...it was complaining about unmet dependencies with the linux 3.0 kernel19:23
RoyKguntbert: it was just a question - I haven't made the move to raid6 yet19:25
guntbertRoyK: I see - just curious myself :)19:25
RoyK:)19:25
RoyKbtw, anyone that knows if it's possible to upgrade the metadata version after creating an md device?19:27
RoyKI have v0.9, being the default, on my home sever, and I see now it doesn't support >2TB drives19:28
patdk-lapdon't think so, to some extent19:32
patdk-lapI think the metadata locations changed too much between some versions19:32
RoyKpatdk-lap: they have, according to the manual, but still, having to recreate your average 10TB md device to use 3TB drives seems a waste19:50
RoyKpatdk-lap: and with linux md being one of the more flexible raid solutions out there, adding metadata upgrades would be another fine thing...19:51
qman__just be aware that raid 6 is _really_ slow19:59
qman__was saturating gigabit with raid 5, struggling to do 35MB/s with raid 6, and I have pretty good hardware19:59
RoyKwtf?20:01
RoyKhow's the CPU load?20:01
RoyKqman__: there's usually a bottleneck somewhere - either that or latency somewhere20:03
patdk-lapqman, what cpu?20:04
jeeves_mosshow would I go about writing a script to move files one by one from one partition to a temp drive, then back to another directory while preserving the structure, etc?20:12
RoyKjeeves_moss: can't you just rsync the bunch?20:14
jeeves_mossRoyK,  the "issue" is that I only have a 160Gb "temp" drive. I forgot to turn dedup on when I set up my ZFS drives, so I have to physically move the data off the cluster, then back again.  So, I can't just copy everything to another drive, and back.  The only way I can take advantage of the dedup is to move the data off of the cluster drives, then back20:15
RoyKjeeves_moss: thank gods you didn't turn on dedup on ZFS20:16
RoyKit's NOT stable20:16
jeeves_moss??20:16
RoyKjeeves_moss: I even have a dedicated test machine with some 10TB storage, some SSDs for caching etc, and zfs dedup sucks rather badly20:17
jeeves_mossit is on now.  I wanted to run dedup on the data on there right now.  hence the request for ideas!20:17
RoyKjeeves_moss: see the mailing lists for more ino20:17
RoyKjeeves_moss: see the mailing lists for more info20:17
jeeves_mossahhhh.  I know it's a new FS, so, I'm testing it on a RAIDZ2 pool.20:17
RoyKjeeves_moss: how much memory/l2arc do you have on the machine?20:18
RoyKjeeves_moss: and what is the pool size?20:18
jeeves_mossRoyK, it's got a gb of RAM (this was a temp soulition untill I get my external deticated NAS box), and the pool is 4.8Tb20:20
RoyKjeeves_moss: then DO NOT USE DEDUP20:20
RoyKjeeves_moss: beleive me on this20:20
jeeves_mossRoyK, is it just not the best preformance, or does it eat your data?20:21
RoyKjeeves_moss: if you have 2GB RAM per terabyte stored and mostly 128kB records, it might work somewhat ok20:21
RoyKjeeves_moss: it'll be dead slow and removing a deduped dataset may take hours or even days20:21
jeeves_mossRoyK, the "plan" is to build this into a 2U box with 8 2.6Ghz cores, and 32Gb of RAM, then exapnd out to ~32Tb of storage20:22
jeeves_mossRoyK, lol, I don't care if it takes days.  it's taken almost a month to move all the data off of other boxes!20:22
RoyKI had a server with dedup at a point and removing a dataset took three days, and during that time, it wasn't available for other use20:22
RoyKjeeves_moss: no, it's like it blocks other services20:23
jeeves_mossRoyK, how did you dedup the data though?20:23
jeeves_mossRoyK, I just enabled it, so I was thinking of moving files one by one off to a temp drive, then back again20:24
RoyKjeeves_moss: beleive me - I've done a LOT of testing of dedup, I've read other tests done by people in the opensolaris/openindiana society, and it's not stable, not for production, hardly for testing20:24
jeeves_mosslol, fun!20:25
RoyKjeeves_moss: beleive me on this - I've spent a long time on this, and ended up buying more drives instead20:25
patdk-lapheh, nothing I have ever done could benifit from dedup20:26
patdk-lapexcept work samba shares for their documents20:26
patdk-lapbut that is small enough it doesn't matter20:26
jeeves_mossahhh, well, the end "goal" of this unit is to be the SAN for a VMWare setup to host a lot of on-line video20:26
patdk-lapheh?20:28
patdk-lapsan ofr vmware or for videos?20:28
jeeves_mosspatdk-lap, if I could "dedup" my wife's bitching, I'd benifit!20:28
patdk-lapseem two different things20:28
jeeves_mosspatdk-lap, it's house both20:28
patdk-lapheh20:28
patdk-lapI would do something like I am then20:28
RoyKjeeves_moss: just forget about dedup on zfs for now20:29
patdk-laprun iscsi/fc/srp/... for vmware using enough space as you need for the vm's20:29
patdk-lapand just nfs share the videos20:29
RoyKjeeves_moss: or use it if you want to be a crash test dummy of sorts20:29
patdk-lapcould even do vm's on nfs too, makes is easier to backup and stuff, but alittle more annoying otherwise20:29
jeeves_mosspatdk-lap, NFS was the plan for the videos.  Haven't decided on the proper way to do the iSCSI20:30
patdk-laphow many esx servers?20:30
patdk-lapand do you want failover HA?20:30
RoyKjeeves_moss: you're not doing zfs fuse on this?20:30
jeeves_mosson the NAS box right now. I haven't decided for the production box.20:31
RoyKpatdk-lap: do you know anything like failover for oi?20:32
patdk-laproyk, not really20:32
patdk-lapluckily I don't have to have extreemly fast failover, so manual is perferred20:32
patdk-lapbut for those wanting seemless, clean, auto, nope, don't know anything20:33
* RoyK just got a message from icinga about a drive failing its SMART tests, and then got another message from a scientist that everything on that server was dead slow - iostat -xdn showed 99% load on that drive alone ... zpool offline ...20:35
patdk-lapstrange, my oi box is rejecting my ssh connections20:38
RoyKwhat did you do to the poor box?20:40
patdk-lapI disconnecting it's IB link :)20:40
patdk-lapeverything is fine on it, except ssh20:40
patdk-lapiscsi, mysql, nfs, samba, all find20:41
RoyKwhy would ssh depend on ib?20:41
patdk-lapwho said that?20:41
patdk-lapoyu asked what I did, I disconnected ib20:41
patdk-laphmm, ssh service keeps going into mantance mode20:42
RoyKwell, reboot the beast :P20:42
patdk-lapguess I'm going have to get a screen/keyboard on it, and check logs20:42
patdk-lapfixed ssh20:46
RoyKpatdk-lap: what was it?20:49
patdk-lapbad sshd_config value20:49
RoyKlol20:50
RoyKso not really related  to IB?20:50
patdk-lapna20:50
* RoyK can only conclude that a backup of 1,5TB over WAN takes its time even with a 60Mbps link20:52
patdk-lapyep20:54
patdk-lapmy friend attempted a 4tb backup over wan, on a 10mbit link20:54
patdk-laphe gave up after 3 days20:54
air_:)20:55
patdk-lapsome things, sneakernet is still excellent at, or pidgonnet20:55
RoyKpatdk-lap: it's only been running for a day or so, and after I offlined that deadish drive, it's running rather quickly20:57
air_what's the recommended filesystem to run on ubuntu these days? ext4 is still teh shit and btrfs is not really ready? or?21:02
air_I suppose zfs + ubuntu might not be the way to go either. (I'm considering what to use for file storage, software raid)21:02
air_today I got 3 drives in software raid-5 running ext4.21:03
air_it's only my home server, but I'd prefer not to loose my wedding photos, etc, so at least some parts of the storage should be "safe".21:04
air_for now I handle that by rsyncing the important parts to an usb drive every now and then. to give me at least some extra security.21:04
patdk-lapis there any other way to be secure?21:06
patdk-lapall it takes is one lightening strike, and all your disks are dead21:07
air_well. yeah, youre right.21:07
air_so I should look into remote syncing my wedding photos somewhere else.21:08
air_or use two different usb drives and have one of them offline at all times.21:08
air_so, any comments on zfs or btrfs? know issues with running any of them on ubuntu?21:34
stlsaintair_: i run it fine (btrfs)21:37
stlsaintair_: but thats on my laptop21:37
qman__RoyK, Patrickdk, phenom II x4 CPU ~3.2GHz, CPU load is all iowait, have a PCIe x8 card known to be able to saturate all 8 channels, two on a PCI controller I was using before, and two on the onboard21:44
RoyKair_: zfs fuse is a no go performance-wise, btrfs is a no go safety-wise, ext4 works well, and with regular scrubbing of the md device, it should be safe enough21:46
RoyKqman__: then md must be doing some rather heavy amounts of random i/o21:47
patdk-lapqman, odd, you shouldn't have any issues with that21:48
patdk-lapunless your doing random writes, and made a large block size21:48
RoyKpatdk-lap: with md-based raid6?21:48
patdk-lapyep21:48
patdk-laphe should be able to substain >4GB/sec with his cpu21:48
qman__wonder if my filesystem is fragmented21:49
qman__using ext321:49
RoyKpatdk-lap: you'll need a rather large amount of drives for that...21:49
qman__and it was >90% before I added the last four disks21:49
air_RoyK: thanks. and in this case, what does regular scrubbing mean? :)21:49
patdk-laproyk, therefor raid6 hsouldn't be his issue :)21:49
qman__but even before that it was not that great21:49
patdk-lapoh, ext* with >85% is slow as hell21:49
RoyKair_: echo check >> /sys/block/mdX/md/sync_action21:50
patdk-lapit takes longer and longer for it to locate a free block21:50
patdk-lapI have had ext3 wait several minutes to locate a free block before, when I was at 99%21:50
qman__it's 57% now21:50
RoyKpatdk-lap: heh - ever tried zfs with 95% full VDEVs?21:50
patdk-laproyk, nope, only been to 76% so far :)21:50
RoyKat > 90% full VDEVs, ZFS is dead slow21:51
qman__when I have some spare cash I'll get more disks and redo it, but until then I can't touch it because I don't have anywhere to back up all my data21:51
patdk-lapbut if you used a 256k stripe size, raid6 would have to read that 256k from each drive, then write out atleast 3 drives21:51
patdk-lapif you only write 4k :(21:51
qman__64k chunk21:52
patdk-lapthat shouldn't be too bad21:52
RoyKqman__: what sort of i/o pattern?21:52
qman__well, mostly large files just being placed21:52
qman__but I also run torrentflux, so when that's downloading I'd understand21:53
qman__but when it's just seeding it doesn't make much sense21:53
qman__or not running at all21:53
RoyKseeding torrents means large number of random i/o21:54
patdk-lapya, not as bad as downloading, but still lots of random reads21:55
* RoyK wonders when linux will get something like l2arc22:01
patdk-lapthought it did22:03
patdk-lapflashcache22:03
patdk-lapworks for both l2arc and zil22:03
RoyKall google can tell me about flashcache is something mysql centric22:06
patdk-lapwell, it was originally designed to maky facebook mysql faster22:06
qman__future plans have the torrents staged on a separate file system, probably a single disk, to alleviate that problem22:06
patdk-lapqman, I did that22:07
patdk-lapthat drive couldn't substain >4MB/sec transfers cause of that22:07
qman__maybe a raid 0 then22:07
qman__but either way, get them off the main data storage to speed it up22:08
RoyKqman__: or a nice set of striped mirrors on zfs :P22:08
qman__I also want something with checksums, I've had video files get some corruption a number of times22:08
qman__disks are so unreliable these days22:08
patdk-lapheh, checksums don't help unreliable disks22:09
patdk-lapthey can only say, you have an issue22:09
RoyKpatdk-lap: it helps you detect the problem and with sufficient redundancy, to fix it22:09
patdk-lapand disks are suppost to have ecc data, rs code22:09
qman__I mean in the filesystem, to detect when a file gets written wrong22:09
patdk-lapbut seems mostly useless22:09
RoyKpatdk-lap: they have ECC all the way, but with the amount of data available today, those ECC algorithms, or sizes, aren't good enough22:10
patdk-laphttps://wiki.archlinux.org/index.php/Flashcache22:11
patdk-laproyk, well it more that22:11
patdk-lapwhen they went to 4k disks, they used a crapload less ecc data22:11
patdk-lapand also, those sectors are so small, the ecc data is also getting destroyed too22:11
patdk-lapthe physical size of the sector on disk22:11
RoyKthus, use a filesystem with checksumming :P22:12
* patdk-lap would gladdly replace checksumming with ecc data :)22:12
patdk-laphmm, normal 512bytes sector has 40bytes ecc22:13
patdk-lapa 4k sector has 100bytes22:14
patdk-lapwish I had the 4k sector with full 320bytes ecc22:15
patdk-lapbut guess they said, it wasn't needed22:15
RoyKseems flashcache isn't in oneiric22:15
patdk-lapnope22:16
RoyKperhaps in debian sid :P22:16
RoyKbut sid is the kid that tend to break toys....22:16

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!