| TimR | is anybody here? | 02:17 |
|---|---|---|
| RoyK | somewhat | 02:19 |
| === RudyValencia- is now known as RudyValencia | ||
| TimR | can anybody tell me how I can make a user go into home/user/public_html when using sftp? Also how can I make sure that user can only see his directory? | 04:41 |
| failover | TimR, set his home to /home/user/public_html | 04:42 |
| TimR | well see im using webmin to control everything | 04:43 |
| failover | dunno webmin, but it should have a way to customize user homedir ! | 04:44 |
| failover | TimR, http://library.linode.com/security/sftp-jails | 04:47 |
| TimR | well see only group setup I have is users | 04:48 |
| TimR | can i change that from filetransfers to users? | 04:48 |
| hdale85 | For some reason my server is loading extremely slow. Swapped out some ram and the CPU and even grub sits there for a while before it starts booting. | 05:22 |
| hdale85 | It does eventually boot though, and for some reason its still not mounting my array...... | 05:28 |
| === iggi__ is now known as iggi_ | ||
| harold_ | oh well still working for now at least lol | 05:35 |
| harold_ | just annoying that I have to go manually mount that drive everytime I reboot | 05:38 |
| rained23 | HI I have problems with my apache, I installed it using tasksel for lamp-server . It seems searching a non existent .htaccess | 06:49 |
| rained23 | (13)Permission denied: /home/user/belajar/.htaccess pcfg_openfile: unable to check htaccess file, ensure it is readable | 06:49 |
| === Major_Tom is now known as Omega42 | ||
| awanti | i need u r help to setup local repository in our office. We are recently migrated to Ubuntu 10.04. Currently every pc is updating from internet. (we are having 10 pc's in our office) | 07:56 |
| bennym | I want my Ubu Server 10.4.03 machine to act as a router/firewall between the internet on eth2 and the switch (and attatched machines) on eth1. What do I need to look up? | 08:39 |
| === bennym_ is now known as bennym | ||
| === bennym is now known as bennymAFK | ||
| ElizabethKelley1 | Hey im trying to join ##Security on Xchat on windows but it does not add it to my chennel list does any one know why that might be? | 10:16 |
| neotyk | Good morning Everyone! | 10:45 |
| neotyk | is it possible to install JDK in EC2 while running from Natty image? | 10:47 |
| neotyk | my instance hangs when I try to do so | 10:48 |
| neotyk | both natty and Oneiric | 10:48 |
| neotyk | please advice | 10:48 |
| CrazyGir | hello! I have a server randomly rebooting on me, and while I am looking into what is going on, I noticed I have a 'kworker' process eating up quite a lot of resource. how can I find out what this process is doing, and why it is running so much on an otherwise idle server? | 11:06 |
| CrazyGir | eg: 183 root 20 0 0 0 0 S 22 0.0 184:07.69 kworker/6:1 | 11:06 |
| CrazyGir | 27003 root 20 0 0 0 0 D 3 0.0 1:15.80 kworker/u:2 | 11:06 |
| CrazyGir | is drdb capable of rebooting a server when it should not, if it is misconfigured? | 11:25 |
| jMCg | CrazyGir: maybe that's a feature of the cluster to stabelize the system when it's unclear who's the master and who's the slave. | 12:23 |
| jMCg | (n.b.: I'm pulling this out of my ass from peripheral experience with Oracle and Sun clusters, I've never worked with drdb) | 12:24 |
| CrazyGir | yea, I think you might be right | 13:18 |
| CrazyGir | any thoughts on the first question RE kworker | 13:18 |
| SockPants | Hi all | 13:55 |
| SockPants | quick question: i'm wiping drives real quick, so i'm using dd if=/dev/random of=/dev/xxx. does this command end when it reaches the end of the drive, or does it continue forever? | 13:55 |
| User488 | hello | 14:01 |
| User488 | can anyone help me with a bind problem? | 14:02 |
| RoyK | !ask | 14:02 |
| ubottu | Please don't ask to ask a question, simply ask the question (all on ONE line and in the channel, so that others can read and follow it easily). If anyone knows the answer they will most likely reply. :-) See also !patience | 14:02 |
| User488 | ok thanks | 14:02 |
| User488 | when I do nslookup ubuntu.com the query reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (my server name) | 14:04 |
| ljaclark | When I do nslookup ubuntu.com my bind server reports server 10.61.3.245 address 10.61.3.245 is ther a way to make bind report server (server name ) instead of the ip address | 14:13 |
| patdk-lap | ljaclark, do you know what nslookup does? | 14:17 |
| patdk-lap | it converts name to ip address | 14:17 |
| ljaclark | yes. I have asked the question because I have to setup bind for a uni project. The lecturer wants me to have the DNS server show the server name instaed of the ip address. in the first line of the nslookup command | 14:21 |
| ljaclark | root@group2:/etc/bind# nslookup www.howtoforge.org | 14:22 |
| ljaclark | Server: 10.61.3.245 | 14:22 |
| ljaclark | Address: 10.61.3.245#53 | 14:22 |
| ljaclark | Non-authoritative answer: | 14:22 |
| ljaclark | Name: www.howtoforge.org | 14:22 |
| ljaclark | Address: 188.40.16.205 | 14:22 |
| onre | ljaclark, your server does not have proper reverse DNS entry for itself and that's why you see ip address instead of server name. | 14:25 |
| ljaclark | Thank you do you know of a guide that can help me as I used the one on the ubuntu forum to setup bind? | 14:30 |
| RoyK | any idea how I can check which PCI Express version my mobo supports? | 14:40 |
| patdk-lap | get the model number from lshw and check it on their website? | 14:45 |
| RoyK | patdk-lap: couldn't find anything there - http://www.asrock.com/mb/overview.asp?Model=M3A%20UCC&cat=Specifications | 14:46 |
| RoyK | just says PCI Ex | 14:46 |
| patdk-lap | AMD 480X | 14:47 |
| patdk-lap | pcie 1.1 | 14:49 |
| RoyK | thanks | 14:49 |
| patdk-lap | annoying when they dont say | 14:49 |
| patdk-lap | then you have to check the northbridge chipset against it's manual :) | 14:49 |
| thesheff17 | anyone know why I get Hash sum mismatch on a local apt-mirror? | 16:47 |
| qman__ | probably a misconfigured proxy | 16:49 |
| qman__ | or a problem with that local mirror | 16:49 |
| thesheff17 | qman__, yea I see a forum post about a wrong security mirror | 16:50 |
| thesheff17 | ah I know....I had to restore the box...and prob had a different mirror.list | 16:51 |
| i3luefire | last night i spent 5 hours trying to install ubuntu-server 11.10 and ended up failing | 16:57 |
| i3luefire | right now i am at the installing base system phase on a new start today | 16:58 |
| thesheff17 | what was the issue you ran into? | 16:59 |
| i3luefire | it failed at the software selection step every time and also was unable to install grub | 16:59 |
| i3luefire | i have pdfs of all the log files | 17:00 |
| i3luefire | i wish they were txt files but i had to pull them up on my phone | 17:01 |
| i3luefire | so the only way to save them was pdf | 17:01 |
| qman__ | for the software selection bit | 17:07 |
| qman__ | try installing without a network connection | 17:07 |
| qman__ | sometimes that messes things up | 17:07 |
| qman__ | for grub, what is your hard drive configuration? | 17:07 |
| i3luefire | i was using 1gb ext4 for /boot , 20gb btrfs / , and 3.7tb lvm ext4 /home | 17:09 |
| qman__ | 3.7tb? what's the physical setup? mdadm, hardware, or fakeraid | 17:10 |
| qman__ | btrfs could be a problem too, I don't know enough about it | 17:10 |
| i3luefire | 1tb sdb1 + 3tb sda1 + 125gb sdc2 | 17:11 |
| i3luefire | with lvm | 17:12 |
| qman__ | that's really complex, and probably the reason grub isn't working | 17:12 |
| qman__ | it has to be able to determine where the system boots to, and install there | 17:12 |
| i3luefire | grub should only care about the /boot partition right? | 17:13 |
| qman__ | no | 17:13 |
| qman__ | grub cares about all of your hard drives and partitions | 17:13 |
| qman__ | it has to determine which drive the bios boots, then install the boot record there | 17:13 |
| qman__ | and then point to /boot from it | 17:13 |
| i3luefire | hmm | 17:14 |
| i3luefire | http://www.filedropper.com/logs_5 | 17:14 |
| RoyK | i3luefire: using a pastebin is a bit easier :P | 17:17 |
| RoyK | !pastebin | 17:17 |
| ubottu | For posting multi-line texts into the channel, please use http://paste.ubuntu.com | To post !screenshots use http://imagebin.org/?page=add | !pastebinit to paste directly from command line | Make sure you give us the URL for your paste - see also the channel topic. | 17:17 |
| i3luefire | RoyK: those pdfs were made last night when i was in ambien land and i thought the only way to get the log files was on my phone | 17:18 |
| i3luefire | but thanks | 17:19 |
| qman__ | in any case | 17:19 |
| qman__ | while grub supports /boot on lvm, I don't do it, because it's still far from perfect | 17:19 |
| qman__ | I also disconnect any drives that are not used during the install, and try to make things as simple as is possible for my application | 17:19 |
| i3luefire | the boot is not lvm | 17:19 |
| i3luefire | the boot is a regular partition | 17:20 |
| i3luefire | 1gb | 17:20 |
| thesheff17 | 1gb for boot? | 17:20 |
| qman__ | and I don't know about btrfs and lvm | 17:20 |
| i3luefire | 1gb for boot | 17:20 |
| thesheff17 | try smaller | 17:20 |
| qman__ | better too big than too small | 17:20 |
| qman__ | no | 17:20 |
| qman__ | ubuntu is not intelligent about kernel updates and simply doesn't remove old kernels | 17:21 |
| qman__ | and if /boot fills up you run into problems installing software | 17:21 |
| qman__ | I usually do 512MB, but 1GB is fine | 17:21 |
| thesheff17 | qman__, same... | 17:21 |
| i3luefire | it looks like from the logs that grub-pc failed to install or something | 17:23 |
| thesheff17 | I would try ext4 for this partition and see if it works 20gb btrfs / | 17:24 |
| i3luefire | who would have thought that a version of bsd (freeNAS) would be easier to install than a version of linux (ubuntu) | 17:24 |
| i3luefire | i did ext3 on boot this time and ext4 for root | 17:25 |
| thesheff17 | same problem? | 17:25 |
| i3luefire | boot and root and swap are all simple partitions too | 17:25 |
| i3luefire | it is now installing base again | 17:25 |
| i3luefire | and the network cable is unplugged | 17:26 |
| qman__ | well, ubuntu is on the so-called 'bleeding edge' | 17:26 |
| i3luefire | lol | 17:26 |
| qman__ | pushes new software in spite of the problems | 17:26 |
| i3luefire | i guess | 17:26 |
| qman__ | if you want a stable, always easy experience, go with LTS releases or something even more stagnant | 17:27 |
| thesheff17 | yea I only use LTS for prod | 17:27 |
| qman__ | and wait until .1 | 17:27 |
| i3luefire | well my wonderful friend who suggested i use ubuntu server for the easy pkg management of it decided to abandon me during the install last night and he is the one who suggested the 11.10 | 17:29 |
| qman__ | unless you need some of the new features, I'd use 10.04 | 17:29 |
| thesheff17 | i3luefire, what qman__ said :) | 17:30 |
| qman__ | all my servers are 10.04, except the one still on 8.04 | 17:30 |
| i3luefire | should i tell it to install security updates automaticlly | 17:30 |
| thesheff17 | I don't | 17:30 |
| qman__ | I do | 17:30 |
| qman__ | personal preference | 17:30 |
| i3luefire | this is a home server that will be on the net at all times | 17:30 |
| i3luefire | ok | 17:30 |
| i3luefire | i am enabling it then | 17:30 |
| i3luefire | i have made it passed the places where it failed last night | 17:31 |
| RoyK | http://i.imgur.com/thEKg.jpg | 17:32 |
| i3luefire | but i changed too many variables so im going back to the start with the fs choice as they were last night and the network unplugged | 17:32 |
| qman__ | the deal with the network is, it tries to update during the install on the fly, so you don't have to later | 17:33 |
| qman__ | but sometimes that messes up, and then apt is broken | 17:33 |
| qman__ | and it can't properly install | 17:33 |
| i3luefire | that may have been the entire problem | 17:34 |
| i3luefire | judging by the log files | 17:34 |
| i3luefire | we shall see | 17:35 |
| i3luefire | my friend says "rtfm" so i say to him "there isnt a manual on 11.10 server yet and you are the one who suggested it so you are the fu**ing manual" | 17:39 |
| qman__ | heh | 17:40 |
| qman__ | https://help.ubuntu.com/11.10/serverguide/C/ FYI, but yeah | 17:40 |
| thesheff17 | i3luefire, https://help.ubuntu.com/11.10/serverguide/C/index.html | 17:40 |
| thesheff17 | hah | 17:40 |
| qman__ | it's still early, it's probably not complete | 17:40 |
| thesheff17 | RoyK, wtf is that cable? | 17:41 |
| i3luefire | i blame google for my lack of knowledge. lol | 17:41 |
| qman__ | when we switched to upstart the server guide still had tons of incorrect references to /etc/init.d | 17:41 |
| qman__ | thesheff17, it's a euro AC outlet to cat5 | 17:41 |
| thesheff17 | haha...that is what I thought.... | 17:41 |
| thesheff17 | does that even work? | 17:42 |
| qman__ | it blows up whatever's on the cat5 end | 17:42 |
| thesheff17 | lol | 17:42 |
| qman__ | not how you do power over ethernet | 17:42 |
| i3luefire | thanks for the manual link tho guys | 17:42 |
| RoyK | :) | 17:44 |
| RoyK | 230VoE | 17:44 |
| air_ | RoyK: yay, ethernet killer. :) | 17:47 |
| i3luefire | fail | 17:48 |
| i3luefire | ok. so it must be the partition setup then | 17:48 |
| thesheff17 | can you purchase that? I would love to send that to some old bosses. | 17:48 |
| air_ | "here's some extra power for your network" | 17:48 |
| thesheff17 | I would need 110VoE | 17:48 |
| air_ | would this do? http://pixdaus.com/pics/HfxKm41AwpIFQRbFXK.jpg | 17:49 |
| thesheff17 | yes | 17:50 |
| thesheff17 | i3luefire, I was just reading about btrfs and there is a conversion tool from ext3/4 to btrfs may break your system though | 17:50 |
| i3luefire | should i leave the boot at ext3 too? | 17:52 |
| i3luefire | instead of ext4 | 17:52 |
| qman__ | shouldn't matter | 17:54 |
| qman__ | I've done both | 17:54 |
| qman__ | I'm almost positive it's the btrfs /, or the LVM that grub is choking on | 17:54 |
| i3luefire | well its not the lvm because i left that the same | 17:55 |
| qman__ | btrfs is definitely still unstable, experimental software | 17:56 |
| RoyK | i3luefire: I usually use ext2 on /boot | 17:56 |
| RoyK | no need for a journal there | 17:56 |
| i3luefire | hmm | 17:56 |
| RoyK | some distros even mount /boot ro by default | 17:56 |
| qman__ | it would make sense now with grub2, since you don't manually edit anything there anymore | 17:57 |
| i3luefire | well i put it on ext3 bc that is what worked earlier and i had it selected already | 17:57 |
| qman__ | remount rw and remount ro could be scripted into update-grub | 17:57 |
| RoyK | IIRC I saw that on SuSE some 5+ years ago, and by then it was a PITA | 17:57 |
| qman__ | back with gentoo 2004, the guide said to simply not mount /boot by default | 17:58 |
| i3luefire | grub2 is supposed to support btrfs too | 17:58 |
| i3luefire | even on the /boot | 17:58 |
| i3luefire | but it cant even do it on the root aparently | 17:59 |
| RoyK | i3luefire: but btrfs is still missing fsck :P | 17:59 |
| i3luefire | tru | 17:59 |
| RoyK | something that's been 'in the works' for >2 years | 17:59 |
| qman__ | well, being able to boot btrfs, and being able to figure out and set it up in the installer are two different things | 17:59 |
| lenios | you don't really need fsck though | 17:59 |
| RoyK | lenios: when the shit hits the fan, you do | 18:00 |
| i3luefire | qman__: tru | 18:00 |
| qman__ | ubuntu jumped on ext4 by default a bit early too | 18:01 |
| qman__ | a couple data mangling bugs popped up post release | 18:01 |
| qman__ | new filesystems are just inherently risky | 18:02 |
| RoyK | qman__: ubuntu should be a bit more conservative imho | 18:02 |
| i3luefire | but they are so cool tho. lol if they worked... and i guess they do if you know enough about them | 18:02 |
| qman__ | well, it's two goals of ubuntu at odds | 18:03 |
| thesheff17 | I do have some prod servers with ReiserFS | 18:03 |
| qman__ | making it easy for everyone, and providing the latest and greatest | 18:03 |
| i3luefire | those 2 goals are at odds for sure | 18:04 |
| i3luefire | good thing im not trying zfs or something | 18:04 |
| i3luefire | it chomps thru the ram like crazy from my experience with freeNAS | 18:04 |
| qman__ | I agree that they're just a little too ambitious | 18:05 |
| qman__ | too many show stopping bugs are in release | 18:05 |
| i3luefire | yep the release defaults should work 95% of the time not 60% of the time | 18:06 |
| qman__ | that's why I stick to LTS and wait for .1 when it's important | 18:06 |
| i3luefire | thats why i dont like fedora | 18:06 |
| i3luefire | by default it fails on my desktop hardware. ati opensourse drivers are not set up right or something | 18:07 |
| qman__ | desktops are different, though | 18:08 |
| qman__ | new features are more important than in servers | 18:08 |
| i3luefire | my desktop has ati onboard graphics.(no card) | 18:08 |
| i3luefire | and hdmi output | 18:08 |
| qman__ | so does mine, still dealing with a number of bugs | 18:09 |
| qman__ | OS drivers have graphical glitches and sometimes hard lock the system, proprietary don't work at all | 18:09 |
| i3luefire | isntalling grub failed again at a different step | 18:10 |
| i3luefire | but i recovered it | 18:11 |
| i3luefire | it just needed me to tell it which drives mbr was available | 18:11 |
| qman__ | yeah, that's been a problem since forever | 18:11 |
| qman__ | even with grub1, as long as I can remember | 18:12 |
| qman__ | once you get more than a couple disks and throw some LVM or raid in, it gets confused | 18:12 |
| i3luefire | ok looks like it is booting | 18:12 |
| i3luefire | cool | 18:13 |
| thesheff17 | yea I'm trying 512MB /boot/, 1GB swap, 7GB btrfs / | 18:13 |
| thesheff17 | w/ ubuntu 11.10 | 18:13 |
| i3luefire | server login prompt | 18:13 |
| i3luefire | thanks everyone | 18:15 |
| lenios | do you really need 1GB swap? | 18:17 |
| thesheff17 | prob not | 18:17 |
| i3luefire | the only features i want from btrfs are cow and lzma compression | 18:17 |
| thesheff17 | I try never to use swap | 18:17 |
| lenios | i usually use not more than 128M | 18:17 |
| thesheff17 | it is just a virtual machine | 18:17 |
| thesheff17 | yea old habbits of 2*ram size | 18:18 |
| i3luefire | i have a 6gb swap for my 4gb ram machine | 18:18 |
| qman__ | my desktops generally have no swap | 18:18 |
| qman__ | servers have a little just because | 18:18 |
| qman__ | but it's really not needed if you put in enough RAM | 18:18 |
| qman__ | instead of caching my RAM on disk, I cache my disk in RAM | 18:19 |
| i3luefire | i still dont understand why most oses dont let you load the entire os files to ram on systems with 8-16gb ram | 18:22 |
| thesheff17 | is there an easy way I can get a script to just run once the first time the virtual machine boots? | 18:22 |
| qman__ | /etc/rc.local | 18:22 |
| i3luefire | make the script disable itself as the last step | 18:22 |
| qman__ | yep | 18:22 |
| i3luefire | i have no idea how to do that tho | 18:23 |
| i3luefire | lol | 18:23 |
| thesheff17 | cool | 18:23 |
| thesheff17 | very easy with python | 18:23 |
| qman__ | make a script, add it to rc.local, make the script edit rc.local at the end | 18:24 |
| qman__ | then you don't run into self-manipulation issues | 18:24 |
| i3luefire | qman__: yeah | 18:24 |
| i3luefire | that sounds like a good solution | 18:24 |
| thesheff17 | says in cat /etc/rc.local that I can just do chmod +x chmod -x and it will start/stop | 18:24 |
| thesheff17 | not cat... | 18:24 |
| i3luefire | man | 18:25 |
| i3luefire | no its time to setup transmission, sab, upnp... | 18:27 |
| i3luefire | *now its time | 18:27 |
| pukeko | howdy al, i am wanting to migrate the OS (Lucid) of a physical file-server with soft-raid /dev/md0 /dev/md1 etc to a VM on another box -- i was thinking about using Clonezilla but from memory last time i tried to clone partitions of a soft raid i ran into problems ... any advice ? | 18:28 |
| qman__ | instead of cloning partitions, just copy files | 18:29 |
| qman__ | then edit fstab and install grub | 18:29 |
| qman__ | linux is reasonably hardware-agnostic like that | 18:33 |
| qman__ | as long as it can use all the hardware, and knows where its kernel and partitions are, it's good | 18:33 |
| qman__ | probably want to rm /etc/udev/rules.d/70-persistent-net while you're at it | 18:35 |
| pukeko | qman__: ...thanks.. so i would need to remove all the mdadm.conf stuff as well change the UUID's in fstab etc ? | 18:54 |
| RoyK | qman__: IIRC I had an issue with grub last time I tried to duplicate a setup | 18:54 |
| RoyK | pukeko: yes, and the UUID(s) in the grub setup | 18:55 |
| RoyK | pukeko: mdadm.conf can be generated quite easily | 18:55 |
| RoyK | pukeko: mdadm --detail --scan | 18:56 |
| pukeko | Royk: i'm going from soft raid to a VM on a hard-raid | 18:56 |
| RoyK | ok, no need for mdadm, then ... | 18:56 |
| thesheff17 | yea my ubuntu 11.10 using a root file system of btrfs failed | 19:15 |
| RoyK | thesheff17: did anyone tell you btrfs is experimental? | 19:19 |
| thesheff17 | yea I was just testing to see if it failed | 19:19 |
| RoyK | worked for me last time I tested it... | 19:21 |
| RoyK | but then, its tools make it rather crappy when being used to zfs :P | 19:21 |
| guntbert | RoyK: did you succeed with raid6->raid5 ? | 19:22 |
| thesheff17 | yea I tested it on a virtual machine...it was complaining about unmet dependencies with the linux 3.0 kernel | 19:23 |
| RoyK | guntbert: it was just a question - I haven't made the move to raid6 yet | 19:25 |
| guntbert | RoyK: I see - just curious myself :) | 19:25 |
| RoyK | :) | 19:25 |
| RoyK | btw, anyone that knows if it's possible to upgrade the metadata version after creating an md device? | 19:27 |
| RoyK | I have v0.9, being the default, on my home sever, and I see now it doesn't support >2TB drives | 19:28 |
| patdk-lap | don't think so, to some extent | 19:32 |
| patdk-lap | I think the metadata locations changed too much between some versions | 19:32 |
| RoyK | patdk-lap: they have, according to the manual, but still, having to recreate your average 10TB md device to use 3TB drives seems a waste | 19:50 |
| RoyK | patdk-lap: and with linux md being one of the more flexible raid solutions out there, adding metadata upgrades would be another fine thing... | 19:51 |
| qman__ | just be aware that raid 6 is _really_ slow | 19:59 |
| qman__ | was saturating gigabit with raid 5, struggling to do 35MB/s with raid 6, and I have pretty good hardware | 19:59 |
| RoyK | wtf? | 20:01 |
| RoyK | how's the CPU load? | 20:01 |
| RoyK | qman__: there's usually a bottleneck somewhere - either that or latency somewhere | 20:03 |
| patdk-lap | qman, what cpu? | 20:04 |
| jeeves_moss | how would I go about writing a script to move files one by one from one partition to a temp drive, then back to another directory while preserving the structure, etc? | 20:12 |
| RoyK | jeeves_moss: can't you just rsync the bunch? | 20:14 |
| jeeves_moss | RoyK, the "issue" is that I only have a 160Gb "temp" drive. I forgot to turn dedup on when I set up my ZFS drives, so I have to physically move the data off the cluster, then back again. So, I can't just copy everything to another drive, and back. The only way I can take advantage of the dedup is to move the data off of the cluster drives, then back | 20:15 |
| RoyK | jeeves_moss: thank gods you didn't turn on dedup on ZFS | 20:16 |
| RoyK | it's NOT stable | 20:16 |
| jeeves_moss | ?? | 20:16 |
| RoyK | jeeves_moss: I even have a dedicated test machine with some 10TB storage, some SSDs for caching etc, and zfs dedup sucks rather badly | 20:17 |
| jeeves_moss | it is on now. I wanted to run dedup on the data on there right now. hence the request for ideas! | 20:17 |
| RoyK | jeeves_moss: see the mailing lists for more ino | 20:17 |
| RoyK | jeeves_moss: see the mailing lists for more info | 20:17 |
| jeeves_moss | ahhhh. I know it's a new FS, so, I'm testing it on a RAIDZ2 pool. | 20:17 |
| RoyK | jeeves_moss: how much memory/l2arc do you have on the machine? | 20:18 |
| RoyK | jeeves_moss: and what is the pool size? | 20:18 |
| jeeves_moss | RoyK, it's got a gb of RAM (this was a temp soulition untill I get my external deticated NAS box), and the pool is 4.8Tb | 20:20 |
| RoyK | jeeves_moss: then DO NOT USE DEDUP | 20:20 |
| RoyK | jeeves_moss: beleive me on this | 20:20 |
| jeeves_moss | RoyK, is it just not the best preformance, or does it eat your data? | 20:21 |
| RoyK | jeeves_moss: if you have 2GB RAM per terabyte stored and mostly 128kB records, it might work somewhat ok | 20:21 |
| RoyK | jeeves_moss: it'll be dead slow and removing a deduped dataset may take hours or even days | 20:21 |
| jeeves_moss | RoyK, the "plan" is to build this into a 2U box with 8 2.6Ghz cores, and 32Gb of RAM, then exapnd out to ~32Tb of storage | 20:22 |
| jeeves_moss | RoyK, lol, I don't care if it takes days. it's taken almost a month to move all the data off of other boxes! | 20:22 |
| RoyK | I had a server with dedup at a point and removing a dataset took three days, and during that time, it wasn't available for other use | 20:22 |
| RoyK | jeeves_moss: no, it's like it blocks other services | 20:23 |
| jeeves_moss | RoyK, how did you dedup the data though? | 20:23 |
| jeeves_moss | RoyK, I just enabled it, so I was thinking of moving files one by one off to a temp drive, then back again | 20:24 |
| RoyK | jeeves_moss: beleive me - I've done a LOT of testing of dedup, I've read other tests done by people in the opensolaris/openindiana society, and it's not stable, not for production, hardly for testing | 20:24 |
| jeeves_moss | lol, fun! | 20:25 |
| RoyK | jeeves_moss: beleive me on this - I've spent a long time on this, and ended up buying more drives instead | 20:25 |
| patdk-lap | heh, nothing I have ever done could benifit from dedup | 20:26 |
| patdk-lap | except work samba shares for their documents | 20:26 |
| patdk-lap | but that is small enough it doesn't matter | 20:26 |
| jeeves_moss | ahhh, well, the end "goal" of this unit is to be the SAN for a VMWare setup to host a lot of on-line video | 20:26 |
| patdk-lap | heh? | 20:28 |
| patdk-lap | san ofr vmware or for videos? | 20:28 |
| jeeves_moss | patdk-lap, if I could "dedup" my wife's bitching, I'd benifit! | 20:28 |
| patdk-lap | seem two different things | 20:28 |
| jeeves_moss | patdk-lap, it's house both | 20:28 |
| patdk-lap | heh | 20:28 |
| patdk-lap | I would do something like I am then | 20:28 |
| RoyK | jeeves_moss: just forget about dedup on zfs for now | 20:29 |
| patdk-lap | run iscsi/fc/srp/... for vmware using enough space as you need for the vm's | 20:29 |
| patdk-lap | and just nfs share the videos | 20:29 |
| RoyK | jeeves_moss: or use it if you want to be a crash test dummy of sorts | 20:29 |
| patdk-lap | could even do vm's on nfs too, makes is easier to backup and stuff, but alittle more annoying otherwise | 20:29 |
| jeeves_moss | patdk-lap, NFS was the plan for the videos. Haven't decided on the proper way to do the iSCSI | 20:30 |
| patdk-lap | how many esx servers? | 20:30 |
| patdk-lap | and do you want failover HA? | 20:30 |
| RoyK | jeeves_moss: you're not doing zfs fuse on this? | 20:30 |
| jeeves_moss | on the NAS box right now. I haven't decided for the production box. | 20:31 |
| RoyK | patdk-lap: do you know anything like failover for oi? | 20:32 |
| patdk-lap | royk, not really | 20:32 |
| patdk-lap | luckily I don't have to have extreemly fast failover, so manual is perferred | 20:32 |
| patdk-lap | but for those wanting seemless, clean, auto, nope, don't know anything | 20:33 |
| * RoyK just got a message from icinga about a drive failing its SMART tests, and then got another message from a scientist that everything on that server was dead slow - iostat -xdn showed 99% load on that drive alone ... zpool offline ... | 20:35 | |
| patdk-lap | strange, my oi box is rejecting my ssh connections | 20:38 |
| RoyK | what did you do to the poor box? | 20:40 |
| patdk-lap | I disconnecting it's IB link :) | 20:40 |
| patdk-lap | everything is fine on it, except ssh | 20:40 |
| patdk-lap | iscsi, mysql, nfs, samba, all find | 20:41 |
| RoyK | why would ssh depend on ib? | 20:41 |
| patdk-lap | who said that? | 20:41 |
| patdk-lap | oyu asked what I did, I disconnected ib | 20:41 |
| patdk-lap | hmm, ssh service keeps going into mantance mode | 20:42 |
| RoyK | well, reboot the beast :P | 20:42 |
| patdk-lap | guess I'm going have to get a screen/keyboard on it, and check logs | 20:42 |
| patdk-lap | fixed ssh | 20:46 |
| RoyK | patdk-lap: what was it? | 20:49 |
| patdk-lap | bad sshd_config value | 20:49 |
| RoyK | lol | 20:50 |
| RoyK | so not really related to IB? | 20:50 |
| patdk-lap | na | 20:50 |
| * RoyK can only conclude that a backup of 1,5TB over WAN takes its time even with a 60Mbps link | 20:52 | |
| patdk-lap | yep | 20:54 |
| patdk-lap | my friend attempted a 4tb backup over wan, on a 10mbit link | 20:54 |
| patdk-lap | he gave up after 3 days | 20:54 |
| air_ | :) | 20:55 |
| patdk-lap | some things, sneakernet is still excellent at, or pidgonnet | 20:55 |
| RoyK | patdk-lap: it's only been running for a day or so, and after I offlined that deadish drive, it's running rather quickly | 20:57 |
| air_ | what's the recommended filesystem to run on ubuntu these days? ext4 is still teh shit and btrfs is not really ready? or? | 21:02 |
| air_ | I suppose zfs + ubuntu might not be the way to go either. (I'm considering what to use for file storage, software raid) | 21:02 |
| air_ | today I got 3 drives in software raid-5 running ext4. | 21:03 |
| air_ | it's only my home server, but I'd prefer not to loose my wedding photos, etc, so at least some parts of the storage should be "safe". | 21:04 |
| air_ | for now I handle that by rsyncing the important parts to an usb drive every now and then. to give me at least some extra security. | 21:04 |
| patdk-lap | is there any other way to be secure? | 21:06 |
| patdk-lap | all it takes is one lightening strike, and all your disks are dead | 21:07 |
| air_ | well. yeah, youre right. | 21:07 |
| air_ | so I should look into remote syncing my wedding photos somewhere else. | 21:08 |
| air_ | or use two different usb drives and have one of them offline at all times. | 21:08 |
| air_ | so, any comments on zfs or btrfs? know issues with running any of them on ubuntu? | 21:34 |
| stlsaint | air_: i run it fine (btrfs) | 21:37 |
| stlsaint | air_: but thats on my laptop | 21:37 |
| qman__ | RoyK, Patrickdk, phenom II x4 CPU ~3.2GHz, CPU load is all iowait, have a PCIe x8 card known to be able to saturate all 8 channels, two on a PCI controller I was using before, and two on the onboard | 21:44 |
| RoyK | air_: zfs fuse is a no go performance-wise, btrfs is a no go safety-wise, ext4 works well, and with regular scrubbing of the md device, it should be safe enough | 21:46 |
| RoyK | qman__: then md must be doing some rather heavy amounts of random i/o | 21:47 |
| patdk-lap | qman, odd, you shouldn't have any issues with that | 21:48 |
| patdk-lap | unless your doing random writes, and made a large block size | 21:48 |
| RoyK | patdk-lap: with md-based raid6? | 21:48 |
| patdk-lap | yep | 21:48 |
| patdk-lap | he should be able to substain >4GB/sec with his cpu | 21:48 |
| qman__ | wonder if my filesystem is fragmented | 21:49 |
| qman__ | using ext3 | 21:49 |
| RoyK | patdk-lap: you'll need a rather large amount of drives for that... | 21:49 |
| qman__ | and it was >90% before I added the last four disks | 21:49 |
| air_ | RoyK: thanks. and in this case, what does regular scrubbing mean? :) | 21:49 |
| patdk-lap | royk, therefor raid6 hsouldn't be his issue :) | 21:49 |
| qman__ | but even before that it was not that great | 21:49 |
| patdk-lap | oh, ext* with >85% is slow as hell | 21:49 |
| RoyK | air_: echo check >> /sys/block/mdX/md/sync_action | 21:50 |
| patdk-lap | it takes longer and longer for it to locate a free block | 21:50 |
| patdk-lap | I have had ext3 wait several minutes to locate a free block before, when I was at 99% | 21:50 |
| qman__ | it's 57% now | 21:50 |
| RoyK | patdk-lap: heh - ever tried zfs with 95% full VDEVs? | 21:50 |
| patdk-lap | royk, nope, only been to 76% so far :) | 21:50 |
| RoyK | at > 90% full VDEVs, ZFS is dead slow | 21:51 |
| qman__ | when I have some spare cash I'll get more disks and redo it, but until then I can't touch it because I don't have anywhere to back up all my data | 21:51 |
| patdk-lap | but if you used a 256k stripe size, raid6 would have to read that 256k from each drive, then write out atleast 3 drives | 21:51 |
| patdk-lap | if you only write 4k :( | 21:51 |
| qman__ | 64k chunk | 21:52 |
| patdk-lap | that shouldn't be too bad | 21:52 |
| RoyK | qman__: what sort of i/o pattern? | 21:52 |
| qman__ | well, mostly large files just being placed | 21:52 |
| qman__ | but I also run torrentflux, so when that's downloading I'd understand | 21:53 |
| qman__ | but when it's just seeding it doesn't make much sense | 21:53 |
| qman__ | or not running at all | 21:53 |
| RoyK | seeding torrents means large number of random i/o | 21:54 |
| patdk-lap | ya, not as bad as downloading, but still lots of random reads | 21:55 |
| * RoyK wonders when linux will get something like l2arc | 22:01 | |
| patdk-lap | thought it did | 22:03 |
| patdk-lap | flashcache | 22:03 |
| patdk-lap | works for both l2arc and zil | 22:03 |
| RoyK | all google can tell me about flashcache is something mysql centric | 22:06 |
| patdk-lap | well, it was originally designed to maky facebook mysql faster | 22:06 |
| qman__ | future plans have the torrents staged on a separate file system, probably a single disk, to alleviate that problem | 22:06 |
| patdk-lap | qman, I did that | 22:07 |
| patdk-lap | that drive couldn't substain >4MB/sec transfers cause of that | 22:07 |
| qman__ | maybe a raid 0 then | 22:07 |
| qman__ | but either way, get them off the main data storage to speed it up | 22:08 |
| RoyK | qman__: or a nice set of striped mirrors on zfs :P | 22:08 |
| qman__ | I also want something with checksums, I've had video files get some corruption a number of times | 22:08 |
| qman__ | disks are so unreliable these days | 22:08 |
| patdk-lap | heh, checksums don't help unreliable disks | 22:09 |
| patdk-lap | they can only say, you have an issue | 22:09 |
| RoyK | patdk-lap: it helps you detect the problem and with sufficient redundancy, to fix it | 22:09 |
| patdk-lap | and disks are suppost to have ecc data, rs code | 22:09 |
| qman__ | I mean in the filesystem, to detect when a file gets written wrong | 22:09 |
| patdk-lap | but seems mostly useless | 22:09 |
| RoyK | patdk-lap: they have ECC all the way, but with the amount of data available today, those ECC algorithms, or sizes, aren't good enough | 22:10 |
| patdk-lap | https://wiki.archlinux.org/index.php/Flashcache | 22:11 |
| patdk-lap | royk, well it more that | 22:11 |
| patdk-lap | when they went to 4k disks, they used a crapload less ecc data | 22:11 |
| patdk-lap | and also, those sectors are so small, the ecc data is also getting destroyed too | 22:11 |
| patdk-lap | the physical size of the sector on disk | 22:11 |
| RoyK | thus, use a filesystem with checksumming :P | 22:12 |
| * patdk-lap would gladdly replace checksumming with ecc data :) | 22:12 | |
| patdk-lap | hmm, normal 512bytes sector has 40bytes ecc | 22:13 |
| patdk-lap | a 4k sector has 100bytes | 22:14 |
| patdk-lap | wish I had the 4k sector with full 320bytes ecc | 22:15 |
| patdk-lap | but guess they said, it wasn't needed | 22:15 |
| RoyK | seems flashcache isn't in oneiric | 22:15 |
| patdk-lap | nope | 22:16 |
| RoyK | perhaps in debian sid :P | 22:16 |
| RoyK | but sid is the kid that tend to break toys.... | 22:16 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!
