p7ank5te7 | I'm trying to change my hard drive out on my home server, which is just a single disk, and trying to go to a Raid 1, but I'm not understanding how I can do this. | 00:36 |
---|---|---|
p7ank5te7 | Can anyone give me a few pointers? | 00:36 |
p7ank5te7 | Also to top it off, when the server was built, it appears that only 2 partitions were made, 1 being the root( / ) and 1 being the swap. Does that pose additional problems | 00:37 |
RoyK | p7ank5te7: create a new raid-1 with a missing drive on the other drive and copy the data over | 00:39 |
RoyK | you can't convert a normal partition to a raid-1 | 00:39 |
p7ank5te7 | See my problem is with the tutorials, they say I'm supposed to have root, boot, and swap partitions but I only have root and swap? | 00:40 |
RoyK | then create a small boot partition on the new drive | 00:44 |
RoyK | copy /boot there | 00:44 |
RoyK | use lvm for the rest | 00:45 |
RoyK | if you're new to linux, ask, it may take some turns to get it fixed right | 00:45 |
RoyK | or - just use partitions - one for /boot, one for the root, and one for swap | 00:46 |
p7ank5te7 | I am still a bit new to it, at least for the partitions and stuff, I have been learning slowly but surely. | 00:46 |
RoyK | then just use partitions for now | 00:46 |
RoyK | fdisk /dev/whatever | 00:46 |
RoyK | create a small boot partition, max 1GB | 00:46 |
RoyK | then the swap, then the root | 00:46 |
RoyK | swap should be on the start of the disk, since that's fastest | 00:47 |
RoyK | but start with the boot partition | 00:47 |
RoyK | then mount the lot in /mnt or smoewhere and rsync -avPHAx / /mnt | 00:48 |
RoyK | as in, mount the root on /mnt | 00:48 |
RoyK | create /mnt/boot | 00:48 |
RoyK | mount /boot there as well | 00:48 |
RoyK | and then do the rsync | 00:49 |
RoyK | then install grub on the new drive | 00:49 |
RoyK | try to reboot into it | 00:49 |
p7ank5te7 | RoyK, I appreciate it, so let me make sure I understand, create the partitions on the "Extra" drive, then rsync the content from the current to the new one, install grub, and try it? | 00:50 |
RoyK | p7ank5te7: erm | 00:51 |
RoyK | p7ank5te7: I think you'll need to do this slowly | 00:52 |
RoyK | p7ank5te7: first, create a partition for boot, swap and root | 00:52 |
p7ank5te7 | Sorry for being a complete idiot with this. | 00:52 |
RoyK | no, I was giving wrong advice | 00:53 |
RoyK | create these partitions as raid partitions | 00:53 |
RoyK | then create raid devices on them with something like "mdadm --create --level=1 --raid-devices=2 /dev/sdXY missing" | 00:54 |
RoyK | meaning you create a degraded raid on each of them | 00:54 |
RoyK | then create raid devices on them with something like "mdadm --create --level=1 --raid-devices=2 /dev/md0 /dev/sdXY missing" | 00:54 |
RoyK | etc | 00:54 |
RoyK | md0 md1 etc | 00:54 |
RoyK | one for each partition | 00:54 |
RoyK | then mount the root on /mnt or somewhere and create /mnt/boot, mount the boot partition there, and do the rsync | 00:55 |
RoyK | then install grub on the new system | 00:56 |
p7ank5te7 | So mount my current setup on mount then mount md0(boot) as /mnt/boot is that right? | 00:56 |
RoyK | p7ank5te7: yes | 01:00 |
RoyK | p7ank5te7: just make sure you mount the new raid on -mnt first | 01:00 |
RoyK | p7ank5te7: /mnt/even | 01:00 |
RoyK | p7ank5te7: /mnt even | 01:01 |
=== Madkiss_ is now known as Madkiss | ||
p7ank5te7 | Ok. So I follow now, mount the raid root as "/mnt" then the raid boot as "/mnt/boot" | 01:03 |
=== Ursinha-afk is now known as Ursinha | ||
RoyK | p7ank5te7: mount raid root on /mnt, mkdir /mnt/boot, mount raid boot on /mnt/boot, do the rsync | 01:08 |
RoyK | install grub | 01:08 |
RoyK | try to reboot into that - should work | 01:08 |
=== heathjs is now known as heath | ||
p7ank5te7 | Let's see if it works | 01:12 |
=== ejnahc_ is now known as ejnahc | ||
=== phunyguy_ is now known as phunyguy | ||
p7ank5te7 | RoyK, i'm up to the Rsync part. As far as install grub, when I do that, just purge it and reinstall it and have it set to the secondary drive? | 01:37 |
=== Sargun_ is now known as Sargun | ||
RoyK | p7ank5te7: install-grub /dev/blah | 02:03 |
RoyK | typically /dev/md0 | 02:06 |
p7ank5te7 | Will that work with grub 2? | 02:11 |
RoyK | yes | 02:14 |
RoyK | but gotta go - time's like 4:15 | 02:15 |
amarcolino | Hi, I have added myself to the web group (www-data), when creating a directory the ownership goes to the user then the group (foobar:www..) is there a way to set it to the group then owner or what I would like is to keep it as the group but still permit me the user to add, delete and read files? | 02:35 |
=== Guest49957 is now known as jrib | ||
heyman | I have an emergency for work! I'm having problems mounting devices so I decided that I'll try wget or curl or something to retrieve the files from another location. | 02:37 |
heyman | Are we able to use ubuntu one with server, or even dropbox? I just need a simple solution to get two small files on my ubuntu server vm | 02:38 |
amarcolino | dropbox has a command interface so yes, n a quick check on google has given me to support what I thought http://rbgeek.wordpress.com/2012/08/19/how-to-install-and-configure-dropbox-on-ubuntu-server-12-04-lts/ | 02:44 |
amarcolino | I assume ubuntu one would be the same but I havent checked | 02:46 |
heyman | thanks amarcolino | 02:57 |
=== roasted_ is now known as roasted | ||
Komplex | Can anyone answer a question? | 04:42 |
Komplex | Considering moving multiple services that are currently running on winblowz servers presently. Does anyone know if 12.10 or 13.04 server edition fully utilizes the RAM on a machine? | 04:44 |
Komplex | for some reason I am only seeing 8 gigs out of 16 on a box I installed it on... just seemed odd... wanted to see if anyone ran into the same issue or not... thanks for your time. | 04:45 |
=== blkperl_ is now known as blkperl | ||
=== DasIch_ is now known as DasIch | ||
Quest | i dont see any /var/log/fail2ban.log . the iptables and service fail2ban status says that fail2ban is running fine.. any clue? | 07:42 |
=== klaas- is now known as klaas | ||
Quest | i would say then which distros are best for servers if wanted to be free and maintain our selfs? | 08:08 |
Quest | ports can be forwarded by routers/switches and NATing can be done. how to do that if the thats a linux server instead? | 10:23 |
dassouki | what is the terminal command that goes through the folder / file sizes and let's you go through them like if it were explorer | 10:24 |
dassouki | i remember it starts with "n" ? | 10:24 |
bekks | dassouki: "find" and "du -sh" :) | 10:31 |
dassouki | ya i use those two but there was a command app, that cycles through your folders and displays the info in a tree, so you can go deeper into a folder, etc | 10:33 |
=== hodge is now known as Hodgestar | ||
=== sygnous_ is now known as sygnous | ||
=== Jever| is now known as Jevermeister | ||
=== sygnous is now known as malikeye | ||
=== malikeye is now known as sygnous | ||
amarcolino | Hi, I have added myself to the web group (www-data), when creating a directory the ownership goes to the user then the group (foobar:www..) is there a way to set it to the group then owner or what I would like is to keep it as the group but still permit me the user to add, delete and read files? | 13:31 |
qman__ | amarcolino, www-data is the user the web server runs as and should not own any files; you should create a new group for website file ownership | 14:30 |
qman__ | take note that, out of the box, all files in /var/www are owned by root, not www-data | 14:31 |
amarcolino | I've already changed ownership to the www directory as well as adding myself to the www-data group, however, the issue is when I add files or directories www-data gets second ownership, which is not helpful because some directories and files can't be auto-updated since the web group is meant to have full access, so I am wondering how I can solve this and if it is possible other then manually changing ownership? | 14:34 |
RoyK | anepanal1ptos: chmod +t /var/www | 14:41 |
RoyK | that should make group ownership stick | 14:41 |
amarcolino | RoyK, will try that even knowing it was intended for someone else | 14:44 |
RoyK | heh - sorry ;) | 14:45 |
RoyK | chmod g+t, perhaps | 14:46 |
amarcolino | RoyK, no good, if I were to create a test directory ownership would be my username and group would be www-data, however, I just thought that wouldn't be a problem if everytime something is created it would be given read and write permission by default, which it isn't | 15:03 |
amarcolino | Royk, thanks I will work on this when I have more time | 15:05 |
RoyK | then the umask is wrong | 15:05 |
amarcolino | Royk, how would I check the umask? | 15:07 |
userr | chat clients disconnect (after a while) when i switch to another Xorg server (by using ctrl+alt+F8). how does the former Xorg server ("at F7") tell that i switched away from it? i need to suppress that. | 15:15 |
RoyK | amarcolino: depends on how you upload things | 15:24 |
bjrohan | In my home directroy in Ubunty server, I have a file "=" what is this file? | 17:52 |
bjrohan | cat "=" gives 13.04 12.10 | 17:53 |
jacobw | bjrohan: That's not part of the distribution | 17:56 |
shauno | seems a pretty sane guess that it's a mistake somewhere. something that's directing when its meant to be comparing | 17:57 |
bjrohan | Hmm. I installed the distro fresh, installed KDE, and alfresco (with tomcat, sql etc) that is all | 17:58 |
jacobw | There's might be an error in the Alfresco installer that creates that file in $PWD | 18:01 |
jacobw | bjrohan: Did the installer exit successfully? | 18:06 |
bjrohan | Yes | 18:06 |
jacobw | In that case, I'd remove the file and carry on | 18:06 |
bjrohan | Ok. I am the owner of the file | 18:07 |
jacobw | If you ran the script as your user, you'll be owner of any files created by the script | 18:07 |
bjrohan | What would the ownership look like if it was something that was created during the dist install? | 18:10 |
bjrohan | Also, I encrypted the user home directories on install. Given this, can I using sudo 1.) see, or 2.) access files in another users encrypted directory? | 18:12 |
bjrohan | Say the file and dir both do NOT have not permissions granted to anyone but the user | 18:14 |
jacobw | sudo ecryptfs-recover-private | 18:16 |
bjrohan | jacobw: If I am understanding right, that is a way to recover encrypted data if one knows the passphrase (say a hdd craps out and you can no longer boot from it, use this command from a livecd to recover the date)? | 18:22 |
jacobw | That's right | 18:23 |
jacobw | bjrohan: ecyptfs volumes are mounted when the user logs in and unmounted when the user logs out | 18:24 |
bjrohan | To get down to brass tacks, if users home directories are encrypted, I as the sys admin, can not use sudo to access their files b/c I don't have their passphrase, whereas if it is NOT encrypted, I can use sudo to access the files. | 18:24 |
jacobw | That's right | 18:24 |
bjrohan | Nice, I understood it correctly :-) | 18:24 |
jacobw | bjrohan: You can see their files when they're logged in because you have root access to the filesystem and their encrypted data is mounted in the filesystem | 18:26 |
jacobw | bjrohan: When they're logged out, their encrypted data is just an encrypted file that you don't have the passphrase to | 18:27 |
bjrohan | That makes sense :-) | 18:27 |
bjrohan | Thank you for the info | 18:28 |
jacobw | bjrohan: However, there's the passphrase and the encryption key, the passphrase is just a wrapper around the encryption key. If you have the encryption key you can always decrypt the file | 18:28 |
jacobw | bjrohan: The encryption key cannot change after the file is created, if you log the encryption key when the ecryptfs is created, you can access it whenever you want | 18:29 |
jacobw | bjrohan: The passphrase is just a way of accessing the encrypted encryption key on disk with the login password | 18:30 |
bjrohan | Very similar to GPG | 18:32 |
jacobw | It's the same scheme | 18:32 |
Jeeves_Moss | what would cause a SSH session to hang during a write to a new ZFS tank? I just made a new tank with RAIDZ2, and now when I move anything larger than a 1Gb file, it locks up | 19:00 |
RoyK | Jeeves_Moss: zfs-fuse? | 19:09 |
three18ti | do apparmor profiles use "#" for comments? | 19:09 |
three18ti | this is my /etc/apparmor.d/libvirt/TEMPLATE: http://paste.scsys.co.uk/247709 | 19:10 |
three18ti | #include <abstractions/libvirt-qemu> | 19:10 |
Jeeves_Moss | RoyK, no, native | 19:10 |
three18ti | is that actually including anything? | 19:10 |
Jeeves_Moss | RoyK, there dosen't look to be any disk activity | 19:10 |
RoyK | Jeeves_Moss: ubuntu doesn't have native zfs | 19:11 |
Jeeves_Moss | apt-get install ubuntu-zfs | 19:11 |
RoyK | no such package | 19:12 |
Jeeves_Moss | RoyK, and have they fixed the expand features so you can add disks to a pool to expand the sapace? | 19:12 |
Jeeves_Moss | RoyK, ubuntu-zfs is already the newest version. | 19:13 |
RoyK | Jeeves_Moss: it's not in the repos | 19:15 |
=== wizonesolutions_ is now known as wizonesolutions | ||
Jeeves_Moss | RoyK, I literly just ran it | 19:16 |
RoyK | E: Unable to locate package ubuntu-zfs | 19:16 |
RoyK | that's on raring | 19:16 |
RoyK | and quantal | 19:16 |
Jeeves_Moss | https://launchpad.net/~zfs-native/+archive/stable/ | 19:16 |
RoyK | yes, it's a ppa | 19:17 |
Jeeves_Moss | yea | 19:17 |
RoyK | not official ubuntu | 19:17 |
Jeeves_Moss | hummm | 19:17 |
Jeeves_Moss | I'm wondering if I should roll the data out of the tank and fire up the fuse version | 19:17 |
=== Jikan is now known as Jikai | ||
RoyK | I've been working with zfs for some years | 19:19 |
RoyK | on opensolaris/openindiana | 19:19 |
RoyK | and it's brilliant for its use, but I chose md for my home server | 19:20 |
RoyK | zfs lacks flexibility | 19:20 |
blkperl | how does zfs lack flexibility? | 19:21 |
blkperl | zfsonlinux works rather well on ubuntu | 19:22 |
jacobw | It depends what you need, most of the components of ZFS are available in other stacks | 19:24 |
jacobw | RAID/LVM is simple, COW isn't | 19:24 |
Jeeves_Moss | ugh, this lockup is pissing me off | 19:27 |
Jeeves_Moss | how can I track IO issues | 19:27 |
jacobw | Jeeves_Moss: iotop | 19:28 |
jacobw | Jeeves_Moss: Also, see IO wait/delay in top and other things | 19:28 |
Jeeves_Moss | jacobw, shows nothing moving | 19:28 |
jacobw | Jeeves_Moss: Do you see anything in syslog/dmesg/kernlog? | 19:30 |
Jeeves_Moss | jacobw, checking. I've tried moiving from USB to the root disk, and everything works. It just locks up when I try to write to the ZFS tank | 19:30 |
Jeeves_Moss | jacobw, failed: use vmalloc=<size> to increase size. | 19:32 |
=== Jikai is now known as Jikan | ||
=== lifeless_ is now known as lifeless | ||
RoyK | blkperl: you can't add more drives to a VDEV | 19:42 |
RoyK | blkperl: you can't rebalance a pool if more VDEVs are added | 19:43 |
RoyK | blkperl: really, it's just fixed - it's good for well-planned long-term storage, but not if you want it flexible | 19:43 |
RoyK | blkperl: and you can't change RAIDz levels either | 19:44 |
RoyK | nothing can be changed | 19:44 |
Jeeves_Moss | yea. once it's built, you're kinda effed | 19:45 |
Jeeves_Moss | this one is for a storage pool for VMs | 19:45 |
RoyK | zfs rocks - but it's not very flexible - that's my motto | 19:46 |
jacobw | It's flexible if you have a large array | 19:46 |
RoyK | no, it's not | 19:46 |
RoyK | you can add a new VDEV, ok, but it won't rebalance the raid | 19:46 |
jacobw | vdev being a block device? | 19:47 |
jacobw | LV/whatever the ZFS term is | 19:47 |
RoyK | that'll require the block pointer rewrite, which was posted as an idea some four year back | 19:47 |
RoyK | but never implemented | 19:47 |
RoyK | a vdev is a mirror or a raidz? | 19:48 |
RoyK | zpool create mirror d1 d2 mirror d3 d4 | 19:49 |
RoyK | makes two vdevs | 19:49 |
jacobw | I haven't heard the term vdev before | 19:49 |
RoyK | heh | 19:49 |
RoyK | then you don't know zfs | 19:49 |
jacobw | Well, I don't | 19:49 |
jacobw | Now Unity has crashed :| | 19:50 |
RoyK | zpool create asdf raidz2 d1 d2 d3 d3 d4 raidz2 d5 d6 d7 d8 d9 | 19:50 |
RoyK | two vdes | 19:50 |
RoyK | vdevs | 19:50 |
RoyK | (albeit bad syntax) | 19:51 |
blkperl | RoyK: ah ok, yep those things will probably be around for a long time | 19:51 |
jacobw | OK, so vdevs are PV in the LV group in ZFS terminology? | 19:51 |
jacobw | http://pthree.org/2012/12/04/zfs-administration-part-i-vdevs/ | 19:54 |
jacobw | :) | 19:54 |
RoyK | jacobw: really, I've been working with zfs for 3 years or so :P | 19:55 |
jacobw | OK | 19:56 |
RoyK | no, in LVM terminalogy, a PV is a disk, a VDEV is a group of disks set in a mirror or raidz-something | 19:57 |
jacobw | I see | 19:57 |
RoyK | better use MD if you want flexibility | 19:57 |
RoyK | chances for silent errors are rather low with small volumes, as in <20TB | 19:58 |
RoyK | or <100TB even | 19:58 |
jacobw | Agreed | 19:58 |
jacobw | Er, silent errors? As in write holes? | 19:59 |
RoyK | silent errors are when the drive doesn't report an error but delivers bad data | 19:59 |
jacobw | I see | 19:59 |
RoyK | whenever they get bp rewrite into zfs, it'll be fun | 20:00 |
jacobw | What do you mean by rebalance the RAID? | 20:00 |
jacobw | BP? | 20:00 |
RoyK | block pointer rewrite | 20:01 |
RoyK | if you add another drive to an md raid, it'll re-balance the data | 20:02 |
RoyK | if you add another vdev to zfs, it won't do much, just try to smear the data over the lot | 20:03 |
RoyK | rebalancing means moving the data over the existing vdevs to make performance better | 20:03 |
jacobw | I see | 20:03 |
=== highvolt1ge is now known as highvoltage | ||
jacobw | What kind of performance difference does that make? | 20:05 |
jacobw | I didn't know mdraid did that | 20:06 |
RoyK | jacobw: it means new writes will only go to the new vdev | 20:13 |
RoyK | earlier it would make the zfs performance almost halt, but that's been fixed | 20:13 |
jacobw | I see | 20:16 |
jacobw | It sounds as if rebalancing is different the RAID and ZFS contexts | 20:16 |
jacobw | I'm trying to find references to it and hitting a lot articles about distributed filesystems like GlusterFS and proprietary SAN stuff | 20:18 |
RoyK | glusterfs comes on top of zfs or md | 20:24 |
RoyK | zfs is fine if you have a fixed set of disks and can plan things well | 20:25 |
RoyK | if you want to add more disks, it gets complicated | 20:25 |
Quest | In Linux, how is it possible to merge/combine 3 internet connections (Dsl/fiber) (actually by eth1,2,3) and supply those to eth4. many client can be connected on a switch that is connected to eth4 of the server. The server does the load balancing and if one eth of 1,2,3, goes down. it shifts traffic to remaining 1,2. I have seen this in microtck router. How is it possible in Linux? | 20:26 |
RoyK | Quest: see http://www.lartc.org/ | 20:28 |
RoyK | Quest: it's not trivial, but quite doable | 20:28 |
Quest | RoyK, hm. thats how microtick did it? | 20:32 |
RoyK | Quest: well, just try | 20:34 |
Quest | where to start | 20:34 |
RoyK | read the docs, for a start | 20:34 |
Quest | oh ok | 20:34 |
codepython777 | is there a way to put a network bandwidth quota on each user when the network usage reaches above certain threshold? (something easy to use compared to ip tables) | 20:56 |
=== heath is now known as data_scientist | ||
=== data_scientist is now known as data_astronaut | ||
jacobw | Quest: Mikrotik RouterOS can bond interfaces using LACP, if that's what you want to do | 21:16 |
=== data_astronaut is now known as heath | ||
Quest | jacobw, what is lacp? | 21:20 |
jacobw | Quest: If you want to balance sessions over 3 subnets read those docs, and have a look at this, http://parkersamp.com/2010/03/howto-using-linux-as-a-simple-load-balancer-nat-router-firewall/ | 21:21 |
jacobw | Quest: Link Aggregation Control Protocol, it combines Ethernet ports in to channels, like port channel | 21:23 |
Quest | hm\ | 21:23 |
Quest | jacobw, i thought they used http://lartc.org/howto/lartc.rpdb.multiple-links.html | 21:24 |
Quest | jacobw, and i think you have experience with mikrotick OS. its linux of their own? or theres some underlying os they use like centos or ubuntu? | 21:24 |
jacobw | Quest: I wasn't sure what you were talking about at first | 21:25 |
Quest | jacobw, and i think you have experience with mikrotick OS. its linux of their own? or theres some underlying os they use like centos or ubuntu? | 21:26 |
jacobw | Quest: RouterOS is Linux based, but Mikrotik have replaced parts of the networking stack and included in house implementations of things like MPLS | 21:28 |
jacobw | Quest: If you look at the firewall interface, it's quite clearly iptables | 21:28 |
Quest | hm | 21:29 |
Quest | jacobw, i was wondering if it uses a known os underneath so i can use a package manager and install apps further in it? | 21:29 |
jacobw | Quest: No, that's certainly not possible :) | 21:30 |
Quest | :( | 21:32 |
jacobw | Quest: RouterOS uses the Linux kernel only, it uses Mikrotik own userspace | 21:33 |
Quest | hm. thanks | 21:34 |
Quest | it will take quite long for me to do what mikrotik doesn, in pure linux and iptables | 21:34 |
jacobw | Quest: http://wiki.mikrotik.com/wiki/Manual:IP/Route#Multipath_.28ECMP.29_routes | 21:35 |
jacobw | Quest: The page you just linked from LARTC has everything you need for your scenario | 21:37 |
Quest | jacobw, thanks! | 21:41 |
=== bobbyz_ is now known as bobbyz |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!