[00:36] <p7ank5te7> I'm trying to change my hard drive out on my home server, which is just a single disk, and trying to go to a Raid 1, but I'm not understanding how I can do this.
[00:36] <p7ank5te7> Can anyone give me a few pointers?
[00:37] <p7ank5te7> Also to top it off, when the server was built, it appears that only 2 partitions were made, 1 being the root( / ) and 1 being the swap. Does that pose additional problems
[00:39] <RoyK> p7ank5te7: create a new raid-1 with a missing drive on the other drive and copy the data over
[00:39] <RoyK> you can't convert a normal partition to a raid-1
[00:40] <p7ank5te7> See my problem is with the tutorials, they say I'm supposed to have root, boot, and swap partitions but I only have root and swap?
[00:44] <RoyK> then create a small boot partition on the new drive
[00:44] <RoyK> copy /boot there
[00:45] <RoyK> use lvm for the rest
[00:45] <RoyK> if  you're new to linux, ask, it may take some turns to get it fixed right
[00:46] <RoyK> or - just use partitions - one for /boot, one for the root, and one for swap
[00:46] <p7ank5te7> I am still a bit new to it, at least for the partitions and stuff, I have been learning slowly but surely.
[00:46] <RoyK> then just use partitions for now
[00:46] <RoyK> fdisk /dev/whatever
[00:46] <RoyK> create a small boot partition, max 1GB
[00:46] <RoyK> then the swap, then the root
[00:47] <RoyK> swap should be on the start of the disk, since that's fastest
[00:47] <RoyK> but start with the boot partition
[00:48] <RoyK> then mount the lot in /mnt or smoewhere and rsync -avPHAx / /mnt
[00:48] <RoyK> as in, mount the root on /mnt
[00:48] <RoyK> create /mnt/boot
[00:48] <RoyK> mount /boot there as well
[00:49] <RoyK> and then do the rsync
[00:49] <RoyK> then install grub on the new drive
[00:49] <RoyK> try to reboot into it
[00:50] <p7ank5te7> RoyK, I appreciate it, so let me make sure I understand, create the partitions on the "Extra" drive, then rsync the content from the current to the new one, install grub, and try it?
[00:51] <RoyK> p7ank5te7: erm
[00:52] <RoyK> p7ank5te7: I think you'll need to do this slowly
[00:52] <RoyK> p7ank5te7: first, create a partition for boot, swap and root
[00:52] <p7ank5te7> Sorry for being a complete idiot with this.
[00:53] <RoyK> no, I was giving wrong advice
[00:53] <RoyK> create these partitions as raid partitions
[00:54] <RoyK> then create raid devices on them with something like "mdadm --create --level=1 --raid-devices=2 /dev/sdXY missing"
[00:54] <RoyK> meaning you create a degraded raid on each of them
[00:54] <RoyK> then create raid devices on them with something like "mdadm --create --level=1 --raid-devices=2 /dev/md0 /dev/sdXY missing"
[00:54] <RoyK> etc
[00:54] <RoyK> md0 md1 etc
[00:54] <RoyK> one for each partition
[00:55] <RoyK> then mount the root on /mnt or somewhere and create /mnt/boot, mount the boot partition there, and do the rsync
[00:56] <RoyK> then install grub on the new system
[00:56] <p7ank5te7> So mount my current setup on mount then mount md0(boot) as /mnt/boot is that right?
[01:00] <RoyK> p7ank5te7: yes
[01:00] <RoyK> p7ank5te7: just make sure you mount the new raid on -mnt first
[01:00] <RoyK> p7ank5te7: /mnt/even
[01:01] <RoyK> p7ank5te7: /mnt even
[01:03] <p7ank5te7> Ok. So I follow now, mount the raid root as "/mnt" then the raid boot as "/mnt/boot"
[01:08] <RoyK> p7ank5te7: mount raid root on /mnt, mkdir /mnt/boot, mount raid boot on /mnt/boot, do the rsync
[01:08] <RoyK> install grub
[01:08] <RoyK> try to reboot into that - should work
[01:12] <p7ank5te7> Let's see if it works
[01:37] <p7ank5te7> RoyK, i'm up to the Rsync part. As far as install grub, when I do that, just purge it and reinstall it and have it set to the secondary drive?
[02:03] <RoyK> p7ank5te7: install-grub /dev/blah
[02:06] <RoyK> typically /dev/md0
[02:11] <p7ank5te7> Will that work with grub 2?
[02:14] <RoyK> yes
[02:15] <RoyK> but gotta go - time's like 4:15
[02:35] <amarcolino> Hi, I have added myself to the web group (www-data), when creating a directory the ownership goes to the user then the group (foobar:www..) is there a way to set it to the group then owner or what I would like is to keep it as the group but still permit me the user to add, delete and read files?
[02:37] <heyman> I have an emergency for work! I'm having problems mounting devices so I decided that I'll try wget or curl or something to retrieve the files from another location.
[02:38] <heyman> Are we able to use ubuntu one with server, or even dropbox? I just need a simple solution to get two small files on my ubuntu server vm
[02:44] <amarcolino> dropbox has a command interface so yes, n a quick check on google has given me to support what I thought http://rbgeek.wordpress.com/2012/08/19/how-to-install-and-configure-dropbox-on-ubuntu-server-12-04-lts/
[02:46] <amarcolino> I assume ubuntu one would be the same but I havent checked
[02:57] <heyman> thanks amarcolino
[04:42] <Komplex> Can anyone answer a question?
[04:44] <Komplex> Considering moving multiple services that are currently running on winblowz servers presently.  Does anyone know if 12.10 or 13.04 server edition fully utilizes the RAM on a machine?
[04:45] <Komplex> for some reason I am only seeing 8 gigs out of 16 on a box I installed it on... just seemed odd... wanted to see if anyone ran into the same issue or not... thanks for your time.
[07:42] <Quest> i dont see any /var/log/fail2ban.log . the  iptables and service  fail2ban status says that fail2ban is running fine.. any clue?
[08:08] <Quest> i would say then which distros are best for servers if wanted to be free and maintain our selfs?
[10:23] <Quest> ports can be forwarded by routers/switches and NATing can be done. how to do that if the thats a linux server instead?
[10:24] <dassouki> what is the terminal command that goes through the folder / file sizes and let's you go through them like if it were explorer
[10:24] <dassouki> i remember it starts with "n" ?
[10:31] <bekks> dassouki: "find" and "du -sh" :)
[10:33] <dassouki> ya i use those two but there was a command app, that cycles through your folders and displays the info in a tree, so you can go deeper into a folder, etc
[13:31] <amarcolino> Hi, I have added myself to the web group (www-data), when creating a directory the ownership goes to the user then the group (foobar:www..) is there a way to set it to the group then owner or what I would like is to keep it as the group but still permit me the user to add, delete and read files?
[14:30] <qman__> amarcolino, www-data is the user the web server runs as and should not own any files; you should create a new group for website file ownership
[14:31] <qman__> take note that, out of the box, all files in /var/www are owned by root, not www-data
[14:34] <amarcolino> I've already changed ownership to the www directory as well as adding myself to the www-data group, however, the issue is when I add files or directories www-data gets second ownership, which is not helpful because some directories and files can't be auto-updated since the web group is meant to have full access, so I am wondering how I can solve this and if it is possible other then manually changing ownership?
[14:41] <RoyK> anepanal1ptos: chmod +t /var/www
[14:41] <RoyK> that should make group ownership stick
[14:44] <amarcolino> RoyK, will try that even knowing it was intended for someone else
[14:45] <RoyK> heh - sorry ;)
[14:46] <RoyK> chmod g+t, perhaps
[15:03] <amarcolino> RoyK, no good, if I were to create a test directory ownership would be my username and group would be www-data, however, I just thought that wouldn't be a problem if everytime something is created it would be given read and write permission by default, which it isn't
[15:05] <amarcolino> Royk, thanks I will work on this when I have more time
[15:05] <RoyK> then the umask is wrong
[15:07] <amarcolino> Royk, how would I check the umask?
[15:15] <userr> chat clients disconnect (after a while) when i switch to another Xorg server (by using ctrl+alt+F8). how does the former Xorg server ("at F7") tell that i switched away from it? i need to suppress that.
[15:24] <RoyK> amarcolino: depends on how you upload things
[17:52] <bjrohan> In my home directroy in Ubunty server, I have a file "=" what is this file?
[17:53] <bjrohan> cat "=" gives 13.04 12.10
[17:56] <jacobw> bjrohan: That's not part of the distribution
[17:57] <shauno> seems a pretty sane guess that it's a mistake somewhere.  something that's directing when its meant to be comparing
[17:58] <bjrohan> Hmm. I installed the distro fresh, installed KDE, and alfresco (with tomcat, sql etc) that is all
[18:01] <jacobw> There's might be an error in the Alfresco installer that creates that file in $PWD
[18:06] <jacobw> bjrohan: Did the installer exit successfully?
[18:06] <bjrohan> Yes
[18:06] <jacobw> In that case, I'd remove the file and carry on
[18:07] <bjrohan> Ok. I am the owner of the file
[18:07] <jacobw> If you ran the script as your user, you'll be owner of any files created by the script
[18:10] <bjrohan> What would the ownership look like if it was something that was created during the dist install?
[18:12] <bjrohan> Also, I encrypted the user home directories on install. Given this, can I using sudo 1.) see, or 2.) access files in another users encrypted directory?
[18:14] <bjrohan> Say the file and dir both do NOT have not permissions granted to anyone but the user
[18:16] <jacobw> sudo ecryptfs-recover-private
[18:22] <bjrohan> jacobw: If I am understanding right, that is a way to recover encrypted data if one knows the passphrase (say a hdd craps out and you can no longer boot from it, use this command from a livecd to recover the date)?
[18:23] <jacobw> That's right
[18:24] <jacobw> bjrohan: ecyptfs volumes are mounted when the user logs in and unmounted when the user logs out
[18:24] <bjrohan> To get down to brass tacks, if users home directories are encrypted, I as the sys admin, can not use sudo to access their files b/c I don't have their passphrase, whereas if it is NOT encrypted, I can use sudo to access the files.
[18:24] <jacobw> That's right
[18:24] <bjrohan> Nice, I understood it correctly :-)
[18:26] <jacobw> bjrohan: You can see their files when they're logged in because you have root access to the filesystem and their encrypted data is mounted in the filesystem
[18:27] <jacobw> bjrohan: When they're logged out, their encrypted data is just an encrypted file that you don't have the passphrase to
[18:27] <bjrohan> That makes sense :-)
[18:28] <bjrohan> Thank you for the info
[18:28] <jacobw> bjrohan: However, there's the passphrase and the encryption key, the passphrase is just a wrapper around the encryption key. If you have the encryption key you can always decrypt the file
[18:29] <jacobw> bjrohan: The encryption key cannot change after the file is created, if you log the encryption key when the ecryptfs is created, you can access it whenever you want
[18:30] <jacobw> bjrohan: The passphrase is just a way of accessing the encrypted encryption key on disk with the login password
[18:32] <bjrohan> Very similar to GPG
[18:32] <jacobw> It's the same scheme
[19:00] <Jeeves_Moss> what would cause a SSH session to hang during a write to a new ZFS tank?  I just made a new tank with RAIDZ2, and now when I move anything larger than a 1Gb file, it locks up
[19:09] <RoyK> Jeeves_Moss: zfs-fuse?
[19:09] <three18ti> do apparmor profiles use "#" for comments?
[19:10] <three18ti> this is my /etc/apparmor.d/libvirt/TEMPLATE: http://paste.scsys.co.uk/247709
[19:10] <three18ti> #include <abstractions/libvirt-qemu>
[19:10] <Jeeves_Moss> RoyK, no, native
[19:10] <three18ti> is that actually including anything?
[19:10] <Jeeves_Moss> RoyK, there dosen't look to be any disk activity
[19:11] <RoyK> Jeeves_Moss: ubuntu doesn't have native zfs
[19:11] <Jeeves_Moss> apt-get install ubuntu-zfs
[19:12] <RoyK> no such package
[19:12] <Jeeves_Moss> RoyK, and have they fixed the expand features so you can add disks to a pool to expand the sapace?
[19:13] <Jeeves_Moss> RoyK, ubuntu-zfs is already the newest version.
[19:15] <RoyK> Jeeves_Moss: it's not in the repos
[19:16] <Jeeves_Moss> RoyK, I literly just ran it
[19:16] <RoyK> E: Unable to locate package ubuntu-zfs
[19:16] <RoyK> that's on raring
[19:16] <RoyK> and quantal
[19:16] <Jeeves_Moss> https://launchpad.net/~zfs-native/+archive/stable/
[19:17] <RoyK> yes, it's a ppa
[19:17] <Jeeves_Moss> yea
[19:17] <RoyK> not official ubuntu
[19:17] <Jeeves_Moss> hummm
[19:17] <Jeeves_Moss> I'm wondering if I should roll the data out of the tank and fire up the fuse version
[19:19] <RoyK> I've been working with zfs for some years
[19:19] <RoyK> on opensolaris/openindiana
[19:20] <RoyK> and it's brilliant for its use, but I chose md for my home server
[19:20] <RoyK> zfs lacks flexibility
[19:21] <blkperl> how does zfs lack flexibility?
[19:22] <blkperl> zfsonlinux works rather well on ubuntu
[19:24] <jacobw> It depends what you need, most of the components of ZFS are available in other stacks
[19:24] <jacobw> RAID/LVM is simple, COW isn't
[19:27] <Jeeves_Moss> ugh, this lockup is pissing me off
[19:27] <Jeeves_Moss> how can I track IO issues
[19:28] <jacobw> Jeeves_Moss: iotop
[19:28] <jacobw> Jeeves_Moss: Also, see IO wait/delay in top and other things
[19:28] <Jeeves_Moss> jacobw, shows nothing moving
[19:30] <jacobw> Jeeves_Moss: Do you see anything in syslog/dmesg/kernlog?
[19:30] <Jeeves_Moss> jacobw, checking.  I've tried moiving from USB to the root disk, and everything works.  It just locks up when I try to write to the ZFS tank
[19:32] <Jeeves_Moss> jacobw,  failed: use vmalloc=<size> to increase size.
[19:42] <RoyK> blkperl: you can't add more drives to a VDEV
[19:43] <RoyK> blkperl: you can't rebalance a pool if more VDEVs are added
[19:43] <RoyK> blkperl: really, it's just fixed - it's good for well-planned long-term storage, but not if you want it flexible
[19:44] <RoyK> blkperl: and you can't change RAIDz levels either
[19:44] <RoyK> nothing can be changed
[19:45] <Jeeves_Moss> yea.  once it's built, you're kinda effed
[19:45] <Jeeves_Moss> this one is for a storage pool for VMs
[19:46] <RoyK> zfs rocks - but it's not very flexible - that's my motto
[19:46] <jacobw> It's flexible if you have a large array
[19:46] <RoyK> no, it's not
[19:46] <RoyK> you can add a new VDEV, ok, but it won't rebalance the raid
[19:47] <jacobw> vdev being a block device?
[19:47] <jacobw> LV/whatever the ZFS term is
[19:47] <RoyK> that'll require the block pointer rewrite, which was posted as an idea some four year back
[19:47] <RoyK> but never implemented
[19:48] <RoyK> a vdev is a mirror or a raidz?
[19:49] <RoyK> zpool create mirror d1 d2 mirror d3 d4
[19:49] <RoyK> makes two vdevs
[19:49] <jacobw> I haven't heard the term vdev before
[19:49] <RoyK> heh
[19:49] <RoyK> then you don't know zfs
[19:49] <jacobw> Well, I don't
[19:50] <jacobw> Now Unity has crashed :|
[19:50] <RoyK> zpool create asdf raidz2 d1 d2 d3 d3 d4 raidz2 d5 d6 d7 d8 d9
[19:50] <RoyK> two vdes
[19:50] <RoyK> vdevs
[19:51] <RoyK> (albeit bad syntax)
[19:51] <blkperl> RoyK: ah ok, yep those things will probably be around for a long time
[19:51] <jacobw> OK, so vdevs are PV in the LV group in ZFS terminology?
[19:54] <jacobw> http://pthree.org/2012/12/04/zfs-administration-part-i-vdevs/
[19:54] <jacobw> :)
[19:55] <RoyK> jacobw: really, I've been working with zfs for 3 years or so :P
[19:56] <jacobw> OK
[19:57] <RoyK> no, in LVM terminalogy, a PV is a disk, a VDEV is a group of disks set in a mirror or raidz-something
[19:57] <jacobw> I see
[19:57] <RoyK> better use MD if you want flexibility
[19:58] <RoyK> chances for silent errors are rather low with small volumes, as in <20TB
[19:58] <RoyK> or <100TB even
[19:58] <jacobw> Agreed
[19:59] <jacobw> Er, silent errors? As in write holes?
[19:59] <RoyK> silent errors are when the drive doesn't report an error but delivers bad data
[19:59] <jacobw> I see
[20:00] <RoyK> whenever they get bp rewrite into zfs, it'll be fun
[20:00] <jacobw> What do you mean by rebalance the RAID?
[20:00] <jacobw> BP?
[20:01] <RoyK> block pointer rewrite
[20:02] <RoyK> if you add another drive to an md raid, it'll re-balance the data
[20:03] <RoyK> if you add another vdev to zfs, it won't do much, just try to smear the data over the lot
[20:03] <RoyK> rebalancing means moving the data over the existing vdevs to make performance better
[20:03] <jacobw> I see
[20:05] <jacobw> What kind of performance difference does that make?
[20:06] <jacobw> I didn't know mdraid did that
[20:13] <RoyK> jacobw: it means new writes will only go to the new vdev
[20:13] <RoyK> earlier it would make the zfs performance almost halt, but that's been fixed
[20:16] <jacobw> I see
[20:16] <jacobw> It sounds as if rebalancing is different the RAID and ZFS contexts
[20:18] <jacobw> I'm trying to find references to it and hitting a lot articles about distributed filesystems like GlusterFS and proprietary SAN stuff
[20:24] <RoyK> glusterfs comes on top of zfs or md
[20:25] <RoyK> zfs is fine if you have a fixed set of disks and can plan things well
[20:25] <RoyK> if you want to add more disks, it gets complicated
[20:26] <Quest>  In Linux, how is it possible to merge/combine 3 internet connections (Dsl/fiber) (actually by eth1,2,3) and supply those to eth4. many client can be connected on a switch that is connected to eth4 of the server. The server does the load balancing and if one eth of 1,2,3, goes down. it shifts traffic to remaining 1,2. I have seen this in microtck router.  How is it possible in Linux?
[20:28] <RoyK> Quest: see http://www.lartc.org/
[20:28] <RoyK> Quest: it's not trivial, but quite doable
[20:32] <Quest> RoyK,  hm. thats how microtick did it?
[20:34] <RoyK> Quest: well, just try
[20:34] <Quest> where to start
[20:34] <RoyK> read the docs, for a start
[20:34] <Quest> oh ok
[20:56] <codepython777> is there a way to put a network bandwidth quota on each user when the network usage reaches above certain threshold? (something easy to use compared to ip tables)
[21:16] <jacobw> Quest: Mikrotik RouterOS can bond interfaces using LACP, if that's what you want to do
[21:20] <Quest> jacobw,  what is lacp?
[21:21] <jacobw> Quest: If you want to balance sessions over 3 subnets read those docs, and have a look at this, http://parkersamp.com/2010/03/howto-using-linux-as-a-simple-load-balancer-nat-router-firewall/
[21:23] <jacobw> Quest: Link Aggregation Control Protocol, it combines Ethernet ports in to channels, like port channel
[21:23] <Quest> hm\
[21:24] <Quest> jacobw,  i thought they used http://lartc.org/howto/lartc.rpdb.multiple-links.html
[21:24] <Quest> jacobw,  and i think you have experience with mikrotick OS. its linux of their own? or theres some underlying os they use like centos or ubuntu?
[21:25] <jacobw> Quest: I wasn't sure what you were talking about at first
[21:26] <Quest> jacobw,  and i think you have experience with mikrotick OS. its linux of their own? or theres some underlying os they use like centos or ubuntu?
[21:28] <jacobw> Quest: RouterOS is Linux based, but Mikrotik have replaced parts of the networking stack and included in house implementations of things like MPLS
[21:28] <jacobw> Quest: If you look at the firewall interface, it's quite clearly iptables
[21:29] <Quest> hm
[21:29] <Quest> jacobw,  i was wondering if it uses a known os underneath so i can use a package manager and install apps further in it?
[21:30] <jacobw> Quest: No, that's certainly not possible :)
[21:32] <Quest> :(
[21:33] <jacobw> Quest: RouterOS uses the Linux kernel only, it uses Mikrotik own userspace
[21:34] <Quest> hm. thanks
[21:34] <Quest> it will take quite long for me to do what mikrotik doesn, in pure linux and iptables
[21:35] <jacobw> Quest: http://wiki.mikrotik.com/wiki/Manual:IP/Route#Multipath_.28ECMP.29_routes
[21:37] <jacobw> Quest: The page you just linked from LARTC has everything you need for your scenario
[21:41] <Quest> jacobw,  thanks!