[01:04] <pythonirc1012> cfdisk -- FATAL ERROR: Bad primary partition 1: Partition ends in the final partial cylinder -- whats wrong?
[01:04] <pythonirc1012> its a fresh machine, and i installed ubuntu server on one of the hard drives
[01:05] <qman__> pretty much exactly what it says
[01:06] <qman__> your partition doesn't end on a cylinder boundary
[01:06] <qman__> which may or may not be a problem
[01:06] <qman__> depending on how smart your software is
[01:06] <pythonirc1012> qman__: Why would that happen with a fresh install?
[01:06] <pythonirc1012> qman__: also, how do i find out if its a problem or not?
[01:07] <qman__> the installer probably used software which is smart enough to handle partitions that don't end on cylinder boundaries, while the software you're using is not
[01:07] <pythonirc1012> I see
[01:07] <pythonirc1012> cfdisk is what i was trying to use
[01:07] <qman__> that, or the software you're using is trying to ensure everything is aligned to 4k sectors
[01:07] <pythonirc1012> I'm trying to build a RAID5 with 4 disks apart from the disk i installed the OS on
[01:07] <maxb> cfdisk is probably just being paranoid and living in the past
[01:08] <qman__> I don't use cfdisk myself, so I honestly have no idea if it's a problem or not
[01:08] <pythonirc1012> I can ssh to the machine...was trying to use mdadm...thought would look at the disks using cfdisk
[01:08] <qman__> I just fdisk, n, p, 1, enter, enter, t, fd, w
[01:08] <qman__> just added five disks to my file server the other night that way
[01:08] <pythonirc1012> what exact command did you use?
[01:09] <pythonirc1012> did you build a raid on them?
[01:09] <qman__> fdisk /dev/sd?, where ? is the disk you want
[01:09] <qman__> and then using those letters in order in fdisk to create the partitions of the correct type
[01:09] <qman__> and then an mdadm command to add the disks to the array (or in your case create an array)
[01:09] <qman__> and then I grew my ext3 filesystem to fit after the array reshaped
[01:10] <qman__> on a new array you'd just make a new filesystem, or use LVM or whatever you're doing
[01:10] <pythonirc1012> k - question 1: how do i find out which disks are empty and what are their names...i usually use gnome-disk-utility for this, but dont know how to do this using text terminal
[01:10] <qman__> fdisk -l
[01:11] <pythonirc1012> WARNING: GPT (GUID Partition Table) detected on '/dev/sdh'! The util fdisk doesn't support GPT. Use GNU Parted.
[01:11] <qman__> AFAIK fdisk does not do 4k sectors by default
[01:11] <qman__> GPT, never done that myself
[01:11] <qman__> 'parted' is GNU Parted
[01:11] <qman__> I don't know the exact commands in parted to do what you want though
[01:12] <pythonirc1012> ok /dev/sde is where my os is installed -- need to make raid5 from fghi
[01:12] <patdk-lap> ya, I don't think anyone is really doing partitions by 4k, but mainly by 1meg now
[01:13] <qman__> you need to create partitions of type "Linux RAID Autodetect", or 'fd'
[01:13] <qman__> then mdadm can deal with them
[01:14] <pythonirc1012> http://paste.pocoo.org/show/422939/
[01:14] <qman__> yeah, you're using GPT, so fdisk won't work
[01:14] <qman__> you'll have to use a GPT aware partitioner
[01:14] <patdk-lap> use parted
[01:15] <patdk-lap> or if you have gui installed, gparted?
[01:15] <maxb> ooi, why are you using GPT?
[01:15] <pythonirc1012> I've no clue
[01:15] <patdk-lap> I'm only using gpt anymore
[01:15] <qman__> I have no need for it
[01:16] <qman__> my data disks are all one big partition anyways
[01:16] <patdk-lap> I have many raids that are >2tb
[01:16] <patdk-lap> most of mine are hardware raided to >2tb
[01:16] <pythonirc1012> my disks are 2TB each
[01:16] <pythonirc1012> 4 disks -- want to put them in RAID 5
[01:16] <pythonirc1012> what parted command do i need to run on each disk ?
[01:17] <patdk-lap> well, you can just wipe the gpt off, and use fdisk
[01:17] <patdk-lap> be simpler
[01:17] <qman__> I use 1TB disks right now
[01:17] <pythonirc1012> seems parted is better that fdisk in anycase? usage wise
[01:17] <qman__> next one will be a major overhaul
[01:17] <qman__> probably
[01:17] <qman__> I only suggested fdisk because that's what I know and use
[01:17] <qman__> I do not know parted
[01:17] <patdk-lap> fdisk is a dump partitioner, it does what you say
[01:18] <patdk-lap> parted is smarter
[01:18] <pythonirc1012> cant i just use "parted /dev/sdf" and then mkpart primary 0 2001G?
[01:18] <pythonirc1012> or is there a better way?
[01:24] <pythonirc1012> qman__: ok i do have partitions on the 4 disks i want to put in raid 5: http://paste.pocoo.org/show/422951/
[01:24] <pythonirc1012> will that work?
[01:24] <pythonirc1012> patdk-lap: is this partitioning any good or do i need to repartition in some other way for mdadm?
[01:25] <qman__> well, they shouldn't have filesystems on them
[01:25] <patdk-lap> mdadm doesn't care :)
[01:25] <qman__> I don't know what exactly that means in parted though
[01:25] <pythonirc1012> patdk-lap: what mdadm command do i need to create the raid 5 from 4 disks then?
[01:26] <patdk-lap> mdadm --create /dev/md0 --level=5 --raid-devices=4 /dev/sd?1 /dev/sd?1 /dev/sd?1 /dev/sd?1
[01:27] <qman__> you might want to tweak other options like stripe size
[01:27] <qman__> but that'll create one with default settings
[01:28] <patdk-lap> stripe size is good, depending what what it is used for
[01:28] <pythonirc1012> I guess in my case I'll try this then: sudo mdadm --create --verbose /dev/md0 --level=5 --raid-devices=4 /dev/sdf1 /dev/sdg1 /dev/sdh1 /dev/sdi1
[01:28] <qman__> my array is used mostly to store large (1GB+) files, so I increased my stripe size
[01:29] <patdk-lap> -c 128 is nice
[01:29] <patdk-lap> -c 1024 is good also for large streaming files
[01:29] <pythonirc1012> http://paste.pocoo.org/show/422955/ ?
[01:29] <qman__> the other thing is, you'll want to tweak your ext3/4 filesystem based on your stripe size
[01:30] <pythonirc1012> most of my files are a few MBs
[01:30] <pythonirc1012> like 10 MBs or so
[01:30] <qman__> more detailed info here: http://ubuntuforums.org/showthread.php?t=408461 and here: http://tldp.org/HOWTO/Software-RAID-HOWTO.html
[01:30] <pythonirc1012> 512K default should be fine for that, isnt it?
[01:30] <patdk-lap> it depends on how it's used
[01:30] <patdk-lap> when those files change
[01:30] <qman__> the latter is very old, but the information is still relevant, just the commands have changed some
[01:30] <patdk-lap> does the while file change? or part of it?
[01:31] <pythonirc1012> most of my files are read only
[01:31] <patdk-lap> than large is ok
[01:31] <pythonirc1012> how do i change the strip size to 1MB?
[01:31] <patdk-lap> I would stick with 512k probably though
[01:31] <pythonirc1012> perfect
[01:32] <pythonirc1012> mdadm: /dev/sdf1 appears to contain an ext2fs file system
[01:32] <patdk-lap> you don't want to go too large and cause a single drive to slow it down :)
[01:32] <pythonirc1012> how do i goto ext4 or some other fs?
[01:32] <patdk-lap> you don't
[01:32] <qman__> each drive partition should not contain a filesystem
[01:32] <patdk-lap> it should overrite it with the raid
[01:32] <qman__> they should just be partitions
[01:32] <qman__> the filesystem should be created on top of the RAID
[01:32] <pythonirc1012> perfect
[01:32] <qman__> that's why it's warning you
[01:32] <qman__> so you don't accidentally nuke a filesystem you shouldn't have
[01:32] <pythonirc1012> says /dev/md0 started
[01:32] <pythonirc1012> now i can get a FS on it?
[01:33] <qman__> you can either create a filesystem directly on md0, or use LVM
[01:33] <patdk-lap> now watch in /proc/mdstat for progress
[01:33] <patdk-lap> if you care :)
[01:33] <qman__> that ^^
[01:33] <qman__> though it's designed to handle whatever you throw at it
[01:33] <qman__> I prefer to stay on the safe side, and ensure not to trust the raid until that's done
[01:33] <pythonirc1012> 5min speed=90111K/sec!?
[01:33] <patdk-lap> it nice to make sure it gets to 1% I think, before messing with it :)
[01:34] <qman__> not reboot the server, not fill more space on the array than the % completed
[01:34] <pythonirc1012> .4% right now
[01:34] <qman__> it takes a long time
[01:34] <patdk-lap> qman, I go both ways
[01:34] <pythonirc1012> done .5%
[01:34] <patdk-lap> sometimes I wait till it completes 100% before anything
[01:34] <qman__> yep
[01:34] <patdk-lap> other times I just don't
[01:34] <pythonirc1012> ok, so we dont add the FS onto it till its done 100%?
[01:34] <qman__> I did when reshaping my array
[01:34] <qman__> because I don't have a backup
[01:34] <patdk-lap> pythonirc, it's fine now, it's just going be slow
[01:34] <qman__> you can create the fs
[01:35] <qman__> just don't start dumping files onto it
[01:35] <qman__> at least until it gets a bit through
[01:35] <pythonirc1012> sorry got booted
 you can create the fs
 just don't start dumping files onto it
 at least until it gets a bit through
[01:36] <pythonirc1012> its 1% done
[01:36] <pythonirc1012> what command do i need to create the fs?
[01:36] <qman__> while it will let you put more data on the array than is allocated
[01:36] <qman__> what exactly it does with that data is a mystery to me
[01:36] <patdk-lap> qman, it's safe :)
[01:37] <patdk-lap> it just goes ahead and inits that part of the time
[01:37] <patdk-lap> drive
[01:37] <patdk-lap> technically you are doing that ways
[01:37] <patdk-lap> cause ext throws the data randomly over the drive
[01:37] <qman__> mkfs.ext4
[01:37] <patdk-lap> but this also assumes it's bug free :)
[01:38] <qman__> though you should set the stride based on your stripe size for best performance
[01:39] <qman__> the numbers are much smaller because the document is old, but this section explains it well: http://tldp.org/HOWTO/Software-RAID-HOWTO-5.html#ss5.11
[01:40] <qman__> also, chunk size == stripe size
[01:40] <pythonirc1012> qman__: mkfs.ext4 /dev/md0 ? can you please tell the exact command
[01:40] <pythonirc1012> or mkfs -t ext4 /dev/md0?
[01:40] <qman__> both are equivalent
[01:40] <pythonirc1012> and thats what i need?
[01:41] <pythonirc1012> writing inode tables
[01:41] <patdk-lap> mkfs.ext4 -T largefile -E stride=512,stripe-width=3 /dev/md0
[01:41] <pythonirc1012> i've 4 disks, strip-width=3 is fine?
[01:42] <patdk-lap> you have 3 data disks
[01:42] <pythonirc1012> 4, right?
[01:42] <patdk-lap> you have 3 data disks
[01:42] <pythonirc1012> oh one is parity?
[01:42] <patdk-lap> yes
[01:43] <pythonirc1012> patdk-lap: thanks
[01:43] <pythonirc1012> now mount ? or wait?
[01:44] <qman__> you can mount and use it normally, but it will be slow until it is done building
[01:44] <pythonirc1012> 2.8% done in /proc/mdstat
[01:44] <pythonirc1012> perfect.
[01:44] <pythonirc1012> ok, so moving on to the next raid, which is even worse...
[01:44] <qman__> I haven't created a file server since ext4 got stable, so I didn't know the command
[01:44] <pythonirc1012> i hope it doesnt crash :)
[01:45] <qman__> you can lower your build time with the following
[01:45] <twb> +1 for -binternal
[01:45] <qman__> echo "200000" | sudo tee /proc/sys/dev/raid/speed_limit_min
[01:46] <pythonirc1012> when i run parted, and do print all : Error: Invalid partition table on /dev/mapper/sil_bhagdgacbhai -- wrong signature 0. Ignore/Cancel? -- Why does this happen?
[01:46] <patdk-lap> qman, not going help him much, it's already going 90MB/s the max those drives go :)
[01:46] <qman__> ah
[01:46] <qman__> didn't notice that
[01:46] <qman__> that happens because you're using fakeraid
[01:47] <qman__> with nothing on it
[01:47] <pythonirc1012> can i just make a fs on it?
[01:47] <qman__> yes
[01:47] <pythonirc1012> ok, next question
[01:47] <pythonirc1012> /dev/mapper/sil_bhagdgacbhai -- 160GB is a 4 x 40GB OCZ drives
[01:48] <pythonirc1012> what FS should i use on it? what raid? I was hoping that this box would show up as one drive on ubuntu, but it does not. I am hoping to use RAID 0 on this one.
[01:48] <qman__> fakeraid is usually terrible
[01:48] <qman__> what type of controller is it?
[01:49] <twb> pythonirc1012: that sounds like some bullshit fakeraid controller, which you should avoid like the plague
[01:49] <qman__> or more importantly
[01:49] <patdk-lap> it is :)
[01:49] <pythonirc1012> http://www.provantage.com/ocz-technology-ocz3hsd1ibs1-160g~7OCZD018.htm
[01:49] <qman__> does it have an actual chip
[01:49] <twb> Also, don't use RAID0 for anything but ephemeral data.
[01:49] <qman__> yuck
[01:50] <patdk-lap> pythonirc, you should have turn off raid in your bios
[01:50] <patdk-lap> so you didn't have that sil_xxxxx thing, but instead a normal sd?
[01:50] <twb> pythonirc1012: unless you paid $400 for your RAID card, you should use Linux md RAID.
[01:50] <qman__> no, it's a black box SSD with a fakeraid built into it
[01:50] <qman__> so he's not going to be able to turn it off
[01:50] <patdk-lap> oh?
[01:50] <twb> Anything less than that won't be battery-backed hardware raid, but rather some kind of fakeraid.
[01:50] <twb> qman__: lame
[01:51] <pythonirc1012> qman__: I think i can turn it off
[01:51] <patdk-lap> normally they don't have fakeraid in it, but that sandcontroller thing
[01:51] <twb> patdk-lap: sandforce, it's an FTL
[01:51] <pythonirc1012> I'll try to switch it off tomorrow
[01:51] <patdk-lap> oh, it
[01:51] <patdk-lap> 's a ibis
[01:51] <pythonirc1012> its at work, cant do it from home
[01:52] <pythonirc1012> what do you guys suggest for it? switch off the fake raid 0 , and then make a raid 0 using mdadm?
[01:52] <qman__> ordinarily yes, but I don't think you'll be able to do that with that hardware
[01:52] <patdk-lap> oh ya, they do display as a sil_xxx fakeraid, how evil
[01:52] <qman__> that, or buy a real RAID controller with dedicated CPU and cache
[01:53] <patdk-lap> qman, won't work, it has a custom connection
[01:53] <patdk-lap> the drive is actually pcie x4
[01:53] <qman__> yeah
[01:53] <pythonirc1012> i saw it in the bios to turn off the raid on that
[01:53] <pythonirc1012> why are you guys saying it wont work? the controller?
[01:54] <patdk-lap> pythonirc, too much unknown, I haven't used one yet
[01:54] <patdk-lap> cause they aren't supported by vmware :)
[01:54] <pythonirc1012> patdk-lap: lets assume i've 4 40GB SSD drives that are visible to the os as /dev/sd?
[01:54] <patdk-lap> just raid0 them :)
[01:54] <patdk-lap> using mdadm
[01:54] <qman__> yep
[01:55] <qman__> fakeraid loads all the effort onto your main CPU anyway
[01:55] <qman__> you might as well use the most stable and optimized software raid, mdadm, instead of a one-off driver
[01:55] <pythonirc1012> just 512K default stripe?
[01:55] <pythonirc1012> what FS?
[01:55] <patdk-lap> whatever fs you want
[01:56] <pythonirc1012> any that works well with SSDs? shouldnt i try to match the stripe length with whatever size the IO of SSDs are optimized for 4k?
[01:57] <patdk-lap> who raid the ssd's are optimized for 4k
[01:57] <patdk-lap> I can tell you for sure they aren't
[01:58] <patdk-lap> 64k, 128k or 256k maybe
[01:58] <patdk-lap> so 512k is probably best
[01:58] <pythonirc1012> patdk-lap: the IOPS they report is for 4k chunks, right?
[01:58] <patdk-lap> sometimes
[01:58] <pythonirc1012> then?
[01:58] <pythonirc1012> i need iops from this device
[01:58] <patdk-lap> if it's done by a proper benchmarking that is reputable, 4k yes
[01:59] <patdk-lap> stripesize doesn't offect iops
[01:59] <patdk-lap> man you really have no idea what your doing
[01:59] <patdk-lap> you have no idea how flash works
[01:59] <patdk-lap> your assuming it works the same as normal drives
[01:59] <patdk-lap> and even on normal drives you wouldn't use 4k strip size
[01:59] <pythonirc1012> thats right strip size doesnt have any effect on IOPS
[01:59] <patdk-lap> stripe size does affect iops
[01:59] <pythonirc1012> mdadm then should work fine, even if i want most for iops
[01:59] <patdk-lap> it affects it a crapload
[02:00] <pythonirc1012> does the FS have any effect on IOPS? what do benchmarkers use when they look into increasing iops?
[02:00] <patdk-lap> the only way to increase iops is to add more drives
[02:01] <patdk-lap> to maximize iops per set raid
[02:01] <pythonirc1012> also: if i want to mount /dev/md0 at boot to /raid, do i just add it to /etc/fstab? or is there an easier way to do this automatically?
[02:01] <patdk-lap> you want to max out the read buffer of the drive
[02:01] <patdk-lap> most drives it's like 16 or 32 sectors
[02:01] <patdk-lap> or used to be
[02:01] <patdk-lap> but flash is different
[02:01] <pythonirc1012> patdk-lap: in my case, i've 4 SSDs, so that should already give good IOPS, if i read randomly all over, isnt it?
[02:02] <patdk-lap> you can write to flash, 8k at a time
[02:02] <pythonirc1012> my app is mostly read only...no writes
[02:02] <patdk-lap> but if you have to erase a sector, that sector for flash can be 16k to 512k
[02:02] <patdk-lap> that large block size is what you want to optimize for in flash stripe size
[02:02] <patdk-lap> cause you don't want to be writing half of that empty space at a time
[02:03] <patdk-lap> and you defently want to get it aligned
[02:04] <pythonirc1012> nice raid now shows 5.2T free, thanks
[02:04] <pythonirc1012> patdk-lap: is there an easy way to add more drives to the RAID 5 that i just created using mdadm?
[02:04] <patdk-lap> yep
[02:04] <pythonirc1012> how do i do that?
[02:04] <patdk-lap> google :)
[02:05] <pythonirc1012> will i have trouble with ext4?
[02:05] <pythonirc1012> mdadm --add /dev/md1 /dev/sdj1 ?
[02:05] <twb> pythonirc1012: you cannot add drives to a RAID5 or 6 array.
[02:05] <pythonirc1012> what happens to the ext4?
[02:05] <patdk-lap> http://ubuntuforums.org/archive/index.php/t-517282.html
[02:05] <patdk-lap> nothing
[02:06] <patdk-lap> after the raid is fully grown
[02:06] <patdk-lap> then you grow the fs
[02:07] <patdk-lap> so, mdadm --add /dev/md0 /dev/sd??
[02:07] <patdk-lap> mdadm --grow /dev/md0 --raid-devices=5
[02:07] <patdk-lap> resize2fs /dev/md0
[02:07] <pythonirc1012> nice
[02:07] <pythonirc1012> so twb is wrong then?
[02:07] <twb> That is, you can add hot spares, and replacements, but not expand the array's effective size.
[02:07] <patdk-lap> yep
[02:07] <patdk-lap> sure you can, you have been able to for years
[02:08] <patdk-lap> since like 05
[02:08] <twb> patdk-lap: hmm, maybe that's an md feature
[02:08] <patdk-lap> yep we are talking mdadm :)
[02:08] <twb> That rings a bell, actually
[02:08] <twb> In the general case of the RAID5 algorithm, you can't
[02:08] <patdk-lap> heh, try to find a raid card that doesn't let you these days :)
[02:08] <twb> I expect mdadm does some rebalancing stuff
[02:09] <patdk-lap> no idea
[02:10] <pythonirc1012> patdk-lap: thanks a lot for all the help today.
[02:10] <pythonirc1012> qman__: Thank you as well.
[02:11] <pythonirc1012> my raid is almost built 10% now :)
[02:17] <twb> pythonirc1012: if you assemble the array with -binternal, it will be have a "write-intent bitmap", which is the RAID equivalent of a journal
[02:18] <twb> It means that after a clean reboot or an unexpected outage, it won't have to resync the entire array (which will take hours for 2TB drives)
[02:19] <patdk-lap> it's 10% done after like 30min
[02:20] <patdk-lap> I don't think he should worry that much :)
[02:21] <twb> Shrug
[02:21] <twb> It's more for outages
[02:21] <patdk-lap> that is what ups's are for :)
[02:25] <twb> And when did you last replace the batteries of yours :-P
[02:25] <patdk-lap> last month
[02:26] <patdk-lap> cost me $300
[02:26] <twb> Nice
[02:27] <twb> How many kWa you get for $300?
[02:27] <patdk-lap> 3kw
[02:27] <patdk-lap> but that is with an extra battery pack
[02:27] <patdk-lap> so like 38min runtime full load
[02:28] <twb> 3 sounds a lot lower than the numbers ISTR
[02:28] <patdk-lap> heh?
[02:28] <twb> For a fully populated 19" rack, we were looking at more like $1500 second-hand and $8000 new
[02:28] <pythonirc1012> its only done 12.5% now with 512mins remaining , and the speed is down to speed=55533K/sec
[02:29] <twb> (Including the device as well as the batteries, but I imagine the batteries are 80% of the cost)
[02:29] <patdk-lap> for a fully populated 19" rack, I have two 5kw's
[02:29] <pythonirc1012> perhaps i really need -binternal?
[02:29] <patdk-lap> pythonirc, if you want, I can't imagine that wouldn't default to that though
[02:29] <twb> http://paste.debian.net/121340/ are my old notes
[02:30] <twb> patdk-lap: the WI bitmap won't make the initial sync faster
[02:30] <twb> Sorry, bad completiong
[02:30] <twb> pythonirc1012: the WI bitmap won't make the initial sync faster
[02:30] <twb> pythonirc1012: it'll just mean that you don't need to do a full resync again
[02:30] <patdk-lap> looks like your old notes wanted like a 2kw
[02:31] <pythonirc1012> is there a way to add the WI bitmap to a prebuilt/mounted raid ?
[02:31] <twb> Probably I confused W with kW
[02:31] <twb> (I'm a bit distracted because the financials Windows VM is on its last legs, and it's the EOFY
[02:32] <patdk-lap> 3000va ups :)
[02:32] <twb> If I have an mdadm array with v1.2 metadata, can I downgrade in place to 1.0 metadata?
[02:33] <twb> Also, what is the latest metadata version supported by hardy (2.6.24)?
[02:33] <patdk-lap> I don't think so
[02:33] <patdk-lap> I can check hardy
[02:33] <twb> please do, thanks
[02:33] <twb> I can just blow away /boot to fix syslinux (which needs >= 1.0), but I don't want to have to blow away the main lvm one :-/
[02:34] <patdk-lap> 1, 1.0, 1.1, 1.2
[02:35] <owen1> everytime i ssh to a remote machine i have to type my passphrase. how to automate this?
[02:35] <patdk-lap> ssh-agent
[02:35] <pythonirc1012> owen1: ssh-copy-id
[02:35] <patdk-lap> pythonirc, copy-id only changes it from a password to a privatekey-password :)
[02:36] <pythonirc1012> patdk-lap: doesnt it make it passwordless?
[02:36] <pythonirc1012> i just generate a key and copy it around
[02:36] <patdk-lap> it makes ssh passwordless
[02:36] <patdk-lap> but ssh has to ask for the privatekey password
[02:36] <patdk-lap> it just neversends that password over tcp
[02:37] <pythonirc1012> is that bad to use?
[02:37] <patdk-lap> no
[02:37] <patdk-lap> but ssh-agent is what he wanted
[02:37] <patdk-lap> you type your password into the agent
[02:37] <patdk-lap> then when ssh needs to use your key file, it already knows the password
[02:37] <owen1> patdk-lap: looking into ssh-agent
[02:37] <twb> patdk-lap: fantastic, thanks
[02:38] <pythonirc1012> I'm on zoneedit and i've a domain forwarded to a static ip-- what is TTL? Type (A,AAAA,CERT,MX,...)?
[02:39] <patdk-lap> pythonirc101: BITMAP CHANGES
[02:39] <patdk-lap> A write-intent bitmap can be added to, or removed from, an active array. Either internal bitmaps, or bitmaps stored in a separate file can be added. Note that if you add a bitmap stored in a file which is in a filesystem that is on the raid array being affected, the system will deadlock. The bitmap must be on a separate filesystem.
[02:39] <patdk-lap> pythonirc1012, how long that entry is valid for, till a recheck is required
[02:39] <pythonirc1012> patdk-lap: in my case i can easily add that since i've a separate 2TB drive.
[02:40] <pythonirc1012> is 7200 a good number for TTL ? which is better smaller or larger?
[02:40] <patdk-lap> depends
[02:40] <patdk-lap> if you change it often, smaller
[02:40] <patdk-lap> if you don't, larger
[02:40] <patdk-lap> I just use 86400
[02:40] <pythonirc1012> i dont change it at all
[02:41] <pythonirc1012> like past 5 years, it was the same map
[02:42] <patdk-lap> mdadm --grow --bitmap=internal /dev/md0
[02:42] <twb> patdk-lap: ah, nice, I only ever passed -b to assemble and create
[02:42] <pythonirc1012> just that?
[02:43] <twb> In a way, it's a pity mdadm will be subsumed by btrfs
[02:43] <patdk-lap> yep
[02:43] <pythonirc1012> where is the bitmap stored?
[02:43] <patdk-lap> twb, not really, depends on workload
[02:43] <pythonirc1012> raid itself?
[02:43] <patdk-lap> yep
[02:43] <patdk-lap> twb, I'm sure over years, people will get used to using btrfs by default though
[02:44] <pythonirc1012> patdk-lap: #mdadm --grow --bitmap=internal /dev/md0  --- says --- mdadm: failed to set internal bitmap.
[02:45] <patdk-lap> probably cause your raid isn't built yet
[02:45] <patdk-lap> it needs to be stable first
[02:45] <patdk-lap> try it tomorrow :)
[02:45] <pythonirc1012> 15% , will try tomorrow, thanks
[02:46] <pythonirc1012> patdk-lap: I'm trying to put a new server into my system so that i can take the load off an older machine
[02:46] <patdk-lap> looks like it can slow down the raid 10% though, for writes
[02:46] <pythonirc1012> i would like to distribute the network load for the http server on these two machines
[02:46] <pythonirc1012> the bitmap! that slow?
[02:47] <patdk-lap> ya
[02:47] <pythonirc1012> k, i'll skip it then :0
[02:47] <patdk-lap> before it writes anywhere on the raid, it has to update the bitmap that it is going to
[02:47] <patdk-lap> then when it's done, clear that bitmap
[02:47] <patdk-lap> and that bitmap is mirrored on all raid drives
[02:47] <twb> patdk-lap: re 10%, I have seen people saying "no problems here" and people saying "cripples my raid"
[02:48] <patdk-lap> I'm going by mdadm's numbers on their doc
[02:48] <patdk-lap> https://raid.wiki.kernel.org/index.php/Write-intent_bitmap
[02:48] <pythonirc1012> patdk-lap: perhaps i should make the bitmap on my SSD RAID then?
[02:48] <pythonirc1012> how much space does it neeD? a few bits per 512K page?
[02:48]  * twb reads
[02:48] <patdk-lap> I imagine that could kill an ssd fast
[02:48] <twb> Ah, "up to 10%"
[02:49] <patdk-lap> pythonirc, this only affects you when you pull the power wire out of the server
[02:49] <pythonirc1012> patdk-lap: if it does, it goes back to OCZ, with a thank you :)
[02:49] <patdk-lap> otherwise the bitmap won't *help*
[02:49] <pythonirc1012> 3 years warranty must count for something
[02:49] <pythonirc1012> patdk-lap: I'll skip...my power is pretty stable...once a year i get a power outage.
[02:50] <patdk-lap> heh, I've gone 5 years without a power outage
[02:50] <patdk-lap> till this year
[02:50] <patdk-lap> I couldn't handle a 76hour outage cleanly, stupid people kept tripping the generator breakers
[02:50] <pythonirc1012> does this show my real read or write speed :  speed=69614K/sec ? in mdstat?
[02:51] <patdk-lap> it shows both
[02:51] <patdk-lap> as it's reading+writing at that speed
[02:51] <pythonirc1012> is that ok for 4 drives ? 2TB seagates 7200rpms is what i have
[02:51] <patdk-lap> is that ok for your cpu? harddrive controller? southbridge?
[02:52] <patdk-lap> I assume you plugged them into the motherboard sata that are on the southbridge atleast
[02:52] <pythonirc1012> load average:1.33 1.19 1.16 -- shows 8 cores, anything barely being used
[02:52] <pythonirc1012> yes, motherboard sata
[02:52] <pythonirc1012> Xeon E3 quad core CPU - brand new
[02:52] <patdk-lap> hmm, mdadm can only use a single core
[02:53] <patdk-lap> per md device, I believe
[02:53] <twb> patdk-lap: per array, or total?
[02:53] <twb> Like if I have two arrays, can it use one core for each
[02:53] <patdk-lap> twb, probably
[02:53] <patdk-lap> I haven't checked
[02:53] <patdk-lap> but I know crypto is per device
[02:53] <pythonirc1012> md0_raid5 is using 10% of one core
[02:53] <patdk-lap> you looking at top?
[02:53] <pythonirc1012> yes
[02:54] <patdk-lap> well, it has to read 3 drives, then write to 4
[02:54] <pythonirc1012> whats the io for one drive these days?
[02:55] <pythonirc1012> how can i measure it easily?
[02:55] <patdk-lap> what kind drive you have?
[02:55] <patdk-lap> normally it is 70-130mb/s
[02:55] <pythonirc1012> how do i measure it on my server easily?
[02:55] <pythonirc1012> for a particular directory , say /tmp
[02:55] <patdk-lap> heh?
[02:56] <patdk-lap> what does /tmp have to do with a drive?
[02:56] <qman__> you could time a dd
[02:56] <qman__> but that has nothing to do with a drive's ability
[02:56] <qman__> hdparm -tT to time disk reads
[02:56] <pythonirc1012> i've a separate drive on which my /tmp is
[02:56] <patdk-lap> if you used green drives, they will be slow
[02:57] <patdk-lap> benchmarks will show them faster, cause well, your accessing them 100% of the time
[02:57] <patdk-lap> but raid doesn't access them 100% of the time, so they keep going to sleep
[02:57] <pythonirc1012>  hdparam -tT /dev/sde2 --> Timing cached reads:   24572 MB in  2.00 seconds = 12299.78 MB/sec -- Timing buffered disk reads: 244 MB in  1.86 seconds = 131.41 MB/sec
[02:58] <pythonirc1012> if one of the disks is giving me 131Mb/sec, why are 4 giving me 70MB/sec?
[02:58] <patdk-lap> you just tested a single drive read speed
[02:59] <patdk-lap> not the amount of time it takes to read calc raid5 then write
[02:59] <patdk-lap> so really atleast cut that 131 in half
[02:59] <pythonirc1012> k, what can i expect my read/write speed from raid 5?
[02:59] <qman__> raid 5 doesn't really hit on reads so much
[02:59] <qman__> just writes
[02:59] <qman__> you can hdparm on md? to test
[03:00] <qman__> writes are harder to test though
[03:00] <twb> bonnie++?
[03:00] <patdk-lap> I made a fun write test program
[03:00] <pythonirc1012> says 337 MB /sec
[03:01] <patdk-lap> whoa, it's almost dead on
[03:01] <patdk-lap> raid5, with 1 dead drive is 20% of full speed
[03:01] <patdk-lap> and since your raid isn't built, it basically has 1 dead drive
[03:01] <patdk-lap> that is the horrible thing about raid5
[03:01] <patdk-lap> if you need performance, and a drive dies, you lost all your performance
[03:02] <pythonirc1012> thats fine...i can live with that :) Tomorrow morning, i should start copying data to it :)
[03:03] <pythonirc1012> need to configure apache now...
[03:03] <twb> Is it "rootdelay=60" to make boot process not wait ten minutes for a root device it can't find?
[03:05] <patdk-lap> I thought that wuld wait 60seconds
[03:05] <patdk-lap> but basic idea
[03:05] <pythonirc1012> when i say mymachine.com/~user -- why does  apache try to read the data from /var/www/~user instead of ~user/public_html? how can i configure it to do the usual?
[03:07] <patdk-lap> cause you didn't tell apache to use userdir's
[03:08] <pythonirc1012> patdk-lap: looking it up, thanks
[03:11] <pythonirc1012> patdk-lap: will this work: http://www.w3expert.com/2011/05/enable-userdir-in-appache-in-ubuntu.html ?
[03:17] <pythonirc1012> how do i move my home directory from /home/user to /raid/user?
[03:18] <pythonirc1012> sudo usermod -d /path/to/new/home -m ----> Is this how?
[03:19] <twb> Well, *I* do vipw and vipw -s, or sudo ldapmodify -YEXTERNAL
[03:19] <twb> re apache, you need to enable the userdir module
[03:19] <pythonirc1012> twb: found the command for that...thanks
[03:20] <pythonirc1012> i need to move my home directory from one place to the other
[03:21] <twb> IMO you're better off doing something like /home -> raid/home
[03:21] <pythonirc1012> sudo usermod --home /raid/user -m user -- says user is logged in...
[03:21] <pythonirc1012> twb: how do i do this?
[03:21] <pythonirc1012> i dont like symbolic links
[03:22] <twb> I can't help what you do and don't like
[03:22] <twb> Use a bind mount if that makes you feel better
[03:23] <pythonirc1012> ok how do i execute my command sudo usermod --home /raid/user -m user -- says user is logged in...
[03:23] <pythonirc1012> i've only one user on the system
[03:25] <pythonirc1012> can i just edit /etc/passwd and point it to /raid/user?
[03:32] <twb> pythonirc1012: sure
[03:32] <twb> I'm just saying I wouldn't do it that way
[03:33] <pythonirc1012> twb: do you know how to avoid this problem : sudo usermod --home /raid/user -m user -- says user is logged in...
[03:34] <twb> vipw
[03:35] <pythonirc1012> i dont understand, what does that have to do with sudo usermod?
[03:35] <twb> Er, you use it
[03:35] <twb> Instead of usermod
[03:36] <pythonirc1012> does that command only edit /etc/passwd?
[03:36] <twb> Yes.
[03:36] <twb> I assume you're smart enough to manage the associated mv(1) on your own
[03:45] <pythonirc1012> twb: thanks
[03:54] <twb> Shit, my collectd hub is OOMing
[03:55] <twb> Ah, an inadvertent forkbomb
[04:12] <overrider_> i installed a simple gui (fluxbox) and slim as the login manager. Unfortunately, slim seems to hang my box (10.04) when booting. Booting into safe Mode and uninstalling Slim fixes all issues. Any ideas?
[04:15] <twb> Don't run slim, I guess
[04:15] <twb> While we discourage GUIs on servers, if you simply must have one, try nodm or xdm instead
[04:16] <twb> It's probably a badly-written upstart job for slim, but I don't care enough to investigate
[04:24] <pythonirc1011> where is this stored in ubuntu+apache2 => http://paste.pocoo.org/show/423126/ ?
[04:56] <twb> It's probably generated by apache from strings built into its binary
[04:56] <pythonirc1011> ah ok
[04:56] <twb> apache stuff might better be addressed to #httpd
[04:57] <twb> (Which is a channel just for "apache httpd", which they just call "httpd" because apache has lots of other projects and "what do you mean there are other httpds?").
[05:09] <pythonirc1011> http://serverfault.com/questions/91468/how-to-set-up-mod-wsgi-for-python-on-ubuntu -- gives me permission denied for test.wsgi
[05:09] <pythonirc1011> any ideas on how to fix that?
[05:12] <pythonirc1011> got it to work, thanks :)
[05:14] <twb> I'm surprised you need a dance that long
[05:14] <twb> Most third-party mod packages will by default set up sensible configuration and enable it in the postinst
[05:14] <twb> e.g. mod-fcgid
[05:15] <twb> Is the script file marked executable?
[05:16] <pythonirc1011> its working, thanks
[06:18] <philipballew> If I wanted to Configure my computer's local lan ethernet address to 192.168.1.100, subnet 255.255.255.0, gateway 192.168.1.1 how would i do that?
[06:19] <twb> Grr
[06:19] <twb> Stupid customers, blocking ICMP...
[06:19] <twb> philipballew: "ip link set dev eth0 up", "ip address add dev eth0 brd + 192.168.1.100/24" and "ip route add 0/0 via 192.168.1.1"
[06:21] <philipballew> twb im gonna flash ddwrt tonight and thats what it asked me to do :)
[06:22] <twb> I recommend OpenWRT over DD-WRT; AFAICT the latter doesn't have any package management.
[06:22] <philipballew> how so?
[06:22] <twb> Well, suppose you want asterisk on your router.  On openwrt, that would be "opkg install asterisk" and it'll download and install it
[06:22] <twb> Whereas IIUC ddwrt provides you a fixed set of packages, and if you want something else, that's too bad
[06:25] <philipballew> it is cli only correct?
[06:25] <philipballew> thats fine with me
[06:31] <twb> Some releases ship with a web UI preinstalled, but you can always uninstall or reinstall it
[06:31] <twb> It's also relatively easy to roll custom binaries with the packages you want pre-installed -- about as hard as rolling a custom kernel.
[06:32] <philipballew> is it harder to install compared to ddwrt?
[06:32] <twb> I haven't tried with ddwrt
[06:32] <twb> My knowledge of DD-WRT is all second-hand
[06:33] <philipballew> no worries. i just bought a router for 3 bucks today and feel stock formware is to limiting for my network i want to build
[06:35] <twb> I wouldn't deploy a router with stock firmware.
[06:36] <twb> Not unless you needed onboard DSL modem (FOSS distros generally can't use DSL chipsets yet)
[06:37] <philipballew> custiom firmware saves money to
[07:01] <twb> Shrug
[07:02] <twb> if you're paying a service fee for firmware updates you are probably in a different market segment
[07:04] <philipballew> who would pay for firmware updates? that should be standard twb
[07:05] <twb> then what are you referring to?
[07:05] <twb> (And re who, both I and I believe cisco charge for firmware updates.)
[07:31] <acidflash> hi everyone
[07:31] <acidflash> i have a file which has mysteriously been deleted 3 times from the /root/ directory of my server
[07:31] <acidflash> this is the only computer which its happening on, and its a clone of 9 others which are working perfectly
[07:31] <acidflash> what might the cause be?
[07:42] <twb> Someone deleting it
[07:42] <twb> What file
[07:47] <amelin> what do you mean with "mysteriously been deleted" ?
[08:01]  * twb pictures Scooby Doo investigating
[10:12] <smoser> mdeslaur, http://paste.ubuntu.com/634893/
[10:12] <smoser> i can't seem to cnovince dnsmasq other than the libvirt one to run
[10:13] <smoser> (telling it explicitly to only listen on lo)
[10:14] <mdeslaur> smoser: darn :(
[10:15] <mdeslaur> smoser: are you sure it's actually reading that config file? how about specifying it explicitly on the command line?
[10:22] <smoser> mdeslaur, woot! http://paste.ubuntu.com/634897/
[10:22] <smoser> bind-interfaces is what you need.
[10:23] <lolmatic> hi guys
[10:23] <mdeslaur> smoser: well, it started, but will it give out dhcp addresses if you use bind-interfaces with an empty list
[10:23] <mdeslaur> ?
[10:23] <smoser> read man page
[10:24] <smoser> i thought it expected a list there too
[10:24] <lolmatic> i have no sound in diablo 2 and it crashes with "halt - unrecoverable error blah blah"
[10:24] <smoser> but it does not.
[10:24] <mdeslaur> smoser: oh! right, cool
[10:25] <lolmatic> oops wrong channel :X
[10:25] <smoser> http://paste.ubuntu.com/634898/
[10:25] <smoser> mdeslaur, there is little snippit with verification of it working
[10:26] <smoser> (fyi, half o f my discussion here is just so i can document it for myself)
[10:27] <mdeslaur> cool
[11:24] <kirkland> RoAkSoAx: ping
[11:51] <smoser> adam_g, http://paste.ubuntu.com/634945/
[11:59] <DMKitsch> hello all
[11:59] <DMKitsch> may somebody please help me with my apache2 server, i have tried password protecting them but it does not work
[12:04] <remix_tj> DMKitsch: password protecting?
[12:04] <remix_tj> what do you mean?
[12:15] <DMKitsch> sorry, um adding a password to a specific URL
[12:16] <DMKitsch> to a directory remix_tj
[12:17] <koolhead11> DMKitsch, https://help.ubuntu.com/community/ApacheMySQLPHP#Password-Protect%20a%20Directory
[12:17] <koolhead11> hope this is what your looking for
[12:18] <remix_tj> yes, is exactly what he needs- DMKitsch this is an example of .htaccess to protect the directory where is in: http://paste.ubuntu.com/634954/
[12:20] <DMKitsch> ok
[12:20] <koolhead11> i would strongly request to check ubuntu community documentation rather than popping up here and asking these questions. :)
[12:20] <DMKitsch> i added a .htaccess
[12:20] <DMKitsch> also a .htpasswd
[12:20] <koolhead11> DMKitsch, please check the ownership as well
[12:21] <DMKitsch> i found i had to add the AllowOverride All to the Sites Available document, not the httpd.conf
[12:21] <DMKitsch> but i am getting a Internal server error
[12:22] <koolhead11> please check the logfile
[12:22] <DMKitsch> which is located where?
[12:23] <koolhead11> tail -f /var/log/apache2/error.log
[12:23] <DMKitsch> ok
[12:24] <DMKitsch> whoops that seems to have shown an error of mine
[12:24] <DMKitsch> let me see if this fixes it, one second
[12:27] <DMKitsch> ok i do not get an internal server error now
[12:28] <DMKitsch> but no login box is coming up
[12:37] <jbernard> hallyn: on bug 693594, sorry for the delay, I'll take a look today and let you know
[12:55] <DMKitsch> why is chat always so quiet with so many people on
[12:57] <xampart> DMKitsch: no one's having problems
[12:58] <xro> Hi, is there a reference tutorial about security and apache server on ubuntu server 11.04 64bits ?
[12:58] <DMKitsch> i was, luckily i fixed it
[13:11] <DMKitsch> hey
[13:11] <DMKitsch> what do you guys like using as a web editor
[13:11] <DMKitsch> GUI and CMD
[13:11] <DMKitsch> CLU*
[13:14] <DMKitsch> hi/
[13:14] <DMKitsch> ?
[13:20] <greppy> DMKitsch: I pretty much use vi(m) if at all possible for any editing.
[13:20] <DMKitsch> ah cool
[13:20] <DMKitsch> does it have syntax highlighting?
[13:22] <Pici> Yes. And more.
[13:25] <greppy> vim does :) stock vi on a lot of systems won't
[13:39] <Klavier> i installed ubuntu server last version 64 bit. i activated serial ata drivers, i installed grub to MBR,
[13:39] <Klavier> but system didnt opened
[13:39] <Klavier> installation finished successfuly than system reboot but i cant see grub
[13:39] <Klavier> :o(((((
[13:40] <Klavier> sir or madams
[13:41] <xro> nobody knows a good tuto about secure apache on ubuntu server?
[13:54] <amelin> Klavier: how did you install it? via CD or USB ?
[13:55] <jamespage> RoAkSoAx: hey  - are you OK to sponsor a few NEW uploads for me?
[14:00] <Klavier> amelin i installed with DVD
[14:00] <Klavier> sorry CD
[14:03] <amelin> okay, so i guess you should check in the bios the boot order to see if it trys to boot from your disk, if it does you maybe need an livecd to check if the disk has the data, does the boot shows any error message?
[14:13] <adam_g> hggdh: test rig free?
[14:13] <hggdh> adam_g: yes (but check with zul)
[14:16] <adam_g> hggdh: he's readin facebook
[14:16] <hggdh> oh. throw something at him (the heavier the better)
[14:17] <hggdh> adam_g: you should copy /home/cerdea/preseeds over to your account on tamarind
[14:17] <hggdh> I updated it to solve the hard link issue with bsdtar
[14:19] <neo21_> hi everyone
[14:20] <RoAkSoAx> jamespage surething... have the packages been divided already  between the sponsors?
[14:25] <adam_g> hggdh: cool. thanks
[14:32] <DMKitsch> hi anybody used AWstats?
[14:37] <pmatulis> DMKitsch: is that your main question?
[14:41] <DMKitsch> no
 can i use it with no URL?
[14:42] <RoAkSoAx> TREllis: ping
 and i am having a few problems using it, i'm new to linux
[14:43] <TREllis> RoAkSoAx: howdy, I see you patched koan for grub2 --replace-self option
[14:44] <RoAkSoAx> TREllis: hehe could you see if bug #760019 still applies?
[14:45] <Ursinha_> nhandler: hi, can I have a ubuntu/member cloak, please? :)
[14:45] <DMKitsch> anybody mind talking through how to set up AWstat, I have no file to load in my WWW directory?
[14:45] <TREllis> RoAkSoAx: did you patch that out too?
[14:49] <RoAkSoAx> TREllis: nope, just want to know the effect now that grub2 has been added as support
[14:49] <pmatulis> DMKitsch: did you use google?  first hit for 'awstats ubuntu': https://help.ubuntu.com/community/AWStats
[14:50] <RoAkSoAx> TREllis: cause I'd be helpful to see a way to reproduce it, and the error shown in the bug report
[14:50] <DMKitsch> pmatulis yes i did but there is no link in my www to goto the stats
[14:51] <TREllis> RoAkSoAx: ah ok
[14:52] <TREllis> RoAkSoAx: not got a setup at the moment, our lab is busy
[14:52] <RoAkSoAx> TREllis: k no worries.. have to work on other stuff atm either way ;)
[14:53] <jpds> DMKitsch: Open file://var/www/ in Firefox?
[14:54] <xro> Hi, Is there a tutorial about secure apache on ubuntu server?
[14:54] <TREllis> RoAkSoAx: I'll check it out for sure tho
[14:54] <jamespage> RoAkSoAx: top three in the list are free still - just checked with zul (and I can't find Daviey)
[14:54] <jpds> xro: #define secure
[14:54] <jamespage> RoAkSoAx: thx
[14:55] <DMKitsch> jpds no that does not work
[14:56] <RoAkSoAx> jamespage: k i'll take care of them then
[14:56] <jamespage> RoAkSoAx: ta
[14:56] <jpds> DMKitsch: well, replace for whevever the awstats output is.
[14:56] <xro> jpds, there should exist some tutorial about right apache configuration...
[14:57] <jpds> xro: Well, that depends on what 'right' for you is.
[14:57] <jpds> xro: https://help.ubuntu.com/10.04/serverguide/C/httpd.html ?
[14:57] <DMKitsch> jpds i am confused
[14:59] <neo21_> someone got lighttpd + fastcgi running on 10.04.2?
[15:02] <xro> jpds, that is basic configuration... i think about security.. for example should i chroot apache and how? should i desactivate default site? what is the right way to restrict access?
[15:04] <xro> what should the file permissions be?
[15:12] <pmatulis> xro: you're going specific apache on us.  it's not really a ubuntu subject anymore
[15:13] <pmatulis> xro: i see you're in #apache, no luck there i guess?
[15:13] <xro> pmatulis, so should i unactivate the default site in apache? (i asked it in #httpd and they said ask in #ubunt)
[15:14] <jimmy51_> i've installed ntp (apt-get install ntp) but running ntpdate says no servers can be used.  is this a firewall problem?
[15:30] <pythonirc101> I would like to make /dev/sde1 bootable and its boot record populated with grub. How can i do this. Seems like the boot was sitting somewhere else and i formatted this drive.
[15:30] <pythonirc101> I dropped inside using rescue mode
[15:35] <pythonirc101> seems like i broke my system, anyone can help me fix it please?
[15:38] <pmatulis> https://help.ubuntu.com/community/Grub2
[15:38] <pmatulis> pythonirc101: ⤴
[15:39] <pythonirc101> pmatulis: my problem is this...
[15:40] <pythonirc101> I had a working system with a fake raid /dev/sdiasad and another drive /dev/sde
[15:40] <pythonirc101> i removed the fake raid, and it seems that my MBR or something else was sitting there, because of which now the machine wont boot
[15:40] <pythonirc101> I used the rescue CD to drop into the file system in /dev/sde1 and it looks fine
[15:41] <pythonirc101> how can i boot back using /dev/sde?
[15:41] <pythonirc101> the other problem is that i dont have network on this machine without booting into /dev/sde
[15:44] <pythonirc101> pmatulis: any ideas?
[15:45] <pmatulis> pythonirc101: try re-installing grub on sde i guess.  fakeraid is always troublesome
[15:45] <pythonirc101> pmatulis: how can i do this?
[15:46] <pythonirc101> the only way i can get inside the system is in rescue mode
[15:46] <pmatulis> pythonirc101: did you read the doc i gave you?
[15:46] <pythonirc101> nope -- reading it slowly...its a long document -- very long -- can  i jump to reinstalling grub2?
[15:47] <pmatulis> pythonirc101: i guess.  what does this server do for you anyway?
[15:51] <pythonirc101> just instaling the OS
[15:51] <pmatulis> pythonirc101: huh?  is the server in production?
[15:51] <pythonirc101> when i drop to install grub using the installer disc, it says No modifications can be made to the partition #3 of device SCSI6 for the reason: In use by LVM volume group jule
[15:52] <pythonirc101> no -- i need to get it in production at some point soon
[15:52] <pythonirc101> and i crashed it today
[15:52] <pmatulis> pythonirc101: so just re-install
[15:52] <pythonirc101> I've a RAID built at /dev/md0
[15:52] <pythonirc101> i had network and web server configured
[15:53] <pythonirc101> will sticking in a line in /etc/fstab -- /dev/md0 mount as /raid -- still work? Or do i have to rebuild the raid using mdadm?
[15:53] <pmatulis> pythonirc101: so?  copy some files onto an external media and re-install
[15:53] <pythonirc101> i cud do that
[15:54] <pythonirc101> if i can find external media that is
[15:54] <pmatulis> pythonirc101: and make sure all traces of fakeraid is gone and disabled in BIOS
[15:55] <pythonirc101> already done
[16:03] <pythonirc101> when i try to mount the raid from the rescue shell: mount: special device /dev/md0 does not exist. Is there any way to mount it?
[16:05] <pythonirc101> pmatulis: mdadm --details /dev/md0 -- cannot open : No such file or directory
[16:06] <pmatulis> pythonirc101: are you using lvm?
[16:07] <pythonirc101> on md0 -- just raid 5
[16:07] <pythonirc101> and ext4
[16:07] <pythonirc101> on sde -- my os disk -- yes lvm -- seems like ubuntu uses it by default
[16:08] <pythonirc101> pmatulis: if i reinstall my os on sde -- do i have to recreate the raid 5 ? or can i just add a line in /etc/fstab and mount  it?
[16:09] <pmatulis> pythonirc101: you'll have to redo everything
[16:09] <pythonirc101> my raid5 is gone with all its data?
[16:09] <pythonirc101> ??
[16:10] <pythonirc101> pmatulis: dont tell me my intact raid is gone because my OS disk got corrupt?
[16:12] <pmatulis> pythonirc101: you would do best to explain your entire setup.  i may not understand it completely
[16:12] <pythonirc101> pmatulis: i've sde == 1 OS drive == which croaked
[16:12] <smb> zul, I opened https://bugs.launchpad.net/ubuntu/+source/xen-common/+bug/803488 for getting blkback and netback started. Adding the modprobes to the initscript seemed to do the right thing.
[16:12] <pythonirc101> I've 4 RAID 5 drives built using mdadm : /dev/md0
[16:12] <pythonirc101> Right now I'm reinstalling the OS on the croaked drive /dev/sde
[16:13] <pmatulis> pythonirc101: what is on sd[a-d] ?
[16:13] <pythonirc101> 4 40GB drives that were on fakeraid...and have no data on them
[16:13] <pythonirc101> i formatted them, and hell broke loose
[16:13] <pythonirc101> i've no clue why
[16:14] <pythonirc101> actually my os drive hasnt croaked...i just formatted those 40GB drives and removed the fakeraid
[16:14] <pmatulis> pythonirc101: you have 10 drives in total?
[16:14] <pythonirc101> and my box wont boot
[16:14] <pythonirc101> yes
[16:14] <pythonirc101> 9 actually
[16:14] <pythonirc101> 4+1+4
[16:14] <pmatulis> right
[16:15] <pmatulis> pythonirc101: did you remove the metadata from those drives via the BIOS?
[16:16] <pythonirc101> what metadata? I just removed the fakeraid setting and formatted them
[16:16] <pythonirc101> they are now visible to ubuntu as separate drives
[16:17] <pmatulis> pythonirc101: so, yes, you should be able to import the array
[16:17] <pythonirc101> thanks
[16:18] <pythonirc101> at least its a good test run -- if the OS drive croaks, the raid survives
[16:19] <pmatulis> pythonirc101: ok, good luck and please report back.  for importing array, investigate 'mdadm --assemble'
[16:21] <RoAkSoAx> jamespage: would you like me to do the uploads now or would you like to wait until some of the dependencies are in the archives?
[16:22] <pythonirc101> pmatulis: how do i get rid of these LVM Partitions on /dev/sde?
[16:22] <jamespage> RoAkSoAx: upload now; they will sort themselves out as soon as the deps are in the archive (discussed with zul)
[16:22] <pmatulis> pythonirc101: are you in the installer now?
[16:22] <pythonirc101> yes
[16:23] <pmatulis> pythonirc101: 'Configure Logical Volume Manager'
[16:23] <pythonirc101> I tried to erase the data on the LVM Partition -- but it takes too much time
[16:23] <RoAkSoAx> jamespage: k gonna add your PPA to my  pbuilder, test builds, and upload then
[16:23] <jamespage> RoAkSoAx: great - thankyou
[16:25] <pythonirc101> pmatulis: removed the logical paritions, now how do i partition /dev/sde?  it seems it still shows 1MB for biosgrub, 256MB ext2 and 2TB LVM
[16:26] <pythonirc101> pmatulis: was able to clean up /dev/sde
[16:58] <RoAkSoAx> jamespage: JAMES PAGE!!! (it's done btw)
[16:59] <jamespage> RoAkSoAx: thankyou!
[16:59] <RoAkSoAx> yw
[17:00] <evilsushi> anyone using daemontools to monitor a service? could you paste your conf i could use an example.
[17:30] <smoser> RoAkSoAx, around ?
[17:31] <RoAkSoAx> smoser: yes
[17:31] <smoser> http://paste.ubuntu.com/635163/
[17:31] <smoser> any ideas what i did wrong there?
[17:32] <RoAkSoAx> smoser: try: sudo cobbler import --name=natty-i386-mini --path=/mnt --breed=ubuntu --os-version=natty --arc=i386
[17:32] <RoAkSoAx> note that I use the '='
[17:33] <RoAkSoAx> smoser: is that in natty or oneiric btw?
[17:34] <pythonirc101> I've installed my ubuntu server on /dev/sde and i had a RAID 5 created on /dev/sdf1 -- /dev/sdi1. When I try to reassemble, I get mdadm: cannot open device /dev/sdf1: Device or resource busy \n mdadm: /dev/sdf1 has no superblock - assembly aborted
[17:34] <pythonirc101> any idea how to fix this?
[17:35] <smoser> RoAkSoAx, natty
[17:35] <RoAkSoAx> smoser: what cobbler package do you have installed? latest?
[17:38] <smoser> http://paste.ubuntu.com/635169/
[17:38] <smoser> RoAkSoAx,
[17:39] <smoser> http://paste.ubuntu.com/635170/
[17:39] <RoAkSoAx> smoser: ok, let me track it down cause this was supposed to be fixed in natty already
[17:40] <RoAkSoAx> smoser: ok the import is successful, but it fails to create the repositories
[17:40] <koolhead11> RoAkSoAx, it worked 4 me without any error
[17:40] <smoser> RoAkSoAx, what does that mean for me?
[17:40] <RoAkSoAx> koolhead11: I just tested and there's an error
[17:40] <smoser> the repositories...
[17:40] <smoser> this is a mini iso
[17:40] <smoser> following https://help.ubuntu.com/community/Cobbler/Import
[17:41] <koolhead11> smoser, ooh. i have not checked mini ISO
[17:41] <RoAkSoAx> smoser: that the import of the ISO is ok, but when importing a mini iso, since it doesn't ship any *.deb, then it creates the concept of "repositories" that are disabled. Don't worry about them though.
[17:41] <smoser> RoAkSoAx, so you think that i should be able to deploy from it?
[17:42] <RoAkSoAx> smoser: yes, but you need to add a preseed first
[17:43] <RoAkSoAx> smoser: that particular error wasn't really fixed in natty, but it is in oneiric
[17:43] <RoAkSoAx> smoser: but the import doesn't fail
[17:43] <smoser> RoAkSoAx, thanks.
[17:43] <RoAkSoAx> smoser: sudo cobbler report -> should show you the distro and profile added
[17:44] <smoser> yes it does
[17:45] <RoAkSoAx> smoser: are you deploying with koan or PXE booting?
[17:49] <pmatulis> pythonirc101: any luck?
[17:51] <pythonirc101> pmatulis: http://paste.pocoo.org/show/423768/ and then http://paste.pocoo.org/show/423775/
[17:53] <tireddddd> for I in {1..1000000}; do dd if=/dev/urandom of=/dev sda; done     (will this make impossible recover data)
[17:54] <smoser> RoAkSoAx, the goal is to do pxe booting
[17:56] <RoAkSoAx> smoser: Ok, you guys will need to configure the router (or dhcp server) that the PXE server is the cobbler server
[17:56] <RoAkSoAx> smoser: and, if you looking into deploying with koan, i'd recommend you to install virtinst from ppa:ubuntu-virt/ppa
[18:06] <smoser> RoAkSoAx, right.
[18:13] <jimmy51_> i'm having trouble getting kerberos to work to connect to my AD domain controller. i've installed kerberos, added my realm info, sync'd my servers with NTP, but i still get errors when i run kinit, or i get nothing at all.
[18:13] <jimmy51_> kinit: KDC reply did not match expectations while getting initial credentials
[18:14] <jimmy51_> i can ping my FQDN of the DC and i've checked the case sensitivity in my conf file.
[18:16] <jimmy51_> i'm not even seeing a log file to work with
[18:36] <muszek> hi... some time ago (a year, more or less), ubuntu started asking me a password to my "password wallet" (or whatever it is) whenever I connect to another computer via ssh.  I used key-based authentication before and having to type in my pass bugs me a bit... is there any way to "fix" it?
[18:41] <jimmy51_> 1kerberos
[18:41] <jimmy51_> !kerberos
[18:41] <jimmy51_> !info kerberos
[18:41] <jimmy51_> !info krb5
[18:42] <jimmy51_> !info kerberos does not work at all for me!
[18:42] <pmatulis> !find krb5
[19:31] <mecode> can anyone help me with a basic question? i created a group "developers" and i added a user "john" to the group. I then changed the /var/www to be of group "developers". however, john still can't write to the files. I even did "chmod -R 775 www" to the directory, but still no writing ability for john.
[19:35] <chieffancypants> mecode: has john logged out since becoming a member of the group developers?
[19:36] <mecode> chieffancypants: that'll do it thanks ! what chmod do i use if they need access? is 775 too loose?
[19:39] <chieffancypants> 774 is likely better
[19:42] <tsimpson> probably not a good idea to have all files executable too
[19:42] <tsimpson> *to not
[19:42] <tsimpson> no, I was right the first time :)
[20:12] <pythonirc101> I created /dev/md1, i mounted it on /dev/raid1 , i rebooted...it showed me that there was some trouble with /dev/raid1 mounting...and now when i try to mount it manually, it says /dev/md1 does not exist
[20:12] <pythonirc101> any ideas what i did wrong? Its a raid 0 with 4 40gig drives
[20:24] <pythonirc101> I created a /dev/md1 -- raid 0 -- 4 drives...when i rebooted, it showed me a warning and now it mounted it on /dev/md127 instead of /dev/md1 -- anyone knows what i'm doing wrong and how to fix this?
[20:59] <pythonirc101> anyone understands mdadm/mkconf here? I've a uuid mismatch that i want to figure out
[21:10] <pythonirc101> anyone using mdadm/mkconf here?
[21:14] <bsg_kwolf> I'm trying to host a couple packages in a local repo, and I'm having trouble adding the repo to sources.list (via http).  Apache is configured and serving up the files fine, but I'm not sure if I can do this over http w/o some type of structure in the directory.
[21:15] <bsg_kwolf> I added to sources.list with "deb http://slam.backstoptest/local  /.", but I'm getting an error when when I run aptitude update of "E: Malformed line 67 in source list /etc/apt/sources.list (dist parse)"
[21:15] <bsg_kwolf> Do I need a specific structure to host it over http?
[21:21] <genii-around> bsg_kwolf: syntax is url dist repo        like ubuntu.com dapper main
[21:23] <bsg_kwolf> ok, apt-get update gave me a better error message.
[21:24] <bsg_kwolf> After I changed the sources.list.
[21:24] <bsg_kwolf> W: Failed to fetch http://slam.backstoptest/local/dists/natty/main/binary-amd64/Packages  404  Not Found
[21:24] <bsg_kwolf> Is there an easy way to just serve a few newer packages from there, or do I need to create the proper directory structure?
[21:27] <genii-around> bsg_kwolf: You do need a fairly specific hierarchy, plus package lists and checksums, etc. Maybe look at http://wiki.freegeek.org/index.php/Debian_Package_Repositories
[21:27] <bsg_kwolf> OK.  thanks.
[21:27]  * genii-around misses Seveas' Falcon package
[23:01] <mtaylor> zomg. why has making a grub menu.lst file gotten so weird?
[23:01] <mtaylor> what the heck do I run to re-generate menu.lst if I edit /etc/default/grub?
[23:29] <Jasonn> I am getting this error: iptables service not started because of error (SVC_RUN_EXCEPT)
[23:29] <Jasonn> mtaylor: Find another menu.lst file online?