[00:24] <antarus> hrm
[00:24] <antarus> did someone futz with the precise netboot images recently?
[00:29] <antarus> we are seeing this weird problem:
[00:29] <antarus> 08/05 14:47:45 INFO |logging_ma:0560| 2013-08-05T21:30:55-07:00 anna[4924]: WARNING **: no packages matching running kernel 3.2.0-50-generic in archive
[00:29] <antarus> usually this just means our mirroring is b0rked
[00:29] <antarus> but we checked and it appears to be working
[00:30] <antarus> the linux kernel is 3.2.0.50, but d-i only has 3.2.0.51 modules
[00:30]  * antarus is still likely to blame mirroring somewhere
[00:39] <antarus> sorry, to be clear, the netboot kernel is 50, but our mirror only has modules for 51
[00:39] <antarus> hence anna being angry
[01:06] <infinity> antarus: Yeah, -50 never hit updates, but the d-i did.  A bit of a screwup, will be fixing first thing when I wake up.
[01:07] <antarus> infinity: ok thx
[01:07] <antarus> infinity: I was going to file a bug, but I figured I'd ask in here, seeing as if it was on your end, you'd know already ;)
[01:14] <infinity> Meh, maybe I'll just upload against the current -updates kernels now, and then re-do it for the .3 kernels later.
[01:21] <infinity> antarus: Should be fixed in -updates in a few hours.  Tis building right now.  I didn't realize how broken it was when Colin brought it up earlier today, sorry.
[01:24] <antarus> no worries
[14:07] <gaaldering> Good afternoon :)
[14:08] <gaaldering> I want to create a preseed partman expert recipe with the following layout: /dev/sda with bootable lvm, ext4 on /, /dev/sdab with lvm, swap
[14:08] <gaaldering> This works fine if i set it up by hand, but im having a hard time doing this with partman-auto in Precise
[14:09] <gaaldering> So, 2 disks, both with their own lvm...
[14:09] <gaaldering> Is this possible that anyone knows?
[14:14] <cjwatson> xnox: ^- could you help gaaldering out?
[14:14] <cjwatson> (on the phone)
[14:34] <xnox> gaaldering: what's /dev/sdab ? second drive? or it all just a single one.
[14:35] <xnox> gaaldering: it sounds like you can just do partman-auto-lvm, if you need to tweak sizes an example recipe from http://www.gasid.org.uk/2012/06/debianubuntu-preseed-lvm-and-expert_recipe/ should do it.
[14:35] <xnox> gaaldering: note the separate /boot partition though.
[15:17] <gaaldering> xnonx: sorry got pulled away into some meetings as well
[15:18] <gaaldering> xnox: i made a type, so i have 2 disks, sda and sdb, on sda i want a bootable / in lvm, on sdb i want swap in lvm
[15:18] <xnox> gaaldering: i see.
[15:18] <gaaldering> right now im getting 1 volume group, a free ext2 /boot, and some more madness :(
[15:18] <gaaldering> is it possible to partition 2 disks in precise preseed?
[15:18] <xnox> gaaldering: yeah, then above advice doesn't apply. Let me figure this out.
[15:19] <xnox> gaaldering: yes, it should be possible to partition 2 disks in precise preseed.
[15:19] <gaaldering> cool
[15:19] <gaaldering> and, does partman understand it if i want to have 1 / partition ext4 in lvm, and boot from that?
[15:20] <gaaldering> to me it seems partman really wants a /boot partition somehow
[15:20] <gaaldering> but grub 2 can boot lvm just fine
[15:21] <xnox> gaaldering: whilst grub 2 can boot of lvm, the installer and grub2 package isn't configured to allow that in precise.
[15:21] <xnox> gaaldering: thus you will need a separate /boot partition.
[15:22] <gaaldering> you mean in preseed?
[15:22] <gaaldering> if i do this by hand this works just fine :)
[15:22] <xnox> gaaldering: yes, it will be part of the expert recipe. as expert recipe defines everything.
[15:22] <gaaldering> ok, so what your saying is that partman does not support a bootable lvm ? :)
[15:23] <gaaldering> or let me rephrase it
[15:23] <gaaldering> its not supports by the preseed answers....
[15:23] <gaaldering> thats too bad :(
[15:23] <xnox> gaaldering: hm =) I didn't think it did, but if no warning showed up, it should fine. (the warning - critical d-i error "no bootable /boot defined" or something like that)
[15:23] <gaaldering> xnox im surpressing that notice
[15:23] <xnox> ah, ok.
[15:24] <gaaldering> the weird thing right now is, that partman gives me a free ext2 /boot partition, and its nowhere to be found in my expert string
[15:25] <xnox> gaaldering: do you want both drives in a single VG or one VG per drive?
[15:25] <gaaldering> 1 vg per drive
[15:28] <xnox> gaaldering: in that case i'd deploy hacks. Assume that your recipe formats just the /dev/sda (without swap, as you want)
[15:29] <xnox> e.g.: partman-auto/method string lvm; d-i partman-auto/disk string /dev/sda;
[15:29] <xnox> (or with a recipe)
[15:29] <xnox> and then in either:
[15:29] <gaaldering> i did that 2 years ago :) thought this would be fixed maybe by now :))
[15:29] <gaaldering> what i did back then is break out of the installer, do a shell script, and go back in the installer
[15:29] <gaaldering> simply because partman doesnt support things that are possible by hand
[15:29] <xnox> in late_command or partman/early_command: setup lvm, vg, lv, format as swap and activate & add to fstab.
[15:29] <gaaldering> something like that yes :)
[15:30] <xnox> gaaldering: if one specifies: d-i partman-auto/disk string /dev/sda /dev/sdb. With lvm method, both drives will be added as PV into a single VG, and then your LVs will be across both of them.
[15:30] <xnox> (with no way to control mirroring/stripping)
[15:31] <xnox> (or which LV goes on to which PV)
[15:31] <gaaldering> xnox: do you know why partman is not supporting these options? :)
[15:31] <xnox> gaaldering: because I didn't write them yet?! =)
[15:31] <gaaldering> xnox: cant we do that ? :)
[15:32] <xnox> gaaldering: so far there hasn't been a pressing need for those. We give users ability to break out into shell and do anything, and that seems to be sufficient so far =)
[15:33] <xnox> gaaldering: UX designers are pressing to remove options =)
[15:33] <gaaldering> xnox: those UX designers never tried booting from LVM :)
[15:34] <gaaldering> xnox: partman needs more options :) easy
[15:34] <gaaldering> xnox: maybe we need better documentation though :)
[15:34] <xnox> gaaldering: when I explained what lvm is, they said - kill all partitioning screens and force use lvm across all drives by default and then we can ignore all partitioning issues.
[15:35] <xnox> ... until i pointed out that windows/mac dual-boot can't read LVM2 volumes. they got very sad at that point.
[15:35] <xnox> gaaldering: http://www.debian.org/releases/stable/amd64/apbs04.html.en#preseed-partman is very thorough.
[15:36] <xnox> gaaldering: together with ubuntu equivalent, documenting some of the ubuntu specific options.
[15:36] <gaaldering> xnox: are you the (partly) author of partman ?
[15:37] <xnox> gaaldering: no, i'm just a minion. =) i have a few patches here and there, and commit access to d-i, but I'm still only a contributor.
[15:37] <gaaldering> xnox: partman could use some love :)
[15:37] <gaaldering> xnox: you should check dispicable me engineer on youtube :)
[15:37] <gaaldering> brilliant
[15:37] <gaaldering> mini movie
[15:38] <gaaldering> xnox: it seems that partman does things by itself which im not telling it to do
[15:38]  * xnox <3 despicable me
[15:38] <gaaldering> but, what your suggesting is break out of the installer because partman recipes do not support booting from lvm
[15:40] <xnox> gaaldering: you can preseed breaking out.
[15:40] <gaaldering> :(
[15:40] <gaaldering> im fan of preseed
[15:40] <gaaldering> i was hoping to do this native :)
[15:40] <xnox> it can be automated.
[15:40] <gaaldering> instead of shell scripts
[15:41] <gaaldering> xnox: is partman hard to dive into?
[15:41] <gaaldering> xnox: and make this possible?
[15:41] <gaaldering> kickstart supports these things as far as i could find
[15:41] <xnox> gaaldering: no, it's easy. it's all mostly shell scripts =) + debconf (for asking questions, driving logic, preseeding)
[15:41] <gaaldering> really
[15:41] <gaaldering> hm
[15:42] <gaaldering> so but what those ux designers want is not really feasable is it?
[15:42] <xnox> gaaldering: here is an example of using " d-i partman/early_command" to execute a shell snippet to drive things dynamically. http://www.debian.org/releases/stable/amd64/apbs05.html.en
[15:42] <gaaldering> xnox: i build that 2 years ago for another custom partioning
[15:43] <gaaldering> xnox: raw formatting on disks
[15:43] <gaaldering> mkfs.xfs /dev/sda
[15:43] <gaaldering> :)
[15:43] <gaaldering> works like a charm in a vm
[15:43] <gaaldering> needs a grubinstall --force though
[15:43] <xnox> gaaldering: ha =) partman has xfs support these days.
[15:43] <gaaldering> took me 2 weeks of struggling
[15:43] <gaaldering> im doing ext4 now
[15:43] <gaaldering> but
[15:43] <gaaldering> i dont get it
[15:43] <gaaldering> why isnt partman being
[15:43] <gaaldering> fixed
[16:08] <gaaldering> xnox: say, id take 1 disk with lvm, could i boot from LVM then ?
[16:11] <gaaldering> xnox: partman keeps surprising me that what i do by hand does not seem to be possible with partman recipes :)
[16:12] <gaaldering> xnox: early_command seems like a workaround to me to get something to work that is not supported
[16:15] <xnox> gaaldering: pre-existing lvm on the disk? recently reuse methods were added to partman ( and i even think it's been ported back to precise)
[16:16] <xnox> gaaldering: sure there is always stuff one can do more, but partman does a good job for an impressive variety of systems/configurations that are suitable for many use-cases.
[16:17] <xnox> the disparity between interractive vs preseed does intrigue me as well. but i'm not sure how that can be solved.
[16:19] <gaaldering> xnox: yeah you are totally right
[16:19] <gaaldering> interface vs preseed incompatability makes it strange
[16:20] <gaaldering> if its possible to do it interactively, then why not via preseed :)
[16:48] <gaaldering> xnox: could you point me where i should look for the sourcecode of partman ? is that a partman.udeb ?:
[16:49] <xnox> gaaldering: https://wiki.debian.org/DebianInstaller/CheckOut
[16:49] <xnox> is the debian one.
[16:49] <xnox> gaaldering: there are a few ubuntu patches/forks for some of the projects. Those can be found as bzr branches at:
[16:50] <xnox> https://code.launchpad.net/d-i
[16:50] <xnox> e.g.: lp:~ubuntu-core-dev/apt-setup/ubuntu for ubuntu fork of apt-setup.
[16:50] <gaaldering> im glad everything is in git
[16:50] <gaaldering> :(
[16:50] <xnox> gaaldering: translations are in svn, ubuntu forks are in bzr, debian upstream is in git.
[16:51] <gaaldering> lol :)
[16:51] <gaaldering> how do you guys keep this stuff working
[16:52] <xnox> gaaldering: well we have automatic git -> bzr imports on launchpad e.g. lp:apt-setup is the debian-git import, which we merge into lp:~ubuntu-core-dev/ owned branches and upload into the archive....
[16:52] <gaaldering> why is launchpad using bzr instead of git?
[16:52] <gaaldering> historical reasons?
[16:52] <cjwatson> Canonical wrote bzr
[16:52] <cjwatson> Before git existed
[16:53] <gaaldering> Cool :)
[16:53] <xnox> it's not as bad as it sounds, all of the multiple projects are fairly standartised.
[16:53] <gaaldering> it took me some time to kind of master git :)
[16:54] <gaaldering> im at least going to try and look in the source how it looks like, and why its doing things that i dont want it to do :)
[16:54] <gaaldering> im curious
[16:54] <xnox> gaaldering: bzr is easy. all svn commands map to direct equivalents in bzr + one needs to know "push" and "pull", which by default does sensible things with pushing/pulling tags unlike git.
[16:58] <gaaldering> xnox: but the part i want to look in is partman right?
[16:58] <cjwatson> Probably partman-lvm or partman-auto-lvm
[16:58] <gaaldering> in regards to the stuff we spoke about
[16:58] <cjwatson> It'll use facilities from partman-base and partman-auto
[17:02] <gaaldering> but the debian installer actually downloads the partman udebs right?
[17:02] <gaaldering> or is that build-in like net-retriever
[17:03] <xnox> gaaldering: depends on the type of the build. can be either.
[17:03] <gaaldering> xnox: im mainly interested in partman-auto-lvm and partman-lvm
[17:03] <xnox> gaaldering: server/desktop has them built-in, mini and pxe boot download them.
[17:03] <gaaldering> im using pxe network preseed installs
[17:08] <gaaldering> autolvm.sh :)
[17:09] <gaaldering> xnox: is almost everything in partman written in shell?
[17:10] <xnox> gaaldering: yes.
[17:11] <gaaldering> cool :)
[17:11] <xnox> gaaldering: there are things that are not shell, busybox ( to provide /bin/sh ), various filesystem unitilies, partman-server itself, and a few other helper tools for networking and some-such.
[17:11] <xnox> gaaldering: but all of the installer and partman logic is in shell.
[17:11] <gaaldering> i think in my case i dont have to go into that much detail
[17:11] <xnox> yeah =)
[17:12] <gaaldering> thanks a lot
[17:12] <gaaldering> for pointing things out to me
[17:12] <xnox> no problem =)
[17:13] <gaaldering> my servers are installing in 3 minutes now :)
[17:14] <gaaldering> from start to prompt
[17:15] <gaaldering> now some nice disk recipe which i can use so resizing vm disks will be easy and im good to go :)
[17:15] <gaaldering> dinner time :) thanks again!