[12:12] <cjwatson> evand: err, no it's not (waiting for approval)
[12:12] <cjwatson> https://launchpad.net/ubuntu/+source/ubiquity
[12:13] <evand> as I'm getting kubuntu in the list, despite having the latest daily live in the drive
[12:13] <cjwatson> evand: that was the Alpha vs. Beta thing
[12:13] <cjwatson> (AIUI)
[12:13] <cjwatson> try wubi --debug
[12:13] <evand> cjwatson: odd on the waiting for approval, my mail server must just be horribly behind
[12:13] <evand> will do
[12:14] <cjwatson> michael_e_brown: the preseed file is read by casper; you should be able to see evidence of that in /var/cache/debconf/config.dat before starting ubiquity
[12:14] <cjwatson> (if you omit automatic-ubiquity)
[12:14] <xivulon> are you using rev 301?
[12:14] <michael_e_brown> ok, yay. It is going now. (fails on partman, but that is where I have commented everything out)
[12:14] <cjwatson> michael_e_brown: yes, you need preseed/file= not preseed=; the latter is not valid
[12:14] <evand> ah, so my cd is probably before the switch to beta
[12:14] <evand> my mistake
[12:16] <michael_e_brown> cjwatson, since automatic-ubiquity is just being committed for this release, is it going to be stable enough for use in the Dell install?
[12:16] <michael_e_brown> And, since I just started looking at it, is there tiem enough to fix any bugs I might find?
[12:18] <cjwatson> michael_e_brown: it had better be, we're relying on it for other things
[12:18] <cjwatson> michael_e_brown: not for beta, but for final there ought to be
[12:18] <cjwatson> starting to use it now is the perfect way to get it stabilised
[12:19] <michael_e_brown> cjwatson, thanks.
[12:19] <xivulon> cjwatson shall I disable wubi loopinstalltions for beta?
[12:19] <michael_e_brown> I'll probably be bugging you some more later, cjwatson. For now, I have it going to where I know it is looking at my stuff.
[12:19] <michael_e_brown> now I just have to sort out partitioning.
[12:20] <xivulon> use a recipe for that
[12:21] <michael_e_brown> So, quick question:
[12:21] <michael_e_brown> One of the requests we have for the next version is for people to be able to keep their /home partition data.
[12:21] <cjwatson> xivulon: huh? no
[12:22] <michael_e_brown> But it is optional. I'll need to ask them.
[12:22] <cjwatson> michael_e_brown: we may well look into restructuring partitioning / ubiquity for that for hardy but it's unlikely to change for gutsy at this point
[12:22] <michael_e_brown> Are the debian docs on partitioning relevant, or where should I look?
[12:23] <michael_e_brown> What I was thinking of doing: partition myself in the pre scriptlet, and then just tell ubiquity to use the preconfigured partitions
[12:23] <cjwatson> https://help.ubuntu.com/7.04/installation-guide/i386/appendix-preseed.html
[12:23] <cjwatson> as a general rule (though not universally) we aim to be compatible with d-i preseeding
[12:23] <michael_e_brown> ah. I've been looking for something like that.
[12:24] <cjwatson> of course there are areas where it doesn't make sense
[12:24] <michael_e_brown> hasnt come up in any of my google searches.
[12:24] <cjwatson> I recommend strongly against doing partitioning yourself, unless you absolutely have to
[12:24] <cjwatson> at most, delete partitions you don't want and then tell ubiquity to partition the free space
[12:25] <michael_e_brown> Well, since we are running from /dev/sda2, I'll see what I can come up with.
[12:25] <michael_e_brown> free space might work.
[12:25] <michael_e_brown> But I'm trying to work in this requirement that they've given me that people would like to (optionally) re-use /home.
[12:25] <cjwatson> assuming, presumably, that it's a separate partition?
[12:25] <michael_e_brown> So, I need to come up with a way to ask the user, and so switch around.
[12:26] <michael_e_brown> cjwatson, not necessarily. With our current feisty install,
[12:26] <michael_e_brown> I was planning on just doing an 'rm' of everything except /home
[12:26] <cjwatson> you'd also have to disable sanity checks in the installer
[12:26] <xivulon> cjwatson talking about /home, that's also a wubi requirement at this point
[12:26] <cjwatson> xivulon: not for gutsy it can't be
[12:26] <xivulon> I'll need to disable /home backups then
[12:27] <cjwatson> michael_e_brown: it's hard to do this with unmodified Ubuntu I'm afraid
[12:27] <cjwatson> it's a bug we recognise, but is complicated to fix properly
[12:27] <cjwatson> to what extent are your requirements modified by being possible within Ubuntu?
[12:27] <michael_e_brown> Can I simply tell the installer to use an existing partition for certain mountpoints?
[12:28] <cjwatson> not with the current automatic partitioning recipe format, no
[12:28] <michael_e_brown> but if I dont care about automatic partitioning?
[12:28] <michael_e_brown> I saw in the docs that it is possible to specify partitioning
[12:28] <cjwatson> that's the only way to tell the installer to do anything with partitioning in a preseedable way
[12:28] <michael_e_brown> but havent read them enough yet
[12:28] <cjwatson> without writing code
[12:28] <michael_e_brown> I can write code
[12:28] <michael_e_brown> thats my job.
[12:28] <michael_e_brown> :)
[12:28] <cjwatson> I know, but it starts deviating from Ubuntu at that point
[12:28] <xivulon> cjwatson, what I meant earlier is that if there is no code for skipping mounted partitions in mount.d hence loopinstallations should not work at the moment
[12:29] <cjwatson> we would greatly prefer Dell's changes to Ubuntu to be rolled into Ubuntu
[12:29] <michael_e_brown> yes.
[12:29] <michael_e_brown> Agreed.
[12:29] <michael_e_brown> but, the debian preseed example file (http://www.debian.org/releases/etch/example-preseed.txt)
[12:29] <michael_e_brown> has manual partitioning.
[12:30] <cjwatson> xivulon: please leave it switched on. if it doesn't work we fix it.
[12:30] <michael_e_brown> Is that not applicable to ubunut?
[12:30] <michael_e_brown> look under d-i partman-auto/expert_recipe string
[12:30] <cjwatson> that's automatic partitioning, not manual partitioning
[12:30] <cjwatson> manual partitioning is where you have user interaction at run-time
[12:30] <xivulon> cjwatson, that's the fix you sent me from your local branch
[12:31] <cjwatson> it's manually-configured automatic partitioning, but it's still automatic :)
[12:31] <michael_e_brown> Yes, that is what I want to do.
[12:31] <cjwatson> and yes, expert recipes are supported in Ubuntu
[12:31] <cjwatson> however there is no way to say in an expert recipe "use this partition that already exists"
[12:31] <michael_e_brown> Can I have a script in the preseed/early_command that pops up a GUI dialog
[12:31] <cjwatson> the syntax has not yet been established
[12:31] <michael_e_brown> ah.
[12:31] <michael_e_brown> hmm.
[12:31] <michael_e_brown> :(
[12:32] <cjwatson> preseed/early_command is d-i only
[12:32] <michael_e_brown> ouch.
[12:32] <michael_e_brown> ok. So I have one more question, then. not partitioning related.
[12:32] <michael_e_brown> I have to have a way to put up a BIG FAT WARNING (TM) that the user has to acknowledge before it continues.
[12:33] <michael_e_brown> Right now, the way it works is that there is a GRUB menu entry for reinstalling the system
[12:33] <xivulon> cjwatson is there something equivalent to early_command hooks in the live CD?
[12:33] <michael_e_brown> and they choose that, and there is a script that displays the BFW and asks them to type "REINSTALL SYSTEM" or some such
[12:33] <cjwatson> there's no preseeding facility to do that, but you could modify any number of different places to do that - the boot loader, casper (via usplash and TEXT-URGENT and the like), ubiquity
[12:34] <cjwatson> xivulon: not at present
[12:34] <michael_e_brown> I need something equivalent for us
[12:34] <michael_e_brown> ok. Well, I'll dive into that tomorrow, then.
[12:34] <superm1_> cjwatson, TheMuso had said to double check with you with what needs to be done beyond adding a task to mythbuntu.gutsy seeds branch, to make it an available task (eg so it shows up in synaptic as an option etc).  What more needs to be done?
[12:34] <cjwatson> I'd be inclined to modify the ubiquity welcome screen
[12:34] <xivulon> cjwatson, then I have some useless code in lupin, shouldn't do much harm anyway
[12:34] <michael_e_brown> Thanks for all the help, guys. I am certainly *MUCH* more happy now than three hours ago.
[12:34] <cjwatson> michael_e_brown: there's an intro.txt file that is displayed on ubiquity's first screen
[12:34] <cjwatson> /usr/share/ubiquity/intro.txt
[12:34] <cjwatson> I'd modify that and put your BFW there
[12:35] <cjwatson> though the automation facility might need to be changed to ensure that that is displayed
[12:35] <michael_e_brown> Ok.
[12:35] <cjwatson> evand's your man for figuring that out
[12:35] <michael_e_brown> time for me to go for today. I'll get partitioning sorted out, and then come back after I have more stuff working.
[12:36] <michael_e_brown> but... my aim here is to be able to burn /dev/sda2 onto a CD and drop on the desktop as the last step in the install process. :)
[12:37] <michael_e_brown> so, we boot in the factory with one set of kernel parameters which do a fully automatic install
[12:37] <cjwatson> xivulon: it's valid for d-i, but overkill - I've fixed it to use anna/choose_modules
[12:37] <michael_e_brown> and the user can either A) boot off their CD copy for a fully automatic install (except for BFW, of course)
[12:37] <michael_e_brown> or B) they can use the Live CD
[12:38] <michael_e_brown> anyways, thanks for the help. I'll talk later.
[12:38] <cjwatson> right, I do think ubiquity is a sane option for recovery CDs
[12:38] <cjwatson> argh
[12:39] <xivulon> cjwatson, I was thinking (post beta) to support a live hook like "find_override_script" and "find_override_folder" the fist finds and run a shell scripts after squashfs is ready, the second makes the special folder specified available (so that the script can use the files in there).
[12:40] <cjwatson> I'd like to have a chance to influence the naming of such options. I accepted find_preseed and find_iso because you'd already done them, but they're not really in the standard style
[12:41] <cjwatson> "folder" is a very non-Unix term too :)
[12:42] <xivulon> stat rosa pristina... you know that one already...
[12:42] <cjwatson> they're directories in Unix, though if I understand you correctly you're talking more about mountpoints
[12:42] <cjwatson> (they used to be directories in Windows too until Microsoft decided for some reason that that was a scary term)
[12:43] <cjwatson> superm1_: I need to roll it into tasksel post-beta
[12:43] <superm1_> cjwatson, okay i assumed it was something like that.
[12:43] <superm1_> cjwatson, i'll add the task early next week and we can discuss after beta then
[12:44] <cjwatson> superm1_: depending on how the seed is written (I haven't looked yet), it may need small syntactic changes there)
[12:44] <cjwatson> s/)$//
[12:49] <xivulon> find_override_files
[12:50] <xivulon> parted_server doesn't want to die
[12:51] <cjwatson> it only dies if partman is shut down properly
[12:51] <cjwatson> if not, kill it and rm -rf /var/lib/partman /var/run/parted_server.pid so that it's reinitialised properly on the next run
[12:51] <cjwatson> and remember to losetup -d any loop-mounted devices and umount /host
[12:52] <xivulon> hmm partman is ignoring kill -9 (not to mention 15)
[12:56] <xivulon> and as mentioned tabcompletion freezes the shell
[12:56] <cjwatson> look in dmesg for unionfs bugs
[12:56] <cjwatson> looks like your kernel has fallen over
[12:56] <xivulon> there are plenty of unionfs stuff in there
[12:57] <xivulon> not sure whether they turned up debugging messages or if those are errors
[12:57] <xivulon> but thing seem quite hosed, so I'd go for the second one
[12:58] <cjwatson> dmesg | grep BUG
[12:58] <cjwatson> if that matches then you're hosed, reboot
[12:58] <xivulon> nothing
[12:58] <cjwatson> dmesg | grep -i oops
[12:58] <xivulon> nope
[12:58] <cjwatson> dunno then
[12:59] <cjwatson> shell hanging on tab-completion sounds like it's bust anyway
[12:59] <xivulon> I am sooo lucky
[12:59] <cjwatson> so even if it's unlogged I'd give it up
[01:00] <xivulon> cjwatson going to reboot and try again, what's the plan with autopartition-loop, I don't think it's of much use without the patch we discussed last time
[01:01] <cjwatson> it works fine in the mode I care about :)
[01:01] <cjwatson> (IME)
[01:02] <cjwatson> http://www.fsl.cs.sunysb.edu/pipermail/unionfs/2007-September/005490.html
[01:05] <xivulon> hmm jwatson, I don't preseed loop files in Use-CD mode or Read-Only mode
[01:05] <xivulon> cjwatson
[01:06] <xivulon> shall I change that?
[01:07] <xivulon> also there is no "automatic-ubiquity" in either mode
[01:07] <xivulon> that's great news!
[01:08] <cjwatson> ./wubi/installer/make_menu_lst.nsh:11:        strcpy $automatic "automatic-ubiquity"
[01:08] <cjwatson> oh, that's if not read-only
[01:09] <cjwatson> automatic-ubiquity should be used in use-cd mode but not in read-only mode
[01:09] <cjwatson> read-only is just "boot into CD without having to reconfigure BIOS", right?
[01:09] <cjwatson> the name is confusing
[01:10] <xivulon> by "use cd" I mean boot using the cd
[01:10] <xivulon> by "read only" I mean boot from hd "installation" (but in read only mode).
[01:10] <cjwatson> err
[01:11] <xivulon> I guess what you want is "install from CD"
[01:11] <cjwatson> I'm sorry, but I find these names incomprehensible
[01:11] <cjwatson> perhaps we can find better names for them :)
[01:11] <xivulon> open to suggestions
[01:11] <cjwatson> even after you've explained them I'm not confident I know what they do
[01:11] <xivulon> basically though the options are:
[01:11] <xivulon> 1. Install using preseeding using physical CD
[01:12] <xivulon> 2. Boot physical CD without running Ubiquity (no preseeding also)
[01:12] <cjwatson> 2 is "read-only mode"?
[01:12] <xivulon> 3. Do a frugal installation (copy the CD to HD) and boot that
[01:12] <xivulon> (3 is read only mode)
[01:12] <cjwatson> which one is "use cd"?
[01:13] <xivulon> 2. is "use cd"
[01:13] <xivulon> 1. is missing
[01:13] <cjwatson> ok
[01:13] <xivulon> all others "4GB+" are loopinstallations using HD
[01:13] <cjwatson> 1 and 3 should have automatic-ubiquity set
[01:14] <cjwatson> 2 should not, and it shouldn't have the preseeding arguments either
[01:14] <xivulon> Hmm 3 is not so much for installing, but for actually using when you only have 1GB
[01:14] <cjwatson> ah
[01:14] <xivulon> If you set automatic ubiquity in 3. it becomes the same as 4GB+
[01:14] <cjwatson> ok, then I guess only 1 should have automatic-ubiquity set
[01:16] <xivulon> 1. is not there yet, also because with current interface you cannot choose the loopinstallation size, and the installation type
[01:16] <cjwatson> 1 needs to be the default we present on Ubuntu CDs
[01:18] <xivulon> But does the user have to select the installation size?
[01:18] <cjwatson> I'm fine with the thing that defaults to some proportion of the available free space
[01:21] <xivulon> Basically the difference would be that if you now use "4GB" I extract the ISO to HD, and use find_preseed. And you do not want that
[01:21] <xivulon> when a CD is detected
[01:21] <cjwatson> find_preseed is fine, find_iso isn't
[01:21] <xivulon> I meant find_iso
[01:21] <cjwatson> particularly since extracting the ISO to the hard disk doesn't work at the moment when the CD's locked :)
[01:22] <xivulon> true
[01:22] <xivulon> shall we keep "read only" mode if a CD is detected?
[01:22] <xivulon> There is little point IMO
[01:23] <cjwatson> 2 seems more useful than 3, and again has the advantage of working while the CD is locked
[01:23] <xivulon> Does ejecting the physical CD work by the way?
[01:23] <cjwatson> I haven't noticed it working
[01:23] <cjwatson> but I haven't tested today
[01:24] <xivulon> I didn't touched so if  it didn't work yesterday it wouldn't work today either, will need to burn a CD to play with
[01:24] <xivulon> Ok I am going to submit the required changes
[01:25] <xivulon> have to log off
[01:25] <cjwatson> thanks
[01:25] <xivulon> np
[01:25] <xivulon> I'll do a build tonight, I'll wait for your feedback
[01:25] <xivulon> not sure I'll be able to look at eject
[01:45] <cjwatson> evand: do you have a system known to exhibit unionfs problems?
[01:46] <evand> cjwatson: yes
[01:46] <evand> need logs?
[01:46] <cjwatson> evand: could you pipe up on #ubuntu-devel?
[01:47] <evand> cjwatson: surely
[02:16] <xivulon> cjwatson I pushed the required changes
[02:17] <xivulon> and uploaded rev 304 binary
[02:17] <xivulon> but did not test it yet
[02:17] <cjwatson> ok, I'm trying to get testing of a possible unionfs fix at the moment
[02:18] <xivulon> basically now cd2iso is never called, so if a CD is detected, and you select say 4GB you have to remove the CD, reboot, then reinsert the CD
[02:18] <xivulon> when requested to do so
[02:18] <cjwatson> probably ok for beta
[02:18] <xivulon> eject should be fixed though, otherwise many people will boot off CD and will be quite confused
[02:18] <cjwatson> argh, I need about a week's sleep when this is done
[02:19] <xivulon> same here
[02:19] <cjwatson> eject probably isn't working because wubi is running off the CD
[02:19] <cjwatson> and thus it's locked
[02:19] <cjwatson> I'm inclined to release-note it for beta if nobody can think of a good workaround
[02:20] <cjwatson> my suggestion for post-beta is to figure out a way for the CD bootloader to detect that we're in the middle of a wubi installation and boot straight through to the hard disk
[02:20] <cjwatson> we should have the technology to do that
[02:20] <xivulon> simple workaround is to write "Please remove any CD/DVD and reboot to complete the installation"
[02:20] <cjwatson> that works too
[02:21] <xivulon> cjwatson, for that you'd simply have to set find_preseed=XYZ
[02:21] <xivulon> if it fails, you go on with normal boot
[02:22] <xivulon> if it doesn't fail, it means you are in a wubi installation
[02:22] <cjwatson> that doesn't work, find_preseed isn't passed to the CD bootloader
[02:22] <cjwatson> and it isn't acceptable just to try it - we don't know what to try
[02:22] <xivulon> hmm to see if we are in the middle of a loopinstallation you will have to scan the HD for some file
[02:23] <cjwatson> yep
[02:23] <cjwatson> that's what I meant
[02:23] <xivulon> which is what find_preseed does
[02:23] <cjwatson> but it's in the wrong place
[02:23] <cjwatson> we need to know this in the CD bootloader before even showing the menu
[02:23] <xivulon> I see
[02:23] <xivulon> don't know much about isolinux workings
[02:24] <xivulon> but IMO the code should replicate find_preseed
[02:24] <xivulon> or better: it should try to find ubuntu/install/boot/grub/menu.lst and use the boot options in there
[02:26] <evand> does the initrd take a decade to load for anyone else?
[02:26] <cjwatson> I don't want to design it now, it's just a thought
[02:30] <xivulon> rev 305, changed the reboot message to mention ejecting CD/DVD
[02:30] <xivulon> going to reboot to test
[02:32] <xivulon> cjwatson, to be clear, "Use CD" works as before, "Read Only" works as before, 4GB+ whith CD inserted does not use find_iso, 4GB+ without CD uses find_iso
[02:32] <cjwatson> that sounds good to me
[02:32] <xivulon> rebooting
[02:33] <cjwatson> xivulon: wait
[02:33] <cjwatson> xivulon: could you put a build of that up on /devel/minefields/ ?
[02:34] <cjwatson> we have an updated ubiquity in the archive now, so I'd like to roll updated CD images
[02:34] <xivulon> the build 305 is up
[02:34] <xivulon> but I have not tested it
[02:35] <cjwatson> oh, the apache directory listing is just lying to me about the timestamp
[02:35] <cjwatson> ok
[02:35] <xivulon> gonna upload again just in case
[02:36] <cjwatson> evand: rebuilding images now
[02:36] <xivulon> done
[02:36] <cjwatson> thanks
[02:36] <evand> cjwatson: ok
[02:36] <xivulon> going to reboot will let you know if anything went sour
[02:36] <evand> I'm still trying to get unionfs to hate me
[02:36] <cjwatson> normally it is so easy ...
[02:37] <evand> it apparently has to be difficult, right up to the end
[02:37] <evand> we should just go back to one of those really old COW filesystems, the kind that only work with 2.4
[02:41] <xivulon> hmm trying to download the file
[02:41] <xivulon> I have 1 thing to fix
[02:42] <xivulon> it's gonna be quick
[02:47] <xivulon> cjwatson, evand, uploaded rev 306 please use that
[02:48] <xivulon> going to reboot to test again (it's becoming a pain)
[02:52] <cjwatson> xivulon: the build hasn't got that far yet, so it'll use r306
[02:52] <CIA-18> ubiquity: superm1 * r2157 mythbuntu-ubiquity/ (185 files in 15 dirs):
[02:52] <CIA-18> ubiquity: add old pending merges, and temporary changes that will be merged back
[02:52] <CIA-18> ubiquity: to main branch soon
[02:53] <superm1> whoops didn't realize bzr-cia was still enabled for that branch.  not really necessary anymore i guess.
[02:54] <cjwatson> it's not a problem
[02:56] <xivulon> cjwatson current build on website seems fine
[02:57] <xivulon> in the rush I might have forgotten to up the revision
[02:57] <cjwatson> cool
[02:57] <cjwatson> no worries
[02:57] <cjwatson> can't that be generated automatically from bzr revno?
[02:57] <cjwatson> seems a hassle to have to bump it all the time
[02:57] <xivulon> no rev 306 is fine
[02:58] <xivulon> Yeah I should have a small script to automate that, not sure whether that should be part of make
[02:59] <evand> curiously that vmware machine isn't hard locking, the mouse just doesn't work and if you try to read syslog the VT locks
[03:09] <evand> cjwatson: getting an invalid module format on that unionfs.ko.  Do I need a specific kernel version?
[03:09] <evand> I'll continue investigating after I go grab something to eat.  Back later tonight.
[03:11] <CIA-18> ubiquity: superm1 * r2158 mythbuntu-ubiquity/ (11 files in 7 dirs): add support for xmltv during installation
[03:11] <cjwatson> evand: are you on amd64?
[03:12] <cjwatson> that's built for i386
[03:12] <evand> oh, wow.
[03:12] <evand> I'll start pulling down an i386 CD
[03:12] <cjwatson> new daily-live CDs up
[03:12] <cjwatson> evand: it might be quicker if I gave you the diff to apply to l-u-m
[03:13] <cjwatson> and you can do 'debian/rules build flavours=generic' yourself
[03:13] <evand> well, I've gotta go get something to eat anyway.  So I might as well have the computer do something in my absence
[03:13] <xivulon> will grab that and resume testing tomorrow
[03:13] <cjwatson> evand: http://people.ubuntu.com/~cjwatson/tmp/unionfs-2.1.3-2.1.4.diff
[03:14] <xivulon> going to sleep, anything you need?
[03:14] <cjwatson> need? sleep
[03:15] <xivulon> :P
[03:15] <xivulon> night
[03:27] <evand> cjwatson: it seems to work here, but I wasn't able to reproduce the unionfs bugs to have something to test against
[03:27] <evand> no unionfs bugs thusfar
[05:23] <evand> with further testing it still appears to be stable, but I haven't tried a remastered cd with wubi install yet, which I'll do now.
[05:28] <cjwatson> I had success reports from mjg59 and amitk
[05:28] <cjwatson> kyle has uploaded it
[05:28] <evand> oh, great!
[05:28] <cjwatson> I'm working on unbreaking bits of wubi now
[05:28] <evand> anything I can do to help at the moment?
[05:28] <cjwatson> beat me to it :-)
[05:28] <cjwatson> it's grotty partman stuff
[05:28] <evand> heh, ok
[05:29] <cjwatson> I committed a lupin fix earlier
[05:29] <evand> where is the install stopping for you currently?  I don't get past 5% on the install itself, curious if you're running into the same issue.
[05:29] <evand> ok
[05:30] <cjwatson> I think partman-basicfilesystems needs to be changed to redirect mount 3<&-
[05:30] <cjwatson> which is why log-output is hanging I believe
[05:30] <cjwatson> need to verify that though
[05:30] <evand> ok
[05:30] <cjwatson> and partman-auto-loop needs to be changed to autoaccept the partitioning
[05:32] <cjwatson> hmm, or maybe not
[06:18] <cjwatson> evand: hmm, same thing for me now
[06:18] <cjwatson> and I switched to vt1 and now can't switch back to vt7
[06:19] <cjwatson> I think it was a valiant attempt but maybe it's time to give up on wubi for beta
[06:19] <cjwatson> what do you think?
[06:20] <evand> arr, I'm not sure.  I want to fight to the end, but we're getting quite close.
[06:20] <evand> hah, that made no sense
[06:21] <cjwatson> that hang we're both seeing seems pretty hard to tackle at short notice
[06:21] <evand> well, at least someone may benefit from the automation work
[06:21] <cjwatson> oh, that will be generally applicable
[06:22] <evand> but I have the feeling that if we don't get wubi in, someone will clearly beat us to the same feature before we have another release in 6 months
[06:22] <cjwatson> it just takes a while for the people using it to show up, because the people who care about that sort of thing tend to be more conservative
[06:22] <evand> indeed
[06:22] <cjwatson> I just don't think we can do it for beta. If we can figure it out immediately post-beta, I'd be willing to consider it ...
[06:23] <cjwatson> I think it will take too much of our energy and consume extra testing resources that we don't have at this point
[06:23] <evand> indeed
[06:23] <evand> I think you're right
[06:24] <cjwatson> I'm not thrilled since we've put so much effort into it, but sunk costs
[06:25] <cjwatson> I suppose one way to tackle the hang would be to install openssh-server first, ssh in from another host, and strace the whole thing with output going to the terminal
[06:25] <cjwatson> then it *might* be possible to see what kills it
[06:26] <evand> the hang locks up everything for you?
[06:26] <evand> for me it's just the mouse and syslog
[06:26] <cjwatson> locked vt-switching which made it hard to tell about anything else
[06:27] <evand> huh, I could switch VTs
[06:27] <cjwatson> you may stand a chance of debugging it then :)
[06:27] <evand> what do I need to strace?
[06:28] <cjwatson> check the process listing first
[06:28] <cjwatson> for me it looked like mkfs.ext3 was running - does that match you?
[06:28] <cjwatson> check free memory, see if it's very low
[06:28] <cjwatson> then strace whatever the deepest process is
[06:28] <evand> will do
[06:29] <cjwatson> I'll leave you to it, I think I need to fall over now
[06:29] <evand> yeah, I was going to suggest it but 32,000 people already have.
[06:29] <evand> I must say, I am quite impressed with your determination
[06:34] <superm1> cjwatson, 32,001 people have now, get some rest, i remember seeing you on when i first signed on earlier today :)
[06:35] <cjwatson> heh
[06:35] <cjwatson> evand: just committing the various things I've got so far from wubi testing
[06:35] <evand> cjwatson: thanks, very much appreciated
[06:43] <cjwatson> evand: I won't upload them (at least for now), but you should find changes to lupin, wubi, and partman-basicfilesystems in their respective bzr branches
[06:43] <cjwatson> evand: the partman-basicfilesystems change, and indeed our problem, seems related to bug 134710
[06:44] <cjwatson> evand: as a parting thought, I wonder if you might be able to work around it by blatting /bin/log-output and making it a symlink to true
[06:44] <cjwatson> er, except not a symlink to true, that won't work
[06:44] <cjwatson> but something that ignores its options and execs the command it's given, anyway
[06:45] <cjwatson> just a thought, may be wildly inaccurate
[06:46] <evand> I follow your thought process.  I'll give that a shot.
[06:46] <cjwatson> alternatively change ntfs-3g to close all its file descriptors when daemonisin
[06:46] <cjwatson> g
[06:47] <cjwatson> that might also help matters
[06:47] <cjwatson> definitely seems to be related to ntfs-3g one way or the other
[07:48] <evand> cjwatson: I don't think log-output is the issue.  I just replaced calls to it in 50format_ext3 with just the commands and it's still getting caught up in the same place.
[07:48] <evand> still investigating
[07:49] <evand> oh wait, I didn't go high enough up.  Hrmm, ignore what I said for right now.
[08:20] <evand> ok yeah, it doesn't appear to be log-output.  I replaced it with a script that stripped -t and it's argument and --pass-stdout, then ran the rest, and it's still locking in the same place
[08:45] <evand> I can't call strace on mkfs.ext3 quick enough.  It locks as I'm calling strace.
[08:47] <superm1> even via ssh?
[08:47] <evand> superm1: indeed
[08:48] <evand> I'm going to give it another go with a while [ true] ; do; strace -p$(pidof mkfs.ext3); done
[08:48] <superm1> evand, perhaps can you inject your call to strace into the source where mkfs.ext3 is called?
[08:49] <superm1> so that its immediately straced
[08:49] <evand> hrmm
[08:49] <superm1> and then from your ssh session keep a tail -f on the log files
[08:49] <evand> that's the problem though, I'd need to quickly tail the files
[08:49] <evand> my window is very small
[08:49] <evand> only a few seconds at best
[08:50] <superm1> oh yikes.
[08:50] <superm1> well however
[08:50] <superm1> when you are launching with strace, the process does take a bit longer to run
[08:50] <superm1> so your window will lengthen a bit
[08:51] <superm1> you can also consider injecting a sleep 10 or so into the source before mkfs.ext3 actually gets called
[08:51] <evand> and I could create the log file beforehand and just tail it then.  Hrm.
[08:51] <superm1> to lengthen that window
[08:51] <evand> indeed
[09:00] <CIA-18> ubiquity: superm1 * r2159 mythbuntu-ubiquity/debian/ (81 files in 2 dirs): update text for myth_button
[09:04] <CIA-18> ubiquity: superm1 * r2160 mythbuntu-ubiquity/debian/ (80 files in 2 dirs): update text for mythweb_button
[09:08] <evand> ugh, compiz is starting to become more trouble than it's worth.  I got all the way to where I would run strace and compiz locked up on me.
[09:17] <soren> Which part of d-i writes the template bits of grub's menu.lst?
[09:19] <evand> grub-installer, I believe
[09:20] <soren> I would have thought so to, but I can't find anything that looks like that template in it.
[09:21] <evand> I believe it calls update-grub
[09:21] <evand> which would write the file
[09:22] <soren> Yes, found it.
[09:22] <soren> Thanks.
[09:22] <evand> anytime
[09:23] <soren> I've managed to implement grub's boot loader installation voodoo in posix shell now :)
[09:23] <evand> awesome!
[09:23] <evand> I'll have to pull from your branch after I wake up
[09:25] <soren> :) Man, grub's code was difficult to figure out.
[09:28] <evand> gah, I can imagine
[09:48] <xivulon> cjwatson, uploaded rev 308
[09:49] <xivulon> cjwatson, evand, unless I noticed that the ISO includes and old version of wubi (rev291)
[09:49] <xivulon> unless I got confused with the isos
[09:59] <CIA-18> ubiquity: superm1 * r2161 mythbuntu-ubiquity/ (debian/changelog scripts/mythbuntu/mythbuntu_install.py): explicitly install all libvia* when setting up openchrome
[01:11] <cjwatson> xivulon: ok, we've arrived at the end of the line for beta and it doesn't work yet, so I'm afraid I have to remove wubi from the daily builds
[01:11] <cjwatson> xivulon: we did our best
[01:11] <cjwatson> xivulon: we'll put it back in again after beta and see what we can do to fix it up
[01:11] <cjwatson> and maybe we can make a decision for final in case it lands early enough
[01:18] <xivulon> sorry cjwatson, what does not work?
[01:20] <xivulon> is it rev308?
[01:24] <cjwatson> it doesn't matter, the breakage is on the installer side
[01:24] <cjwatson> but unfortunately we do not at present have a clear idea of how to fi xit
[01:25] <cjwatson> fix it
[01:26] <cjwatson> we got through several of the problems, but at the moment it's hanging on mkfs.ext2
[01:26] <xivulon> can it be because the images are sparse?
[01:26] <xivulon> you may want to try with zeroed images
[01:27] <cjwatson> it's possible and worth a try
[01:27] <cjwatson> but the beta images are being prepared NOW
[01:27] <cjwatson> we simply ran out of time, I'm afraid
[01:27] <cjwatson> despite our best efforts
[01:27] <xivulon> I understand. But can we leave the autopartition/lupin stuff in the there anyway?
[01:29] <cjwatson> oh, sure, it's much too painful to rip it out
[01:29] <xivulon> good
[01:29] <cjwatson> obviously I want to try to support wubi in the final release regardless of whether we end up shipping it
[01:29] <xivulon> that's very nice to hear
[01:30] <xivulon> Ideally we need to make sure that autorpartition works off HD ISO
[01:30] <xivulon> And that initramfs-tools behaves proeprly
[01:31] <xivulon> I will add the find_override_script code to lupin today/tomorrow
[01:31] <cjwatson> please don't, I was thinking of adding that to ubiquity
[01:31] <cjwatson> or something similar
[01:31] <cjwatson> but I want to have it designed first :)
[01:31] <cjwatson> ubiquity> well, maybe casper
[01:32] <xivulon> i.e. lupin-casper ;)
[01:32] <cjwatson> it's not loop-installation-specific AIUI
[01:32] <cjwatson> lupin is not intended to be a playground for stuff that should be in casper but we couldn't be bothered :)
[01:33] <xivulon> True, it might require the find_path code though, but we might move that into casper if you want
[01:33] <cjwatson> please can we discuss this after beta
[01:33] <xivulon> sure
[01:33] <cjwatson> then I will have slept etc. :)
[01:33] <xivulon> I won't let you sleep that much until the ca
[01:33] <xivulon> changes above are in :P
[01:34] <xivulon> Anything you need on my side for beta?
[01:35] <cjwatson> no
[01:35] <xivulon> no is good
[01:35] <xivulon> thanks for all the trouble
[04:16] <xivulon> cjwatson, fyi apparently dd is 8x slower when using bs != 4k
[04:21] <xivulon> I guess it's to late now, but apparently ntfs-3g 1.913 is quite faster
[04:21] <cjwatson> we can consider it after beta
[04:21] <cjwatson> thanks for the dd tip; could you please file it as a bug on /ubuntu/+source/partman-auto-loop?
[04:23] <xivulon> sure, I have not tried it myself it was a suggestion from szaka
[04:23] <xivulon> He also mentioned we should use v1.913, but don't think it's going to happen
[04:23] <cjwatson> it's not out of the question
[04:23] <cjwatson> though of course every upstream always thinks we should use their most current releases :)
[04:24] <xivulon> good
[04:24] <xivulon> I have also prepared a plan for integrating lupin into casper + adding external hooks
[04:32] <xivulon> https://bugs.launchpad.net/ubuntu/+source/partman-auto-loop/+bug/144793
[04:38] <michael_e_brown> cjwatson, I found a small bug.
[04:38] <michael_e_brown> If you copy the installation media to HDD, it boots from hdd just fine.
[04:39] <michael_e_brown> But if you then try to boot from CDROM (newer media)
[04:39] <michael_e_brown> the CDROM mounts the hdd image
[04:39] <michael_e_brown> instead of the cdrom
[04:40] <michael_e_brown> In the past (another project), I had fixed this by embedding a serial # in the initrd that had to match the CDROM media
[04:40] <michael_e_brown> that way it wouldnt be fooled by older media copied to the hdd
[04:41] <michael_e_brown> This will bite Dell customers if they put in a gutsy install media and expect it to use that rather than our hdd copy
[04:42] <cjwatson> michael_e_brown: could you file it on casper, please?
[04:42] <cjwatson> https://bugs.launchpad.net/ubuntu/+source/casper/+filebug
[04:43] <xivulon> https://bugs.launchpad.net/ubuntu/+source/casper/+bug/144798
[04:43] <xivulon> you      shall        not      sleep!
[04:43] <cjwatson> ok, guys, I don't need the bug URLs pasted here :)
[04:43] <xivulon> lotr citation
[04:43] <cjwatson> that's what bugmail's for
[04:44] <cjwatson> we'll get to post-beta things after the beta
[04:44] <xivulon> just in case cjwatson...
[04:46] <michael_e_brown> https://bugs.launchpad.net/ubuntu/+source/casper/+bug/144800
[04:48] <xivulon> out of curiosity what file contains the serial numbers of ISOs?
[04:49] <xivulon> michael_e_brown, when you boot from HDD, do you also use d-i/ubiquity for partitioning?
[04:50] <michael_e_brown> I'm working on it. Havent gotten it working yet
[04:52] <xivulon> What I mean is that I may have the same issue, I need to resize/modify partitions when one of the devices is mounted to use the ISO
[04:52] <xivulon> If you find a solution to that, I'd be more than interested
[04:53] <xivulon> But I guess cjwatson will chip in to slash my hopes
[05:04] <michael_e_brown> cjwatson, ping.
[05:04] <michael_e_brown> ok. have installer installing now
[05:04] <michael_e_brown> Now, I absolutely must have a way to add pre/post scripting.
[05:05] <cjwatson> michael_e_brown: this is a really bad day for me - I'm totally blasted with beta things
[05:05] <cjwatson> is it life-threatening? :)
[05:05] <michael_e_brown> actually, yes.
[05:05] <xivulon> michael_e_brown is that the live iso you are using?
[05:05] <michael_e_brown> yes
[05:05] <michael_e_brown> I have to have it by friday.
[05:05] <xivulon> https://bugs.launchpad.net/ubuntu/+source/casper/+bug/144798
[05:05] <cjwatson> I'm afraid you're going to have to add that yourself, and we can worry about integrating later
[05:05] <michael_e_brown> if today isnt good, as long as I can get an answer tuesday or wed would be ok, but pushing things.
[05:06] <cjwatson> we have a beta in two days which is our highest priority
[05:06] <michael_e_brown> Ok. so if I get a method for adding pre-scripts/post-scripts, we can integrate it after the next beta?
[05:07] <michael_e_brown> ah, I see xivulon's stuff...
[05:07] <cjwatson> yes (though I won't guarantee we won't want to change it in the process of integration of course!)
[05:07] <xivulon> michael_e_brown if the spec above is ok and cjwatson agrees, I may add it today/tomorrow in a separate branch
[05:07] <michael_e_brown> does xivulon's stuff have a patch?
[05:07] <cjwatson> michael_e_brown: no
[05:07] <cjwatson> xivulon: decouple it from find_preseed and find_iso; it's separate work
[05:08] <cjwatson> don't file single bugs with five separate bullet points in them, they're too hard to manage
[05:08] <xivulon> michael_e_brown you can have a look at find_preseed in https://code.launchpad.net/~ubuntu-installer/lupin/gutsy, the hook would be similar code
[05:08] <xivulon> sorry cjwatson
[05:08] <cjwatson> xivulon: please hold on
[05:08] <cjwatson> xivulon: as I understand it, find_preseed is not right
[05:09] <xivulon> I filed it together because all of them are depending on get_file/find_file (find_path in lupin)
[05:10] <xivulon> cjwatson look at the syntax proposal for paths
[05:10] <cjwatson> michael_e_brown: could you please explain exactly what pre and post are in your context? i.e. before and after what? How much of the operating system, graphical environment, etc. needs to be up?
[05:10] <xivulon> that would apply to ISO, preseed, and override
[05:10] <cjwatson> xivulon: not today
[05:10] <michael_e_brown> do you need a bug for this?
[05:10] <michael_e_brown> or just irc?
[05:11] <xivulon> michael_e_brown, my proposal is simply to make a bunch of file on HD available and a script is executed when the ISO squashfs is mounted
[05:12] <xivulon> so for instance, if you need to replace /bin/autopartition-loop, you can add that to override_files, and have a simple script to replace the file in override_script
[07:31] <evand> cjwatson: Does 144857 look to you like being caused by the ntfs-3g issues we've been seeing?
[07:40] <cjwatson> evand: hmm, could be but it's pretty hard to say. It's certainly different from the problems we saw
[07:41] <cjwatson> it's while partman is starting up and parted_server is scanning disks
[07:41] <evand> not really sure how we can get more information out of them for that one, given the way it crashes.
[08:35] <evand> cjwatson_: Looking at bug 107686, I've noticed that closing the install progress window has the same effect.  How would you like to see this handled?  The two options I can think of is to prompt the user to cancel the install or to block closing (but then we should probably tell the wm to not create a close button.
[09:54] <evand> cjwatson_: Also, can bug #42202 be closed?  This seems to have been resolved for a very long time.
[11:11] <cjwatson> evand: the progress window's delete method or whatever it is should be bound to the same thing that that method of the main window is bound to
[11:11] <cjwatson> if that sentence made any sense
[11:12] <cjwatson> it may be that the KDE frontend is particularly dodgy here
[11:13] <cjwatson> evand: 42202> hmm, is it? try selecting say English language with a German keyboard in gfxboot
[11:13] <cjwatson> though if that works, then I guess it was fixed by console-setup and I've just forgotten about it
[11:14] <evand> cjwatson: it does, and I will test the latter further
[11:14] <evand> it does make sense, that is
[11:45] <evand> cjwatson: german keyboard> works for me
[11:47] <cjwatson> oh, cool, feel free to close then
[11:50] <evand> thanks
[11:51] <evand> ahhh, it was closed in casper already, just not ubiquity
[11:52] <evand> oh nevermind