/srv/irclogs.ubuntu.com/2008/06/26/#ubuntu-installer.txt

=== ago_ is now known as xivulon_
xivuloncjwatson, evand, please see https://bugs.edge.launchpad.net/wubi/+bug/24310510:11
xivulonI made a tiny progress10:12
xivulonbasically the problem is in apt_pkg -> Acquire -> Run10:12
xivulonwhich explain the Type Int error in Pulse (it is the pulse inside acquire.cc not in install.py...)10:13
xivulonI still do not know why bindmounts create issues here though10:14
xivulonany hint welcome10:14
xivulonhmm could the issue be in cdrom.py mountpoint handling? I cannot test anymore10:27
holsthmm11:02
holstis there some way to format if no file system exist otherwise just mount, in parted?11:03
holsthttp://rafb.net/p/6KigAK96.html11:09
holstdo you see any problem with my /NOBACKUP partition?11:10
holstanyone? :)11:15
holstit reformats my disk even if i have method{ keep }11:15
cjwatsonholst: did you see the comments I addressed to you yesterday evening?11:20
holstwell, I need to format /11:22
holsthmm, reading up on what you said11:23
holstgimme a sec11:23
holsthmm11:24
holstcan you run a script that, before the installation starts, runs some formatting?11:24
cjwatsonyes, unfortunately it's a bit complicated due to bug 23934811:25
holstohh, how bitter, I really wanted to solve this11:26
cjwatsonbut you can do it by using preseed/early_command to write out a script in /lib/partman/display.d/00local and make it executable11:26
cjwatsonthen that will be run at the start of the partitioner11:26
cjwatsonholst: I'm still not clear on whether your existing /NOBACKUP is a separate partition or just an ordinary directory on /11:26
holstI solved it!11:27
holstI have two CDs11:27
holstone is labeled: FORMAT11:27
holstone is labeled: KEEP11:27
holstwith the obvious meanings for /NOBACKUP :)11:27
holstwhat do you think?11:27
cjwatsonI'm not sure I understand11:27
holstwell, one cd formats /NOBACKUP11:27
holstand if you know you have a /NOBACKUP,11:28
holstthen you install with the other CD11:28
holstthe one labeled KEEP11:28
holstwhich just mounts /NOBACKUP11:28
cjwatsonit's still tricky to deal with existing partitions in the current automatic partitioner11:28
cjwatson21:22 <cjwatson> holst: however, unfortunately, it's really hard to do this automatically at the moment, because the automatic partitioner doesn't have any support for selecting an existing partition11:29
cjwatson21:22 <cjwatson> this is something I'm hoping to fix - but at the moment all it can do is create new partitions11:29
cjwatson21:23 <cjwatson> if /NOBACKUP is a separate partition, then I've seen ways to do this by deleting all the other partitions you *don't* want to keep before the partitioner runs, then telling the automatic11:29
cjwatson                 partitioner to operate on the free space, then mounting it at the end - but they're all a bit hackish11:29
cjwatsonas I said yesterday11:29
xivuloncjwatson how is the cdrom repository handled by apt during installation? is /proc/mounts involved in the process? could bindmounts in /cdrom create problems?11:31
cjwatsonit just calls mount as far as I know11:32
cjwatsonthough I thought we told it not to do that, generally11:33
cjwatsonplease see the configure_apt method in ubiquity/scripts/install.py11:33
cjwatsonwhat I mean is, we configure apt so that it shouldn't muck about with mounting/unmounting /cdrom itself, although ubiquity bind-mounts /cdrom into /target/cdrom11:34
xivulonit would still need a mountpoint though, could it be that the mountpoint is retrieved from the device?11:35
xivulonso that you end up with 2 mountpoints11:35
cjwatsonI'm not sure that question makes sense ...11:35
cjwatsonapt's cdrom mountpoint is part of apt's configuration, /cdrom by default11:36
xivulonhm assuming the cd is mounted, apt would need to know the mountpoint I assume11:36
cjwatsonit isn't retrieved from the device (that doesn't make sense)11:36
cjwatsonapt-pkg/cdrom.cc:199:   string cdromPath = _config->FindDir("Acquire::cdrom::mount","/cdrom/");11:36
cjwatsonapt-pkg/cdrom.cc:523:   string CDROM = _config->FindDir("Acquire::cdrom::mount","/cdrom/");11:36
cjwatsonapt-pkg/cdrom.cc:583:   string CDROM = _config->FindDir("Acquire::cdrom::mount","/cdrom/");11:36
cjwatsongrep is your friend ;-)11:36
xivulonI know, but cannot access the source now, I assume that "/cdrom" is a fallback for "Acquire::cdrom::mount"11:38
xivulonand FindDir("Acquire::cdrom::mount") does not parse /proc/mounts by any chance (in case the cdrom is stored as "device")11:40
cjwatsonno it does not11:40
cjwatsonif you don't mind me saying so I think you may be a little bit obsessed with /proc/mounts format :-) in most cases it is not an issue11:41
cjwatsonpractically everything either just accesses it as an ordinary directory or uses mount/umount11:42
xivulonre 243105 so far we know that the issue is due to cdrom being bindmounted and the trace ends at apt_pkg.PkgAcquireRun11:42
cjwatsonno, you know that it happens when cdrom is bind-mounted11:43
cjwatsonthat's not quite the same thing as "due to"11:43
xivulontrue11:43
cjwatsonI think strace might be more useful than a python stack trace11:44
xivulonyes but that is where I ended yesterday night, will resume tonight with strace11:45
cjwatson(strace -f, mind, there will be a lot of processes involved)11:46
cjwatsonin particular I'd be very interested if something in apt were calling umount11:48
cjwatsonbut you should also be able to see it statting files under /cdrom11:48
cjwatsonoh, hmm!11:49
cjwatson   and the '..' file in the mount point and see if they are on the same device.11:49
cjwatson   By definition if they are the same then it is not mounted. This should11:49
cjwatson   account for symlinked mount points as well. */11:49
cjwatsondrat, sorry11:49
cjwatson // IsMounted - Returns true if the mount point is mounted              /*{{{*/11:49
cjwatson // ---------------------------------------------------------------------11:49
cjwatson /* This is a simple algorithm that should always work, we stat the mount point11:49
cjwatson    and the '..' file in the mount point and see if they are on the same device.11:49
cjwatson    By definition if they are the same then it is not mounted. This should11:49
cjwatson    account for symlinked mount points as well. */11:49
cjwatsonif /cdrom is bind-mounted from the same device then that algorithm would fail11:49
xivulonahh11:50
xivulongreat catch11:50
cjwatsonthough I don't see why a symlink to something on the same device would be any better11:50
cjwatsonso, while this looks like a plausible guess, it could do with some verification11:51
cjwatsonfurthermore, shouldn't the CD content still be on a different device (albeit loop-mounted) from /target?11:51
xivuloncjwatson, would you mind pasting the relevant chunk of code, otherwise I am a bit blind11:53
cjwatsonI don't have a relevant chunk of code11:53
cjwatsonthe IsMounted code doesn't matter, it's adequately described by the comment above11:53
cjwatsonit stats /cdrom/ and /cdrom/../ and compares the st_dev fields11:54
xivulonI see11:54
cjwatsonoh, hmm now, apt is running in the live CD root filesystem not in /target11:54
cjwatsonmaybe it just needs to be configured to use /target/cdrom11:55
cjwatsonyou might try something like http://paste.ubuntu.com/23063/12:03
cjwatsonI'm not entirely sure that will work but it makes a twisted kind of sense12:04
xivulonah thanks, will try tonight, I am sure evenad will be able to do some testing earlier on :)12:04
xivulona shame davmor2 is not around12:04
xivulonI have updated the bug report with the ^12:11
CIA-48hw-detect: cjwatson * r82 ubuntu/ (6 files in 3 dirs): merge from Debian 1.6312:55
CIA-48hw-detect: cjwatson * r83 ubuntu/debian/changelog: releasing version 1.63ubuntu112:57
xivuloncjwatson re 226622, what is the correct behaviour of panic messages? it seems like they are not displayed unless you are in recovery mode13:15
xivulonis this by design?13:15
cjwatsonTheMuso: ^--13:15
xivulonI would expect that whenever you are thrown in busybox you should see the error message, whether you booted with usplash or quiet13:16
cjwatson(I don't know the answer, but I think TheMuso dug into that last)13:16
* TheMuso reads scrollback.13:16
xivulonTheMuso, basically 226622 patch simply adds a "Meaningful message" to panic13:17
xivulonbut that is not always displayed13:17
TheMusoxivulon: hang on, let me have a look at the bug also.13:17
TheMusoYou shouldn't need to boot to recovery mode just to get the panic message. Let me look at the hardy initramfs-tools code where the dirty flag message is displayed. I saw it during the intrepid merge, but I'll look at the hardy package to be sure.13:20
TheMusoThe code looks ok, the only thing I can think of is that mount is not returning the correct status all the time. I currently don't have a windows/wubi setup to test with right away, but I'll set one up tomorrow to see if I can reproduce the issue.13:22
xivulonTheMuso, if you run panic "XXX" when booting with quiet splash, do you see "XXX" once you hit the busybox?13:23
xivulonI mean in a normal setup13:23
TheMusoxivulon: Yes. The panic code kills usplash to display text on the console.13:23
xivuloncould splash have some "screen artifacts" that hide the text somehow?13:24
xivulonlike the screen taking some time to reset13:24
TheMusoI don't know. All the code does is if it finds usplash_write, it tells it to shut down usplash.13:24
xivulonYep I noticed that, could you test with a panic message in a normal setup booting with quite splash?13:25
TheMusoThe only way I know to trigger a panic message is to make sure the root device cannot be found, and I don't have full installs on other boxes to test with currently without rebooting this one.13:26
xivulonah you can just add "panic mymessage" somewhere in the initrd13:27
TheMusoYes, but I have a better idea of triggering one. Forcing initramfs to think the root device is something it is not.13:27
TheMusoanyway brb will test13:27
xivulonmuch appreciated13:27
TheMusoOk. Its nothing to do with the code at all, well not really. It has to do with the TTY usplash is running on, and the TTY that the error message gets displayed on. What happens is that usplash is on TTY8, and when it gets shut down, the active console is still TTY8.13:36
TheMusoHowever, when text is echoed, its echoed to TTY1, however busybox still gets launched on tty8 because thats where usplash was.13:36
TheMusoSO the reason why its seen without usplash is because the tty doesn't get changed.13:36
TheMusoSo we either echo the text to tty8 if usplash is running, (harder to do), or we switch to tty1 when usplash quits.13:37
TheMuso...which may be harder, as the initramfs doesn't have chvt...13:39
xivulonTheMuso not sure if we can push that in, but it possible it would a lot :)13:45
TheMusoxivulon: There may be another way I haven't yet thought of.13:46
xivulonshall I open a bug against initramfs-tools?13:46
TheMusoYes please do.13:47
xivulon#24322613:51
TheMusoThanks./13:52
xivulonah thank you13:52
xivulondo you think we can have that in hardy point release?13:53
TheMuso8.04.1 is highly unlikely now.13:53
xivulonguess not :(13:53
xivulonwell it would be almost as good if users could get that via normal updates13:53
TheMusoyep.13:53
xivulonin most cases that manifest after in post-installation13:54
xivulonevand ping14:21
evandxivulon: pong14:22
xivulondid you see ^14:24
xivulonevand do you think we can test the cjwatson patch? looks promising14:24
xivulonwe also need ferification for 13668214:25
evandI'll give it a shot in a second.14:27
evandre 136682> I'll give it a shot after we resolve the python-apt mess.14:27
xivulonevand does the new iso contain wubi selfextract?14:33
xivulonrev 50414:33
evandI don't see a new ISO14:34
evandlink?14:34
xivulonah didn't even notice...14:41
xivulonI also see 20.1 :(14:41
xivulonanyway, new ISOs will contain rev 504 self-extact correct?14:42
evandcorrect14:49
giosue_cI'm having trouble with cdimage/debian-cd and I was hoping someone had a few minutes to help me troubleshoot...15:31
cjwatsonI'm on the phone, but say what your problem is and stick around15:32
giosue_cok. thanks.15:32
cjwatsonIIRC you've asked a question several times but left before I could answer ...15:32
giosue_csorry about that.  I think our time zones are quite different :)15:32
giosue_cSo I've been working on getting a smaller local repository that will work with cdimage, and i think i'm getting close.  but now debootstrap is complaining about the following missing packages:15:33
giosue_cMissing debootstrap-required libtext-charwidth-perl15:34
giosue_cMissing debootstrap-required libtext-iconv-perl15:34
giosue_cMissing debootstrap-required libtext-wrapi18n-perl15:34
giosue_cMissing debootstrap-required bsdmainutils15:34
giosue_cMissing debootstrap-required debconf-i18n15:34
giosue_cMissing debootstrap-required liblocale-gettext-perl15:34
giosue_cthese packages are all in my repository and show up in the Packages lists... but obviously i've got something wrong.15:34
cjwatsonIIRC (I'll check in more detail once I'm off the phone, but maybe this will help) that usually indicates that the Priority fields of those packages are wrong15:49
cjwatsonpackages installed by debootstrap are always 'required' or 'important' and it does matter15:49
giosue_cok.  will look into that.15:54
giosue_cLooked at each entry in the Packages file and it looks like they are all 'required' or 'important'.15:59
giosue_cI was just looking at the main/binary-i386 Packages file.  does debootstrap care about any of the other ones?16:00
evandhttp://evalicious.com/tmp/strace-20080626-1.txt17:24
evandread(11, "403 Media Failure\nMedia: Ubuntu "..., 64000) = 9717:24
evandwrite(2, "result could not be parsed", 26) = 2617:25
xivulonO_o ETA 55m17:30
evandit's nearly 200MB17:31
xivulonnoticed it17:31
cjwatsonevand: might want -s 1024 there17:57
cjwatsonotherwise it tends to get truncated17:57
evandcjwatson: noted.  I'm assuming the python process running scripts/install.py was the right thing to attach to, correct?18:02
cjwatsonyeah18:04
cjwatsongiosue_c: those should be enough18:04
giosue_cok.  my repository must be missing something...18:06
giosue_ci wish my repo were publicly visible so I could let you have a quick look at it... :(18:12
giosue_ccjwatson: if the tasks aren't specified properly (meaning not all overrides are in indices) will that cause problems for debootstrap?18:24
cjwatsonshouldn't18:24
cjwatsononly priority overrides matter18:24
giosue_ccjwatson: in creating a fairly stripped down local repo I noticed that something in cdimage was complaining if I didn't have $DIST-proposed $DIST-security $DIST-updates in my repo.  However I don't think I need anything more than $DIST to create a CD.  Am I right?18:37
cjwatsonshould be fine ...18:40
CIA-48apt-setup: cjwatson * r137 apt-setup/ (apt-setup-verify debian/changelog):18:45
CIA-48apt-setup: Initialise local variable 'file' so that apt-setup-verify doesn't get18:45
CIA-48apt-setup: excruciatingly confused when you pass file=/path on the kernel command18:45
CIA-48apt-setup: line.18:45
CIA-48apt-setup: cjwatson * r138 apt-setup/debian/changelog: releasing version 1:0.37ubuntu218:46
giosue_cI've a general question about creating your own repository.  how does apt-ftparchive know which debs to list in the packages file under main, restricted, etc...  the control file of a package doesn't say anything about where packages belong in the repo.21:03
giosue_cPerhaps you use the file list option instead of letting it grind through your entire pool?21:04
giosue_cthat would be a bummer because you'd have to run it once for every dist and component in your repo.21:05
cjwatsongiosue_c: we use the file list option for the main Ubuntu archive, and record the information in the override file (see indices/ on any mirror); it's possible for the same version of the same package to be in different components in e.g. hardy and intrepid22:07
cjwatsonfor example it's not uncommon for something to be in universe in hardy and then in main in intrepid, because something in main starts depending on it22:08
giosue_cmakes sense.22:08
giosue_cfor the local repo i am trying to create i am generating the Packages and Release files myself and I realized apt-ftparchive wasn't doing the right thing just by scanning the pool.  seems like i need to pull the override files to try to recreate the file lists.22:10
giosue_ccjwatson: is there a place i can see the scripts and config files used to build and maintain the main Ubuntu archive?22:31
cjwatsonI'm afraid that's part of Launchpad, whose source code is not published22:31
cjwatsonyou can look at dak, which does the same kind of job for Debian22:32
giosue_cdak.  ok thanks.22:32
giosue_care you a volunteer contributor to ubuntu or do you work for canonical?22:33
cjwatsonI work for Canonical22:33
giosue_cyea.  i thought that you were pulling a pretty heavy load for a volunteer.22:33
giosue_ccjwatson: the nonprofit i'm working for is build a distro off xubuntu.  my boss was just down in capetown with some folks from the shuttleworth foundation working on a project to deliver phone service to some townships in S. Africa.22:43
giosue_ccjwatson: cdimage has been awesome for getting our own distro off the ground.22:44
cjwatsonglad to hear it22:45
cjwatsonhave to go to bed now, though :)22:45
giosue_cg-nite.  see u round.22:46
xivulonwhat package is on the CD which is not already installed in the live desktop?23:00
xivulonthis is for testing whether installing something from a bindmounted /cdrom can reproduce the issues without going through the full installation23:01
xivulonwell never mind I can find out easily23:02
xivulonI tried to apt-get install "patch" from a bindmounted /cdrom dir containing iso content and it fails23:13
xivulonwill try python-apt next23:13

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!