[00:46] slangasek, around ? [00:46] http://paste.ubuntu.com/1191848/ [00:46] so it seems like 2 issues. a.) network is already up, so i think ifup decides it doesn't need to bring the network up, and b.) mountall doesn't like me doing mounts for it. [00:55] smoser: how do you mean, "network is already up"? [00:55] iscsi root. [00:55] it came up in the initramfs [00:55] smoser: right; ifupdown doesn't consider that "up" [00:56] hm.. [00:56] to ifupdown, it's only up if ifup has been called [00:56] i'd have thought. [00:56] which is not to say that the network already being up can't be causing problems for ifupdown [00:56] or maybe iscsi even injects state? [00:57] injects state? [00:58] hm.. [00:58] smoser: yes, as in, perhaps the open-iscsi initramfs script scribbles something in /run to tell ifupdown to under no circumstances bounce the interface [00:58] i dont think so. [00:58] but clearly it cannot bounce the interface. [01:00] but i dont know what i thought was wrong. about mountallnot liking me [01:02] smoser: dunno... there's some noise about filesystems already mounted, but coincidentally these are all optional mounts [01:03] smoser: looks like mountall itself succeeds, it's just the network not happening [01:03] right. [01:03] it was the "busy" stuff that i was confused by. [01:04] i'll look foranything iscsi might be doing to protect [01:04] or maybe ifupdown somehow just "knows"that it has non-local filesystems [01:05] although it appears to have tricked mountal [01:05] smoser: should I be seeing full upstart logging here? there's nothing after 37.584470, at which point udev has not actually succeeded in starting and therefore ifupdown is not being triggered [01:05] smoser: upstart-udev-bridge is 'start on starting udev'; it never completes [01:07] at least, not that's shown in this log [01:09] well, it still hasnt then (looking at that log now) [01:10] smoser: what's 'status upstart-udev-bridge' show? [01:11] hm.. start/running [01:11] ok [01:11] so maybe the log output went somewhere else [01:11] (in which case... we probably need to see that log output, wherever it is, to get the whole picture) [01:12] yeah. [01:12] i have had thoughts that i was not getting all of output [01:18] /var/log/syslog: http://paste.ubuntu.com/1191875/ /var/log/kern.log: http://paste.ubuntu.com/1191876/ [01:19] anything interesting in /var/log/upstart/* ? [01:20] cause that's where it's going by default.... [01:22] $ ls -l /var/log/upstart -d [01:22] ls: cannot access /var/log/upstart: No such file or directory [01:40] smoser: um? where'd you put that directory then? It's shipped by the upstart package [01:41] well... i changed the timeout waiting for static-networking-up back to 120 seconds (i had put it to 10) in cloud-init-nonet.conf [01:41] http://paste.ubuntu.com/1191899/ [01:41] well, i didn't put that directory anywaere. [01:41] suck. [01:41] so this is definitely a bug. some cleaning out of images. in the build process kills that. [01:41] so i'll open a bug on that. [01:42] i changed that timeout back to 120 seconds [01:43] and http://paste.ubuntu.com/1191889/ is the result [01:43] its more obvious that there something is still blocking, waiting for that. [01:43] probably for mounted / to finish [01:45] smoser: so http://paste.ubuntu.com/1191875/ shows a correct udev-based bring-up of the networking [01:46] but the timing is a bit odd [01:46] * slangasek looks at the latest [01:47] smoser: hah; udevtrigger waits to find out if you're in a container [01:47] smoser: /etc/init/container-detect.conf has an explicit check for mounted MOUNTPOINT=/run instead of virtual-filesystems [01:47] smoser: try twiddling it to use virtual-filesystems instead [01:47] bah. [01:48] smoser: that seems like a change we can easily make in the distro - if it works [01:48] well, it might be by design. [01:48] in that it can run earlier than virtual-filesystems (much earlier) [01:48] nah [01:49] altougho i guess nothing (as we see) is gonna guarantee that anyway. [01:49] I mean, it is, but there's nothing in the design that requires the rest of mountall to wait for the container answer [01:49] and changing the container-detect job is better than making your workaround job double-emit the mounted event [01:49] so.. https://bugs.launchpad.net/ubuntu/+bug/1047707 is to cover /var/log/upstart in the images. [01:49] Launchpad bug 1047707 in Ubuntu "/var/log/upstart deleted from cloud images" [High,Triaged] [01:50] well i had my work around in place there. [01:50] and i think its required to get to the point. [01:50] smoser: I assume that's a symptom of a larger "purging stuff willy-nilly" bug? [01:50] smoser: Unless you were explicitly removing that one directory for some reason... [01:50] yeah, it is. [01:50] smoser: yes, and your workaround does NOT emit the 'mounted' event, it emits virtual-filesystems [01:50] no. its like rm -Rf /var/log/* [01:50] right. [01:50] smoser: Gah. [01:50] which we should bring container-detect into alignment with [01:50] right. [01:50] one thing that i'm running into [01:51] the cloud-init-nonet job has 'output console' [01:51] but its output is *not* getting to console [01:51] where console=/dev/ttyS0 (per that command line). [01:51] i had to explicitly | tee /dev/ttyS0 to get it to the console. [01:52] i'll try the change on container and boot [02:08] slangasek, that seems to fix the proble. [02:09] * slangasek nods [02:09] well, with the hack-emit-virtual-filesystems. [02:09] it certainly should have been the last thing left that could be a problem :) [02:09] so i can get where i need to go now, i think. [02:10] so you want a bug against upstart for container-detect? [02:10] smoser: can you file a bug on upstart about container-detect and /run vs. virtual-filesystems? [02:10] yes please :) [02:10] i'll open one, but i'd appreciate if you fill in some better debug and justfication. [02:10] so that some time from now when i'm trying to trace steps i'll have some info [02:12] smoser: ack [02:14] https://bugs.launchpad.net/ubuntu/+source/upstart/+bug/1047712 [02:14] Launchpad bug 1047712 in upstart (Ubuntu) "container-detect.conf should be 'start on virtual-filesystems'" [Undecided,New] [02:16] slangasek, what woudl you think about trying to make mountall happier by running my virtual-filesystems-emitter on 'starting mountall' [02:16] (in addition to cloud-init-nonet. it should just prep the system so mountall doesn't htink it should have to mount those filesystems) [02:53] slangasek, well. one more piece of my puzzle (i'm stillnot getting resolv.confworked out). [02:53] but /etc/init/iscsi-network-interface.conf is a bit of info [02:55] http://paste.ubuntu.com/1191973/ [03:13] smoser: 'start on starting mountall' should be fine for that, yeah [03:13] smoser: right, that's kinda what I was expecting to see from iscsi [03:14] and it's skipping the ifupdown hooks, which is a problem [03:14] though from the comment, it seems that may have been deliberate [03:21] slangasek, yeah. i'm poking around. [03:22] i'm in initramfs now. [03:22] was hoping i could get it to store off the dns server responses [03:22] from the dhcp request. [03:23] they get printed. and "configure_networking" pretends that "Ip-Config tries to create this file and when it succeds" (/run/net-"${DEVICE}".conf) [03:23] but it sure doesn't look like it does to me. i'm in an initramfs and dont see any such stuff getting created. [03:26] shoot. [03:26] it loo like our initramfs is busted in that respect [03:26] it writes /tmp/net-eth0.conf [03:26] at least in precise [03:27] so, where does ipconfig come from? busybox? [03:27] klibc [03:28] http://paste.ubuntu.com/1191999/ [03:30] smoser: fixed in quantal; seems klibc-utils and initramfs-tools were out of sync on this in precise [03:30] smoser: sounds like that should be cherry-picked from klibc-utils [03:30] ah. so the klibc-utils updated to /run [03:30] klibc 2.0-2, in Debian [03:30] yes [03:30] i'm opneing a bug for that. [03:31] easiest thing might be to just update to lok in 2 places [03:31] no, just update klibc to use /run [03:31] that's the right place for it to be [03:31] and nothing relies on the current behavior in precise [03:35] slangasek, are you sure this is "fix-released" ? [03:35] https://bugs.launchpad.net/ubuntu/+source/klibc/+bug/1047722 [03:35] Launchpad bug 1047722 in klibc (Ubuntu) "configure_networking net-DEVICE.conf in /run, but ipconfig writes in /tmp" [Undecided,New] [03:36] smoser: I've checked the source in quantal, it's definitely writing to /run onw [03:36] now [03:36] k. [03:38] so i thin i shoudl be able to get that information from the dhcp response (dns info) [03:38] and store it somewhere [03:38] and then replay it to resolvconf [03:40] in fact, so long as you're getting it written to /run, I believe the initramfs should be mount -omove'ing that for you [03:42] yeah, i wondered about that. so i dont have to store it even. [03:42] yep [03:42] you do have to make sure you're not mounting something else over /run ;) [03:42] i think i'm gonna close this laptop now. [03:42] you've been very helpful, slangasek [03:42] thanks. [03:42] y/w [03:42] have a good evening [03:43] evening for 8 more minutes here [03:43] then am [03:43] later. [03:56] looking at the dictionaries-common code makes me very angry === cpg is now known as cpg|away === cpg|away is now known as cpg === cpg is now known as cpg|away === cpg|away is now known as cpg === wzssyqa1 is now known as wzssyqa === wzssyqa is now known as Guest43660 [07:31] can someone point me to how i can create animated progressbars in gtk-3? === iulian is now known as Guest54251 === Guest54251 is now known as iulian === mcclurmc_away is now known as mcclurmc === cpg is now known as cpg|away === korn_ is now known as c_korn [11:10] jtaylor: thanks for doing asterisk [11:11] np but it needs doing for precise [11:11] unfortunately it are ~8 CVEs and the simple diff are 10000 lines ... [11:11] I have no time for that and no idea how to test anything [11:13] jtaylor: Well, if you are able to prepare an update.. I'm happy to test it? [11:16] thanks, I'll come back to you if an update gets prepared [11:17] super! === doko_ is now known as doko [13:51] doko: Which gcc package version were you using for bug 1019725 ? [13:51] Launchpad bug 1019725 in gcc-4.6 (Ubuntu) "tiny STL code sample segfaults cc1plus" [Medium,Triaged] https://launchpad.net/bugs/1019725 === yofel_ is now known as yofel [15:07] is it just me, or is canonical trying to get rid of the gnome ecosystem and quantal a step toward more and more components in qt? [15:22] Any particular examples in mind? [15:34] I'm trying ubuntu-defaults-image, and it's working ok except that the generated .iso doesn't have the following files: [15:34] autorun.inf boot dists install pics pool preseed README.diskdefines ubuntu wubi.exe [15:34] ...can I do something to include those as well? [16:14] is there any reason that 12.04 LTS comes without CONFIG_CIFS_ACL kernel setting ?! === cpg|away is now known as cpg [19:15] jamespage: Thanks for fixing the iPXE [19:16] penguin42, np [19:17] jamespage: What's your setup like; I'm running two kvm vm's one with tgt, and I've got two different clients; one disk less, and the other with disk - the diskless install doesn't seem to have setup the inittab properly yet (from last weeks iso) [19:18] penguin42, I run tgt on the KVM host alongside libvirt and I use diskless kvm vms with a scripted ipxe setup todo automated iscsi root installs for testing [19:19] penguin42, its a bit hacky but it works - https://code.launchpad.net/~james-page/+junk/iscsi-testing [19:22] jamespage: Have you had any problem with boot order issues on tgt? I seem to need to restart tgt after server boot for it to pick the disk up [19:23] penguin42, I'd not noticed anything like that - but my test cases don't normally persist between boots :-) [19:23] I don't make the tgt configuration persistent [19:24] penguin42, BTW have you tried 12.04 against a quantal tgt target? I'm wondering whether I need to SRU that fix to 12.04 as well [19:24] jamespage: No I haven't; I haven't got a 12.04 host to try [19:25] (I guess I could go nuts and go nested kvm...) [19:25] penguin42, thats my prob as well [19:25] I probably will try that; I have access to a cloud which supports it [19:25] jamespage: I've done nested kvm before - it's surprisingly easy; other than getting the default netmask right, it just works if you stack 12.04's [19:30] jamespage: I suspect the other thing the people running iscsi in the real world would want to do automatically in the installer is get multipath going [19:33] penguin42, I have lots of experience with multipath in fibre channel based SAN's - but zip with iscsi [19:35] jamespage: I don't know much about it - my server setup does have two net interfaces and I've bound it to both 'portals' - and in the non-root version I've got I have it log in once on each interface and see both instances as separate discs in /proc/scsi/scsi so I assume multipath would sort it out into one device [19:36] jamespage: I think like FC there is a lot of 'magic' knowledge of timeouts and stuff with particular vendors [19:37] jamespage: The only other commonality is that multipath is renowned as a pain === cpg is now known as cpg|away === ml|vacation is now known as ml|transit [20:42] jamespage: Bug 1047998 is my problem with the server install on iscsi root [20:42] Launchpad bug 1047998 in debian-installer (Ubuntu) "iscsi root: iscsi not started in initramfs" [Undecided,New] https://launchpad.net/bugs/1047998 [21:02] jamespage: and bug 1048008 for tgt needing a restart [21:03] Launchpad bug 1048008 in tgt (Ubuntu) "tgt needs restart to find LUN" [Undecided,New] https://launchpad.net/bugs/1048008 [21:06] ScottK: ubuntu-sso-client-qt, ubuntuone-control-panel-qt, apparently libaccounts === jtechidna is now known as JontheEchidna === jtechidna is now known as JontheEchidna === cpg|away is now known as cpg