/srv/irclogs.ubuntu.com/2011/03/01/#ubuntu-release.txt

marjoping skaet01:32
marjoping skaet_d01:32
=== doko_ is now known as doko
skaet_jdstrand, thank you for looking into the natty_probs.html.  fingers are crossed for a smooth set of builds tonight before Riddell switches the builders to manual.02:44
skaet_Riddell, when the images come off the build, please get them added into the .iso tester, so we can get started on testing them immediately.   Note, when I checked just now,  .iso tester still needs to be reset.   Please work with jibel to get it cleaned up, if its not reset already to Alpha 3 when you've got images to push.03:02
charlie-tcaKubuntu alternate-amd64.iso dated 2011-03-01 installed on hardware03:03
jdstrandhuh03:14
jdstrandvarious cd images died cause ubuntu-minimal couldn't be installed due to:03:14
jdstranddpkg: error processing lsb-release (--configure): subprocess installed post-installation script returned error exit status 103:14
jdstranddpkg: error processing rsyslog (--configure): subprocess installed post-installation script returned error exit status 1003:14
jdstrandnot reproducable here...03:14
* jdstrand makes note to ask how antimony bootstraps images03:15
slangasekskaet_: so given that bug #723846 is approved for a3, does it make sense for me to upload what's in James' branch to give us a leg up on image respins?03:16
ubot4Launchpad bug 723846 in upstart (Ubuntu) "Feature Freeze Exception request for Upstart in Natty (affects: 1) (heat: 14)" [High,In progress] https://launchpad.net/bugs/72384603:16
slangasekjdstrand: exit status 10 is a pretty good indicator of a debconf-related failure03:16
jdstrandinteresting.03:17
jdstrandwell, I am just passing through and noticed that03:17
jdstrandno time to debug, but will follow up and certainly learn something tomorrow03:17
* jdstrand likes to learn :)03:17
slangasekthe lsb-release error is almost certainly *not* debconf-related, however03:17
slangasekjdstrand: do you have an example log I could fix my eyes on?03:18
jdstrandslangasek: there is not a lot to go on, but let me paste one03:18
slangasekwell, you said "how antimony bootstraps", but package installation is normally done on the livecd builders, no?03:18
jdstrandslangasek: full log for LiveFS kubuntu/natty/i386 failed to build on 20110301: http://paste.ubuntu.com/573772/03:19
skaet_slangsek, branch 1-3 are approved for A3 based on what jhunt and cjwatson did.03:19
skaet_those changes have been uploaded already earlier.   What's in james' branch?03:20
slangasekjdstrand: right, that log is available at available at http://people.canonical.com/~ubuntu-archive/livefs-build-logs/natty/kubuntu/20110301/livecd-20110301-i386.out, no?03:20
* skaet_ approved it earlier in the day, but forgot to hit save on the bug update until she got back to her computer (multiple windows hid it... :P )03:20
jdstrandslangasek: looks like it :)03:20
slangasekskaet_: ah, if it's already uploaded then nevermind :)03:20
jdstrandsee, I even got to learn something *tonight* \m/03:21
slangasekskaet_: I saw the bug update and was trying to avoid it waiting until morning03:21
slangasekjdstrand: :)03:21
slangasekso, this is some sort of debootstrap failure involving lsb-release and pycentral; not god03:21
slangasekgood03:21
slangasek(not god either, but that's a somewhat less specific statement)03:21
jdstrandlol03:22
skaet_:)03:22
skaet_slangsek,  yup I think were good for the upstart side,  now the issue of failure to builds .... urk.   not good.03:24
slangasekyep, working on reproducing locally03:24
skaet_thanks.03:25
jdstrandI tried 'apt-get install ubuntu-minimal' in my natty schroot, which was created via mk-sbuild03:26
jdstrandit worked fine03:26
jdstrand(or course with just main and restricted, and archive.ubuntu.com, not something local03:26
jdstrand)03:26
GrueMasterarmel images failed to build.  Looks like dpkg postinst issues with lsb-release and rsyslog.03:28
jdstrandGrueMaster: yeah, so did several others03:29
GrueMasterAh.  See it now in the backscroll.03:29
jdstrand(in recent backscroll)03:29
jdstrandslangasek: does antimony use debootstrap?03:29
slangasekjdstrand: shouldn't; the debootstrapping should be on the livefs builders03:30
* jdstrand really doesn't want to get embroiled in this right now, but is curious03:30
slangasekbut that log is from the debootstrap call on a livefs builder, yes03:30
slangasek(i.e., not /from/ antimony, only dispatched via antimony)03:31
jdstrandI think you might have taken my question slightly too precisely03:31
slangasekguess so :)03:31
jdstrandI only know that antimony 'does stuff' to boot strap an image03:31
slangasekanyway, yeah, this'll be a problem related to initial installation of the core packages03:32
jdstrandwither helpers do it or whatever, I have no idea. but if the main thing is debootstrap, then maybe I can try that here03:32
slangasekyes, it's debootstrap03:32
jdstrands/wither/whether/03:32
jdstrandmy schroot uses a buildd bootstrap...03:33
* jdstrand tries a straight up debootstrap before heading to bed03:34
slangasekreproducible03:38
jdstrandslangasek: I'm using something like this: debootstrap natty /natty/ http://archive.ubuntu.com/ubuntu/03:39
jdstrandslangasek: as that what you are using?03:39
slangasekyes03:39
jdstrandslangasek: so, lsb-release failed there right? looking at the logs there seemed to be problems before trying to install ubuntu-minimal03:40
slangasekit's lsb-release; ubuntu-minimal depends on lsb-release03:40
slangasekand I think this is related to my dpkg upload03:41
* jdstrand nod03:41
jdstrandnods even03:41
slangasek(pycentral is snuffling around inside of /var/lib/dpkg, which it Ought Not Do)03:41
* jdstrand just reproduced03:41
slangasek        if not os.path.exists('/var/lib/dpkg/info/%s.list' % self.pkgname):03:41
slangasek            self.error("package %s is not installed" % self.pkgname)03:41
slangasektsk, bad python-central03:42
slangasekfix will be on its way before the top of the hour03:42
jdstrandcool03:42
slangasekwhat builds should I retrigger once it's published?03:42
jdstrandwell, I got two learn 2 things tonight03:42
jdstrandlet me get the list03:43
jdstrandkubuntu/natty/armel+omap03:43
jdstrandkubuntu/natty/armel+omap403:43
jdstrandubuntu-netbook/natty/armel+omap403:43
jdstrandubuntu-netbook/natty/armel+omap03:43
jdstrandkubuntu/natty/amd6403:43
jdstrandkubuntu/natty/i38603:43
jdstrandedubuntu-dvd/natty/amd6403:43
jdstrandedubuntu-dvd/natty/i38603:43
jdstrandkubuntu-mobile/natty/i38603:43
jdstrandI don't know what's pending, but that is everything I have03:44
jdstrandkubuntu/natty/armel+omap was the last and failed 28 minutes ago03:45
slangasekok03:45
jdstrandnice, now I don't have to feel guilty about going to bed03:45
jdstrandslangasek: thanks! :)03:46
slangaseksure thing :)03:46
slangasekit's my bug anyway ;)03:46
jdstrandlearned 2 new things, and a guilt-free sleep. pretty sweet03:46
slangasekwell, technically pycentral's, but I set it off :-)03:46
jdstrandhehe03:46
slangasekok, python-central is accepted but I ran into the content generation job as usual04:41
slangasektrigger set to fire off builds as soon as that's cleared and python-central is in the archive04:42
slangasekand I have the fix for libreoffice on armel, but maybe today is not the day to upload that, given that it's not going to get done before alpha3 anyway :)04:50
Keybukslangasek: would you mind if I made an upload?05:06
evit's a trap!05:07
Keybukev: can you test something for me?05:07
Keybuktouch /etc/init/.conf05:07
slangasekKeybuk: I'm too busy putting out my own dpkg-induced fires to mind, but that doesn't mean the other members of the release team won't :05:07
slangasek)05:07
slangasekI think I have python-central fixed now05:07
slangaseknow I have to unbreak ucf05:08
slangasekwhich ironically is broken because of a patch to ucf that I wrote05:08
Keybukwow, ev stopped responding to PING05:08
slangasekso... another hour before debootstrap will work again05:08
Keybukhe really tested that05:08
Keybukyou'd think he'd know better than listening to me :p05:08
evjerk05:21
Keybuklove you too05:21
cody-somerville+105:21
ev'twas an excuse to make more coffee05:21
evand curse your name05:21
Keybukslangasek: ok, no upload from me05:22
slangasekkubuntu alternate will also need respun for this issue06:11
slangasekit has the new dpkg in it, so debootstrap will fail at install time06:11
pittislangasek, cjwatson: disabling CD cron jobs now, so that we can do an optimized pipeline mass rebuild after the remaining debootstrap fixes07:39
slangasekyes, I already have a pipeline queued... I didn't notice that cronjobs were still enabled07:39
pittiah, good to know07:41
pittislangasek: do you also have a current pipeline which includes ports?07:45
pittithe pipeline in my documentation is already quite old07:46
slangasekpitti: AIUI there are no longer separate jobs for ports07:46
pittiah, seems your pipeline already started? at least natty/powerpc alternates are already building07:47
evmight I kindly ask an archive admin to promote dpkg-repack to main07:47
pittiev: ugh, yes07:48
pittiev: I see it's blocking ubiquity, but please file an MIR07:48
evI did07:48
evsorry, I didn't reference it in the upload07:49
pittiah, you aren't supposed to07:49
pittigreat, promoting and closing07:49
pittislangasek: ^ I think this needs another publishing cycle (for your wait-for pipeline)07:49
evbug 72645307:49
ubot4Launchpad bug 726453 in dpkg-repack (Ubuntu) "[MIR] dpkg-repack (affects: 1) (heat: 8)" [Undecided,Fix released] https://launchpad.net/bugs/72645307:49
evpitti: thanks07:49
pittislangasek: as ubiquity depends on it07:50
slangasekoh; should I turn this over to you then?07:50
slangasekway past my bedtime here07:50
pittislangasek: sure; mind to throw me your pipeline?07:50
slangasekdone07:52
pittislangasek: good night!07:53
evcould I squeeze in one last ubiquity upload or are we well into the process?  There's a bug in partman-auto that's fixed with the latest upload, but it requires another ubiquity upload for it to make it to the desktop CDs as well.07:56
pittiev: we can squeeze it in, I think07:57
evawesome, uploading now07:57
pittiI checked natty_probs now, and all i386/amd64 uninstallabilities are expected now (fglrx/nvidia), except for ubiquity (fixed with promotion) and jasper (investigating now)07:58
pittiev: I'll rebuild the livefs-base in the meantime then, and the alternates07:59
pittiah, jasper is just a followup of ubiquity08:01
slangasekev: so, ah... just how much does ubiquity depend on dpkg-repack?08:07
slangasekbecause on a hunch (man, I'm never gonna get to bed) I just checked, and dpkg-repack isn't multiarch-safe08:07
evslangasek: heavily for the reinstall/upgrade option08:08
evalternative proposals welcome08:08
slangasekwell, dpkg-repack will need fixed for multiarch regardless08:08
slangasekI'm just asking if this is a feature you need working in alpha 3... because right now it won't08:08
slangasekit needs to be ported to use $dpkg_lib/info/$arch instead of $dpkg_lib/info... not too tricky, but I think somebody on your side of the pond will need to take care of this08:09
evI'm not overly concerned if it's broken and release noted, so long as it's still allowed to make the final cut08:09
slangasek(if you need it urgently)08:09
slangasekok08:10
slangasekgood, then I'll sleep easy :)08:10
ev:)08:11
evpitti: ubiquity 2.5.21 uploaded08:15
evright, I'm going to bed for a few hours. Don't hesitate to call my cell and wake me if it turns out I broke the world somewhere along the way.08:17
jibelcjwatson, skaet_, Ubuntu alternate amd64/i386 fails to install this morning. rsyslog and lsb-release failed to install. I'll file a report and attach the logs.09:08
jibelduring the setup of the base system09:08
pittijibel: nevermind, it's known09:08
pittijibel: and already fixed09:08
pittijibel: I'm about to respin all images09:08
jibelpitti, okay, thanks.09:09
Riddellany plan for ubuntu desktop being oversized?09:35
pittiRiddell: I killed a langpack09:40
pittiand we have a bug to remove libreoffice-tango from the default install09:41
pittibut too late for a309:41
pittiRiddell: FTR, I have all alternate rebuilds queued up, and wait for ubiquity 2.5.21 to rebuild the entire lot of desktops/dvds/preinstalled09:42
pittiRiddell: are you aware of anythign the Kubuntu CDs block on?09:42
pittiargh, sync-mirrors keeps hanging on scandium (discussing with IS)09:43
RiddellKubuntu is fine except I had bug 726581 yesterday09:44
ubot4Launchpad bug 726581 in ubiquity (Ubuntu) "install stops half way through (affects: 2) (heat: 12)" [Undecided,New] https://launchpad.net/bugs/72658109:45
pittiI temporarily take out scandium from etc/config, to unblock CD builds09:45
pittijibel: new ubuntu alternates posted, they ought to work now09:51
pittis/new// really (it's the first image on the tracker for a3)09:51
jibelpitti, ok syncing.09:53
pitticjwatson: sorry for all the build log spam; I'm on it09:55
* pitti starts desktop/DVD build pipeline from hell09:56
pittikubuntu alternates posted, ready for testing10:09
pitticjwatson: looks like nic-usb-modules-2.6.32-410-dove-di is on the mirror now, I'm retrying a build10:10
pitti... of d-i10:10
cjwatsonyeah, I probably ought to have looked at the d-i/armel build failures rather than ignoring them10:18
pitticjwatson: good morning10:19
pitticjwatson: I didn't investigate a lot whether the 410 kernel was actually only NEWed recently, but the buildds don't have anything else to do anyway10:19
pittiand I guess this is a blocker for the preinstalled images10:19
pitti(maybe not -- I don't know how they are actually built)10:20
pitticjwatson: dang, failed again with the same error10:21
pittiE: Unable to locate package kernel-image-2.6.32-410-dove-di10:21
pittiE: Couldn't find any package by regex 'kernel-image-2.6.32-410-dove-di'10:21
didrocksso, FYI, we are testing unity trunk and should get something ready for upload in the next hour10:21
pitticjwatson: ah, that's because I can't look properly10:21
pittikernel-image-2.6.32-410-dove-di | 2.6.32-410.27 | maverick/main/debian-installer | armel10:21
pittimaverick != natty..10:21
didrocksdo you think that, as planned yesterday, there will a window for it in alpha3?10:22
pittididrocks: the current ubuntu desktops are just about to finish, and my current rebuild queue will still take several hours, so it's not too urgent10:23
didrockspitti: ok, will keep you posted then10:23
pittididrocks: DVD will build in some 2 hours, so if it gets uploaded and published  before, that'd speed it up a bit10:23
pittididrocks: but if it misses that, no worries; good testing >> speed at this point :)10:24
didrockspitti: we are still testing a lot to ensure we have no regression, I'll tell you :)10:24
didrocksyeah10:24
didrocksprefer quality so closed to the gate10:24
didrocks;)10:24
pittixubuntu alternates posted10:27
cjwatsonpitti: so should I just disable dove support in d-i for now?  looks like the kernel is gone ...10:28
pitticjwatson: TBH I have no current idea about our variety of armel kernels10:28
cjwatsonbug 71598410:29
pittiogra: which armel flavours are we supposed to have these days? "linux" only builds omap AFAICS; no omap4, no dove?10:29
ubot4Launchpad bug 715984 in linux-mvl-dove (Ubuntu Natty) (and 3 other projects) "Remove linux-mvl-dove from Natty (affects: 1) (heat: 201)" [Critical,Fix released] https://launchpad.net/bugs/71598410:29
pittiaah10:29
pittithat'd be it :)10:30
cjwatsonOK for me to reupload debian-installer for that, then?10:30
pittisounds fine to me10:30
pitticjwatson: it doesn't practically affect the currently built alternates, right?10:31
pitticjwatson: or does it include new wrapped components?10:31
cjwatsonnot that I know of10:32
pittiubuntu-server posted10:58
pittiapparenty my seed change didn't make it into the ubuntu desktop rebuild, so it's still oversized; at this point I'll wait for the new unity to land before I rebuild11:17
pittihttp://cdimage.ubuntu.com/daily-live/20110301.1/ if someone wants to give it a smoketest11:18
pittiubuntustudio posted11:28
pittikubuntu desktop posted11:28
cjwatsonwait11:30
cjwatsonwe need to fix bug 72710611:30
ubot4Launchpad bug 727106 in dpkg (Ubuntu) "multiarch symlink not present in fresh installs (affects: 1) (heat: 6)" [Undecided,New] https://launchpad.net/bugs/72710611:30
cjwatsonit's a pain to migrate otherwise11:30
cjwatsonuploading a quick fix now, and patch sent to buxy11:35
pitticjwatson: that'll require rebuilds of all images?11:36
cjwatsonyes11:36
* pitti stops the big pipeline then11:36
pittimarking all images as to be rebuilt then11:37
cjwatsonotherwise any systems installed from those images will be different from upgraded systems in a way that's (a) significant and (b) hard to put right latere11:37
cjwatson*later11:37
cjwatsonsorry11:37
pitticjwatson: hm, on first sight that seems like something that could be done in a postinst?11:37
cjwatsonthen you have to move a load of files in /var/lib/dpkg/info in a maintainer script, temporarily making them be not a path that dpkg will consider11:38
cjwatsonI don't think this is safe11:38
pittiok11:38
pittiall images disabled (I left upgrades, as there haven't been any tests yet)11:39
cjwatsonI'm waiting for brltty to build before reuploading d-i11:43
cjwatsonthere was a conflict marker in one of its startup scripts11:43
jibelwhen can we expect the next batch of images to be ready for testing ?11:54
pittijibel: I'm currently doing a smoketest, and doing so with the current images is appreciated (to check for installer failures, etc.)11:55
pittijibel: the "good" ones will still take some 4 hours, I'm afraid11:55
pittiwe need dpkg, brltty, d-i, nux, unity, and have dependencies between brltty->d-i and nux->unity11:55
cjwatsonhmm, tempting to stop the publisher so that brltty/armel will have time to get in11:59
cjwatsonwould that be ok?11:59
pittiplease do11:59
cjwatsondone12:00
pitticjwatson: is the d-i build failure due to the missing symlink in dpkg? (doesn't immediately look like it) or yet another bug?12:01
pitticat: ./tmp/cdrom_gtk/tree/extraudebs-tmp/var/lib/dpkg/info/*.templates: No such file or directory12:01
jibelpitti, thanks, I'll continue testing the current images in approx. 1 hour. I'm doing upgrades at the moment.12:01
cjwatsonalready fixed in bzr and upstream git12:01
cjwatsond-i sets up its own dpkg/info directory12:01
pitti\o/ you rock12:01
pittijibel: nice, thanks12:01
cjwatsonso it needs to create that symlink otherwise (a) its own build system and (b) udpkg will get horribly confused12:02
pittijibel: I'm running an amd64 smoketest now, too12:02
ograpitti, right, we only support omap flavours12:10
cjwatsonpublisher running12:15
cjwatsonuh, except there was already one running from the last hour, WTF12:16
cjwatson09:43 <pitti> argh, sync-mirrors keeps hanging on scandium (discussing with IS)12:16
cjwatsonpitti: what did IS say to that?12:16
cjwatsonbecause the publisher is hanging on scandium too12:16
cjwatson27321 11:26:36      \_ ssh archvsync@scandium12:16
cjwatson$ date12:16
cjwatsonTue Mar  1 12:16:43 UTC 201112:16
pitticjwatson: talked to Ng, and he promised to get back to it once he sorted out some high-urgency stuff12:21
* pitti pokes again12:22
wgrantarchive.u.c is partly borked too, so there are probably big issues.12:22
ograwould someone kick off armel builds in the meantime (we dont need d-i on the preinstalled ones)12:22
pittiogra: need to wait on dpkg12:23
ograoh, ok12:23
pittiwell, perhaps not, unless armel needs multiarch?12:23
ograit will, though i would like to have a boot smoketest asap12:23
ograwe didnt have images since feb 16th due to archive out of sync-ness12:23
ograso all feature freeze breakage hasnt been tested yet12:24
pittijibel: just finished a successful amd64 desktop smoketest, so don't bother about that one12:25
cjwatsonpitti: we should block on the new dpkg on all architectures, multiarch or not12:26
pitti*nod*12:26
cjwatsonit will affect any software that looks in /var/lib/dpkg/info/12:26
pittiso, waiting on publisher, smoketest done, I think I can disappear for a quick lunch12:27
pitticjwatson: Ng re-poked, FTR12:27
cjwatson[5~/wg 6412:30
cjwatsonurgh12:30
didrockscompiz just uploaded to fix unity launching in the classic session12:33
didrocksall nux + unity testing is succesfull (testing done by four people on trunk)12:33
didrocksnux building in my pbuilder (will take 30 min)12:33
cjwatsonpublisher really running12:33
didrocksthen building packaged unity12:33
ograSetting up lsb-release (4.0-0ubuntu9) ...12:56
ograpycentral: pycentral pkginstall: package lsb-release is not installed12:56
ograpycentral pkginstall: package lsb-release is not installed12:56
ogradpkg: error processing lsb-release (--configure):12:56
ograhmpf12:56
cjwatsonthat should be fixed with current python-central12:57
ographew, k12:57
skaet_pitti, cjwatson,   just read through the backscroll,   busy morning.    Has unity been incorporated in the current run or not?  must be missing some key comment ( /me slurping tea now - caffine is likely to be needed today :P )13:16
pittihey skaet_13:16
pittiskaet_: unity is still being prepared13:17
skaet_pitti, good.13:17
pittiskaet_: currently wrangling kernel updates, after that I'll check the status of dpkg etc. and start building new imagwes13:17
cjwatsonjust uploading d-i now13:17
cjwatsonpublisher's still on manual for maximal throughput13:17
skaet_cjwatson,  sounds good.13:18
skaet_pitti,  if unity has any possibility of introducing regressions at this point, we can't afford to include it since we don't have a good set of images at this point.13:21
=== shadeslayer_ is now known as shadeslayer
didrocksok, nux 0.9.30-0ubuntu1, unity seems fine, just looking if we can sneak a distro-patch here13:21
didrocksskaet_: we tested it 4 people for 2 hours now13:22
didrocksand I'm running the packaged version to ensure there is no crash at all13:22
didrocksin any case, unity is dep on latest nux that I just uploaded13:22
didrocksso, waiting for a publisher run, and still testing for now13:22
skaet_didrocks, what does the nux that was just uploaded do/fix?13:24
didrocksskaet_: unity dep on latest nux, it's speed improvement for most of them for the dash13:24
didrocksand some crash fixes13:24
pittididrocks: does it change ABI? you only need a strict build dep on nux abi changes13:25
didrockspitti: yeah, nux changes the ABI basically whith each upload, hence the <<13:26
njpatelyeah it does13:26
pittiok13:26
njpatelhey pitti :)13:26
* pitti ^5s njpatel13:26
njpatelI haven't see a "^5s" before but I'm instantly impressed :)13:26
* njpatel ^5s pitti back13:26
skaet_pitti, are the dpkg issues now resolved?13:29
pittiskaet_: should now, yes13:29
* cjwatson does another debootstrap to confirm13:30
skaet_pitti,  what's left before pushing off the image rebuilds?13:30
pittiskaet_: FYI, I also cleaned up https://bugs.launchpad.net/ubuntu/natty/+bugs?field.milestone=33573, but not finished yet13:30
pittiskaet_: let me check13:30
pittiogra, cjwatson: to confirm: armel preinstalled only depend on new dpkg; non-ubuntu alternates depend on brltty+d-i; non-ubuntu desktops only depend on dpkg; ubuntu desktop/DVD depend on unity13:31
pittiubuntu alternates depend on unity as well, of course13:32
pittiIOW, as soon as my wait-for-package dpkg_1.16.0~ubuntu2 finishes, I'll trigger armel preinstalled builds13:32
cjwatsonpitti: that sounds right to me13:33
skaet_do we have nux uploaded but unity not,  or are both not uploaded yet?13:33
pittiskaet_: antimony will be busy for a fair while with building the others, FWIW13:34
* skaet_ nods13:34
cjwatsondpkg should be available already13:34
pittiah, w-f-p just finished13:34
cjwatsonmy debootstrap picked it up13:34
pittiubuntu-netbook daily-preinstalled should be ok, as this uses unity-2d13:35
cjwatsonurk13:35
pitticjwatson: ?13:35
cjwatson$ ls -l /chroot/natty-multiarch/var/lib/dpkg/info13:35
skaet_?13:35
cjwatsontotal 2013:35
cjwatson-rw-r--r-- 1 root root     0 2011-03-01 13:35 dpkg.list13:35
cjwatsondrwxr-xr-x 2 root root 20480 2011-03-01 13:35 i38613:35
didrocksskaet_: nux is pushed, I'm taking all the time I can get before it's published before pushing unity13:35
didrocksskaet_: as it will need nux to be published13:35
cjwatsonthat's still bad :(13:35
cjwatsonand yes, that's new dpkg13:36
cjwatsonI wonder if debootstrap needs to be changed13:36
skaet_didrocks, but if the abi has changed, will it not break the current unity if we build images without the updated unity?13:36
didrocksskaet_: we need either now:13:36
didrocks- rebuilding old unity13:36
didrocks- take the new one13:37
didrocksboth option are working, I tested them13:37
didrocksoptions*13:37
cjwatsondamnit.  yes, debootstrap needs to be changed as well13:37
skaet_thanks didrocks.13:38
didrocksskaet_: welcome, just doing some final "try to crash it" tests and then uploading unity13:39
skaet_cjwatson, pitti - I have an appt I need to leave for now.  Will be back online in about 2 hours.13:39
cjwatsontesting ...13:39
cjwatsonsorry, going as fast as I can13:39
skaet_cjwatson,  understand completely, no apologies needed.13:40
skaet_cjwatson, pitti - don't wait for my return for decisions,  get them building as soon as you're comfortable we'll get usable images.13:42
cjwatsonack13:44
didrocksok, unity sounds good, didn't get any crash trying hard for the last 20 minutes in addition to the whole testing we did before13:51
didrocksuploading it13:51
njpatel\o/13:52
didrockspitti: uploaded13:53
ograhmm, it is supposed to produce good sound ?!?13:53
cjwatsonhmm, why is SIGPIPE set to SIG_IGN in my terminal?13:54
cjwatsonnot in gnome-terminal though, maybe it's a pterm bug13:54
didrocksogra: heh, full dolby digital :)13:56
cjwatsongnome-session bug13:57
ogrageez13:57
ograand i never have my speakers attached when using it !13:57
DavieyHello release team... ebtables is a new Recommends of libvirt-bin, showing in component-mismatch.  Is this ok?14:02
DavieyOr should we drop it to Suggests... we don't /need/ it.14:03
Daviey(this cycle)14:03
Davieyjdstrand and I are discussing it14:03
jdstrandwell, I asked questions. I don't know the policy/rule surrounding that. I just figured if universe wasn't enabled, then a Recommends on a universe package just wouldn't get installed, which would go for cd images14:04
Davieyjdstrand, the fear i have with that is inconsistent installations... without a user explicitly setting no recommends.14:05
jdstrandthat is a valid concern14:06
cjwatsonuniverse is enabled by default for CD images; it might create networked vs. not inconsistency14:06
cjwatsonif you don't need it, though, drop it to Suggests14:06
Davieyack14:07
jdstrandinteresting14:07
* jdstrand starts to see the 'why' in all those reports14:07
jdstrand:)14:07
pitticjwatson: wrt. your 'urk', was that an unexpected result from your debootstrap test? time to cancel the armel preinstalled builds?14:08
cjwatsonyes14:09
cjwatsonsorry, got distracted by SIGPIPE confusion14:09
pittiok, cancelling14:09
cjwatsonI just uploaded debootstrap 1.0.28ubuntu114:09
ograhmpf14:09
cjwatsonsorry, but you don't want to have to clean this up later14:10
ograno, indeed14:10
cjwatsonpublisher running now with all of that14:12
pittiah, was just about to ask, as there's none running ATM14:12
cjwatsonalso with nux on ... whoops, not armel14:12
pitticjwatson: 's ok, we don't need it there14:12
cjwatsoneverything else though14:13
pittiarmel has unity-2d14:13
cjwatsonah ok14:13
ograpitti, err, nope14:13
ograwe have both14:13
pittiuh?14:13
ograunity needs to be insrtallable14:13
ograand i think it has a versioned dep14:13
pittiogra: I see Recommends: unity-place-files, unity-place-applications14:14
pittibut those are separate14:14
ograwe have unity and it should be used, but default to 2d because we cant ship the drivers in the images14:14
pittinext publisher round then..14:15
ograk14:15
pittiogra: so, I'll wait with building preinstalled until nux and unity are built?14:16
ograwell, if its installable you can just build away ... i still need a boot test14:16
pittiso, new trigger list; debootstrap -> everything !ubuntu; unity -> all ubuntu images14:16
ograi fear we might need a good bunch of changes in the bootprocess14:16
charlie-tcacjwatson: we are going to stop the Xubuntu ppc builds entirely. We don't have any testers or developers that can work them, and users when trying to install have issues.14:17
cjwatsoncharlie-tca: OK :-/  stopped14:19
charlie-tcathank you. Just no point in building them only to hear complaints they are broken14:20
pittiogra: if you have nux on the preinstalled, I'm afraid we need to wait for unity, as they strictly depend on each other14:27
pittihttp://paste.ubuntu.com/573949/ is my current build plan14:28
pitticjwatson: do you want to re-test once debootstrap is published, or did you do that locally already?14:28
ograpitti, well, i get used to it, we couldnt build images since feb 16th due to that14:29
ograits just massively frustrating14:29
cjwatsonpitti: I did locally14:29
cjwatson(also committed upstream)14:30
pitticjwatson: ok, cool; so I'll fire as soon as debootstrap is up14:30
cjwatsonstuck on scandium again14:30
pittipublisher?14:31
pitticjwatson: is there any way to temporarily take scandium out of the publisher mirror poke, just like in cdimage?14:31
cjwatsonkicked, it's on its way14:31
cjwatsondon't know, I don't like to touch that14:31
pittiok14:34
cjwatsonasked #is14:42
jibelkubuntu upgrades are failing because of bug 72721115:15
ubot4Launchpad bug 727211 in udev (Ubuntu Natty) (and 1 other project) "package udev 166-0ubuntu2 failed to install/upgrade: dpkg-divert: error: mismatch on package (affects: 1) (heat: 6)" [High,Triaged] https://launchpad.net/bugs/72721115:15
pittilooking15:16
* pitti taps feet on debootstrap appearing in antimony's Pacakges.gz (it's already in pool/)15:23
pittihm, that udevadm diversion hasn't changed in years15:25
pittitrying in pbuilder..15:25
pittijibel: do you still have the affected machine/vm from above bug?15:27
jibelpitti, yes15:27
pittijibel: do you need to tear it down in the next 30 mins? I'ld like to test this locally first15:28
pittijibel: could you please add the output of "dpkg-divert --list" to the bug for now?15:28
pittijibel: and "ls -l /sbin/udevadm*"15:29
pittiok, can't reproduce locally15:31
jibelpitti, I can keep it to the release of natty if you wish. http://paste.ubuntu.com/573969/15:31
* skaet_ back15:32
=== brendand_ is now known as brendand
pittijibel: trying upgrade in conjunction with new dpkg now, the new dpkg migth be the one to blame15:34
jibelpitti, I'm retrying ubuntu upgrades. They passed this morning.15:35
pittijibel: I don't think it's specific to u/kubuntu; just sounds like it'd hit the upgrade on some particular package order15:35
cjwatson  * Use DPKG_MAINTSCRIPT_PACKAGE environment variable as package name on15:36
cjwatson    dpkg-divert when no --package or --local options have been specified.15:36
cjwatsonalthough udev seems to use --local explicitly everywhere15:36
pittihah, reproduced15:36
cjwatsonbut that does suggest a possible location for the bug15:36
pittijibel: ok, you can tear down your machine15:37
jibelok, thanks pitti15:37
cjwatsonthe code in dpkg-divert looks wrong to me15:37
cjwatsonin setpackage:15:37
cjwatson        /* If value is NULL we are being called from --local. */15:37
cjwatson        opt_pkgname = value;15:37
cjwatsonand in main:15:37
cjwatson        env_pkgname = getenv("DPKG_MAINTSCRIPT_PACKAGE");15:37
cjwatson        if (!opt_pkgname && env_pkgname)15:37
cjwatson                setpackage(NULL, env_pkgname);15:37
cjwatsonI suggest tracking down Guillem on #debian-dpkg@oftc15:38
cjwatsonI *think* the right answer is to replace !opt_pkgname with opt_pkgname_match_any there15:39
pittiI updated the bug with the details; I'll go find him15:39
slangasekcurrent policy forbids use of --local for packages15:40
slangasekseems dpkg now enforces this15:40
cjwatsonthe changelog does not document that15:41
cjwatsonit says:15:41
cjwatsonoh, I quoted it above15:41
cjwatsonit looks like a dpkg bug regardless of what policy says15:41
slangasekright15:41
cjwatsonI agree udev's use of --local is questionable, but it seems easier to fix dpkg-divert in a hurry15:42
cjwatsonpublisher back on auto15:42
* slangasek nods15:42
pittifinally, debootstrap landed on mirror; /me starts new images15:43
cjwatsonow, what a day15:43
skaet_is unity on the mirrors, or are we still waiting for it?15:47
pittiskaet_: I was waiting for debootstrap, which just got mirrored (hiccup again, had to run anonftpsync myself)15:48
pittiskaet_: images are building now, starting with !ubuntu/!edubuntu (since these wait for unity)15:48
skaet_sounds like we're still waiting on unity then.15:49
pittiunity is building on i386/amd64, depwait on nux on armel15:49
skaet_ack.15:49
pittiRiddell, ogra: do we want kubuntu daily-preinstalled? they failed to build15:49
Riddellif they don't build we don't have a choice surely15:50
pittior only kubuntu-mobile daily-preinstalled? or both?15:50
pittiRiddell: no, I mean, are these even expected to build?15:50
pittinot quite sure about kubuntu vs. kubuntu-mobile preinstalled15:50
pittithese are only for arm, so potentially we might only want mobile?15:50
Riddellpreferably we'd have both15:51
pittiRiddell: do you happen to know where the preinstalled logs are?15:51
* pitti tries kubuntu-mobile preinstalled in the meantime15:51
RiddellI think kubuntu-mobile won't work because of that tasks issue needing launchpad to be updated15:52
Riddellnot sure where the logs are15:53
ograif they need the recent qt fix Riddell uploaded, thats likely still building15:53
ograRiddell, i dont think they are mirrored, look on the buildds directly15:53
Riddellogra: how would I look on the buildds directly?15:54
ograw3m from antimony15:54
Riddellmm hmm15:54
Riddell libreoffice-style-oxygen : Depends: libreoffice-core but it is not installable15:58
Riddelltsk15:58
ograugh15:58
ograwhy do you install libreoffice on your images at all :)15:58
cjwatsonwhat architecture?15:58
ograarmel15:58
pittiRiddell: ah, right; libreoffice currently FTBFS on armel, hitting a gcc ICE15:59
ogradoes linaro know about it ?15:59
pittiarmel images on a3 need to remove LibO, sorry15:59
ograwe dont ship it anywhere15:59
ograand Riddell should stop that too :)15:59
ograwe have zoho-weboffice in main for armel images15:59
ograwill work with kde too16:00
slangasekno, libreoffice currently FTBFS on armel, debian/rules was updated with an untested exception that results in a recursive variable definition16:01
pittiah, right; the previous version ICEed, then this variable update was done, which failed, too16:02
pittianyway, won't get fixed in time for armel to build it16:02
slangasekright16:02
pittiRiddell: so I guess it's down to "temporarily unseed libo for kubuntu{,-mobile} preinstalled, or skip it for a316:02
Riddellyep, removing from seeds16:03
Riddellit's not in -mobile but that needs the launchpad update anyway16:03
pittiah, ok16:03
pittislangasek: hm, http://www.debian.org/doc/debian-policy/ap-pkg-diversions.html doesn't actually speak about --local16:07
slangasekpitti: hmm, it's in the upgrading checklist, let me see16:08
pittianyway, I'll fix it (--local -> --package udev)16:08
pittisounds more standard anwyay16:08
slangasek     You should not use `dpkg-divert' on a file belonging to another16:09
slangasek     package without consulting the maintainer of that package first.  When16:09
cjwatson     3.916:09
cjwatson          Maintainer scripts must pass `--package' to `dpkg-divert' when16:09
cjwatson          creating or removing diversions and must not use `--local'.16:09
slangasek     adding or removing diversions, package maintainer scripts must provide16:09
slangasek     the `--package' flag to `dpkg-divert' and must not use `--local'.16:09
slangasekPolicy version 3.9.1, section 3.916:09
pittih, thanks16:09
cjwatsonpitti: is there any upgrade handling needed?16:09
cjwatsontransition, I mean16:09
pitticjwatson: the diversion doesn't exist in an installed system16:09
pittionly between unpack (well, preinst) and configure (postinst)16:09
pittiso I think not16:09
cjwatsonthat's what I was hoping, but was on the phone so couldn't analyse16:10
pittiI'd just like to test/upload it now, so that upgraders get this in time for a316:10
cjwatsonyes, it's not vital for images but should be there16:10
pittitested udev upgrade again, works fine now. uploading16:21
pittiimages are getting built, but cdimage mirror is badly behind.. so not posting yet16:25
GrueMasterFor arm, we only need the omap and omap4 preinstalled images.  No dove or imx51, and no netboot images (afaik).16:28
slangasekDo we know what's happening with mirroring?  Is this scandium still?16:28
pittiGrueMaster: hm, the only preinstalled ubuntu image type we have is ubuntu-netbook16:28
pittislangasek: I disabled scandium from cdimage config temporarily, so sync-mirrors stops hanging16:29
pittiI think now it's just utterly slow16:29
pittihttp://cdimage.ubuntu.com/kubuntu/daily/20110301.4/16:29
GrueMasteryes, that is correct.  But I have email from iso.qa saying images for imx51 & dove were ready.16:29
pitti(it's like that for > 20 mins already)16:29
cjwatsonslangasek: Ng said that it's because security.u.c is getting hammered quite a lot at the moment16:29
slangasekpitti: well, there are public mirrors that are out of date also; the python-central and ucf fixes I pushed last night are still not available16:29
slangasekcjwatson: ah16:29
cjwatson(if I'm paraphrasing correctly)16:29
GrueMasterAnd looking at the tracker, I saw that the netboot images had been enabled.16:29
cjwatsonthey're trying to rebalance16:29
pittislangasek: same reason probably; the world downloading openjdk from -security16:29
jdstrandone of the openjdk's has finally made it to -updates16:29
jdstrand(lucid)16:30
pittiGrueMaster: don't want netboot?16:30
jdstrandthe karmic one is still finding its way16:30
ograpitti, nice to have16:30
GrueMasterNo easy way to test it as it doesn't have ta bootable image.16:30
ogranot priority or focus16:30
pittiGrueMaster: ah, I see -- I accidentally enabled netboot dove/imx51, those should go of course16:30
GrueMasterYes, that was what I was referring to.16:30
ograyeah, dove and imx should go16:30
GrueMasterWe can have the images, just don't want them showing up as needing testing.16:31
ograomap3/4 would be nice to have but wont be tested16:31
ogra(omap3 is helpful for having a downloadable vmlinuz for qemu)16:31
pittiGrueMaster: ack16:31
pittipublisher stuck again16:44
pitticjwatson: you just killed the ssh archvsync@scandium for that?16:44
cjwatsonyeah16:45
pitti*zap*16:45
pittiskaet_: downloaded and installed new unity debs from Launchpad, seems tame16:59
pitti(and awesome, too)17:00
skaet_whew!!17:02
ogradid they build on arm ?17:02
ogra:)17:02
seb128no17:03
seb128not yet rather17:03
pittinux did, published now17:05
pittiarmel unity is building17:05
pittiogra: FTR, kenvandine just mentioned another libdbusmenu fix which is very important for unity-2d17:05
pittihe'll upload now17:06
pittiI just don't know whether it's important enough to delay the preinstalled images another hour?17:06
ograpitti, we will likely need to rebuild anyway and have a couple of uploads once we actually *have* an image17:07
pittiogra: ok; so build it ASAP?17:07
ograright, we can still rebuild, but we need something to test first17:08
evanyone have an opinion on whether these will require a tech board decision: https://bugs.launchpad.net/ayatana-design/+bug/723831 https://bugs.launchpad.net/ayatana-design/+bug/723826 ?17:16
ubot4Launchpad bug 723831 in ubiquity (Ubuntu) (and 1 other project) "Installer – The option to 'install third-party software' when installing Ubuntu should be selected by default (affects: 1) (heat: 6)" [Critical,New]17:16
cjwatsonI'm going to be away for about three hours17:18
charlie-tcaI thought third party software required user approval to install, wouldn't checked by default be wrong?17:18
cjwatsonKirsten needs to go out so I have to babysit17:18
pitticjwatson: I'll still be here for 3 hours17:18
charlie-tcaIf it was checked by default, why not just install the software, which is what will be done anyway?17:19
evcharlie-tca: not a lawyer, but we might be able to get away with it by changing the button label to "Accept" or something like that.  I've seen such things on other platforms with larger legal teams than ours.17:21
charlie-tcaI am not a lawyer either, but I thought the whole reason behind it not being checked was to insure the user knew it would be installed17:22
pitti^ I agree17:22
pittiwe print "free software" on the cover17:22
evthe text is still there for them to read; it's still vastly different than just sticking it in the squashfs.17:25
charlie-tcaIf they read it, why would it need to be checked by default? Isn't that being done because they don't read!17:26
evI don't know the motivation, but I suspect it's because they may not realize the benefit of checking the box, a difficult proposition to solve in a paragraph of text.17:27
evAnd it does benefit the vast majority of users, who greatly outnumber the people who care about software purity.17:27
evwhom equally tend to better understand these issues and can uncheck the box.17:27
slangasekwell, if you're talking about "third party software", isn't that more than just a question of freeness?  Isn't there also a question of quality of integration?17:29
slangasek(from the bug description, it's not clear to me what this "third party software" option points to)17:29
evubuntu-restricted-addons17:29
slangasekoh; how is that third-party at all? :)17:30
evso yes, but I suspect (I'm not claiming to have done user research) people will care more about having working java in the browser than they will being able to report bugs about it and get a decent response.17:30
pittiev: oh, I thought this thing was about installing wl and nvidia, not extra codecs17:30
evthat's part of it as well17:30
evbut the same principle applies17:30
pittiev: the latter are handled quite fine by our codec installer already, with much better UI?17:31
ev"rather have a working network card"17:31
skaet_ev, charlie-tca, re 723826 - we need to get signoff from legal before this is done, since its not just a convenience thing.   Basically some of the non free licenses combined with the free licenses have redistribution implications.17:31
pittiI'd be fine with installing drivers by default (wlan/graphics), as we have always considered them an "enabling pain" to use free software at all17:31
pittibut lumping both drivers and u-restricted-extra into one option seems hard to describe in a single sentence indeed17:32
evhistorical context: the original motivation for the option was Michael Forrest surveying the community to find out what the most common set of actions were immediately after install, and he found that most people went straight for ubuntu-restricted-extras.17:33
evskaet_: absolutely17:34
slangasekjudging by bug reports it looks like the second most common post-install action is to remove grub2 in favor of grub1 and break their bootloader setup, but I wouldn't recommend we do that by default ;-)17:34
evskaet_: we had long conversations with Amanda and Andrew about this originally, and I suspect we'd pick those back up with this change, if accepted.17:35
evslangasek: heh17:35
skaet_ev,  want to have this accepted by amanda and andrew, before the change is made ;)17:36
evwhy on earth are people switching to grub1?  Is there some Automatix Part Deux out there doing this for them?17:36
evskaet_: of course17:36
skaet_anyhow,  have changed the priortity to wishlist,  and put my comments into this bug.  Pull me in, if the discussions start up.17:37
evskaet_: will do17:37
slangasekev: I don't think it's automatix; maybe some bad advice in the forums17:37
evugh, the forums.17:37
evif I had but one nuclear weapon, I know where I'd point it.17:37
charlie-tca+117:40
=== joshuahoover1 is now known as joshuahoover
pittiyay, images trickling in on cdimage17:49
pittimirrors ran out of space, had to free up a bit17:49
* pitti starts tracker'ing17:49
pittiRiddell: kubuntu alternates, desktop posted17:51
Riddellooh!17:52
pittiunity appeared now, building images17:54
pittismoser: are you taking care again about the UEC image building and adding to the tracker?17:58
smoserwell, yes, i will ping someone to do that when we have a build.17:58
smoseri cannot build at the moment17:58
smoser(or at least could not all morning)17:59
smoseris that expected to be resolved ?17:59
pittismoser: what broke?17:59
smoseri get archive errors. sudo debootstrap --arch=i386 natty ./out.d http://archive.ubuntu.com/ubuntu17:59
smoserwill regularly fail18:00
pittiweird, my cron.dvd/kubuntu-dvd build just finished, and yet there's no trace of it in www/full/kubuntu/dvd - WTH?18:00
smoserright now:18:00
smoserW: http://archive.ubuntu.com/ubuntu/dists/natty/main/binary-i386/Packages.gz was corrupt18:00
pittismoser: when did you try last?18:00
pittiah18:00
pittidebootstrap was fixed a few hours ago18:00
smoseroh? SRU'd to lucid ?18:00
pittino, in natty18:01
smoserthis is a lucid system building natty18:01
smoserjust now, trying 'apt-get update' on that system showed 'Failed to fetch' errors.18:02
pittismoser: judging by http://launchpadlibrarian.net/65373191/debootstrap_1.0.28_1.0.28ubuntu1.diff.gz it seems that you need to copy natty's recipe file to your build system18:02
pittismoser: the failed to fetch sound like fallout from the security.u.c/archive.u.c. hammering18:03
smoserthats going to fix *download* ?18:03
pittismoser: no, not download, but should fix the debootstrap result for natty18:04
smoseri think right now i'm not that far.18:05
skaet_pitti, ==== Syncing Kubuntu mirror =====18:05
skaet_Tue Mar  1 17:51:50 UTC 201118:05
skaet_lockfile: Sorry, giving up on "/srv/cdimage.ubuntu.com/ftp/Archive-Update-in-Progress-antimony.canonical.com"18:05
skaet_antimony.canonical.com is unable to start rsync, lock file exists18:05
pittiah, that'd explain it18:05
pittithanks18:05
smoseryeah... an dearlier today, i was lucky and actually got rhough an image build without such a thing. so i dont think thats it.18:05
pittiskaet_: re-running cron.dvd18:05
pittiskaet_: I just checked cardamom, the livefs is there (which is the expensive part)18:06
skaet_pitti, cool.18:06
skaet_thanks!18:06
smoserthe hammering of security.ubuntu.com definitely isnt helping anything, though.18:06
pittiunity armel being published nwo18:08
ogra\o/18:09
smoseryeah, i'm getting corrupt downloads still from the mirrors. :-(18:12
jdstrandsmoser: that should be resolving itself soon. the offending packages have been pocket copied and so mirrors should start to pick them up18:13
smoserso, i'm blocked on that at the moment.18:14
pittifinally! no "rebuilding" images any more on http://iso.qa.ubuntu.com/qatracker/18:21
pittixubuntu/ubuntu alternate etc. all posted now18:21
pittiubuntu/edubuntu desktops/dvds to come18:22
ogradid you accidentially fire off an arm build ?18:24
ograi just got empty build failure mails18:24
pittiI might have earlier, yes; sorry18:24
ogranp18:24
pittiwait-for-package returned, but I didn't realize it wouldn't wait for all arches18:24
pittihave it running wiht -a armel now18:24
ograheh18:24
ograyeah, we are used to that :P18:24
smoserpitti, what is wait-for-package ?18:27
pittismoser: it's a script that waits until a particular package version is on antimony's mirror18:27
smoseri've a similar [sounding] thing that is buggy right now because out of the N archive.ubuntu.com, only X of them have what i want.18:28
pittismoser: so we can upload a fixed package, then set of a trigger with wait-for-package -a armel unity_3.6.0-0ubuntu1 && buildlive ..18:28
smoseryeah.. ihave something very similar, but would rather use yours18:28
smoseris that in a bzr repo somewhere ?18:28
pittismoser: the heart of it is just a zgrep -q "$PACKAGE" "$CDIMAGE_ROOT/$FTPDIR/dists/$DIST/$COMPONENT/binary-$ARCH/Packages.gz"18:29
pittismoser: the rest is rather specific to antimony, like the scripts to call anonftpsync, etc.18:29
smoseryeah, thats basically what i have. wget + grep.18:29
smoserk18:29
pittiparent branch: /srv/cdimage.ubuntu.com/bzr/private/cdimage18:30
pittismoser: hm, I'm sure cdimage is in some branch on LP, just not sure where exatly18:30
pittikubuntu-desktop_1.217 just hit, building kubuntu preinstalled18:30
smoserdont worry about it, pitti thanks.18:31
pittiok, I did all I can for now, now I need to wait for the machinery; AFK for a bit for dinner18:32
stgraberskaet_: I'm working on a new ltsp package at the moment, that'll be a new upstream release containing only bugfixes. It'll fix LTSP for Edubuntu and possibly for Ubuntu Alternate (assuming it's also broken for alternate at the moment). Is it fine for me to upload that ?18:44
stgraberskaet_: I don't think we need it for alpha-3 but it'd definitely be a nice to have if we have to rebuild for whatever reason18:44
stgraber(the issue is caused by the new ssh introducing ecdsa keys which didn't exist before. LTSP currently doesn't copy them and so login doesn't work, the new package will fix that)18:45
skaet_stgraber,  if its not necessary for A3,  lets hold off until we know we're going to need a rebuild.  We may have some fragile other parts, and we probably need to minimize changes for a bit.18:46
stgraberok18:48
skaet_stgraber, is there a bug number/s for tracking the LTSP fixes?18:48
* stgraber checks18:49
* skaet_ wants to dig into it a bit more and understand implications ( and what should be documented, etc. )18:49
stgrabernope, filing one now18:49
skaet_:)  okie,  copy release team on it,  since its going to be a FFe, since we're pulling in the new upstream package (even though it should be mostly bug fixes... :/ )18:51
stgraberoh, do we need FFe now for bugfix only upstream releases ? (as in, I'm the upstream :))18:53
stgraberanyway, bug 72733918:54
ubot4Launchpad bug 727339 in ltsp (Ubuntu Natty) (and 1 other project) "LTSP on natty doesn't support ecdsa ssh key. Login impossible (affects: 1) (heat: 8)" [Undecided,New] https://launchpad.net/bugs/72733918:54
dbarth__skaet_: https://bugs.launchpad.net/ubuntu/+source/compiz/+bug/709461 should provide a clearer description now19:06
ubot4Launchpad bug 709461 in unity (Ubuntu Natty) (and 4 other projects) "Application windows can sometimes fail to display and will mask regions of the screen (affects: 16) (dups: 2) (heat: 108)" [Undecided,In progress]19:07
skaet_stgraber, :) thanks for the bug number.  Sometimes the line between bug fixes and features is kinda blury.   https://wiki.ubuntu.com/FreezeExceptionProcess  calls for a bug in any case.  From the description, it sounds like you are adding the a capability to handle something that wasn't there before - so is it a new feature or bug fix, I could argue both ways? :P   But its a good thing to add and a bug is asked fo19:07
skaet_r in either case, just question of timing before it will go in. ;)19:07
stgraberhmm, looks like we also have a bug in tftp-hpa affecting ltsp ...19:11
* stgraber tries to reproduce19:11
stgraberskaet_: bug 727356 (Chuck Short is looking at it)19:16
ubot4Launchpad bug 727356 in tftp-hpa (Ubuntu) "tftp-hpa crashes on natty (buffer overflow) (affects: 1) (heat: 6)" [Undecided,New] https://launchpad.net/bugs/72735619:16
skaet_stgraber, thanks for letting me know.19:19
* pitti feeds the hamsters to build faster19:25
pittiRiddell: Kubuntu DVDs posted, FYI19:25
pittiRiddell: kubuntu preinstalled took an hour now, so I guess they succeeded19:26
ograjust wait another 30min and you will know ;)19:27
pittiskaet_: do you know whether we post the chinese edition dailies in the tracker?19:31
pittiit just finished building19:31
pitti*cry*, ubuntu desktops still oversized; oddly enough they come out as the same size as this morning, althuogh I already removed a langpack19:33
skaet_pitti, re: chinese editions haven't gone in the tracker so far.  Do you know who's lined up to test them?19:33
pittiskaet_: I don't know19:33
skaet_pitti, ok,  will dig a bit and see if I can figure out what needs to happen to them.19:34
marjo_skaet_, pitti: no testers, no image!19:34
* ogra guesses chinese people 19:34
skaet_pitti,  will let you focus on the oversized desktops...19:34
skaet_marjo_,  ack,  need to find out why they were added to the build list this time around...19:35
* skaet_ goes off to talk to the OEM folk...19:35
pittiskaet_: they are always built19:35
pittiskaet_: we just haven't added them to the iso tracker so far19:35
pittihttp://cdimage.ubuntu.com/daily-live/20110301.1/ ready for testing, but is oversized19:40
marjo_pitti: we don't want to add images to tracker unless there are committed testers for them19:40
skaet_pitti,   as part of dailies, but not part of release manifest.  ;)19:40
pittiso I won't add to tracker19:40
skaet_pitti, are we going to be able to get one out today that isn't oversized?19:41
pittiskaet_: your today, yes; my today, probably not19:41
pittior just barely19:41
pittiskaet_: I synced upower, which just adds a new binary (GIR), and has no other code changes19:42
pittiI need a harmless main uplaod to update the Taks headers for my dropped langpack19:42
pitti(i. e. I dropped another one)19:42
pittineed to investigate what caused the CD to baloon19:42
pittibut that'll do for now19:42
pittiskaet_: so, we'll ideally get a CD in about 2 hours19:42
skaet_pitti,  thanks ok,  yeah no point in starting to test then.19:44
pittiunfortunatley the CD builds need a lot of handholding today19:45
pittiat least I got all builds in my "plan.txt" queued, and most of them done now19:46
skaet_pitti,  thanks for doing the hand and finessing.   I think ogra's suggestion that we allow 2 weeks between FF and a release makes sense for next time.19:51
skaet_s/hand/handholding/19:52
ograyeah, to have some time for settling the newly introduced FF breakage19:52
pittiskaet_: we'd just get more FFEs..19:53
pittibut the dpkg one hit quite hard, yes19:53
pittibut actually the handholding mostly comes from the mirror breakage19:53
pittiogra, Riddell: wohoo! http://cdimage.ubuntu.com/kubuntu/daily-preinstalled/20110301/19:54
skaet_\o/,    will add the pompoms when we know it works ;)19:55
pittitracker'ed19:55
pittiI added it as "kubuntu netbook" (it's what the tracker offers), hope that's right19:56
* skaet_ believes so19:56
jibelskaet_, re: chinese edition, chrisxia is the one you should ask. they have a tester if needed.20:01
* ogra doesnt care about kubuntu to be honest20:01
skaet_jibel, thanks for the pointer.   will work with management to determine if this is going to be on the manifest/tracker or not in the future (and if it is, can they sign up to the  2 day testing cycle ;) )20:03
* ogra wonders if there will be any trace of armel images at some point before A3 :P20:25
pittiogra: kubuntu is published, ubuntu building20:26
ograk20:26
ografinally20:26
ogradid kens fix make it in ?20:26
ogranow that it took several hours anyway20:26
pittiI suppose yes20:27
ogragreat20:29
jcastrohi, I'd like to make sure that the unity bug filing docs are linked to from release notes or the announcement or whatever: https://wiki.ubuntu.com/Unity/FilingBugs20:36
pittiUbuntu DVD posted (http://cdimage.ubuntu.com/dvd/20110301/)20:45
pittiogra: ubuntu preinstalled fs builds just succeeded, running cron.daily-preinstalled now20:46
pittiwhee, after what feels like 20 hours stuff is finally coming together20:46
* ogra hugs pitti20:46
ograwhat do you mean with "feels"20:46
ogra:)20:46
ogradidnt we start yesterday afternoon with preparations20:46
pittiHeghlu'meH QaQ jajvam20:47
ograhookah hey20:48
mvoI have some fixes in software-center, is that still appropriate for a3?20:50
pittimvo: you can upload, but no guarantees that they'll make it into the images20:51
pittiogra: Quapla'! omap/omap4 .img.gz in antimony's tree now, just need to catch up rsyncing20:52
ograyep, waiting for them to show up publically :)20:53
pittilibdbusmenu-glib3 0.3.99-0ubuntu420:53
pittiogra: ^ so it missed ubuntu5 :/20:53
ograwell, a build just takes 90min20:54
pitti(as we discussed earlier on)20:54
pittibut at least there are images now20:54
ograyeah20:54
mvopitti: thanks!20:56
skaet_jcastro,  ack.   Will put a link into the TechOverview.20:57
jcastrothanks!20:58
cjwatsonback21:00
cjwatsonI'm going to continue working on bug 723482, unless somebody has something better for me to do21:00
pitticjwatson: wb21:00
ubot4Launchpad bug 723482 in mountall (Ubuntu) "system hangs on boot after updates from 2011-02-22 (affects: 14) (heat: 78)" [High,Confirmed] https://launchpad.net/bugs/72348221:00
pitticjwatson: quick status: cdimage mirror syncs have been resolved (was -ENOSPC), except for scandium21:01
pitticjwatson: most images are ready now, and on the tracker21:01
pittiogra: ubuntu omap preinstalled added to tracker, ther enow21:01
pitticjwatson: currently building edubuntu DVD, still need to wait a bit for publisher to rebuild ubuntu CDs for oversizedness21:02
jibelpitti, can I test Ubuntu 20110301.2 ? I get an error with kubuntu i386: dpkg-query: error: failed to open package info file '/target/var/lib/dpkg/status' for reading: No such file or directory which doesn't make sense21:04
pittiskaet_: I'm about to fall off my chair; can you add the edubuntu DVD once it finished building? should be 30 mins to an hour; should appear at http://cdimage.ubuntu.com/edubuntu/dvd/21:04
pittijibel: you can test the current ubuntu iso, but it's oversized21:05
skaet_pitti,  sure,  can do.21:05
pittijibel: eww21:05
cjwatsonjibel: what's the context of that error?21:05
pittijibel: is that alternate?21:05
jibelkubuntu desktop i386 on VBox, dialog box at the end of the installation. I can post the syslog21:05
cjwatsonbah.  it'll be ages before I've synced it21:06
jibelthat's just after "Removing Ubiquity ..."21:06
jibelwell there are more errors higher in the logs related to update-alternatives21:07
cjwatson/var/lib/dpkg/status hasn't moved with multiarch though, AFAIK21:07
jibel:q21:08
jibelsorry wrong keyboard21:08
pitticjwatson: I did an upower upload (no code changes, just building an extra gir deb) about an hour ago, which shuold have updated the Task: headers; apparently I need a second publisher run now, to finalize it21:08
pitticjwatson: would you be able to re-run ubuntu desktops in about an hour, after language-pack-pt finally loses its ubuntu-live task header on amd64?21:08
cjwatsonyeah, I guess so21:09
pittior are you going to bed soon, too?21:09
cjwatsonno21:09
pittiI'm just feeling tired enough, I think I'll be more useful if I get up early tomorrow21:09
cjwatsonlanguage-pack-pt/amd64  Task  ubuntu-dvd-live21:09
cjwatsonlanguage-pack-pt/amd64  Task  kubuntu-dvd-live21:09
cjwatsonlanguage-pack-pt/amd64  Task  kubuntu-full21:09
cjwatsonlanguage-pack-pt/amd64  Task  edubuntu-dvd-live21:09
cjwatsonthat looks OK21:09
pitticjwatson: hm, just did an apt-get update, and I still have it21:10
cjwatson(grep language-pack-pt/amd64 /srv/launchpad.net/ubuntu-archive/ubuntu-misc/more-extra.override.natty.main on cocoplum)21:10
pitticjwatson: where do you see that?21:10
pittiah21:10
cjwatsonthat's the output of cron.germinate; it may not be committed yet21:10
cjwatsonFYI, the upower upload is not what causes cron.germinate to be rerun21:10
cjwatsonit's what causes the output of cron.germinate to be applied to the archive21:10
pittiubuntu/dists/natty/main/binary-amd64/Packages.gz on cocoplum still has the header, though21:11
pitticjwatson: I remember that you said it needs two publisher runs?21:12
pitticjwatson: ah, so it should have been uploaded in this publisher run, not in the previous?21:12
cjwatsonhard to tell exact timings21:13
cjwatsonno, probably not, I think your seed change was after the cron.germinate run in the publisher run immediately before your upower sync21:14
cjwatsonso your upower sync was too soon to be effective21:14
cjwatsonhowever, the publisher had work to do in natty/amd64 this cycle anyway, so that doesn't matter21:14
cjwatsonall it needs is for the pocket to be dirty for some reason21:14
pittiok, thanks for taking over21:16
* pitti waves good night21:16
ograpitti, night and thanks for everything !21:16
marjo_pitti: thx!21:16
skaet_pitti,  thanks and sleep well.21:20
jibelcjwatson, bug 72742721:27
ubot4Launchpad bug 727427 in ubiquity (Ubuntu) "dpkg-query: error: failed to open package info file '/target/var/lib/dpkg/status' for reading: no such file or directory at the end of kubuntu desktop installation (affects: 1) (heat: 6)" [Undecided,New] https://launchpad.net/bugs/72742721:27
cjwatsonev: ^- don't suppose you're still around?21:29
skaet_slangasek: ^ - any insight?21:35
slangasekmmh - as cjwatson said, it's not supposed to have moved with multiarch21:36
skaet_ack.21:38
cjwatsonI'm syncing it, but ETA at least an hour even for the sync to finish, so if somebody could investigate first that would likely be better21:42
cjwatsonI've only been working with server images lately :-/21:42
slangasekcan someone tell the exact command that's being run to give this error?21:42
slangasekI'm in a similar situation as cjwatson as far as being able to test here21:42
cjwatsonfrom the context, it's a python-apt package removal21:43
cjwatsonMar  1 20:53:40 ubuntu ubiquity: update-alternatives: error:21:44
cjwatsonMar  1 20:53:40 ubuntu ubiquity: scan of /target/var/lib/dpkg/alternatives failed: No such file or directory21:44
cjwatsonI wonder if this is a "process being run chrooted when we thought it wasn't" problem21:44
cjwatsonor chroot-suitable configuration leaking through to a chrooted command, that kind of thing21:44
cjwatsonfor all I know it may have nothing to do with dpkg multiarch, and be related to an apt change or something21:44
slangasekvery strange21:46
cjwatsonas far as I know, the dpkg in question should be running outside the chroot, with --root=21:46
* slangasek nods21:47
cjwatson  * Propagate --admindir to programs run from maintainer scritpts.21:47
cjwatson    Closes: #9707621:47
cjwatsonit doesn't have anything to do with that, does it?21:47
slangasekchecking21:47
slangaseklooks probable21:48
slangasekhmm, but does dpkg call chroot for --root?21:49
cjwatsonfor maintainer scripts, yes21:49
cjwatsonso I think it needs to strip the value of --root off the front of the DPKG_ADMINDIR it sets21:49
cjwatsonor something simiar21:49
cjwatson*similar21:49
* slangasek nods21:49
cjwatsonbasically undo what setroot does21:50
cjwatson  m_asprintf(&p, "%s%s", value, ADMINDIR);21:50
cjwatson  admindir= p;21:50
cjwatsonshould be easily testable in isolation21:51
slangasekright21:52
cjwatsonso that will clearly hose all desktop images21:54
cjwatsonI don't think we use dpkg --root in d-i21:54
cjwatsonit would seem unlikely given the environment21:54
slangasekcjwatson: would you do the stripping in preexecscript() right before the chroot, then?22:00
cjwatsonno, I'd do it where it sets DPKG_ADMINDIR22:03
cjwatsonhm, would I22:03
slangasekwell, are there other subprocesses that will care about this besides maintainer scripts, is what I wonder22:03
cjwatsonI suppose doing that would break dpkg --root= -l22:04
cjwatsonsince that execs dpkg-query22:05
cjwatsondoing it in preexecscript feels inelegant, but it would work as a stopgap at least22:05
slangasekcompletely untested so far, buT: http://paste.ubuntu.com/574179/22:06
slangasekhmmm, building from bzr gives me a strange build failure22:11
* slangasek grabs the source packgae22:11
cjwatsonlooks nominally OK22:11
slangasekright, builds fine from source package; something out of sync maybe?  will check later22:14
charlie-tcaThe wording in the ubiquity installer is now unclear.22:17
charlie-tcathe page "Install Ubuntu alongside them" does not explain what "them" is22:17
slangasekcjwatson: checks out in a test here22:18
slangasekshall I upload?22:18
skaet_charlie-tca, please open a bug and we'll deal with it there.22:21
charlie-tcaokay22:22
* slangasek uploads22:23
skaet_hmm,  Thanks to who ever beat me to the edubuntu DVDs - they're on the ISO tracker now.22:25
slangasekskaet_: but I guess they'll be uninstallable and need respun like the others, so I don't know if it's worth having people test?22:27
skaet_slangasek, was wondering if that might be the case.   ok,  marking them for rebuild.22:27
slangasekanything that uses ubiquity is broken and needs respun22:27
ograslangasek, your change onmly affects /target ?22:28
slangasekit affects installing with ubiquity (due to use of dpkg --root=)22:28
ograGrueMaster just reported a hang in oem-config on the preinstalled images22:28
ograhmm, does it use that on oem-config mode ?22:28
slangasekI can't think of any reason oem-config would be affected22:28
slangasekand it doesn't present as a hang, anyway22:29
ograright22:29
slangasekso sounds like you've got a separate bug22:29
GrueMasterYep.  Filing a bug report now.22:29
ograyeah, thats what i thought22:29
jibelserver images fail to upgrade, something to do with mysql being blocked by apparmor :(22:36
jdstrandjibel: is there a bug?22:36
jibelidk, I've just got the hang here.22:37
jdstrandjibel: what is the apparmor denied message in the logs?22:37
slangasekogra, GrueMaster: according to the manifests, the preinstalled images carry a full copy of ubiquity; do you know why?22:38
ograoem-config depends on it22:39
ograsince oem-config == ubiquity nowadays22:39
GrueMasterSubmitting bug report now.22:39
ograit runs the same ubiquity but supresses modules22:39
GrueMasterBug #72746822:39
ubot4Launchpad bug 727468 in ubiquity (Ubuntu) "oem-config crashed during install on armel (affects: 1) (heat: 6)" [Undecided,New] https://launchpad.net/bugs/72746822:39
slangasekogra: ok - not quite how I had thought that was structured, but makes sense22:40
jibeljdstrand, http://pastebin.ubuntu.com/574195/22:40
ograit doesnt run tasksel and the partitioner22:40
ograbut beyond that they are the same22:40
slangasekogra: "the same" - it doesn't need to copy packages either, does it?22:41
slangasekto a different install partition22:41
ograMar 1 21:54:27 acorn ubiquity: grep:22:41
ograMar 1 21:54:27 acorn ubiquity: /target/etc/apt/sources.list22:41
ograMar 1 21:54:27 acorn ubiquity: : No such file or directory22:41
slangasekthat's what's currently broken in dpkg - trying to confirm whether it affects preinstalled22:41
ograit shouldnt use /target at all22:42
Riddellev, cjwatson: any thoughts on bug 726581 ? it's been confirmed by someone else now too22:42
ubot4Launchpad bug 726581 in ubiquity (Ubuntu) "install stops half way through (affects: 3) (dups: 1) (heat: 3510)" [Undecided,New] https://launchpad.net/bugs/72658122:42
slangasekogra: ok, so that's probably a ubiquity bug22:42
ograif it would chroot in an oem install i would expect it to just use /22:42
ograit doesnt seem to be the cause of the trasceback though22:43
jdstrandjibel: please file a bug and assign it to me. is this required for alpha3?22:43
GrueMasterAre there any other logs I can include in my bug report that would help?  I'm not seeing anything in most of the other reports, but if there is a hidden report somewhere...22:50
ograthe syslog is already quite descriptive22:51
slangasekcan someone score up dpkg on powerpc, or should we run without it?22:51
slangasekn/m... only two ppc builders, one has a kernel, the other has eclipse22:52
slangasekskaet_, cjwatson: triggers set to rebuild livecds + dvds with dpkg 1.16.0~ubuntu322:52
jibeljdstrand, bug 72747822:56
ubot4Launchpad bug 727478 in mysql-5.1 (Ubuntu) "mysql upgrade hang at 'installing new version of config file /etc/init/mysql.conf' during upgrade from 10.10 to 11.04 (affects: 1) (heat: 6)" [Undecided,Confirmed] https://launchpad.net/bugs/72747822:56
doko_slangasek: done22:57
jibeljdstrand, I'll keep the testing env if you need more info.22:57
slangasekdoko_: ta22:57
jdstrandjibel: is this a stock configuration?23:00
jdstrandjibel: it seems odd that mysql needs a raw ip socket23:01
jibeljdstrand, yes, fresh 10.10 LAMP + ssh, dist-upgrade, reboot, do-release-upgrade.23:01
jdstrandjibel: is this required for alpha3?23:02
jdstrandjibel: or is friday good enough?23:02
jibeljdstrand, if we can ensure that its mysql and verify the upgrade without it I think that's good enough for a3. skaet_ what do you think ?23:03
ograslangasek, hmm, looking at line 130 in scripts/plugininstall.py it calls some debconf output, i wonder if it23:05
ograperhaps doesnt find the template23:05
jdstrandjibel: can you add the following to /etc/apparmor.d/usr.sbin.mysqld:23:06
ograself.db.progress('START', self.start, self.end, 'ubiquity/install/title')23:06
jdstrand  network stream,23:06
jdstrandjibel: then run 'sudo apparmor_parser -r /etc/apparmor.d/usr.sbin.mysqld'23:07
jdstrandjibel: then try 'apt-get -f install'23:07
jdstrandjibel: I'm assuming that your test environment failed in such a way that apt-get -f install will sufficiently test the fix23:08
jdstrandjibel: and to confirm, you saw this on both i386 and amd64 upgrades?23:10
skaet_bug 727288 just came across the list.   Is there any chance it could be a lingering effect from last night's instability?  worth holding off on debugging until we can get a retest with new dpkg/ubiquity?23:11
ubot4Launchpad bug 727288 in ubiquity (Ubuntu) (and 1 other project) "installer crashes with InstallStepError: HwDetect failed with code 1 on Dell XPS 1340 (affects: 9) (dups: 1) (heat: 22)" [Critical,Confirmed] https://launchpad.net/bugs/72728823:11
ograskaet_, bug 727468 is definitely a blocker for armel23:11
ubot4Launchpad bug 727468 in ubiquity (Ubuntu) "oem-config crashed during install on armel (affects: 1) (heat: 8)" [Critical,New] https://launchpad.net/bugs/72746823:11
skaet_ogra,  ack.  thanks for flagging explicitly.23:12
jibeljdstrand, I get lot of errors like debconf/config.dat is locked probably because the upgrade has been interrupted abruptly. I'll apply the config change and then upgrade but that will take more time.23:15
slangasekcjwatson: 727288> should we be holding off on respins for a ubiquity rebuild?23:17
cjwatsonskaet_: 727288 has nothing to do with last night's work.  I've just committed a fix23:17
skaet_cjwatson,  great.  thanks.23:17
cjwatsonogra: I have no idea what's going on with 727468 other than to say that it's probably got nothing to do with the message about /target/etc/apt/sources.list, and that that message essentially means that the underlying debconf confmodule fell over23:18
cjwatsonogra: if you want that fixed for alpha-3, you guys will have to do it23:18
ograyes, its clear that the sources.list has nothing to do with it23:19
cjwatsonogra: you should use --debug to get debconf debug output23:19
ograi just dont understand why the confmodule would fall over23:19
cjwatson(oem-config-debug as a boot parameter)23:19
ograyep23:19
GrueMasterOk will do.23:19
cjwatsonsorry, debug-oem-config23:19
cjwatsonnot oem-config-debug23:19
cjwatson(maybe I should make both work ...)23:19
cjwatsonI'm going to upload ubiquity 2.5.22 nowish23:21
* slangasek cancels his trigger and sets one for ubiquity instead23:21
jdstrandjibel: this was on both i386 and amd64?23:22
jibeljdstrand, yes23:22
* jdstrand is trying a do-release-upgrade after install LAMP via tasksel to try to reproduce23:22
jibeljdstrand, same problem with the configuration change.23:28
jdstrandthat... is... odd...23:29
jdstrandjibel: same as in 'same end result' or same apparmor denial?23:29
jibeljdstrand, same end result and same apparmor denial. How do I verify that the rule is active ?23:30
jdstrandjibel: verify that 'network stream,' is in /etc/apparmor.d/usr.sbin.mysqld, then compare the timestaps on /etc/apparmor.d/cache/usr.sbin.mysqld and /etc/apparmor.d/usr.sbin.mysqld23:33
jdstrandjibel: the cache should be newer (or possibly the same minute if using ls -l). if the cache is older, it certainly wasn't applied23:34
jibeljdstrand, I confirm that the cache is 11 minutes newer and the rule is there.23:36
jdstrandjibel: how did you prepare the VM prior to do-release-upgrade?23:36
jdstrandjibel: I can confirm it here with up-to-date maverick23:39
jibeljdstrand, prepare ? That's a virtualbox ose 4.0.4, I attached a 10.10 ISO downloaded from releases.u.c, selected install ubuntu server, ran the install with LAMP + ssh, setup my local proxy, rebooted once, login with the user I added during the install, applied the updates with apt-get update && apt-get dis-upgrade, then rebooted, login again and entered do-release-upgrade on the command prompt.23:39
jibelto all the questions about configuration files, I replied 'install the maintainer version'23:40
jdstrandjibel: k. I was curious if the VM was up to date prior to upgrading23:40
jdstrandand I see it was23:40
jdstrandI can confirm here, so I'll take a look23:40
jibeljdstrand, nice, thanks for your help. Heading to bed then. see you23:41

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!