/srv/irclogs.ubuntu.com/2012/03/29/#launchpad-yellow.txt

bacgood morning frankban11:16
frankbanmorning bac11:54
gary_posternot sure it is needed after that upgrade, but going to restart anyway...12:01
gary_posterbac benji frankban call in 1 or 2 (gmb is sick)12:09
* bac hordeing12:09
gary_posterFor future reference for myself, in case I have to tell someone about this for help later...http://pastebin.ubuntu.com/905522/12:31
gary_posteroff to restart and choose the new kernel; wish me luck12:31
gary_poster-1 point to gary for not following instructions properly; +0.5 for figuring it out before asking anyone about it.  Similar complaints for correct kernel as opposed to incorrect kernel http://pastebin.ubuntu.com/905554/12:55
gary_poster...and I need to restart again12:56
bachey gary you want to collaborate on an email to francis re: the switchpoint conference?13:17
gary_posterbac, sure13:19
gary_posterbac, I feel like I should stare at the website more13:19
bacmy points for wanting to go:  1) learn more about how open source is being using by NGOs, especially for health care in africa, 2) see how ubuntu is being used in that mix and look for opportunities for canonical, ubuntu, and ubuntu-ngo, 3) profit13:19
bacit is worth noting the main sponsor (intrahealth) has been a long time user of ubuntu, bzr, and launchpad.  check out their suite of LP projects:  https://launchpad.net/ihris-suite13:20
gary_posterbac, sounds like you should write the email, and I should affix my name to it ;-)13:20
bac:)13:20
baci've been in touch with those folks before and even did an in-house training session for LP and bzr many moons ago13:21
gary_posterbac, the only possible addition I had was whether anything technically interesting was going to be discussed.  I saw a lot of seemingly big titles from big named tech companies, but I was suspicious that the message was going to be more high-level than technical.  I'm pretty sure that's the case, despite the one seemingly technical talk title I saw of "Building for Scale".13:27
bacgary_poster: i don't even see that session.  where did you find it?13:28
gary_posterbac, seriously, if you are ok with it, are you ok with writing the message, then I'll read and discuss as appropriate, and then forward?  session: fifth down in afternoon segment at http://www.switchpointideas.com/schedule13:29
bacgary_poster: i'll send you a draft13:29
gary_postercool bac, thanks13:30
bacgary_poster: you did note it is kind of pricey?13:30
gary_posterfrankban, I'm in https://talkgadget.google.com/hangouts/extras/canonical.com/goldenhordeoneonone .  Head on over when ready; no rush13:30
gary_posterheh. another title: "Hybrid Ideation"13:30
baci don't even know what that means13:32
gary_posterme either13:34
bacgary_poster: off topic, but are getting/got a new ipad?  you'd mentioned in the past you mentioned the screen resolution being a limiting factor for you.  i'm curious to see how much clearer the text is.13:35
gary_posterbenji, frankban saw your error on a non-parallel ec2 run.  That opens us up even better to a disabling story.  In fact, I might encourage frankban to disable, and then you can follow along and try to fix in a timebox.  http://pastebin.ubuntu.com/905569/13:35
benjigary_poster: sounds good13:36
benjifrankban: I'm really confused about something in setuplxc, do you have a minute to help me?14:40
frankbansure benji14:40
benjifrankban: heh, as such things happen, I believe I've figured out the answer just by formulating the question14:43
benjifrankban: thank you for all your help ;)14:43
bacfrankban: i'm having problems with setuplxc too.  i get this:14:43
bac'ubuntu' template installed14:43
bac'lptests' created14:43
bacssh: Could not resolve hostname lptests: Name or service not known14:43
bacwith the last message repeated lots14:43
frankbanbac: and then it exits?14:44
bacfrankban: no14:44
bacfrankban: it is stuck, emitting that message every so often.  about 20 now14:44
bacif i kill it, do i have to start over?14:44
frankbanit should exit after 30 retries14:45
frankbanbac: no, 6014:46
bacer, ok14:46
frankbanbac:  and you don't have to start over, but you are experiencing a known issue involving precise and dns resolution14:47
bacok14:47
frankbanbac: the script is not able to ssh inside the container14:47
bacyeah, i figured as much.  but i don't know how much more work it needs to do14:48
frankbanbac, can I see the contents of your resolv.conf?14:48
bacnameserver 10.0.3.114:48
bac# Generated by NetworkManager14:48
bacdomain spoetzl.net14:48
bacsearch spoetzl.net14:48
bacnameserver 127.0.0.114:48
frankbanhm...14:49
frankbanactually you have the right nameserver, bac are you able to ssh lptests?14:49
bacthe localhost line is odd.  it should not be there.  it should be my local DNS at 192.168.x.x14:49
bacno, manually ssh'ing shows the same name resolution problem14:50
frankbanbac, but the conteiner is running, right?14:50
baci assume so.  how would i tell?14:51
bacsince i cannot ssh to it14:51
frankbansudo lxc-info -n lptests14:52
bacno, it is stopped14:52
bachmm14:52
frankbanbac: what about the script14:55
frankbanstill running?14:55
bacyes14:56
frankbanbac: could you check the lxc starts correctly?14:58
frankbansudo lxc-start -n lptests14:58
bacthe script just ended with14:59
bacError running command: ssh -t -t -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -i /home/bac/.ssh/id_rsa bac@lptests -- true14:59
benjihas anyone seen this error from setuplxc? AppArmor parser error for /etc/apparmor.d/usr.bin.lxc-start in /etc/apparmor.d/usr.bin.lxc-start at line 5: syntax error, unexpected TOK_END_OF_RULE, expecting TOK_ID14:59
benjibac: I'm working on that one as we speak14:59
bacfrankban:14:59
baclxc-start: failed to attach 'vethttuY7k' to the bridge 'lxcbr0' : No such device14:59
baclxc-start: failed to create netdev14:59
baclxc-start: failed to create the network14:59
baclxc-start: failed to spawn 'lptests'14:59
baclxc-start: No such file or directory - failed to remove cgroup '/sys/fs/cgroup/cpuset//lxc/lptests'14:59
frankbanbac: do you have the 'lxcbr0' device?15:03
frankbanbenji: that's new, something has changed in apparmor?15:03
bacfrankban: no, no /dev/lxc*15:04
benjifrankban: I can only assume so.  I don't know if this is related to the log-in issue or not (that seems to have to do with the binding (-b) option to lxc-create)15:04
frankbanbac, what virtual device you have running ifconfig?15:04
benjiI think we should have been more strict with our checking of errors when running subprocesses, I don't know when that error started or if it was coincident with the ssh issue15:05
bacfrankban: i have virbr015:06
frankbanyes benji, I agree, setuplxc reports errors and exits only during ssh operations. lpsetup is different15:06
frankbanbac: aha15:06
frankbanand I assume you have an upgraded precise host...15:07
bacfrankban: yes, i'm on the slashing edge15:10
frankbanbac: do you have dnsmasq installed and running in your host?15:12
frankbanbac: if so, maybe you are encountering this bug: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/92852415:16
_mup_Bug #928524: lxcbr0 fails to come up when dnsmasq is installed <dnsmasq (Ubuntu):Confirmed> <libvirt (Ubuntu):Confirmed> <lxc (Ubuntu):Confirmed> < https://launchpad.net/bugs/928524 >15:16
benjiit's wstarting to look like -b is broken15:18
bacfrankban: i do.  but a manually-installed lxc had been working for me for a very long time15:18
frankbanbac: and you were following those instructions? https://dev.launchpad.net/Running/LXC15:20
bacfrankban: yes15:21
gary_posterbenji, which -b?15:21
frankbanbac: ok, so you were using virbr015:21
benjigary_poster: lxc-create's15:21
gary_posterbenji, interesting.  If you want me to try and dupe, just ask.15:22
frankbanbac: you can try to use that now, change lxc.network.link in /var/lib/lxc/lptests/config and try to start the container again15:22
benjigary_poster: since bac has the same problem with his lxc, I suspect it's endogenous15:23
bacfrankban: yes, it will now start, then goes to a login prompt but doesn't recognize ubuntu/ubuntu15:26
bacssh lptests does not work either as before15:26
gary_posterI'm going to look, and ask serge if I see something similar15:27
bacbenji: you win vocabulary bingo today15:27
frankbanbac: to be able to use the lxc name you have to change the first line of resolv.conf to point to the ip address of virbr015:27
bacfrankban: ah, ok15:27
benjiha!15:27
benjiI've been listening to too many economist podcasts.15:28
bacfrankban: great, that worked15:28
bacfrankban: so, has my adventure exposed any real problems or just known issues with dnsmasq/virbr0, etc?15:29
bacbenji: which podcasts?15:29
baceconomic podcasts are the new ambien15:30
benjiheh15:30
benjiecontalk.org is very good15:30
frankbanbac: I didn't know that issue, so, if not fixed, it can be a problem when using lpsetup to set up a development environment. It should not be a problem for the testing environment15:30
frankbangary_poster: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/928524 : IMHO this means that we need to check the interface is up before doing anything in lpsetup, it should not be a problem for the testing environment.15:33
_mup_Bug #928524: lxcbr0 fails to come up when dnsmasq is installed <dnsmasq (Ubuntu):Confirmed> <libvirt (Ubuntu):Confirmed> <lxc (Ubuntu):Confirmed> < https://launchpad.net/bugs/928524 >15:33
frankbanbac: I don't know if your lxc is in a consistent state now, but, if you want, you can try to resulm setuplxc using -a initialize_lxc15:36
frankbans/resulm/resume15:36
bacfrankban: ok15:36
frankbanbac: you should add that option to the many you used before15:37
bacfrankban: it looks like -a must come last or it tries to interpret the directory as an action15:39
gary_posterI thought benji meant indigenous and didn't look it up (until now) :-P15:39
benjiyes, I imagine bugs as tribesmen running around in the forest of code15:40
bacgary_poster: me too,but i gave it the benefit of the doubt and learned something15:40
gary_posterfrankban, agreed that we should check.  We don't need it in setuplxc?  I thought we would15:41
frankbangary_poster: can't we (in setuplxc, for testing purposes) assume that dnsmasq is not installed?15:43
gary_posterfrankban, if we already connect exclusively via IP.  I didn't think that was the case15:43
frankbangary_poster: no, we connect using the name, but I thought only dnsmasq-base is required, e.g. in my host I have only that installed and I can see both interfaces (lxcbr0 and virbr0)15:46
frankbangary_poster: but I will agree if you say: let's do the check to prevent future lxc/dnsmasq/whatever bugs15:48
frankbangary_poster: we can check if lxcbr0 exists, then fallback to virbr0, and then, if none is found, exit. unfortunately we can do that only after the installation of lxc and libvirt-bin15:49
gary_posterfrankban, ok cool.  so, it would be nice to have but is not urgent, if I understand you correctly.  I'll make a low priority bug; maybe we'll be ready to use lpsetup first15:50
* bac -> long lunch/ride15:50
frankbangary_poster: yes, and I will create a card for lpsetup15:52
gary_postercool frankban15:56
gary_posterbenji, the problem is that -b sets up an fstab that has "$homedir $homedir none bind 0 0" instead of "$homedir /var/lib/lxc/$container/rootfs/$homedir none bind 0 0".  Have you already seen this?  Have you filed a bug, or shall I?  Would you like me to pursue with hallyn, or shall I?16:03
benjigary_poster: I was coming to the same conclusion.  Feel free to file a bug.  I think I'll step away for lunch now.16:04
gary_postercool benji16:06
benjiok, I'm back16:55
benjisince Gary is at lunch, I assume he's not working on the binding bug, so I'll look at fixing that16:56
frankbangary_poster: forwhen you're back, could you re-review https://code.launchpad.net/~frankban/launchpad/bug-609986-add-zope.testing-3.9.4-p5/+merge/99536? thanks17:08
gary_postersure frankban.  binding bug: you mean, implement hallyn's hix?17:24
gary_posterwell, his workaround?17:24
gary_posterbecause I'm sure he is going to fix it17:24
gary_posterin the lxc stuff17:24
gary_posterfrankban, re-reviewed17:26
benjigary_poster: I wasn't aware of hallyn's workaround; was that in the bug or in IRC?17:27
gary_posterbenji, https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/96837117:27
_mup_Bug #968371: lxc-create -b is broken <lxc (Ubuntu):Confirmed> < https://launchpad.net/bugs/968371 >17:27
frankbanthanks gary_poster17:27
gary_posterwelcome17:27
gary_posterso benji, I'm not sure what to do in terms of automation17:27
gary_posterbecause the only thing we can do is come behind and fix the broken fstabs17:28
gary_posterwhich should be fixed soon anyway17:28
gary_posterso implementing that (in bash, no less) seems like a waste17:28
benjior we could patch lxc-start-ephemeral, but if it's going to be fixed "soon", I would just wait17:28
gary_posterwell, we would need to fix both lxc-start-ephemeral and the ubuntu template17:29
benjiI do think hacking on lxc-start-ephemeral and making sure that everything is working end-to-end is important though, we've had several regressions lately17:29
gary_posterthe ubuntu template appears to be broken, and lxc-start-ephemeral is therefore also broken17:29
benjiin that case we could just wait and do the end-to-end test once the bug is fixed17:29
gary_posterseveral?  I'm forgetting.  what beyond this one?17:30
gary_posterunless lately mean "the past month or so"17:30
gary_posterin which case I agree17:30
gary_posterbut no others this week, right?17:30
benjiwe also had to add --use-http switch17:31
benji(that was this week)17:31
gary_postergotcha17:32
benjiand I removed the code to add the buildbot user to a group because it keeps hooks/install from being re-runnable (but that may not have ever caused a first-run error)17:32
gary_posterend-to-end test: mmm...well, right.  I mean, you could make a proposal for a change to lxc-start-ephemeral, but you'd want to make sure that hallyn isn't already working on it17:32
benjiand the bug that neccesitated adding it to a group has been fixed17:32
gary_posterbut you couldn't have an end-to-end until the template was fixed17:33
gary_posteryeah, I don't think the buildbot user to a group thing was a regression17:33
benjigary_poster: I don't understand that last bit.  I propose we wait until the binding bug is fixed and then we do a juju deploy of a master and slave and make sure the tests run17:33
gary_posterbenji, then I think we should talk. :-)17:35
gary_postergoldenhorde?17:35
benjisure17:35
* gary_poster is there17:36
bacgary_poster, benji: after applying frankban's virbr0 work-around i now have an lxc but it is not mounting my home directory.  if i ssh to it there is nothing there.  on the host, /home/bac/lxc/devel has a LP tree.  any ideas on how to salvage this setup?17:54
benjibac: yep, that's a known bug, hallyn is working on it/will work on is soon17:54
benjiif he isn't going to get to is very soon we may take it up since it's hurting us so bad17:55
baclooks like i picked the wrong week to try setuplxc for the first time.17:55
gary_poster:-/17:55
gary_posterbac, there's an easy workaround17:55
gary_posterbac, in your container's fstab...17:55
gary_poster(/var/lxc/$containername/fstab)17:56
gary_poster...modify the line that starts with "/home/bac /home/bac" to start with "/home/bar home/bac"17:56
gary_posterthat is, delete that initial slash in the second entry17:56
bacand change bac to bar?  :)17:57
bacok, then stop and start the container, i guess17:58
gary_posterbar, not so much :-)17:58
gary_posteryeah17:58
baccool, thanks17:59
gary_posterwelcome.  bug 968371 fwiw bac18:02
_mup_Bug #968371: lxc-create -b is broken <lxc (Ubuntu):Confirmed> < https://launchpad.net/bugs/968371 >18:02
bachmm, perhaps i should've run lxc-stop before monkeying around with the fiddly bits.  now it is hanging18:07
bacyo gary_poster19:30
gary_posterbac, hey.  https://talkgadget.google.com/hangouts/extras/canonical.com/goldenhordeoneonone19:32
bacgary_poster: script now works.  i guess i shit-can the unit tests since there is nowhere for them to live20:28
gary_posterbac :-(20:28
gary_posterbac, there will be a place for them in lpsetup20:28
bacok, i'll keep a local copy20:28
gary_posterthat can have standalone scripts20:28
gary_postermaybe send it to yellow, bac?  frankban might want it20:29
bacok20:29
gary_posterGo error handling: :-/ unconvinced and skeptical, but willing to give it a try.  Not something I'd be attracted to myself without the company advocating it.21:23
gary_posterWell, maybe that's too strong...21:24
gary_posterbut I'm a bit skeptical so far.21:24
gary_posterttyl, all21:24

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!