/srv/irclogs.ubuntu.com/2012/04/11/#launchpad-yellow.txt

bac hi gmb10:08
bacgmb, the latest drop of juju deprecated some settings in environment.yaml in favor of usng --constraints.  it makes the rewriting o the environments file done by your run_lp_tests script unecessary.  i've made changes to it and to charmhelpers to account for juju changes but haven't completed the changes or pushed them anywhere yet.10:20
baci'll do that after breakfast.  just wanted to give you a heads up so you don't duplicate effort.10:21
gmbbac, Awesome, I was just looking at that.10:45
gmbI'll let it lie, then.10:45
bacgmb: great.  i'll get to it post-oatmeal10:45
gary_posterbac benji frankban gmb, call asap12:10
gmbBooting FF now.12:10
* bac enhordes12:10
* frankban lunches12:33
baci have pushed run_lp_tests branch to lp:~yellow/+junk/run_lp_tests12:33
bacthat allows me to move the card, so the lane is unblocked now12:33
* gmb moves bug 974586 card, blocks the lane again.12:34
_mup_Bug #974586: bugtracker test logging failures <paralleltest> <Launchpad itself:Triaged> < https://launchpad.net/bugs/974586 >12:34
* bac should read warthogs more. didn't know poolie was leaving. :(12:41
* gmb -> lunch12:55
bachow does one set up PYTHONPATH so that it'll load the code being tested instead of the system version?  i would've expect this approach to work, but the local version (/home/bac/add-charm-helpers/helpers/python) is stuck in the middle and isn't getting loaded.  http://paste.ubuntu.com/924798/plain/12:56
benjigary_poster: I'm back for the time being teathered to my phone.  I doubt I12:57
benjican do video confrencing, but other things seem to be ok.12:58
bacso eggs in /usr/local/lib always get inserted before PYTHONPATH?13:00
gary_postercool benji.  replying to jml now.  his branch looks good13:00
gary_posterbac, that's a policy; maybe a deb one13:01
bacergh13:01
benjigary_poster: will you point me at his branch?13:02
bacgary_poster: do you know a work-around?  gmb added this to the makefile but it is ineffective:13:02
bacPYTHONPATH=helpers/python python helpers/python/charmhelpers/tests/test_charmhelpers.py13:02
gary_posterbenji, sorry forgot you did not have IRC history.  #launchpad-dev now fwiw.   https://code.launchpad.net/~jml/testtools/forward-current-tags/+merge/10153813:03
benjithanks; I'm following along13:04
frankbanbac: if you only need to get rid of the system site packages to test an app locally, I think virtualenv is an easy tool to get that kind of isolation13:12
bacfrankban: but the package in question is the one being tested.  i think requiring people to use virtualenv is a bit heavy handed.  i can achieve the same results by hacking sys.path in the test.  ugly.13:14
frankbanbac: oh, I thought  it was only for your local environment13:16
gary_posterbac, sorry, was talking on launchpad-dev.  reviewing backlog...13:17
bacnp13:17
gary_posterbac, system Pythons suck for isolation, sorry.  sys.path hack might be best bet.  -S will leave a clean sys.path initially, but will probably not be what you want13:18
bacgary_poster: sys.path hack isn't so bad.  mainly i was just surprised to see my PYTHONPATH stuck in the middle.  :(13:19
gary_posterbac, it's pretty common to make a requirement that virtualenv --whatever-that-option-is be required in these kinds of circumstances I think13:19
gary_posteryeah13:19
gary_posterreminds me of dark days trying to figure that stuff out :-P13:19
baci've pushed a new branch of charm-tools to lp:~yellow/charm-tools/trunk and have created a merge proposal.13:26
bacuntil it is packaged we should try to work off of the ~yellow version13:26
gary_postergmb, you up for reviewing lpsetup branch from frankban?13:27
gary_posterbac, actually, did you see than Sean actually committed code with his fix?13:38
bacgary_poster: i did not.13:39
gary_posterI'm tempted to use it, rather than ours, and see if it works13:39
bacthat's good.13:39
gary_posterbac, but a review from you would be appreciated by him and me13:39
bacgary_poster: ok.  i'll add comments to the bug since he didn't use a MP13:41
gary_posterbac, makes sense13:41
baci'm a bit partial, but i think my approach was cleaner.  :)13:42
gary_posterbac, heh, you are probably right :-)13:43
bacgary_poster: so he has committed code but not made a release.  are you still going to make an interim egg and package it in LP?13:46
gary_posterbac, yes, that's what I was thinking.13:51
gmbgary_poster, frankban: Just finishing lunch etc., but I'll be happy to take that review in the next 20 minutes or so.13:53
gary_posterthx gmb13:53
frankbanthanks gmb13:53
frankbangary_poster: when you have a minute, I'd like to discuss about lxc and dns servers13:56
gary_posterack frankban.  should be available in 313:58
frankbanthanks gary_poster13:58
gary_posterfrankban, in https://talkgadget.google.com/hangouts/_/extras/canonical.com/goldenhorde & ready whenever you are14:00
gmbfrankban, Is there a diff for your lpsetup changes somwhere?14:10
frankbangmb: https://code.launchpad.net/~frankban/lpsetup/create-scripts/+merge/10153614:11
gmbTa14:11
bacgmb, frankban: please see my comment on frankban's MP.14:25
gmbbac, I'd already made the same note :)14:26
bacokey dokey14:26
frankbanthanks bac, I've just replied15:03
bacfrankban: we need to agree as a group whether our related work will use the LP style guide or not.  IIRC "launchpad related"  projects have continued to use it.  from a ease-of-programming perspective that is what i would advocate, meaning i'd prefer to have one set of guidelines and use it across projects where practical.  the exception to that rule is for projects that will be community-supported and only have a tangential relationship to LP.15:11
gary_posterbac, frankban, given that lpsetup has PEP 8 everywhere, I'd suggest keeping PEP8 for this MP, with bac raising the issue on the dev list.  Depending on that resolution, we can have a future style-only branch.15:14
gary_posterfor now, let's go with consistency within lpsetup15:14
gary_posterwell, and for the future too; we can switch all at once15:15
bacfrankban, gary_poster: i hadn't reviewed the whole branch and didn't realize that was the case.  our style guide also says "stay consistent with existing code" or something like that.15:17
gary_posterright bac, cool.  still I agree with your assertion that we should collectively agree15:17
gary_posterabout this kind of policy15:18
gary_posterbac, if we have not already agreed...?15:18
bacwith open("worms") as can:15:18
gary_posterheh15:18
bac   colour = random.choice(palette)15:18
bac   paint()15:18
frankban:-)15:19
gmbThere should be a law against people phoning me whilst I'm reviewing.15:19
gary_posterbac, :-)15:20
gmbfrankban, I'm really sorry, I've been looking at this branch for ages and I can't find anything I don't like.15:30
gmbr=me15:30
gmbApologies.15:30
frankbangmb: what a shame :-) however thanks for trying15:31
gmb:)15:31
benjigary_poster: my connectivity looks like it might be back, but it's intermittent; I'm going to take an early lunch and hope that it's stable by the time I'm done15:35
gary_posterbenji ack good luck15:48
benjigary_poster: I take it that I should re-implement our worker tagging test result on top of lp:~jml/testtools/forward-current-tags.  Correct?16:20
gary_posterbenji, yes, that's my suggestion.  Please feel free to argue otherwise, as usual16:21
benjigary_poster: does that mean that it's usual for me to argue?  ;P16:21
gary_posterbenji, :-P no16:22
benjiheh16:22
benjithat looks like a good approach; I'll see where it takes me16:22
gary_postercool thx16:25
gmbgary_poster, It's just been pointed out to me that the first Monday of UDS is a UK national holiday. Is it okay with you if I take the coming Monday (16th) in lieu of it, since I'm going to be swimming the nerd sea on that day?16:55
gary_postergmb, sure, though what is the nerd sea? :-)16:56
gmbgary_poster, The UDS lobby, of course :)16:56
gmb(I hasten to add, it was Jono Bacon's name for it, not mine :))16:56
gmbgary_poster, Thank you. I'll add it in CanonicalAdmin now.16:57
gary_posterlol gmb, cool16:57
gmbAhaha.17:00
* gmb accidentally builds LP tree on Precise.17:00
gmbHilarity ensues.17:00
gary_posterin order to work around an ec2 test problem with lightweight checkouts, I have to specify --pqm-public-location.  Because I'm trying to have fun with sed, I end up with the general command...17:00
gary_posterec2 test --pqm-public-location=`bzr info | sed -e '/push branch/!d' -e '/push branch/s/\s*push branch: //'`17:00
gary_posterevilness is fun17:01
gary_posterso is making a noun into a noun17:01
gmbWow.17:01
gary_posterevilnessitude might be even better17:01
gmbgary_poster, That's disturbingly like something I would do :)17:02
gary_posterheh17:02
gary_posterok, test started, sed played with...17:02
gary_postertime for some lunch17:02
* gmb knocks off for the evening. Night all.17:03
benjinight, gmb17:05
gary_posternight gmb.  approved Monday.17:27
bacgary_poster, with an 8 cpu ec2 machine, should we expect a slave to come up within an hour?17:50
gary_posterbac, give or take.  two hours is usually too long.  You should be able to look at the juju log on the slave instance to see the output of setuplxc17:51
gary_posterbac, I self-approved this, but in case you are curious: https://code.launchpad.net/~gary/launchpad/trivial/+merge/10161918:19
gary_postertests have been running for a couple of hours now.18:19
gary_posterbac, I'd like to get a parallel test run or two or three to see how we are doing.  Did you get one running?18:20
bacmemcache change looks good.  thanks for the thorough documenting18:21
bacgary_poster: i just started one a little bit ago and am waiting for the slave to come up18:21
baci think gmb's script is working now it was just too aggressive in only giving the slave 1 hour to come up18:22
gary_posterbac, memcache: cool, thanks.  waiting for slave: great.  Please lemme know when tests have run: I'd like you to collect the output of testr failing after a test run.18:22
bacgary_poster: will do18:22
gary_posterthanks18:23
bacsadly i don't think my run got your memcache fix18:23
gary_posterno, it won't18:26
bacgary_poster: my attempt failed, at least the automatic part.18:57
gary_posterbac, :-/ how so?18:57
bacwhile waiting for the slave to come up, a call to 'juju status' got18:57
bacCalledProcessError: Command '['juju', 'status']' returned non-zero exit status 118:58
bac2012-04-11 14:47:17,862 INFO Connecting to environment...18:58
bac2012-04-11 14:47:19,807 INFO Connected to environment.18:58
bac[('SSL routines', 'SSL3_READ_BYTES', 'ssl handshake failure')]18:58
bac2012-04-11 14:47:22,699 ERROR [('SSL routines', 'SSL3_READ_BYTES', 'ssl handshake failure')]18:58
bacthis is not uncommon18:58
bacbut, i can manually wait for the slave to come up and force the build by hand18:58
bacit has been up 66 minutes so perhaps it'll be happy soon19:00
gary_posterhm19:02
gary_posterok19:02
bacok, setuplxc is done.  took about 80 minutes19:14
bacgary_poster: you ever see juju status report 'relation-errors'?19:19
bac        relation-errors:19:19
bac          buildbot:19:19
bac          - buildbot-slave19:19
gary_posterbac, rarely, yes19:20
bacwell it is my lucky day19:20
gary_postertrying to think of something helpful....19:20
gary_posterbac, usually the logs are the place I go19:20
bacyeah, i see some stuff in charm.log19:21
bacnothing too informative, though19:22
gary_posterbac, also try master's log19:23
gary_poster/var/lib/buildbot/masters/master/twistd.log19:23
bachmm, at :06 the bb master received SIGTERM and shut itself down19:25
baci don't think the slave was even up yet19:25
baci was able to restart the master by hand19:27
bacand manually started a slave.  go juju go.19:32
bacgary_poster: my hand starting stuff did work.  it looks like the slaves started as the wrong user.19:38
bac /usr/bin/xvfb-run: 181: /var/lib/buildbot/slaves/slave/lucid-devel/build/bin/test: Permission denied19:38
bacwhich confuses me as the log shows:19:39
bacsudo /usr/local/bin/launchpad-lxc-test -t stories/gpg19:39
gary_posterbac, the permission denied with xvfb-run usually indicates a bad command passed to xvfb-run19:50
gary_postercaused by crazy bash escaping19:50
gary_posterwe've had careful escaping to try and prevent this19:50
bacgary_poster: such as where?19:50
gary_posterso, the trigger for the problem is that we are trying to pass an argument with spaces to xvfb-run's -a argument IIRC19:51
bacgary_poster: i'm using stock yellow charms.  are you suggesting it is an error in one of the hooks?19:51
gary_posterbac, no, the problem is arguably in ssh, but we are not fixing that today. :-P .  Today's breakage of the workaround we implemented is in one of these:19:52
gary_posterlaunchpad-lxc-test19:52
gary_posteror lxc-start-ephemeral19:52
gary_posterI don't think there would be another19:52
gary_posterbac, to see a related behavior, change lxc-start-ephemeral to begin with set -ex (IIRC)19:54
gary_posterthat will spit out the commands lxc-start-ephemeral sends19:55
gary_posterbac, could you give me the url of your master19:55
bacgary_poster: looking20:00
bacgary_poster: ec2-23-21-33-127.compute-1.amazonaws.com:801020:01
gary_posterbac, ack.  Maybe we should pair on getting a test run manually tomorrow.  If we run into any problems, you can get a feel for where the bodies are buried20:17
bacgary_poster: that's a good idea20:17
bacif this instance is no good to you i'll tear it down now20:17
gary_posterbac yeah tear down20:21
gary_postersorry for frustrations (and slow turn around; other stuff going on too)20:21
bacok20:22
bacgary_poster: sean says he'll push a new py-memcached tonight20:48
gary_posterbac, heh, ok cool20:48
bactwas the right decision20:49
gary_postercool bac20:49
bacbesides we haven't seen it yet20:49
gary_poster:-) true20:53
gary_posterI also haven't seen my testresults yet...20:54

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!