| SpamapS | Hmm.. weird problem here.. after a successful install hook.. | 00:03 |
|---|---|---|
| SpamapS | http://paste.ubuntu.com/698811/ | 00:03 |
| jimbaker | SpamapS, trying to think where to start there with that (twisted's reactor structure makes such output frequently useless) | 00:14 |
| jimbaker | SpamapS, is it related at all to the bug you just reported (bug 861298)? | 00:15 |
| _mup_ | Bug #861298: libasound2 addition to linaro-x11-base seems suspicious <Linaro Seeds:New> < https://launchpad.net/bugs/861298 > | 00:15 |
| SpamapS | jimbaker: I'm betting that the ZK connection failed for some reason... and it just needs to be handled/reconnected | 00:15 |
| jimbaker | (wrong bug # obviously) | 00:15 |
| SpamapS | jimbaker: same env, but I don't think its related no | 00:15 |
| jimbaker | SpamapS, so is the agent still running on that node? | 00:17 |
| SpamapS | jimbaker: oo, darn, I destroyed the env.. didn't check | 00:18 |
| jimbaker | SpamapS, making agents robust against failure with upstart is something we discussed, i assume it's still not there yet | 00:18 |
| jimbaker | SpamapS, no worries, random failures are easy enough to recreate ;) | 00:19 |
| jimbaker | (of the sort seen here, seriously) | 00:19 |
| SpamapS | jimbaker: I'll report it if I see it again | 00:19 |
| SpamapS | this particular case is a *very* busy nova compute machine | 00:19 |
| SpamapS | so its entirely possible that ZK was overwhelmed or something else weird happened | 00:20 |
| jimbaker | SpamapS, ahh, that will much more likely expose things | 00:20 |
| jimbaker | SpamapS, also i need to review https://code.launchpad.net/~hazmat/txzookeeper/errors-with-path/+merge/77254, this looks good for getting somewhat better info - knowing the actual path is a pretty big signal, especially as we add more nodes | 00:21 |
| SpamapS | +1 for that | 00:22 |
| SpamapS | useful errors was a theme of an entire month of development we did at my last job | 00:22 |
| SpamapS | Because we had so many confused 3 hour pager responses where you spent 3 hours just trying to figure out WTF happened | 00:23 |
| fwereade | jimbaker, SpamapS: upstart is rather critical for orchestra too, I think it's likely to be top of my list as soon as I'm not thinking about the charm store | 00:24 |
| jimbaker | i do wonder if niemeyer is trying to intentionally pun on wtf with the waterfall at http://wtf.labix.org/wtf/ | 00:24 |
| jimbaker | i'm sure he is | 00:24 |
| niemeyer | jimbaker: Yes :-) | 00:24 |
| fwereade | potential recursive acronym, too: WTF Test Failures | 00:26 |
| niemeyer | fwereade: Hah, nice | 00:26 |
| fwereade | niemeyer: if anyone asks, you could say that, and act all mystified -- "does WTF stand for something else as well? goodness me!" | 00:27 |
| niemeyer | fwereade: Totally :- | 00:27 |
| niemeyer | ) | 00:27 |
| jimbaker | biab, i'm going to hang out over at the python in the cloud meetup going on locally in boulder shortly | 00:29 |
| jimbaker | someone will be demoing some sort of python mgmt tool for running apps in ec2 | 00:30 |
| fwereade | niemeyer: ok, I thought I was ready to merge resolve-formula-names (hm, which should be called merge-charm-names) | 00:44 |
| fwereade | niemeyer: then I thought the breaking UI changes might need some documentations | 00:44 |
| fwereade | niemeyer: ...then I thought "NO TIME NO TIME" | 00:45 |
| fwereade | niemeyer: er, opinions? | 00:45 |
| niemeyer | fwereade: Hm | 00:45 |
| niemeyer | fwereade: One thing we definitely have to do is sending a mail to ensemble@ pointing out what is going on, how the interface is changing, and why | 00:46 |
| fwereade | niemeyer: indeed -- shall I try to get that in before the merge? | 00:47 |
| niemeyer | fwereade: Yeah, it feels like a good idea to point to people in sync with the merge | 00:49 |
| niemeyer | fwereade: So that trunk users will get to know about it | 00:49 |
| niemeyer | fwereade: and PPA users in a bit | 00:49 |
| fwereade | niemeyer: ok, I'll write something up now | 00:50 |
| fwereade | niemeyer: still ensemble@lists.ubuntu.com then? | 00:50 |
| hazmat | Talk done!.. wahoo.. | 01:09 |
| hazmat | its very easy to slip up charm/formula | 01:09 |
| niemeyer | jimbaker: and the saga continues.. | 01:17 |
| niemeyer | hazmat: Woohay | 01:17 |
| niemeyer | hazmat: how was it? | 01:17 |
| niemeyer | fwereade: Sorry | 01:21 |
| niemeyer | fwereade: juju@ | 01:21 |
| niemeyer | fwereade: As hazmat just said, easy to slip :) | 01:22 |
| fwereade | niemeyer: absolutely :) | 01:22 |
| fwereade | niemeyer: I wondered if you meant it, because I could swear I signed up to juju@ but still seem to be getting all my mails from ensemble@ | 01:22 |
| niemeyer | fwereade: Hmm.. there's an alias between them so it continues working | 01:24 |
| niemeyer | fwereade: I don't think we should be getting emails from the old address, though | 01:24 |
| fwereade | niemeyer: don't worry about it, I'll double-check, maybe aI got confused around the changeover | 01:25 |
| niemeyer | fwereade: What might be going on is that people (like me!) are still using the old address | 01:28 |
| fwereade | niemeyer: ah, could be | 01:30 |
| jimbaker | niemeyer, the company is opdemand, they are currently demoing wordpress ;) | 01:33 |
| jimbaker | http://www.opdemand.com/ | 01:33 |
| jimbaker | they publish information from one tier to another tier | 01:35 |
| niemeyer | jimbaker: pvt | 01:39 |
| hazmat | ouch just got dissed hard by the opscode (adam) from stage | 01:50 |
| hazmat | idempotency... see me after class | 01:50 |
| niemeyer | hazmat: Very noble of him :-) | 02:01 |
| niemeyer | hazmat: The best answer to a public insult is making juju rock harder | 02:06 |
| _mup_ | juju/env-origin r374 committed by jim.baker@canonical.com | 02:08 |
| _mup_ | Fixed review points | 02:08 |
| _mup_ | juju/env-origin r375 committed by jim.baker@canonical.com | 02:15 |
| _mup_ | Merged trunk | 02:15 |
| jimbaker | oh, i'm glad i just tried running ./test against trunk, the failures are there, not in the merge with env-origin | 05:16 |
| SpamapS | we should rename the juju binary to just jj | 05:19 |
| jimbaker | SpamapS, please don't give anyone any ideas on that ;) | 05:20 |
| jimbaker | SpamapS, i assume you're seeing the same failure as here: http://wtf.labix.org/366/unittests.out.FAILED | 05:21 |
| jimbaker | looks like it was introduced in r365 | 05:23 |
| jimbaker | bcsaller, have you tried looking at trunk since your merge? | 05:23 |
| bcsaller | jimbaker: yeah, its a known issue, sorry. Still trying to get omega in the proper state to merge, it was missing some tests and we know how testing goes... esp. with this level of system interaction | 05:28 |
| jimbaker | bcsaller, ok, thanks for the update | 05:28 |
| bcsaller | jimbaker: it happened because lxc-lib is a prereq to omega but other thing depending on it got merged first | 05:28 |
| jimbaker | bcsaller, ok, makes sense | 05:30 |
| jimbaker | presumably one of these things corrects the ppa name too | 05:30 |
| jimbaker | although i would expect the bridge to the support of juju-origin in my env-origin branch would take care of that regardless | 05:31 |
| bcsaller | jimbaker: it will, but I think I will do that in a subsequent branch, using the ppa to get started with local dev (and fixing trunk tonight) seems fine | 05:33 |
| _mup_ | juju/env-origin r376 committed by jim.baker@canonical.com | 05:35 |
| _mup_ | Merged trunk | 05:35 |
| jimbaker | bcsaller, sounds like a good plan to me | 05:36 |
| bcsaller | cool | 05:36 |
| SpamapS | jimbaker: I don't like typing juju .. its all right index finger.. jj would be a nice shortened version. :) | 05:52 |
| SpamapS | we can just symlink it in the package. :) | 05:52 |
| jimbaker | SpamapS, i wonder if my typing here is canonical - i use index for j, middle for u, so it's not as bad in this case | 05:53 |
| jimbaker | (that's probably a misuse of canonical...) | 05:54 |
| jimbaker | (more like standard i guess) | 05:54 |
| jimbaker | fwereade, is local resolution of charms now broken? | 05:59 |
| jimbaker | i noticed the change to the series, but i'm seeing this on the machine agent | 06:00 |
| jimbaker | fwereade, so i'm seeing this, http://paste.ubuntu.com/698912/ - anyway, i guess it will have to wait until tomorrow, just using irc async here :) | 06:02 |
| jimbaker | SpamapS, apparently my typing is nonstandard. darn. http://en.wikipedia.org/wiki/Touch_typing | 06:07 |
| SpamapS | jimbaker: very nonstandard, I don't even know how you reach u with your middle finger | 06:29 |
| SpamapS | fwereade: one thing about this breakage.. now any version before this is completely broken because the PPA package wants local: prefixed | 06:47 |
| SpamapS | CharmStateNotFound: Charm 'local:hadoop-slave-1' was not found | 06:47 |
| SpamapS | thats not something you mentioned in your email. :-/ | 06:48 |
| _mup_ | juju/env-origin r377 committed by jim.baker@canonical.com | 07:28 |
| _mup_ | Remove tabs in rst file | 07:28 |
| rog | hurray, all tests pass | 09:14 |
| fwereade | rog: belated /cheer | 10:36 |
| rog | :-) | 10:36 |
| rog | my computer made the requisite sound effect when you mentioned my name | 10:37 |
| rog | well ok, it was a sort of bleep, but close enough | 10:37 |
| fwereade | rog: haha, awesome | 10:37 |
| fwereade | SpamapS: hm, I hadn't considered that side effect | 10:49 |
| fwereade | SpamapS: I kinda feel that we're still (just barely) in "developing, expect breakage" mode, and so it's (just barely) acceptable, if annoying | 10:53 |
| fwereade | SpamapS: am I right in thinking that error shows up when you have an env running, you upgrade juju locally, and then try to issue commands to the env running the old version? | 10:54 |
| fwereade | SpamapS: ...or, yes, also if you try to run any older version against the PPA | 10:55 |
| fwereade | SpamapS: is my interpretation sane? | 10:55 |
| _mup_ | Bug #862415 was filed: Juju bootstrap node disappearance <juju:New> < https://launchpad.net/bugs/862415 > | 13:59 |
| _mup_ | Bug #862417 was filed: Cloud Foundry server charm was not found on the instance <cloud> <foundry> <juju:New> < https://launchpad.net/bugs/862417 > | 14:03 |
| _mup_ | Bug #862418 was filed: Add a way to show warning/error messages back to the user <juju:New> < https://launchpad.net/bugs/862418 > | 14:04 |
| _mup_ | Bug #862417 was filed: Cloud Foundry server charm was not found on the instance <cloud> <foundry> <juju:New> < https://launchpad.net/bugs/862417 > | 14:04 |
| lynxman | SpamapS: whenever you're awake, let me know if you have the final juju package for oneiric :) | 14:06 |
| _mup_ | Bug #862422 was filed: Add a "block" add/remove unit hook <juju:New> < https://launchpad.net/bugs/862422 > | 14:07 |
| rog | i can never remember where to create a new issue for code review... | 14:19 |
| rog | is it standard to always create a new branch when making some changes? if i haven't done that, how can i change the branch name? | 14:37 |
| fwereade | rog: depends: if I'm doing a significant chunk of work I'll start by branching, if I'm just (say) addressing a minor review point in an existing branch I'll continue the existing one | 14:39 |
| fwereade | rog: there's a line between them but I find its location varies with my current levels of optimism, forgetfulness, foolishness | 14:40 |
| fwereade | rog: offhand, I'm not sure how best to retroactively branch something without the process being somewhat manual | 14:41 |
| fwereade | rog: you could just bzr diff --old=[revision you wanted to branch from] > somewhere | 14:42 |
| fwereade | rog: bzr revert -r [that revision again] | 14:42 |
| fwereade | rog: bzr commit | 14:42 |
| fwereade | rog: ...and then branch from there and apply the patch | 14:42 |
| fwereade | rog, and everyone else: if there's a better way I'd love to hear it :) | 14:43 |
| rog | at the moment, i'm trying a branch and then a merge with the changes i made in the old branch | 14:43 |
| rog | dunno if it'll work. we'll see. | 14:43 |
| fwereade | rog: I think I tried something like that once, and it went wrong -- if you then revert the parent branch, and *then* merge from it again, I think it'll try to apply your subsequent unchanges | 14:44 |
| fwereade | rog: ...er, if you see what I mean | 14:45 |
| rog | fwereade: hmm, not sure i do. is that something i shouldn't do, or something i will inevitably do? | 14:47 |
| rog | fwereade: it *seems* to have worked | 14:49 |
| rog | except the log history is no longer linear, which might be a problem | 14:49 |
| fwereade | rog: possibly I misunderstood what I did, or what you did | 14:49 |
| rog | i did: cd $HOME/gozk; bzr branch lp:gozk my-upcoming-revision; cd my-upcoming-revision; bzr merge ../zk; bzr commit | 14:50 |
| rog | where $HOME/gozk/zk was the place i'd been doing the edits | 14:50 |
| fwereade | rog: ah, yes, that sounds fine | 14:55 |
| fwereade | rog: I'd been imagining a situation where you'd made several commits already to the wrong branch | 14:55 |
| rog | fwereade: i made commits, but hadn't pushed | 14:56 |
| fwereade | rog: still sounds fine :) | 14:57 |
| rog | cool | 14:57 |
| * fwereade crosses fingers | 14:57 | |
| * rog also crosses his fingers. | 14:58 | |
| hazmat | bcsaller, none of the things that had lxc-lib as a pre-requisite got merged first.. they where using what was already committed to trunk | 15:04 |
| hazmat | lxc-lib-clone changed the api | 15:05 |
| jimbaker | hazmat, yes, that's what we are seeing on wtf.labix.org right now | 15:09 |
| hazmat | jimbaker, it should be okay after lxc-omega gets merged, but breaking trunk isn't | 15:10 |
| jimbaker | hazmat, agreed with that for sure | 15:10 |
| jimbaker | (invariably when trunk is broken and i do a merge, i blame my branch first. goose chase, not productive... anyway, it happens) | 15:11 |
| SpamapS | fwereade: yes, all older versions of juju break when they deploy because they pull from the PPA | 15:17 |
| SpamapS | fwereade: breaking stuff is fine, but telling us about it *well before* committing would be quite helpful. | 15:17 |
| SpamapS | why are we committing to trunk without running the test suite? | 15:18 |
| SpamapS | Every time I've merged one of my little fixes in, I merge and then run the test suite. :-P | 15:19 |
| jimbaker | SpamapS, fwereade, agreed. and announce it here would be nice. the other thing that bit me last night | 15:19 |
| fwereade | SpamapS, jimbaker: I'm sorry, it was entirely wrong to assume anyone else had the faintest idea what I was up to :( | 15:20 |
| fwereade | it never really crossed my mind that niemeyer and I had talked about it lots, but not with everyone | 15:20 |
| jimbaker | fwereade, no worries, just some suggestions to get everyone in the loop first. this channel has its deficiencies, but i poll it much more frequently than email ;) | 15:21 |
| jimbaker | (much more signal for what i immediately need to know) | 15:21 |
| fwereade | jimbaker: definitely | 15:22 |
| SpamapS | At this point nobody can test the packages in 11.10 properly.. it only works by using juju-branch: lp:ubuntu/oneiric/juju but thats not the end of the world | 15:22 |
| SpamapS | The email as great.. and its the only reason I didn't go "WTF!!" right away.. I knew what was up. Its just that the scope of the breakage may not have been fully explored. Given the velocity you all are maintaining, I'm not surprised (or upset :) | 15:23 |
| SpamapS | s/email as/email was/ | 15:23 |
| fwereade | SpamapS: so, the stuff that's currently in 11.10 is old, and therefore broken; I had the impression we were planning to slip in a last-minute update (er... tonight?) with lxc stuff, and origin stuff ...and this stuff | 15:24 |
| fwereade | SpamapS: and that implies the breakage is at least somewhat temporary | 15:25 |
| fwereade | SpamapS: have I misunderstood the plans? | 15:25 |
| SpamapS | we are planning to update again. The point of updating before then though, was to allow testing of what was done up until now. | 15:26 |
| fwereade | SpamapS: indeed :( | 15:27 |
| SpamapS | Don't worry, I totally understand the implications and reasons behind this incompatible change. I'm only frustrated that I pushed so hard to get a somewhat new version in that is totally broken. :-/ | 15:27 |
| SpamapS | "old" is the revision from Monday morning btw. | 15:28 |
| fwereade | SpamapS: and now you're stuck only able to test the moving target that is trunk :( | 15:28 |
| SpamapS | No I can test using juju-branch: | 15:28 |
| fwereade | SpamapS: heh, "old" is everything before this morning :( | 15:28 |
| fwereade | SpamapS: ah, good | 15:28 |
| fwereade | SpamapS: which is to say, "less bad" | 15:29 |
| fwereade | SpamapS: in future I will definitely make sure people know of breaking changes well in advance (if I can't avoid making them at all) | 15:29 |
| fwereade | SpamapS: is there anything I can do to mitigate the pain now? | 15:30 |
| SpamapS | no. :-/ | 15:30 |
| SpamapS | Just git 'er done. :) | 15:30 |
| SpamapS | seriously, ignore my whining.. you all have important work to do. | 15:31 |
| fwereade | yeah, but so do you, and I'm sorry to have disrupted it :( | 15:31 |
| SpamapS | It only means the bugs that I might find now will be found after you're done.. and you'll have more of a time crunch to fix them next week. | 15:32 |
| SpamapS | fwereade: please don't feel guilty in any way. You guys can't stop for every squirrel crossing the road. ;) | 15:33 |
| fwereade | SpamapS: don't worry, I'm neither sobbing nor rending my clothes | 15:34 |
| fwereade | SpamapS: still wish I'd done it differently, but we live and learn ;) | 15:34 |
| jimbaker | fwereade, please no self-flagellation, ok? ;) | 15:35 |
| rog | jimbaker: i've just pushed a new gozk merge request. any comments or feedback welcome. | 15:36 |
| rog | https://code.launchpad.net/~rogpeppe/gozk/update-event-interface/+merge/77560 | 15:36 |
| jimbaker | rog, thanks! | 15:37 |
| robbiew | SpamapS: so basically all charms are broken now, right? | 15:37 |
| * robbiew notes this is why we need juju pulling from the archive at release...not a ppa :/ | 15:37 | |
| robbiew | I realize we need this change to allow for the store to work...which means **WE** will need to fix everyone's charm before release | 15:38 |
| robbiew | not fair to expect authors to go back and do that now, imo | 15:38 |
| robbiew | and apparently there's no legacy support :/ | 15:38 |
| SpamapS | robbiew: all charms and all juju deployments from 11.10 are broken, yes. Tracking in bug 828147 | 15:40 |
| _mup_ | Bug #828147: Ensemble branch option needs to allow for distro pkg, ppa, and source branch install <cloudfoundry:New> <juju:In Progress by jimbaker> <juju (Ubuntu):Triaged by clint-fewbar> < https://launchpad.net/bugs/828147 > | 15:40 |
| robbiew | awesome | 15:41 |
| SpamapS | robbiew: there is a workaround, which is to add 'juju-branch: lp:ubuntu/oneiric/juju' to your environment config | 15:41 |
| jimbaker | robbiew, really hope that branch gets approved soon | 15:42 |
| jimbaker | in terms of env-origin | 15:42 |
| robbiew | jimbaker: that change must get in | 15:42 |
| robbiew | agreed | 15:42 |
| SpamapS | The alternative is to patch the distro version to default to pulling from the distro. I've tried that in a privately built package and it works fine, but the problem is the deployed provisioning agent then still has the distro version deploying from _PPA .. | 15:42 |
| SpamapS | Anyway, the best thing to do is probably to just test from the PPA.. ignore the distro package.. and try to help these guys finish off the work so we can upload "the real juju" ASAP | 15:43 |
| robbiew | agreed | 15:44 |
| robbiew | a hack in the distro is suboptimal | 15:44 |
| SpamapS | worst case.. if something goes horribly wrong and we can't do that.. we can regress the PPA to the distro version and move daily builds to a different PPA. | 15:44 |
| robbiew | if env-origin works, then we can just use that set to the archive, right? | 15:44 |
| jimbaker | fwereade, re robbiew's point - the backwards breaking change seems to be only to change the directory structure. i understand with the juju rename there's been some drastic changes already. but we could make it easier possibly by assuming oneiric | 15:45 |
| SpamapS | robbiew: env-origin is intelligent, and chooses distro when your client version came from the distro | 15:45 |
| robbiew | cool | 15:45 |
| SpamapS | Its probably going to break horribly on OS X tho. :P | 15:45 |
| jimbaker | robbiew, env-origin does the right thing | 15:45 |
| jimbaker | SpamapS, it doesn't know about os x yet | 15:45 |
| SpamapS | jimbaker: it shouldn't really. Serious users will probably be very explicit about their environments.yaml | 15:46 |
| jimbaker | SpamapS, the workaround is to set juju-origin manually | 15:46 |
| jimbaker | SpamapS, agreed | 15:46 |
| jimbaker | SpamapS, it might be something as simple as that for os x/non ubuntu clients, it basically insists that this setting be made | 15:46 |
| SpamapS | Actually I think it should just choose distro at that point. | 15:47 |
| jimbaker | SpamapS, also a reasonable choice | 15:48 |
| SpamapS | hmm.. something's borked with juju-branch too actually | 15:48 |
| SpamapS | Ahh, my AMI's are out of date and couldn't download packages. | 15:49 |
| fwereade | SpamapS, jimbaker: it seems that it would be better to insist on explicit default-series *everywhere* than to special-case non-ubuntu | 15:52 |
| jimbaker | fwereade, certainly a valid point. being clever can surprise | 15:53 |
| fwereade | SpamapS: that would mean everybody had to change their environments.yaml, though, which is maybe too much to expect | 15:53 |
| fwereade | SpamapS, jimbaker: if that would be acceptable, though, it feels like the Right Thing to me | 15:55 |
| robbiew | I guess the big problem we need to resolve is broken existing charms...and getting them fixed asap | 15:56 |
| robbiew | the change is in...and newer charms will be written accordingly | 15:56 |
| robbiew | for example...our much talked about cloudfoundry charm is now broken :/ | 15:57 |
| robbiew | we need that working by release | 15:57 |
| robbiew | and so on | 15:57 |
| fwereade | robbiew, SpamapS: are we saying that *charms* are broken, or that *repositories* are broken? | 15:57 |
| RoAkSoAx | hazmat: ping? | 15:57 |
| jimbaker | fwereade, but as i understand it, the charms are not themselves broken by this change, it's how we refer to them in terms of their repository structure and when deployed? | 15:57 |
| fwereade | jimbaker: that's exactly what I'm fretting about | 15:58 |
| jimbaker | fwereade, exactly | 15:58 |
| fwereade | :) | 15:58 |
| jimbaker | fwereade, i looked at the change in trunk. the sole change to the example charms, which should be reasonable for any other charms, is moving the files around one level | 15:58 |
| jimbaker | (reasonable, as in talking about other charms, that is) | 15:59 |
| fwereade | jimbaker: exactly, I don't believe that any charms are themselves broken | 15:59 |
| robbiew | right....sorry...you are correct | 15:59 |
| fwereade | jimbaker: every repository outside the source tree is, though | 15:59 |
| jimbaker | now there is certainly broken code out there that manages this process | 15:59 |
| jimbaker | so pretty much everyone has their own script to deploy a stack of apps. no one is typing it in again and again | 16:00 |
| jimbaker | that's broken now | 16:00 |
| robbiew | exactly...nothing we can do about that though...sed/awk to the rescue there | 16:00 |
| jimbaker | but a trivial fix to add in the right locator info | 16:00 |
| jimbaker | the only challenge is that it totally sucks when they are deployed | 16:01 |
| fwereade | jimbaker: we discussed defaulting to "local:" when --repository is given, but that causes us more problems down the line | 16:01 |
| robbiew | fwereade: ftr, I'm happy this change has gone in...as we need it for the Charm Collection/store thingy ;) | 16:01 |
| jimbaker | errors are nontransparent, and show up in debug logs | 16:01 |
| fwereade | jimbaker: bad-repo errors, right? | 16:02 |
| jimbaker | fwereade, i forget specifics, i made a paste on this last night | 16:03 |
| fwereade | jimbaker: hopefully "cs:blah/blah not found in repo https://store.juju.ubuntu.com" is reasonably clear? | 16:03 |
| jimbaker | let me see if i can dig it up | 16:03 |
| fwereade | jimbaker: but I suspect it's not so nice if the repo has the wrog structure | 16:03 |
| jimbaker | fwereade, depends on where it is. if from the command line, cool | 16:03 |
| jimbaker | if it is in the debug-log, not so cool | 16:04 |
| jimbaker | way too buried. yes, i will go there. but even for me it's an extra step to ssh in to find what's happening, and i know what i'm looking for | 16:04 |
| fwereade | hm, yes :( | 16:05 |
| jimbaker | there may be some gnashing and wailing and rending and tearing at the cheeks | 16:05 |
| fwereade | jimbaker ...but wait, when are we hitting repositories except from the command line? | 16:06 |
| jimbaker | fwereade, need to dig up this error for you... | 16:07 |
| fwereade | jimbaker: thanks | 16:07 |
| jimbaker | fwereade, lost it. i will have to recreate. hopefully not some dream from last night... | 16:09 |
| fwereade | jimbaker: np, although from my perspective I kinda hope it *is* a dream | 16:11 |
| fwereade | ;) | 16:11 |
| SpamapS | robbiew: the cloudfoundry charms should work w/ the PPA | 16:11 |
| robbiew | SpamapS: cool, thx | 16:12 |
| fwereade | jimbaker: you have reminded me of one possibility, can I get a +1 trivial on http://pastebin.ubuntu.com/699194/ please? | 16:17 |
| jimbaker | fwereade, looking at it now | 16:20 |
| SpamapS | Hey didn't we introduce a schema version or something into ZK so that clients would detect when they are trying to twiddle an incompatible ZK? | 16:20 |
| SpamapS | Seems like this latest formula change woudl be a good time to bump that. | 16:21 |
| jimbaker | fwereade, so basically this covers a bad path | 16:21 |
| fwereade | jimbaker: yep, that's it | 16:21 |
| fwereade | jimbaker: it should just make the error clearer when people try to deploy from an un-upgraded local repo | 16:21 |
| jimbaker | fwereade, well +1, i assume this will not let it get into the bad state i discussed | 16:21 |
| jimbaker | SpamapS, yeah, we have that bit, it would be nice to use in this case. we have the power... | 16:22 |
| fwereade | jimbaker: it won't start or stop anything working, it'll just complain differently | 16:22 |
| jimbaker | fwereade, and i believe more importantly, complain earlier | 16:22 |
| jimbaker | and closer | 16:22 |
| fwereade | SpamapS, jimbaker: oh, blast, I thought that was discussed but not implemented | 16:22 |
| fwereade | jimbaker: indeed | 16:23 |
| jimbaker | fwereade, https://code.launchpad.net/~jimbaker/juju/verify-version/+merge/71559 | 16:23 |
| jimbaker | fwereade, don't worry, i thought i knew what you were working on too | 16:24 |
| robbiew | lol | 16:24 |
| fwereade | haha | 16:24 |
| jimbaker | mostly right, but a few missing, possibly critical bits ;) | 16:24 |
| jimbaker | fwereade, so if you want to make a change to VERSION = 1 in ensemble.state.topology, that sounds like a trivial we might all approve | 16:27 |
| fwereade | jimbaker: was just about to suggest it :) | 16:27 |
| jimbaker | it complains early and close. almost all stuff goes through the topology | 16:28 |
| fwereade | jimbaker: for form's sake: http://pastebin.ubuntu.com/699200/ | 16:28 |
| jimbaker | sounds good, the minimum requirements specified in that comment have been satisfied, so +1 ! | 16:29 |
| fwereade | jimbaker: cheers :) | 16:30 |
| rog | right, i'm off. it's an unseasonably warm and beautiful evening here. the garden calls. see you tomorrow. | 16:39 |
| jimbaker | rog, enjoy! | 16:41 |
| _mup_ | Bug #862415 was filed: Juju bootstrap node disappearance <juju:New> < https://launchpad.net/bugs/862415 > | 16:52 |
| RoAkSoAx | b/win 2 | 16:53 |
| Aram | hello. | 17:00 |
| Aram | will niemeyer be here later? | 17:00 |
| niemeyer | Hallo! | 17:01 |
| Aram | hi! | 17:02 |
| niemeyer | Aram: Hey Aram | 17:03 |
| niemeyer | bcsaller: ping | 17:03 |
| bcsaller | niemeyer: hey | 17:03 |
| niemeyer | bcsaller: Hey! | 17:03 |
| niemeyer | bcsaller: I see the problem not only isn't fixed, but it's getting worse: http://wtf.labix.org/ | 17:04 |
| niemeyer | bcsaller: Can you please revert the change, if you can't make the tests work again? | 17:04 |
| bcsaller | I didn't get the final +1, my branch is ready to merge | 17:04 |
| bcsaller | should be in your email and I pinged kapil about it as well | 17:05 |
| niemeyer | bcsaller: It already has my +1 I think | 17:05 |
| niemeyer | bcsaller: Or is it another branch? | 17:05 |
| bcsaller | you said it needed one more sign off at the end and I made changes for the review and no one ok'd them | 17:05 |
| niemeyer | bcsaller: Yeah, from Kapil specifically | 17:06 |
| bcsaller | yeah | 17:06 |
| niemeyer | bcsaller: Did you talk to him about this already? | 17:08 |
| bcsaller | niemeyer: I pinged him about it this morning but haven't seen him | 17:08 |
| robbiew | he's at a conference today | 17:08 |
| bcsaller | all the tests are passing, I can go and merge it if your ok with that niemeyer | 17:09 |
| niemeyer | bcsaller: Yeah, I think that's the best thing to do | 17:09 |
| niemeyer | bcsaller: Let's invite him for a post-review | 17:10 |
| jimbaker | niemeyer, the env-origin branch is ready for review | 17:11 |
| niemeyer | jimbaker: Cool, I'll check it out | 17:12 |
| jimbaker | niemeyer, thanks | 17:12 |
| _mup_ | Bug #862595 was filed: Provisioning agent and destroy-environment show NoneType not iterable on machine shutdown with Openstack <openstack> <juju:New> < https://launchpad.net/bugs/862595 > | 17:27 |
| HarryPanda | is there anything in place to test charms with Jenkins etc. | 17:27 |
| SpamapS | HarryPanda: jamespage has some preliminary work on that. | 17:30 |
| jimbaker | SpamapS, looks like more txaws issues there with 862595 | 17:32 |
| SpamapS | jimbaker: yeah.. I think that may actually be causing big problems on the provisioning agent.. it doesn't seem to want to provision new instances after that | 17:33 |
| bcsaller | niemeyer: http://wtf.labix.org/ is happy again | 17:34 |
| bcsaller | niemeyer: well, the non-ftests part anyway | 17:34 |
| jimbaker | SpamapS, the provisioning agent certainly doesn't expect errors. i'm not certain what it should be, but just barfing is not one of them | 17:34 |
| jimbaker | bcsaller, those are because of the respository changes, so that's independent | 17:35 |
| jimbaker | SpamapS, ok, that may be overstating it, but it is vulnerable | 17:36 |
| SpamapS | jimbaker: seems like whats happening here is that while the provider has shutdown the machine and changed ZK to remove it, the error has somehow caused the provider to not thing the machine is gone | 17:37 |
| SpamapS | jimbaker: leading to bug 861928 | 17:37 |
| _mup_ | Bug #861928: provisioning agent gets confused when machines are terminated <juju:New> < https://launchpad.net/bugs/861928 > | 17:37 |
| jimbaker | SpamapS, the periodic rescan is supposed to sync it with reality for cases like this, as i understand it, but the changes in aws api impl is presumably making it confused | 17:38 |
| SpamapS | jimbaker: probably because the group is still there | 17:39 |
| jimbaker | SpamapS, you mean the security group per machine? | 17:42 |
| SpamapS | jimbaker: hrm, no its not there | 17:43 |
| SpamapS | seems like there's some order of ops that gets confused by that NoneType iterable error. | 17:44 |
| jimbaker | SpamapS, as a general rule, we expect specific errors from txaws - it looks like it's not catching this TypeError, so it bubbles all the way up to the reactor loop | 17:46 |
| _mup_ | juju/env-origin r378 committed by jim.baker@canonical.com | 17:51 |
| _mup_ | Merged trunk | 17:51 |
| jimbaker | just had an opportunity to see the incompatible juju protocol version in action | 17:57 |
| SpamapS | jimbaker: hah :) | 17:58 |
| jimbaker | it was expected, fortunately... i think the error message could be more helpful on what to do in this case | 18:00 |
| SpamapS | jimbaker: so this does look like nova-api doesn't return the same expected XML after TerminateInstances | 18:03 |
| jimbaker | SpamapS, at the python meetup last night, i think someone mentioned that txaws is using an older version of the aws api. don't know about the truth of this | 18:04 |
| jimbaker | SpamapS, it may have nothing to do here, but supporting multiple apis is tough | 18:05 |
| jimbaker | as usual, we might want to look at boto | 18:06 |
| SpamapS | well in this case, comparing to boto .. boto just returns whatever list was responded with | 18:06 |
| SpamapS | txaws asserts that it has to be id=instancesSet | 18:06 |
| niemeyer | jimbaker: ping | 18:21 |
| jimbaker | niemeyer, hi | 18:21 |
| niemeyer | jimbaker: Hi | 18:21 |
| niemeyer | jimbaker: Please re-read points 3, 4 and 5 | 18:22 |
| niemeyer | jimbaker: and compare to the implementation | 18:22 |
| jimbaker | niemeyer, ok | 18:22 |
| niemeyer | jimbaker: Is there anything missing there? | 18:23 |
| jimbaker | niemeyer, #3 - python-txzookeeper dependency is no longer relevant; #4, it uses the original implementation; #5, there is no attempt to test deb repositories, since they are no longer supported | 18:25 |
| niemeyer | jimbaker: Maybe I'm just missing.. where's that: 3) Otherwise, store the version in a variable, and keep parsing | 18:25 |
| niemeyer | jimbaker: 4) Find the version table, and find the installed version | 18:25 |
| niemeyer | ? | 18:25 |
| jimbaker | niemeyer, ok, i'm referring to the review points. you are referring to a list from irc | 18:26 |
| niemeyer | jimbaker: yeah | 18:26 |
| jimbaker | looking at that now | 18:26 |
| jimbaker | niemeyer, ok, i believe what you are saying here is that 6) refers to the installed version, which was stored earlier in 3), is that correct? | 18:28 |
| niemeyer | 1) Grab the installed version from the "Installed:" line | 18:29 |
| niemeyer | 2) If this is "(none)" return "branch" | 18:30 |
| niemeyer | 3) Otherwise, store the version in a variable, and keep parsing | 18:30 |
| niemeyer | 4) Find the version table, and find the installed version | 18:30 |
| niemeyer | jimbaker: Is there any ambiguity here? | 18:30 |
| jimbaker | niemeyer, correct, there is no ambiguity. the version table has more information than i have assumed, and this parse needs to take it in account | 18:31 |
| niemeyer | jimbaker: Thanks. | 18:31 |
| niemeyer | biab | 18:35 |
| SpamapS | wow.. nova-api's response to TerminateInstances is *completely* different from ec2 | 18:49 |
| jimbaker | i'm feeling sick right now, i will be back later | 18:56 |
| SpamapS | http://pastebin.com/jFDQLrcQ | 18:57 |
| SpamapS | thats ec2's response | 18:57 |
| SpamapS | http://pastebin.com/ZMXwA4MY | 18:57 |
| SpamapS | And that is openstack | 18:57 |
| _mup_ | juju/ftests r5 committed by gustavo@niemeyer.net | 19:31 |
| _mup_ | Removing unused imports. | 19:31 |
| SpamapS | note that bug 862595 is actually pretty serious.. really confuses the provisioning agent. | 19:40 |
| _mup_ | Bug #862595: terminate_instances raises NoneType not iterable on machine shutdown with Openstack <openstack> <juju:Invalid> <txAWS:New> <txaws (Ubuntu):Triaged> < https://launchpad.net/bugs/862595 > | 19:40 |
| SpamapS | hazmat: when you're around, if you can ack the merge proposal against txaws .. I will patch it into the Ubuntu txaws | 19:41 |
| robbiew | bcsaller: free for a catch up call? | 19:50 |
| bcsaller | robbiew: I was just sitting down to lunch, can we push it a little bit? | 19:54 |
| robbiew | bcsaller: absolutely not! | 19:55 |
| robbiew | lol | 19:55 |
| robbiew | sure | 19:55 |
| bcsaller | thanks | 19:55 |
| bcsaller | robbiew: free when you are | 20:15 |
| _mup_ | juju/ftests r6 committed by gustavo@niemeyer.net | 20:15 |
| _mup_ | Reverse the order of revisions and link them to Launchpad. | 20:15 |
| robbiew | bcsaller: cool...need 5min | 20:23 |
| robbiew | bcsaller: g+, phone, skype, mumble...pick yer poison :) | 20:27 |
| bcsaller | robbiew: sent g+ invite | 20:28 |
| robbiew | bcsaller: cool...one sec | 20:28 |
| _mup_ | juju/ftests r7 committed by gustavo@niemeyer.net | 21:05 |
| _mup_ | Move environments.yaml creation into the ec2 suite, and | 21:05 |
| _mup_ | make it use trunk rather than packages, so that the code | 21:05 |
| _mup_ | has better chances of being in sync. Hopefully this fix | 21:05 |
| _mup_ | the current breakage. | 21:05 |
| _mup_ | juju/trunk r370 committed by gustavo@niemeyer.net | 21:12 |
| _mup_ | Rename readme.txt to README since we already have one of those. [trivial] | 21:12 |
| _mup_ | But really, this is just bumping the revno for an ftest cycle. :-) | 21:12 |
| * hazmat catches up | 21:16 | |
| niemeyer | Hah.. missed the URLs | 21:19 |
| niemeyer | hazmat: YO! | 21:19 |
| hazmat | niemeyer, greetings hows your conference? | 21:20 |
| hazmat | SpamapS, which merge proposal? | 21:20 |
| niemeyer | hazmat: Awesome! Delighted to see everyone here, even though has been a bit tough to be in and out, and still need to do my talk for tomorrow | 21:20 |
| niemeyer | hazmat: Fixing the ftests now.. | 21:21 |
| niemeyer | hazmat: Hey, I had made a comment on bcsaller's review to invite you for one last look on lxc-omega before the merge since there were a few things since your last review | 21:21 |
| niemeyer | hazmat: But tests were broken in trunk, so we decided to move on with it | 21:21 |
| hazmat | niemeyer, yeah.. saw that.. i'll have a last look at the commit | 21:22 |
| niemeyer | hazmat: If possible, would you mind to do a post-review on this once you have some spare time? | 21:22 |
| niemeyer | hazmat: Cheers! | 21:22 |
| _mup_ | juju/ftests r8 committed by gustavo@niemeyer.net | 21:24 |
| _mup_ | Forgot to update the ec2 tests to use local: urls (!). | 21:24 |
| === robbiew is now known as robbiew-afk | ||
| hazmat | SpamapS, +1 on the terminate fix | 21:29 |
| SpamapS | hazmat: cool thanks! | 21:35 |
| jamespage | SpamapS: zookeeper -> upstart transition - next release right? | 21:36 |
| jamespage | or do we want that now? | 21:36 |
| SpamapS | jamespage: yes next release :) | 21:36 |
| jamespage | coolio | 21:36 |
| jamespage | should be pretty easy | 21:36 |
| SpamapS | jamespage: agreed | 21:36 |
| SpamapS | jamespage: we should be able to do it in Debian so we don't have a permanent delta | 21:36 |
| jamespage | we should be able to - I need todo the tomcat's as well in the same way | 21:37 |
| hazmat | 3.4 release of zk is going to require some packaging love for next release, the build system is a bit different afaicr | 21:37 |
| * jamespage sighs | 21:38 | |
| jamespage | better take a look a trunk sooner rather than later then... | 21:38 |
| SpamapS | indeed, would be good to get that going into experimental soon | 21:39 |
| jamespage | yeah - that had crossed my mind | 21:42 |
| jamespage | meh - looks much the same to me | 21:43 |
| jamespage | I'll have a go at an new upstream release for experimental some time in the next few weeks | 21:43 |
| SpamapS | well anyway, time to run off to the urgent care to take care of this pinkeye.. grubby filthy things those kids are. | 21:43 |
| jamespage | hehe | 21:43 |
| hazmat | bcsaller, i see one bug in the omega merge to trunk | 21:59 |
| bcsaller | hazmat: whats that | 22:00 |
| hazmat | bcsaller, on the merge proposal | 22:00 |
| hazmat | bcsaller, its referencing self.master_template.. which is undefined, so it won't work if you don't already have one | 22:00 |
| hazmat | here's my diff to fix that as well as other style issues, http://paste.ubuntu.com/699361/ | 22:01 |
| bcsaller | I'll fix it, thanks, well spotted | 22:01 |
| bcsaller | hazmat: I'll go ahead and merge that as a trivial then I guess | 22:05 |
| _mup_ | juju/ftests r9 committed by gustavo@niemeyer.net | 22:17 |
| _mup_ | Show what the wordpress title seems to be. | 22:17 |
| _mup_ | juju/ftests r10 committed by gustavo@niemeyer.net | 23:00 |
| _mup_ | Fixed title extraction. | 23:00 |
| hazmat | niemeyer, jimbaker, bcsaller can i get a +1 on this trivial http://paste.ubuntu.com/699361/ | 23:08 |
| hazmat | actuall | 23:08 |
| hazmat | nevermind | 23:08 |
| hazmat | i'll incorporate into my next branch | 23:08 |
| bcsaller | hazmat: I think that was already merged as a trivial | 23:09 |
| hazmat | bcsaller, ah.. cool.. wasn't sure since there wasn't any mup noise | 23:10 |
| hazmat | it would be nice if mup could directly monitor the repo | 23:10 |
| hazmat | niemeyer, thanks for the email btw | 23:20 |
| niemeyer | hazmat: No problem | 23:20 |
| hazmat | niemeyer, was talking to some of the heroku guys on how they do multi-tenant with lxc last night, they basically dictate to the process which port to listen on | 23:21 |
| hazmat | niemeyer, this conference is pretty awesome btw for ops stuff, we should have some more people here | 23:22 |
| hazmat | hopefully they'll get videos up in timely fashion this year | 23:22 |
| niemeyer | hazmat: Interesting | 23:23 |
| _mup_ | juju/env-origin r379 committed by jim.baker@canonical.com | 23:42 |
| _mup_ | Properly parse version table of apt-cache policy | 23:42 |
| _mup_ | juju/env-origin r380 committed by jim.baker@canonical.com | 23:47 |
| _mup_ | Merged trunk | 23:47 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!