[01:03] cherylj: ping [01:03] 10:03 < davecheney> cherylj: what's the status of 1.25.4 ? [01:03] 10:04 < davecheney> i'm building up a lot of chagnes on master that should be backported to 1.25 [01:04] davecheney: I think you should prepare the changes for 1.25 branch [01:04] the question becomes whether to do one or many [01:04] davecheney: I hear zfs works real well with lxd [01:07] thumper: should I land what I have now? [01:07] when is 1.25.4 coming out ? [01:07] davecheney: I think some of these connection type issues are needing to be fixed in 1.25 too [01:07] so yes, I think you should be landing these changes on 1.25 too [01:08] anastasiamac: thanks for review, please see my response to your issue before I go ahead [01:08] sweeet master is bless [01:09] perrito666: I hope you kicked off all your merges before you announced that [01:09] axw: no pending merges from me :) [01:09] perrito666: :p [01:12] davecheney, cherylj is out for the evening === alexisb is now known as alexisb-afk [01:17] Bug #1491399 changed: TestInstallMongodServiceExists fails on centos [01:17] Bug #1494726 changed: TestGetUsesCache different mime-type centos [01:20] Bug #1491399 opened: TestInstallMongodServiceExists fails on centos [01:20] Bug #1494726 opened: TestGetUsesCache different mime-type centos [01:23] Bug #1491399 changed: TestInstallMongodServiceExists fails on centos [01:23] Bug #1494726 changed: TestGetUsesCache different mime-type centos [01:25] alexisb-afk: ahh, thanks [01:27] thumper: do we have a error.Causes checker ? [01:27] ie, rather than writing [01:27] errors.Cause(err), gc.Equals, ....) [01:27] can wr write [01:28] I don't think so... [01:28] err, gc.Causes, expected [01:28] i thought you were talking about adding htat way back when [01:28] there is jc.Satisfies [01:28] that checks type [01:28] I'm not sure if that looks at the cause [01:28] which isn't close enough [01:28] pretty sure we don't [01:29] but could be useful [01:29] anyway, i have got my branch to the point that we dont' have to add all that 'request error: ' prefix nonsense [01:29] cool [01:29] which is the whole reason params.ClientError existed -- to filter that out [01:29] now we have *rpc.RequestError as a type, properly annotated all the way back out to the caller [01:31] :) [01:33] thumper: [01:33] - c.Assert(err, gc.ErrorMatches, "permission denied") [01:33] + c.Assert(errors.Cause(err), gc.Equals, &rpc.RequestError{ [01:33] + Message: "permission denied", [01:33] + Code: "unauthorized access", [01:33] + }) [01:34] nice [01:34] ... [01:34] but begs for some new checkers [01:34] c.Assert(err, blah.IsUnauthorized) [01:36] lets see how big the diff is [01:36] i dont want to change more than I have to to backport this to 1.2 [01:36] i dont want to change more than I have to to backport this to 1.25 [01:38] k [01:51] yeah, this attempt is generating a much smaller diff [01:53] Bug # changed: 1497355, 1508585, 1510951, 1514877, 1534201, 1536425, 1536426, 1539656, 1542336, 1543178, 1543189, 1543193 [01:56] Bug # opened: 1497355, 1508585, 1510951, 1514877, 1534201, 1536425, 1536426, 1539656, 1542336, 1543178, 1543189, 1543193 === natefinch-afk is now known as natefinch [01:59] Bug # changed: 1497355, 1508585, 1510951, 1514877, 1534201, 1536425, 1536426, 1539656, 1542336, 1543178, 1543189, 1543193 [02:02] Bug #1538868 changed: kill-controller failed: sudo: switch: command not found [02:02] Bug #1541473 changed: ensure-availability brings down the state-server [02:02] Bug #1543216 changed: EOF uploading charm [02:04] cherylj: hrm. still hasn't run :( [02:04] cherylj: is there a queue somewhere i can look at? [02:08] Bug #1538868 opened: kill-controller failed: sudo: switch: command not found [02:08] Bug #1541473 opened: ensure-availability brings down the state-server [02:08] Bug #1543216 opened: EOF uploading charm [02:09] tych0: we've been busy testing master [02:10] wallyworld_: sorry, I forgot to look at your branch earlier. it's ready to ship now [02:10] tych0: now that we're releasing alpha2, CI should pick up other branches [02:10] axw: np, ty. i've been caught up in other things [02:10] cherylj: ah, ok, cool. [02:11] davecheney: we will probably be doing 1.25.4 after 2.0-beta1. So, sometime the week of Feb-22 [02:18] Bug #1538868 changed: kill-controller failed: sudo: switch: command not found [02:18] Bug #1541473 changed: ensure-availability brings down the state-server [02:18] Bug #1543216 changed: EOF uploading charm [02:19] axw: u r all good to go! HUGE thank you for this PR \o/ [02:19] anastasiamac: thanks, accounts.yaml on its way (basically just a sed command, for real) [02:19] anastasiamac: also, your PRs are reviewed [02:20] axw: u r amazing \o/ tyvm! [02:21] Bug #1538868 opened: kill-controller failed: sudo: switch: command not found [02:21] Bug #1541473 opened: ensure-availability brings down the state-server [02:21] Bug #1543216 opened: EOF uploading charm [02:22] axw: about show-contoller not showing last model... would be nicer to show all models for this controller with indication of current? [02:22] anastasiamac: I think both would be good actually [02:23] axw: excellent \o/ i agree :D [02:24] Bug #1538868 changed: kill-controller failed: sudo: switch: command not found [02:24] Bug #1541473 changed: ensure-availability brings down the state-server [02:24] Bug #1543216 changed: EOF uploading charm [02:26] wallyworld_: I'll fix your comments in my next branch for accounts [02:26] fix/address [02:26] np ata ll [02:41] wallyworld_: when you remove the api-info command, can you please remove ModelCommandBase.ConnectionEndpoint (if you haven't already) [02:41] yup [02:42] axw: i'm waiting to merge your work and then will deal with the inevitable conflicts etc [02:42] wallyworld_: ok [02:43] cherylj: ok, i'll work hard to get all my fixes backported before then [02:46] wallyworld_: axw: list-controllers output in spec shows "-" for not-currently-logged-in... AFAIK there is no precedence, can I just leave the column cell empty or is "-" highly desired? [02:47] * wallyworld_ checks the spec [02:48] p 9 (of 13) [02:48] anastasiamac: I kinda like "-", but prefer consistency [02:48] axw: we can start consistency from here, if it's preferred :D [02:49] "-" is for currently logged in [02:49] not not currently logged in [02:49] right? [02:49] and * is for default [02:49] wallyworld_: USER and MODEL columns [02:50] ah [02:50] wallyworld_: the prefix - is not consistent [02:50] wallyworld_: and list-model uses * suffix to indicate current [02:50] "-" is for the active controller [02:51] you can be logged into more than one [02:51] but only one is active [02:51] wallyworld_: axw and I *thought* *suffix would be nice for active controller too [02:51] how to we denote the default one in that case? [02:52] i agree that we should be consistent [02:52] wallyworld_: we're talking about the "-" in columns that have no value [02:52] wallyworld_: separately, there is some inconsistency in the spec w.r.t. using - vs * for active [02:52] I think we settled on using * as a suffix [02:52] yes :-( [02:52] ok [02:53] wallyworld_: axw: http://pastebin.ubuntu.com/15013438/ [02:53] i must admit, i would like to see "-" for empty region too :-) [02:54] when in doubt, i think we adhere to spec (use "-" for model/user) and ask for feedback [02:54] wallyworld_: yes, I think we should b consistent from now on to show "-" for empty in cmd output :D [02:55] wallyworld_: axw: from the pastebin above, *suffix may be obscured by long names... [02:55] wallyworld_ anastasiamac: added AccountStore [02:55] https://github.com/juju/juju/pull/4379/ [02:55] \o/ [02:55] axw: u r powering thru this \o/ [02:55] anastasiamac: a simple sed command [02:56] :) [02:56] axw: all simple things r ingenious :P [02:57] Bug # changed: 1382274, 1468972, 1497802, 1511659, 1515289, 1533275, 1533896, 1535165, 1536378, 1537717, 1540701, 1542510 [02:58] in your current work, we are moving away from separate current-controller and current-model files right? [02:58] wallyworld_: this is what it looks like form axw's recent PRs \o/ [02:59] wallyworld_: for now we still have current-controller, but current-model will be no more [02:59] great, i only skimmed, just wanted to check :-) [02:59] anastasiamac: ^ [02:59] we can add current-controller to controllers.yaml too though? [02:59] i think so [03:00] Bug # opened: 1382274, 1468972, 1497802, 1511659, 1515289, 1533275, 1533896, 1535165, 1536378, 1537717, 1540701, 1542510 [03:00] axw: although, that embeds user state in that file [03:01] so not sure. makes sense for models file as that's a cache [03:01] wallyworld_: true. and you'd (probably) never share accounts.yaml. [03:02] yes, i was thinking about accounts.yaml too and think i came to the same conclusion that it's ok to put current account in there, but still am not 100% [03:02] i can see a case for a current-ccount file [03:02] wallyworld_: it'll need to be a per-controller file [03:03] true, so in that case, ok as is probably [03:03] Bug # changed: 1382274, 1468972, 1497802, 1511659, 1515289, 1533275, 1533896, 1535165, 1536378, 1537717, 1540701, 1542510 [03:04] axw: wallyworld_: could we plz update blueprint with all files we are unravelling? :P [03:04] one day [03:04] the files are in the spec [03:04] i don't want to duplicate info [03:04] the blueprint should just refer to the spec [03:05] we should have separate as-built doco [03:05] but that's not for the blueprint, we should have that stuff elsewhere [03:05] we're not good at doing that though :-( [03:05] the blue print can refer to the as-built doc [03:06] the blueprint is more to track progess the way we're using it [03:06] wallyworld_: also to communicate with QA [03:07] wallyworld_: this info can b the backbone of Release Notes [03:07] there needs to be separate doc for that IMO - a proper test plan [03:07] wallyworld_: that we tend to write *after* the effect [03:07] file implementation detail is not for release notes [03:08] wallyworld_: \o/ proper test plan would b amazing! [03:08] when and who would do it? [03:08] all the people we don't have :-( [03:08] should be done as the feature is planned, post one page spec [03:08] file implementation detail is not but what files to expect may b of interest to QA [03:08] sure, but that's not what we are using blueprints for [03:09] the spec in this case has the file detail [03:09] but it's not detailed enough for QA - we need a test plan [03:10] wish there were more hours in a day [03:10] wallyworld_: i agree, jeez, a lot of planning and definition needs to happen after one pager :D Test Plans, Acceptance Criteria, Task break down [03:10] indeed [03:10] we do the task breakdown [03:10] wish we had a dedicated resource... :))) [03:10] yes :-( [03:11] wallyworld_: https://www.youtube.com/watch?v=Dj3GH5myc3M [03:11] rotflmao [03:12] you look nothing like a donkey [03:12] are you saying i am an ogre [03:13] wallyworld_: not everything needs to be read literally (just btw the lines) :P [03:13] i know, just going along with the theme [03:13] :)) i know u know [03:17] wallyworld_: a smaller, easier one: http://reviews.vapour.ws/r/3823/ [03:17] looking [03:17] so we don't need to change crap that can just be deleted [03:18] +1 to that [03:18] +2 [03:20] axw: there may be some nuggets in api_test that need to be retain i suspect? [03:20] or at least re-homed [03:21] wallyworld_: the file's not gone, the branch is conflicted so it doesn't show up on RB [03:21] wallyworld_: will fix in a sec, look on GitHub in the mean time please [03:21] ok [03:35] wallyworld_: so once controllers, models, accounts are all in, what else are you waiting on? [03:35] wallyworld_: are you doing the changes to pass controller/model name through, or am I? [03:35] pass through to API conn opening code that is [03:36] i was working to eliminate cache.yaml [03:36] remove bootstrap config etc [03:36] and not write controller addresses, accounts etc [03:36] you could do the work to pass in controller/model first [03:37] i am currently adding private-key to joyent [03:37] * thumper headdesks [03:37] but the credentials stuff needs to pass in the optional attr [03:37] wallyworld_: seems like something you'd do at the same time [03:37] ok, np, i can do do, need to look at the code again [03:37] wallyworld_: that's why I don't want it to be a separate attr, but a flag on the attr that allows you to specify a file [03:38] wallyworld_: I'm happy to do it, just not sure how far into it you are [03:38] the joyent stuff? [03:38] just started looking [03:38] so you can do that if you want [03:38] wallyworld_: no, the API stuff [03:39] i have a branch that i started that has a shit tonne of changes, but many will be conflicting with your recent work; i think it just needs to be discarded [03:39] so you could look to do that next bit while you're on a roll in the area [03:41] wallyworld_: ok. if I can, I'll leave stuff to be done in parallel [03:41] axw: what i can do first if you want is remove the bootstrap config stuff [03:41] that won't conflict too much [03:41] wallyworld_: that would be good [03:42] axw: in the interim, did you want to add that fromfile attr to credentials schema? CI needs it [03:42] as they like to use the private-key directly [03:42] wallyworld_: ok, I'll take a lok [03:42] look* [03:42] ok, ty [03:45] axw: damn, such a long queue waiting to land, hopefully your account store is not at the end [03:46] wallyworld_: maybe just pull my branch down and work off that? [03:46] wallyworld_: actually you shouldn't need it [03:46] if you're just removing bootstrap bits [03:47] might go a bit further depending. wil grab a bite to eat [03:50] /me is surprised thumper's desk is still standing [04:02] thumper: PTAL [04:02] https://github.com/juju/juju/pull/4361 [04:02] totally redone and made much simpler [04:03] no reviewboard link im afraid [04:08] hmm... I wonder why no reviewboard [04:14] 'cos I closed the old review [04:14] removed the link from the description [04:14] but rb didn't add a new one [04:33] bootstrapping [04:33] is [04:33] soooo [04:33] slow [04:33] * davecheney drums fingers while some huge file is uuencoded, sent to the remote bash at a few kb / sec [04:37] thumper: if this bootstrap works [04:37] are you find with me to JFDI this fix onto master [04:37] then I'll roll up a big backport patch for 1.25 [04:37] which fix is this? [04:37] the error stuff? [04:38] https://github.com/juju/juju/pull/4361 [04:38] this is all the groudnwork I think we need to implement retrying on all API requests [04:42] davecheney: yes [04:45] axw: the preferIPv6 flag is used to sort the host api addresses so that ipv6 appear first because we start at the top of the list and try each in turn [04:45] * thumper is off now [04:45] wallyworld_: I understand how, but not why [04:46] wallyworld_: if we're trying them all, why does it matter...? [04:46] because we will take the first one we connect to i think [04:47] connect to successfully [04:48] wallyworld_: yep... why does that matter? :) [04:49] not sure, but i assume this has come from stakeholders who want juju to connect to ipv6 if at all possible [04:49] wallyworld_: I *think* it might be because api-endpoints prints out the last-connected-to address, and someone was relying on that being v4/v6 [04:49] yeah, not sure either [05:37] wallyworld_: no rush, but joyent change is here: http://reviews.vapour.ws/r/3827/ [05:37] wallyworld_: not tested because I have no account, but there's a unit test un the cloud package [05:38] axw: awesome, ty. have almost finished unpicking the change from my conflicted branch that i want to keep, have tests to fix. btw you can get joyent creds from cloud-city repo [05:38] changes [05:38] wallyworld_: cool [05:39] wallyworld_: yeah, being lazy. I'm pretty sure it's ok. [05:48] axw: lgtm [05:49] wallyworld_: ta [05:49] wallyworld_: it's a bit more than immediately necessary, but my intention is to add things like this into environschema [05:49] yep, i like it [05:51] fark so many failing tests to fix :-( i hate tests that compare log lines === \b is now known as benonsoftware [05:52] axw: remind me - restore will be broken with the current cloud-credentials branch i think you said? [05:52] wallyworld_: correct [05:53] axw: we'll need to fix that if we want to get this branch into master for beta1. is that something you could look at next rather than the next round of feature work [05:54] wallyworld_: ok [05:54] ta, i can't recall the scope of the problem offhand [05:54] hopefully not too major [05:55] wallyworld_: https://github.com/juju/juju/blob/cloud-credentials/cmd/juju/backups/restore.go#L133 [05:55] ah yes that's right [05:57] wallyworld_: I'm assigning 5 points to that, sound reasonable? [05:58] think so, or 8 if it turn ulgy [05:59] axw: as a drive by, could you also change the version to "delta1" so that the QA guys can target the new scripts [06:00] wallyworld_: delta? not beta? [06:00] axw: master is beta1, we need something different for this feature branch just as the new scripts are being tested [06:00] wallyworld_: ok [06:00] we will change back to beta1 prior to merge [06:51] wat? [06:51] "github.com/juju/juju/apiserver/testing" [06:51] apiservertesting "github.com/juju/juju/apiserver/testing" [06:54] :) my fav so far is "gitjujutesting" [07:54] why do we have juju/api, the client [07:54] and [07:54] juju/apiserver/client ... ? [08:07] wallyworld_: the restore-rebootstrap code is broken in general. I propose we delete it. [08:08] wallyworld_: ... and just require people to bootstrap-then-restore [08:09] wallyworld_: (BTW, CI is not using this code path AFAICS) [09:10] dimitern, voidspace, dooferlad: I'm back in the land of the living \o/ [09:11] dimitern, voidspace, dooferlad: and this (http://reports.vapour.ws/releases/3596) tells me maas-spaces is blessed. \o/ \o/ \o/ [09:11] dimitern, voidspace, dooferlad: nice work! [09:14] frobware: double yay! [09:14] \o/ [09:19] frobware, hey! welcome back! :) [09:19] frobware, oh yeah! we're merging today [09:43] dimitern, frobware: some comments on the extra bindings stuff but I think it will fulfill our requirements [09:43] jamespage, awesome! tyvm [09:44] jamespage, thanks. I think your "is this a list" can be answered by the "Future extensions" section [09:44] frobware, ack - i see [09:44] frobware, you can't hear me apparently [09:44] jamespage, I was just typing that when your ^ message arrived. :) [09:44] one comment on the network-get use for extra-bindings - feels odd with just the name but that might be just me [09:44] dimitern, nope. problem is definitely at my end. [09:45] frobware, I can hear you fine though [09:47] morning folks o/ [09:55] TheMue: o/ [09:55] dimitern: so, I'm building a function that builds a map of spaces from maas name -> SpaceInfo [09:56] dimitern: we *could* use that in maasEnviron.Spaces to set ProviderId as well as Name [09:56] dimitern: shall I do that in my branch or leave it for a follow up? [09:57] dimitern: (we still need the space name from MAAS here so we can generate a juju name) [09:59] voidspace, let's chat during standup [09:59] dimitern: kk [11:07] frobware, fyi, here's how I tested: http://paste.ubuntu.com/15015446/ [11:10] dimitern, do you currently see any failures with what's on maas-spaces now? [11:11] frobware, yes, that's the base line - about 10 out of 50, the one with the patch is running now [11:11] dimitern, can you pastebin the patch [11:12] frobware, http://paste.ubuntu.com/15015467/ [11:12] voidspace, ^^ that's what you meant, right? [11:12] dimitern, ty [11:14] frobware, with the patch I can see the forked processes running almost in sync [11:15] dimitern, and which version of Go are you using? [11:16] frobware, on first glance - fewer failures: 7 out of 50, but in reality less than 5 due to TestLoginsDuringUpgrade - the rest are mongo panics and other similar [11:17] frobware, go version go1.6rc2 linux/amd64 [11:19] dimitern, so I initially tried with loop(1..5). I got one failure. What's the failure message to look for without the patch? [11:19] dimitern, upgradeSuite.TestLoginsDuringUpgrade? [11:21] frobware, usually upgrade_test.go:316: [11:23] frobware, actually with the patch it's always that same line - without it occasionally lines 138 or 129 fail as well [11:24] dimitern, so it fails with the patch too? [11:25] frobware, it does, but about less than half of the unpatched runs [11:26] s/of/compared to [11:26] dimitern, so not a slam dunk in terms of landing this before merging maas-spaces back into master... [11:27] dimitern, just trying to assess the risk of landing this change vis-a-vis merging what we have [11:27] frobware, I still think landing as is ok atm [12:08] axw: sounds ok to me, sorry i was at soccer. if it didn't work anyway, then no point keeping it [12:21] dimitern: not really [12:21] dimitern: just the changes lines 28-29 in that diff are sufficient [12:21] dimitern: the other changes are fine too I guess [12:24] voidspace, cheers [12:25] * dimitern just realized we haven't tried maas-spaces on maas 1.10 - yet another maas to setup (mostly done anyway) [12:33] dimitern, voidspace, dooferlad: I plan to postpone the release note sync. any objections? [12:33] frobware, +1 [12:40] cool === lazypower|travel is now known as lazyPower [13:09] dimitern: heh, so the spaces endpoint isn't implemented in the gomaasapi test server [13:09] dimitern: so looks like I'm diverting into that [13:12] voidspace, yeah, unfortunately, but it can be worked around [13:12] voidspace, like what I did for the interfaces [13:12] dimitern: well, I can patch out the function - but then that code isn't tested [13:13] voidspace, the parsing can be tested given a maasObject [13:13] dimitern: well yes, but it still leaves untested code [13:13] voidspace, but at this point it's better to do it properly and start tackling the piling gomaasapi changes we need [13:14] dimitern: so you're saying I should implement spaces for gomaasapi? [13:14] it's not hard [13:14] voidspace, yeah, exactly [13:14] dimitern: cool [13:21] dimitern, so I tested a bit, with/without the patch and looping(1..5) - failure rate seems identical. [13:21] voidspace, ^^ [13:22] frobware: dimitern: The change is still good, but may not be the root issue for this test. [13:22] voidspace, yeah, we should separate the two. patch good, but there's something else too. [13:22] frobware: dimitern: I haven't had a chance to look at the test, but I suspect if it's just trying to login after upgrade and it hits a discovery in progress error it need to try again (in a short attempt loop) [13:25] frobware: hmm, it's in a LongAttemptLoop [13:25] frobware: what's the full failure message please [13:26] voidspace, bear with - I'll pastebin a failure. [13:26] frobware: ah, during discovery api.Open will fail - so line 316 should be "return err" not an Assert [13:26] dimitern: ^^ [13:27] dimitern: that should fix it [13:28] voidspace, hmm possibly, yeah [13:29] dimitern: I'm pretty sure - I hit that in writing the code/tests for limitLogins [13:29] because we're preventing login, not returning a restricted api [13:30] you should see very similar code in the machine_test.go for limited logins during space discovery [13:30] api.Open returns an error until discovery is completed [13:31] and it's intermittent because it's timing related - there's only an error if the login attempt is in the short window whilst discovery is in progress [13:33] voidspace, sounds good [13:33] voidspace, and we do have another test to check that client logins are blocked while agent logins are not? [13:35] dimitern: yes [13:35] dimitern: the test tries to login as a user - that fails with the right error message [13:35] dimitern: then it checks it *can* login as the local machine and that succeeds [13:35] dimitern: then after discovery completes the client login succeeds [13:36] voidspace, sweet! [13:38] voidspace, http://pastebin.ubuntu.com/15016031/ [13:40] frobware: in featuretest/upgrade_test.go change line 316 from c.Assert to "if err != nil { return err}" [13:40] frobware: it *should* pass more reliably then [13:41] the real commit should have a comment too I guess that api.Open can fail if discovery is still in progress [13:41] and it should be *with* dimitern's fix to prevent deadlock [13:41] voidspace, ok - funnily enough I just got 3 successful runs ... hence why it took a while to pastebin. :) [13:54] voidspace, oh-la-la. I'm now out of disk space, so the tests are failing... Grrr. [13:55] voidspace, looks like mongo is leaving stuff in /tmp. Approximately 5GBs worth. :( [13:55] nice [13:58] * voidspace lunch [13:58] voidspace, I need to go eat too. bbiab. [14:59] frobware, dooferlad, voidspace, guys, I've prepared the merge PR: https://github.com/juju/juju/pull/4392 and I'll leave you to your judgment, but now's the best time to get it in [15:00] * dimitern goes to get some rest (off tomorrow btw) [15:02] ericsnow: standup time === alexisb-afk is now known as alexisb [15:32] frobware: I say ShipIt [15:32] voidspace, sure? ;) [15:32] voidspace, the err check instead of assert makes a diff. [15:34] frobware: does? [15:35] cherylj: ping [15:35] voidspace, yes. just double-checking because the tests leave /tmp/test-mgo* files around so can't run it for a long time. Just working around that atm. [15:35] frobware: cool [15:35] frobware: I can do that on master with the potential deadlock fix [15:35] after maas-spaces lands [15:36] voidspace, agreed. but give me 20 mins, as I'm part way through this already. [15:36] frobware: it will take that long to land maas-spaces anyway I think, waiting on cherylj to give the ndo [15:36] voidspace, btw, we just got a maas-spaces cursed build. [15:36] *nod even [15:38] cherylj, we have a both a blessed and cursed maas-spaces build. Choose your poison. :) [15:38] cherylj: frobware: leadership (uniter) tests failed in attempt 291 but succeeded in 292 [15:38] (trusty unit tests) [15:39] that was the only failure [15:49] frobware, cherylj are we need a CI on MAAS Spaces? [15:49] alexisb: we had a bless [15:49] alexisb, we've had two results today. 1 blessed, and just recently 1 cursed. [15:49] alexisb: then a curse due to a flakey test [15:49] SWEET! [15:49] :) [15:50] alexisb, personally, I'm big fan of the first result. [15:50] cherylj, sinzui are there any high priority branches we are needed to test asap? [15:50] frobware, heh [15:50] alexisb: upgrade-mongodb3 [15:50] sinzui, past that run can we queue up lxd-container-type for tych0 ? [15:50] alexisb: we are retesting maas-spaces which had i386 and ppc64el failures. [15:51] alexisb: oh, well, it is actually in the priority list after mongo3 [15:51] sweet, thanks [15:52] alexisb, sinzui: am I hearing we're waiting for another blessed build? [15:52] frobware: yes. [15:53] boo said the crowd [15:53] sinzui, is this some form of majority vote? [15:55] frobware: no. there are voters and non-voters. ppc64el unit tests vote. Ci will willing to test 3 times...juju is that bad on ppc64el. But maas-spaces might need 5 or 6 tries to pass [15:56] sinzui, I meant in terms of status overall. this morning maas-spaces was blessed. [15:56] voidspace: can I pick your brains for a moment? [15:57] dooferlad: sure [15:58] frobware: yes, but dimitern merged another change and now we don't have a bless. also. I forced a retest of ppc as you were waking up to get that bless [15:58] voidspace: hangout? [15:58] dooferlad: sure [15:58] dooferlad: give me ten minutes! [15:58] dooferlad: send me a hangout link - just about to phone the bank [15:59] voidspace: no problem. Ping me when you are ready. Was going to use https://plus.google.com/hangouts/_/canonical.com/juju-sapphire?authuser=0 [15:59] sinzui, which change? this one? http://reviews.vapour.ws/r/3829/ [16:01] maybe http://reports.vapour.ws/releases/3597 points to https://github.com/juju/juju/commit/f4de48d033ce30be495756492ba3ab726a3ec68f [16:01] frobware: I am going to restart the host and retest [16:01] sinzui, ack [16:08] sinzui, is ppc64 using gc or gccgo? [16:09] frobware: gccgo-go [16:09] sinzui, ok I temporarily have access to h/w - will try running the unit tests. [16:09] frobware: you have permanent access to the stilsons CI uses. [16:10] dooferlad: frobware: alexisb: my daughter just had a fit (febrile convulsion - she's had them before) [16:10] sinzui, heh. yes, I keep forgetting about that... [16:10] dooferlad: frobware: alexisb: need to sign out for a bit [16:10] frobware: you have access to every CI host you need to do you job. [16:10] alexisb: I'll probably miss our meeting tonight :-( [16:10] voidspace, take the time you need [16:10] just called for ambulance [16:10] not a problem [16:10] voidspace: sure. [16:10] my thoughts are with you guys [16:13] sinzui, so... what can I do on those machines? clone my juju repo, build, et al? [16:16] frobware: those machines are on canonical's network. they are very restricted. I scp files up and run them on the host. [16:16] good luck voidspace [16:25] sinzui, and cross-compile from x86? [16:29] frobware: no cross-compile. the compiler on ppc64el is not the compiler you have on amd64. We do everythign native. debs are created on the ppc. in the case of the unit-tests. we make a release tarfile, untar it on the host and run the unit-tests. the host has go ready or it can be installed. I think we need to use stilson-07 now because 08 is dedicated to go1.5 testing [16:29] sinzui, ok. on the h/w I'm using I was using gcc-go-4.9 [16:30] go version [16:30] go version xgcc (Ubuntu 4.9.3-0ubuntu4) 4.9.3 linux/ppc64le [16:32] natefinch: thanks [16:32] sinzui, I have: [16:32] go version go1.4.2 gccgo (Ubuntu 5.2.1-22ubuntu2) 5.2.1 20151010 linux/ppc64le [16:32] frobware: alexisb: dooferlad: she's ok, she has these fits when she gets a high temperature (inherited from her mother unfortunately) [16:33] voidspace, all resolved? hope so... [16:33] frobware: alexisb: dooferlad: but I have to go to hospital with her now (they always take her in after them) [16:33] frobware: she's fine, she won't stay overnight [16:33] but I have to go :-( [16:33] voidspace: go go! [16:33] voidspace, sure [16:33] voidspace, I am glad it sounds like she is ok, take care [16:41] sinzui, are the CI machines running wily? [16:41] sinzui, for ppc64 [16:41] frobware: trusty except for one wily that is not running any unit tests [16:42] sinzui, ok, I suspect that explains the gcc go version difference. [16:54] Bbl lunch [17:25] Bug #1544662 opened: cannot bootstrap with mongodb3 and manual-provider [17:28] Bug #1544662 changed: cannot bootstrap with mongodb3 and manual-provider [17:31] Bug #1544662 opened: cannot bootstrap with mongodb3 and manual-provider [17:35] Bug #1544662 changed: cannot bootstrap with mongodb3 and manual-provider [17:36] goo/quit [17:41] Bug #1544662 opened: cannot bootstrap with mongodb3 and manual-provider [17:56] Bug #1526063 changed: TestNoContextWithLock [18:32] Bug #1544694 opened: [maas-provider] Juju is incorrectly configuring os bridge interfaces [18:41] man, our pseudo transactions make separating the business logic from the persistence layer nearly impossible. [18:50] ericsnow: did you have ideas on how to increment the CharmModifiedVersion in the same transaction as SetResource? I can do it the horrible hacky way, where resource persistence now has intimate knowledge of the service collection's info... not sure what my other options are, besides not having them in the same transaction, which seems very likely to cause bugs if something only half-succeeds. [18:52] natefinch: gah, yet again mongo transactions are making us leak persistence info into state :( [18:52] natefinch: I do have a plan [18:53] ericsnow: yeah, I hate that about our transactions.... [18:57] natefinch: consider adding a "NewServiceCharmModifiedOps()" method to resource/persistence.PersistenceBase [18:57] natefinch: then the adapter in component/all/resource.go must provide that, exposing a similarly named helper in corestate [18:58] natefinch: or just in state/resources.go, since that is the point of that file :) [18:59] natefinch: (the point: avoid exporting more persistence concerns out of the state package) [18:59] ericsnow: ahh, yeah, ok. I was trying to figure out how to get the left hand to talk to the right hand. I was looking at state/resources.go and trying to figure out how to do it there. Iget it. [18:59] natefinch: cool [19:00] natefinch: let me know if you get stuck on that or have any other questions [19:01] ericsnow: natefinch: merge of master into the feature-branch just succeeded. may want to rebase [19:01] katco: nice! [19:01] katco: huzzah! [19:01] katco: thanks so much for taking that on. [19:01] natefinch: happy to so you guys can keep kickin arse :) [19:02] natefinch, katco: +1 [19:02] ericsnow: natefinch: cherylj: we should see if we can get a CI run through by tomorrow so we can merge INTO master [19:02] katco: well, we're trying to merge maas-spaces now, so there will be one less branch to compete with for CI runs :) [19:03] cherylj: :) is there any way to guarantee a run? [19:03] let me send you my paypal link [19:03] ;) [19:03] lol [19:04] cherylj: oh man if i had known this is how this works... [19:04] we were mostly focusing on master until we got the bless yesterday. [19:04] mongo3 was up next, then lxd-container-type, then I think your branch [19:05] Bug #1544694 changed: [maas-provider] Juju is incorrectly configuring os bridge interfaces [19:06] katco, cherylj, alexisb: team meeting? Or should we skip it? [19:07] cherylj: sweet! is there somewhere i can view the queue? [19:07] natefinch: in another meeting atm, so i can't attend [19:28] MAAS SPACES HAS MERGED [19:28] I repeat [19:28] MAAS SPACES HAS MERGED!!! [19:29] alexisb, frobware ^^ [19:29] :) [19:30] * natefinch gets the feeling from the all caps, that this is a big deal. [19:30] YES IT IS [19:30] heh [19:30] * lazyPower throws confetti [19:30] natefinch i have to confetti if you have fanfare under control :D [19:31] so/to/the/ [19:35] cherylj: woo! grats to everyone [19:35] * katco has a sinking feeling that she had better merge master again [19:36] katco: yes :) [19:36] * katco cries into her coffee [19:37] 9 conflicts. here we go again. [19:41] heyyyy cherylj [19:42] does juju 2.0 alpha bidniss work with maas 1.8? or do i need to upgrade to 1.9? [19:44] lazyPower, you will need to upgrade to 1.9 [19:45] ah, well that explains the weird issue i'm seeing about series mismatches [19:45] * lazyPower grabs a pick and returns to the maas saltmines [19:58] ericsnow: am I correct in assuming that a staged resource that is being activated will never be pending? [19:59] * ericsnow thinks about it [20:05] natefinch: pending resources should be staged as well, for exactly the same reason we stage non-pending resources [20:06] natefinch: however, I think the staging code isn't doing it right (there's a slight race) [20:09] natefinch: in resource/persistence/mongo.go, stagedID() should accommodate pending IDs [20:10] natefinch: that isn't a problem now, but could be in the future [20:19] ericsnow: hey can you hop into moonstone? [20:43] * frobware looks through the scrollback and HEADS TO THE BAR! :-D [20:47] * frobware ponders... maas-spaces has landed. Gravitational waves breakthrough. Surely just a coincidence. [20:59] Bug #1544724 opened: repeatedly checks /dev/fd0 when it doesnt even exist [21:02] well, that was something from the past [21:02] Bug #1544724 changed: repeatedly checks /dev/fd0 when it doesnt even exist [21:02] frobware: you need to keep these jokes coming. [21:14] Bug #1544724 opened: repeatedly checks /dev/fd0 when it doesnt even exist [21:24] man, I am terrible at bash [21:24] natefinch: good that ensures you are not going around embedding bash in go [21:28] ericsnow: btw, I think there's a bug in how we load resource information... when you deploy a local charm, the resource info defaults to says it's a charmstore resource, which is not correct [21:29] natefinch: yep [21:39] ahh man, the uniter tests are so slow..... [21:42] sigh... that feeling when I forget to filter out all the logging, so I can't even tell what failed... [21:43] OMG these tests are so bad [21:56] fwereade: ping? [21:58] sinzui: alexisb: ok. i think i've updated. i basically just merged master and cherry picked a bunch of old commits on top because git didn't figure it out. i'd prefer a rebase, but it's not obvious to me how to accomplish that with juju's feature branch setup. https://github.com/juju/juju/pull/4396 is the PR === natefinch is now known as natefinch-afk [22:09] ericsnow: can you please review natefinch-afk 's branch so we can possibly land that tonight before the ci run? [22:09] katco: sure [22:10] ericsnow: ty... i'll try and weigh in if i can get this merge through, but feel free to give it a ship it w/o me [22:15] tycho, you can just merge the rebase into your feature branch [22:16] once it is merged we can just re-queue for CI [22:17] tych0: generally you don't need a review for merging master into your feature branch [22:17] tych0: rebases are nice, but rebasing a feature branch on top of master is a headache, so most people just merge master in [22:17] ok. so nobody will be offended if i $$merge$$ myself? [22:17] tych0: nope, not if it's a feature branch [22:17] ok. [22:17] tych0: and it's just a merge from master [22:17] well, it's a merge from master + some fixups [22:18] which are mostly just cherry-picks of previously reviewed commits because git sucks :) [22:18] tych0: were the fixups reviewed at one point? [22:18] tych0: yeah, you're fine :) [22:18] katco: cool, thanks. [22:18] tych0: maybe do those in a separate pr next time, but not a huge deal [22:18] * katco is currently merging from master as well [22:18] well, i can't because the resulting merge won't build without them [22:18] ah i see [22:44] thumper: "juju migrate" is here: http://reviews.vapour.ws/r/3839/ [22:56] ericsnow: natefinch-afk: merge from master just landed [22:56] katco: k, thanks! [22:59] ericsnow: natefinch-afk: we're also last in the queue to get a ci bless, so have a bit of time to land patches. [23:35] looks like my merge failed, but i'm not entirely convinced the errors are mine: http://juju-ci.vapour.ws:8080/job/github-merge-juju/6362/console [23:35] katco: cherylj: thoughts? ^ [23:35] looking [23:36] ah, the dreaded bad record MAC [23:36] just retry the $$merge$$ [23:36] cherylj: was there a successful CI run last night ? [23:36] davecheney: yes, we got a bless on master [23:36] i want to make sure the logging and rpc changes I have made so far are blessed before I backport them to 1.25 [23:36] excellent, excellent, chrry-pick coming right up [23:37] tych0: yeah, looks like the bad record MAC was the only problem, just retry the $$merge$$ [23:37] just the uusual mongodb is web scale problem [23:37] ignore it [23:38] ok :) [23:40] oh my god [23:41] why is the apiserver code base like an episde of hoarders [23:41] it's got every line of code ever written in thre [23:41] nothing is every thrown away [23:41] even the apiserver has a client, even though there is another client in another package [23:41] this is like buying one of every color in the store so they don't feel lonely