/srv/irclogs.ubuntu.com/2016/04/12/#juju-dev.txt

mupBug #1569097 opened: jujud fails to start with "could not find a suitable binary for "0.0/mmapv1"" <blocker> <mongodb> <juju-core:Triaged> <https://launchpad.net/bugs/1569097>00:25
cheryljwallyworld: could you or someone from your team take bug 1569097?00:30
mupBug #1569097: jujud fails to start with "could not find a suitable binary for "0.0/mmapv1"" <blocker> <mongodb> <juju-core:Triaged> <https://launchpad.net/bugs/1569097>00:30
wallyworld_ok00:30
cheryljthanks!00:30
wallyworld_cherylj: part of the issue is the mongo stuff got erged too soon, so we'll need to look into how to deal with that. i'm still ramping up on the issues00:31
wallyworld_cherylj: i also added a bug to the board - HA doesn't use bootstrap constraints00:31
cheryljwallyworld_: I guess that was a miscommunication - we thought it was safe to merge because it had a fallback :/00:31
wallyworld_cherylj: my PR didn't have a fallback - it expected mongo 3.2 to be in xenial00:32
cheryljthe above bug happened on trusty, if it makes a difference00:33
wallyworld_anyways, all good, we'll fix00:33
wallyworld_on trusty it was supposed to use mongo 2.4 stull, hmmm, i'll need to check00:33
wallyworld_i bootstrapped yesterday without issues, but that may have been on xenial, i'll need to check00:34
wallyworld_i wonder if wily is also broken00:34
wallyworld_cherylj: good news though - it's in the queue, so progress :-) https://launchpad.net/ubuntu/xenial/+queue00:35
cheryljyay!00:35
cheryljbrb00:35
wallyworld_cherylj: i reckon bug 1534627 should be high rather than medium, since it quite adversely affects stakeholder deployments00:44
mupBug #1534627: Destroyed models still show up in list-models <2.0-count> <conjure> <juju-release-support> <juju-core:Triaged> <https://launchpad.net/bugs/1534627>00:44
rick_h_wallyworld_: +1 and the change on it is backward incompatible00:46
wallyworld_yep, that too00:46
mupBug #1569106 opened: juju deploy  <service> --to lxd:0 does not work <conjure> <juju-core:New> <https://launchpad.net/bugs/1569106>00:46
perrito666wallyworld_: hey, ruthere?01:07
wallyworld_maybe01:08
wallyworld_depends who's asking01:08
perrito666I would make a taxes joke, but I have no idea how is the Ausie irs called01:08
wallyworld_ATO01:08
wallyworld_australian tax office01:09
perrito666will it kill you? like everything in australia?01:09
wallyworld_it can01:09
wallyworld_feeding it money helps01:09
perrito666so lemme know when you can ho01:10
wallyworld_anytime01:11
perrito666k standup room?01:11
wallyworld_ok01:11
mupBug #1569109 opened: Juju makes wrong network configuration when adding physical machine <juju-core:New> <https://launchpad.net/bugs/1569109>01:25
natefinchevening folks01:36
alexisbgood evening all, see you in the morning01:43
thumperbugger...01:47
* thumper sighs01:48
thumpershelving all current work to pop the stack and fix other bits.01:48
natefinchcherylj: is there something I should be working on to help unblock master?01:55
cheryljnatefinch: want to take a look at https://bugs.launchpad.net/juju-core/+bug/1564791 ?01:56
mupBug #1564791: 2.0-beta3: LXD provider, jujud architecture mismatch <blocker> <lxd> <juju-core:Triaged> <https://launchpad.net/bugs/1564791>01:56
cheryljlooks like an interesting one01:56
natefinchnot really ;)  But I will :)01:56
natefinchcherylj: actually, it gets less bad toward the end of the bug :)01:57
mupBug #1569120 opened: wrong lxc bridge still used in juju beta4 <conjure> <juju-core:New> <https://launchpad.net/bugs/1569120>01:59
cheryljaxw: got a sec?02:07
axwcherylj: yup?02:07
cheryljaxw: I'm looking at bug 156902402:07
mupBug #1569024: Region names for rackspace should accept caps and lowercase <blocker> <rackspace> <juju-core:In Progress by cherylj> <https://launchpad.net/bugs/1569024>02:07
cheryljand was thinking that for public clouds, we could strings.ToLower the region names02:07
cheryljthat way we don't mess with any user defined cloud regions02:07
cheryljand maintain compatibility for rax02:08
axwcherylj: gah, yeah, we should and I meant to do that02:08
axwcherylj: on input, lower case02:08
cheryljbut just for public clouds, yes?02:08
cheryljor for all?02:08
axwcherylj: hrm. well, maybe not lowercase when we pass through, just compare case insensitive02:09
* axw looks at the code02:09
cheryljah, that works too02:10
cheryljstrings.EqualFold()02:10
cheryljneato02:10
axwcherylj: I *think* it's just a matter of changing "getRegion" in cmd/juju/commands/bootstrap.go02:11
axwwhere we check region.Name ==02:11
axwcherylj: also the set-default-region command02:11
cheryljaxw: yeah, I had some changes in there already, just wanted to verify what we should do02:12
cheryljaxw: so don't change the region, just do a case insensitive comparison?02:12
axwcherylj: I think that's safest, yeah02:12
cheryljaxw: sounds good, thanks02:12
cheryljnatefinch: I have access to the arm hardware for that lxd bug.  Need me to forward it your way?02:24
natefinchcherylj: yes please02:26
natefinchcherylj: though it probably will be a matter of looking at the code and then thinking real hard.02:27
cheryljbreak out the hamster02:27
cheryljhey rcj, slumming it with the juju devs?02:27
natefinchcherylj: my brain refuses to read arm64 ... every time it translates it into amd64, and I have to do a double take to make sure it says the right thing02:37
cheryljnatefinch: oh me too02:38
axwmenn0: when you're importing a model, will it be visible during import? will it be mutable while importing?03:19
axw(import as in migration)03:19
menn0axw: there's a migration-mode flag which will be set to "importing"03:20
menn0axw: that blocks critical txns as well as preventing API logins for it03:20
menn0axw: the former has been done but not the latter03:20
axwmenn0: ok, cool. but you'll still be able to see it in list-models?03:20
menn0axw: I guess so, but we could make it so they didn't show up03:21
axwmenn0: I'm thinking it might make sense to have a status entry for models03:21
menn0axw: that could be done03:21
axwavailable, importing, destroying, archived03:21
axwsomething like that03:21
menn0axw: sounds useful03:21
axwmenn0: we need to be able to filter out Dead models in list-models, but I think we should show status of Alive vs. Dying03:22
axwbut a more descriptive status would be better03:22
axwI'll look at adding that03:22
natefinchmenn0: speaking of migrations... I added a field to charmDoc and tried to figure out if there was anything I needed to do for migration, but couldn't find code migrating charm stuff. What's up with charms and migration?03:24
menn0natefinch: migration of charms and tools is still in-progress... there is code but it needs reworking and isn't plugged in to the process yet03:26
menn0natefinch: for most collections there's tests that fail if fields are added03:27
menn0natefinch: but probably not for charms yet03:27
menn0natefinch: so just add your field for now and email thumper and me about it just to make sure03:27
natefinchmenn0: ok, cool, will do03:27
menn0axw: you thinking this status would replace the migration-mode field?03:28
menn0axw: or is the status a virtual concept only for the status API?03:28
axwmenn0: probably not, it's just for human consumption03:28
menn0axw: kk03:28
menn0axw: you know that there's already a environment-status (hopefully model-status) section which can optionally appear in the status output03:29
menn0axw: perrito666 added it to support reporting that there's a tool upgrade available03:29
menn0axw: model migration status will appear there too03:30
axwmenn0: ah ok, I'll check that out - thanks03:30
rcjcherylj, what did I do?03:37
rcjcherylj, I'm just here to remind everyone to use the 'daily' stream when running with the xenial series until it ships, otherwise you have a very stale experience.03:38
cheryljheh03:39
rcjI mean, that's not why I'm here, but I'll make that public service address whenever the opportunity presents itself.03:39
cheryljthis has been a CPC public service announcement03:39
rcjcloud images, best consumed fresh03:39
rcjalso, I'm not in charge of any actual branding efforts03:40
cheryljaxw:  Can you do a quick review?  http://reviews.vapour.ws/r/4528/03:45
axwcherylj: looking03:45
cheryljnatefinch: how's that arm bug coming?  (I'm curious because it's such a weird bug)03:46
cheryljit's not a nag :)03:46
axwcherylj: looks good, but can you please do set-default-region while you're there?03:47
cheryljgah, I forgot you said that03:47
cheryljyes03:47
axwcherylj: thanks :)03:47
cheryljaxw: can you take another look?  http://reviews.vapour.ws/r/4528/04:19
cheryljI had to do it a bit differently for set-default-region04:19
cheryljso that we wrote out what was in the cloud region list, not what the user specified04:20
menn0cherylj, thumper: what was the decision on where to land stuff while master is blocked?04:30
cheryljbleh, I haven't done that.04:30
* thumper waits...04:30
thumpercherylj: what was the decision?04:30
cheryljit was a back and forth for a while, but the general consensus was "yeah, sure"04:31
axwcherylj: sorry was afk, looking04:32
cheryljmenn0, thumper, since it's already tomorrow, I can go either way on a bug branch.04:33
cheryljif either one of you wants to create one, go for it04:33
cheryljI'm just waiting to land this rackspace fix so I can go to bed04:33
axwcherylj: LGTM, thank you04:33
axwsorry for keeping you from bed :(04:33
cheryljit happens :)04:33
cheryljthanks for the review!04:33
thumpercherylj: was it acceptable to have a release branch?04:33
cheryljthumper: I'd rather not do that at this point because I do'nt know if CI would run on it tonight (until the QA team wakes up)04:34
thumperah... good point04:34
menn0thumper, cherylj: let's make a "next" branch04:40
thumperack04:41
thumpernext branch created04:41
menn0the compression ration acheived by lrzip is amazing but geez it's slow04:41
* menn0 has been waiting for almost 2 hours for a file to decompress04:42
mwhudsonmenn0: two *hours*?04:43
mwhudsonmenn0: seems unlikely the extra compression saved you two hours of download time...04:43
menn0mwhudson: I agree but that's how the file came04:46
menn0it's a 365MB file that currently up to 11GB and climbing04:46
menn0lrzip is even using every core and it's still taking this long04:46
thumperwow04:57
menn0mwhudson, thumper: just finished... a little over 2 hours. 365 MB to 14GB05:05
davecheneywhat was in that giant file ?05:08
mwhudsonmenn0: that is quite a ratio05:09
menn0davecheney: DB dump from a broken system05:11
wallyworld_axw: if you get a chance, here's a small mongo ha fix for beta4 http://reviews.vapour.ws/r/4529/05:14
axwwallyworld_: ok, a little later, trying not to context switch right now05:14
axw(unless it's urgent)05:15
wallyworld_tis fine, whenever suits05:15
wallyworld_nah, can wait05:15
wallyworld_so long as it lands sometime today so Ci can run05:15
wallyworld_i could bug menn0 :-) if he is waiting for lrzip05:16
davecheney        m.Server = httptest.NewServer(nil)05:17
davecheney        c.Assert(m.Server, gc.NotNil)05:17
davecheney        m.oldHandler = m.Server.Config.Handler05:17
davecheneycreate a new server, then save the value of it's handler ...05:17
davecheneythen restore the handler in the tear down05:17
davecheneythen the new test overwrites the value we just restored ...05:17
davecheneywat05:17
menn0wallyworld_: i'm waiting for a long mgopurge run05:24
menn0wallyworld_: i'll take a look05:24
wallyworld_ty05:24
wallyworld_is there a custimer issue?05:25
menn0wallyworld_: ship it05:38
wallyworld_menn0: yay, tyvm05:38
menn0wallyworld_: even though you're deleting a lot of my turd polishing :)05:39
wallyworld_menn0: sorry :-)05:39
wallyworld_less turds left now05:39
menn0wallyworld_: actually hang on05:41
* wallyworld_ hangs05:41
menn0wallyworld_: can't you be a bit more aggressive about test removal05:41
wallyworld_possibly05:41
wallyworld_i thought about removing the whole fakeensure stuff05:41
menn0wallyworld_: some of those asserts you've removed were the point of those tests so I suspect the whole test can go05:41
menn0that's what I was thinking too05:41
wallyworld_yeah, had the same thought05:42
menn0if it's not being used05:42
wallyworld_i was trying to be a bit conservative05:42
wallyworld_i'll take another look05:42
menn0wallyworld_: it's really just TestMachineAgentUpgradeMongo05:42
menn0and perhaps the fakeensuremongo05:42
wallyworld_yep, i convinced myself that test remained useful05:42
wallyworld_but seems not05:43
wallyworld_menn0: yeah, a lot of extra code can just be deleted05:50
menn0wallyworld_: excellent05:50
wallyworld_peergroup is having a big haircut05:51
wallyworld_peergrouper05:51
axwwallyworld_: before you delete all that...06:15
wallyworld_already gone :-)06:15
axwis it still possible to promote machines to controllers with your changes?06:15
wallyworld_axw: you mean ones which are not yet has-vote06:16
axwwallyworld_: I mean "enable-ha --to 0,1,2"06:16
axwwhere we transform a non-state-server into a state-server06:16
wallyworld_i'll double check, i didn't test that explicitly06:16
dimiternwhew it finally worked !07:08
mupBug #1569196 opened: enable-ha with placement fails due to invalid JobManageNetworking <juju-core:Triaged> <https://launchpad.net/bugs/1569196>07:31
voidspacemorning everyone08:04
voidspaceback to the routine of the school-run this morning08:05
voidspace*sigh*08:05
dimiternmorning voidspace08:13
voidspacedimitern: so thumper broke my code *again* overnight :-)08:23
dimiternvoidspace: oh yeah? :)08:23
voidspacedimitern: see here: https://docs.google.com/document/d/1YmbdGpP7Oy5uglOwqbRXf1k_7siaxfEpoWkshk5_oPo/edit?ts=56fb30ca#08:24
voidspacedimitern: basically you were right about not_networks so he changed the allocate machine args again08:24
voidspacedimitern: and I was just updating the code to work with master as it was yesterday :-)08:24
voidspaceit's not a big change - so not difficult08:24
dimiternvoidspace: cool :)08:25
thumpervoidspace: it is my mission in life to make your mornings miserable08:36
thumperhowever, dimitern will like to hear that he was right08:37
voidspacethumper: ah, that explains why you joined our standups!08:37
voidspacethumper: :-)08:37
voidspacethumper: hey, so gomaasapi now has its own dependencies.tsv08:37
thumpervoidspace: if you want to jump in the hangout now, we can chat that way I can not work later08:38
thumpervoidspace: yeah, needed for the merge bot08:38
voidspacethumper: sure08:38
voidspacethumper: right, but the versions of its dependencies are different than the juju ones08:38
voidspacethumper: I'll join the hangout08:38
voidspacebabbageclunk: you too?08:38
thumpervoidspace: shouldn't be off by much08:38
voidspacebabbageclunk: early hangout08:38
thumpervoidspace: probably just testing08:38
voidspaceall of them are now different I think08:38
babbageclunkvoidspace: sure08:38
voidspacethumper: but everything still works08:39
voidspacewe just need to be careful08:39
* thumper nods08:39
dimiternthumper: I told you ;)08:49
TheMuemorning09:10
dimiternTheMue: \o09:10
TheMuedimitern: heavy on fire for Juju 2 and also 16.04?09:15
dimiternTheMue: oh yeah :)09:17
Alex____Hi, I wonder if somebody could please point to the place for a quick question on BigData charms?09:18
TheMuedimitern: how is J2 different from the J1.*? so many incompatible changes to change the major release number?09:18
dimiternTheMue: a lot has changed, and some things in an incompatible way, check the release notes :)09:20
TheMuedimitern: will do. still very interested in juju and always trying to place it in projects or give interested people a hint. many don't know it.09:23
axwfwereade_: the branch I put up is for 2.0, in which compatibility breaks are many and varied09:35
babbageclunkAnyone know why building the next branch is failing?09:44
fwereade_axw, oops, fair enough, I do default to unthinkingly-maintain-compat09:59
dimiternfrobware: managed to figure it out - erc-email-userid needs to match my nick for i.canonical.c to accept it along with the server password09:59
axwfwereade_: and I thank you for it :)09:59
frobwaredimitern: no turning back now :)09:59
dimiternfrobware: indeed :)10:00
frobwarebabbageclunk: guessing... did you run godeps -u ...10:00
babbageclunkfrobware: not locally - in the github-merge-juju Jenkins job.10:01
babbageclunkfrobware: http://juju-ci.vapour.ws:8080/job/github-merge-juju/7313/console10:01
babbageclunkfrobware: looks like lots of provider/lxd tests10:02
dimiternbabbageclunk: fwiw I see the same errors even after upgrading to xenial when running make check on master tip10:02
axwfwereade_: responded to your other questions on RB, will look again tomorrow. thanks for the review10:02
dimiternif anything it got worse - I only saw a couple of failures yesterday on wily10:03
babbageclunkfrobware: some of the failing builds under that are against master, some against next.10:03
babbageclunkfrobware, dimitern: I tried running provider/lxd tests for next locally and I don't see the failures (although I didn't run the full test suite).10:04
babbageclunkdimitern: I'll try running make check10:05
dimiternbabbageclunk: I'll try next now so see if it's any better10:05
dimiternbut first I need to reboot..10:06
menn0hi all10:18
babbageclunkmenn0: hi!10:23
menn0babbageclunk: how's it?10:23
babbageclunkHey, I saw a build of yours failed with lots of lxd provider failures.10:23
babbageclunkDid you work out why? A branch of mine had that just now too.10:24
menn0babbageclunk: everyone's seem to be failing like that. I wonder if there's a problem with the test runner hosts.10:24
menn0any QA people about?10:24
dooferladfrobware: launchpad seems to have gone read only, so I can't put this in the bridged bond bug right now. The pre-up/post-down thing is a red herring. Even if you include them cloudinit hangs. Rebooting always works and cloudinit seems to finish happily.10:24
dooferladfrobware: and I really need to get the proxy bug fix landed, so pausing on this for now.10:25
frobwaredooferlad: ack10:25
dooferladfrobware: ah, bug just updated. Yay web services.10:26
frobwaredooferlad: really need to conclude on an investigation of replace ENI and reboot...10:26
babbageclunkmenn0: Running the full test suite locally (on juju/next) I get the same failures10:28
menn0babbageclunk: interesting... so not the build hosts then10:30
menn0babbageclunk: I'm just finishing something else up and then I'll try on my machine.10:31
babbageclunkmenn0: takes ages though so I haven't run the tests against master as well yet - I saw that cherylj has some failing runs against master with the same errors.10:31
frobwaredimitern: whoa! that's subtle...10:34
frobwaredimitern: we currently have 00-juju.cfg and eth0.cfg10:35
frobwaredimitern: which would/could/should give us 2 addresses on eth010:35
frobwaredimitern: but because we specify a mac addr, the ifup via DHCP on eth0.cfg gives us the same IP addr10:36
frobwaredimitern: ok, that explains it (for me at least) :)10:37
menn0babbageclunk: if you run just one of the tests that's failing in CI does it fail then? (that shouldn't take too long)10:37
babbageclunkmenn0: Yeah, it turns out running just ./provider/lxd that fails.10:38
dimiternfrobware: interesting10:38
dimiternfrobware: and lucky I guess :)10:39
babbageclunkmenn0: But now I can't find a version where it doesn't fail.10:39
* menn0 runs those tests10:39
menn0babbageclunk: they pass for me10:39
frobwaredimitern: I was trying to understand the behaviour. If I try this outside of juju the ifup on another foo.cfg (which also specifies eth0) will just add another IP addr to eth0.10:39
babbageclunkmenn0: is it safe to just do a checkout, godeps, then go test?10:39
menn0babbageclunk: yep that should do it (as long as you have mongodb installed)10:40
menn0babbageclunk: and I guess you probably need to have lxd installed for some tests too10:40
frobwaremenn0, babbageclunk: isn't the underlying problem related to the configuration of lxdbr0?10:40
babbageclunkmenn0: ok, so it'll rebuild everything.10:40
frobwareor lack of10:40
menn0frobware: sure... but why is it suddenly happening in CI and on babbageclunk's machine?10:41
babbageclunkmenn0, frobware: ok - I installed lxd last friday.10:41
menn0babbageclunk: what does "lxc version" show?10:41
babbageclunk0.2010:41
babbageclunkmenn0: I'm on wily10:41
menn0babbageclunk: I'm on vivid but I'm running 2.0.0.rc110:42
dimiternso I see exactly the same test failures on next as on master10:42
babbageclunkMaybe I should upgrade to that.10:42
menn0dimitern: yes, all recent merge attempts have had the same lxd/lxcbr0 problems10:42
babbageclunkmenn0: potentially that's also the problem on the build machine(s)10:43
menn0babbageclunk: there's a PPA for the current lxd from the lxd/lxc team10:43
frobwaremenn0, babbageclunk: to repro this just 'cd provider/lxd; go test'?10:43
menn0frobware: I believe so10:44
babbageclunkfrobware: yup - might need a godeps in there too10:44
* menn0 prefers or "go test ./provider/lxd" but whatever10:44
dimiternfrobware: same thing with running only provider/lxd tests10:45
frobwaremenn0, babbageclunk: ok && not terribly helpful but OK: 77 passed, 1 skipped10:45
frobwaremenn0, babbageclunk: however, I am _only_ at dd9828ec7003d1a6ec1fc4dbcb7e6d17467a21f010:45
babbageclunkmenn0, frobware - ok, I'm going to add the ppa and upgrade.10:46
frobwarebabbageclunk, menn0: or go backto dd9828ec and try there... it may be something more recent in master10:46
babbageclunkmenn0, frobware: then I guess if that fixes it then it's an indication that someone should do the same on build hosts.10:46
dimiternfrobware: I suspect you did run `sudo dpkg-reconfigure -p medium lxd` as suggested by the tests?10:47
dimiternotherwise how are you not seeing the failures..10:47
frobwaredimitern: nope, not medium. but I did reconfigure some time last week10:47
menn0dimitern: I can't repro the problem, and I haven't run dpkg-reconfigure in a long time10:47
babbageclunkfrobware: I tried going back to find a bisect start point, but got back to last Monday and the tests were still failing.10:47
frobwaremenn0: it was probably last tue/wed when I did the dpkg-reconfigure10:48
menn0I haven't since I installed lxd (about 2 months ago?)10:48
* dimitern *facepalm*10:48
frobwarebabbageclunk: my /etc/default/lxd-bridge config: http://pastebin.ubuntu.com/15784102/10:48
babbageclunkanyone have the ppa handy?10:49
dimiternI remember what I did - changed /e/default/lxd-bridge to not have IPv4 addresses as it was messing up my lxd multi-nic testing10:49
* frobware would like to kickstart/jumpstart all his machines every morning to avoid state...10:50
menn0dimitern: but why is this also happening on the build hosts?10:50
frobwaremenn0: which is why I was suggesting first go back to my current rev ^^ to see if it's just recent churn in master.10:51
babbageclunkfrobware: I'm on that rev - it's upstream/next and upstream/master (since no one's been able to land anything)10:53
frobwareoooohhh. I am at that rev. apologies...10:53
frobwarebabbageclunk: my lxd package is:10:54
dimiternmenn0: not sure - perhaps when /e/d/lxd-bridge was introduced it did not have IPv4 config and CI machines haven't been updated since?10:54
frobware$ apt-cache madison lxd10:54
frobware       lxd | 2.0.0-0ubuntu2 | http://gb.archive.ubuntu.com/ubuntu xenial/main amd64 Packages10:54
dimiternnow all provider/lxd tests pass10:54
frobwaredimitern: to confirm, you're running xenial?10:54
dimiternfrobware:yep10:54
dimiternhowever, p/lxd tests should NOT fail if anything like that on the machine happens - they should be properly isolated10:56
babbageclunkHuh. lxc version still says 0.20, but the tests pass for me now.10:58
dimiternbabbageclunk: you're on wily?10:58
babbageclunkdimitern: yup10:59
dimiternbabbageclunk: so I needed to add `deb http://ppa.launchpad.net/ubuntu-lxc/lxd-stable/ubuntu wily main` to /e/a/srcs.list to get lxd to work on wily11:00
babbageclunkdimitern: yeah - I did the same, but via add-apt-repository for ppa:ubuntu-lxc/lxd-stable11:01
dimiternbabbageclunk: yeah - same thing, and then a-g update && a-g dist-upgrade11:01
dimiterndist-upgrade if you already installed lxd I mean11:02
babbageclunkok, so how do we get the tests passing on the build machines?11:03
voidspaceooh, down to two failures11:10
dimiternmgz: ^^11:13
dimiternmgz: istm the dpkg configure for lxd might have been skipped with the noninteractive frontend11:14
dimiternmgz: it will be useful to keep the machine around when the merge job fails to see what's going on11:14
babbageclunkdimitern: I'm running apt-get under ansible, so maybe it's being run noninteractively as well?11:15
dimiternbabbageclunk: well, what's in /etc/default/lxd-bridge ?11:16
babbageclunkdimitern: http://pastebin.ubuntu.com/15784982/11:17
babbageclunkdimitern: But the tests are passing now that I've upgraded.11:17
babbageclunkdimitern: so maybe it was just that I added the ppa.11:18
=== babbageclunk is now known as babbageclunch
dimiternbabbageclunk: yeah, it looks like the tests should still fail (?!) mine was very similar before I fixed it11:18
frobwarebabbageclunch: looks like most of the config is empty11:21
=== babbageclunch is now known as babbageclunk
voidspacefrobware: dimitern: babbageclunk http://reviews.vapour.ws/r/4535/11:35
voidspacefrobware: dimitern: babbageclunk http://reviews.vapour.ws/r/4535/11:45
* voidspace lurches to lunch11:45
dimiternvoidspace: looking11:48
voidspacedimitern: thanks11:51
babbageclunkfrobware, dimitern, voidspace: http://reviews.vapour.ws/r/4536/11:54
babbageclunkvoidspace: looking at yours now.11:54
voidspacebabbageclunk: dimitern just reviewed it, but thanks11:54
babbageclunkvoidspace: yeah, I just saw that it's merging11:54
voidspaceit will fail11:55
voidspacedammit11:55
voidspaceI missed off some test fixes - didn't push them11:55
babbageclunkvoidspace: probably should have a look anyway - I'm OCR tomorrow.11:55
voidspaceooh11:55
babbageclunkvoidspace: Well, it was going to fail due to the lxd thing anyway, right? ;)11:55
voidspacehah11:55
voidspacebabbageclunk: are all merges backed up on that11:56
babbageclunkvoidspace: there are 9 failures in a row on github-merge-juju that I think are provider/lxd ones.11:57
voidspacebabbageclunk: nice :-)11:59
voidspaceright11:59
* voidspace really goes on lunch11:59
wallyworld_cherylj: a small one for a ha bug i found testing ha http://reviews.vapour.ws/r/4537/12:55
babbageclunkvoidspace: that AllocateMachine change is biting me too - I'll use a version that has Link.IPAddress() but not the AllocateMachine change until you've updated stuff.12:59
babbageclunkwallyworld_: we've been having merge jobs fail on Jenkins because of LXD provider tests - do you know about that?13:22
wallyworld_i saw my job fail, but don't know what's wrong with lxd13:22
rick_h_babbageclunk: wallyworld_ cherylj and QA at looking into I think13:23
wallyworld_but i did see a bug where lxd behaves differently on trusty vs xenial with the bridge13:23
wallyworld_i strongly suspect an upstream lxd issue13:23
babbageclunkrick_h_: ok, thanks13:23
wallyworld_babbageclunk: bug 1569120 may be related / relecant13:24
mupBug #1569120: wrong lxc bridge still used in juju beta4 <conjure> <juju-core:Incomplete> <https://launchpad.net/bugs/1569120>13:24
babbageclunkrick_h_, wallyworld_: if it helps, I was getting the same failures on my machine (wily) until I added the PPA for lxd-stable and upgraded.13:25
mgzwe're using daily xenial images for the merge bot (which we have to, as the last one has too old an lxc)13:25
mgzand there's a new lxd as of 2016-04-11 that's probably in today's image13:26
mgzwith various changes, bug 154848913:26
mupBug #1548489: [FFe] Let's get LXD 2.0 final in Xenial <lxd (Ubuntu):Fix Released> <https://launchpad.net/bugs/1548489>13:26
mgzso it's likely we just got broken again13:26
babbageclunkmgz: ah, ok - thanks13:26
frobwarebug #1569361 makes it hard to iterate on fixing container bugs...13:39
mupBug #1569361: LXD containers fail to upgrade because the bridge config changes to a different IP address <network> <juju-core:New> <https://launchpad.net/bugs/1569361>13:39
cheryljfrobware:  :(13:43
* perrito666 gets budgeted for his next home internet... U$D450/5M13:43
mupBug #1569361 opened: LXD containers fail to upgrade because the bridge config changes to a different IP address <network> <juju-core:New> <https://launchpad.net/bugs/1569361>13:43
mgzso... where are we actually at with lxd?13:57
mgzour master doesn't work with their 2.0 - plus various other bugs?13:57
voidspacebabbageclunk: or you can merge my branch14:00
voidspacebabbageclunk: https://github.com/juju/juju/pull/5094/files14:00
babbageclunkbabbageclunk: yeah, but this was pretty easy and likely to require less explanation at review time.14:01
voidspacebabbageclunk: cool, that branch is ready to land though14:02
katcomorning all14:02
babbageclunkvoidspace: true - I'll need to merge it in eventually.14:02
babbageclunkkatco: o/14:02
wallyworld_                         14:10
wallyworld_\14:10
mgzwallyworld_: your arm is falling off14:10
wallyworld_pressed wrong key14:11
ericsnowkatco: rogpeppe1 is proposing a small API change in csclient.Client which would require a likewise small (isolated) change in core14:16
ericsnowkatco: any objections?14:16
katcoericsnow: yeah saw the email... cherylj what would a change to core look at this point? would it still go into rc1?14:16
cheryljkatco: it pulls in an updated dep, right?14:17
* ericsnow ignores wallyworld_ since he can't possibly be coherent at this point14:17
katcocherylj: and a small change to core14:17
cheryljkatco: I'm going to say that should go into rc1.  (not what we're trying to release this week)14:18
katcocherylj: that's fine14:18
katcoericsnow: ok, no objections14:18
cheryljso put it in the next branch that thumper created14:18
ericsnowcherylj: FYI, it *is* a bug14:18
ericsnowkatco: k14:18
cheryljyes, I know14:18
ericsnowrogpeppe1: ^^^14:18
cheryljericsnow:  is there a bug opened?  the email I saw didn't mention one?14:18
ericsnowcherylj: not yet, I expect14:18
rogpeppe1cherylj: no, i didn't file a bug yet. will do.14:19
ericsnowrogpeppe1: thanks14:19
cheryljthanks rogpeppe114:19
ericsnowand thanks for noticing the bug :)14:19
katcoericsnow: fix lands here: https://github.com/juju/juju/tree/next14:19
rogpeppe1cherylj: not sure if i should file the bug against juju-core or charmrepo/csclient14:19
cheryljrogpeppe1:  you can target to both14:20
rogpeppe1cherylj: interesting. how would I do that?14:20
ericsnowkatco: is master for 2.0.1 now?14:20
ericsnowrogpeppe1: "Also affects project"14:21
cheryljrogpeppe1: Use "also affects project"14:21
katcoericsnow: that is my understanding. cherylj, correct?14:21
cheryljericsnow: no, master is for beta4.  We didn't branch for the release last night because I didn't know if the branch would've been picked up for testing overnight14:21
cherylj(but it didn't matter anyway because no merge jobs passed because of lxd)14:22
ericsnowcherylj: so the fix for rogpeppe1's bug should go in master or next?14:22
katcocherylj: what is the "next" branch for?14:22
rogpeppe1cherylj: do i have to do that after submitting the bug? i don't see that option in the "new bug" page.14:22
cheryljnext is for rc114:22
cheryljwhen we release beta4, we will merge next into master14:22
ericsnowcherylj: ah, okay14:23
mgzit's 100% that someone is going to screw up targetting here14:23
katcothat seems... backwards14:23
cheryljrogpeppe1: yes, after you create the bug you can target to a different project14:23
cheryljkatco: yes, I know, but we did it that way because we wanted to make sure master / whatever we're going to release got a CI run overnight and I didn't know if it would pick up a new branch14:24
cheryljand it was way past EOD for the qa team14:24
katcocherylj: our tooling T.T14:24
rogpeppe1cherylj: it doesn't like the fact that there's no launchpad project for charmrepo (it's in github)14:24
cheryljrogpeppe1: then just target to juju-core14:24
rogpeppe1cherylj: i've created the bug. https://bugs.launchpad.net/juju-core/+bug/156938614:24
mupBug #1569386: list resources will not work correctly <juju-core:New> <https://launchpad.net/bugs/1569386>14:25
cheryljthanks!14:25
cheryljguess I should create a 2.0 rc1 milestone14:25
cheryljhey natefinch, any luck with bug 1564791?14:29
mupBug #1564791: 2.0-beta3: LXD provider, jujud architecture mismatch <blocker> <lxd> <juju-core:Triaged by natefinch> <https://launchpad.net/bugs/1564791>14:29
natefinchcherylj: it's kind of a twisty maze of code getting passed around, but I have some suspicious lines I'm looking at. e.g.  if result.Arch == "" {result.Arch = "amd64"}14:31
mupBug #1569386 opened: list resources will not work correctly <juju-core:New> <https://launchpad.net/bugs/1569386>14:46
natefinchericsnow: just had a good idea about the bug 3 lines up... I think this is another case of needing to make our "local" provider special.  LXD has to always default to the arch of the host machine, but we have provider code that says that if you don't specify the arch, we default to amd64, which obviously fails to run on other arches.  I think we never see this in development, because we always use --upload-tools14:57
mupBug #3: Custom information for each translation team <feature> <iso-testing> <lp-translations> <Launchpad itself:Fix Released> <MTestZ:Invalid> <Ubuntu:Invalid> <mono (Ubuntu):Invalid> <https://launchpad.net/bugs/3>14:57
ericsnownatefinch: yep14:58
katcoericsnow: natefinch: standup time15:02
natefinchcherylj: is there a card for https://bugs.launchpad.net/juju-core/+bug/156479115:13
mupBug #1564791: 2.0-beta3: LXD provider, jujud architecture mismatch <blocker> <lxd> <juju-core:Triaged by natefinch> <https://launchpad.net/bugs/1564791>15:13
cheryljnatefinch: not yet, I can make one for you15:13
frobwareanybody else see bootstrap failures related to mongod not found in PATH?15:13
frobwareI have bootstrapped quite a few times today but has failed twice in a row now15:14
frobwaresee bug #156940815:14
natefinchcherylj: thanks15:14
mupBug #1569408: Failed to bootstrap because exec: "mongod": executable file not found in $PATH <juju-core:New> <https://launchpad.net/bugs/1569408>15:14
katcocherylj: can redir land help text changes into the next branch?15:18
cheryljkatco: yes15:19
katcocherylj: k ta15:19
mupBug #1569408 opened: Failed to bootstrap because exec: "mongod": executable file not found in $PATH <juju-core:New> <https://launchpad.net/bugs/1569408>15:20
redir:)15:21
katcoredir: what's your launchpad id?15:25
redirreedobrien15:34
redirkatco: ^15:34
katcoredir: ty15:34
dimiternnow everything is broken15:50
dimiternmaas cannot bootstrap due to missing mongod, aws can't add lxc containers as cloud-init sets a non-present locale en_US.UTF-815:53
dimiternand the locale is missing because apt-get update & upgrade are apparently required for xenial now15:54
frobwaredimitern, voidspace, tych0: PTAL @ https://github.com/juju/juju/pull/509915:56
frobwaredimitern: I went back to trusty and added backports to sources.list -- working there. \o/15:57
dimiternfrobware: looking15:58
dimiternfrobware: I managed to get xenial to work as well by doing a-g up & upg & a-g install language-pack-en-base15:58
frobwaredimitern: I can no longer bootstrap with xenial...15:59
dimiternfrobware: on maas, I have the same issue - but I'm using AWS now to verify dropping address-allocation ff does not break something there15:59
frobwaredimitern: gotcha16:00
natefinchlol, I now have 3 unkillable lxd environments16:01
dimiternfrobware: LGTM16:02
frobwaredimitern: ty16:02
natefinchuh.... anyone know what this means?16:03
natefinch$ juju bootstrap local-Apr-12 lxd --upload-tools16:03
natefinchERROR invalid config: no addresses match16:03
perrito666throw some debug there?16:04
dimiternnatefinch: try --debug?16:04
natefinchoh, maybe this is the lxd problem everyone's been having, that I avoided by just not using lxd for a while :/16:04
natefinch2016-04-12 16:04:14 DEBUG juju.cmd.juju.commands bootstrap.go:365 preparing controller with config: map[type:lxd name:admin uuid:0a58e9ef-099f-4cf8-8a48-2772cf8b5c05 controller-uuid:0a58e9ef-099f-4cf8-8a48-2772cf8b5c05]16:04
natefinch2016-04-12 16:04:14 ERROR cmd supercommand.go:448 invalid config: no addresses match16:04
dimiternthat's a new issue to me16:10
katconatefinch: there's a good thread on that with rogpeppe1 and redir16:11
katconatefinch: search email for that error message16:12
rogpeppe1natefinch: i think the underlying cause is this: https://bugs.launchpad.net/juju-core/+bug/156795216:14
mupBug #1567952: container/lxd: TestDetectSubnetLocal fails with link/none <juju-core:Triaged> <https://launchpad.net/bugs/1567952>16:14
cheryljnatefinch: you need to do the dpkg-reconfigure to set up the bridge, then service lxd restart16:16
cheryljperrito666: do you have a minute?16:17
natefinchcherylj: is this something that'll get fixed?  Or is this something special because we ran old versions of lxd, or?16:19
cheryljnatefinch: you should only have to do it once16:19
cheryljbut it's something that right now, you have to do every time for newly provisioned instances16:20
natefinchcherylj: ew16:20
cheryljyeah16:20
natefinchcherylj: omg, this is so much worse than I expected16:23
cheryljhahaha16:23
natefinchseriously, an order of magnitude16:23
cheryljyeah16:23
cheryljit's *awesome*16:23
natefinchI hope the only thing I have to change the default for is the name of the bridge16:23
frobwarecherylj: but at least I can run --upgrade-juju now with LXD containers... makes debugging a little quicker.16:24
natefinchand lol still fails with the same error message16:25
* natefinch reboots just in case16:27
alexisbnatefinch, for master I was able to get it working by running lxd init and configuring the bridge and network that way16:27
natefinchalexisb: ok16:27
natefinchalexisb: oh, it doesn't want me to to that since I have existing containers, let me dump those16:28
bogdanteleagais there a way to replace the tools that are in state?16:28
bogdanteleagato deploy a machine with freshly built tools?16:28
alexisbnatefinch, yep you have to dump those, then I also removed my lxc bridge16:28
alexisbnot sure if that step was necessary, but that was my process16:28
natefinchstill thinks I have containers around, even though list says there aren't. Sigh.  Gotta run to lunch, will pick this up after.16:32
=== natefinch is now known as natefinch-lunch
=== redir is now known as redir_afk
dimiternso the missing juju-mongodb3.2 package on xenial broke AWS bootstrap as well as MAAS (with update/upgrade enabled)16:53
cheryljperrito666: ping?16:53
cheryljdimitern: yeah, I'm working on it16:53
cheryljdimitern: well, the problem is now that it's there16:54
cheryljand we're not looking in the right place for it16:54
dimiterncherylj: oh, cheers then! :)16:54
perrito666dimitern: what?16:54
cheryljperrito666: hey, I've got mongo questions for you :)16:54
perrito666dimitern: current master wont fail if the package is not there16:55
perrito666cherylj: sure16:55
cheryljperrito666: it does :(16:55
dimiternperrito666: yeah? :)16:55
cheryljwait16:55
dimiternperrito666: sure16:55
cheryljsorry16:55
cheryljit fails if it *is* there16:55
cheryljheh16:55
perrito666cherylj: ok, ill need more details16:55
cheryljI can has english16:55
cheryljperrito666: can you HO?16:56
perrito666cherylj: gimme a sec16:56
cheryljperrito666: np, when you're ready:  https://plus.google.com/hangouts/_/canonical.com/mongo-fun?authuser=016:56
mgzthat sounds fun16:59
perrito666cherylj: mgz look its no fun adding bugs to stuff if you people are going around finding them17:07
cheryljha17:07
cheryljso it *IS* sabotage?17:07
cheryljhey mgz - about functional-container-networking17:08
mupBug #1569467 opened: backup-restore loses the hosted model <backup-restore> <ci> <regression> <juju-core:Triaged> <https://launchpad.net/bugs/1569467>17:08
cheryljoh yeah, I was going to look at that ^^17:08
cheryljgood timing, mup17:08
cheryljmgz: there was a change in juju ssh to default to not using the proxy17:08
cheryljwhich breaks that test on AWS17:09
mgzoh fun17:10
cheryljmgz: but an easy fix.  Just use juju ssh --proxy=true17:10
cheryljand backwards compatible to boot17:10
mgzhow long have we had the --proxy flag?17:10
mgzI guess it doesn't matter too much, can just supply it always for 2.017:11
cheryljhttps://goo.gl/X0oQBt17:11
perrito666cloud "lxd" not found, trying as a provider name  <--- such is my luck17:23
mgzperrito666: that's an expected warning17:27
mgzperrito666: it should still continue fine from there17:28
perrito666mm I am getting same error as nate, I wonder if the upgrade did something to my conf17:31
=== natefinch-lunch is now known as natefinch
natefinchso... lxc list returns an empty list, but lxd init says error: You have existing containers or images. lxd init requires an empty LXD.17:47
* natefinch reboots just in case17:48
natefinchsigh17:49
natefinchhey, that's a ifferent error message17:50
natefinch$ juju bootstrap local-apr-12 lxd --upload-tools17:50
natefinchERROR cannot find network interface "lxcbr0": route ip+net: no such network interface17:50
natefinchERROR invalid config: route ip+net: no such network interface17:50
alexisbnatefinch, it should not be looking for lxcbr017:50
alexisblxdbr017:51
alexisbare you working off master?17:51
perrito666natefinch: did you dpkg-reconfigure lxd ?17:51
perrito666be sure to sat yes to the ipv4 config17:52
natefinchperrito666: yes, I did, but I changed lxdbr0 to lxcbr0... I guess that was not the right thing to do.17:52
perrito666natefinch: I did too and am working now with lxd17:52
perrito666bootstraping a xenial as we speak17:52
alexisbnatefinch, you have time for a hangout17:53
alexisbw should be able to work through this17:53
natefinchalexisb: definitely... I'd love to get past this17:53
alexisbk, out 1x1 HO17:53
perrito666lemme know if I can help you17:54
cheryljugh, I can't even get restore to work17:56
cheryljthe db just exits17:56
cheryljlike "see ya, suckers"17:56
cheryljApr 12 17:49:41 ubuntu mongod.37017[3194]: Tue Apr 12 17:49:41.356 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends17:56
natefinchperrito666: thanks, alexis is helping me out17:57
cheryljI hit this during the last restore problem I was debugging17:57
cheryljperrito666: did you ever see this restore problem?17:58
perrito666cherylj: never, which is weird since I coded it17:58
cheryljI hit this every time.  am I doing something wrong?  argh!18:00
natefinchyay, alexisb fixed it for me :)18:02
alexisb:)18:03
natefinchugh wow, I wonder if there's a network problem between me and wherever the images are hosted 'cause dayum this is a slow download18:03
alexisbnatefinch, they have been very slow18:03
alexisbonce the image is cached it is easy18:03
natefinchyeah18:04
alexisbyou can always copy the image over and alias it with the tag18:04
alexisblxd will look for the tag and use it18:04
natefinchalexisb: this will be done in 5 minutes or so, it's ok18:07
natefinchgah... is juju ssh supposed to work?18:16
perrito666natefinch: might fail in lxd18:17
perrito666natefinch: just lxc list and ssh to the machine18:17
mupBug #1569490 opened: storage-get crashes on xenial (aws) <storage> <juju-core:New> <https://launchpad.net/bugs/1569490>18:17
natefinchyou just need to put -m <model> before the machine number for some reason18:17
natefinchoh, I guess because if you put it after, it thinks that's the ssh command18:18
natefinchblech18:18
natefinchperrito666: works fine in lxd... just PEBCAK18:19
perrito666lol I just ssh I am lazy18:19
natefinchI juju ssh because I'm lazy :)18:20
natefinchwhelp, figured out why I always call kill-controller and not destroy-controller... I don't have to type out the pesky --destroy-all-models18:31
cheryljyep18:32
cheryljnatefinch: are you trying to ssh to machine 0 just after a bootstrap?18:33
natefinchcherylj: yes, but it was just a problem of spelling the command correctly, what with multiple models and stuff18:34
cheryljah, ok18:34
cherylj..... and now mongo3.2 has hit the mirrors for my region18:35
cheryljyay18:35
natefinchcherylj: like, it defaults to an empty model, but I wanted to ssh to the controller, so I had to specify the model, but if you put that after juju ssh 0 then it thinks it's a command....18:35
cheryljyeah, that's totes annoying18:35
natefinchand I happened to have already created a machine in the non-admin model, so juju ssh 0 still worked and tried to run -m admin as an ssh command, which gave a wacky error message18:36
redirif unrelated tests fail in CI, do I need to resubmit the PR?18:41
natefinchyes, if you think they're spurious and will go away18:41
natefinch...which is fairly common, unfortunately.  But if you're not sure, send a link and we can help18:42
redirwell the first failure is a termination worker timeout which is fine locally and I can't imagine that it would be related to helptext updates, so I'll resumbit in a bit.18:47
redirsecond failure is because it can't untar juju-core_2.0-beta4.tar.gz...18:49
redirwhich seems like a CI hiccup18:49
natefinchsinzui: ^18:49
redirI'll resumbit both after the queue shrinks.18:49
natefinchredir: I wouldn't count on the queue shrinking, just sayin' :)18:50
cheryljtrue dat18:50
natefinchredir: yes, sounds like one-off failures, though the failure to untar is concerning18:50
redirno such file/dir so prolly failed to DL in time.18:51
sinzuiredir: looks like a hiccup, the tar file didn't arrive on the testing instance.18:51
mgznatefinch: looking at the log, we got ssh disconnected when scping the source to the ec2 test running machine18:51
mgz...sinzui won ;_;18:52
sinzuioh, is this using the xenial ami?18:52
sinzuimgz: We are testing with the xenial from last week.18:53
rediryeah I see 'lost connection' above18:53
redirI know exactly what will fix this for me.18:53
redirSoup and/or sandwich18:53
=== redir is now known as redir_lunch
cheryljif only that were the answer to all problems.  sigh...18:54
mgzmmm, soup18:54
redir_lunchI guess it is just a work-around18:55
=== redir_lunch is now known as redir
mupBug #1569529 opened: update-clouds strips "DO NOT EDIT" warning <ci> <update-clouds> <juju-core:Triaged> <https://launchpad.net/bugs/1569529>19:17
natefinchsinzui, mgz: is there a trick to compiling for arm64?  GOARCH=arm64 go build github.com/juju/juju/cmd/juju returns errors from lxd about undefined functions19:18
sinzuinatefinch: You can compile on the actualy host if you lile, That is what we do19:19
natefinchsinzui: I guess... cross compile *should* work and lets me edit in my local environment... but I guess I can copy my code up19:20
sinzuinatefinch: We cross compile windows. In the case of all builds, we use the release tarfile. The scripte that makes it double checks the deps and purges undocumented packages.19:21
sinzuinatefinch: The installed lxd packages can differ between archs in ubuntu.19:23
cheryljsinzui: Okay, I actually got a restore to work.  Does the test kill the controller?  or use destroy-controller?19:23
natefinchsinzui: yes, not the code, though... and I'm getting a compile error19:23
sinzuicherylj: kill-controller.19:23
cheryljthanks.19:24
cheryljbtw - the output makes it look like it's a status command that's failing:19:24
cheryljERROR:root:Command '('juju', '--show-log', 'show-status', '-m', 'functional-backup-restore', '--format', 'yaml')' returned non-zero exit status 119:24
cheryljit's just confusing for me19:24
cheryljbut anyway19:24
natefinchsinzui: oh, it uses cgo, that's probably the problem19:25
sinzuinatefinch: I don't think arm64 golang-1.6 is using cgo. only the osx is using cgo to my knowledge19:25
natefinchsinzui: no no, sorry, not being clear. The LXD code uses cgo, which complicates cross compilation19:26
sinzuiah19:26
sinzuiyeah it does. natefinch . We had to setup a dedicated  OS X builder because it does need cgo to link to the native crypto libs19:26
sinzuinatefinch: this long log shows the last build of arm64 for master http://reports.vapour.ws/releases/3881/job/build-binary-xenial-arm64/attempt/42419:28
natefinchlooks like the reason that yuo can cross compile windows is because the cgo stuff is all linux only.... what a PITA.19:31
natefinch..well, duh, of course the lxd stuff isn't compiled in Windows :)19:35
natefinchsinzui: the arm64 machine can't access github, can it? :/19:36
sinzuinatefinch: I just sent you an email with the ssh rules I use. The machine is on Canonical's network. It cannot see much19:37
natefinchsinzui: yeah, I got the ssh config stuff from cherylj last night.  I guess tgz it is19:37
perrito666cherylj: I got it fixed, ill make a pr, this goes against master?19:41
natefinchWhat happens when I targz a brand new gopath with just juju in it: -rw-rw-r-- 1 nate nate 216M Apr 12 15:44 src.tar.gz19:45
natefinchoh well, ship it.  Take longer to fix it than just push it up.  Yay for a decent upload speed.19:47
natefinch4.8 MB/s... I'll take it19:47
alexisbnatefinch, I was wondering if you had a minute to repay the favor from earlier :)19:50
alexisbI am stuck on a test update that I am sure is a simple "how go works" type q19:51
bogdanteleagacan I actually forcibly kill a controller using current master?19:54
bogdanteleaga"kill-controller" seems to be stuck waiting19:54
alexisbbogdanteleaga, you should be able to with kill-controller19:55
alexisbif it is not working it is a bug19:55
bogdanteleagaseems to be very happily stuck on "Waiting on 1 model, 2 machines, 3 services"19:56
bogdanteleagaalexisb, but I might be able to help with the how go works thing :p19:56
redirsinzui: got a second?20:06
sinzuiI do20:06
cheryljperrito666: yes, against master20:07
cheryljbogdanteleaga, alexisb if the model is not in a good state, kill controller can "hang"20:07
natefinchalexisb: sorry, yes, I can help20:08
cheryljbogdanteleaga: see bug 156642620:08
mupBug #1566426: kill-controller should always work to bring down a controller <juju-release-support> <kill-controller> <juju-core:Triaged> <https://launchpad.net/bugs/1566426>20:08
bogdanteleagacherylj, yeah I turned of the controller, issued it again and it went straight to the provider20:08
cheryljthere's a "workaround" in there20:08
bogdanteleagas/of/off20:08
cheryljyeah, that's the workaround :)20:08
alexisbnatefinch, back to the 1x1 hangout20:09
cheryljwhile I have you here, bogdanteleaga, is bug 1516668 addressed by your action changes?20:09
mupBug #1516668: Switch juju-run to an API model (like actions) rather than SSH. <2.0> <2.0-count> <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1516668>20:09
bogdanteleagacherylj, yup20:10
cheryljbogdanteleaga: and that landed, right?20:10
bogdanteleagacherylj, correct20:10
cheryljyay, fix committed it is, then!20:11
bogdanteleagaI think sometime last week20:11
redirtx sinzui20:11
cheryljbogdanteleaga: also bug 1470820 - now that we're ta go 1.6, should this be done?20:11
mupBug #1470820: Remove github.com/gabriel-samfira/sys/windows once go 1.4 lands <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1470820>20:11
bogdanteleagacherylj, https://bugs.launchpad.net/juju-core/+bug/142672920:12
mupBug #1426729: juju-run does not work on windows hosts <juju-agent> <run> <ssh> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1426729>20:12
bogdanteleagathis too probably20:12
bogdanteleagacherylj, yeah I've talked with curtis about that one last week before the CI switch20:13
bogdanteleagahowever I'm still unsure20:13
bogdanteleagasince the tests on windows get ran using 1.220:13
cheryljbogdanteleaga: maybe something to look at for 2.1 then?20:13
mupBug #1545116 changed: When I run "juju resources <service>" after a service is destroyed, resources are still listed. <2.0-count> <juju-release-support> <resources> <juju-core:Fix Released by cox-katherine-e> <https://launchpad.net/bugs/1545116>20:17
bogdanteleagacherylj, I was about to say it shouldn't be that hard to get the tests passing on 1.6 until I saw the last email with the job20:20
bogdanteleagacherylj, we might have to push it further back I guess20:21
bogdanteleagaany idea what's up with all the "no tools" test errors?20:21
cheryljbogdanteleaga: do you have a job link you could send?20:22
cheryljmgz: you still around?20:22
mgzcherylj: yo20:22
bogdanteleagacherylj, http://reports.vapour.ws/releases/3881/job/run-unit-tests-centos7-amd64-go1_6/attempt/120:23
bogdanteleagasorry20:23
bogdanteleagahttp://reports.vapour.ws/releases/3881/job/run-unit-tests-win2012-amd64-go1_6/attempt/120:23
bogdanteleagathis one20:23
cheryljhey mgz could you help me figure out the juju commands that are run as part of the functional-backup-restore test?20:24
cheryljI can't recreate using what I *think* is going on, and the job output is unhelpful20:24
cheryljbogdanteleaga: let me take a look20:24
cheryljbogdanteleaga: I *think* there is one place in the test suite I could change to fix a lot of those problems20:25
mgzcherylj: sure, also refer to assess_recovery.py for the details20:27
perrito666how can git not be able to fix a conflict where one commit has nothing and the other has something there....20:28
perrito666cherylj: did anyone just land anything in master?20:31
mgzcherylj: if you want, we can also rerun a CI job with --verbose for the explicit20:31
cheryljmgz: would you be able to do that for this job?  It would be most helpful to see the output of the reboostrap20:32
bogdanteleagacherylj, sounds good, I don't understand how changing the go version can give that kind of error20:32
perrito666cherylj: well a change from wallyworld_ has just landed that broke my patch and pseudo fixed the issue20:32
cheryljhmm20:32
mgzcherylj: backup-restoe exactly, not one of the other variants?20:32
mupBug # changed: 1175580, 1235529, 1276403, 1279879, 128094920:32
cheryljmgz: yeah functional-backup-restore20:33
mgzbuilding20:33
perrito666I really need a punching bag in my office20:34
cheryljsounds like an idea for the next team sprint, perrito66620:34
cheryljinstead of tshirts20:34
cheryljhere's a punching bag!  (complete with juju logo)20:34
perrito666cherylj: oh no need, in the sprint I can use wallyworld_  :p20:34
cheryljlol20:34
wallyworld_perrito666: wot you talking about?20:35
perrito666wallyworld_: GO TO SLEEEEEEEEP20:36
TheMuehehe20:36
perrito666oh ts 6:30 tis ok20:36
wallyworld_perrito666: i just woke up20:36
perrito666wallyworld_: go breakfast?20:36
TheMuepunching bags w/o sand, otherwise hard to take it as hand luggage in the plane20:36
perrito666anyway we just clashed on a fix20:36
wallyworld_perrito666: getMongoDumpPath still needs to be fixed20:37
TheMueperrito666: I'll go to bed instead of wallyworld_. here it is almost 11pm now, so time is getting closer.20:37
cheryljwallyworld_: no sts call today, btw20:37
wallyworld_cherylj: yeah, saw, ty20:37
wallyworld_i can actually have breakfast :-)20:38
perrito666this inability to actually finish destroying controllers is beginning to get into my nerves20:39
perrito666finally20:40
mgzoh, what the pants. assess_recovery.py is one of our few jobs that doesn't use common args yet20:44
mupBug # changed: 1158187, 1280953, 1289619, 137490620:47
mgzcherylj: really rebuilding this time20:51
cheryljI'm watching it now, mgz  :)20:52
mgzhm, I want to make our wait loops nicer with --verbose20:53
natefinchgah, I can't tell if I've fixed this bug, because --upload-tools hides it20:57
cheryljyeah, what a pain  :(20:57
natefinchcherylj: I gotta run to make dinner for the kids.  won't be back for a few hours until after they're in bed.20:59
cheryljnatefinch: can you push your changes somewhere?  maybe we could make a branch and test?21:00
natefinchcherylj: here's a PR..I am honestly not super confident in the fix, since I was kind of running blind... and furthermore the tests in that package pass both before and after I made my change, which means they're not actually testing that21:02
natefinchcherylj: https://github.com/juju/juju/pull/511621:02
cherylj:(21:02
cheryljthanks, natefinch, we'll see what we can do21:02
natefinchcherylj: I'll be back on likely in 3.5 hours.21:02
=== natefinch is now known as natefinch-afk
mgzcherylj: run finished, 'INFO juju --show-log' search should get you all the commands21:08
mupBug #1554863 changed: juju bootstrap does not error on unknown or incorrect config values <2.0-count> <juju-release-support> <juju-core:Fix Released> <https://launchpad.net/bugs/1554863>21:09
cheryljthanks mgz21:10
perrito666cherylj: http://reviews.vapour.ws/r/4552/21:12
cmarsdoes lxd placement work? as in, should i be able to juju deploy xyz --to lxd:<machine-number> ?21:15
katcocherylj: i need a new bug to work on. all of them seem to require a lot of context... any suggestions on what to pick up?21:15
cheryljlet me look21:15
cmarsdoes lxd placement work? as in, should i be able to juju deploy xyz --to lxd:<machine-number> ?21:16
cheryljkatco:  you can review perrito666's PR while I do that?  ^^ :)21:16
cmarssorry, wrong window21:16
katcocherylj: sure21:16
katcoperrito666: if you can review mine :) http://reviews.vapour.ws/r/4551/21:16
cmarswas up-arrow,enter-ing in a term21:16
perrito666katco: just in case, check it in github too, I am not sure how well rb takes amends21:16
perrito666katco: sure21:16
katcoperrito666: where's the test for this?21:18
perrito666katco: mm, you are right, that did not break a test, lemme check that again21:20
perrito666katco: ship it, but, I am curious, why this change?21:21
perrito666this is going to make developmente testing incredibly hard21:21
katcoperrito666: just going on what the bug said. "the decision has been made"21:24
katcoperrito666: i was not part of that conversation21:24
perrito666oh, ok, well It is time to resurrect my fake streams builder it seems21:25
perrito666well of course I did not break any tests... there arent tests for that, well, lets fix that21:26
katcoperrito666: :)21:26
perrito666aaand of course, external tests21:27
katcoperrito666: what do you mean external tests?21:27
perrito666package_test tests21:30
katcoperrito666: i think that's devs discretion and i actively avoid doing that21:30
katcoperrito666: because it just causes boilerplate churn21:30
perrito666I believe Ill do regular unit tests21:31
* katco cheers21:31
perrito666I am on your side, I was protesting that the existing ones are externals21:31
perrito666I cant wait for this semester discussion about internal vs external tests21:31
katcoperrito666: lol21:32
* perrito666 has it pretty much like one of the sprint events21:32
* redir is in a maze of twisty little passages, all alike21:40
katcoredir: please beware of the gru, we've only begun to get to know you.21:40
redir:)21:41
perrito666oh dont worry, if you find it just throw the status tests to it, that should keep it occupied a good half an hour21:47
mupBug #1565089 changed: create-model does not use the same config format as bootstrap <jujuqa> <juju-core:Fix Released> <https://launchpad.net/bugs/1565089>21:48
mupBug #1566303 changed: uniterV0Suite.TearDownTest: The handle is invalid <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Invalid> <juju-core 1.25:Fix Released by dave-cheney> <https://launchpad.net/bugs/1566303>21:48
mupBug #1339931 changed: Status panicks during juju-upgrade <panic> <status> <upgrade-juju> <juju-core:Fix Released> <https://launchpad.net/bugs/1339931>22:18
wallyworld_perrito666: quick chat?22:22
perrito666wallyworld_: sure22:22
perrito666where?22:22
wallyworld_standup22:22
bogdanteleagathis is impressive http://classicprogrammerpaintings.tumblr.com/22:30
perrito666wallyworld_: frozen22:31
perrito666wallyworld_: cannot hear you, you are frozen22:32
perrito666wallyworld_: you left me speaking alone22:35
anastasiamacperrito666: wow.. i think something exciting just happenned on our side... i was kicked out from perrito666uassel at least... maybe ian experiences fun too..22:37
anastasiamacquassel that is..22:37
wallyworldperrito666: sorry, chrome ate all my memory :-(22:39
=== alexisb is now known as alexisb-afk
mupBug #1567690 changed: Can't push charm to my new LP home <juju-core:Invalid> <https://launchpad.net/bugs/1567690>23:15
thumperugh... struct equality again...23:25
thumperwhat's valid?23:25
davecheneystruct equality ?23:33
thumpernm23:34
thumperinterestingly...23:34
thumperif args == StructType{} {23:35
thumperreturn nil23:35
thumperdoesn't work23:35
thumperbut23:35
thumpervar empty StructType23:35
thumperif args == empty {23:35
thumperdoes23:35
thumperhit this before, and no idea why Go doesn't like it23:35
bogdanteleagathumper, have you tried args == (StructType{})?23:37
thumperno23:37
thumperbut I find that less readable23:37
thumperso would probably go with empty var23:38
anastasiamacwallyworld: ? :/23:42
bogdanteleagait breaks symmetry though :P23:44
davecheneythumper: http://play.golang.org/p/C16rPMEAlO23:50
davecheneyit's a parsing ambiguity because the parser cannot tell where the start of the block begins and the struct literal ends23:51
davecheneyironicall it can with this even more verbose version23:52
davecheneyhttp://play.golang.org/p/R_ui2oTlma23:52
davecheneybut, what you're trying to do smells bad23:52
wallyworldkatco: around?23:54
mwhudsoncan i get some juju usage help?23:54
wallyworldcherylj: katco: i think we got the PR for bug1567170 backwards23:55
mwhudsoni'm trying to test the juju-mongo-tools3.2 package i made23:55
mwhudsonso i need to try to make a backup23:55
mwhudsoni have an controller bootstrapped in ec223:55
wallyworldmwhudson: bootstrap with mongo 3.2 is broken at the moment23:55
mwhudsonbut now i get23:55
mwhudson(master *)mwhudson@aeglos:juju-mongo-tools3.2$ juju backups create23:55
mwhudsonERROR backups are not supported for hosted models23:55
mwhudsonwallyworld: i merged perrito666's PR23:55
wallyworldmwhudson: juju create-backup -m admin23:56
wallyworldor first switch to admin23:56
wallyworldjuju switch admin23:56
wallyworldwhen you bootstrap, you are switched to the hosted model23:56
mwhudsonERROR while preparing for DB dump: mongodump not available: failed to get mongod path: exec: "mongod": executable file not found in $PATH23:56
mwhudsonwin, i think23:56
mwhudsonwallyworld: now how do i log into the controller node?23:56
cheryljwallyworld, katco I think you're right23:56
wallyworldmwhudson: yeah, that's a bug i told horatio i found yesterday when doing a code read23:57
mwhudsonoh juju ssh 023:57
mwhudsonoh right23:57
wallyworldmwhudson: the mongodump path needs to be fixed23:57
wallyworldi'll do a fix today23:57
mwhudsonwallyworld: well mongodump is not even installed23:57
wallyworldmwhudson: that's because the mongotools package is not installed23:58
wallyworldjuju should depend on it23:58
mwhudsonwallyworld: because i haven't uploaded it yet :-)23:58
wallyworldright :-)23:58
mwhudsonso i was going to install the package from the ppa23:58
wallyworldmwhudson: but even when it is uploaded, juju will look in the mongo2.4 path :-(23:58
mwhudsonbut you're saying that even that won't work, because the path is wrong?23:58
mwhudsonexcellent23:58
wallyworldi will do a fix this morning23:59
wallyworldi only just saw it yesterday doing a code read by accident23:59
wallyworldthe backup code is not something i am 10000% familiar with23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!