[00:33] <alexisb> ok axw ready when you are
[01:01]  * redir eods. may be back later.
[01:07] <blahdeblah> hi folks - anyone available to help troubleshoot what looks like a bug in user removal?  https://pastebin.canonical.com/169528/
[01:11] <wallyworld> blahdeblah: not sure about troubleshoot - looks like a straight bug. when users are removed, they are actually marked as inactive. looks there's there's some logic issues there
[01:12] <wallyworld> axw: remind me - for bootstrap, the majority of machine config is done via ssh; cloud init is used to get the ssh keys onto the machine I think. is that also the case for workload machine provisioning ie we do the bulk of setup via ssh and not cloud init?
[01:17] <axw> wallyworld: we don't use ssh at all for non-bootstrap machine provisioning
[01:17] <wallyworld> axw: ta, i thought that was the case but wasn't certain
[01:17] <axw> wallyworld: (apart from one or two providers which may use it internally)
[03:13] <natefinch> axw, menn0: do you want me to come into the tech board meeting to talk about the dependencies I emailed about, or are you good?
[03:16] <menn0> natefinch: it might be useful if you could talk about them when we get to that bit, but we can also manage without you if you're finishing up for the day
[03:16] <natefinch> menn0: I have some time
[03:16] <menn0> natefinch: cool. i'll ping you when we get to it (or join whenever you like)
[03:16] <natefinch> menn0: cool, thanks
[04:00] <menn0> natefinch: now?
[04:00] <natefinch> menn0: omw
[04:26] <mup> Bug #1254402 changed: error bootstrapping on ec2 duplicate security group <ec2-provider> <security> <juju-core:Expired> <https://launchpad.net/bugs/1254402>
[04:26] <mup> Bug #1456725 changed: TestActionEvents fails <ci> <juju-core:Expired> <juju-core 1.22:Won't Fix> <https://launchpad.net/bugs/1456725>
[04:26] <mup> Bug #1502139 changed: Panic in TestUpgradeJuju <ci> <panic> <juju-core:Expired> <https://launchpad.net/bugs/1502139>
[04:36] <redir> anastasiamac: yt?
[05:58] <anastasiamac> redir: i m. why r u? (was doing a school pick-up)...
[06:31] <wallyworld> anastasiamac: do you recall - i think --metadata-source for bootstrap was broken around beta15 timeframe and it needed to be fixed before 2.0GA. Right?
[06:32] <anastasiamac> wallyworld: sounds about right..
[06:32] <anastasiamac> wallyworld: why r u in beta15?
[06:32] <wallyworld> i'm not
[09:44] <dimitern> voidspace: ping
[10:10] <voidspace> dimitern: pong
[10:10] <dimitern> voidspace: so I've been testing your gomaasapi change: https://github.com/juju/gomaasapi/pull/62
[10:11] <dimitern> voidspace: it looks like it's doing the right thing (compared to the maas cli at least) with one or more negative spaces constraints
[10:11] <voidspace> dimitern: great
[10:12] <dimitern> voidspace: however, I can see that 'unorderable types Subnet() < Subnet()' in some cases
[10:12] <dimitern> voidspace: is there a bug for that in maas?
[10:12] <voidspace> dimitern: I've never seen that
[10:12] <voidspace> dimitern: is that an error from MAAS or in the gomaasapi code?
[10:14] <dimitern> voidspace: from maas - e.g. when trying `jujy bootstrap --no-gui --debug vmaas-21 --config=~/.j/conf-x-fast.yaml --constraints 'arch=amd64 spaces=^compute,^external'` - the config just sets trace logging, default-series: xenial, disables apt update/upgrade
[10:14] <voidspace> dimitern: ah, so definitely sounds like a MAAS bug
[10:15] <dimitern> voidspace: there's 1 machine that matches those spaces, and here's the error we get: http://paste.ubuntu.com/23415499/
[10:16] <dimitern> voidspace: yeah, IIRC mpontillo did mention something about that and they seem to be fixing it
[10:16] <voidspace> dimitern: cool, so I don't think we should hold up this PR with it - I haven't seen a MAAS bug for it
[10:16] <voidspace> dimitern: worth filing even if it turns out to be a duplicate
[10:19] <dimitern> voidspace: I'll look into filing one later today; just testing with 2.0 now - 2.1 tested OK
[10:19] <voidspace> dimitern: I have a very short PR fixing not_networks for 1.9 I'd like you to test too if possible
[10:19] <voidspace> dimitern: will ping in a couple of minutes
[10:20] <dimitern> voidspace: sure - can do - is it about the way we serialize multiple negatives?
[10:22] <voidspace> dimitern: yep
[10:23] <voidspace> dimitern: changing from comma separated to multiple parameters
[10:32] <dimitern> voidspace: ok
[10:32] <dimitern> mgz: ping
[10:33] <dimitern> mgz: do you know which mongo version are we using for the windows CI slave running this job: http://reports.vapour.ws/releases/4546/job/run-unit-tests-win2012-amd64/attempt/3002#highlight
[10:33] <dimitern> mgz: if it's 2.6.x, the test might be failing due to this mongo bug - https://jira.mongodb.org/browse/SERVER-14840
[10:52] <dimitern> voidspace: tested on 2.0 successfully and LGTM-ed
[10:53] <voidspace> dimitern: you rock
[10:55] <dimitern> voidspace: it took me a lot longer to setup the spaces / subnets on maas than to run bootstrap OK :)
[10:56] <voidspace> dimitern: I can imagine
[10:56] <voidspace> dimitern: my maas 2 is not playing ball and won't enlist new nodes
[10:56] <voidspace> burned a few hours on it :-/
[10:56] <voidspace> dimitern: might have to reinstall from scratch
[10:57] <voidspace> got inveigled in another conversation
[10:57] <voidspace> about to create the PR for maas 1.9
[10:57] <voidspace> and I'll do PRs to bump the gomaasapi dependency in juju
[10:57] <voidspace> both for 2.0 and develop branches
[10:58] <dimitern> voidspace: I'm now using frobware's kvm-maas-add|remove-node with great success to add nodes - see https://github.com/frobware/kvm-maas/pull/1
[10:58] <dimitern> it takes <5m to create, enlist, and commission 6 KVM nodes with multiple NICs
[10:58] <voidspace> dimitern: yeah, I've used that before - don't know why I didn't think of it.
[10:58] <voidspace> dimitern: will try it now
[10:59] <voidspace> dimitern: it uses the api so should work fine
[10:59] <voidspace> dimitern: I'll just delete my existing nodes that MAAS won't recognise and try again
[10:59] <dimitern> voidspace: it works quite well, but I'd suggest trying my modified version (re that PR), as it improves quite a few things :)
[11:00] <dimitern> voidspace: like not hard-coding 4 NICs per node but as many as you've passed as args
[11:00] <voidspace> dimitern: where's your version?
[11:01] <dimitern> voidspace: this branch essentially: https://github.com/dimitern/kvm-maas/tree/multiple-networks
[11:01] <voidspace> dimitern: cool, thanks
[11:01] <voidspace> dimitern: I only have two spaces/subnets defined in maas - but that's easy to change and enough to test this anyway
[11:02] <dimitern> voidspace: +1
[11:28]  * dimitern steps out for ~1h
[11:31] <rogpeppe1> does anyone know if juju restore actually works?
[11:55] <mgz> dimitern: see bug 1637294 btw
[11:55] <mup> Bug #1637294: Windows host needs a current mongodb (3.2.x) <juju-ci-tools:Triaged> <https://launchpad.net/bugs/1637294>
[11:59] <dimitern> mgz: cheers!
[11:59]  * dimitern is just getting out the door - bbiab hopefully in ~1h
[12:05] <SimonKLB> is aws efs volumes something that is on the horizon or will it be a while before network shared storage will be available in juju?
[12:05] <SimonKLB> it would be really great being able to deploy multiple units that share the same filesystem
[12:26] <voidspace> dimitern: sorry for the delay I got distracted: https://github.com/juju/juju/pull/6528
[12:26] <voidspace> dimitern: bugger, I need to retarget that to develop not staging
[12:27] <voidspace> dimitern: done
[12:27] <voidspace> unfortunately means pre-check failed
[12:27] <voidspace> all unit tests pass though
[12:37] <voidspace> dimitern: and https://github.com/juju/juju/pull/6529
[12:37] <voidspace> dimitern: gah, conflicts
[12:42] <voidspace> dimitern: rick_h___: so, when a PR forked off staging but targetted against develop has conflicts
[12:42] <voidspace> dimitern: rick_h___: I assume the correct approach is to merge develop into the PR and fix the conflicts?
[12:42] <voidspace> I have both "go fmt" and build failures (probably related to go version) with current develop
[12:42] <voidspace> so I've fixed both those as part of the conflict resolution and they'll now show up in my PR
[12:43] <voidspace> running all related tests
[12:43] <rick_h___> voidspace: the best thing is to cherry pick the conflict commit and resolve the conflicts
[12:43] <rick_h___> voidspace: imo
[12:43] <voidspace> rick_h___: so fork off develop and just make the new commit
[12:44] <voidspace> rick_h___: I think that has the same end result - and I still need to fix the two issues
[12:44] <voidspace> rick_h___: thanks
[12:44] <rick_h___> voidspace: so checkout develop, update it from upstream, go to your branch, and cherry pick the conflict from develop
[12:44] <voidspace> rick_h___: ah, I see
[12:45] <voidspace> rick_h___: that would be better, yes
[12:45] <voidspace> rick_h___: I'm still concerned that we have a "go fmt" error and a build error on develop!
[12:45] <voidspace> rick_h___: (the build error is in a test)
[12:45] <voidspace> rick_h___: and is likely to be go version related - but with my fix tests all pass
[12:46] <voidspace> rick_h___: this is now my PR (very short) https://github.com/juju/juju/pull/6529/files
[12:47] <voidspace> rick_h___: (self assignment to args.Host was the build error I saw)
[12:53] <voidspace> mgz: thanks for the magic incatation on my branch - I've repeated it
[12:54] <mgz> voidspace: I'm a little surprised it didn't listen to mine
[12:55] <mgz> voidspace: also, lgtm
[12:55] <voidspace> mgz: cool, thanks
[12:55] <voidspace> mgz: I'll wait for the check and for dimitern to QA
[13:08]  * dimitern is back
[13:10] <rogpeppe1> a small names change to make it easier to work with empty cloud credentials: https://github.com/juju/names/pull/77
[13:10] <rogpeppe1> reviews appreciated: ^
[13:11] <dimitern> voidspace: looking at both of your PRs, and QAing the 1.9 one
[13:13] <dimitern> actually QAing both of them as it's trivial
[13:14] <voidspace> rick_h___: is our 1:1 going to be on?
[13:19] <voidspace> rick_h___: I have no burning questions, so happy to skip this week
[13:24] <mup> Bug #1638560 opened: 1.25 broken on MacOS sierra <osx> <juju-core:Triaged> <https://launchpad.net/bugs/1638560>
[13:26] <abentley> rogpeppe1: Hi.  I've been asked to do one of the things we talked about yesterday: test the latest juju against a released version of JIMM, to ensure juju doesn't break what JIMM uses.  Do you have any tips on how to go about that?
[13:35] <rick_h___> voidspace: skip please
[13:35] <voidspace> rick_h___: kk
[13:47] <dimitern> voidspace: both PRs LGTM
[13:48] <voidspace> dimitern: you rock, you really do
[13:48] <voidspace> dimitern: about to propose same PRs against 2.0
[13:49] <dimitern> voidspace: ;) cheers
[14:03] <katco> natefinch: dimitern: frobware: standup time
[14:03] <frobware> katco: skipping, at the cloud sprint.
[14:04] <katco> frobware: ah ok... ta!
[16:00] <rick_h___> dimitern: ping for call
[16:08] <mpontillo> dimitern: the 500 error happens in lieu of a "no machine matched constraints" error. positive space constraints should happen in the interfaces constraint; they will not work properly in the 'subnets' constraint.
[16:08] <mpontillo> voidspace: ^
[16:09] <voidspace> mpontillo: ok, interesting
[16:17]  * dimitern well, it's been good 4 years... take good care ;)
[16:19] <natefinch> dammit
[16:21] <natefinch> mgz, voidspace, dooferlad: any of you know dimiter's home email?
[16:22] <natefinch> got it, thanks
[16:30] <katco> ....
[16:30] <katco> what just happened?
[16:34] <mgz> I do not know.
[16:35] <voidspace> :-(
[16:38] <natefinch> check your email
[16:39] <perrito666> natefinch: I believe that their reactions are mail related
[16:40] <natefinch> ahh, right
[17:01] <mgz> okay, I think I finally have a solution I might like with this ssh stuff
[17:02] <mgz> and I can do it in two somewhat sane prs
[17:02] <rick_h___> mgz: did you see jam's reply there?
[17:02] <rick_h___> mgz: he sent an email on the ssh notes a couple of days ago I think?
[17:02] <mgz> rick_h___: yeah, that sent me off down a rabbit hole
[17:02] <rick_h___> ah ok nice
[17:03] <mgz> which, to be fair, gets to a much better final result, but involves deeper magic
[17:58] <alexisb_> changing locations all, will be back online is a few minutes
[18:02] <mup> Bug # changed: 1541482, 1597601, 1626304, 1634289
[18:02] <rick_h___> heh, that was a drop off
[18:03] <katco> yeah
[18:03] <katco> i think the event ends when the person ends it, not when the time-delayed stream ends
[18:03] <katco> i've had that happen a few times now
[18:07] <natefinch> easy review anyone? https://github.com/juju/jsonschema/pull/2
[18:08] <natefinch> +19 -19
[18:08] <mgz> natefinch: I'm in reviewing mode while waiting for build so okay
[18:09] <mgz> natefinch: heh - er, are we going to use this for actual translations ever?
[18:09] <mgz> because if so singular/plural is wrong
[18:10] <natefinch> I'm not sure what you mean.  It's used for generating interactive UI
[18:10] <mgz> natefinch: https://www.gnu.org/savannah-checkouts/gnu/gettext/manual/html_node/Plural-forms.html
[18:12] <natefinch> ahh, the old "multiple plural forms"
[18:12] <mgz> if we only ever want this to do english it's fine
[18:12] <natefinch> you uh, let me know when we plan to translate Juju, and I'll get right on making this better :)
[18:12] <perrito666> well this is great, I only have decaf and I live too far from the coffee shop... I really need a second car or a bike safe city
[18:14] <natefinch> perrito666: I feel you, I ran out of coffee today too. luckily I have caffeine pills in the cupboard which let me function until I could get to a coffee shop
[18:15] <perrito666> natefinch: I live way closer to "civilization" than you do, I just have one car only which my wife takes to work so even though I live closer its not all that close
[18:15] <natefinch> mgz: anyway... yes, for now, I think it's sufficient.  At some point, if we want to localize juju, we'll need to update this.  But that's a much bigger job.  This is just so you can take jsonschema and produce reasonable english-looking queries out of it
[18:15] <mgz> natefinch: code changes approved.
[18:15] <natefinch> mgz: thanks :)
[18:16] <mgz> perrito666: I don't really believe that you can't use the internet to cause a man on a scooter to bring you coffee
[18:17] <perrito666> mgz: never been to south america eh?
[18:18] <mgz> perrito666: I simply trust your ingenuity
[18:19] <perrito666> well I guess I could kidnap one of mi neighbours and ask their family to bring me coffee but its a bit excessive
[18:19] <mgz> :D
[18:20] <natefinch> lol
[19:02] <katco> dooferlad: hey are you still around?
[20:10] <alexisb> perrito666, nice job on the quick turnaround on the backup/restore test failure
[20:13] <perrito666> thank me when CI passes, jenkins does not always agree with me ;)
[20:13] <perrito666> anyway, ill step out for a moment
[21:40] <redir> natefinch: yt?
[21:59] <menn0> wallyworld: unit tests appear to failing on non-ubuntu test hosts and it could be a recent change by you
[21:59] <wallyworld> damn ok, will look
[21:59] <menn0> wallyworld: http://reports.vapour.ws/releases/4551/job/run-unit-tests-win2012-amd64/attempt/3007#highlight
[21:59] <wallyworld> how did it land i wonder
[22:00] <wallyworld> i have meeting for the next hour will look after
[22:01] <menn0> wallyworld: b/c the windows tests for merge only seem to test packages under cmd/
[22:01] <menn0> which is a bit shit
[22:01] <wallyworld> well that sucks
[22:02] <perrito666> menn0: that sucks a lot
[22:02] <perrito666> and by that I dont mean wallyworld but the limited scope of windows tests
[22:03] <wallyworld> oh i suck too
[22:03] <wallyworld> menn0: luckily looks like it will just be a skip
[22:07] <menn0> wallyworld: sweet
[22:14] <babbageclunk> menn0: To do a migration, do I need to have bootstrapped both controllers with the feature flag?
[22:14] <menn0> yep
[22:15] <babbageclunk> that would explain it then!
[22:15] <menn0> I have this in my shell config:
[22:15] <babbageclunk> okthx
[22:15] <menn0> export JUJU_DEV_FEATURE_FLAGS=migration,developer-mode
[22:17] <babbageclunk> cool - what's developer-mode?
[22:18] <menn0> it enables commands like dump-db and dump-model
[22:18] <menn0> I *think* it also enables the introspection worker
[22:18] <menn0> or maybe that runs all the time, not sure
[22:18] <perrito666> babbageclunk: the world becomes pixelated around you and you hear 8 bit music, a bit like what happens in tron :p
[22:18] <babbageclunk> perrito666: so it's like DMT?
[22:19] <perrito666> wouldnt know :) but I would adventure things are a bit more nerdy
[22:19] <perrito666> like this https://www.youtube.com/watch?v=KEkrWRHCDQU
[22:20] <babbageclunk> I'm pretty sure that's how I learned to program!
[22:23] <perrito666> babbageclunk: to be more accurate https://www.youtube.com/watch?v=KEkrWRHCDQU&feature=youtu.be&t=134
[22:27] <babbageclunk> perrito666: I had to have a one minute cad chill-out to recover https://youtu.be/mNTj05I4k5I?t=6m9s