/srv/irclogs.ubuntu.com/2017/05/11/#juju-dev.txt

babbageclunkUgh, environs imports api?00:21
babbageclunkBut *I* want params to import environs! <pouts>00:23
* babbageclunk pouts more.00:24
babbageclunkthumper: ^ this seems wrong - environs shouldn't depend on api, right?00:25
axwbabbageclunk: it shouldn't, but nor should params depend on environs00:27
axwIIRC environs depends on api because of api.Info00:27
babbageclunkaxw: Why not? It depends on network.00:28
axwbabbageclunk: it probably shouldn't00:28
axwbabbageclunk: but mostly because environs has a complex mess of dependencies itself00:28
babbageclunkaxw: Darn, my solution was going to be to move ProviderSpaceInfo into network.00:28
axwbabbageclunk: params should be more or less self contained, we've just been lazy about it00:28
axwbabbageclunk: what should be done is to have a separate struct in params specifically for de/serialisation00:29
axwbabbageclunk: in a magical faraway time we hope to move the api code outside of core00:30
axwdepending on more stuff in tree would make that more difficult00:30
babbageclunkaxw: Hmm, I want to have a sensible place for conversion between params.RemoteSpace and environ.ProviderSpaceInfo. I can just have it in apiserver/application for now, but I'm going to need it in other facades.00:30
babbageclunkaxw: I guess apiserver/common then?00:30
babbageclunkaxw: But yeah, I see your point about pulling params out.00:31
axwbabbageclunk: yeah, that's what we've done in the past00:31
babbageclunkaxw: ok, thanks00:31
thumperyeah... some of those lower level things are ick00:32
axwveebers balloons: a third-party contributor has added support for openSUSE Leap as a new series ("opensuseleap"). how hard would it be to add it to the agents built in streams.canonical.com?00:33
veebersaxw: hmm, I'm not sure, balloons ? ^^00:36
veebersaxw: I take it the agents are built elsewhere (i.e. not us)00:37
axwveebers: nobody is building it yet, I'm thinking it would be built by us00:37
veebersaxw: I think it should be reasonably do-able, maybe straight forward even. Would like balloons opinion though before I promise anything ;-)00:41
axwbabbageclunk: standup01:00
babbageclunkaxw: sorry!01:00
balloonsaxw, the agents aren't generic?01:04
balloonsaxw, I imagine it would use the same agents; so it's simply a matter of us publishing them01:06
axwballoons: yeah, should be the same code as the other linux distros - I think we just need to update simplestreams?01:23
balloonsaxw, yes. I agree with veebers, very doable01:24
axwcool01:24
axwballoons: eventually we should also have a test or two for it, but that should probably wait until after the overhaul :)01:25
balloonsaxw, that's a question to ask back -- I guess we'll just use a cloud machine with opensuse, but which image, etc. Recommendations on a machine to run tests are welcome01:27
axwballoons: I don't know the answer to that yet. I guess on AWS, with updated image metadata. it's also possible to use LXD by modifying the image from linuxcontainers.org01:28
axwhml: reviewed01:36
hmlaxw: thx!01:36
axwhml: also I added to the release notes: " * MAAS 2.x block storage now works correctly with physical disks, when MAAS reports the WWN unique identifier (lp:1677001)."  -- do you think that's sufficient?01:36
axwoh, I can add the one about SSH/bootstrap too. that's a big one01:37
hmlaxw: is it easy to descibe “now works correctly”?01:37
axwhml: yeah, a bit vague :)  well it never worked at all before. I'll see if I can come up with something01:37
axwI guess just drop "correctly"01:38
hmlaxw: that helps.01:38
hmlaxw: how’s this for the ssh/bootrap:  SSH Keys of the bootstrap host are now verified before bootstrap, reducing opportunities for MITM attacks (lp:1579593)02:09
axwhml: that sounds great, thank you02:09
axwhml: s/reducing/eliminating/02:10
hmlaxw: eliminating the opportunity for an MITM attack?02:10
axwhml: yeah that sounds good02:11
balloonsaxw, hml, thumper, wallyworld, menn0, et la. We've lost our jenkins due to AWS hardware failure. It's unrecoverable. We're working on restoring from backup now, but CI will be offline until it's fixed. I expect at least another hour of downtime02:22
thumperhazaah02:23
hmlballoons: no fun.02:23
axwballoons: oh my :(02:23
menn0balloons: weeee02:24
balloonsgood fun eh? Turns our veebers, burton and I were kind of bored.. nothing to do clearly, so we needed some good fun02:24
veebers^_^02:25
hmlg’night all02:31
balloonsthings appear to be largely settled all, ci runs are happening again. we;re monitoring03:43
menn0balloons: nice work03:50
babbageclunkaxw: Do you know what Space.IsPublic is for?04:00
menn0babbageclunk: I just dig some digging and it looks like the command line always passes public=true04:04
menn0babbageclunk: jam might be able to shed some more light but it seems like an unused concept04:04
jamI will do no such thing. :)04:04
babbageclunkmenn0: Huh, so it doesn't do anything at the moment?04:04
babbageclunkjam: lol04:05
jamouch balloons, nice recovery04:05
babbageclunkmenn0: ha, looking in the discoverspaces worker it always creates them with false.04:06
menn0awesome :/04:12
thumperheh04:15
thumperFFS04:15
* thumper is composing a looooong email04:16
babbageclunkaxw: I've just had an annoying thought - at the moment I'm getting the subnets in the space from the provider. Should I be getting them from state instead?04:16
babbageclunkaxw: in which case, the provider attributes we're getting are really for the network, not the space, aren't they? :/04:17
axwbabbageclunk: sorry was out. sorry, not really following. what's wrong with getting subnets from the provider?04:34
babbageclunkaxw: From that answer, nothing I guess - is the provider the authoritative source for that info then?04:36
axwbabbageclunk: I think so? I'm not really sure - better ask jam04:36
axwbabbageclunk: it may be that users can add them in manually too?04:37
babbageclunkaxw: They can, but I think in that case we go back to the provider for extra information (like CIDR if it was added by providerid, or the inverse), so it seems like this is fine.04:38
babbageclunkI think I meant vice versa there.04:39
babbageclunkphew, just a crisis of confidence then.04:39
axwbabbageclunk: sounds fine to me, but I don't really know for sure04:40
babbageclunkjam, what do you think? ^04:41
jambabbageclunk: so, Public vs Private, AIUI, doesn't do anything today04:42
jamand is probably vestigle04:42
jamvestigal ?04:42
jamvesti-whatever04:42
babbageclunkvestigial04:42
jam:)04:42
babbageclunkha04:43
jambabbageclunk: as for the rest... there are a couple of thoughts04:43
jam1) In one very real sense, the Provider is authoritative for what subnets actually exist04:43
* babbageclunk braces for impact04:43
jam2) In MAAS, the Provider is also authoritative for what Spaces exist04:43
jam(we can't create machines that have access to spaces that MAAS does not know about)04:44
jam3) In other providers, Juju *has* to be authoritative about Spaces as a collection of subnets, because Providers don't aggregate subnets in that way04:44
jamunless we start tagging subnets by what space Juju thinks they are in.04:44
jamthen you get into distributed controllers trying to manage tags on shared subnets, which is probably where we will go, but is messy04:44
jambabbageclunk: the other potential complicating factor is that we *might* need to track subnets that are not part of our model (other subnets for other models, etc)04:46
jamMAAS certainly lets you create spaces/subnets that are not managed by itelf04:46
jamitself04:46
jamand we'll likely have things like ingress/egress rules to subnets that are not ones we can actually put machines in.04:46
thumperveebers, balloons: the 5211 test run, how many of those results are real?04:46
jamI guess that was 4)04:46
thumperif it is all, then we have some serious problems04:47
babbageclunkhmm, so that makes Environ.ProviderSpaceInfo a bit hard to implement then (unless we start doing subnet tagging, which sounds nontrivial)04:47
jambabbageclunk: ProviderSpaceInfo is probably only valid for MAAS, and we have a field about ProviderHasDiscoverableSpaces04:47
jamlet me check the actual boolean04:47
jambabbageclunk: SupportsSpaceDiscovery()04:48
babbageclunkjam: So the process should use ProviderSpaceInfo if the provider supports space discovery, but use the subnets from the space in state otherwise (since for other providers that's the only place that knows about the grouping)?04:52
* veebers looks04:52
veebersthumper: the proxy-* and deploy-* (where not joyent) are unknown. I can confirm them after dinner tonight (have this meeting coming up now)04:54
babbageclunkjam: I think the structure we have stores the right information, I just might need to get the information from different places if the provider doesn't know about spaces.04:54
thumperaxw: I see that you marked bug 1677001 fix committed04:54
mupBug #1677001: Storage remains in pending state <sts> <juju:Fix Committed by axwalk> <juju 2.0:Won't Fix> <juju 2.1:Won't Fix> <https://launchpad.net/bugs/1677001>04:54
axwthumper: yup04:54
thumperis the the Juju half of 1674148 ?04:54
thumperit seems weird that there were two bugs04:54
* axw looking04:54
jambabbageclunk: you and wpk should make sure to sync, as he's been looking to tweak some of this as well. But we should use Space Discovery to map what the Provider has into State objects04:54
thumperbug 167414804:54
mupBug #1674148: hook for storage: storage already attached - Juju using already mounted disk <cdo-qa-blocker> <stable-blocker> <uosci> <juju:Confirmed> <MAAS:Fix Released by blake-rouse> <https://launchpad.net/bugs/1674148>04:54
thumperfor mup04:54
jamand then everything uses State Objects from there out04:54
babbageclunkjam: So in that case maybe we should extend spaces in state to have the extra information we'd need to compare them across models. (I think this was what axw was pushing for a long time ago, d'oh.)04:56
veebersthumper: FYI just a quick look now (re-doing some jobs to rule out infra issues) a handful of those tests have passed since that run04:56
babbageclunkjam: Ok, I'll get in contact with wpk.04:56
veebersso re-running will give us a better picture04:56
axwthumper: I'm having trouble understanding andres' reply. so not sure yet, I'll try and dig into that after the travel call.04:56
thumperaxw: thanks04:57
veebersthumper: ok, so can't promise anything but I've re-kicked the unexpected failed tests. Seeing the history of the re-kicked tests they should pass (unless the issue was fixed inbetween those builds)05:02
menn0wallyworld: ping?05:21
babbageclunkmenn0: He's on a swap day today05:21
menn0babbageclunk: ah right05:21
menn0i'll use email then05:21
babbageclunk(which isn't to say he won't be around)05:21
axwthumper: AFAICT, they're separate issues. one was due to MAAS mapping block devices in a way we're not expecting, and the other is due to us not extracting the right block device details from the MAAS response, even when they're mapped correctly05:37
axwthumper: I'm not sure if there's any issues remaining - I'll ask Ante05:37
thumperok05:37
thumpercheers05:37
* thumper is done for today05:37
rogpeppeaxw, wallyworld: hiya, i'm after a review of these PRs if you have a moment at some point https://github.com/juju/juju/pull/7327 https://github.com/juju/juju/pull/732405:55
axwrogpeppe: okey dokey, will look shortly06:13
rogpeppeaxw: tyvm06:13
rogpeppeaxw: BTW, what is the "grant" CI job that fails so often?06:13
axwrogpeppe: not sure. I think to do with grant/revoke permissions?06:14
rogpeppeaxw: i'm getting more failures than successes with it, which seems a bit counterproductive06:14
axwrogpeppe: I believe the QA team are looking into it06:15
rogpeppeaxw: cool06:15
rogpeppeaxw: do we have a QA team now?06:15
axwrogpeppe: yes: balloons, veebers, and burton-aus06:16
rogpeppeaxw: ah, good to know which people, thanks06:16
axwrogpeppe: LGTM, and thanks for tidying up - much nicer06:32
rogpeppeaxw: np, ta!06:33
rogpeppeaxw: i'm really glad to finally see the back of PrepareEndpointsForCaching06:33
rogpeppeaxw: i actually did most of that PR back in October and only just had reason to finally get it landed06:34
=== frankban|afk is now known as frankban
wpkhm, do we really need DiscoverSpaces API? It seems redundant for Spaces API, it's only used by discoverspaces worker (and it can just as easily use spaces API)10:18
wpkjam: ^^^10:18
jamwpk: DiscoverSpaces is a worker/agent API, vs Spaces is a Client API12:03
jamI'd rather we not conflate them.12:03
jamwpk: generally workers are meshed with a corresponding API that makes it clearer what surface interaction we have12:05
wpkok12:08
wpkso WatchSpacesSyncSettings should be in discoverspaces, ResyncSpaces in spaces?12:08
wpkok, I see it's even guaranteed at the top level12:22
jamwpk: yes12:58
=== mup_ is now known as mup
=== frankban is now known as frankban|afk
mupBug #1690166 opened: Juju add-machine CentOS failed with "no tools found" <juju-core:New> <https://launchpad.net/bugs/1690166>15:27
mupBug #1690166 changed: Juju add-machine CentOS failed with "no tools found" <juju-core:New> <https://launchpad.net/bugs/1690166>15:33
mupBug #1690166 opened: Juju add-machine CentOS failed with "no tools found" <juju-core:New> <https://launchpad.net/bugs/1690166>15:36
rogpeppe i brushed off my old branch for giving access to juju API information, tired of refactoring it every time I want to use it. anyone wanna give it a review? https://github.com/juju/juju/pull/733117:52
zeestratHey, is there anything I can do to help y'all reproduce/fix https://bugs.launchpad.net/juju/+bug/1680392 ? (It is still tagged with the wrong milestone btw)18:36
mupBug #1680392: Model migration fails on large model <juju:New for thumper> <https://launchpad.net/bugs/1680392>18:36
=== frankban|afk is now known as frankban
arosalesHello, is there a arch docc that describes communication between Juju and MAAS to provision services?19:58
arosalesaxw: ^ any thoughts or recommendations?20:37
* arosales didn't see thumper around 20:37
babbageclunkwallyworld: ping?22:13
wallyworldyo22:13
babbageclunkwallyworld: got time for a hangout?22:13
wallyworldsure22:14
babbageclunkwallyworld: on 1:1?22:14
wallyworldok22:14
=== frankban is now known as frankban|afk
hmlwallyworld: 1 line PR:  https://github.com/juju/juju/pull/7333  :-)  easy review?23:28
wallyworldsure23:28
wallyworldlgtm23:29
hmlthx23:31
thumperwallyworld: who has most experience reviewing providers at the moment?23:31
thumperwallyworld: I need someone to glance over some code and see if it is going in the right direction'23:31
thumperdoesn't have to be a full review, because the code isn't ready23:32
wallyworldandrew would be the best choice right now23:32
thumperbut more they want to know if what they have is a good start or not23:32
thumperwallyworld: when does axw turn up?23:32
wallyworldreal soon23:32
axwthumper: I'm on23:32
thumperaxw: hey23:32
thumperwallyworld, axw: if you could both join https://hangouts.google.com/hangouts/_/canonical.com/provider-x briefly, that'd be swell23:33
axwarosales: hey again :) I'm not aware of any docs.23:33
axwok23:33
arosalesaxw: thanks for the reply and info23:56

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!