/srv/irclogs.ubuntu.com/2017/10/10/#juju.txt

axwhallyn: hmm. I think you may need to set it in your environment too, to affect the client process. i.e. env http_proxy=... juju ...01:26
axwhallyn: BTW I'm waiting on a license to test against ESXi 5.1. the free version is too crippled to work with Juju01:37
axwhallyn: from the looks of things so far, though, changing to hardware version 8 will be fine01:38
hallynaxw: hm.  seems like no matter what i try, i get http://paste.ubuntu.com/25711441/ .  trying with http_proxy in env too now, though it does also need to respect no_proxy02:45
axwno_proxy should be honoured02:46
hallynnope, i just keep getting the same thing...04:12
hallyn"vm '*' not found" seems like it would stem from some confusion04:12
hallynaxw: http://paste.ubuntu.com/25711792/04:23
axwhallyn: yep, I don't know what that's about. can you please try 2.3-beta1? there have been significant changes to the vsphere provider since 2.0.204:26
hallynaxw: waht the...04:27
hallyni installed from snap intending to have 2.3-beta104:27
axwhallyn: $PATH order I guess?04:32
axwoh, or maybe you just need to specify --edge04:32
hallyni did sudo snap install juju --beta --classic04:33
hallynah yes /snap/bin/juju is 2.3-beta104:34
axwbeta, that's the one04:34
hallynlooking better04:34
hallynthings are being done04:34
hallynjuju-vmdks are being uploaded04:35
axwhallyn: is this with ESXi 5.1?04:35
hallynoh, no.  this is with a DC that only has my lone 6.0 :(04:35
hallyni'll re-try with a 5.1 added in later, if this works04:36
chamarcurious, is it with the free ESXi version?04:36
axwhallyn: ok cool. you'll need to modify the source (OVF) though for that04:36
hallynchamar: i don't think so.  there's licenses at any rate.  (i inherited the lab...)04:37
axwchamar: I tried with vSphere Hypervisor 5.1 earlier, doesn't work. Juju wants to create folders and clone VMs, which apparently don't work with the free version04:37
chamarThanks.  Got the same result with the free hypervisor.  sadly.04:38
chamarthere's feature that are not available / enabled.  Same goes with MAAS... ho well.04:39
chamarhum. removing a kubernetes-worker unit.. works well.  except it still appears in the k8s dashboard..humm04:40
hallynaxw: so is there any point in trying with a 5.1?04:48
hallynsounds like no04:48
axwhallyn: not without source changes, no04:48
axwhallyn: did bootstrap complete on 6.0?04:52
hallynstill running04:59
hallynaxw: not without source changes to make it not try to upload the files, or do i really only need to change the min machine type?  (not sure based on waht you were telling chamar)05:00
axwhallyn: just changing vmx-10 to vmx-8. the other stuff was to do with the free version05:01
hallynaxw: ok, i'll hopefully try that this week then.  one holdup has been trying to find hte actualy source package to pull-lp-source :)05:01
hallynor am i gonna have to learn how to do the snap thing05:02
axwhallyn: git clone https://github.com/juju/juju/, then: make JUJU_MAKE_GODEPS=true install05:03
axwrequires go 1.8+05:03
axwdevelop branch will become 2.3-beta205:04
hallyncool thanks05:05
* hallyn sets up a build env05:07
hallynsay, can no_proxy be a subnet?05:09
axwhallyn: from 2.3-beta1 onwards, yes: https://github.com/juju/juju/pull/788505:14
axwI suspect there's some gotchas when it comes to external processes though, when juju shells out to wget/curl/etc., because it's non-standard05:15
hallynaxw: nifty05:20
hallynok, juju build going.  can i just scp the built ~/go/bin/juju over, or do i needmore?05:22
hallynwell the other juju bootstrap is still going.  new juju is built - i assume i'll have to rebootstrap?05:35
hallynwill deal with it in the morning05:35
hallynthanks axw!05:35
hallyn\o05:35
axwhallyn: no worries, let me know if I can help any more. you'll need to scp the juju and jujud binaries, and yes you'll need to rebootstrap05:36
axwhallyn: (I assume you mean scp to wherever you're bootstrapping from - you can't just just copy over the top of the binaries in a bootstrapped environment)05:37
axwalso, seems like a long time for bootstrap - might be borked. if you can ssh to the VM, /var/log/cloud-init-output.log should tell you what's happening05:38
axwassuming it got that far05:38
xavpaiceis there any way for an lxd unit to know what the hostname of it's parent host is?  Would be handy for exporting nagios checks.10:01
hallynaxw: /var/log/cloud-init-output.log on which ohst?14:26
bdxon CMR, what things do we want to relate across models, should we only be concerned with logical groupings?15:17
bdxfor example15:18
bdxI have an web application deployed to web-app-model, and a monitoring stack deployed to monitoring-model15:18
bdxrick_h: for example, lets say I have the prometheus monitoring stack described in your blog deployed to monitoring bundle15:19
bdxso I have this telegraf subordinate component15:19
rick_hbdx: so mentally (and you can see it based on the status output) we think folks will basically have SaaS-like setups15:20
bdxpart of me wants to deploy telegraf to my "web-app-model", and make the CMR to prometheus in the "monitoring-model"15:20
rick_hso a model will be the bits needed to offer up a SaaS endpoint (or DBaaS) and such15:20
rick_hbdx: exactly15:20
rick_hbdx: so you want the subordinate on each thing (many) but only one prometheus gathering the data15:21
bdxthe other part of me wants to deploy telegraf to the "monitoring-model", and make the CMR from the web server in web-app-model to telegraf in the "monitoring-model"15:21
bdxrick_h: missing the point15:21
bdxrick_h: see what I'm saying15:21
rick_hbdx: k, sec sorry otp with folks on your models issue and trying to do two things at once15:22
bdxok, no rush15:22
bdxlol thx15:22
rick_hbdx: there might be a temp way to improve your models call until we can get some  updates into juju-core and new releases/etc. So was just seeing how we can make that happen.15:26
rick_hbdx: but ok, phone over. /me rereads15:26
rick_hbdx: so, I think that you'd put telegraf in the webapp model15:27
rick_hbdx: you want that model to say that things are in fact being wired up to be monitored. telegraf is installed on each of those machines. It's a subordinate and does not effect the number of VMs and such in the web-app-models15:27
bdxtotally15:28
rick_hbdx: and it'll be a LOT easier to see which future models have telegraf setup vs not15:28
rick_hbdx: that's how my brain thinks anyway.15:28
bdxright15:28
bdxrick_h: so, the way I was thinking about it was, if a user needs something monitored, I just grant access to the telegraf:juju-info endpoints15:29
bdxto that user15:29
bdxtelegraf is already related to prometheus in the monitoring-model15:29
rick_hbdx: thinking...for some reason I really don't like subordinate realtions over CMR...but I'm not 100% sure why15:29
bdxso then I could essentially gate which users could monitor things by granting access to the telegraf:juju-info endpoint15:30
bdxyeah, feel you on that15:30
bdxrick_h: possibly because we want the charm to live on the controller for which model its being deployed into15:30
rick_hbdx: so...but at that point you're locked into telegraf15:30
rick_hbdx: vs just "send stuff to prometheus"15:30
bdxahh, I see15:30
bdxyeah15:31
rick_hbdx: so if you used anything else, you'd need those setup as well15:31
bdxtotally15:31
rick_hbdx: I think it's because prometheus is basically a database. I'd want to control access to the DB, not which apps are already wired to the DB15:31
bdxentirely15:32
bdxthat makes sense15:32
rick_hbdx: so I think what you're asking "would work" but it just feels really off in my head15:32
bdxyeah, its does now for me too15:32
bdxrick_h: thanks for being the voice of reason here15:32
* rick_h writes that down on the calendar "voice of reason!" :P15:32
bdxI'm hooking up my first live CMR deploy with monitoring decoupled from the web app stuff, and the db decoupled from the web app stuff too, pretty exciting this is finally happening15:33
bdxI'm expecting it all to work, 1st try, using beta215:34
bdxjp15:34
bdx:)15:34
bdxhigh hopes15:34
bdx^^15:34
rick_hbdx: know that the prometheus charm needs an update to use the new netwokring stuff. I'm working on tests against charm-helpers to add the tooling for it15:36
bdxohhhh niceee15:36
bdxrick_h: thats separate from CMR though right? or are they linked? like if you use CMR then you have to use the new network-get too?15:38
rick_hbdx: so if you relate telegraf to prometheus over CMR, prometheus needs to use the public IP vs the 10.x one of the vm15:40
rick_hbdx: right now the prometheus charm asks for the relation-get private address15:40
rick_hbdx: vs using network-get -r and that will be CMR aware and provide a public address15:40
stubrick_h: I'd say that subordinates, by definition, are in the same container as their primary. And splitting the container over two models seems wrong.15:45
rick_hstub: +115:45
bdxrick_h: that makes sense15:47
bdxrick_h: what about the scenario where the models are in the same vpc15:48
bdxooooh15:48
bdxI see, thats where the new network-get functionality comes in15:48
bdxyou can now make your charm choose which network interface to get the relation info for, so if you want to set the private interface info, then you can15:49
rick_hbdx: right, so network-get is all "bindings aware" and provides more full featured network dump15:50
rick_hbdx: so if I can get this test to pass I'll have a PR for new network_get() charmhelper to use for that15:50
bdxoh nice, I think I see .... what you are working on is a wrapper in charmhelpers for the new network-get that will allow us to access the new functionality via the python api15:52
bdxbut is that only for "bindings", or does it differentiate between public vs private address too?15:52
bdxe.x. aws instance15:53
bdxdeployed to an a subnet in which it gets a public ip15:53
bdxwill have an private and public address, but may not use bindings, and may not be deployed to spaces via constraint15:54
bdxthen deploy another charm to another model (in the same vpc/private address space, just a different model) and relate those two charms via CMR15:55
bdxwhat will happen? how do I control this?15:56
rick_hbdx: https://github.com/pmatulis/juju-docs/blob/00f06dfa4f62020e5598253f0b066af9610df032/src/en/developer-network-primitives.md15:56
rick_hbdx: making up some lunchables so in and out atm but give that a read15:56
rick_hbdx: so in the meantime, you have to manually edit the prometheus config with the proper addresses for prometheus to reach telegraf across models...but hopefully that's not true by the EOD today15:57
bdxnice, so your wrapper will basically give us access to all of the things that I'm concerned about I think15:57
bdxgreat15:57
pmatulisrick_h, https://jujucharms.com/docs/devel/developer-network-primitives :)15:58
rick_hbdx: right15:58
rick_hpmatulis: ty :)15:58
rick_hHad the tab open a while. Heh15:58
pmatulisha ha15:58
bdxso16:06
bdx"Both ingress address and egress subnets may vary depending on the relation. This is because if the relation is cross model, the ingress address is the public / floating address of the unit to allow ingress from outside the model. And a given relation may see traffic originate from different egress subnets."16:06
rick_hbdx: exactly16:07
bdxrick_h: ok, so this better exposes what I'm concerned about16:07
bdx"if the relation is cross model, the ingress address is the public / floating address of the unit"16:07
rick_hSo what we need to do is test this out and make sure in a vpc it behaves16:08
bdxrick_h: so a common network setup/use case I use is to have multiple models in the same vpc16:08
rick_hbdx: and file bugs and feedback during the betas on it16:08
bdxright16:09
rick_hIf I follow your concern through16:09
bdxlike, I want to monitor things from one model to the next16:09
bdxI don't want default talk over WAN16:09
rick_hYea, and no expose anything in the internet you don't have to16:09
bdx"if the relation is cross model, the ingress address is the public / floating address of the unit"16:09
rick_h+1 so we've got to help test and build clear rules for how juju can"do the right thing"16:09
rick_hbdx: that might involve specifying binding of endpoints to put things together clearly16:10
bdxfor me this means all of my monitoring cross talk and database <-> web app cross talk that I want to stay inside the vpc will automatically be forced over the wan if its CMR16:10
bdxrigh16:11
bdxpossibly^ is worded incorrectly16:12
rick_hbdx: so what I'm saying is that might be the default behavior.16:12
bdxoh16:13
rick_hbdx: but, if you deploy and bind the endpoints to the internal vpc networks16:13
bdxgot it16:13
rick_hbdx: then perhaps that overrides the default WAN behavior?16:13
bdxI see16:13
rick_hbdx: so that's my "you might have to set things up more clearly"16:13
bdxok, I'm tracking16:13
rick_hbdx: and if that's failing, then we file bugs and ask wallyworld to help us out :)16:13
bdxgot it16:13
rick_hbdx: so mentally, I'd expect it to WAN so that working > * as a default behavior.16:14
bdxright16:14
rick_hbdx: but that manually targeting the network paths through endpoint binding would do what an experienced user wants to be done16:14
* rick_h starts disclaimer'ing that he's not tested that out atm though....sooo....16:14
rick_hany charmer folks know what error I'm getting here? https://pastebin.canonical.com/200266/17:02
rick_hkwmonroe: ^17:02
cory_furick_h: What channel of charm-tools are you using?18:52
rick_hcory_fu: I'm trying to use a custom build to test out the PR https://github.com/juju/charm-helpers/pull/20 in a charm18:53
rick_hcory_fu: so I did a make source in charmhelpers, updated the wheelhouse charmhelpers tar.gz to try to use my patched version18:54
rick_hcory_fu: maybe there's an easier path but not sure how this balance works out18:54
cory_furick_h: A custom build of charm-tools to test a charm-helpers change?18:54
rick_hcory_fu: sorry, for charm-tools I'm using edge channel of charm18:55
rick_hcory_fu: so I just did a charm pull prometheus and attempted to build it. I ended up doing a --no-local-layers --force to get it working enough to move forward.18:59
cory_furick_h: So, from your pastebin, it's picking up the current directory as the source of the prometheus interface layer for some reason19:00
cory_furick_h: (Note the "(from .)" at the end of the pastebin)19:00
rick_hcory_fu: yea, I wasn't sure why there. I tried to unset the interfaces path19:00
rick_hcory_fu: but it continues to think so19:00
cory_fuIt might actually be because you *don't* have INTERFACES_PATH set.  I'm going to test that.19:01
cory_fuWe should probably just skip any local interface layers if the path isn't set19:01
cory_fuOr have better detection about what local path is an interface path19:01
rick_hcory_fu: so originally it was set to my interfaces path, but to build this charm I didn't need any so I unset it in an effort to make it work out.19:01
cory_fuNope, having it unset does the right thing for me, too19:02
rick_hcory_fu: k, I'm feeling my way through the best practices on working on these tools/charms and stumbling a bit. I assume I'm holding it wrong so curious what folks say when I hit stuff19:02
cory_fuWhat was set to your interfaces path?19:02
rick_hexport INTERFACE_PATH=$JUJU_REPOSITORY/interfaces19:03
rick_hecho $JUJU_REPOSITORY19:03
rick_h/home/rharding/src/charms19:03
cory_fuYeah, that should be fine.  You don't have the prometheus charm checked out in that interfaces sub directory, do you?19:03
rick_hand the charm is in the charms directory ".../charms/prometheus"19:03
cory_furick_h: Ah!  That let me reproduce it.  I have my layers in a layers subdir (e.g., ~/charms/layers/prometheus).  Putting it directly into JUJU_REPOSITORY causes it to break19:05
rick_hcory_fu: no, the only interface in the interfaces path is grafana-source. No other directories in there19:05
rick_hcory_fu: oic, so yea holding it different than everyone else :)19:05
* rick_h has to run to get the boy from school, biab19:05
cory_furick_h: I'll open a bug for this19:05
cory_fuIt should definitely be doing the right thing here and it's not19:06
zeestratcory_fu: are you the right person to bother for some questions regarding charm tools?19:07
zeestratI am having a bit of a hard time figuring out the intended/preferred way to use charm tools when developing some charms in regards to which distribution/version to use. Asked on the mailing list (https://lists.ubuntu.com/archives/juju/2017-October/009553.html) but not much luck.19:15
cory_fuzeestrat: marcoceppi would probably be better to answer that question, because I'm not really clear on the versioning there, either.  I suspect that the versioning has just fallen out of maintenance since we moved to snaps as the preferred deployment and snap revisions already handle that need to some degree, but it definitely needs to be cleaned u19:37
cory_fup.19:37
rick_hcory_fu: kwmonroe is there a way to get the relation_ids just from juju run xxxx ?20:00
cory_furick_h: juju run --unit <unit/0> -- relation-ids <endpoint-name>20:20
rick_hcory_fu: gotcha ty20:21
rick_hcory_fu: I figured they looked numeric and started with 0 and then 1 and found it :)20:21
zeestratcory_fu: Thanks. I'll try to ping him then. I'm already using the snaps in my dev environment which works great, but when I try to run some tests with bundletester as recommended in https://jujucharms.com/docs/stable/developer-testing, bundletester pulls and old charm-tools from PyPI which is a bit frustrating. How are y'all testing these charms with bundletester?20:24
rick_hcory_fu: for getting a review and feedback on https://github.com/juju/charm-helpers/pull/20/files is there anything I should do?21:31
rick_hcory_fu: that's going to hold up changes to the prometheus charm to leverage the updated networking information.21:31
cory_fuzeestrat: Sorry for the delayed response.  marcoceppi will update PyPI to fix bundletester and we'll look in to getting things updated to be more consistent.21:47
cory_furick_h: Merged21:47
rick_hcory_fu: ty21:49

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!