/srv/irclogs.ubuntu.com/2018/01/25/#juju.txt

zeestratjamespage: Got some spare time for some administrative work on charm-helpers? https://github.com/juju/charm-helpers/issues/2706:57
=== rogpeppe1 is now known as rogpeppe
elmaciejHi!14:30
elmaciejHi! I have a charm nova-compute with lvm storage backend. There is no option to provide images_volume_group = my-volumes, I have to put it myself to nova.conf in libvirt section. How can I dissallow juju to roll back my changes in this file.14:31
elmaciejplease let me know, it is actually very seroius problem.14:31
zeestratelmaciej: You can use the https://jujucharms.com/nova-compute/#charm-config-config-flags option in the nova-compute charm to set options in nova.conf15:16
magicaltrouthello folks15:26
magicaltroutwhats the Canal support like for CDK if I swap out flannel?15:26
rick_htvansteenburgh: might have an idea ^15:27
magicaltrouti see a couple of issues on github, are they the edge cases, or the norm? :)15:27
magicaltroutrick_h: i haven't forgotten the CLI feedback stuff, just been mega busy recently15:29
magicaltrouthonest!15:29
rick_hmagicaltrout: all good, sorry for the bugging but wasn't sure you were back from holiday/got lost in the holiday mailbox, etc15:29
rick_hmagicaltrout: and I know of everyone out there you had the biggest eye for it :P15:29
magicaltroutyeah, its pretty epic, I did get a 2 minute demo of it via hangout a few months ago, it looked great. I'm looking forward to getting to tinker15:30
rick_hmagicaltrout: nice. When you get time we're eager if this is solving your issues and doing what you need. Thanks for checking it out15:31
magicaltroutno problem, we've got some new stuff coming to Juju soon, our new platform called Anssr which is a scalable natural language processing platform aimed at discovering personally identifiable information for the new GDPR legislation coming into force in may15:34
magicaltroutJuju will be great at dealing with the server components for those companies who use Cloud services15:35
rick_hmagicaltrout: very cool, when you're ready I've love to see a demo and what's up sometime15:37
magicaltroutindeed, indeed!15:39
=== Spads_ is now known as Spads
SaMnCohi there16:35
SaMnCoanyone from the K8s team around here?16:35
petevgSaMnCo: hi there, long time no chat. :-) It looks like kjackal and kwmonroe are both logged in, and they're both doing k8s stuff now. Not sure if either of them is paying attention, though.16:39
SaMnCoheeyyy!! Yes, been busy on other stuff16:43
SaMnCoI am trying to get the HPA working with custom metrics and I am STRUGGLING big time16:43
SaMnCowanted to discuss a few things16:44
petevgCool. My k8s knowledge is still pretty basic, so I'm probably not useful. Hopefully, one of those two cats will see my ping.16:45
magicaltroutpetevg: as a technical sales pro... surely you must know everything16:46
magicaltrouthow else can you sell stuff?16:46
magicaltroutoh openstackers :)16:46
magicaltrouti forgive you16:46
magicaltroutnow learn some kubernetes and help the man out16:46
petevgmagicaltrout: I'm working on it :-p16:46
knobbywhat is your question, SaMnCo?16:48
SaMnCoknobby:  a github issue says a 1000 words: https://github.com/DirectXMan12/k8s-prometheus-adapter/issues/1216:48
SaMnColast comments I made16:49
SaMnCoFor some reason I cannot get the controller manager to read the metrics from the Metrics API Server nor the Custom Metrics API Server16:50
SaMnCoboth are registered correctly and I can see the values right from calling the API16:50
SaMnCobut the HPA cannot leverage them16:50
SaMnCoand I cannot start to figure out what is going on16:50
SaMnCoit seems that the HPA in the Controller Manager keeps trying to hit http://heapster as a resource metrics value despite using  --horizontal-pod-autoscaler-use-rest-clients16:51
SaMnCobut even at max log level I do not have any error anywhere but in the HPA events16:52
SaMnCoSo that is for one16:52
SaMnCothe other is that I have weird RBAC errors which do not match the RBAC profile of CDK:16:53
SaMnCohttps://www.irccloud.com/pastebin/advBNfeG/16:53
SaMnCoAll these rights are covered by the RBAC for system:node but they keep coming16:53
SaMnCohave you guys started working on Custom Metrics?16:54
knobbyso you have a horizontal autoscaler and you're trying to reach into the heapster pod to ask about request counts so it can scale, right?16:58
knobbyam I reading it correctly that your controller manager is outside the cluster?16:59
knobbyand it's trying to use an internal cluster ip to hit heapster?16:59
SaMnCoyeah exactly17:00
SaMnCobtw for rbac: https://github.com/kubernetes-incubator/bootkube/issues/48317:00
SaMnCoupdate the default rbac manifest for system:node binding to:17:01
SaMnCohttps://www.irccloud.com/pastebin/PQrRs7zm/17:01
SaMnCowill solve this problem, I am guessing others have it17:01
SaMnCoopening github issue now17:02
knobbyI always use services to get to things from outside my bare-metal cluster. It's either that or a nodeport really. I think you'll have to expose the pod via a service and then use that service ip.17:05
knobbyip routing to your cluster for your service addresses would be required17:05
SaMnCobut in theory according to the docs, using the flag horizontal-pod-autoscaler-use-rest-clients on the controller-manager should tell it to talk to the API server17:07
knobbyI have an appointment now, but I'll check back in an hour or so. kjackal would be the one to talk about RBAC. The issue will help track it.17:07
knobbySaMnCo, how does it auth?17:07
SaMnCobut for some reason it keeps hitting the heapster17:07
SaMnCofilled in https://github.com/juju-solutions/bundle-canonical-kubernetes/issues/47517:07
SaMnCoknobby: I am using a specific Service Account with a custom RBAC profile17:10
SaMnCoOK I finally nailed the issue (it is my 4th day on this)17:23
SaMnCoIt all goes  back to a bug in the scaling mechanism of masters17:23
SaMnCoWIll explain in a another GH issue17:23
SaMnCofor those interested: https://github.com/juju-solutions/bundle-canonical-kubernetes/issues/47617:44
knobbythanks SaMnCo, glad you got it figured out and thanks for the bug19:40
=== agprado_ is now known as agprado
=== agprado is now known as agprado|afk
admcleodim using the manual provider, have bootstrapped a controller, controller is behind a firewall (nat) - can connect to the machine21:10
admcleodhowever, the client is then trying to download the tools from the controllers internal address instead of its external ip - is there any way to specify this?21:10
=== agprado|afk is now known as agprado
kwmonroeadmcleod: try adding the public-ip first in .local/share/juju/controllers.yaml for the api-endpoint.21:56
admcleodkwmonroe: hmm yeah its there first.. maybe i should make it the only one22:00
kwmonroeadmcleod: yeah, try that, but don't forget whatever was there before you remove it ;)22:02
admcleodkwmonroe: ha, thanks22:04
admcleodkwmonroe: has something like this worked for you?22:05
kwmonroeadmcleod: yeah, forcing an endpoint ip has worked for me in the distant past (like 2.0 timeframe).  it's been months since i've been in that kind of environment though.22:48
admcleodkwmonroe: k cool22:55
admcleodkwmonroe: something is adding the other ip back in automatically22:57
kwmonroehrm... admcleod, could you use sshuttle to give your client access to the controller's subnet?  sshuttle -r user@firewall a.b.c.d/2423:13
kwmonroes/firewall/nat machine23:14

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!