/srv/irclogs.ubuntu.com/2020/03/24/#juju.txt

tlmany idea how to fix this warning when building juju "failed to update distro info: open /usr/share/distro-info/ubuntu.csv: no such file or directory"01:36
wallyworld_tlm: update deps, there was a bug in juju/os01:42
wallyworld_that or install distro-info dep01:42
tlmah sweet01:42
hpidcocktlm: stickupkid: I think landed a fix to develop01:47
hpidcockon k8s we don't have the apt package installed01:47
hpidcockso the error was happening01:47
hpidcockalso on centos01:48
wallyworld_thumper: were you looking for a new 2.7 sha for QA testing?03:36
thumperwallyworld_: why did we need another? rick_h_ said he had passed on the previous one03:37
wallyworld_thumper: you asked for the race fix to be targetted to 2.703:37
thumperwallyworld_: ah, no03:38
thumperwe don't need that for 2.7.503:38
thumperjust that if we are going to fix it, should do it on that branch first03:38
thumpersince we know the problem is there too03:38
wallyworld_yup, no worries, just wanted to clarify03:38
wallyworld_i was hoping we would not do a new sha03:38
thumperReview for anyone that feels the need: https://github.com/juju/juju/pull/1135004:26
thumperor desire04:26
thumperor whatever04:26
wallyworld_ok04:26
thumperwallyworld_: thanks04:27
thumperwallyworld_: it may be easier to review the commits one by one04:28
thumperI made sure they made sense individually04:28
wallyworld_because you care04:28
thumperyes, I care04:28
thumperthey even have decent commit messages04:28
thumperIMO04:28
wallyworld_not too shabby04:29
hpidcockwallyworld_: found the bug04:39
hpidcockyou approved it :)04:39
wallyworld_oh :-(04:40
tlm[m]:(04:40
hpidcockI'm assuming daemonset support was only in develop?04:40
hpidcockor did it get backported to 2.7?04:40
wallyworld_yeah04:40
wallyworld_only develop04:40
hpidcocksweet, unreleased bug then04:41
wallyworld_what was it?04:41
hpidcockensureStatefulSet was missing else { return nil } on the create04:41
hpidcockso it would create04:41
hpidcockthen immediately update it04:41
wallyworld_bollocks04:42
hpidcockI was this "" close to thinking it was a k8s bug04:42
wallyworld_so that explains all the symptoms?04:43
hpidcockwallyworld_: at least the deployment failure05:06
wallyworld_thumper: lgtm with a few comments05:13
thumperthanks05:21
thumperI'm EODing, and away tomorrow, will look Thursday05:21
wallyworld_enjoy the drive05:21
wallyworld_jam: did you want to land your jujuc PR and we can pick it up? easier than forking and re-proposing06:42
wallyworld_we can do the common socket code refactor etc06:43
jamwallyworld[m]: sure06:43
wallyworld_ty06:43
flxfooHi all07:11
flxfoohow do I see all permissions for  a user? I have two superuser but only one can perform system calls, the other one receives permission denied...07:12
wallyworld_flxfoo: juju show-model will show the users with acess to that model and what permissions they have07:39
wallyworld_juju show-user <fred> will also show a specific user07:39
flxfoowallyworld_: thanks07:43
flxfoowallyworld_: I tried to automate the backup (percona-cluster run-action backup) of the percona cluster, with  a cronjob.. at the end user needs to be superuser+admin ... any other idea to do that?07:46
wallyworld_flxfoo: i can't recall what level of permission is needed to run an action. i can try it07:49
wallyworld_flxfoo: i just tested a user with write access to a model containing a deployed application, and that user could run an action on that app07:54
achilleasajam: I pushed the PR for relation-created. Can you take a look? https://github.com/juju/juju/pull/1134109:08
achilleasamanadart: if curious how I worked around that interface limitation that we were chatting about you might also want to take a look at ^09:09
manadartachilleasa: Ack, will take a look.09:16
flxfoowallyworld_: mmm interesting... and just calling `run()` ?09:29
wallyworld_flxfoo: "juju run-action" on a client09:31
wallyworld_hpidcock: lgtm with a question about cm generations10:00
wallyworld_i don't quite get how we handle a mismatch10:00
stickupkidmanadart, is anyone calling UpdateSpace, from my initial grepping, it seems like update-space and UpdateSpace method do nothing, is that correct?10:22
stickupkidmanadart, seems like I could propose a PR to remove old stuff at the very least10:23
manadartstickupkid: Yes, I believe there are some commands not implemented that date from the spaces MVP.10:24
stickupkidmanadart, let me do that first, it's very confusing to have UpdateSpace that will panic10:24
stickupkidmanadart, https://github.com/juju/juju/pull/1135310:31
stickupkidmanadart, I've got some other dead code to remove, if you've got a sec10:42
manadartstickupkid: Yep.10:43
stickupkidmanadart, https://github.com/juju/juju/pull/11353 <- removed - I have a question about this though (https://github.com/juju/juju/pull/11353/files#diff-bfb621f2a13c2cf9efe1d5eaee1a31c7), everything else came out clean11:02
manadartstickupkid: I'd remove that method from API too.11:06
stickupkidmanadart, agreed, just wanted another set of eyes11:06
stickupkidmanadart, done11:08
flxfoowallyworld_: no sorry I meant, if I `run('ls -l')  on remote machine, I have permission denied11:22
manadartstickupkid: https://github.com/juju/juju/pull/11354.11:59
stickupkidmanadart, you can delete the checklist from the PR, it's just away to make you remember :D12:00
manadartstickupkid:12:01
manadartDone.12:01
stickupkidmanadart, done12:05
jamstickupkid: any chance you could help me understand an issue with compiling Juju for windows?12:11
stickupkidjam, of course12:11
stickupkiddaily?12:11
jamsure12:11
stickupkidmanadart, do we want `juju move-to-space db-space 172.31.1.0/28 172.31.16.0/20` or `juju move-to-space db-space id1 id2`?12:54
stickupkidjam, "success"13:08
jamstickupkid: indeed :013:32
achilleasarick_h_: this is how the who-departed will work: https://paste.ubuntu.com/p/KVFDYrhnXQ/ did I miss anything?14:53
stickupkidmanadart, if I use SubnetsByCIDR to gather the tags for calling MoveSubnets, what's a tag in the params.SubnetsResults?15:06
stickupkidmanadart, the ID?15:06
manadartstickupkid: Yes.15:06
stickupkidyolo15:06
stickupkidthat's not confusing, tags are IDs15:06
stickupkid:|15:06
rick_h_achilleasa:  looking15:07
rick_h_achilleasa:  is that first number the relation id?15:08
achilleasayes this is a debug log entry15:08
rick_h_achilleasa:  that looks right to me15:08
achilleasathe plan is to expose the departing unit to charms via the JUJU_DEPARTING_UNIT envvar15:08
achilleasa(only present when running relation-departed hooks)15:09
rick_h_achilleasa:  +115:10
achilleasarick_h_: is this the bug we are targeting or is there a newer one out there? https://bugs.launchpad.net/juju-core/+bug/141787415:19
mupBug #1417874: [RFE] Impossible to cleanly remove a unit from a relation <canonical-is> <charms> <feature> <hooks> <sts> <sts-rfe> <juju:Triaged> <juju-core:Won't Fix> <https://launchpad.net/bugs/1417874>15:19
rick_h_achilleasa:  let me check. I think I added the one to the checklist on the main card15:21
rick_h_achilleasa:  yea, that's the right looking one15:21
achilleasarick_h_: cool; I will mark that as in-progress15:22
rick_h_achilleasa:  woot woot15:23
stickupkidmanadart, why do these exist here? https://github.com/juju/juju/blob/develop/core/network/space.go#L26-L4915:33
manadartstickupkid: Not sure where those are used in conversion, but they might be better closer to usage...15:37
stickupkidmanadart, yeah, these aren't core, esp. if we want to rip out the CLI, thise makes it super hard15:37
stickupkidoh god, they're like fucking view models and core models - yikes15:38
stickupkidmanadart, got a sec15:39
stickupkid?15:39
manadartstickupkid: Yep.15:40
flxfoohi all,16:08
flxfoowe have an issue with rackspace, when trying to deploy a new unit we have "cannot run instance: failed to run a server with nova.RunServerOpts{Name:"juju-00f9f6-v5-prod-50", FlavorId:"general1-2", ImageId:"6e731e8e-ff3d-4e27-be6c-147fde688b7c", UserData:[]uint8{0x1"16:08
flxfoowhere the imageID is no longer available16:09
flxfoosupport told me to use another image ID16:09
flxfoobut I don't know how to tell juju to use that new image ID...16:09
flxfooany idea?16:09
achilleasaI think I just found the function with the longest signature in juju! https://github.com/juju/juju/blob/develop/worker/uniter/runner/context/export_test.go#L15617:16
* rick_h_ dies just a little more inside17:16
rick_h_wow, that...is impressive17:16
achilleasaIts call-site is even more impressive: https://github.com/juju/juju/blob/develop/worker/uniter/runner/context/env_test.go#L11317:17
achilleasaI will ... structurify it :D17:18
rick_h_hah, good luck!17:19
achilleasaI need to add an extra field there so...17:19
flxfoohi all20:10
rick_h_howdy flxfoo20:10
flxfooI find the reference if the "bad" image Id in /var/lib/juju/bootstrap-params file in the controller instance20:10
flxfoorefered as a custom-image-metada20:11
flxfoocan I remove or change that value?20:11
rick_h_flxfoo:  normally that's set via controller-config I believe. Is this a running controller?20:13
flxfoorick_h_: yeah running controller20:16
rick_h_flxfoo:  ok, let me dbl check if it's model-config or controller-config you'd set to change that value20:17
flxfoorick_h_: I have neither that key in controller-config nor model-config :(20:18
flxfooor I don't look at the  right place?20:19
rick_h_flxfoo:  yea, refreshing. I think you're into https://discourse.jujucharms.com/t/cloud-image-metadata/113720:20
rick_h_flxfoo:  which is using the metadata-source arg on bootstrap.20:20
rick_h_flxfoo:  and you can see some metadata related config in the model-config `juju model-config | grep meta`20:21
rick_h_flxfoo:  I'd be curious what those are currently set to?20:21
flxfoorick_h_: agent-metadata-url defalt ""20:22
flxfoorick_h_: agent-metadata-url default ""20:22
flxfoorick_h_: container-image-metadata-url default ""20:22
flxfoorick_h_: image-metadata-url default ""20:23
flxfoothat's what I got20:23
flxfooI think the issue is related to that thread https://discourse.jujucharms.com/t/rackspace-cloud-london-region-missing-images/1339/520:23
flxfoowhere had been applied a "temporary" fix... using simplestream... and I think it should revert... but I don't know how... :(20:24
rick_h_flxfoo:  oh ok, good question.20:24
flxfoothis `custom-image-metadata should probably be empty or so..20:24
flxfoorick_h_: I suppose if I change that `bootstrap-params` file that won't change anything... right?20:25
rick_h_flxfoo:  yea looking. I'd not expect that to do anything now that bootstrap is over. Since it's a bootstrap arg, and not config, it's not really a thing that's got a knob for "changing it"20:29
rick_h_flxfoo:  so trying to validate if there's a clear path to changing it or not. I'd hate to bork things even more.20:29
flxfoorick_h_:ok thanks... do you a location where i could check that as well? or is it source code only?20:30
rick_h_flxfoo:  yea in this case I'm just poking at source trying to see20:31
flxfoorick_h_: k20:31
rick_h_flxfoo:  honestly might have to wait and ask wallyworld for his expertise in this area20:31
flxfooand he is the one who was appearing in the thread... so...20:31
flxfoorick_h_: is he around sometime... better tomorrow?20:32
rick_h_flxfoo:  he'll be online in the next couple of hours20:32
flxfoook will try to wait a little then... thanks for your time... I though i was going crazy... (not to mention the quarantine)20:33
flxfoomaybe you could answer that following question though...20:33
flxfooso i have this `custom-image-metadata` with at least a image id which is causng trouble because not theire anymore...20:34
flxfoothen the following lines defines the regions etc...20:34
flxfoocontroller-cloud: name:rackspace. etc... regions etc...20:35
rick_h_right, that's the general cloud definition baked in. It tells the contrller things like api endpoints to use/etc20:35
flxfooI suppose that custom-image-metadata is taking precedence on the that following list... am I making a correct assumption?20:36
rick_h_flxfoo:  well it's filling in the images specific data and not everything there. It can't refer to a region that the cloud list doesn't know about, for instance20:37
rick_h_flxfoo:  but it's tied together for sure20:37
flxfoocustom-image-metadata: '[{"id":"6e731e8e-ff3d-4e27-be6c-147fde688b7c","virt":"pvhvm","arch":"amd64","version":"18.04","crsn":"LON","region":"LON","endpoint":"https://lon.identity.api.rackspacecloud.com/v2.0/"}]'20:38
flxfoohere it would tell to use that particular image in case of region LON endpoint reached...20:39
rick_h_flxfoo:  right so that's saying that image is avilable in that region20:39
flxfoook20:39
rick_h_flxfoo:  there could be more images with different architectures/etc as well.20:39
rick_h_flxfoo:  in particular different ubuntu series like 14.04, 16.04, 18.04 but we know not all regions have the same things, etc20:39
flxfoorick_h_: that's my point, the URL (thread) I posted was saying that for some time images were not available for LON region... so a custom bootstrap was made... then the images are then available... but the controller does not know about it20:40
flxfooI am curious what would look like a setting when images are provided by region...20:41
rick_h_flxfoo:  right, so this gets interesting as the use case for htis is more bootstrapping on openstack and defifining things for that. I'm not sure how it's mutated/managed over time20:42
rick_h_flxfoo:  in theory all this data should be pulled from an online stream url. If the stream is valid, and Juju is looking at that url, it might just be a cause of removing this.20:42
rick_h_flxfoo:  but in looking at the code a metadata directory is setup on the machine and such so I think there's more to it than that20:43
rick_h_so that's where I don't want to mess you up and wait for wallyworld20:43
flxfoorick_h_: exactly... obviouslly it is not manageable, because now that rackspace upgraded their images (That I suppose is my issue) then my model is just no its own,  I can not deploy or up.dwon scale anything20:43
rick_h_flxfoo:  yea :( maybe you can use that model config to set the image-metadata-url to the official one?20:44
flxfoorick_h_: ok thanks...20:44
rick_h_flxfoo:  but it's not clear who wins priority atm20:44
flxfoorick_h_: right, well I have to check... would it be the images endpoint url?20:45
flxfoorick_h_: (if I cURL rackspace api I can get a list of available images)20:46
rick_h_flxfoo:  so I was thinking the model-config parameter image-metadata-url20:46
rick_h_flxfoo:  we can test this by adding a new model if you can?20:46
rick_h_and then set that value, and see if you can `juju add-machine`20:46
flxfoorick_h_: I suppose I won't interfere with the current model?20:47
flxfoorick_h_: sorry I am a bit new to juju...20:47
flxfoorick_h_: what are the risks? :p20:47
rick_h_flxfoo:  right, but doing it in a new model we're reducing any risk20:48
rick_h_flxfoo:  once we're done with the test we can just remove the model20:48
flxfoorick_h_: sure I got that, not playing with the current model but a new one...20:49
flxfoorick_h_: I don't have any config to pass to a new model though20:51
rick_h_flxfoo:  do you know the url that rackspace hosts for the image data normally?20:55
flxfoohttp://cloud-images.ubuntu.com/releases/streams/v1/com.ubuntu.cloud:released:rax.json could it be this?20:57
flxfoonaaaa20:57
flxfoosorry20:57
flxfoo https://lon.images.api.rackspacecloud.com/v2/<tenantid>/images20:59
flxfoothrough their api...21:00
flxfooso you got a json list of image definitions with other details...21:00
rick_h_hmm, so the question is can you set that in the new model using `juju model-config image-metadata-url="https://lon.images.api.rackspacecloud.com/v2/<tenantid>/images"`21:00
flxfoorick_h_:  as the controller has the `tenant-name` + the identity endpoint defined by region , i suppose it should be just https;//lon.images.api.rackspace.com/v221:04
rick_h_flxfoo:  yea, might be. That I'm not 100% sure on. one thing we can do is make sure to crank up logging and watch for what it's doing in the actual requests.21:05
rick_h_flxfoo:  juju model-config logging-config="<root>=DEBUG;unit=TRACE"21:06
rick_h_well probably not unit-trace21:06
rick_h_flxfoo:  juju model-config logging-config="<root>=DEBUG;"21:06
flxfoorick_h_: can that debug configuration load machines?21:10
timClicksprogress report for last week is live https://discourse.jujucharms.com/280721:11
rick_h_flxfoo:  what do you mean by "load machines"?21:12
rick_h_flxfoo:  it'll make all logging at debug level until it's set back to info21:12
flxfoook21:14
flxfooI will try now to see if that gives something21:15
flxfoorick_h_: should I add a charm like memcached or something small?21:17
rick_h_flxfoo:  just `juju add-machine`21:19
rick_h_flxfoo:  and see if you can get a new machine to come up21:19
flxfoook I have something different21:22
rick_h_hah, not sure if that's a good sign or a bad one21:22
flxfoofailed to start machine 0 (multiple networks with label "": [5836eb06-731c-4653-87ac-bebcd97f1a18 dd3389c6-cc70-43bf-a8ec-489be09855cb21:23
flxfoo:)21:23
flxfooTo resolve this error, set a value for "network" in model-config or model-defaults;21:24
flxfooor supply it via --config when creating a new model), retrying in 10s (10 more attempts)21:24
rick_h_flxfoo:  ok, so have to set the model value for that21:25
rick_h_flxfoo:  exactly21:25
rick_h_flxfoo:  so have to add that to the model-config for our test model21:25
rick_h_flxfoo:  juju model-config network=XXXXXX (not sure which one you want)21:25
flxfoorick_h_: wait not sure what I am suppose to put here21:27
rick_h_flxfoo:  one of those uuids from above21:29
rick_h_flxfoo:  we might have to check and see if there's a value in your other working model?21:30
rick_h_flxfoo:  I would assume that was needed there as well21:30
rick_h_flxfoo:  you can get the current config values by just doing `juju model-config network`21:30
flxfoorick_h_: ok passes, but still have the original error line from custom-metadata-url content21:45
flxfoo:(21:45
flxfoorick_h_: so I suppose the custom-metadata-url gets precedence21:50
flxfoorick_h_: which code did you look at for `custom-metadata-url`?22:12
babbageclunkhey timClicks, how should I fix a bug in the docs?22:18
wallyworldflxfoo: if you bootstrapped with --metadata-source arg, then that custom image metadata is stored in mongo and takes precidence. you'll need to delete those image metadata records. to do that you'll need to turn on the image-metadata feature flag on the controller and on the client. to set on the controller, "juju controller-config features=[image-metadata]". you might need to bounce the controller agent systemd, not sure. then22:20
wallyworld on the client, export JUJU_DEV_FEATURE_FLAGS=image-metadata. after that, you can juju metadata delete-image <id>. you can also juju metadata list-images22:20
flxfoowallyworld: ok, thanks... I will need to read that several times... :)22:21
wallyworldsure, it's a bit messy because image metadata manipulation is not something normally exposed out of the box - you need a feature flag enabled and if not done at bootstrap, you need to turn it on afterwards. if anything is unclear, just ask. i would expect there will be questions22:22
flxfoowallyworld: thanks a lot... give me a bit time :)22:23
wallyworldi assume you had custom jsom image metadata at bootstrap time? and you bootstrapped with --metadata-source22:23
wallyworldin any case, once the feature flag is enabled, you'll have access to add/list/delete custom image metadata commands22:24
wallyworldto see what your controller is using22:24
flxfoowallyworld: correct bootstrapped with --metadata-source (I did not do that personally but the person in charge at the time)22:29
flxfoowallyworld: so I understood properly, we will tell the juju client to use the `image-metadata` with the JUJU_DEV_FEATURE_FLAGS env var. Then by setting the related controller config entry `features`... restart the controller agent (which I need to check which process it is)... did I get things right?22:32
flxfoowallyworld: I mean , If you undrestand what I am writing... I look tired :)22:33
flxfoowallyworld: I think I got the picture...22:33
flxfoowallyworld: are you around about that time usually?22:33
flxfoowallyworld: the fact that I modified the `image-metadata-url` would have an incidence?22:36
babbageclunkflxfoo: that sounds right to me - I think wallyworld might have afk'd for a moment22:37
babbageclunkflxfoo: you can bounce the juju agent on the controller with `sudo systemctl restart jujud-machine-0.service`22:40
babbageclunk(assuming this is just a one-machine controller?)22:40
flxfoobabbageclunk: yes22:40
flxfoobabbageclunk: thanks22:41
wallyworldflxfoo: sorry, was caught up with something else. yeah, summary is correct. first step is to get the feature flag enabled and use the list-images command to see what the controller is using22:41
flxfoowallyworld: nm22:41
wallyworldtz here is GMT+1022:41
flxfoowallyworld: k22:41
wallyworldto restart the controller agent, ssh into the controller machine (ususally juju ssh -m controller 0) and then restart the juju-machine-0 systemd service22:43
flxfoowallyworld: I will try that tomorrow morning.. and will let you know... I think things/issues come from there https://discourse.jujucharms.com/t/rackspace-cloud-london-region-missing-images/1339/522:43
flxfoowallyworld: many thanks, I would not have found that by myself for sure... :)22:44
wallyworldnp, here to help you get this sorted. good that rackspace has complete image metadata but a mess to clean up for sure22:45
flxfoowallyworld: and they are not helping... you are... thanks guys22:45
flxfooI am out... good night/day :)22:46
wallyworldttyl :-)22:46

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!