/srv/irclogs.ubuntu.com/2016/06/30/#juju-dev.txt

mupBug #1597601 opened: ERROR cannot deploy bundle: cannot deploy application: i/o timeout <oil> <juju-core:New> <https://launchpad.net/bugs/1597601>05:02
=== frankban|afk is now known as frankban
perrito666thumper: fix it then ship it08:23
urulamathumper: hey ... any estimate when this will be fixed and shipped? :) http://reviews.vapour.ws/r/5185/08:42
thumperurulama: before lunch08:42
* urulama lunches in 15min then ...08:43
urulama:)08:43
=== wwitzel3_ is now known as wwitzel3
=== ionutbalutoiu_ is now known as ionutbalutoiu
ericsnowkatco: ping09:31
ericsnow(oops, too early)09:32
thumperperrito666 or natefinch: http://reviews.vapour.ws/r/5186/09:32
thumperjust picking on you because you did the other one09:32
perrito666thumper: that is how you pay us09:37
thumperpenalty for helping09:40
perrito666thumper: done09:42
perrito666as usual, If menn0 reviews this he will find 120138019283019831023 more things than I did09:42
thumperperrito666: ta09:43
rogpeppeaxw: ping09:49
menn0perrito666: and wallyworld will find even more than me :)09:51
perrito666So wallyworld should be the only reviewer, naturally09:54
rogpeppemenn0: hiya09:58
rogpeppemenn0: do you know what the status of the controller/model config split is, by any chance?09:58
rogpeppeperrito666, wallyworld, axw: ^09:58
rogpeppethumper: ^09:59
thumperrogpeppe: axw is working on it09:59
wallyworldit's wip, partly done09:59
thumperI'm not sure09:59
wallyworldwhat is the specific question?09:59
rogpeppewallyworld: we're wondering whether the config is going to be split in the providers themselves10:00
rogpeppewallyworld: and if so, what's going to happen to Provider.Schema method?10:00
axwrogpeppe: not sure what you mean - providers shouldn't need to know about controller config in general10:01
wallyworlddon't quite follow sorry. by the time the providers are instantiated, they will see environ/config/Config10:01
wallyworldwhich will contain only model config10:01
rogpeppeaxw: ah, ok, cool.10:01
axwrogpeppe: I guess we'll still have it, but it won't include controller config fields. we can have a separate controller config schema, but I don't think that's really useful for you?10:01
wallyworldthere's a state api call to get controller congih10:01
rogpeppeaxw: so there will still only be one set of configuration attrs for a given model10:02
rogpeppeaxw: but... what about credentials?10:02
axwrogpeppe: there's a separate schema for creds10:02
axwrogpeppe: so, separate schemas for model, controller and credentials10:02
axwtho controller is general, so doesn't really need a schema at all10:03
rogpeppeaxw: so environschema.AccountGroup becomes redundant?10:03
axwrogpeppe: yep10:03
rogpeppeaxw: so Provider.Schema returns two values?10:03
rogpeppeaxw: can the attribute names overlap?10:03
axwrogpeppe: maybe. EnvironProvider already has a CredentialSchemas method though10:04
axwrogpeppe: credential and model attrs?10:04
rogpeppeaxw: Schemas plural?10:04
axwrogpeppe: yeah, each provider can define multiple auth types10:04
axwrogpeppe: e.g. access-key and userpass for openstack10:04
rogpeppeaxw: so where is the auth type specified?10:05
axwrogpeppe: hypothetically the model and credentials could have overlapping attr names. they should be considered completely separate10:05
frankbanwallyworld: I am trying to convert the GUI API client for the new ModelManager facade (without COnfigSkeleton). I am encountering credential errors on ec2: e.g. http://pastebin.ubuntu.com/18158931/10:05
axwrogpeppe: a credential is a key-value map, one of the keys has a special name "auth-type"10:05
axwthe value of which is interpreted in a provider-specific manner10:06
axw(and must have a schema defined by the provider)10:06
rogpeppeaxw: how does the CredentialAttr.FilePath stuff work when credentials are passed across the network?10:07
axwfrankban: I think that's a small bug, can you try passing "user-admin@local" as the owner?10:08
wallyworldfrankban: you need to specify a credential to use if you are not the controller admin10:08
axwrogpeppe: they have to be converted at the client first10:08
axwrogpeppe: that bit is a bit iffy at the moment, needs some rework when we come to updating environschema10:09
frankbanaxw: that works10:09
rogpeppeaxw: ISTM that most of this stuff isn't really compatible with the way environschema does things10:09
axwfrankban: thanks, I'll patch that shortly10:10
rogpeppeaxw: or could do things, even10:10
frankbanaxw: cool, so we don;t need to pass any config anymore, and no ssh keys correct>10:10
frankban?10:10
axwfrankban: authorized-keys are still required at the moment, I have a patch up but can't land until the beta is out10:10
axwfrankban: i.e. the patch will make authorized-keys optional10:10
rogpeppeaxw: in particular, we've now got many overlapping attribute names with potentially different types depending on other attributes10:11
frankbanaxw: well, this worked without ssh keys... http://pastebin.ubuntu.com/18159325/10:11
axwfrankban: ah, special case for admin user :) that will be going away10:12
axwrogpeppe: example?10:12
frankbanaxw: so, is it ok for the GUI, for the time being to not set CloudCredentials and to still pass fake ssh keys?10:12
frankbanaxw: and to use @local in the onwner-tag?10:13
rogpeppeaxw: for example, AFAICS you could have two auth types, both of which define a credential field with the same name but a different type10:13
axwfrankban: that's fine10:13
frankbanaxw: cool thanks10:13
rogpeppeaxw: as returned from CredentialSchemas10:13
axwrogpeppe: credentials are always strings10:13
frankbanaxw: just to confirm, "user-admin@local" will continue working after your fix, correct?10:13
axwfrankban: yes10:14
rogpeppeaxw: ok, i see10:14
axwfrankban: we may want to stop accepting invalid SSH keys at some point, but that should be easy to drop in the GUI10:14
rogpeppeaxw: but different descriptions and other attributes, which amounts to a similar thing10:14
rogpeppeaxw: different sets of allowed values too10:15
axwrogpeppe: I don't really understand the problem. You could hypothetically, but they're still relative to the auth-type. In the GUI you would select an auth-type, and then the attr name should make sense in that context10:16
frankbanaxw: ok so params would be like this: params': {'config': {'authorized-keys': 'bad-wolf'},10:16
frankban            'name': 'test-model',10:16
frankban            'owner-tag': 'user-admin@local'},10:16
frankbancorrect?10:16
axwfrankban: yup10:16
rogpeppeaxw: the problem is that in our service, we have a unified view of "the model config" which includes all attributes. that's just become extremely special-case-y10:17
redirPR seeks review: http://reviews.vapour.ws/r/5153/10:17
axwrogpeppe: credentials are not part of model config *at all* now, though. you manage credentials separately in juju, using the Cloud facade. then when you create a model, you specify a credential by name10:18
rogpeppeaxw: i guess i was hoping to see a mode general mechanism than just special-casing auth-type10:18
frankbanaxw: to be more future proof, should always include the first credential name returned by Cloud.Credentials?10:18
rogpeppeaxw: they're part of the configuration you need when creating a model10:18
rogpeppeaxw: are you saying you can't explicitly pass credentials attributes now?10:18
axwrogpeppe: that's something I'm working on fixing. you currently have to duplicate the creds into model config due to things being half done10:19
rogpeppeaxw: if possible, i think we'd prefer to avoid the *necessity* to have a named set of credentials in order to use some credentials, as it's just another thing to manage.10:20
axwfrankban: https://github.com/juju/juju/pull/5704 <- this PR adds a Cloud.CloudDefaults method, which includes the default credential name10:20
axwfrankban: I guess for now yo ucould just use the first one in Cloud.Credentials10:20
* rogpeppe drops of the network for a few seconds10:21
rogpeppeoff10:21
rogpeppeback10:22
frankbanaxw: if I need to change it later, then maybe I'll just go with empty credential and therefore only allow admin to create models from the GUI for now. does it sound reasonable to you? and also could you please send me an email when everything is ready with a summary of the new strategy I should implement in the GUI?10:22
axwrogpeppe: so credentials are managed separately from models now. you can have multiple models using the same credentials. to avoid duplication, and to support updating/revoking creds, we use a name for reference10:23
axwrogpeppe: similar to how you specify credentials at bootstrap time10:23
axwfrankban: yes that sounds fine to me. will do10:23
frankbanaxw: thanks a lot10:23
axwnp10:24
wallyworldericsnow: this is a quick and dirty pr just to get *something* done for the release deadline http://reviews.vapour.ws/r/5187/10:44
ericsnowwallyworld: k10:45
axwwallyworld: can you please review https://github.com/juju/juju/pull/574110:59
=== jamespag` is now known as jamespge
=== jamespge is now known as jamespage
wallyworldaxw: looking11:03
fwereadekatco, wallyworld, I am seeing a *lot* of audit spam that looks like: machine-0: 2016-06-30 10:56:18 CRITICAL juju.cmd.jujud machine.go:1055 ModelUUID not valid11:04
wallyworldfwereade: i just found that myself :-( i've fixed it11:05
fwereadewallyworld, <311:05
fwereadewallyworld, katco: do we know how this happened? presumably we did run a controller with these changes before we landed them?11:06
wallyworldfwereade: i just found it running a controller to test the addition of an local audit log file sink11:07
mupBug #1385276 changed: juju leaves security groups behind in aws <bug-squad> <destroy-environment> <ec2-provider> <jujuqa> <repeatability> <security> <juju-core:Fix Released> <juju-core 1.25:Triaged> <https://launchpad.net/bugs/1385276>11:12
mupBug #1597704 opened: juju status --format=tabular goes double space if one message is long <2.0> <status> <ui> <juju-core:Triaged> <https://launchpad.net/bugs/1597704>11:12
thumperjam: http://reviews.vapour.ws/r/5186/11:16
axwcherylj: can I JFDI https://github.com/juju/juju/pull/5741, or would you like me to wait?11:22
jamthumper: http://reviews.vapour.ws/r/5188/11:25
mupBug #1597720 opened: It is not possible to refer to multiple models with the same name from the CLI <juju-core:Triaged> <https://launchpad.net/bugs/1597720>11:48
ericsnowaxw: https://github.com/juju/juju/pull/574312:07
redirfwereade: diagram?12:37
fwereadewallyworld, do you have a CL up for that logging yuck? it's... really quite inconvenient12:37
fwereaderedir, that sounds good, I thought we had a couple of sessions coming?12:38
redirfwereade: OK. I am also good doing it by habgout with a screen large enough and a trackball12:38
natefinchredir: https://github.com/natefinch/claymud/blob/master/util/query.go12:49
* perrito666 wonders if his credit card would mind if he nuked it with a laptop12:55
fwereaderedir, face to face is better, though: can we do it after the escape analysis session?13:01
redirsure thing fwereade13:02
alexisbbabbageclunk, please update when you have a moment: https://bugs.launchpad.net/juju-core/+bug/156770813:17
mupBug #1567708: unit tests fail with mongodb 3.2 <juju-core:In Progress by 2-xtian> <https://launchpad.net/bugs/1567708>13:17
alexisbhttps://bugs.launchpad.net/juju-core/+bug/157901013:21
mupBug #1579010: state: removing model can generate huge transactions <destroy-model> <juju-release-support> <scalability> <juju-core:Triaged> <https://launchpad.net/bugs/1579010>13:21
alexisb^^ thumper13:21
mupBug #1555368 changed: Panic due to sending on closed channel <ci> <intermittent-failure> <panic> <test-failure> <juju-core:Triaged> <https://launchpad.net/bugs/1555368>13:31
menn0perrito666: http://reviews.vapour.ws/r/5190/13:31
=== dimitern` is now known as dimitern
babbageclunkalexisb: yup, sorry - was afk13:35
cory_fujunaidali: You asked in a PM about `unit-get public-address` returning an IP instead of a FQDN for your deployment and whether there was any way to work around that; I'm not entirely certain, but I think that Juju just passes through what the provider gives it.  Someone here might be able to give more insight13:36
mbruzekalexisb: and or cherylj: A partner at IBM has pointed out a possible bug with Resources here: https://bugs.launchpad.net/juju-core/+bug/1597354  This is a blocker for IBM and they are very concerned about it. Can someone triage it and respond in the bug?13:37
mupBug #1597354: Juju 2.0 Resource Error - cannot add resource failed to write data: read tcp : i/o timeout <juju-core:New> <https://launchpad.net/bugs/1597354>13:37
cheryljmbruzek: we need /var/log/syslog and /var/log/juju/machine-0.log  from the controller machine13:38
cheryljmbruzek: I'll put that in the bug13:38
mbruzekcherylj: they are chatting with me on IRC. I told them what you need as well.13:40
mbruzekThank you cherylj13:40
cheryljsure thing.  I might need to pull in katco or someone else who's done work on resources to help13:41
cheryljkatco, ericsnow - could either of you take a look at this bug comment and see if there's any workaround?  https://bugs.launchpad.net/juju-core/+bug/1597354/comments/314:03
mupBug #1597354: Juju 2.0 Resource Error - cannot add resource failed to write data: read tcp : i/o timeout <juju-core:Incomplete> <https://launchpad.net/bugs/1597354>14:03
ericsnowcherylj: yep14:07
cheryljthanks ericsnow!14:09
aisraelcherylj: Do you know who'd be the point of contact for juju actions?14:14
cheryljaisrael: bogdanteleaga might be able to help you out14:17
aisraelcherylj: Thanks!14:17
cheryljnp!14:17
katcofwereade: sorry about that. landed that change at close to midnight to try and unblock axw the following day. didn't have time to do any manual testing14:30
aisraelbogdanteleaga: I think the issue w/the client I'm helping is resolved, so you're off the hook. I have some usability requests but I'll file bugs for those.14:36
katcoericsnow: hey saw you pinged me earlier15:11
ericsnowkatco: just wanted to catch up15:11
ericsnowkatco: and see how things have gone with closing ;)15:11
katcoericsnow: boring paperwork :)15:11
ericsnowkatco: yep15:12
cheryljjam, alexisb - https://bugs.launchpad.net/juju-core/+bug/159472015:23
mupBug #1594720: lxd containers not using configured proxy for downloading images <addressability> <lxd> <network> <proxy> <juju-core:Triaged> <https://launchpad.net/bugs/1594720>15:23
thumperurulama: all api breaks landed16:01
thumperas far as we are aware16:01
thumperfrankban: ^^16:02
thumperif I have missed any, I'll be grumpy but let me know16:02
thumperjust emailed juju-dev list with details16:02
frankbanthumper: cool thanks16:02
thumpersome cribbed from frankban's email16:02
thumper:)16:02
thumperno worries16:02
urulamathumper: all api breaks *that we are aware of atm* landed ? :)16:04
thumperyeah16:04
frankbanurulama: ah "DestroyModel has moved from the "Client" facade to the "ModelManager" facade" I was not aware of that, we need to handle that as well16:04
thumperI thought I got them the first time around16:04
urulamafrankban: yeah, seen the list :-/16:04
thumperand the CharmInfo call16:05
urulamafrankban: but ATM, we don't destroy models in the gui as well16:05
thumpernot sure if you were getting it from "Client" or "Charms"16:05
frankbanurulama: I remember we do16:05
thumperthe go api only called the "Client"16:05
urulamafrankban: it was disabled16:05
frankbanthumper: yes I am working on CharmInfo16:05
frankbanurulama: cool, but let's just keep that in mind, the change should be trivial16:06
thumperhowever there were two, slightly different, implementations in the server16:06
urulamafrankban: yeah, keeping the list visible on screen :)16:06
frankbanthumper: I see we had a side effect of this API change that is not only related to consistency at least: we discovered quite a lot of internal structures sent over the wire16:08
mupBug #1597830 opened: agent restarted as part of machine jobs update <juju-core:Triaged by anastasia-macmood> <juju-core 1.25:In Progress by anastasia-macmood> <https://launchpad.net/bugs/1597830>16:22
plarsHi, anyone seen a situation where the bootstrap node constantly has *very* high load? I'm not sure if it's the cause or a symptom, but mongodb is hammering the logs16:37
=== frankban is now known as frankban|afk
plarshigh as in - 400-500! restarting juju-db brings it down for a little while, but it goes back up pretty quickly16:38
plarsjuju version is 1.25.516:39
perrito666plars: how many nodes?16:43
plarsperrito666: it seems to be just the bootstrap node where this is happening16:43
perrito666plars: yes, but how many nodes are there in your environment?16:43
plarsperrito666: not many, I think 5 or so?16:44
plarsperrito666: I didn't see this problem until recently16:44
cheryljbogdanteleaga: are you around?16:45
plarsperrito666: we had a power outage, and things came back. But I had a lot of trouble reaching anything or getting juju status. After a few timed out attempts, I was finally able to juju ssh 0 and see that the load was so high16:45
perrito666plars: ok, that strange behavior with so little nodes I have not seen before, what size is your db? (you can tell by the size of /var/lib/juju/db folder in the bootstrap node16:45
bogdanteleagacheryl, yup16:46
cheryljhey hey bogdanteleaga16:46
plarsperrito666: all the files taken together? there are a lot of numerical extension files there, like rotated logs?16:46
bogdanteleaga-what's up16:46
perrito666all together16:46
cheryljbogdanteleaga: I've been working more on bug 157794916:46
mupBug #1577949: windows services cannot upgrade to 1.25.6 <blocker> <ci> <regression> <upgrade-juju> <windows> <juju-core:In Progress by anastasia-macmood> <juju-core 1.25:In Progress by cherylj> <https://launchpad.net/bugs/1577949>16:46
plarsperrito666: 7.8G according to du16:46
cheryljbogdanteleaga:  and I'm seeing that when we restart the juju machine agent on the windows machine, and it's running 1.25.6, it thinks that the unit agent isn't running and that it has to start it again16:47
cheryljbogdanteleaga: so the service.ListServices call isn't listing the unit agent16:47
cheryljbogdanteleaga: I don't see that anything has changed in juju/juju/service/windows16:48
cheryljbogdanteleaga: nor has the github.com/gabriel-samfira/sys dependency16:48
cheryljBUT16:48
bogdanteleagawe have had some problems some time ago with that particular function having weird behavior when compiled with different go versions16:49
cheryljbogdanteleaga: we did change from using go 1.2 to using go 1.6 between 1.25.5 and 1.25.616:49
anastasiamacthumper: fwereade: https://github.com/juju/juju/pull/5746 (for some reason rb is not picking it up)16:49
bogdanteleagaiirc, it didn't work with 1.4, but it did work with 1.6 in our tests, so we ended up not changing it16:50
bogdanteleagayou can just do a small main function that calls it and see if it works16:51
bogdanteleagain case you have access to the failing machine16:51
perrito666plars: for now, I can advice you to get juju/juju-db running and, if the load can be sustained leave it  be and it might clean up the db, otherwise perhaps tomorrow I could give you a better answer since we are working on a similar issue tryig to pinpoint what is going on16:51
cheryljbogdanteleaga: I have access, but I would need some handholding as I don't know windows much at all16:51
plarsperrito666: it's running ok, but it's been in this state for almost a week16:51
perrito666plars: a full week running at a 400 load?16:52
perrito666plars: could you ping me tomorrow same time?16:52
plarsperrito666: I modified rsyslog to have it discard a lot of those messages and was able to get the load down to 15-100 most of the time, but still not great16:52
perrito666I might have a solution for you16:52
plarsperrito666: sure16:52
perrito666tx a lot, if you could put up some logs and perhaps report a bug I would be most grateful16:52
plarsperrito666: sure, will do16:53
perrito666again, tx a lot16:53
cheryljbogdanteleaga: I need to run soon (I'm sprinting with the team in London this week and I need to get out of the office)16:53
bogdanteleagacherylj, so is it the deployer that checks for the unit agents?16:53
bogdanteleagayeah, I g2g soon too16:54
bogdanteleagaso my first advice would be to just write a small main function and create an executable that just calls ListServices and check how the output looks16:54
bogdanteleaga(run the executable on the failing machine, and also make sure to use the same go version for compilation)16:55
cheryljbogdanteleaga: yeah - worker/deployer16:55
cheryljbogdanteleaga: if it doesn't work, do you guys already know what changes were needed for 1.4?16:56
cherylj(in case they're still broken)16:57
mgzOdd_Bloke: /quot eod17:11
mgzOdd_Bloke: sorry, ignore me17:11
mupBug #1597860 opened: "juju machine remove" cmd throughs error in 2.0  <juju-core:New> <https://launchpad.net/bugs/1597860>18:02
mupBug #1597879 opened: jujud hangs on trusty arm64 <juju-core:New> <https://launchpad.net/bugs/1597879>18:56
bogdanteleagacherylj, we needed a new package that used another windows api to fetch the info, you should probably ask gabriel about i19:07
bogdanteleagait*19:08
=== urulama is now known as urulama|___
mupBug #1597941 opened: juju2.0beta10: websockets API usability Application Deploy failure to inform of required addCharm pre-requisite <kanban-cross-team> <usability> <juju-core:New> <https://launchpad.net/bugs/1597941>22:56
mupBug #1597941 changed: juju2.0beta10: websockets API usability Application Deploy failure to inform of required addCharm pre-requisite <kanban-cross-team> <usability> <juju-core:New> <https://launchpad.net/bugs/1597941>23:09
mupBug #1597860 changed: "juju machine remove" cmd thows error in 2.0 <juju-core:Invalid> <https://launchpad.net/bugs/1597860>23:12
mupBug #1597941 opened: juju2.0beta10: websockets API usability Application Deploy failure to inform of required addCharm pre-requisite <kanban-cross-team> <usability> <juju-core:New> <https://launchpad.net/bugs/1597941>23:12

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!