/srv/irclogs.ubuntu.com/2013/09/19/#juju-dev.txt

=== andreas__ is now known as ahasenack
axwthumper-gym: re Preflight, do you have a preference for splitting it into two methods, one for creating an instance, one for a container on an instance? Then the instance.Instance parameter is never optional.01:06
=== thumper-gym is now known as thumper
thumperaxw: sounds very reasonable01:29
wallyworldthumper: so i missed you before, i was stuffing my face. i got that big branch landed :-)01:29
thumperaxw: for example, the null provider can't create machines, but could perhaps create containers01:29
thumperaxw: what did you think of my method name suggestions?01:29
thumperwallyworld: good to get it landed01:29
axwthumper: I quite like Vet, and Precheck isn't bad01:29
axwnot so keen on Probe01:30
axwor Review01:30
thumperPrecheckCreateMachine, PrecheckCreateContainer01:30
thumper?01:30
axwyeah I think that sounds decent01:30
axwthumper: do you think different interfaces are necessary, or is that overkill?01:31
axwMachinePrechecker, ContainerPrechecker... *shrug*01:31
thumperI don't mind either way01:31
thumperchances are01:31
thumperthat every provider will end up having it anyway01:32
thumperfor some precheck stuff01:32
axwyeah true01:32
axwI'll just keep it in one then01:32
thumperok01:32
axwcool01:32
axwthanks!01:32
wallyworldthumper: if you are tired of coding, i have a small piece of work which uses the new storage stuff to set tools retries when needed. but it can wait if you have other things to do https://codereview.appspot.com/13577045/01:37
thumpertired? I haven't even started01:37
wallyworldoops, sorry01:38
* thumper looks01:38
wallyworldyou don't have to01:38
thumperdid01:53
wallyworldthumper: with bool params, i hear you but they are used everywhere. and there are others in the tools area and felt consistency was better here01:57
thumperI know... but I still feel the need to push back01:58
thumperwhat about type AllowRetry bool01:58
wallyworldalright01:58
thumperand then two const values01:58
thumperit doesn't have to be exactly that01:59
thumperbut play and see what feels good01:59
wallyworldyeah, i know the pattern to use. just felt wrong ony changing one instance of it01:59
wallyworldi'll finish my current branch and go back to it soon02:00
hazmatanyone know where we are filing doc bugs?02:11
davecheneyhazmat: juju-core docs series isn't a bad start02:11
davecheneythey all kind of go to the same place/people anyway02:11
hazmatyeah..02:11
hazmatdavecheney, thanks02:12
davecheney% juju scp gccgo/0:/home/ubuntu/gccgo.tar.bz2 .02:32
davecheney^ :heart juju02:32
hazmatfwereade, curious what you think of this https://bugs.launchpad.net/juju-core/+bug/122745002:56
_mup_Bug #1227450: juju does not retry provisioning against transient provider errors <juju-core:New> <https://launchpad.net/bugs/1227450>02:56
hazmatfwereade, it seems with 1.14 things are a bit better for recovering without waiting (ie i can kill machines and services/units without the unit agent coming online)... but ideally the transient would just be auto'd02:57
thumperwallyworld: coming?03:30
wallyworldno 1:30 yet03:30
wallyworldstill 10s to go03:30
axwthumper: wallyworld can you hear/see me in the hangout?03:31
thumperno03:31
thumpertry this one axw wallyworld https://plus.google.com/hangouts/_/0d2e7f7c6d9229ef8ed15d6c8f7ff08b0de146cc?hl=en03:32
bradmdavecheney: any luck on those charm reviews? :)03:37
davecheneybradm: i am really sorry03:51
davecheneyi know they are reviewed but have not made it into the charm store03:51
davecheneyi will try to find out (again) what is going on03:51
bradmdavecheney: no worries, I'll just prod you every now and then about it :)03:53
davecheneybradm: i will follow up with marcoceppi03:56
* thumper twiddles thumbs waiting for lbox before going to make coffee04:11
* wallyworld looks at thumper's review04:12
* thumper noticed something wrong04:12
thumperpoo04:12
* thumper leaves it for now as an exercise for wallyworld to find04:12
* thumper -> coffee04:13
* thumper needs to help with early dinner04:17
thumperback for meetings tonight04:17
=== thumper is now known as thumper-afk
=== tasdomas_afk is now known as tasdomas
rogpeppemornin' all05:01
davecheneyo/05:04
rogpeppedavecheney: hiya05:13
hazmatjust ran into my first real world user who has a default vpc05:41
davecheneyzomg05:51
davecheneyhow did it go05:51
davecheney?05:51
hazmatdavecheney, it didn't work with juju .. throws an error05:54
hazmatthumper-afk, how do you remove a container on a machine05:54
davecheneyhazmat: poop05:55
bradmis there some best practice about how to ship updated code to juju instances via a charm?  right now I've got to update the stuff from python-moinmoin to do openid properly, and I'm shipping files, which just feels like a terrible unmaintainable hack.06:30
bradmI could do patches, but thats only slightly less of an unmaintainable hack06:30
bradmI could try to get the code upstream, but that won't always happen06:31
davecheneybradm: if you're talking about including code inside the charm06:31
davecheneythat is one way06:32
davecheneyotherwise you could have the charm bzr branch something06:32
davecheneybut putting the code inside the chamr will at least ensure that all units of that service get the same copy06:32
bradmdavecheney: yeah, basically I need to patch the python code that the python-moinmoin deb puts on disk for openid06:32
davecheneysounds nasty any way you cut it06:33
bradmlp:~brad-marshall/charms/precise/python-moinmoin/python-rewrite06:33
davecheneyquite a few charms have a configuration settting to control adding a ppa06:34
davecheneyso if you have that config set06:34
bradmthats what I've gotten so far, it does seem to work ok, I've got an instance up on canonistack06:34
davecheneythe install hook will use the ppa version06:34
bradmooh, that could work06:34
bradmit feels like a less terrible hack06:34
davecheneybradm: the wordpress charm is a good plcae to look06:35
bradmdavecheney: ta, I'll have a look at that, it feels like at least then I'll know it'll all work together06:36
bradmit does mean I'd have to keep on top of new versions of moin that come out, and have a way of getting people to update06:37
davecheneyfork's suck06:38
bradmah, a downside of that is you have to assume egress access too, which wouldn't work in our environment06:39
bradmmaybe I should just try and get the code upstream, thats the least sucky option06:40
rogpeppeanyone for a review? https://codereview.appspot.com/1377804306:41
yolandahi, any update on the juju failure from yesterday?07:10
rogpeppeyolanda: hi07:32
yolandahi rogpeppe07:33
rogpeppeyolanda: i got a question that you may be able to answer07:33
yolandatell me07:33
rogpeppeyolanda: do you still have access to an instance that this happened on?07:33
yolandarogpeppe, i destroyed it07:33
yolandabut i can create a new one with the same problem07:33
rogpeppeyolanda: that would be great. i'd like to find out the contents of /proc/sys/vm/overcommit_memory07:34
yolandaok, just a moment07:34
rogpeppeyolanda: thanks07:34
yolandai need to have a working juju for the work i'm doing now so i'm glad to help07:34
rogpeppeyolanda: for the record, here's the question i asked, and its reply from one of the Go core team: http://paste.ubuntu.com/6127199/07:36
yolandashall i try with a bigger instance?07:37
rogpeppeyolanda: if you can, that would be an excellent thing to try, yes07:40
rogpeppeyolanda: but i'd like to see the overcommit_memory thing on an instance where the problem has happened07:40
rogpeppeyolanda: so that we can try to pin down the issue07:40
yolandaok, still bootstrapping, it takes time to sync tools07:40
yolandarogpeppe, /proc/sys/vm/overcommit_memory = 007:44
rogpeppeyolanda: ah ok, i think that probably settles it07:46
rogpeppeyolanda: thanks07:46
rogpeppeyolanda: i guess that too much is going on at bootstrap time07:46
rogpeppeyolanda: perhaps we should run juju as root07:47
yolandarogpeppe, shall i try with a bigger instance to discard memory?07:49
rogpeppeyolanda: yes please - i predict it'll work fine on a bigger instance07:49
yolandalet me try07:50
yolandaby default it uses 512mb right?07:50
rogpeppeyolanda: i don't think there's any default - it probably just chooses the smallest available07:53
yolandatrying with 102407:53
rogpeppemgz: ping07:54
yolandarogpeppe, with 1gb of memory works08:07
yolandaso yes, it's a ENOMEM issue08:07
rogpeppeyolanda: ok, thanks, at least we know where we are now08:07
yolandabut this was working until yesterday afternoon, can it be related with some update done?08:08
rogpeppeyolanda: perhaps something different is being done at bootstrap08:08
rogpeppeyolanda: which uses more memory08:08
yolandai'll deploy a service with 1gb of memory now to test08:09
rogpeppeyolanda: i'm afraid i don't know much about the details of how the openstack instances are set up08:10
yolandaat least the defaults now should be set to 1GB to work08:11
rogpeppeyolanda: yes. or we could set overcommit_memory to 1, i guess08:22
rogpeppeyolanda: or, even better, work out what's taking all that memory at bootstrap time :-)08:23
rogpeppeyolanda: go does grab a lot of VM at init time, although it doesn't touch it until it actually needs it08:23
yolandarogpeppe, but that's not directly related with juju, but with cloud-init, right?08:25
rogpeppeyolanda: well, juju is written in Go, so the VM issue is partially Go-related08:42
rogpeppeyolanda: but what's running at bootstrap time is indeed cloud-init and image-related08:43
yolandarogpeppe, i was asking that to try to file a bug, but i'm not sure on how to place it08:44
rogpeppeyolanda: file it against juju, because there are several possible ways to solve the problem, not all of them in cloud-init.08:49
yolandarogpeppe, ok08:50
jamyolanda, rogpeppe: If you are not overcommitting memory, and go is asking for a bunch that it will use later (but doesn't touch yet), doesn't that cause this issue?09:05
rogpeppejam: indeed it does09:05
jamor is the go request "give me address space" different from "allocate some memory to me"09:05
jamrogpeppe: I know internally we have a default "minimum memory" of 1GB for VMs.09:05
jamthough I think you can pass your own constraints to override it.09:06
rogpeppejam: i'm surprised that when yolanda used a 1GB constraint, that it caused it to work09:06
jamrogpeppe: it might depend on which provider09:06
yolandaworks like a charm now09:06
rogpeppejam: if we do have that minimum memory default constraint09:06
rogpeppejam: yeah. are we getting this stuff from simplestreams now? i wonder if something changed there.09:07
rogpeppeyolanda: which charm would that be? :-)09:07
jamrogpeppe: environs/instances/instancetype.go: "minMemoryHeuristic = 1024"09:09
jamwhich I'm pretty sure is in MB09:09
rogpeppejam: if the instance types were somehow reporting the wrong value, then it might be choosing the wrong instances, i suppose09:10
rogpeppejam: hmm, but then the change in constraints value wouldn't affect it.09:11
jamrogpeppe: theoretically. It is possible that we are getting our units wrong. Do you know what provider this is?09:11
rogpeppejam: this is on canonistack09:11
rogpeppejam: and the issue only just started happening09:12
rogpeppejam: so *something* has changed recently09:12
jamrogpeppe: do you know if there was any change like lcy01 => lcy02 ?09:13
jam01 runs Openstack F while 02 runs Grizzly, IIRC09:14
rogpeppejam: the same issue occurs in both, afair09:14
yolandarogpeppe, https://bugs.launchpad.net/juju-core/+bug/122753309:15
_mup_Bug #1227533: Juju fails to bootstrap if memory is lower than 1GB <juju-core:New> <https://launchpad.net/bugs/1227533>09:15
rogpeppeyolanda: thanks09:16
jamyolanda: are you passing a constraint? or just no constraints?09:20
yolandajam, now i pass a constraint for 1024mb, without constraints it fails09:20
yolandai tried with canonistack only, but i think it was failing under other environments09:21
jamyolanda: strange, because I bootstrapped to canonistack 2 days ago, and things are working. I'll see if I can reproduces09:21
yolandajam, yes, it started to fail yesterday afternoon09:21
yolandai've been playing with juju and canonistack for weeks09:21
jamyolanda: I wonder if a new instance type showed up in the catalogue or something.09:22
yolandait's grabbing from simple-streams, so maybe, yes09:22
jamyolanda: so instance types are in the openstack Flavor catalogue. Vs *image* which is from simplestreams09:22
jamImage == Ubuntu 12.0409:22
jamInstance == m1.small09:22
jamyolanda: it is possible that we got a new image, too, which might have changed overcommit09:23
yolandajam, do you have some booted machine previous to the failure? then you can check for the overcommit09:23
jamyolanda: I do, give me a sec09:24
jammy instance has overcommit_memory = 0 as well09:25
jamfree says I have 512MB, though09:25
yolandasame as mine that were failing09:25
jamtop agrees09:25
jamso it is always possible that canonistack itself is under mem pressure because of a lot of people starting instances, etc. But if it is reliable and not intermittent than I doubt that is the issue09:26
yolandajam, it's not intermittent, happens all time since yesterday, in the 2 zones, at different hours09:27
jamyolanda: so I'll try quickly with 1.14 that is in the stable ppa, I don't know if I can get 1.1209:27
yolandajam, i tested with 1.14 today09:28
yolandasame problem, now i'm using that09:28
jamrogpeppe: so at the least, we have a bug that we think we use a min-memory heuristic of 1GB but don't09:28
yolandayesterday i tried with 1.1209:28
rogpeppejam: well, i think that's true - but it would be good to check the actual memory of the provided instance09:28
jamrogpeppe: I did, the instance I have running for a couple of days is 512MB09:29
rogpeppejam: cool09:29
jamrogpeppe: And I just bootstrapped now and got the same 512MB09:30
rogpeppejam: i've got a proposal for review, if you fancy taking a look: https://codereview.appspot.com/1377804309:30
fwereaderogpeppe, are you expecting https://codereview.appspot.com/13493044/ to go anywhere, or are you dropping it? I've kinda forgotten context from before this week09:31
rogpeppefwereade: ^09:31
fwereaderogpeppe, I'm just going through from the top today, trying to approach the bottom09:31
jamrogpeppe: I do see the failure like yolanda mentioned, Cloud init reports that something failed, and I have "fatal error: runtime: ..."09:31
fwereaderogpeppe, but it's also my meeting day, so...09:31
rogpeppejam: ah, so juju failed to start09:32
jamrogpeppe: right09:32
fwereaderogpeppe, also https://codereview.appspot.com/13512051/09:32
axwfwereade: thansk for https://codereview.appspot.com/13635044/ I'm just waiting for sshstorage to land first.09:32
rogpeppefwereade: ah, i'll submit the latter; the former can wait, i think09:32
axwthanks*09:32
=== thumper-afk is now known as thumper
thumperrogpeppe: hey09:33
rogpeppethumper: yo09:33
jamrogpeppe: https://codereview.appspot.com/13512051/ I think Tim has a branch that changes some names, so it will conflict (eventually), otherwise seems ok09:34
jamfwereade: https://bugs.launchpad.net/juju-core/+bug/1227450 Are we intending that if the first request to Provision fails, we will ever try again?09:38
_mup_Bug #1227450: juju does not retry provisioning against transient provider errors <juju-core:New> <https://launchpad.net/bugs/1227450>09:38
jamI thought we intentionally weren't restarting things people manually stopped09:38
jamwhich sort of falls into a similar category09:38
fwereadejam, the original intent was that we hook up juju resolved09:39
jamfwereade: so you could run "juju resolved" and it would try to provision again?09:39
fwereadejam, yeah, that's the idea09:39
dimitern__fwereade, hey, I see you didn't have time for this - can you take a look now please? https://codereview.appspot.com/13501051/09:40
fwereadedimitern__, I'm ...2 away from it in the list09:41
dimitern__fwereade, ok09:42
fwereadedimitern__, thanks for your patience09:42
dimitern__fwereade, no rush, just reminding :)09:45
thumperfwereade: coming?10:01
hazmatis there a tag for 1.14?10:06
jammgz: can you link me the document?10:43
jamthumper, fwereade: 1 min to meeting10:59
jammgz: fwereade, rogpeppe: https://codereview.appspot.com/13562045/ is the critical fix for Openstack security groups11:06
mgzjam: sorry, was paged up11:06
rogpeppejam: i don't think it would be too hard to add a live test that checked exposing11:11
rogpeppejam: but it would be slow to run11:11
rogpeppejam: unless we jammed it in the kitchen sink of BootstrapAndDeploy11:12
jamrogpeppe: we don't have any tests today that run a custom program on the remote machine, so I didn't have much to go off of. It would be possible, but I'd rather land the fix and have done manual testing.11:12
rogpeppejam: agreed, good to land the fix, but please file a bug11:12
jamrogpeppe: https://bugs.launchpad.net/juju-core/+bug/122758611:15
_mup_Bug #1227586: cross-provider test that we don't expose non-juju service ports <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1227586>11:15
rogpeppejam: thanks11:15
jamrogpeppe: note also that we have bug #1217595 which means that "juju upgrade" won't fix the security groups that exist, and "juju destroy-environment" doesn't delete security groups so "juju destroy-environment && juju bootstrap" will leave you vulnerable, but I'm thinking to fix #121759511:17
_mup_Bug #1217595: security groups reused without ensuring validity <canonical-webops> <juju-core:Triaged> <https://launchpad.net/bugs/1217595>11:17
_mup_Bug #1217595: security groups reused without ensuring validity <canonical-webops> <juju-core:Triaged> <https://launchpad.net/bugs/1217595>11:17
jambug #122758811:19
_mup_Bug #1227588: destroy-enviroment does not delete security groups <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1227588>11:19
rogpeppejam: i don't think that the old security groups pose a security hazard, on ec2 anyway11:24
rogpeppejam: just a resource problem11:24
rogpeppejam: because the ensures that if old security groups exist, they have the correct permissions11:24
rogpeppejam: s/because the/because the code/11:25
rogpeppejam: ah, i hadn't seen 121759511:25
rogpeppejam: do you know what provider that's using?11:26
jamrogpeppe: openstack at least11:26
rogpeppejam: i remember writing logic in the ec2 provider that specifically tried to cope with that case11:26
jamrogpeppe: note that I think we copied that behavior from ec211:26
jamit detects a duplicate, though I'm trying to see if it updates it11:27
jam"if err == nil { g = resp.SecurityGroup"11:27
rogpeppejam: see ec2.environ.ensureGroup11:27
jamI do see it doing a set stuff11:27
jamto find what to revoke11:28
rogpeppejam: it looks like the openstack provider doesn't do the right thing11:28
* rogpeppe gets some lunch11:29
mgzrogpeppe: that was changed in codereview.appspotcom/1165504311:31
mgzthe alternative is using the same fiddly stuff that ec2 does with security groups11:32
mgzreally the code should be unified regardless11:32
jammgz: I think we should move the permSet into a shared module and both use it11:36
jammgz: right, so I'm fine with doing a Get before we do Create to avoid the duplicate-with-quantum bug11:38
jambut we can still take the thing we have and do a set diff to figure out what to put on it11:38
* TheMue => AFK11:41
* thumper -> bed11:44
dimitern__fwereade, review poke :)11:49
rogpeppemgz: it doesn't look like the openstack provider ever revoked security group rules, even before that change11:50
rogpeppedimitern__: i'll do yours if you do mine: https://codereview.appspot.com/1377804311:50
dimitern__rogpeppe, looking11:51
dimitern__rogpeppe, reviewed11:59
rogpeppedimitern__: ta!11:59
dimitern__rogpeppe, fwereade: I have 2 CLs that need reviews please https://codereview.appspot.com/13501051/ and https://codereview.appspot.com/1362705112:14
rogpeppedimitern__: i'm already on the first one12:15
dimitern__rogpeppe, great12:15
jamdimitern__ how many underscores do you need ? :) Is it possible to share the Machine object somewhere, it sure feels repeated.12:20
dimitern__jam, not sure what do you mean?12:21
mgzabout the underscores or the Machine? :)12:22
dimitern__it's how we agreed to do the api12:23
jamfor underscores, there appear to be 3 of you12:23
dimitern__my irc client surely acts funny today12:24
mgzah, so that's his trick12:24
jamfor Machine, it looks like a tiny object with 2 bits of state and a callable that has a few apis on it. If it is actually different than the other ones thats fine12:24
dimitern__jam, they're all different12:24
dimitern__jam, and expose only a subset of the state.Machine methods, as needed by each worker12:25
yolandahi, using config_changed hook, what should be the best way if a config var has changed since the previous invocation? we receive the hook on each config, but i'd like to take some action if a given var has a different value. Maybe store old value in some place?12:26
dimitern__yolanda, you could save the old value at each config_changed call, and the use it in the next12:27
dimitern__yolanda, that will of course trigger a config_changed on the remote unit as well12:28
jamdimitern__: Id() Life() and Tag() sure seem common, but we can deal with that some other time, I guess12:28
dimitern__jam, we can yes12:28
yolandadimitern__, you mean, saving on a file? not sure if i follow you12:29
dimitern__yolanda, I mean doing relation-set oldValue=X, but you can use a file as well12:29
dimitern__yolanda, that way the remote config_changed hook won't be triggered12:30
yolandadimitern__, maybe a file is simpler, then i avoid double relation hook call12:30
dimitern__yolanda, yes12:31
yolandajust i was wondering if juju methods had something to retrieve previous val, may be useful12:31
rogpeppeyolanda: i sometimes wonder if we should provide a standard easy way to store persistent state across hook invocations12:32
rogpeppeyolanda: because everyone reinvents their own wheel there12:32
dimitern__yolanda, juju doesn't provide that at the moment12:32
yolandarogpeppe, dimitern__, sounds like an useful feature12:33
dimitern__rogpeppe, something like relation-save key=value12:33
rogpeppedimitern__: there's not really anything relation-oriented about it12:34
dimitern__rogpeppe, config settings are stored per relation12:34
dimitern__rogpeppe, so it makes sense to have a way to store them locally with a hook command, but the name could be anything, yeah12:35
rogpeppedimitern__: i'm not necessarily talking about config settings - just persistent state that one hook invocation can set to let another one see12:35
rogpeppedimitern__: tbh it's probably just a matter for better standard bash tooling - not something that juju-core needs to be involved in12:36
dimitern__rogpeppe, should these things be stored in state as well?12:36
rogpeppedimitern__: definitely not12:36
dimitern__rogpeppe, i agree12:36
rogpeppedimitern__: https://codereview.appspot.com/13501051/ reviewed12:48
dimitern__rogpeppe, thanks!12:48
jammgz:  did you get a chance to look at: https://codereview.appspot.com/13562045/ ?12:50
jamor rogpeppe. You made some comments on IRC, but didn't comment on the CL from what I can see12:51
rogpeppejam: oh, sorry, i got distracted.12:51
jamrogpeppe: I'm looking at dimitern's second CL12:52
rogpeppejam: cool, thanks - i was some way through it, but happy for you to do it12:53
jamrogpeppe: well certainly submit what you've gotten through12:53
rogpeppejam: i had no comments yet12:53
mgzjam: looked at, not gone through all the test stuff yet12:54
mgzwill do that now12:54
rogpeppejam: reviewed13:00
jamdimitern: https://codereview.appspot.com/13627051/ reviewed13:00
jamnatefinch: you should be doing some sort of "ssh shared@maas.mallards"13:08
jameg Username == shared13:09
natefinchjam: oh.. duh13:09
natefinchjam: I guess I expected the config "user" setting to do that for me, but then failed to realize it obviously wasn't13:10
natefinchjam: using shared@  works perfectly13:10
jamnatefinch: it should13:10
jamwere you accidentally doing nate@ ?13:10
natefinchjam: nope13:10
natefinchjam: maybe  it just wasn't picking up the config13:11
jamnatefinch: did you put it into config.personal?13:11
jamI don't *think* that file is read by default, (It has to be imported somehow)13:11
natefinchjam: yep13:11
natefinchI reran sshebang afterward...13:12
jamnatefinch: I think it is ok to use garage mass without calendar as long as you aren't trying to allocate all 16 machines, and cleanup after yourself13:12
natefinchactually I see User nate being specified for *.mallards in config.personal above there.... depending on which one wins13:12
jamnatefinch: your test cases are just provisioning 1-2 machines so it should be reasonably well behaved.13:12
jamnatefinch: I *think* first-entry wins13:13
natefinchthat would do it.  easy enough to try13:13
natefinchjam:  yep, first one in wins13:15
natefinchwriting wiki docs makes me happy13:44
dimitern__rogpeppe, fwereade, updated https://codereview.appspot.com/13501051/14:02
fwereadeTheMue, I can'tfind where your auto-sync-tools code is, did something happen to it?14:05
TheMuefwereade: have to look myself14:06
TheMuefwereade: should be this one https://code.launchpad.net/~themue/juju-core/035-bootstrap-autosync merged on Aug, 2nd14:08
TheMuefwereade: and found it in trunk14:12
fwereadeTheMue, yep, just did likewise, thanks14:13
TheMuefwereade: yw14:13
fwereadeTheMue, was looking right past it, sorry14:13
TheMuefwereade: np, as long as my answer is positive (and i haven't missid to merge it *phew*)14:13
rick_h_niemeyer: ping, any luck with more details on the issue?14:51
niemeyerrick_h_: Hey14:52
niemeyerrick_h_: Not really, unfortunately14:52
niemeyerrick_h_: Now that I'm consciously trying to replicate it I can't either14:52
gary_posterthanks rick_h_ .  yeah niemeyer, we want to stomp this but can't dupe :-(14:52
hatchyes very frustrating14:52
rick_h_niemeyer: ok, we've had 4 people try to replicate without success so far. If we can find something let me know and we'll jump right on it. Where were you linked from when it died?14:52
niemeyerrick_h_: I've accessed it directly14:53
niemeyerrick_h_: It actually stopped right on entrance the first time14:53
rick_h_niemeyer: right, your second email said you were linked there?14:53
niemeyerrick_h_: I was trying to guess the URL of a charm14:53
niemeyerrick_h_: So both times were hand-written14:53
niemeyerrick_h_: Both times CTRL-R solved the issue14:54
rick_h_niemeyer: ok, hmm. So maybe some race in a deeper url. Ok, well that gives more info to go on trying to replicate14:54
hatchniemeyer: on entrance - do you mean, 'loading juju-gui' ?14:54
niemeyerhatch: No, just typing jujucharms.com14:54
gary_poster:-/14:55
niemeyerrick_h_: I wouldn't be surprised if it's something timing out14:55
hatchniemeyer: sorry - I mean, there are two loading messages, one is for the assets and one is for the actual juju connection14:55
niemeyerhatch: Hmm, ok?14:55
hatchsounds like you're getting hung up on the connection14:56
niemeyerhatch: I'm not using any juju environments14:56
niemeyerhatch: Well, that I know of14:57
hatchyeah it still connects on sandbox14:57
gary_poster(to an in-browser-memory fake juju)14:57
niemeyerI see, ok14:57
hatchyeah that :D14:57
niemeyerSo, a timeout might explain why it failed on the first try, when all the caches on my path were cold14:58
hatchyeah odly enough that should never happen14:58
hatchI have some ideas to track this down though14:59
gary_posterright, we need console messages14:59
niemeyerOkay, I don't have them now, but if it happens again I'll try them14:59
gary_posterthank you very much niemeyer.  ok hatch, cool, glad you have some ideas.  I was going to suggest that we reply to Gustavo's message with a request for anyone who encounters this issue to please get in touch with us *before* reloading.15:00
gary_posterI'll send that out quickly15:00
niemeyergary_poster: Sorry about that.. it was kind of stupid.. I should know to have observed  the console for any hnts15:01
gary_posternp thanks for raising it niemeyer.  at least we know there's a likely issue somewhere15:01
hatchdamn schrodinbugs15:05
rogpeppefwereade: hmm, i just noticed that checkers.Set was renamed to testing.PatchValue. i'm not that keen, as the reason for it being in jc was because it has minimal dependencies so that it can be used from internal tests without fear of import loops.15:06
rogpeppefwereade: i thought it's worth discussing before i propose a move back though.15:09
mrammis the lean kit board reasonably up to date for me to look through it for things that have already landed but are not yet in a release?15:10
mrammfwereade: rogpeppe: dimitern__: TheMue: ^^^^15:11
rogpeppemramm: i did put a Doing card on earlier, but tbh I haven't looked at it much since we stopped doing daily kanban runthroughs15:11
mrammso how are we managing work now?15:11
rogpeppemramm: that's bad, i know, sorry15:11
mrammtickets, lkk, whatever -- something needs to be there15:12
rogpeppemramm: yeah. i thought that kanban board discussion gave a good focus actually.15:12
mrammwell, that is for you guys to sort out15:13
mrammfor now I guess I'll try to just look through the commits that have been merged to trunk and go from there...15:13
dimitern__mramm, mine is always up-to-date15:15
* rogpeppe polishes dimitern__'s halo :-)15:15
dimitern__:P15:16
rogpeppedimitern__, natefinch, TheMue: do you have any opinions about jc.Set vs testing.PatchValue ?15:16
rogpeppedimitern__, natefinch, TheMue: (the latter being a new name for the former)15:17
fwereaderogpeppe, I confess a mild preference for testing.PatchValue15:17
rogpeppefwereade: i'd like it not to be in testing15:18
rogpeppefwereade: because of the dependency issue15:18
rogpeppefwereade: and how about just Patch ?15:18
fwereaderogpeppe, jc.Patch definitely > jc.Set15:19
fwereaderogpeppe, I'd +1 that15:19
rogpeppefwereade: cool15:20
natefinchyeah, I like patch15:21
natefinchPatch implies temporary, set implies permanent15:22
* TheMue votes for Patch too15:23
dimitern__+1 for Patch15:24
marcoceppiHow is this possible? http://i.imgur.com/7x5eYib.png15:28
mgzdoes TestManageStateServesAPI failin on the bot mean anything to anyone?15:28
marcoceppiRan debug-hooks during an install error hook, ran resolved --retry, trapped both hooks?15:28
marcoceppi1.14.0, should this be a bug or is this expected, or what?15:28
mgzhm, bug 121966115:30
_mup_Bug #1219661: TestManageStateServesAPI is flakey <test-failure> <juju-core:Fix Committed> <https://launchpad.net/bugs/1219661>15:30
mgzlanded on trunk only15:31
bachi, go question:  for my juju-core branch, bzr shows i'm out of date by many revisions.  but 'go get -v launchpad.net/jujuj-core/...' does nothing.  what gives?15:36
rogpeppefwereade: one thought on <environmentname>.yaml vs bare <environmentname>, how about a ".juju" extension? that way the files are readily identifiable when sent around the network, and could even be potentially double-clicked to open15:36
bacgah, nm s/v/u/15:38
mgzrogpeppe: can I have a rubber stamp on cl 13722051 please?15:44
rogpeppemgz: stamped15:45
mgzta15:45
rogpeppefwereade: ping15:55
fwereaderogpeppe, pong15:56
fwereaderogpeppe, ah, sorry, missed the above15:57
rogpeppefwereade: just wondering how you feel about the above possibility15:57
fwereaderogpeppe, it's somewhat interesting15:57
rogpeppefwereade: using an extension means that we can be sure that temp files don't clash too15:57
rogpeppefwereade: (we don't currently have any restriction on environment names)15:57
fwereaderogpeppe, yeah, that's not a bad idea... but, hmm, .juju doesn't feel quite right15:58
fwereaderogpeppe, if anything, .env or something15:58
rogpeppefwereade: .jujuenv15:58
fwereaderogpeppe, not totally in love15:58
rogpeppefwereade: neither me15:58
fwereaderogpeppe, anyway, sorry, I have a call starting15:58
rogpeppefwereade: can i leave .yaml for the time being, and we can bikeshed it when we actually hook up the Write code?15:59
fwereaderogpeppe, ok, sgtm15:59
mgzarosales, sinzui: landed the required fix on 1.14 branch16:16
sinzuimgz thank you16:16
arosalesmgz, thanks. Do you have authority to get sinzui access to the go-bot creds?16:16
arosalesneeded to make a release16:16
sinzui^ you are a faster typer than I am16:17
mgzI can't add his key to the launchpad account, I can stick a tag on for him today though16:17
sinzuimgz, that helps.16:17
sinzuimgz, we also need a 1.14.1 tag on goose at the same rev as 1.14.016:18
TheMuefwereade: ping16:18
sinzuimgz, I want to try using dependencies.tsv for the 15+ releases. No more tags16:18
fwereadeTheMue, listening, but in a meeting16:18
mgzthat would be a good thing16:19
TheMuefwereade: you hade a good nose16:19
TheMuefwereade: see http://paste.ubuntu.com/6128903/16:19
mgzsinzui: changing the tarball script is easy, the harder half is making the bot do the same, so things actually break if people forget to bump a dep16:19
fwereadeTheMue, nice16:19
TheMuefwereade: have to see now where exactly it crashes, but it dislikes those statements in the data16:20
TheMuefwereade: i think it's the $where16:20
sinzuimgz. yeah, I thought as much. I intended to try a ci approach where the tarball is used as a source for the tests. Release candidates fail if the tarball doesn't build16:20
mgzugh, 1.14 is impressively diverged from trunk16:21
mgzsinzui: I poked tarmac a little to try that approach, but it doesn't fit in well with the current use of the bzr plugin16:21
mgzjust need some time to re-look at the bot setup really16:21
mgzand understand how tarmac wants to work a little16:22
sinzuimgz. Understood. We are building a plugin/subordinate charm for the jenkins charms that acts as a tarmac gatekeeper and test runner.16:23
sinzuiWe have nothing against tarmac, but it was just one piece that was failing in our setup of charmworld testing16:24
TheMuefwereade: halve so wild, it only has been the . in the map key. mongo dislikes dots there. eval or db.eval as value are not executed16:41
rogpeppedimitern__, fwereade, mgz, TheMue: a small change:  https://codereview.appspot.com/1378604316:44
dimitern__rogpeppe, looking16:46
rogpeppedimitern__: thanks16:46
TheMuerogpeppe: reviewd16:47
rogpeppeTheMue: ta!16:47
dimitern__rogpeppe, me too16:49
rogpeppedimitern__: ta to you too!16:49
mgzrogpeppe, fwereade: stamp on cherrypick sg fix to trunk cl  13787043 please!16:59
rogpeppemgz: done17:01
rogpeppenatefinch, dimitern__, fwereade, mgz, TheMue: another small one: https://codereview.appspot.com/1334105117:13
=== tasdomas is now known as tasdomas_afk
mgzrogpeppe: I'll run the live tests on that branch17:20
rogpeppemgz: thanks17:20
rogpeppemgz: i don't think the live tests verify the expose semantics currently, so probably worth doing a sanity check there too, if poss17:21
* lamont has what may be a stupid question...17:24
lamontTo connect to ... insecurely, use `nocheckcertificate'.17:24
lamontwhere do I say 'nocheckcertificate' for juju (-core) bootstrap to see and use it?17:24
mgzlamont: juju-core doesn't use ssh to connect, you may want bug 120216317:28
_mup_Bug #1202163: openstack provider should have config option to ignore invalid certs <cts> <papercut> <Go OpenStack Exchange:Confirmed> <juju-core:Triaged by jameinel> <https://launchpad.net/bugs/1202163>17:28
TheMuerogpeppe: reviewed, like it17:28
rogpeppeTheMue: thanks17:29
natefinchrogpeppe: is there a NewApiClient that is not from a name? Wondering why you need to say "fromName" when it clearly takes the name as an argument?17:33
TheMueso, will step out now. see you on monday (tomorrow holiday)17:33
rogpeppenatefinch: i didn't invent the name and i try to avoid repainting sheds17:33
rogpeppenatefinch: i agree in principle though17:34
rogpeppeTheMue: see ya17:34
natefinchnatefinch: oh, sorry, I should have scrolled down, missed that it was there before17:34
TheMuehave a good night17:34
lamontmgz: it's trying to talk to swift, using https because I don't like cleartext tokens and all that17:46
lamontbut the CA cert for the signing cert is not in the ca-certs package17:46
lamontand I'm too cheap to go buy a cert for this particular venture17:46
lamont+ tar xz C /var/lib/juju/tools/1.12.0preciseamd6417:47
lamont+ wget noverbose O  https://swift....17:47
lamontso what I actually need to know is how to tell whatever is calling wget to say wget --nocheckcertificate ...17:47
lamontwhich may just mean hacking over the tarball17:47
lamontexcept it's fetching the tarball that is failing.17:50
rogpeppeg'night all18:17
natefinchg'night18:18
natefinchmgz: is there a way to do a build such that I can copy the juju client and the tools to another computer for testing purposes?18:19
natefinchmgz: I finally have a maas setup, but I can't really get juju to connect to it from my local machine18:20
natefinchmaybe that's fixable with some ssh magic, I don't know18:20
jpds_lamont: That related to https://bugs.launchpad.net/juju-core/+bug/1202163 ?18:20
_mup_Bug #1202163: openstack provider should have config option to ignore invalid certs <cts> <papercut> <Go OpenStack Exchange:Confirmed> <juju-core:Triaged by jameinel> <https://launchpad.net/bugs/1202163>18:20
lamontjpds_: probably18:20
* natefinch is not good with teh ssh18:20
mgznatefinch: you can give sync-tools a directory with stuff in as a param18:21
lamontand I think I got my mess figured out enough to have ways forward18:21
natefinchnatefinch: I recognize that sentence as valid english, but I don't know how to execute on it :)18:22
natefinchmgz: err ^^18:22
=== tasdomas_afk is now known as tasdomas
=== tasdomas is now known as tasdomas_afk
rogpeppenatefinch: fancy a review? https://codereview.appspot.com/1348904420:23
rogpeppefwereade: ^20:23
rogpeppeor anyone else that happens to be around20:23
rogpeppenatefinch: fairly simple stuff20:24
natefinchrogpeppe: sure20:28
rogpeppenatefinch: thanks20:28
natefinchrogpeppe: sorry, got a phone call in the middle, and now don't have time to finish, but I can finish in the morning if it still needs it. Sorry :/21:09
rogpeppenatefinch: ok, fair enough21:09
rogpeppenatefinch: if you could publish any comments you already have, that would be great21:09
natefinchrogpeppe: good point.. I don't have much, it was a long phone call21:10
natefinchgotta run21:10
rogpeppenatefinch: g'night21:11
natefinchrogpeppe: actually, got a reprieve from dinner duties, so I can finish the review21:24
thumpermorning21:44
natefinchthumper: morning.  How's your team in the Cup doing?  Scoring lots of goalies?21:46
* natefinch doesn't understand sailing.21:46
thumpernatefinch: oracle won the first race, and the second was called off due to wind limits hit21:47
thumpernext race is tomorrow morning (afternoon SFO time)21:47
thumpernz needs one more to win21:47
thumperoracle needs 721:47
natefinchthumper: wow21:47
natefinchthumper: ok then21:47
thumperoracle has fixed their boat now and has a slight speed advantage21:47
thumperso it makes it interesting21:48
natefinchhey, interesting is better than boring21:48
natefinchfriend of mine follows the Cup and was complaining for days about all the races getting cancelled21:49
rogpeppethumper: a review for you if you wanna: https://codereview.appspot.com/1348904421:51
natefinchrogpeppe: I just finished that one up btw21:52
bigjoolshowdoo21:53
thumpero/ bigjools21:56
natefinchwhelp, I'm outta here21:57
bigjoolshttps://bugs.launchpad.net/juju-core/+bug/122772221:57
natefinchnight all21:57
bigjoolsfun21:57
_mup_Bug #1227722: juju uses tools for the wrong architecture when bootstrapping a MAAS node <maas> <juju-core:New> <https://launchpad.net/bugs/1227722>21:57
thumperbigjools: I blame wallyworld22:00
rogpeppethumper: thanks22:00
thumperI don't know if it is his fault or not22:00
thumperbut22:00
* thumper shrugs22:00
thumperrogpeppe: np22:00
bigjoolsblame schmame.22:00
bigjoolsit's far too early in the morning for blamestorming22:01
wallyworldnever too early22:01
bigjoolsnever too early to blame wallyworld? I could get behind that :)22:01
wallyworldyep22:02
bigjoolswallyworld: plus I am happy because I am off on our road trip tomorrow22:05
wallyworldoh yah22:05
wallyworldwill be great22:05
bigjoolsbrimmed the fuel tank - $200...eek22:05
wallyworldi still have another week :-(22:06
wallyworldpetrol is expensive here22:06
bigjoolscheaper than Europe22:06
bigjoolsshould come down a bit, the A$ made ground against US$ lately22:07
wallyworldyep :-)22:07
wallyworldfwereade: you still around?22:07
fwereadewallyworld, heyhey, yeah, I wanted to chat about your CL, because the last thing I want to do is block you22:08
wallyworldfwereade: ok, quick hangout?22:08
fwereadewallyworld, sure22:08
wallyworldhttps://plus.google.com/hangouts/_/d3f48db1cccf0d24b0573a02f3a46f709af109a622:08
fwereadewallyworld, you sure that's the link?22:09
wallyworldit worked for me22:09
wallyworldi'll try another22:09
fwereadewallyworld, https://plus.google.com/hangouts/_/67b33e32c2942787f0aa5076ba1f070cd1203c4c22:10
thumperfwereade: any reason you aren't landing https://code.launchpad.net/~fwereade/juju-core/prepare-leave-scope/+merge/181065 ?22:26
thumperironically a test for synchronization fails22:41
thumperhmm...23:05
* thumper is looking at an intermittent test failure23:05
* thumper tries something...23:13
* thumper proposes23:29
thumperwallyworld: I'd like axw to review the branch I'm just proposing23:34
thumperbut you could take a look too if you like23:34
wallyworldok23:35
thumperit fixes a race condition in a test23:35
thumperand also writes the test in a more broken up way23:35
thumperso three tests, not one test that tests three things23:35
wallyworld\o/23:36
thumperhttps://codereview.appspot.com/13799043 if you are interested23:36
wallyworldlooking23:36
wallyworldthumper: this is for the 1.15 release if you have a moment https://codereview.appspot.com/1376304423:36
thumpersure23:37
thumperwallyworld: I have the gym shortly, but we should catch up after that to talk about logging23:38
wallyworldsounds good23:38
wallyworldi have one more branch to write for the release23:38
wallyworldthen testing23:38
wallyworldthen tools cleanup23:38
wallyworldthen release notes23:38
wallyworldthumper: those revised tests look nice to me23:42
thumperthanks23:42
wallyworldsmaller tests are good23:42
thumperlooking over yours now, but not sure I'll get it finished before gym time :)23:42
thumperagreed23:42
wallyworldnp23:42
wallyworldi'm cleaning up the mps william looked at, and landing those now23:43

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!