[00:02] rick_h_: it's *always* mongodb [00:03] I'm hitting an error that I can't track down. Here is my wip: https://codereview.appspot.com/76670043 [00:03] error: launchpad.net/juju-core/testing/testbase.PatchEnvPathPrepend(0): not defined [00:09] wallyworld: launchpad.net/juju-core/testing/testbase.PatchEnvPathPrepend(0) [00:09] ^ still importing the lp version [00:28] https://bugs.launchpad.net/juju-core/+bug/1293269 [00:28] <_mup_> Bug #1293269: juju fails to destroy environment due to missing configuration key [00:29] great, now destroy environment doesn't work [00:32] o/ davecheney [00:32] I have a branch for the local provider lxc settings [00:32] davecheney: ah, I know what you did there [00:32] thumper: thanks [00:32] davecheney: that was all me... [00:33] they used to be omit, then I changed the default to "", and now they are omit again [00:33] pretty sure they were only omit for releases [00:33] :( [00:33] dev envs are likely screwed [00:34] here is my environment.yaml [00:34] local: [00:34] type: local [00:34] < yeah... [00:34] you will need to do the manual thing [00:35] although, I have a bug on my plate to fix destroy environment [00:35] however due to the early dying [00:35] won't help this case [00:37] fudge [00:37] thumper: has this screwed 1.17.4 -> 1.17.5 upgrades ? [00:38] davecheney: no, those are fine [00:38] the setting was changed and changed back in beteween releases [00:39] right [00:39] cool [00:39] sorta [00:40] yeah... [00:40] kinda [00:40] * davecheney remains alarmed, but not alert [00:41] rick_h_, davecheney thanks :) I'm on the packaged Mongo for Ubuntu 14.04 -- tried building 2.4.9 from source but I got tons of build errors for some reason. bleh [00:42] bodie_: that is the worst of all choices [00:42] sudo apt-get install juju-mongodb [00:42] oy [00:42] ok [00:42] much appreciated [00:42] this should have already happened for you [00:42] this package is a dep of juju-local [00:42] is this a documentation bug ? [00:44] Maybe it didn't go in because I already had Mongo [00:44] but, I don't think Go would fetch a package, would it? Just source, I thought [00:45] I'm still just getting my head wrapped around the whole thing, I think I may have been told the packaged Mongo was suitable [00:45] not suitable [00:45] manditory :) [00:45] this smells like a bug [00:46] juju should detect that you had /usr/bin/mongdb [00:46] where we rerequire [00:46] /usr/lib/juju/bin/mongodb [sic] [00:46] if you uninstall mongo [00:46] hm [00:46] and run a juju command it *should* give you reliable advice [00:47] thumper: well fuck, how do I delete that environment then ? [00:47] just table flip it ? [00:47] yeah... [00:47] lxc-destroy all the machines [00:47] stop the services [00:47] and delete the upstart entries [00:47] delete the rsyslog entry [00:47] right-o [00:47] and delete everything from /var/lib/juju/containers [00:50] I think I have some kinda conflict with a mongo already sitting on my system, but I just now removed everything mongo using apt... maybe the one I'd built from source [00:50] yeah [00:51] okay, removed that and now it's suggesting I install mongodb-server [00:51] but you're saying I need to use juju-mongodb [00:51] bodie_: this is absolteyly a bug [00:54] yay, I accomplished something [00:54] davecheney: you recently updated the ec2 provider to add ppc and arm arches to tools lookup constraints, right? [00:56] wallyworld: only ppc [00:56] someone else is tpo blame for arm [00:56] arm64 [00:56] davecheney: because we have a list of hard coded aws instances types (m1.small, etc) which are recorded as supporting i386 and amd64 only [00:56] wallyworld: i know [00:57] hence image matching will fai; [00:57] fail [00:57] this was raised in review and I believe I removed those lines were removed [00:57] which lines? [00:57] the tools lookup arches? [00:57] the ones in the ec2 and azure provider from memory [00:58] so [00:58] return &simplestreams.MetadataLookupParams{ [00:58] Series: e.ecfg().DefaultSeries(), [00:58] Region: region, [00:58] Endpoint: ec2Region.EC2Endpoint, [00:58] Architectures: []string{"amd64", "i386", "arm", "arm64", "ppc64"}, [00:58] }, ni [00:58] guess I didn't get all of them [00:58] the Architectures above should just be i386, amd64 right? [00:58] not sure about arm [00:58] no problem [00:58] i'd say no [00:58] but I think arm via stgrabers' qemu ami is possible [00:59] being realistic, just 386 and amd64 [00:59] ok. so long as we are consistent across the board [00:59] that's what i'm aiming for [00:59] then we can add in the extra arhes [00:59] arches [01:00] i just got a little confused when reading the code [01:00] do I need to submit a bug report or can I simply lbox propose my fix? [01:00] bodie_: if you can fix it yourself, go for it [01:03] so it HAS to be juju-mongodb? I thought it just had to be a version with SSL support [01:03] bodie_: they are one in the same [01:03] especially if you are on precise [01:04] hmm [01:04] not in my case I guess since I'm using trusty tahr [01:04] it installed 2.7.0-pre [01:05] bodie_: oh bodie_ the problem is so many turtles deeper [01:05] I like turtles... but not this many turtles [01:06] was really confusing trying to make my tests pass -- I knew it had something to do with the Mongo version but beyond that it gets really murky [01:06] and then having to wrangle build issues on top of that was making me insane [01:07] I think GCC 4.8.2 treats a certain thing as a warning that isn't supposed to be treated as a warning [01:07] do you know if the Vagrant box is suitable for dev? [01:07] bodie_: is the README in the project incorrect ? [01:10] ah, the make install-dependencies bit? I hadn't tried that, I think I stopped reading when I saw the directions for installing the binaries and assumed the README was about that [01:11] the juju build was failing due to an incompatibility with the latest gwacl, but someone told me about the "known working revisions" doc [01:21] anyway, thanks for the assist :) [01:26] the "PatchEnvPathPrepend(0): not defined" error I was hitting was resolved by rebuilding the pkg dir [01:27] which means the branch is now ready for review: https://codereview.appspot.com/76670043 [02:22] thumper: good news [02:22] davecheney: yes? [02:22] building static tools means we don' tneed install moew pkgs into the environment [02:30] axw: how far away is this? [02:30] // TODO(axw) 2014-02-11 #pending-review [02:30] // Embed state.Prechecker, and introduce an EnvironBase [02:30] // that embeds a no-op prechecker implementation. [02:30] wallyworld__: oops, that was reviewed and should've had an issue added... [02:31] but the EnvironBase thing may not happen, as the implementation ended up changing [02:31] wallyworld__: why? [02:31] axw: i want to introduce some more common, shared functionality across all providers [02:31] in this case SupportedArchitectures() [02:32] wallyworld__: okay. I have no immediate plan to add it, so feel free to do it [02:32] i'll just do a new interface i think [02:32] Go loves single method interfaces :-/ [02:34] just gotta think of a name, and no I don't want to use Archer cause there's no arrows to be seen anywhere [02:34] why do you need another interface? [02:35] adding it to Environ seems appropriate [02:35] guess so [02:36] i think though having an EnvironCapability interface would be good [02:36] we can add more methods to it as needed [02:36] eg is block storage supported [02:37] and easier to stub out for testing [02:38] sounds reasonable [02:45] wallyworld__: https://codereview.appspot.com/74660044 [02:46] thumper: https://codereview.appspot.com/76710043/ [02:46] :-) [02:46] np [02:50] wallyworld__: I have a parent teacher interview, but will review ASAP on return [02:50] ok, no hurry [02:50] have fun [02:51] wallyworld__: why not utils.arch ? [02:51] then arch.AMD64 [02:51] or something [02:51] thought about that, yeah can do that [02:51] I'll keep looking first [02:51] just didn't want to introduce such a small package [02:51] just wondering out loud at the first thing I saw [02:51] ok, let me keep looking first [02:52] sure, but i think you may have a valid poitn cause i almost did it that way [02:56] 2014-03-17 02:54:32 INFO juju.worker.uniter uniter.go:474 running "config-changed" hook [02:56] 2014-03-17 02:54:32 ERROR juju.worker.uniter uniter.go:480 hook failed: fork/exec /var/lib/juju/agents/unit-u0-0/charm/hooks/config-changed [02:56] just hit this with 1.17.5.1 [03:01] latest test output.... [03:01] http://paste.ubuntu.com/7105935/ [03:01] going to bed, will look over this in the morning. any input welcome [03:01] o/ [03:03] bodie_: sorry mate, still the wrong mongodb [03:04] or more speciically [03:04] the test suite tries to bring up a mongodb, but fails [03:04] most of those tests don't consider the case that mongo couldn't fail to start [03:04] and so panic during tear down [03:09] well fuck [03:09] i need to log a bug about charm-helpers-sh being missing [03:09] but i can't confirm if it works on precise because I've hit another bug [03:40] davecheney: is that hook failure one where the hook doesn't exist? [03:41] davecheney: the code paths should catch that, and I was horribly confused... [03:41] thumper: that is correct [03:41] it shouldn't happen [03:41] I don't understand how we get that error [03:42] axw: was looking into it [03:42] i think [03:42] we explicitly catch that error [03:42] and I see that explicit catch happening locally [03:42] and on ec2 [03:42] so I'm dumb struck [03:44] I was looking at what? [03:44] nope.. don't think so [03:46] oh yeah I remember this... [03:55] /insert jarring chord [03:57] morning thumper, I'm in the hangout whenever you're around [03:58] thumper: so can we now drop JUJU_TESTING_LXC_FORCE_SLOW? [03:59] wallyworld__: yes [03:59] jam: ok [04:00] thumper: wanna do that then as part of your work? [04:00] wallyworld__: yeah [04:00] ok, i'll re-review then [04:15] davecheney: so the uniter code normally works because exec.Command internally uses LookPath [04:15] LookPath is the one that returns an *exec.Error [04:15] is it not working with gccgo? [04:17] axw: this was one ec2 [04:17] with gc [04:17] huh [04:17] this is not a ppc64el specific issue [04:31] wallyworld__: https://codereview.appspot.com/74660044/ [04:31] ok [04:41] davecheney: you're on Go tip aren't you? (or > 1.2 at any rate) [04:41] davecheney: behaviour of os/exec.Command has changed in 1.3 [04:41] axw: is that a question or a statement ? [04:42] first is a question, second is a statement [04:42] then yes, and ok [04:42] the statement leads to my question, I'm backwards like that [04:42] ok [04:42] but others have hit this problem using released tools [04:42] mmk, nfi why it would fail otherwise === vladk|offline is now known as vladk === vladk is now known as vladk|away === Ursinha is now known as Ursinha-afk === Ursinha-afk is now known as Ursinha === vladk|away is now known as vladk === vladk is now known as vladk|away === vladk|away is now known as vladk === vladk is now known as vladk|away === vladk|away is now known as vladk === vladk is now known as vladk|away === vladk|away is now known as vladk === vladk is now known as vladk|away === vladk|away is now known as vladk [06:05] axw: LGTM on https://code.launchpad.net/~axwalk/juju-core/lp1293310-non-existent-hooks/+merge/211247 [06:06] jam: thanks === vladk is now known as vladk|offline [08:11] mornin' all [08:13] morning rogpeppe3 [08:13] axw: hiya [08:14] rogpeppe3: I made the changes to https://codereview.appspot.com/75990043/, but thought I'd wait until you had a glance in case you weren't happy about the new package === vladk|offline is now known as vladk [08:14] axw: looking [08:19] axw: tiny thing: i wonder if the test should use /bin/sh rather than /bin/bash, as i think that might be what cloud-init is using. [08:19] axw: (i may be wrong there though) [08:20] rogpeppe3: the synchronous bootstrap bit is always bash [08:21] axw: ok, and the DumpFileOnError code is only ever run in that context? [08:21] rogpeppe3: and add-machine ssh, but that's also bash [08:22] axw: LGTM === vladk is now known as vladk|offline [08:22] thanks === vladk|offline is now known as vladk [08:39] * jam => luncdh [08:56] wallyworld_, are you around? [09:02] morning dimitern [09:02] jam, morning [09:02] dimitern: I missed you earlier [09:02] rogpeppe3: 1:1? [09:03] jam: ah yes! [09:03] jam, i'm sorry i trusted my nexus ubuntu touch to sound the alarm but it didn't and i read later that it's not implemented yet [09:27] dimitern: hi [09:27] dimitern: hi [09:36] hey vladk [09:36] wallyworld_, I have a question about upgrades [09:36] sur [09:36] e [09:36] wallyworld_, we need to create some dirs with root permissions [09:36] ok. where? [09:36] wallyworld_, specifically, when upgrading rsyslog config and logdir [09:37] wallyworld_, what's the best way to do that? i've seen provider/local calling exec.Command("sudo", "/bin/bash", "-s") and attaching stdout and stderr [09:38] dimitern: the machine agent runs as root, right? [09:38] wallyworld_, or maybe generate a script and pass it on stdin (i.e. mkdir -p ) [09:38] wallyworld_, so you're saying we should be able to create /var/log/juju- in an upgrade step? [09:38] i think so [09:38] ok, i'll try that [09:39] it's just an educated guess [09:39] but would be the simplest i think [09:39] cause an upgrade step is easy enough to write, and is only executed the once when needed to get to 1.18 [09:40] wallyworld_, yeah, i was testing my fix for bug 1291400 and found out some errors due to the logdir in var/log not getting created and hence rsyslog cannot create its certs there [09:40] <_mup_> Bug #1291400: migrate 1.16 agent config to 1.18 properly (DataDir, Jobs, LogDir) [09:42] dimitern: good luck, let me know if it works. my only question is if the owner of the dir would be root but i think so since machine agent runs as root [09:42] wallyworld_, it has to be a specific user/group i think, i'll check [09:43] maybe, not sure ottomh [09:43] * dimitern really hates how we don't chown local provider logs to the user so I don't have to do sudo less ... [09:43] even so, the process will have the priviliges to do it [09:43] dimitern: i agree. file a bug :-) [09:44] will do :) [09:44] hola [09:48] hi all [09:48] voidspace: ping [09:48] hey rogpeppe3 [09:49] wwitzel3: yo! [09:49] rogpeppe3: you have a good weekend? [09:49] wwitzel3: an excellent weekend, thanks [09:49] wwitzel3: we actually had some sun yesterday, and even better, managed to go out and take advantage of it [09:50] wwitzel3: you? [09:50] rogpeppe3: that's great :) [09:51] rogpeppe3: yeah, it was good, nothing exciting, but nice and relazing [09:51] relaxing [09:53] rogpeppe3, morning [09:53] voidspace: hiya [09:53] rogpeppe3, hi :-) [09:53] rogpeppe3, sorry about Friday [09:54] voidspace: how's your configuration working now? [09:54] rogpeppe3, well, mostly good [09:54] rogpeppe3, :-) [09:54] rogpeppe3, I can't get the USB monitor working with Ubuntu and I think I'm stuck on a maximum of three monitors [09:54] rogpeppe3, but other than that, good [09:55] rogpeppe3, I still need to move the drives to the new machine [09:55] voidspace: only three monitors, how can you survive? :-) [09:55] heh [09:55] it is hard [09:55] anyway [09:55] rogpeppe3, shall I pair with you today? [09:55] voidspace: i was just about to suggest that, yes [09:55] great [09:56] voidspace: whenever you're ready [09:56] rogpeppe3, I'm pretty much ready [09:56] rogpeppe3, hangout for audio? === rogpeppe3 is now known as rogpeppe [09:57] voidspace: let's start with that [09:58] * rogpeppe tries to work out how to create a hangout [09:58] rogpeppe: shall we use the juju-core one, or start our own? [09:59] voidspace: let's just use the juju-core one [09:59] voidspace: https://plus.google.com/hangouts/_/canonical.com/juju-core [10:08] jam: are you around? [10:09] mgz: I am, I just need to do a quick "get some coffee/tea" run, and then I'll be happy to chat [10:09] mumble or G+ ? [10:09] sure thing [10:09] lets try mumble [10:16] mgz: no love.... [10:16] I'll try again [10:17] mgz: so I'm guessing this is Dubai's anti-VOIP software going into effect. [10:17] we'll have to make a new hangout [10:17] cunning [10:17] At least, it is what it sounds like when I try to use Skype-out [10:17] mgz: there is a hangout associated with our 1:1 calendar event [10:17] can you get to that? [10:17] is the canonical mumble server not over ssl? [10:18] lets see [10:19] mgz: have you got the link to the instructions for reconfiguring the gobot, please? [10:20] rogpeppe: https://lists.ubuntu.com/archives/juju-dev/2014-March/002182.html [10:21] jam: thanks! [10:21] rogpeppe: he's in G+ with me, and its easier to paste via me, then copy it to IRC :) [10:27] mgz: is there a reason that the verify_command in the tarmac configuration doesn't do a godeps -u ? [10:28] because it would also need go get -u [10:28] rogpeppe: because half the time that would just break because you have to fetch first? [10:28] and go get -u can overwrite the current branch that we are trying to test? [10:28] jam: in that case, it *should* break, i think [10:29] jam: otherwise we're testing with the wrong deps [10:30] jam: currently i'm trying to help michael get his Instances aggregration branch in, and there's no easy way to do it [11:06] rogpeppe, https://pastebin.canonical.com/106567/ [11:06] voidspace: yeah, just fixed it, i think [11:08] rogpeppe, cool, thanks [11:08] rogpeppe, nope :-) [11:08] voidspace: indeed [11:10] now the hook borked [11:16] rogpeppe, I'm grabbing coffee [11:16] voidspace: k [11:32] hi everyone === vladk is now known as vladk|away [11:40] fwereade: just encountered an interesting error with juju resolved [11:41] * fwereade peers nervously at rogpeppe [11:41] hi again perrito666 :) [11:41] fwereade: it's not too bad actually [11:42] fwereade: i did "juju resolved", and the hook was still in error state [11:42] fwereade: i did it again, and it said "ERROR cannot set resolved mode for unit "tarmac/0": already resolved" [11:43] fwereade: but that was because a hook was still running [11:44] fwereade: i wonder if the uniter should set the unit status out of error state the moment it starts to try rerunning the hook [11:45] rogpeppe, it *was* designed that way but I'm trying to remember why [11:45] fwereade: BTW the first time i did "juju resolved --retry" [11:46] fwereade: it certainly felt a bit weird when it happen: "why can't i resolve this hook that's in error state?") [11:46] rogpeppe, IIRC the idea is that we make sure we actually try to handle the resolved before we mark it ready to try again [11:46] happened [11:46] fwereade: i think that's the bit that's not so intuitive [11:46] fwereade, I've been exchanging emails with Erik Naslund :-) [11:47] rogpeppe, the failure mode of setting resolved early is that we could not actually respond, but claim we did [11:47] fwereade: because the user has no visibility into when hooks are actually running [11:47] rogpeppe, I *think* that's worse [11:47] voidspace, ah cool -- how's he doing? [11:47] voidspace, say hi :) [11:48] fwereade, I will do [11:48] fwereade, he is using mock at his startup and sent an email saying thanks [11:48] voidspace, excellent, I'm pretty sure I introduced him to it :) [12:04] ng [12:05] natefinch: ping [12:07] wwitzel3: howdy [12:08] natefinch: quick hangout? [12:08] sure [12:10] x [12:13] is there a standard for which version of ubuntu this should work best on? davecheney says I'm still using the wrongodb, but this is definitely the one make install-dependencies set me up with [12:14] bodie_: most testing is done on Precise, we tried to enable Trusty correctly, but then ended up regressing support elsewhere, so we have a patch in progress to restore proper support for Trusty's local provider [12:15] makes sense [12:15] is there anything I can do to help there? [12:15] maybe I'll try the Vagrant setup in the meantime [12:16] fwereade: heya. did you want to review https://codereview.appspot.com/70190050/ before Jesse lands it? [12:16] it's a big 'un [12:17] looks (nearly) good to me, but just checking if I should provision a LGTM on your review [12:19] rogpeppe: yeah, I found that (resolved not changing error state immediately) a bit unintuitive too. some sort of feedback would be nice [12:25] axw, if I haven't looked at it by eod I think we can go ahead,it [12:25] just downloaded the 639MB vagrant image in almost exactly a minute... love this fios [12:25] fwereade: okey dokey [12:25] 's had several rounds and you were making smart comments last time I saw [12:26] axw, you can represent me :) [12:26] I'll do my best [12:26] axw, btw I have been trying to assimilate all the awesome azure changes, couple of quick questions [12:27] axw, 1 (possibly trivially working, probably deserves minor reflection) subordinates in fancy-azure mode [12:27] axw, I suspect they will all work fine, but if you haven't considered them explicitly please do some thinking [12:28] I haven't, and I think they'll work fine, but yes I will have a think about it [12:28] axw, 2 (maybe more of a sticking point) can we change the startinstance params so that it's expressed in terms of instances to avoid, rather than leaking the concept of "principals" into environs? [12:29] axw, I haven't figured out whether that screws everything up wrt AddMachine though [12:29] axw, I suspect they will all work fine, but if you haven't considered them explicitly please do some thinking [12:29] I haven't, and I think they'll work fine, but yes I will have a think about it [12:30] sorry, net cut out [12:30] axw, 2 (maybe more of a sticking point) can we change the startinstance params so that it's expressed in terms of instances to avoid, rather than leaking the concept of "principals" into environs? [12:30] axw, I haven't figured out whether that screws everything up wrt AddMachine though [12:31] fwereade: that makes sense for ec2, but not for azure I think? [12:32] axw, my though for azure was that we could just put the machine into the same cs/as as all supplied instances (in fancy-azure mode) or ignore (in placement mode) [12:32] i.e. with AZ you want to avoid other machines in the AZ, but in azure you want to stick them all in the same Cloud Service [12:32] true [12:32] axw, yeah, but in azure we can do so iff the instances to avoid all match [12:33] axw, otherwise we can't distribute for reliability but whether that's an issue depends on the setting I think [12:33] axw, thank god we decided not to allow racing provisioners though [12:33] :) [12:33] indeed [12:35] axw, there might be some horrible hole in my logic but I'd like us to try quite hard to keep state concepts out of environ implementations [12:35] axw, the jobs/info dependencies make me grumpy but they don't feel too fundamental, this raher does [12:36] fwereade: yeah, I'll have to have a think about how it'll work [12:36] axw, tyvm [12:36] It'll mean recording more information specifically for provisioning [12:36] axw, expand please? [12:37] fwereade: instances to avoid is determined by the provider policy, right? that needs to happen as we're doing AddMachine if we're going to support clean machine assignment for ec2 [12:38] then it needs to be picked back up by the provisioner to pass to StartInstance [12:39] axw, I think we can just always assume instances-to-avoid == instances-running-a-unit-of-this-service [12:39] axw, provider is free to best-fit that [12:39] axw, and in the case of manual placement it's completely overridden [12:40] axw, ah doh I see [12:40] axw, ormaybe not [12:40] fwereade: I think that might work, need to let it marinate [12:41] axw, it's more info we need at provisioning time, but I think we can just get away with a quick scan of the units on that machine -- if any -- and an API call to find out what other instances are also running those units [12:41] axw, (prinicpals only, I think, but you already know that) [12:42] yup. so basically what I was going to do, but hiding the principals from StartInstance [12:42] axw, (also consider how/whether we can/should handle principals running on hosted machines -- I'd accept a TODO-figure-it-out there because it won't become a real concern until we start implementing zone distribution inside the other providers) [12:42] axw, yeah, exactly [12:43] axw, it's reimplementation but not fundamentally rearchitecting :) [12:43] on hosted machines...? [12:44] fwereade: what do you mean by "hosted machines"? [12:44] axw, 2/lsc/3 [12:45] axw, 2/lxc/3 [12:45] ah [12:45] yep, I only thought about it in so far as it's not really supported in Azure :) [12:48] axw, I'm not quite decided what the Right Thing is yet, in an ideal world we'd be supplying some sort of weighting information -- ie it matter much more that we're not near instance X than Y, because the unit running on X is not well-distributed yet but the one on Y is [12:48] axw, but that's off in best-is-enemy-of-good territory [12:48] axw, so sticking with the simplest thing might be wise [12:49] gaah need to do something quickly before meeting at 2, gtg [12:49] fwereade: later, thanks for the chat [13:23] voidspace: lp:~rogpeppe/juju-core/515-state-rename-api-addresses [13:27] mgz, ping [13:27] mgz, I'm starting again on a new machine [13:28] mgz, so I need the bzr magic incantations to create the local branches [13:28] mgz, and yet again I don't remember them :-) [13:29] nor indeed where you put the instructions [13:31] voidspace: yeah, I said I should write them down [13:32] voidspace: `bzr switch -b trunk; bzr pull --remember lp:juju-core; bzr switch -b feature_branch` [13:32] mgz, wonderful, thanks [13:32] I will email those to myself [13:32] it's just the initialisation I can't remember [13:32] using it is fine :-) [13:33] https://pastebin.canonical.com/106571/ [13:33] rogpeppe, ^^ [13:37] the logging calls in state/open.go where do those get logged to? logger.Infof [13:38] wwitzel3: i'm not sure i understand the question [13:38] wwitzel3: do you mean "where do the log messages end up?" [13:39] there are logger.Infof calls in state/open.go, Open() where do the string values passed to Infof end up? [13:41] what file would I tail to see them? [13:45] cloud-init-output.log has them [13:55] Is there a virtualbox / vagrant image specifically for core dev? [13:55] i.e., Go installed, etc [13:55] trivial method-renaming review anyone? https://codereview.appspot.com/76890043 [13:55] if not I'm going to host one [13:55] wwitzel3: it depends on the context [13:55] wwitzel3: is this when running a real environment? [13:56] * rogpeppe goes for lunch [13:56] rogpeppe: I found it on the machine being bootstrapped in cloud-init-output.log [14:00] does anyone know an eta on fixing the azure provider? [14:01] er, rather the compat with the updated provider [14:01] ... with the updated driver* [14:01] sigh [14:02] bodie_: use godeps to flip back to the comaptible revision [14:02] I was just using bzr [14:02] axw has some juju-core branches in progress but they're not yet landed [14:02] is there a fancy simple go way? [14:02] and this is why we have godeps :0 [14:02] rogpeppe: ^you got a potted simple way? [14:03] godeps -u dependencies.tsv [14:03] hehe.. potted. fun working with people who have variations in their syntax ;) [14:03] thanks axw [14:03] nps [14:04] should be something like: `go get launchpad.net/godeps/...; go install launchpad.net/godeps/...; godeps -u dependencies.tsv` [14:04] from inside juju-core dir [14:04] go install is not necessary if you do go get [14:05] go install rebuilds, right? [14:05] *double-checks note to self: "stop asking dumb questions"* === hatch__ is now known as hatch [14:07] bodie_: go install = go build and install the result to $GOPATH/(pkg|bin) [14:10] go get installs? that seems obnoxious, no wonder I generally avoid it [14:12] heh [14:12] I feel like the go tool is trying to do too much and not doing enough at the same time [14:12] it should either do very little, or do things properly [14:19] wwitzel3: ready to start up again? [14:25] bodie_: the go tool does the right thing... we're doing slightly the wrong thing right now. *usually* trunk just builds. I actually think it's a mistake for us to ever have trunk not build.... but others may disagree. === psivaa_ is now known as psivaa [14:28] heh [14:31] sinzui, good morning [14:31] hi jamespage [14:32] sinzui, so I was poking at 1.17.5 for trusty upload the morning and wanted to make a time/risk decision that I was not in the full facts of to make [14:32] * sinzui nods [14:32] sinzui, and that really boils down to when 1.18.x will be released; I don't really want to upload 1.17.5 (and revert the juju-mongodb change I put in for .4) if its only really going to be there for a few days [14:33] jamespage, understood [14:34] natefinch: yep, ready [14:34] jamespage, My only angst relates to ppc64 and arm64. [14:34] sinzui, in the context of 1.18? [14:35] jamespage, I can ask utlemming to release streams.canonical.com, but without those arch among the tools, they wont be tested [14:35] jamespage, but too your point...they need to know juju-mongodb [14:36] sinzui, right [14:36] jamespage, I still think we can see 1.18.0 this week. [14:36] sinzui, so will 1.18.0 use juju-mongodb across all archs if avaliable? this is fairly critical for the MIR [14:36] or I release again when I see juju-mongodb restored [14:36] * jamespage scrubs fairly from that sentence [14:37] jamespage, yes, juju-db will be used when it is available [14:37] sinzui, great [14:37] sinzui, sorry - juju-db or juju-mongodb? [14:37] (just to make sure we all know which one) [14:38] jamespage, sorry. I tried to type less. I mean the latter [14:38] * jamespage breathes again [14:38] I know that was discussed as a rename [14:42] so I'm on the verge of wiping my workstation and installing 12.04 (using 14.04 now) -- should I wait for this change to go in and just use a VM for now or something? [14:42] tests seem to be breaking [14:42] gustavo said it's mongo [14:42] and I am using juju-mongodb [14:43] bodie_: 14.04 works fine. I'm on 14.04 and so are several other devs. [14:43] bodie_: does mongod --help have the ssl section in the help now? [14:43] yeah [14:44] bodie_: can you pastebin the failing tests? I know you have before, but I want to see if there are differences now that you have the right mongo [14:45] http://paste.ubuntu.com/7108482/ [14:45] feeling a tiny bit hopeless at this point, it's been 4 or 5 solid days of struggle [14:45] mongod isn't in my path [14:46] it's in /usr/lib/juju/bin/mongod [14:46] bodie_: the code I believe right now expects mongod to be in /usr/bin/ [14:46] it's these tiny little gotchas that make this impossible for people to join in on [14:47] ok, not impossible [14:47] frustratingly unobvious [14:47] this is what I got from using make install-dependencies [14:47] bodie_: that actually is probably the problem.... we have a bug with the current code about the juju-mongodb. I know it's terrible, but try moving mongod to /usr/bin [14:48] can I just symlink it? [14:48] bodie_: possibly, but you may need to actually remove the juju/bin one.... try symlinking first. [14:48] bodie_: and yes, we need a better onboarding process, with better documentation etc. [14:49] I keep thinking it's just me being an idiot [14:49] was really hoping to get some code in by friday at least [14:49] thanks for the assistance [14:50] see, gustavo said it was the wrong mongo version [14:50] I don't know how he got that from my test output [14:50] do I just need to move mongod or all 5 binaries? [14:51] 6* [14:52] bodie_: I think just mongod, but I'm honestly not 100% sure. [14:54] bodie_: That is very strange that you're getting all those panics, though. While we have problems with the juju/bin mongod.... it doesn';t usually panic like that [14:57] you're on trusty, right? [14:57] bodie_: yes [14:58] so I don't really have any reason to expect switching distros to help [14:58] i'll see if moving the binaries fixes this [14:59] where did you get your copy of mongodb? [14:59] James used make install-dependencies and it put his copy in /usr/bin, unlike mine [15:00] bodie_: I built mine from source [15:01] finally. looks like the symlinks worked [15:01] interesting, what version of gcc? [15:01] bodie_: 4.8 I think lemme check [15:01] bodie_: 4.8.2 [15:01] I wasn't able to get the source build to work, it kept spitting out warnings [15:01] -_- [15:02] forums looked like maybe a gcc 4.8 issue [15:02] but I guess not [15:02] bodie_: er.... hmm.... that's my version of gcc now, but I was on Raring when I built mongo [15:02] ah [15:02] bodie_: so possibly an older version of gcc, I don't know [15:02] ok [15:03] dimitern, natefinch, mgz, fwereade: trivial review please? https://codereview.appspot.com/76890043/ [15:03] aaaand 107,772 test errors [15:05] rogpeppe: wwitzel3 got there already [15:05] mgz: cool [15:06] rogpeppe, reviewed [15:06] dimitern: thanks [15:06] wwitzel3: thanks to you too - i just hadn't refreshed the page to see your review :-) [15:07] dimitern: i don't understand your comment [15:08] dimitern: the API hasn't change (and hopefully won't change) [15:08] changed [15:09] rogpeppe, ah, sorry - the public/agent facing api is still the same [15:09] dimitern: yeah [15:09] rogpeppe, then ignore me ;) [15:09] dimitern: duly ignored [15:11] adeuring: started testing but have to update my 3rd party packages first [15:12] adeuring: could you paste me your error(s)? [15:13] TheMue: http://paste.ubuntu.com/7108636/ [15:14] adeuring: hehe, yep, bingo [15:14] adeuring: exactly the same here [15:15] TheMue: the last error is from r 2428. Reverting to r2427 fixes that one [15:15] but the other two error messages remain... [15:15] adeuring: that's bad :/ [15:16] adeuring: you need the right rev of gwacl, not top [15:16] *tip [15:17] and you want the ratelimiter package [15:17] see the log ^ for godeps tips [15:17] mgz: ahhh.. thanks, that fixed it! [15:23] natefinch... any thoughts? http://paste.ubuntu.com/7108679/ [15:23] I have very little idea what could be causing this [15:25] bodie_: that's the test that fails if mongod exists in /usr/lib/juju/bin :) [15:26] bodie_: rename or move mongod from that directory and it'll pass. [15:26] bodie_: it's a bug in the code & tests [15:27] bodie_: we half-added a feature to use mongo from that directory [15:27] bodie_: (where we = me) [15:34] rogpeppe, mgz: is there a technical reason why cloud-init-output.log isn't mirrored back to the client when bootstrapping with --debug? That would make my life so much easier [15:34] natefinch: axw is the one to ask [15:34] natefinch: i think it now sends back the output if the bootstrap fails [15:38] natefinch: it's because bootstrap is still in a funny place [15:38] were I redoing from scratch, I'd just have --debug echo/tail/poll the console-log nova api, and similar for local/manua [15:40] curent;y we have a funny mix of cloud-init parts and ssh-in-and-do-things parts that have disparate logging [15:40] oy. ok. thanks natefinch [15:40] mgz: probably why some of our errors come back as "rc: 1" [15:41] yeah, those are paricularly bad [15:41] because the stderr gets dropped [15:41] unlike with cloud-init [15:42] mgz: I actually tried fixing that, and ended up with stderr being "return code 1" or something along those lines equally useless [15:43] :) [15:43] too many lovely layers [15:47] is there any documentation on using kvm as a container? [15:48] the code looks like it supports it but couldnt find any documentation [15:49] natefinch, can you point me to the bit that tries to use /usr/lib/juju/bin ? would be nice if I could take a crack at fixing something [15:49] stokachu: there's a bug about us needing to add documentation about it [15:49] ok cool, any notes lying around? [15:50] I guess /agent/mongo/mongo.go [15:52] bodie_: yeah... I think the problem is that the test is using the MongoPath method, and the MongoUpstartService function is not. we hard coded the MongoUpstartService but forgot to fix the test. REally we should hardcode MongoPath for now, and put MongoUpstartService back to using MongoPath. [15:52] stokachu: juju help add-machine, and just replace lxc with kvm [15:52] natefinch: ah ok thanks [15:52] I see [15:52] and use manual provider right? [15:53] hey, make on master yells errors in lxc.go and clonetemplate.go [15:53] stokachu: that's orthogonal [15:53] is this expected or I have something broken? [15:53] perrito666: I'm not sure anyone actually uses make [15:54] stokachu: do juju help deploy to see how to deploy to a specific machine (including new container) [15:54] ok thanks will do [16:15] voidspace: can you hear me? [16:15] voidspace: or are you still coffeeing? [16:22] rogpeppe, https://lastpass.com/ [16:23] rogpeppe, vault [16:23] rogpeppe, that's the lastpass terminology anyway [16:25] dimitern, fwereade, natefinch, mgz: small review (adding State.SetAPIAddresses)? https://codereview.appspot.com/76950043 [16:33] i <3 juju+kvm [16:38] voidspace, rogpeppe: I love lastpass. I don't know how anyone actually uses the web without it (or something like it)\ [16:38] natefinch: yeah, i think i need to use it [16:38] natefinch: +1 got the wife using it as well [16:38] natefinch, I've just migrated from 1password as part of the move away from OS X [16:39] natefinch, so far so good :-) [16:39] it makes it trivial to use a different very strong password with every single service, which is really the only way to be secure. [16:40] voidspace: I've been using it for a few years now. No complaints. [16:44] two branches out for review, please: https://codereview.appspot.com/76950043, https://codereview.appspot.com/76870044 [16:44] dimitern, natefinch, wwitzel3, mgz, fwereade: ^ [16:44] voidspace: one thing I like is that if you pay for it, you get the mobile client and access to the dolphin browser plugin (if you're on android, not sure if they have it on iOS)... the dolphin plugin works just like the desktop plugin, which is handy for browsing on your phone [16:44] rogpeppe: I'll grab at least one [16:44] natefinch, I've been using 1password for years which is very similar, except with syncing via dropbox instead of the passwords on their servers... [16:45] natefinch: the 1st is a prereq of the 2nd [16:45] natefinch, you can't have browser plugins on iOS unfortunately :-/ [16:45] voidspace: pretty sure lastpass is encrypted locally before you send your data to them, btw [16:45] voidspace: I have a suggestion you probably won't like ;) [16:45] natefinch, you buy me a new phone and I'll use it :-) [16:45] natefinch: works in mobile firefox. I use it in that on android [16:45] voidspace: rofl [16:49] voidspace: that's cool. I'll have to try it and see how it compares to dolphin [16:49] er rick_h_ ^ [16:53] rogpeppe: there you go [16:54] natefinch: thanks [16:55] natefinch: the second one is even simpler :-) [16:55] rogpeppe: I did both ;) [16:55] natefinch: brilliant! === vladk|away is now known as vladk|offline [17:20] rogpeppe, back [17:24] rogpeppe, I got dumped out of the hangout - trying to join again [17:24] voidspace: k [17:25] rogpeppe, hmm... it won't let me back in [17:26] voidspace: what error do you see? [17:27] rogpeppe, it takes me to the error page and says "there was an error", with a "Start a new hangout" button [17:27] voidspace: awesome [17:27] rogpeppe, now it's saying "It's taking too long to connect you to this video call.Try again in a few minutes" [17:28] rogpeppe, which at least is progress I think... [17:28] voidspace: i could try leaving and joining again [17:28] Google is having some issues with hangouts atm [17:28] that would explain it... [17:28] voidspace: it still thinks you're connected, BTW [17:29] voidspace: ha, i also cannot rejoin [17:35] rogpeppe, creating a new one fails. wwitzel3 would appear to be correct :-) [17:35] voidspace: yup [17:37] rogpeppe, I'm going to work on my vim setup as that's pretty essential [17:37] rogpeppe, I have half an hour to EOD [17:37] voidspace: sgtm [17:37] voidspace: we've done alright today i reckon [17:37] rogpeppe, Mondays I have to leave promptly at 6pm due to krav maga, most other days I can be more flexible [17:37] rogpeppe, yep, been fun [17:38] voidspace: branch just merged [17:38] voidspace: one still to go [17:38] I saw [17:38] great [17:38] yep [17:38] dimitern: ping [17:39] fwereade: ^ [17:44] TIL not to mess with voidspace.... unless there's some other krav maga I don't know about, that's like, a UK form of knitting [17:49] natefinch, hehe [17:49] natefinch, I've only been doing it for a couple of months [17:49] natefinch, I really enjoy it but still at the "complete beginner" stage [17:51] natefinch, I still advise not messing with me though... [17:56] natefinch: wwitzel3 hi, just wanted to say hello, you seem to be my most overlapped co-teammers :) [17:56] right - EOD [17:56] 'night all [17:56] laters [17:56] see you tomorrow [17:56] voidspace: night! [17:57] perrito666: hi, yes, it's nice not to be the only one here in the afternoons :) [17:58] perrito666: hi :) [18:08] rogpeppe, mgz: wwitzel3 and I were wondering if there were things in state.Open we should *not* be doing in an HA environment... .like if you're not the first bootstrap node to come up. It's a little hard to tell what might cause problems if it were ran more than once. [18:09] natefinch: i've certainly be *trying* to make everything that happens in state.Open applicable in a HA environment [18:09] s/be /been / [18:10] rogpeppe: we're having a problem where bootstrap seems to finish successfully, but then juju status gets an error ERROR state/api: websocket.Dial wss://ec2-54-198-131-15.compute-1.amazonaws.com:17070/: dial tcp 54.198.131.15:17070: connection refused [18:11] natefinch: is this on tip? [18:11] rogpeppe: tip-ish. I synced my branch last thursday, I believe [18:11] natefinch: what do you see in the logs? [18:12] natefinch: (it sounds like the machine agent isn't coming up properly) [18:12] rogpeppe: I'm bringing up a new environment now, I'll check and see if I see anything noteworthy in the logs. [18:19] rogpeppe: ahh, hmm, looks like we're getting a mongo error when we try to read the replsetconfig while opening state (we do that to know if we need to call initiate) [18:20] natefinch: sounds right [18:20] natefinch: i have some code that does the initial replicaset setup for state, if it might be helpful for you [18:21] rogpeppe: we actually just were working on that today. Right now our code does it in state.Open if the replset isn't already initiated [18:22] natefinch: i'm not sure that's a great idea [18:22] natefinch: it seems to take quite a long time after setting the initial (1 member!) replica set configuration until you can actually use the mongo again [18:23] natefinch: i have no idea why that should be [18:23] natefinch: i would prefer to keep the replicaset logic out of the state package [18:24] rogpeppe: I was just putting it there because there's 40 lines of setup to dial mongo, which we have to do anyway [18:27] natefinch: yeah, i see that, but i wonder if there some other possibility [18:28] rogpeppe: I'm sure we can factor out the 40 lines so we don't have to write it multiple times. And re-dialing isn't a big deal. [18:28] natefinch: well, we'll have to redial anyway [18:29] rogpeppe: right [18:29] This line should read juju-mongodb, right? http://paste.ubuntu.com/7109636/ [18:29] It currently says mongodb-server [18:29] which I don't think will come from the ppa [18:29] natefinch: i can think of two possibilities atm [18:29] natefinch: 1) add a method to State that returns the mongo DialInfo that's appropriate for dialling the state's mongo server. [18:30] natefinch: 2) factor out the dial code into another package and make state.Open call it [18:31] rogpeppe: seems like the mongo package we already have would be a reasonable place to put the refactored method. Getting stuff out of state seems like a good idea. [18:31] natefinch: 3) factor the dial code out of state entirely and pass a mongo session into state.Open and state.Initialize [18:32] rogpeppe: 2 or 3 seem fine, I don't really have an opinion as to which is better. Probably passing the session into state is more flexible. [18:33] (so I guess I do have an opinion ;) [18:33] no strong opinion :) [18:33] natefinch: the first option is least work [18:33] natefinch: the third option is the most work [18:34] rogpeppe: the difference between 2 and 3 seems small. though I don't know about the tests. Mostly it seems like cut and paste. [18:34] (aside from tests) [18:35] natefinch: yeah, 3 isn't actually so bad - there are only 33 calls to state.Open in the code [18:35] heh [18:35] natefinch: i think it's my preferred option actually [18:37] natefinch: but it is actually quite a big change, now i think about it [18:37] natefinch: we'd need to move state.Info out of state [18:38] natefinch: it might all work out nicely though [18:40] natefinch: i would definitely run the idea past fwereade though, as it is definitely making the state abstraction a more leaky [18:40] s/a more/more/ === vladk|offline is now known as vladk [18:42] natefinch: done for the day, but I will still be here on and off [18:43] natefinch: if you make any break throughs make sure you push it to your branch so I can check it out in the morning [19:05] wwitzel3: will do. [19:06] rogpeppe: I'll mention it to fwereade. Probably to get things going ,the best idea right now is to do #1. Bringing on extra work, even if it's refactoring things a little more nicely, is probably not the best idea. [19:06] natefinch: agreed [19:12] hey, I am on my way out, see you all tomorrow :) [19:12] perrito666: see you tomorrow :) [19:26] o/ [19:30] o/ thumper === vladk is now known as vladk|offline [19:50] thumper, so with aufs local lxc.. is that optional? [19:50] hazmat: it is about to be [19:50] hazmat: I have a branch that allows configuration [19:51] thumper, awesome [19:51] spent yesterday writing tests for it mostly [19:51] hazmat: it was on all the time (other than btrfs) [19:52] yeah.. twould be nice as constraint.. [19:52] but env config is an ok fallback [19:52] thumper, cause next would be aa-unconfined profile as container/workload constraint [19:52] re ostack on local [19:53] all of which would come back to supporting provider specific constraints [19:53] * thumper nod [19:53] s [20:01] right, i'm done [20:01] g'night all === BradCrittenden is now known as bac [21:05] EOD for me. Night all. [21:06] thumper: did fast lxc land in 1.17.5? [21:06] marcoceppi: yes, but it seems there may be permission issues [21:06] looking into it [21:07] thumper: well if there's something i have to do, like modify a path or whatever, I'm down for that, I just want fast lxc while writing this charm [21:07] yes, it is there [21:13] mwhudson: ping [21:13] mwhudson: maybe you are flying... [22:21] * thumper waits for the merge... [22:32] phew, third time lucky [22:40] thumper: so, after the first time I deploy, each deployment (even between bootstraps) should be fast? [22:43] thumper: oh, actually, I got an error executing lxc-clone [22:43] thumper: ah, juju-local needs to depend on aufs-tools [22:44] ah [22:44] thumper: :\ http://paste.ubuntu.com/7110975/ [22:44] write that shit down L) [22:44] after install aufs-tools [22:45] hmm... [22:46] thumper: oh,I'll def file a bug as soon as I track down the issue [22:46] coolio [22:46] s/I/you === thumper is now known as thumper-gym [22:50] heh [22:56] thumper-gym: yeah, I aufs-tools didn't fix it and i'm nto sure where else to look. I'm guessing the lxc-container-aufs option is in trunk and not released? [23:34] thumper-gym: hey, i am at kingsford smith airport so am happy for you to try to stop me getting bored out of my mind :-) === Ursinha is now known as Ursinha-afk [23:40] (that said the internet is pretty rubbish, so i might not be very good conversation)