/srv/irclogs.ubuntu.com/2014/03/18/#juju-dev.txt

waiganiwallyworld_: morning00:13
wallyworld_hey00:13
waiganiI have a problem for you:00:13
waiganipulled trunk, got "undefined: ratelimit.New", go get github.com/juju/ratelimit, still get error. What did I miss?00:13
wallyworld_what error?00:14
waiganiratelimit is undefined00:14
waiganiit can't find the package00:14
wallyworld_go get -u00:14
wallyworld_maybe00:14
waiganiah00:14
davecheneymarcoceppi: thanks for fixing the charm-helper-sh problem00:15
waiganiwallyworld_: no luck, strange..00:15
wallyworld_hmmm00:15
wallyworld_i did hear that tip of ratelimit is not compatible with juju core00:16
wallyworld_but for the whole package to be undefined doesn't fit with that00:16
wallyworld_i just pulled ratelimit and it is there00:17
waiganiit must be something with my setup, otherwise others would be hitting this00:17
wallyworld_are you sure your GOPATH is correct?00:18
waiganiI'll check go paths etc (again!)00:18
waiganihmm, GOPATH looks correct, ratelimit is in $GOPATH/src/github.com/juju/ratelimit, tried rebuilding pkg hmmm00:24
=== thumper-gym is now known as thumper
thumpermwhudson: where are you off to?00:24
mwhudsonthumper: uk00:24
thumpersprint?00:24
thumperor holiday?00:24
davecheneywaigani: i'm concerned that the solution to your problems is 'rebuild' everything00:24
mwhudsonholiday!00:24
mwhudsondad's 80th00:24
thumpernice00:25
davecheneythat smells like something is wrong with your setup00:25
thumperhave fun00:25
thumperwaigani: you need to do this:00:25
thumpergo get github.com/juju/ratelimit00:25
thumperthen run00:25
mwhudsonthumper: i have to keep reminding myself that the routing with 6 hours in sydney was over $1000 cheaper :-)00:25
thumpergodeps -u dependencies.tsv00:25
thumpermwhudson: haha00:25
davecheneymwhudson: where you going ? neptune ?00:25
thumpermwhudson: emma and pheobie going too?00:25
thumpermwhudson: how do you spell that?00:26
* thumper feels like it is wrong00:26
mwhudsonthumper: no, solo00:26
mwhudsonthumper: phoebe00:26
davecheneyo before e == long eee sound00:26
waiganithumper: thanks, davecheney: more of a desperate attempt than a solution00:26
davecheneywaigani: lets fix the underlying problem00:27
thumperwaigani: you have godeps built?00:27
davecheneyplease tell the doctor where it hurts00:27
thumperdavecheney: the underlying problem is not having the deps right :)00:27
hatchhey I just updated to 1.17.5 on precise and now local machines give me this error "(error: container failed to start)" is this a known issue?00:27
waiganithumper: godeps -u dependencies.tsv00:27
waigani"/home/jesse/go/src/github.com/juju/ratelimit" now at 0025ab75db6c6eaa4ffff0240c2c9e617ad1a0eb00:27
waiganigodeps: cannot update "/home/jesse/go/src/github.com/juju/testing": fatal: reference is not a tree: 9c0e0686136637876ae659e9056897575236e11f00:27
davecheneywaigani: go version00:28
thumperwaigani: cd ~/go/src/github.com/juju/testing00:28
davecheneygo env | pastebinit00:28
thumpergit pull00:28
davecheneythumper: yeah, if waigani is using go get00:29
thumperprobably a way to do it without changing directory00:29
waiganidavecheney: go version go1.2.1 linux/amd6400:29
davecheneyand a working copy already exists00:29
davecheneythen it will not update00:29
davecheneygo get -u github.com/juju/ratelimit00:29
thumperalso, godeps doesn't pull00:29
davecheneyis required00:29
thumperdavecheney: ack00:29
* thumper breaks his own rules and takes the laptop into the kitchen00:31
waiganithumper: davecheney: wallyworld_: all working now, tests pass thanks00:32
thumpergood00:33
thumperaxw: all that thinking and we already have it in the Makefile :)01:27
axwdoh :)01:28
thumperdavecheney: any idea why I'd be getting link errors when trying to build the tests on power?01:45
thumperoh fark01:49
thumperstabby01:49
thumperstabby01:49
thumperstabby01:49
rick_h_thumper: needs more stabby!01:53
thumperrick_h_: ✂ ☹01:57
thumperrick_h_: ✂☹ ✂☹✂☹✂☹01:57
rick_h_lol01:59
mwhudsonthumper: heh, you're being roped into the "make it work on funny arch" game?02:03
thumpermwhudson: yeah...02:03
wallyworld_davecheney: hiya02:04
=== hatch__ is now known as hatch
thumperdavecheney: I need help02:06
axwwaigani: shipit02:24
axwwaigani: well, apparently there's a text conflict in state/initialize_test.go, so after you fix that :)02:24
waiganioh really?02:24
waiganiokay, axw thanks for the massive review02:25
axwwaigani: no worries :)02:25
thumperwaigani: https://code.launchpad.net/~waigani/juju-core/remove-checkers-dir/+merge/210935 needs updating with trunk, someone added a test pointing to old checkers02:44
waiganithumper: on it02:44
thumperwaigani: also the migrate testbase branch has conflicts with trunk02:48
davecheneyhello02:51
davecheneyi'm here to help02:51
davecheneythumper: sorry, was eating02:52
thumperdavecheney: you aren't allowed to eat02:52
thumpermy god man02:52
davecheneysorry sir02:52
thumperwhy is mongodb-server failing on power?02:52
thumperI'm guessing you've solved this already02:52
davecheneythumper: ahh02:52
davecheneythis is a good question02:52
davecheneyjuju looks for /usr/bin/mongod02:53
davecheneyand chides you if it's not there02:53
davecheneyBUUUUUUUUUUUUUUUUT02:53
davecheneythe actual path of juju-mongodb is somewhere else02:53
davecheneybecuase this is our special versino of mongo02:53
davecheneyso even if the package is installed, the check still fails02:53
davecheneyor the upstart script points to the wrong location02:53
thumperare we installing that?02:54
davecheneywell02:54
thumperI didn't think that that branch had landed02:54
thumperit did land and was reverted02:54
davecheneythe install instructions say 'apt-get isntall mongo-server02:54
davecheneywhich isn't correct02:54
thumperso the default mongo-server on power is fucked02:55
thumperand we need to use our one?02:55
=== Ursinha-afk is now known as Ursinha
davecheneythumper: not fucked02:55
davecheneynot available02:55
thumperI installed it02:55
davecheneythumper: as I understood it02:55
davecheneywe (juju) should always be recommeding juju-mongodb package02:56
thumperbut it fails to start02:56
davecheneynot just for trusty/ppc64el02:56
davecheneybut for everyting back to precise02:56
davecheneythumper: it doesn't work 'cos v8 doesn't run on ppc02:56
thumperit should be juju-db package (according to our sabdfl)02:56
davecheneythe juju-mongodb package does not have a javascript interpreter enabled02:56
thumperwell... unless you have the v8 power thing from github02:56
mwhudsonum02:56
thumpero/ mwhudson02:57
mwhudsoni thought a v8 port was available for power?02:57
mwhudsonprobably not packaged though i guess02:57
thumperI don't think it is packaged02:57
davecheneythumper: sir, it's a little late to reopen this discussion02:57
thumperdeveloped by not available02:57
davecheneywe (juju) should always be recommeding juju-mongodb package02:57
thumperdavecheney: I'll take it to the people I know...02:57
davecheney^ am I mistaken02:57
* thumper sighs02:57
mwhudsoni agree that davecheney is right about where things _should_ be02:57
thumperdavecheney: you are correct with what we originally said02:57
mwhudsonnfi what the current state is though02:58
thumperhowever we had been trumped along the way02:58
thumperbut I'm not sure whether it has been actioned02:58
* thumper will take to the email02:58
davecheneywho wants to get on a hangout and thrash this out ?02:58
thumperdavecheney: so... your local on power had a hacked juju-db upstart?02:58
davecheneythumper: NO02:58
davecheneymy hack is02:58
davecheneyubuntu@winton-02:~$ ls -l $(which mongod)02:59
davecheneylrwxrwxrwx 1 root root 24 Mar 14 00:55 /usr/bin/mongod -> /usr/lib/juju/bin/mongod02:59
davecheneyIMO two things need to happen02:59
mwhudsoni don't want to muddy the water tooooo much02:59
davecheney1. juju stops recommending the mongodb-server package02:59
mwhudsonbut https://launchpad.net/ubuntu/+source/mongodb/1:2.4.9-1ubuntu1/+build/5664994 is a ppc build of mongo for trusty02:59
davecheney2. upstart scripts are corrected to reflect the path is /usr/lib/juju/bin/mongod02:59
davecheneymwhudson: sorry03:00
davecheneyplease, this discussino is over03:00
davecheneyjames page made this package03:00
mwhudsonok03:00
thumpermwhudson: I did try it, it failed to start03:00
davecheneyit's too late to try to re solve this problem03:00
mwhudsonah ok, so it builds but doesn't work, ok03:00
davecheneywe have a solution03:00
davecheneyit's a really good solution03:00
mwhudsondavecheney: i'm not trying to change the solution03:00
davecheneybecause it *ALSO* solves the problem for precise03:00
thumperdavecheney: AFAIK nate is working on changing to use the juju db package03:00
davecheneywhich we still have to support for another 3 years03:00
thumperdavecheney: it is a different argument about the name 'juju-db' or 'juju-mongodb'03:00
thumperI want to see where we are with it03:01
davecheneythumper: cool03:01
davecheneythe name of the replacement pacakge is unimportant03:01
thumperdavecheney: so you just symlinked /usr/bin/mongod03:01
davecheneythe key is that it does not live in /usr/bin/mongod03:01
davecheneyand it isn't called mongodb-server03:01
thumperack03:01
davecheneythumper: yes, that is my workaround03:01
davecheneyto unblock myself03:02
davecheneyit is not a soluton03:02
thumperright03:02
* thumper is on to fix the solution03:02
davecheney1. juju stops recommending the mongodb-server package03:02
davecheney2. upstart scripts are corrected to reflect the path is /usr/lib/juju/bin/mongod03:02
davecheney^ i believe this is the correct sequence03:02
thumpersure...03:03
thumperdavecheney: do you want to be CC'ed on the emails, or are you happy to be left off?03:03
thumperaxw: due to the current aufs issues, I'm going to submit a branch to default aufs to off03:04
axwthumper: okey dokey03:04
davecheneythumper: sure03:06
davecheneyemail away03:06
wallyworld_davecheney: i'm guessing i need to configure the ppc vms to be able to ssh out to an ec2 instance?03:06
davecheneythumper: re aufs: i agree03:06
davecheneyi know mramm really really wants it03:06
davecheneybut lets get *something* working03:06
davecheneybefore moving on to making it use all the super amazing optional features03:06
davecheneywallyworld_: oh, there is no external access03:07
thumperwallyworld_: if you have the http proxy03:07
thumperdavecheney: none at all?03:07
davecheneygoota go through the proxy03:07
wallyworld_thumper: i used the squid proxy to get http03:07
davecheneyand the proxy is whitelist only03:07
wallyworld_the ip addresses didnt work03:07
davecheneywallyworld_: i'm really sorry03:07
davecheneyyou have to raise an RT03:07
davecheneyplease cc me on the RT03:07
davecheneyi'm maintaining a list of open ones03:07
davecheneyi'm tyring to get the PM to be more active in getting them actioned03:07
thumperwallyworld_: also, ask for all the vms03:08
wallyworld_davecheney: so my ssh foo is crap - i can't just set up a config and use the proxies from the doc, they are only for http?03:08
davecheneywallyworld_: not quite sure what you are asking03:08
thumperwallyworld_: axw has good ssh-fu03:08
davecheneythe doc talks about from bne -> your vm03:08
davecheneynot the other way around03:08
davecheneyincoming access is via batuan, the jump host03:08
wallyworld_davecheney: yes, but the doc also gives proxies to use inside the vm03:08
davecheneyoutgoing access is via proxy03:08
wallyworld_i have outgoing http access via http://squid.internal:3128/03:09
davecheneycorrect03:09
davecheneybut that is whitelisted03:09
wallyworld_but you are saying an RT is needed to get outpoing ssh?03:09
davecheneywallyworld_: yes03:09
davecheneyand also to have addtional sites whitelisted for the proxy03:10
wallyworld_davecheney: ok, will raise rt. cause once that's done, i have a branch which would have been abl to bootstrap a workload on aws03:10
davecheneyfor example I had to ask rog to hold off on the launchpad.net/goyaml -> gopkg.in/goyaml change03:10
davecheneybecause that site was not whitelisted by the proxy03:10
davecheneyOH FUCK03:10
davecheneyi just realised that03:10
davecheneysync bootstrapo03:10
wallyworld_yep03:11
davecheneywe required ssh access from the client03:11
davecheneyWE"RE FUCKED03:11
wallyworld_yep03:11
* davecheney cries03:11
wallyworld_oh?03:11
wallyworld_we can't organise that?03:11
davecheneythe chances or elmo allowing that are effectively zero03:11
davecheneycan we disable sync bootstrap ?03:11
axwwhat's the problem?03:12
wallyworld_no outgoing ssh03:12
wallyworld_from ppc boxen03:12
axwyou can't proxy it?03:12
axwwhat is outgoing?03:13
wallyworld_bootstrap tries to ssh into aws instance and fails to connect03:13
davecheneyaxw: sync bootstrap03:13
axwif you can ssh, you can ssh out using a tunnel at the worst03:13
axwif you can ssh in*03:13
davecheneyaxw: a human can03:13
davecheneyjuju probably cant03:13
axwdavecheney: do you have an HTTP proxy you can go out through?03:15
axwdavecheney: if so, you can set up ssh to use HTTPS/CONNECT using ProxyCommand03:15
axwman ssh_config, look for ProxyCommand03:16
axwand set up your ~/.ssh/config accordingly03:16
davecheneyaxw: worth a shot03:17
davecheneyi think some parts of aws are whitelisted03:17
davecheneybut it might just be the api endpoiints03:17
davecheneyaxw: are you actively trying to use the proxy for outgoing ssh ?03:37
axwdavecheney: I'm not doing ppc stuff, so no03:40
davecheneyaxw: thanks for confirming03:40
axwdavecheney: I can help debug if you're having trouble though03:40
davecheneyaxw: i am also not trying03:41
axwok03:41
thumperwallyworld_: are you trying?03:51
wallyworld_no03:52
wallyworld_am finish tests03:52
wallyworld_finishing03:52
wallyworld_i can try after that cause i want to get the branch proposed03:52
wallyworld_and it's a bit of a rabbit hole with existing code cut and pasted around a bit03:53
wallyworld_the branch i'm working on is not blocked by the ssh issue03:54
thumperwallyworld_: https://codereview.appspot.com/7722004303:58
thumperwallyworld_: I changed lxc-clone and lxc-clone-aufs to bools03:59
wallyworld_ok03:59
thumperwallyworld_: as I tried to use it locally and realised how fucked up strings were in their place03:59
wallyworld_will look in 2 minutes03:59
thumpersure03:59
thumperno rush03:59
thumperI have to head out shortly03:59
thumperalso has aufs defaulting to off for now03:59
wallyworld_thumper: what's failing at the moment are tests which i don't think should have passed originally03:59
thumperhaha03:59
thumperdamn04:00
wallyworld_ie upload tools should not upload for non dev versions04:00
wallyworld_ie 1.2.x should not upload since it's not a dev release04:00
thumperright... and I take it that it is?04:00
wallyworld_yep04:00
wallyworld_so i'm having to change existing tests04:00
thumperbut 1.2.x.1 should right?04:00
wallyworld_yep04:00
thumperok04:00
wallyworld_those table driven tests are a pita04:01
wallyworld_or at least that how it appears04:01
wallyworld_i have to did though gobs of output04:01
wallyworld_i might review your stuff to give my eyes a rest04:02
davecheneythumper: https://codereview.appspot.com/77220043/ LGTM04:04
thumperdavecheney: ta04:07
* thumper goes away for while...04:08
davecheneywallyworld_: is there an MP for the tools/arch change you are working on ?04:08
* davecheney is ready to review04:08
wallyworld_davecheney: it's still wip sadly. it was ready and i used it to test live but i added extra tests and they failed cause we have cut and paste code and broken tests which passed even though they should not have IMO04:09
davecheneyle fuck04:09
wallyworld_unless i am wrong, if version.Current is 1.2.x say, the --upload-tools should not work cause 1.2 is a release version04:10
davecheneywallyworld_: i think that you are correct04:10
davecheneybut that restriction was never implemented in code04:10
wallyworld_and yet tests set up such a version.Current and called bootstrap --upload-tools and expected tools to be uploaded04:10
wallyworld_well, it was in some places04:11
davecheneyso, the tests assume that restrictino is not in place04:11
davecheneyremove the restriction ?04:11
wallyworld_hmmm. i would like to keep it04:11
wallyworld_cause relese tools should be available04:11
wallyworld_i think it's reasonable to say that upload-tools should be for dev versions04:11
davecheneywallyworld_: sure, i have no position on this04:14
davecheney--upload-tools always produces, x.y.z.104:14
wallyworld_yeah04:14
davecheneyso there is no possibility of a conflict04:14
wallyworld_there was 2 pices of almost identical code04:14
wallyworld_one lot enforced it i think, and the other didn't04:15
wallyworld_i've made changes so can't recall exactly04:15
wallyworld_but the code is now shared, so we can change the policy in once place04:16
wallyworld_davecheney: if you still feel like reviewing https://codereview.appspot.com/77270043 a lot of the diff is deleted/moved code and tests. i also retained upload release versions for explicit uploads05:21
wallyworld_davecheney: you should be happy once this lands05:21
wallyworld_tested on ppc box but failed due to ssh - the tools bit worked fine05:22
davecheneywallyworld_: /me looks05:26
wallyworld_ta :-)05:26
=== vladk|offline is now known as vladk
=== vladk is now known as vladk|away
=== vladk|away is now known as vladk
vladkjam, good morning08:06
vladkjam, https://juju.ubuntu.com/docs/config-LXC.html says that08:06
vladk"The usage of LXC Linux Containers enforces that bootstrapping and destroying of an environment are done as root. ...08:06
vladk... sudo juju bootstrap"08:06
vladkbut I have got08:06
vladk"ERROR bootstrapping a local environment must not be done as root"08:06
vladkwhere can I write about it?08:06
dimiternvladk, it is done by root, but sudo is called later in the bootstrap process08:23
vladkdimitern, morning08:24
dimiternvladk, morning!08:24
vladkdimitern: I see, but there is an error in documentation, if I follow it, I have got the above error. So I would like to know who can I write to fix the documentation08:25
vladkdimitern: how can I 'juju bootstrap' with trusty series?08:26
dimiternvladk, evilnickveitch is in charge of the documentation, and there are bugs filed for the docs separately08:26
dimiternvladk, https://bugs.launchpad.net/juju-core/docs08:27
dimiternvladk, so on trusty, you just need to do juju bootstrap --upload-tools08:27
vladkdimitern: how to understand upload-tools?08:28
dimiternvladk, ah, that's an instruction to bootstrap to package your existing binaries (from cmd/juju and cmd/jujud) into a tools.tar.gz package and set the version to version.Current.Number + 0.0.0.108:29
dimiternvladk, i.e. if version.Current is 1.17.6, with --upload-tools version 1.17.6.1 will be uploaded (and .2 next time you call --upload-tools and so on)08:30
jamvladk: morning08:30
jamvladk: the docs do need updating, they are correct for juju 1.16.6 (our last stable release), but not correct for trunk08:30
jamhowever, we won't update the docs until 1.18 is out, since otherwise they'd be wrong for everyone using stable08:30
evilnickveitchvladk, dimitern, feel free to file bugs anyhow on things you think are wrong, but mention you are running the dev version08:38
evilnickveitchsomeday we will have notes for the unstable releases too08:38
dimiternevilnickveitch, \o/08:39
rogpeppemornin' all08:48
vladkrogpeppe: morning08:52
rogpeppevladk: hiya08:52
dimiternmgz, fwereade, maas vlan meeting?09:02
jammgz: vladk, fwereade: care to join us to discuss MaaS ?09:02
jamhttps://plus.google.com/hangouts/_/canonical.com/discuss-vlan09:02
mfoordrejoining09:26
jammgz: poke about MaaS vlan09:28
jammgz: poke09:48
perrito666good morning everyone09:55
jammorning perrito66610:00
jamwwitzel3: let me know when you come online10:00
wwitzel3jam: I'm here10:02
jamwwitzel3: hi. We're still doing some of the MaaS VLAN discussion, but I think we're winding down.10:02
jamwwitzel3: I'm in the hangout associated with the 1:1 calendar event I sent you10:03
jammgz: poke for standup10:47
dimiternvladk, ^^10:48
mgzgah, sorry guys11:00
adeuringcould somebody have a llok here: https://codereview.appspot.com/77260044 (trivial fix(11:10
voidspaceadeuring: LGTM11:11
adeuringvoidspace: thanks11:11
rogpeppe1voidspace: shall we make another hangout?11:34
jamnatefinch: if you have known tests that fail, and we can fix them with runtime.GOMAXPROCS(1), we can certainly add them.11:35
wwitzel3I'm interested in vlan stuff, but if I sit in on that, I will loose all the HA stuff jam and I talked about this morning11:35
wwitzel3natefinch: I am going to take a look at the code changes you pushed up and run them through MaaS, ping me when you're back in the saddle.11:35
rogpeppe1voidspace: https://plus.google.com/hangouts/_/7acpj0plqg71qcoie9g4705ddo?hl=en-GB11:36
voidspacerogpeppe1: coming11:40
voidspacejust testing something - please ignore this message (or not at your pleasure)11:59
rogpeppe1mgz, fwereade, dimitern, jam: we want to factor out the address-related stuff from the instance package. suggested package is juju-core/netaddr, with the same Address, etc types that are current in the instance package12:14
rogpeppe1does that seem reasonable?12:14
dimiternrogpeppe1, +112:14
mgzwhy the factor out?12:16
rogpeppe1mgz: because addresses need to be seen by clients, and it doesn't really make sense for clients to import instance12:18
=== rogpeppe1 is now known as rogpeppe
mgzthat surprises me a little, I thought everything imported instance12:18
rogpeppemgz: there's a load of stuff in the instance package which is really not applicable to API clients12:20
mgzeg, lots of things use Instance.Id even if they don't use other bits12:21
rogpeppemgz: factoring out the address-related stuff seems kind of reasonable to me12:21
rogpeppemgz: instance.Id, yes12:21
mgzit seems reasonable to move it if it helps things12:21
mgzI just thought instance was pretty pervasive12:21
rogpeppemgz: it is, but i guess to me the address stuff feels much less juju-specific than the other stuff in the instance package12:24
rogpeppemgz: and dividing them up could make for two nicely coherent packages12:25
rogpeppemgz: but if you don't think it's a good idea, i don't think it matters too much12:25
mgzit seems reasonable if it actually helps anything12:26
mgzas in, if there are places that don't ending up importing both anyway :)12:26
TheMuemgz, rogpeppe: could you tell me why juju-backup/juju-restore are no regular commands (e.g. juju backup/juju restore)?12:27
TheMueand why they are called plugins?12:27
mgzTheMue: they are, just magic plugin things12:27
rogpeppeTheMue: they're a bit hacky to be first-class citizens12:27
rogpeppeTheMue: but "juju backup" should work12:28
TheMuerogpeppe: hacky in the way they are implemented? sure, a bit different. ;)12:28
rogpeppeTheMue: as should "juju restore"12:28
rogpeppeTheMue: (the former requires the shell script to be installed tho)12:28
TheMuerogpeppe: hmm, where is the magic hidden that the script is called? didn't found a reference to the script in the code. maybe too blind.12:29
rogpeppeTheMue: it starts with "juju-"12:29
TheMuerogpeppe: ah, so if juju (the command) doesn't find a command (e.g. "foo") directly implemented it looks for a "juju-foo" file to execute it?12:30
TheMuerogpeppe: then also the naming as plugin makes sense12:30
TheMuerogpeppe: found the magic, thanks. important for the documentation I'm writing12:33
natefinchjam: want to meet now?12:39
* jam whimpers12:39
jamsoo many meetings12:40
jambut actually yes12:40
natefinchjam: ok12:40
jamfwereade: are you back yet12:40
natefinchjam: maybe the new manager person will help take some of the meetings off your plate?  She has a name that I have, of course, forgotten.12:40
jamnatefinch: alexis is *my* manager, not a team lead12:40
jamso just another person to report to :)12:41
natefinchjam: heh... I just hoped she might be able to help with some of the managerial stuff, but sounds like that's not the problem :)12:41
jamnatefinch: I'm in the channel from the earlier calendar event12:42
natefinchjam:  oh, ok12:42
=== BradCrittenden is now known as bac
sinzuijamespage, Did you unsubscribe me from ~juju-packaging/+archive/stable ?13:02
jamespagesinzui, nope13:03
sinzuioh dear. I don't know who could do it besides you and me13:03
sinzuijamespage, I will avert the 1.18.0 release catastrophe by resubscribing and updating cloud city with the new credentials13:03
rogpeppex13:22
rogpeppemgz: fancy a review of some instance package additions? https://codereview.appspot.com/77410043/13:31
voidspace rogpeppe I can hear you13:39
voidspacerogpeppe: wow, that's about a ten second latency on audio13:39
rogpeppevoidspace: ok, let's try the IRC challenge13:40
rogpeppevoidspace: i'll type x and say it at the same time13:40
voidspacerogpeppe: ok13:40
rogpeppex13:40
rogpeppex13:40
rogpeppey13:40
voidspacerogpeppe: the first one seemed instantaneous13:40
rogpeppez13:40
voidspacerogpeppe: maybe a second or two13:40
voidspacerogpeppe: let me try13:40
voidspacerogpeppe: this13:41
voidspacerogpeppe: did you even get that?13:41
voidspacewow13:41
voidspaceouch13:41
rogpeppeabout 11 seconds delay13:41
voidspacerogpeppe: wwitzel3: I have 1Mbit upstream13:41
voidspacerogpeppe: wwitzel3: maybe if I switch off my camera it will help13:42
voidspacereduce my upstream13:42
voidspacerogpeppe: lunch sounds *great*13:42
voidspace:-)13:42
rogpeppeawesome, let's do lunch :-)13:42
voidspacebyeeee13:42
natefinchwwitzel3: ok, ready, finally13:44
wwitzel3natefinch: ok :)13:51
adeuringanother trivial MP: https://codereview.appspot.com/7743004313:53
mgzrogpeppe: looking13:57
axwhazmat: you don't use the PublicAddress client API do you?14:00
axwhazmat: actually.. never mind, probably too late in 1.17 to remove it now.14:01
mgzrogpeppe: lgtm14:01
rogpeppemgz: thanks14:02
mgzadeuring: lgtm.14:03
adeuringmgz: thanks14:03
mgzadeuring: did you also check the other providers just in case? :)14:03
adeuringmgz: let me look again ;)14:04
adeuringno looks good14:04
=== vladk is now known as vladk|away
bits3rpentAny reason updated master wont replace juju binaries?14:13
natefinchare you doing juju install or juju build? Build doesn't install, it just compiles14:14
natefincher sorry, go build bo install14:14
natefinchbrains14:14
bits3rpentgo install launchpad.net/juju-core/...14:14
bits3rpenthaha, it's fine :)14:15
hazmataxw, i don't, there's a usage mode in deployer (-f) where people want that but i extract from status14:16
hazmataxw, iotw i was going to.. but no i don't use it atm14:17
fwereadebits3rpent, are you talking about replacing binaries in $GOBIN or those installed via apt?14:17
natefinchbits3rpent: that should work, unless there's no changes to the code.   Do you have just a single path in your GOPATH?  go install always installs to the first path in GOPATH, if you have multiple14:17
natefinchfwereade: ahh good question14:17
bits3rpentfwereade: $GOBIN14:18
axwhazmat: thanks, it'll likely stay in anyway14:18
fwereadebits3rpent, hmm, that's surprising -- does it install to that location if you move/delete what's already there?14:22
axwfwereade: I'm planning to make "juju ssh" connect to private addresses, proxying through the API server address. Any objections to this approach?14:26
axwit won't be azure-specific14:26
fwereadeaxw, I'm +1 on that in general, public ips are in short supply all over the place14:26
axwcool, I can work on that independent of the azure stuff14:27
axwfwereade: did you see my reply about PrincipalUnits vs. DistributionInstances? I can't really see away around it while also preventing add-machine at that point14:29
fwereadeaxw, sorry, I didn't get to that yet, just a sec14:30
axwadd-machine can be prevented by a Prechecker, but that's not supposed to be reliable14:30
fwereadeaxw, remind me the forces that lead towards a callback ratherthan a plain slice14:32
fwereadeaxw, but DistributionInstances sounds like a tolerable name to me :)14:32
axwfwereade: purely for performance14:32
fwereadeaxw, so we don't bother calculating it for providers that can't handle it? fair enough14:33
axwfwereade: though it's on the state server already, so... *shrug*14:33
fwereadeaxw, I'm fine leaving it as a callback, I had a vague recollection there was another reason to prefer it, I just can't remember what14:34
axwfwereade: perhaps I'll think of it in the middle of the night, but I can't think of any other reason now14:35
fwereadeaxw, fwiw I wouldn't be opposed to a field that took a string that providers are free to use to try to helpfully tag nstances if possible14:36
axwfwereade: sure. that's not a blocker really. the thing blocking me now is that I can no longer prevent StartInstance with no assigned principals14:38
mgzaxw: it *is* the middle of the night, isn't it?14:40
axwmgz: it's only 10:40pm :)14:40
mgz:)14:40
fwereadeaxw, I see -- it means there's no way to prevent add-machine?14:43
axwfwereade: yup14:43
* fwereade makes a face and stares into space a bit14:43
axwfwereade: I'm using the principals in two places for that: in PrecheckInstances, and in StartInstance14:43
axwPrecheckInstance*14:44
fwereadeaxw, how do prevent --to?14:44
fwereades/do/do we/14:44
axwfwereade: a new UnitAssigner state policy14:44
* axw context switches a bit14:44
axwfwereade: UnitAssigner.CheckUnitAssignment(*state.Unit, *state.Machine) error14:45
fwereadeaxw, yeah, just found it again14:45
=== hatch__ is now known as hatch
axwfwereade: so Azure just returns an error all the time. It only gets called if a new machine isn't created14:45
axwerr, if an existing machine is requested14:46
fwereadeaxw, so, one thing we had for a while that didn't end up sitting quite right was having the environ itself return the assignment policy14:47
fwereadeaxw, ie AssignLocal, AssignCleanEmpty, etc14:47
fwereadeaxw, I'm trying to figure out if there's some similar way of describing the allowable operations at that sort of level14:48
axwfwereade: --to effectively overrides the policy14:48
axwoh, I see what you mean14:49
=== vladk|away is now known as vladk
=== hatch is now known as negatron
=== negatron is now known as hatch
fwereadeaxw, thinking a bit more: it's *kinda* a CanAssignUnits flag on an environ, that controls validity of both --to and add-machine15:10
voidspacerogpeppe: are you back?15:11
rogpeppeyup15:11
axwfwereade: sounds reasonable. I'm fine with blocking it at that level15:12
voidspacerogpeppe: want to try starting a new hangout15:12
voidspacerogpeppe: nearly typed hangup by mistake15:12
rogpeppevoidspace: https://plus.google.com/hangouts/_/76cpjgribubncq8d4f1s1nalr0?hl=en-GB15:12
voidspaceI have enough hangups already without you starting more15:12
voidspacecool :-)15:12
axwfwereade: though, the UnitAssigner was meant to grow to handle filtering machines that can be assigned to for ec2 AZs15:13
axwfwereade: so you may support assignment, but you can't assign to any old machine15:13
fwereadeaxw, --to overrides that, right? this is just for auto-assignment to existing machines?15:14
axwfwereade: yup15:16
axwfwereade: supporting add-machine/--to could be a flag, independent of that15:17
axwjust saying I had intended to put them both together in one interface15:17
bits3rpentIs there anyway to only display unassigned bugs on launchpad?15:19
fwereadeaxw, I'm wondering whether the assignment could be handled with an interface more like FurthestPossibleInstance(candidates, onesToAvoid []Instance) (Instance, error)15:19
fwereadebits3rpent, sorry: there's an Assignee field in https://bugs.launchpad.net/juju-core/?advanced=115:20
fwereadebits3rpent, with a "Nobody" radio button15:20
bits3rpentfwereade, thanks!15:20
axwfwereade: for ec2, yes, that sounds about right15:20
fwereadebits3rpent, if you click the "search" button at the top of the page it might ignore the stuff you specify below, though15:21
fwereadebits3rpent, use the one at the bottom :)15:21
fwereadeaxw, well, for azure in assignment-allowed mode we can just return any of them15:21
bits3rpentfwereade, will do :)15:21
fwereadeaxw, (and for ec2 we will also need an error meaning "you can start an instance that's even further than any of those"15:22
fwereade)15:22
axwyeah that makes sense15:22
axwthis is getting ahead of the immediate need though I think15:23
axwfwereade: did you have any thoughts on how to flag a StartInstance as being add-machine'd without PrincipalUnits?15:24
axwhow that works actually has ramifications on API and maybe state15:24
axwthe other stuff can be changed with refactoring15:24
fwereadeaxw, I was thinking we could actually get away with doing so at the API/state layer, if we just look up the flag on the environ15:24
fwereadeaxw, if we can guarantee only good data gets into state, we don't need to worry about checking it again later15:25
fwereadenote: the obove is obviously not true15:25
fwereadebut sometimes it's not unreasonable to pretend it is15:25
axw:)15:25
axwit's actually not the end of the world if we do start the instance, so I'm okay with that15:26
axwso basically some variation of the PrecheckInstance modification I did15:26
marcoceppiI've got a bone to pick with the destroy-environment command15:26
fwereademarcoceppi, oh yes?15:27
marcoceppifwereade: I just watched someone type juju status <environment> and get annoyed that the output was something other than what the user expected15:27
marcoceppiWe're mixing user expereinces with environments and destroy-environment started this15:27
fwereademarcoceppi, ha, so the destroy-environment change trained them wrong15:27
fwereademarcoceppi, bugger15:27
natefinchdang15:27
marcoceppiyeah, I feared this, but now I have evidence15:28
fwereadecan anyone remember where that requirement originated?15:28
axwfwereade: better go to sleep before I fall asleep on the keyboard. I'll rework my stuff and repropose after the ssh proxy branch is up. Thanks for the chat again...15:29
fwereadeaxw, thank you15:29
fwereadeaxw, sleep well15:29
natefinchfwereade, marcoceppi:  it was my change that made the environment name mandatory, with -e optional, because flags shouldn't be mandatory15:29
natefinch(for destroy-environment)15:29
natefinchfwereade, marcoceppi: the name was made mandatory due to feedback from several users at canonical that said destroy environment was scary, especially if you have several environments on the same machine.  So forcing the user to type out the name of the environment is insurance against destroying the wrong one15:31
marcoceppinatefinch: I'd rather just make the -e flag manditory15:31
fwereademarcoceppi, natefinch: if it's causing active upset I think I'd come down on the side of consistency with other uses of -e there... did we do a stable release with that change in yet?15:32
marcoceppifwereade: I don't think so15:32
natefinchmarcoceppi, fwereade: yeah, in hindsight, the consistency with the rest of the commands is more important than the fact that it's weird to have a mandatory flag15:33
fwereadenatefinch, I'm worried that people will have updated to use the no-e version15:35
fwereadenatefinch, any serious drawback to just accepting both forms?15:35
marcoceppifwereade: could add a depreciated warning15:35
natefinchfwereade: we accept both now15:35
natefinchfwereade: or at least, on tip we do15:35
fwereademarcoceppi, natefinch: just swap the deprecation warning :)15:35
marcoceppifwereade natefinch should I file a bug wrt this?15:36
sinzuinatefinch, Are you still working on Bug #1271937, I thought someone else was going to be assigned15:39
_mup_Bug #1271937: Use juju-mongodb when the package is available <arm64> <ci> <mongodb> <ppc64el> <trusty> <juju-core:In Progress by natefinch> <https://launchpad.net/bugs/1271937>15:39
mgzfwereade: if I hurl up a mp of a first pass of state networks doc, can you look it over?15:42
fwereademgz, soon, on a call atm15:42
mgzI currently lack tests, and want to know what a sane base level of testing is for new state documents15:42
mgz(my template, constraints, has no unit-testy bits for just the constraints doc)15:42
dimiternanyone willing to review my fix for bug 1291400 ? https://codereview.appspot.com/77340044/15:47
_mup_Bug #1291400: migrate 1.16 agent config to 1.18 properly (DataDir, Jobs, LogDir) <regression> <upgrade-juju> <juju-core:In Progress by dimitern> <https://launchpad.net/bugs/1291400>15:47
dimiternmgz, voidspace ^^ ?15:49
dimiternnatefinch, wwitzel3 ^^ ??15:51
mgzdimitern: can probably look in a sec15:51
dimiternmgz, ta! it's not huge15:52
voidspacedimitern: he beat me to it...15:54
voidspacexchat notifications are very subtle15:54
mgzfwereade: https://codereview.appspot.com/7727004615:57
vladkdimitern: ping15:57
natefinchsinzui: about Bug #1271937, I have code that makes it work.  it should be landing this week. I'm not sure what the timeline is for people that want it16:01
_mup_Bug #1271937: Use juju-mongodb when the package is available <arm64> <ci> <mongodb> <ppc64el> <trusty> <juju-core:In Progress by natefinch> <https://launchpad.net/bugs/1271937>16:01
dimiternvoidspace, :) thanks anyway16:01
dimiternvladk, pong16:01
sinzuinatefinch, The landing will unblock several people. I will consider a 1.17.6 release when the fix is available.16:01
fwereademgz, yeah, that's pretty much what I was looking for16:03
natefinchsinzui: there's basically two ways to make it work:  one involves a fair amount of code, which is what I have, and one is a little hackier but much easier.  currently we create the upstart script on the client and send it to the bootstrap node, so it doesn't know if the bootstrap node has juju-mongodb or not.16:03
natefinchsinzui: the fix is either to create the upstart script on the bootstrap node, or just create it with the command as "mongod" and let the PATH figure out which one to use16:04
* sinzui nods16:04
natefinchsinzui: my code does the former, but the latter would be trivial to get in.  my code should be ready in a day or two, but historically I've been bad about estimating when this particular code will finish16:05
* fwereade bbs16:06
wwitzel3rogpeppe: any idea where we might get a hold of the actual hostname of a machine (to use for mongo replicaset) during bootstrap.16:08
rogpeppewwitzel3: ha ha16:08
rogpeppewwitzel3: actually...16:08
rogpeppewwitzel3: perhaps you can, these days16:08
rogpeppewwitzel3: i'm not entirely sure whether bootstrap-state now has a valid environ config now or not16:09
wwitzel3rogpeppe: ok, so the environ config is where it would be though16:10
rogpeppewwitzel3: no, but the environ config lets you get an environs.Environ which allows you to get an instance.Instance which allows you to find out the address :-)16:11
rogpeppewwitzel3: you'll also need the bootstrap machine's instance id16:11
wwitzel3rogpeppe: obviously16:11
rogpeppewwitzel3: from ... i can't quite remember where16:11
wwitzel3rogpeppe: sounds straightfoward ...16:13
dimiternwwitzel3, rogpeppe, it's provider-state16:14
rogpeppedimitern: ah yes16:14
dimiternbootstrap-state just says "storage is writable"16:15
rogpeppedimitern: i guess now that bootstrap is synchronous, there's actually no need for the bootstrap instance to query the provider-state file16:15
rogpeppedimitern: (assuming it still does)16:15
wwitzel3rogpeppe, dimitern: what does that mean, it's provider-state?16:15
rogpeppemgz: another instance package review for you: https://codereview.appspot.com/7747004316:15
rogpeppewwitzel3: there's a file in the environ's Storage that's conventionally used to store the bootstrap machine's instance id16:16
dimiternmgz, review poke ;)16:22
mgzdimitern: nearly have a gap :016:24
dimiternmgz, cheers :)16:25
wwitzel3rogpeppe: so how do you retrieve an instance if you have a given id?16:26
rogpeppewwitzel3: Environ.Instances([]instance.Id{id})16:27
rogpeppewwitzel3: godoc launchpad.net/juju-core/instance and  launchpad.net/juju-core/environs for details16:27
* dimitern is away for a while16:34
rogpeppeany reviews of this would be appreciated:  https://codereview.appspot.com/7747004316:59
=== niemeyer_ is now known as niemeyer
rogpeppevoidspace: away for a minute or two17:00
=== vladk is now known as vladk|offline
viperZ28_ it looks like Juju does not have ability to enforce runtimes only startup17:21
viperZ28_In my test I brought up a multi-node RabbitMQ cluster, I then took one of the machines out using `lxc-shutdown`,17:22
viperZ28_Juju did not try to restart the machine or spin up another one17:22
viperZ28_I was hoping Juju would sense the downed machine and make an attempt to restart it17:22
viperZ28_I am also looking for plans to integrate with vSphere/ESX stack17:22
perrito666hey fine people, please review this if you'v got the time https://codereview.appspot.com/7749004317:28
natefinchviperZ28_: you're correct, it doesn't do that currently.  At some point it probably will, we're just not there yet.17:29
viperZ28_any plans for ESX/v* integration?17:29
bodie_anyone familiar with wemux?17:29
bodie_I'm trying to set up pairing for my team and it's not being friendly17:30
natefinchviperZ28_: as far as I know there's no plans for it, but plans can change and I'm not the leader of much.  fwereade might have a better idea, but I think he's AFK for a while17:31
fwereadeviperZ28_, oddly enough we've found that most people seem to get upset when we start up downed units/machines for them -- and the python version *did* do that, and nobody noticed for months, until they tried to shut down some unused machines out-of-band and got upset when juju replaced them :/17:37
viperZ28_perhaps this should be an option17:38
voidspacerogpeppe: grabbing a drink too17:38
viperZ28_if I want a HA RabbitMQ cluster I could not use Juju for this use case17:38
wwitzel3rogpeppe: can you invite me to your hangout?17:39
fwereadeviperZ28_, I think I agree there, but I'm not sure I can promise it'd get scheduled any time soon -- to Do It Right in the general case we'd need to be able to assign the storage from the old nodes to the new ones17:39
bits3rpentis there still a bug in juju debug-log?17:39
fwereadeviperZ28_, well, you'd need monitoring and human response, at least17:39
fwereadeviperZ28_, automated response to *apparent* failure can itself be problematic17:40
bodie_anyone know what's up with the bug that's like17:40
bodie_# launchpad.net/juju-core/worker/instancepoller17:40
bodie_go/src/launchpad.net/juju-core/worker/instancepoller/aggregate.go:67: undefined: ratelimit.New17:40
bodie_?17:40
bodie_I'm getting this as output of go get on a fresh system17:40
viperZ28_seems in a cloud model or IT as a service this is a requirement, of course with added alerting and throttling17:40
natefinchbodie_: that's a new package that recently got added17:41
natefinchbodie_: go get github.com/juju/ratelimit I believe17:42
bodie_shouldn't that be pulled down automatically if it's needed?17:43
bodie_bits3rpent check this out17:43
fwereadeviperZ28_, it also enables a whole host of exciting problems -- consider a network partition in which a majority of nodes are lost to the state servers, and the state servers bring up replacements17:43
natefinchbodie_: go get -u launchpad.net/juju-core  will get it, but it'll overwrite whatever branch you're working on in juju-core17:44
viperZ28_I think this is manageable as long as a single master is controlling units running17:44
natefinchbodie_: do a go get launchpad.net/godeps   and then you'll have the godeps program, which we use to track dependencies17:44
natefinchbodie_: then from the root of juju-core, you can do godeps -u dependencies.tsv and it'll tell you if any dependencies are missing or out of date17:45
viperZ28_so is the Juju model more about orchestrating startup and less about operation?17:45
viperZ28_or should I say maintaining state and operation17:46
fwereadeviperZ28_, (also: re vsphere/esx: no current plans, but we love new substrates and would be keen to assist anyone who wanted towork on it)17:46
natefinchviperZ28_: for now, basically, yes.  I mean, for operation, you can add or remove instances, add or remove services.17:46
fwereadeviperZ28_, not necessarily -- but the correct responses at runtime are very application-spcific17:46
fwereadeviperZ28_, and hence more within the individual charms' purview17:46
viperZ28_this is true, I think this is why there is a gap in PaaS and IaaS when talking about services17:47
bodie_natefinch, I got that bit.  it looks OK now.17:47
natefinchbodie_: cool17:47
rogpeppewwitzel3: https://plus.google.com/hangouts/_/76cpjgribubncq8d4f1s1nalr0?hl=en-GB17:49
fwereadeviperZ28_, more detailed runtime orchestration is certainly possible via the API fwiw -- we're not currently focused on building more sophisticated external brains for juju, but we're definitely not opposed to them :)17:49
* fwereade puts his own supper on, bbs17:50
viperZ28_Does Juju currently have REST API?17:50
viperZ28_I saw this https://bugs.launchpad.net/juju/+bug/804284, but didn't see a resolution17:51
_mup_Bug #804284: API for managing juju environments, aka expose cli as daemon <pyjuju:Triaged> <juju-core:Fix Released by jameinel> <https://launchpad.net/bugs/804284>17:51
hatchviperZ28_ that bug is resolved17:56
viperZ28_is there any documentation for the API?17:57
=== vladk|offline is now known as vladk
hatchI don't think so, the GUI communicates via a websocket18:00
bodie_cool18:00
bodie_that appeases me18:00
natefinchviperZ28_, hatch: right, there's an API, but it's through websocket  (the CLI uses that too)18:02
fwereadeviperZ28_, er, not really :( -- the juju-gui talks to it, but I'm not sure that bit is very well abstracted out; and then there's https://launchpad.net/python-jujuclient18:02
fwereadebbiab again18:02
hatchwell, not abstracted out to the point you could put it into another project18:02
hatchthere is a feature request to do that however18:03
viperZ28_thanks all for the insight18:05
hatchviperZ28_ the GUI is open source so you could extract the commands from here https://github.com/juju/juju-gui/blob/develop/app/store/env/go.js18:09
hatchex) https://github.com/juju/juju-gui/blob/develop/app/store/env/go.js#L45418:10
bits3rpentDoes the API server in fact currently log everything as debug?18:15
bits3rpentI am trying to replicate https://bugs.launchpad.net/juju-core/+bug/117312218:15
_mup_Bug #1173122: API server should not log passwords <logging> <security> <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1173122>18:15
bits3rpenttail -f ~/.juju/local/log/unit-*.log shows no debug messages18:16
bits3rpentHas anyone replicated this bug?18:17
natefinchbits3rpent: if you bootstrap with --debug it'll output debug messages18:19
bits3rpentThank you.18:19
bodie_so many gotchas :(18:23
natefinchbodie_: is there something we can do to help?18:32
bodie_we're just figuring out the collaborative side of things right now, I'm putting a vm together for us to share that hopefully will have working versions of the code and such18:33
* rogpeppe is done for the day18:43
rogpeppeg'night all18:44
bodie_nite18:45
perrito666hey, my local copy of juju-core, obtained using go get lacks a trunk, it does has a branch master, why is that?19:04
natefinchperrito666: go get doesn't actually check out the branch, it just gets the code.  You can do a bzr branch lp:juju-core to get an actual branch19:08
perrito666natefinch: just a branch and then I can switch to trunk?19:09
natefinchperrito666: there's no real reason to be on trunk per se.  You can't commit directly to trunk anyway, and a branch of trunk is just as good as trunk as long as it's up to date19:09
perrito666natefinch: indeed, but since I was just peer programming with gz and his local had trunk I was wondering if my own branch was not from the wrong place19:11
natefinchperrito666: oh, so, that's not a real thing.  That's a branch called trunk that he keeps in sync with master19:12
natefinchperrito666: he's using cobzr, which is a way of keeping multiple branches in the same directory on disk.   It's the way git works, and it's handy for working with go.19:13
perrito666natefinch: I am cobzring too :)19:14
natefinchperrito666: the way you start it is to do bzr checkout lp:juju-core, which will grab trunk/master/tip whatever you want to call it from juju-core, then do brz switch -b trunk, and that'll make you a colocated branch called trunk that you can keep in sync with main19:14
natefinchperrito666: ahh good19:14
perrito666altough the idea to have a trunk in place is nice19:14
natefinchperrito666: yeah, it's a lot easier to just have a cobzr branch called trunk, then you can always just bzr switch trunk; bzr pull; bzr switch -b <newbranch>19:15
bodie_you guys need a bot to answer these questions :S19:15
bodie_I had the same exact problems not two days19:15
bodie_ago19:15
natefinchbodie_: how do you know I'm not a bot? :)19:16
perrito666bodie_: we could also add it to CONTRIBUTING or README I guess19:16
perrito666:p19:16
bodie_now that's just crazy talk19:16
bodie_READ the README?19:16
perrito666bodie_: for what I have seen of natefinch he is a bot that has a tiny human controlling him in fron of him19:17
perrito666s/fron/from19:17
bodie_lol19:17
bodie_pay no attention to the man behind the curtain...19:18
bodie_or, maybe it's more like the men in black aliens that pilot a humanoid robot19:18
natefinchbodie_: he means my 9 month old daughter who sits on my lap for our morning standups because she always wakes up at 6am19:19
natefinch(or earlier)19:19
bodie_I can so relate!19:20
bodie_the tiny masters are powerful...19:20
natefinchyep19:21
perrito666natefinch: tx, I have my repo up and running19:27
perrito666out of the box tests explode right?19:35
natefinchperrito666: uh.... not if your environment is set up correctly.  The main thing is that you need mongo with SSL installed in /usr/bin  (note that apt-get does not install one with SSL capability)19:37
natefinchperrito666: also you currently need to *not* have mongod at /usr/lib/juju/bin/mongod19:37
perrito666duh, I had run the install dependencies step on another vm19:39
perrito666natefinch: thanks again19:39
natefinchperrito666: welcome19:41
perrito666curiosity, tests also fail if bzr name is not set19:45
natefinchperrito666: yeah that should really be fixed, but since you'll almost certainly have one to work on juju, it's usually not a huge deal19:49
thumpermorning19:56
* thumper peruses the email for urgent items19:57
bodie_howdy19:58
=== vladk is now known as vladk|offline
perrito666one more, I am getting coding errors from lxc.go, something there that I am missing right?20:06
* perrito666 runs updates for go lxc20:11
waiganithumper: https://codereview.appspot.com/76670043/, https://codereview.appspot.com/73390043/ (added tests for auto-restart) (oh and good morning)20:13
thumpermorning20:13
thumperperrito666: what sort of errors?20:13
* thumper looks at his calendar20:16
thumpernatefinch: ping20:18
natefinchthumper: yo20:22
thumperhi natefinch20:22
thumperthe juju-mongodb package work, is that progressing?20:22
thumperor shall I take it off you?20:22
natefinchwayne and I are finishing it up. Currently works except for the local provider for some reason20:23
thumperI'm also curious as to the actual other reasons it broke things20:23
thumpernatefinch: want me to look at it?20:23
natefinchthumper: sure, help would be appreciated. the branch is lp:~natefinch/juju-core/030-MA-HA20:24
* thumper grabs it20:24
natefinchthumper: the reason it broke things is because we were creating the upstart script for mongo on the client, and using the existence of /usr/lib/juju/bin/mongod on the client to determine the path of mongod to specify in the upstart script that gets created on the server20:25
thumperah20:25
natefinchhow that came about was that I landed half the changes in a branch, and so it had the changes to figuring out mongod, but not the changes to creating the upstart script on the server20:26
* thumper nods20:26
natefinchs/creating/create/20:26
natefinchthumper: also, destroy environment local isn't cleaning up the new upstart script yet, so you may need to do a stop juju-db-v2 between bootstraps, or it'll complain the mongo port is in use20:30
thumperany particular reason for changing the upstart script name?20:31
natefinchthumper: poor man's version control20:32
natefinchso we can know if we need to remove the old version and install the new version20:32
thumpernatefinch: what is the purpose of all the agent config changes?20:35
thumperseems somewhat unrelated to just the mongo package20:35
natefinchthumper: so the branch is really for HA support, so that's code the machine agent runs to call EnsureMongoServer when it notices it's now supposed to be an EnvironManager20:36
perrito666thumper: I had an outdated version of golxc20:36
thumperperrito666: ack20:36
thumpernatefinch: hmm...20:36
natefinchthumper: we could probably factor out just the code that calls ensure mongo server during bootstrap, but it would kind of be a pain20:38
natefinchthumper: the other option is a temporary hack to change the upstart script to have the command it runs be "mongod"  and then if /usr/lib/juju/mongod is the first mongod in your path, bam, it works.20:39
thumperI'm very concerned that we have tied a dependent piece for something I need right now into HA which is still coming20:39
natefinchthumper: there's not much actual HA stuff here.  it can land on its own without the rest of HA.20:40
natefinchwe didn't know we needed it right now until a few days ago, from my understanding, so we didn't worry too much about it as long as it wasn't breaking things.20:41
thumperyeah... I didn't know it was breaking things either20:43
natefinchWell, so it was breaking things, and then martin made a patch to revert it to the previous behavior, and then from what I hear, some people with a lot of money decided they wanted it to work sooner rather than later.20:43
natefinchthough this is all third hand, so I may be misunderstanding various bits.20:44
thumpernatefinch: how would you feel if I created a branch that pulled bits out of your branch and just did the package change thing?20:45
natefinchthumper: I'd be happy it was you and not me.20:45
thumperhaha20:46
thumpernatefinch: I'm pretty sure I know what I need to do...20:46
thumperish20:46
natefinchI think all you really need to do is take the code from agent/bootstrap.go and have it call EnsureMongoServer.  We've tweaked ensure mongo server to do some replicaset stuff, but that should be easy to see and ignore20:46
thumperI was thinking a bit simpler than that :-)20:47
natefinchwhat's your plan?20:48
* thumper is still reading the diff20:48
natefinchvery little of the diff on that branch is applicable20:49
natefinchthe only thing that really matters is the call to ensuremongoserver in agent/bootstrap.go and making sure agent/mongo/mongo.go is doing the right thing to figure out the mongo path20:49
natefinchcome to think of it, that's not really hard at all to pull out20:50
thumperso... the key bit is that you are moving the creation of the mongo upstart script to the machine agent?20:50
natefinchso, yes and no.  That part is actually only needed for HA.  If you only have one bootstrap node, you can just toss EnsureMongoServer in agent/bootstrap.go20:50
natefinchand remove the code that creates the upstart script on the client20:50
thumperwell... actually the bare minimum I need to do is to update cloudinit :-)20:52
thumperand fix the path of the import20:52
natefinchYou mean before we send it to the server?  Isn't that going to hit the same problem, where we don't know where mongod will exist on the server?20:53
thumpernatefinch: oh... now I get it20:55
thumpernatefinch: as the simplest thing that can work now, how about this:20:59
thumpernatefinch: we update the mongo upstart script to add the location of the juju-mongodb mongodb exec to the path, and don't specify the full path for mongodb ?21:01
thumperthat way if we have juju-mongodb installed, we pick up the right mongodb21:01
natefinchthumper: yeah, that was my hack to get it done ASAP in a way that's not awful21:01
thumperI think that is the best thing to get what we need *right now*21:01
thumperthat way I'm not blocked on you21:02
* thumper was surprised to see that the mongo upstart script location had moved in trunk21:02
thumperhadn't noticed that move21:02
* thumper hacks around a bit21:03
thumpernatefinch: your branch didn't install the juju-mongodb package21:04
natefinchthumper: nope21:04
thumperok21:04
natefinchok, I gotta run.  Email me if you need anything, I'll keep an eye on it.21:05
natefinchbtw, the mongo upstart script moving was part of my half-feature commit that broke things :/21:05
thumperah bollocks21:26
jamespagethumper, it does "juju-mongodb | mongodb-server"21:27
thumperah21:27
thumpercan we change that?21:27
jamespagewe can21:27
thumperjamespage: I'm thinking that for the local provider on trusty, we always use mongodb-server21:27
thumpereither that, or I need to check21:27
jamespagethumper, can't21:27
jamespagethumper, mongodb-server is not mir'able21:28
jamespagejuju-mongodb is21:28
thumpersorry, typed the wrong thing...21:28
jamespagephew21:28
thumperwhat I meant to say was:21:28
thumperon trusty, I want to have the local provider use juju-mongodb21:28
thumperso we just have one mongo thing for trusty juju\21:28
thumperso I don't have to see what you hvae installed21:29
jamespagethumper, so mongodb-server would not be supported21:29
jamespagethat's fine21:29
thumperumm...21:29
thumperperhaps as of 1.17.6 we make the local provider use juju-mongodb21:29
thumperon trusty21:29
thumperdoes that sound reasonable?21:29
thumperjamespage: I'm trying to get a minimal patch in for juju so that it will work with power and not screw up the ha stuff too much21:30
thumpereffectively I want to do a switch internally that says "if trusty use juju-mongodb, otherwise use mongodb-server"21:30
thumperand deal with other operating systems as we get them21:30
jamespagethumper, that would apply to all providers right?21:30
thumperright21:30
jamespagethumper, not just local21:30
thumperright21:30
jamespageOK - that's fine21:30
jamespagethumper, if >= trusty :-)21:31
thumperwe have juju-mongodb for trusty everywhere right?21:31
thumperright21:31
jamespagethumper, yes21:31
thumperok... that is my plan then21:31
jamespage+121:31
jamespagethumper, I'll line up the juju-mongodb change when 1.17.6 releases21:31
thumperawesome...21:32
thumperjamespage: also...21:32
thumperjamespage: I have a plugin coming 'juju-local' that we should include in the juju-local package21:32
bodie_worth noting that trusty installs juju-mongodb to /usr/lib/juju/bin and juju looks for it in /usr/bin21:32
thumperbut it has nothing in it yet21:32
thumperI'll keep you in the loop21:32
jamespagethumper, ok21:32
thumperbodie_: ack, this will be part of the change21:32
bodie_hooray21:33
bodie_does that mean I don't have to wipe my workstation and reinstall with 12.04?  *sigh*21:33
thumperbodie_: you can if you like21:33
bodie_I've just been setting up a remote dev box today in the hopes it'll get resolved soon on trusty21:33
bodie_as much as i love reinstalling my pc...21:34
* thumper dev machine is trusty21:34
thumperit is also my day to day machine21:34
bodie_same here21:34
bodie_I just keep getting one thing after another21:34
bodie_moved the mongod binary to /usr/bin, now some other thing is broken21:34
thumperdon't do that21:35
thumper:)21:35
bits3rpentHello all, I am working on the bug stating that juju in debug mode stores passwords of logins etc.21:45
bits3rpentI will be fixing the issue (most likely) a configurable switch21:45
bits3rpenti.e juju bootstrap --debug --show-passwords (Default is false)21:46
jcw4this bug right?  https://bugs.launchpad.net/juju-core/+bug/120268221:46
bits3rpentWould everyone prefer the whole log is dropped, or just that the password is parsed out.21:46
_mup_Bug #1202682: debug-log doesn't work with lxc provider <cts-cloud-review> <debug-log> <local-provider> <papercut> <ssh> <ui> <juju-core:In Progress by dimitern> <https://launchpad.net/bugs/1202682>21:46
bits3rpenthttps://bugs.launchpad.net/juju-core/+bug/117312221:46
_mup_Bug #1173122: API server should not log passwords <logging> <security> <tech-debt> <juju-core:Triaged> <https://launchpad.net/bugs/1173122>21:46
jcw4oops thanks bits3rpent21:46
bits3rpentI wanted to keep it as a switch just in case someone wanted it, but do most of you not want any possibility of passwords being logged (via very specific switch)?21:48
bits3rpentjcw4 no problem21:48
bits3rpentAlso I was wondering if all of you would rather have the whole log output dropped or just the password parsed out.21:48
thumperbits3rpent: how do you propose to parse the output?22:03
bits3rpentthumper: check for ,"Password":*", and replace with empty string22:06
bits3rpentcheck result of jsoncodec.DumpRequest(hdr,body) to be specific22:07
thumperwallyworld_: I have a few errands in town, back later22:28
wallyworld_ok22:28
thumperwallyworld_: lbox is still working out the diff for my branch22:28
wallyworld_of course it is22:28
thumperhttps://code.launchpad.net/~thumper/juju-core/juju-mongodb/+merge/21164222:28
wallyworld_will look22:28
thumpernot tested on power yet, will check that later...22:28
* thumper thinks22:28
wallyworld_hopefully rt will be done soon too22:28
thumpermight have time now22:28
* wallyworld_ reboots to apply updates22:29
thumperwallyworld_: power still seems to have issues, will chase more later22:33
wallyworld_ok, what issues?22:33
thumpernot starting issues22:40
=== thumper is now known as thumper-afk
wallyworld_thumper: i think nate is doing some work in the area of EnsureMongoServer etc22:40
thumper-afkyes I know22:40
thumper-afkI've taken a minimal approach22:40
thumper-afkhis work wasn't yet installing juju-mongodb22:40
thumper-afkand was tied up with HA stuff22:40
wallyworld_ok, so no issues landing yours then22:41
thumper-afknope22:41
=== Ursinha is now known as Ursinha-afk
=== Ursinha-afk is now known as Ursinha
davecheneysinzui: lost you23:11
davecheneyi think we're done23:11
davecheneyno need to reconnect23:11
bodie_http://paste.ubuntu.com/7117018/ ....23:47
bodie_this is on a totally clean 13.10 install... did make install-dependencies and go get -u dependencies.tsv23:48
bodie_any input welcome23:48
davecheneyi'd guess the ssh command exited early23:48
bodie_so maybe just a fluke?23:56
davecheneybodie_: hope so23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!