/srv/irclogs.ubuntu.com/2014/04/01/#juju-dev.txt

davecheneysinzui: ping00:24
waiganithumper: you about?00:34
thumperya00:34
waiganihttp://pastebin.ubuntu.com/7187528/00:35
waiganithe test passed for me00:35
waiganijust ran it locally, not ppc obviously00:35
davecheneywallyworld_: which gccgo ?00:36
waiganibut i thought you said that just using gccgo would cause it to fail00:36
davecheneysorry00:36
davecheneywaigani:00:36
waiganidavecheney: gcc version 4.9.0 2014033000:36
davecheneywaigani: your ppc details are incoming00:36
thumperwaigani: now we need to get you set up on the ppc machine00:36
waiganiwallyworld_: I'm stealing your identity ;)00:36
thumperwaigani: your login has been setup...00:36
wallyworld_nothing worth stealing really00:36
thumperwaigani: I can add you as an ssh user to my vm00:36
davecheneythumper: waigani got a new vm for waigani00:37
thumperdavecheney: already?00:37
waiganithumper: okay. Didn't you say it failed for you on your local machine?00:37
thumperyeah...00:37
waiganidavecheney: nice :)00:37
thumperwaigani: run the entire package00:37
davecheneywaigani: what lp is this again ?00:38
waiganithumper: all pass00:38
thumperhmm...00:38
thumperwaigani: definitely need to get you running that on power00:38
waiganidavecheney: https://bugs.launchpad.net/juju-core/+bug/130003200:38
_mup_Bug #1300032: charm: gccgo test failure <gccgo> <ppc64el> <juju-core:Triaged> <https://launchpad.net/bugs/1300032>00:38
thumperdavecheney: what is that line to import ssh keys from lp?00:38
davecheneywaigani: yeah that will pass on your local macine00:38
davecheneydisconnect from your network00:38
waiganiah00:39
davecheneyor export http_proxy="www.microsoft.com"00:39
davecheneyor something00:39
davecheneythumper: ssh-copy-id00:39
davecheneyssh-import-id00:39
davecheneyi forget00:39
davecheneyi think the latter00:39
davecheneyssh-import-id $LAUNCHPAD00:39
thumperkk00:39
davecheneywaigani: your machine is winton-0900:40
davecheneyinstructions are here -> https://docs.google.com/a/canonical.com/document/d/1m9R2n6LPLNLGjdopcNkQYVG8D5V4FTyvc1vvn-9ZifM/edit00:40
davecheney11:40 < davecheney> waigani: your machine is winton-0900:44
davecheney11:40 < davecheney> instructions are here -> https://docs.google.com/a/canonical.com/document/d/1m9R2n6LPLNLGjdopcNkQYVG8D5V4FTyvc1vvn-9ZifM/edit00:44
waiganidavecheney: cheers. I've got a screen full of errors now :) yay00:44
Valduarehows this coming https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-arm-service-orchestration00:49
Valduareand could i use devices such as http://www.amazon.com/Rikomagic-Android-Cortex-A9-External-Miracast/dp/B00GPJLVQW00:49
davecheneyValduare: wrong channel made00:51
davecheneymate00:51
davecheneysorry00:51
Valduarethis is where the developers of juju are?00:52
Valduarethe guys who are implementing juju for arm or is there a #juju-arm channel00:52
davecheneyValduare: we write juju00:52
davecheneywe don't know anything about ubuntu on arm00:52
davecheneyspecfically00:52
davecheneytry #server00:52
davecheneyor #ubuntu00:53
Valduareok00:53
davecheneyValduare: sorry, i can't really tell you who to talk to, only that we're not the right people00:54
Valduaresomeone here has to be interested in testing juju on arm?00:55
Valduaredoesnt make sense there wouldnt lol00:55
thumperValduare: there is...00:59
thumperValduare: mwhudson looks at arm of some form00:59
thumperValduare: depends what you are wanting to know00:59
thumperaxw: hey, here on time?00:59
axwthumper: yo, I am in fact00:59
thumpercool00:59
Valduarethumper: im interested in some suggestions for arm servers that will be supported well01:00
Valduarei only have experience with mk808 style hdmi stick devices heh01:00
waiganihmm... I'm getting: ssh_exchange_identification: Connection closed by remote host01:06
davecheneywaigani: add a -vv on there01:15
axwthumper: sorry, closed wrong tab01:20
waiganidavecheney: emailed you output01:21
davecheneywaigani: something between you an batuan is blocking port 2201:22
davecheneywaigani: is tim using the internet again01:23
waiganiheh01:23
davecheney    c.Assert(a, gc.DeepEquals, []string{"amd64"})01:34
davecheney... obtained []string = []string{"i386", "amd64"}01:34
davecheney... expected []string = []string{"amd64"}01:34
davecheneyOOPS: 81 passed, 1 FAILED01:34
davecheney--- FAIL: TestMAAS (11.60 seconds)01:34
davecheneyFAIL01:34
davecheneyFAIL    launchpad.net/juju-core/provider/maas   11.699s01:34
davecheneyffs01:34
mwhudsonValduare: there is still (!) no really compelling arm server product01:35
davecheneymwhudson: highbank ?01:35
mwhudsondavecheney: calxeda went bust01:35
mwhudsonso if you have one, sure01:35
mwhudsonbut you can't get any more...01:35
Valduaremwhudson: though not a lot of ram ie 2 gigs each, these mk902 devices look pretty neat01:35
davecheneyValduare: when the ubuntu server team look at those arm boards01:36
davecheneythe lack of an onboard LOM or IPMI controllre01:36
davecheneypretty much knock them out of contention01:36
mwhudsonValduare: just check that the ethernet isn't some usb2 rubbish01:36
mwhudsonyes, and that01:36
Valduareah01:36
ValduareI was talking to the linux-sunxi guys about a u-boot that could pause and wait for the kernel over network01:36
davecheneyValduare: sure01:37
davecheneybut there is a difference between being able to do that in software01:37
davecheneyand being able to do it in hardware01:37
davecheneyand it's that distinction that is what draws the line between consumer grade and server grade01:37
davecheneyat least in my mind01:37
Valduareaye01:37
mwhudsonif you want to solder things and play around and have fun, then yes, go for it01:38
mwhudsonbut it's not something you put in a data centre01:38
Valduarei dream of running my small DC on solar one day lol01:38
davecheneymwhudson: except in our data center :)01:38
davecheneyi've heard that is *exactly* how the lp arm builders work :P01:38
mwhudsondavecheney: not any more, we have some highbanks now :-)01:38
mwhudsonlucky we got them in time01:38
* davecheney doffs hat01:38
mwhudsonbut yes, we did have panda boards in our dc01:38
mwhudsonis _really_ hated them01:39
davecheneymwhudson: yeah01:39
davecheneymwhudson: i love my panda01:39
davecheneyi've never had a more reliable builder01:39
Valduarewhat do you think of panda board vs mk902 type device01:39
mwhudsonalthough probably not as much as some of the strange things we had before01:39
davecheneyValduare: I don't have much experience with mk902s01:39
mwhudsonValduare: panda is better supported for running ubuntu-type distros on i think01:39
davecheneyi've used the A20's from cubie01:39
davecheneyimx6's01:40
davecheneyTi's01:40
davecheneyand the exegons01:40
davecheneywhatever01:40
davecheneystupid name01:40
davecheney-1 for marketing a product that nobody can spell01:40
Valduarelol01:40
Valduarethen i was looking at these little beasts http://www.ebay.com/itm/FREE-SHIP-Supermicro-A1SAM-2750F-O-Intel-Atom-C2750-DDR3-SATA3-V-4GbE-/191091952279?pt=LH_DefaultDomain_0&hash=item2c7df7ca9701:40
Valduare8 core atom - 64 gigs ecc ram01:40
Valduarenot enough money in the world hwen your buying for yourself heh01:42
Valduareon your icydocks what kind of drives are you running in them01:48
davecheneyValduare: i appreciate you really want to talk about arm01:48
davecheneybut this isn't the channel01:48
Valduareaye -01:49
thumperwallyworld_: hangout?02:30
wallyworld_sec02:30
thumperwallyworld_: https://plus.google.com/hangouts/_/76cpj3ag8c2517af97k8drl72c?hl=en when you are ready02:31
waiganithumper: I'm back02:42
thumperwallyworld_: https://plus.google.com/hangouts/_/7acpj3620q4qsuh0smb7157iqg?hl=en02:46
thumpernope02:46
thumperwaigani: https://plus.google.com/hangouts/_/7acpj3620q4qsuh0smb7157iqg?hl=en02:46
thumperwallyworld_: sorry02:46
wallyworld_np02:46
waiganithumper: packages are all installed now03:03
thumperwaigani: oh, good03:03
waiganidavecheney: I'm in! But ... trying to install golang, it has unmet dependencies which can't be installed03:12
davecheneywaigani: paste ?03:15
waiganidavecheney: http://pastebin.ubuntu.com/7187924/03:15
davecheneywaigani: where did you get those instructions ?03:18
davecheneywaigani: instructions are here -> https://docs.google.com/a/canonical.com/document/d/1m9R2n6LPLNLGjdopcNkQYVG8D5V4FTyvc1vvn-9ZifM/edit03:20
davecheneywaigani: thumper mwhudson http://paste.ubuntu.com/7187946/03:25
davecheneycurrent state on ppc6403:25
* thumper looks03:39
thumperwow, joyent tests suck03:39
davecheneythumper: is that why they pass ?03:41
davecheneyor the whole, 90% chance of timing out03:41
thumperdavecheney: I was just looking at the time03:41
waiganidavecheney: what am I missing? Can't install go on ppcvm: http://pastebin.ubuntu.com/7188020/03:56
wallyworld_thumper: yeah, i never got to fix the tests run time03:59
wallyworld_didn't look into it03:59
waiganialso, testing bug 1300032 locally, gccgo without network, I get a pile of linker errors: http://paste.ubuntu.com/7187960/04:00
_mup_Bug #1300032: charm: gccgo test failure <gccgo> <ppc64el> <juju-core:Triaged> <https://launchpad.net/bugs/1300032>04:00
waiganiI rebuilt pkg, updated and upgraded via apt-get - still get the same errors04:01
waiganithumper: ^04:01
thumperwallyworld_: ok, we can put it on the TODO list04:01
davecheneywaigani: where did you read those instructions ?04:02
thumperwaigani: hmm... I don't know04:02
davecheneywaigani: lets fix one problem at a time04:03
waiganidavecheney: trying to follow yours, go get ..., no go, so trying to install go04:03
davecheneywaigani: can you please show me where in the instructions that it it says to do the line that you are having trouble with04:03
waigani$ go get -v launchpad.net/juju-core/…04:03
davecheneywaigani: which document04:03
waiganidavecheney: the one you sent me: https://docs.google.com/a/canonical.com/document/d/1m9R2n6LPLNLGjdopcNkQYVG8D5V4FTyvc1vvn-9ZifM/edit#04:04
davecheneywhat does the line directly preceeding that one say ?04:04
waigani$ sudo apt-get install gccgo-4.9 gccgo-go bzr git04:05
davecheneydid that command work ?04:05
waiganidavecheney: nop04:06
davecheneyok, so lets fix that one04:06
davecheneythen following commands might work04:06
waiganiokay04:06
davecheneywaigani: http://pastebin.ubuntu.com/7188020/04:06
davecheney^ this paste does not match the command you said you entered04:07
davecheneycan you check please04:07
waiganidavecheney: that was my attempt to install go04:08
waiganidavecheney: http://pastebin.ubuntu.com/7188045/04:08
davecheneyok, so those are all installed04:08
davecheneyapt is complaing because a prevoius installation failed04:09
davecheneywhat happens if you follow its advice ?04:09
davecheneyit'll probably tell you to uninstall something, probably the 'golang' meta package04:09
waiganiapt-get -f install..04:09
waiganiyep removed04:10
davecheneyyou should be good to go04:10
waiganiyep, reran install and I've got go. Thanks04:12
davecheneycool04:13
davecheney/usr/bin/go is probably provided by an alternative04:14
davecheneyso it won't be present til the post install of gccgo-go runs04:14
davecheneyand that doesn't run if there are apt errors04:14
* thumper taps fingers waiting for lbox04:38
* davecheney plays a few hands of solitare04:40
thumper for someone... simple test tweak https://codereview.appspot.com/8294004404:41
davecheneythumper: you need a defer to close that listenre04:43
davecheneywell, need is a bit strong04:43
davecheneymaybe should04:43
=== vladk|offline is now known as vladk
davecheneyprotip: if you've been running juju tests all day, check /tmp06:07
=== vladk is now known as vladk|offline
rogpeppemornin' all07:22
axwmorning rogpeppe07:30
rogpeppeaxw: hiya07:30
axwrogpeppe: I have an LGTM from fwereade on the fixes to parallel open, did you want to take a look before I land?07:31
rogpeppeaxw: just looking07:31
axwfwereade: no rush, just checking: did you see my email about InstanceDistributor?07:33
rogpeppeaxw: TestDialWebsocketStopped looks a little dubious to me07:36
rogpeppeaxw: doesn't it run the risk of panicking?07:36
axwrogpeppe: I don't see how, can you please expand?07:37
rogpeppeaxw: you're passing websocket.Config into newWebsocketDialler07:38
rogpeppeaxw: s/passing/passing a nil/07:38
rogpeppeaxw: istm that you're only lucky that it doesn't get into websocket.DialConfig before it receives the stop notification07:39
axwrogpeppe: no luck involved, it's intentional that it should not use the config if the channel is stopped. but I can pass in a non-nil config if you feel strongly07:40
rogpeppeaxw: ah, of course, you close the channel before calling the function.07:41
rogpeppeaxw: doh! sorry, ignore me07:41
axwrogpeppe: no worries :)07:41
rogpeppeaxw: LGM07:42
rogpeppeaxw: LGTM even :-)07:42
axwcheers07:42
fwereadeaxw, not yet07:43
axwrogpeppe: what's wrong if "else if"?07:43
axwfwereade: okey dokey07:43
rogpeppeaxw: it makes me look to see if there's some reason that the if is necessary07:44
rogpeppeaxw: s/if is/else is/07:45
rogpeppeaxw: the only reason that i can see that it's necessary here is to save a line, but i don't think that's a great reason07:45
axwrogpeppe: ok. I tend to do it not so much to save lines, but to group related comparisons07:46
axwrelated tests07:46
axwwhatever07:46
rogpeppeaxw: yeah, fair enough. i guess whereever i see an else after a break or return, i wonder if there's been a mistake07:48
rogpeppeaxw: but if you feel strongly about it, keep it07:48
axwnot particularly :)07:48
=== vladk|offline is now known as vladk
vladkgood morning08:13
axwmorning vladk08:16
dimiternmorning all08:21
axwmorning dimitern08:22
axwrogpeppe: isn't "HA: agent cache current API addresses" (i.e. with a worker) pointless if we keep provider-state up-to-date in storage?08:26
rogpeppeaxw: only if the agent can get access to provider-state08:27
rogpeppeaxw: (which it can't currently)08:27
axwah right08:27
mattywrogpeppe, fwereade when you both get a moment can you take another look at https://codereview.appspot.com/75600044/. fwereade: It's changed since you LGTMed it08:28
rogpeppemattyw: will do08:28
axwrogpeppe: https://codereview.appspot.com/83050045 - jujud generates shared secret & calls SetStateServingInfo08:30
rogpeppeaxw: brill, looking08:31
rogpeppeaxw: voidspace is shortly to propose a CL which adds a SetStateServingInfo to agent config.08:33
rogpeppeaxw: (and a StateServingInfo getter too)08:33
axwah ok08:34
rogpeppeaxw: but actually, that should merge ok with your branch08:34
rogpeppeaxw: isn't the "between 6 and 1024 chars and base64" stipulation funny?08:35
axwrogpeppe: it is a bit, not sure what the deal is there08:37
axwrogpeppe: it's not clear on whether it's inclusive/exclusive either, but mongo doesn't complain with 1024 at least08:38
rogpeppeaxw: good08:38
rogpeppeaxw: 1024 seems a bit like overkill though08:38
rogpeppeaxw: especially as the randomness won't compress and cloudinit files are limited in size08:39
rogpeppeaxw: although... it actually never goes in a cloudinit file, does it?08:39
rogpeppeaxw: so it probably makes no odds08:39
axwrogpeppe: right, it doesn't. it only goes to disk and mongo08:40
rogpeppeaxw: i'm just looking at MongoUpstartService. I *think* that's never used to generate an upstart conf that goes across the network. does that seem right to you?08:41
rogpeppeaxw: in which case filepath would be more appropriate than path, but then again, this is *upstart*, so path will be fine in fact.08:42
axwrogpeppe: MongoUpstartService is used inside environs/cloudinit08:42
axwfor how long I don't know08:42
rogpeppeaxw: that needs to go away though08:42
axwI assume once this is all done, we'll generate the mongo upstart service in the agent08:43
axwsure08:43
rogpeppeaxw: when EnsureMongoService is called by jujud08:43
rogpeppeaxw: yeah, there's a long-standing CL that will do that08:43
jam1axw, thumper: hopefully I requeued the right branches to land. I had to do some bot surgery to get 1.18 available, and I noticed we were out-of-disk-space, which is probably why you were resubmitting them earlier.08:44
axwjam1: thanks, sorry if I was interfering08:45
jam1axw: I didn't do my normal safety checks to see if it was running anything and grab the fslock, but hopefully I didn't break anything too badly.08:46
=== axw is now known as axw-afk
voidspacemorning all08:50
foiegrasg'morning08:50
rogpeppevoidspace: hiya09:23
=== axw-afk is now known as axw
* fwereade will be a few mins late to the meeting to allow the nearby hoovering to complete09:44
fwereadedon't wait for me09:44
mgzfwereade: it's an hour later09:44
fwereadeso much the better then :)09:45
rogpeppevoidspace: https://code.launchpad.net/~axwalk/juju-core/jujud-bootstrap-mongo-sharedsecret/+merge/21361009:46
jamfwereade: that's a lot of hoovering :009:50
fwereadehaha09:50
voidspacerogpeppe: I'm not muted09:50
voidspacerogpeppe: I can hear09:50
rogpeppevoidspace: hmm, you just went ultra-quiet09:51
jamwwitzel3: I'm just grabbing a coffee, then I'll be in our 1:1 hangout09:58
perrito666good morning09:59
wwitzel3jam: sounds good09:59
jamgood morning perrito66610:01
natefinchmorning all10:09
wwitzel3morning natefinch10:11
voidspacenatefinch: morning10:14
voidspacewwitzel3: morning10:14
wwitzel3voidspace: morning10:15
rogpeppe1voidspace: environs/cloudinit/cloudinit.go10:24
voidspacerogpeppe1: ~mfoord/juju-core/stateservinginfo10:29
voidspaceso running tests is pooing in my tmp directory10:39
wallyworld_fwereade: will you have a moment after the standup to discuss SetPrivate/PublicAddress?10:40
jamaxw: re: https://code.launchpad.net/~axwalk/juju-core/jujud-bootstrap-mongo-sharedsecret/+merge/21361010:40
jamaxw: what happens if you pass --keyFile when we don't use replSet, especially on a Mongo that was initialized differently ?10:41
fwereadewallyworld_, ofc10:46
axwjam: I tested with the local provider, it just worked10:58
axwjam: I created another card to create the keyfile on upgrade10:58
jamaxw: thx. I think the idea is that EnsureMongoServer code (that hasn't landed yet) is intended to "make the state consistent"10:59
jamwhich would be writing that file10:59
jamand rewriting the Upstart file10:59
axwmakes sense11:00
axwI will update the card to reflect that11:00
natefinchvoidspace: about the tmp directory. That can happen if you kill the tests.  In theory it shouldn't ever happen if you don't kill the tests.  The problem with killing them is that deferred statements don't happen if the application dies, and that's how we do all our cleanup.11:03
natefinch(note the "in theory" ... we seem to leak stuff in tmp occasionally on the bot, which shouldn't be killing anything)11:04
jamperrito666: I think someone changed canonical admin, because I just got emails for 5 holiday requests from you. Approving them now.11:06
perrito666jam: sarah did11:06
perrito666jam: I was under the wrong person11:06
voidspacenatefinch: right, thanks11:07
hazmatfwereade, post call.. ran into a strange bug around proper garbage collection of machines in status ... seems to be consistent around the 150 machine point..  https://bugs.launchpad.net/juju-core/+bug/1299584 .. was curious if you might be able to identify src location so i could poke at a  bit more.11:14
_mup_Bug #1299584: dead machines stuck in status <destroy-machine> <juju-core:Triaged> <https://launchpad.net/bugs/1299584>11:14
fwereadehazmat, that sounds like a provisioner bug, but I can't see why it only shows up after a while11:16
fwereadehazmat, the provisioner is responsible for the last step of machine cleanup -- the cleanup actually removes other stuff, and leaves the machines dead for the provisioner11:17
hazmatfwereade, ic, thanks11:17
hazmatrogpeppe1, which tool is that?11:19
hazmatrogpeppe1, re deps and go get11:20
rogpeppe1hazmat: https://github.com/tools/godep11:20
rogpeppe1hazmat: but we should go the api stabilisation route too11:21
wwitzel3rogpeppe1, natefinch: https://codereview.appspot.com/83150043 IsMaster API review11:34
rogpeppe1wwitzel3: will take a look after the meeting11:35
wwitzel3rogpeppe1: yep, thanks11:35
wallyworldfwereade: who is the relevant landscape guy?11:42
perrito666wwitzel3: just a personal opinion, I would like a less pythonic way to mock SeectPeerAddress :) but it its completely personal and with no justification11:44
wwitzel3perrito666: comment on the review with an example and I'd be happy to consider it11:46
rogpeppe1voidspace: shall we move into another hangout?11:50
voidspacerogpeppe1: sure11:51
voidspacerogpeppe1: ah, wrapping up11:51
rogpeppe1voidspace: or... we could stay, yeah11:51
perrito666wwitzel3: done, I am not sure if mine is better :) It could actually be worse11:53
perrito666local coffee substitute beverage time, brb11:57
rogpeppe1wwitzel3: you have a review12:00
rogpeppe1perrito666: i made an alternative suggestion12:00
perrito666rogpeppe1: I dont fully understand your suggestion (although I sense is better than mine)12:12
=== psivaa is now known as psivaa-lunch
voidspacerogpeppe1: I'm going on lunch - if you produce a branch that fixes the config flow, or some test code to generate config files, can you email me the details please12:28
bodie_epic - http://0value.com/my-Go-centric-Vim-setup12:38
rogpeppe1bodie_: see also http://blog.gopheracademy.com/vimgo-development-environment12:41
perrito666rogpeppe1: I definitely need to read that in depth12:42
rogpeppe1it's not surprising i've got problems with hangouts. my internet speed is currently terrible. (0.74/0.18 Mbps)12:44
perrito666rogpeppe1: measured how?12:45
sinzuijam, I think you just beat me to make an MP to merge 1.17.7 into 1.1812:46
rogpeppe1perrito666: speedtest.net (usually fairly reliable)12:46
perrito666rogpeppe1: 15/1.2 :| I did not see that coming, being in the internet equivalent to congo12:49
rogpeppe1perrito666: that's better than i usually get12:49
rogpeppe1perrito666: but your effective speed will depend on routers out of your country too12:50
perrito666well I do live in a neighborhood where internet is only used by me during work hours12:50
mgzI'm pretty sure the internet equivalent of the congo is the congo12:50
perrito666mgz: well, I dont know, our topology is rather shameful :p but you might be right there jaja (the most used example outside is argentina)12:51
perrito666mgz: the issue here is that I live on the country usually used as bad example12:51
perrito666sinzui: good morning, dont hate me, did you see my email? :)12:52
sinzuiNot yet12:52
rogpeppe1mgz: lol12:52
bodie_rogpeppe1, very nice :) I'm still using Sublime mostly because I'm lazy.12:56
bodie_the gosublime package is pretty handy.  a little bloaty, perhaps.12:57
rogpeppe1bodie_: i'm an outlier when it comes to editor usage :-)12:57
bodie_it's lonely at the top ;)12:58
natefinchbodie_: yeah, I use sublime because I like having mouse support and rational hotkeys.  Gosublime does have a lot of stuff I don't need.12:58
rogpeppe1bodie_: i did use vi once upon a time though12:59
bodie_I'm really comfortable with vi; so, "vintage mode" in sublime is great! ;)12:59
rogpeppe1i wrote a vi-mode command line editor once13:00
TheMuenatefinch: I left ST3 now and moved back to the good old vim13:00
bodie_fun13:00
bodie_I'm slowly transitioning off my training wheels, but for now it helps to be able to click around and see the filetree at a glance13:01
jamsinzui: :). I'm still sorting out the bot, but it should be good now.13:01
jamI believe Ian wants to get the joyent stuff into a 1.17.8 release.13:01
sinzuithank you jam. I saw that in the log. We will see if I configured the joyent env properly for testing13:02
dimiternmgz, jam, fwereade, https://codereview.appspot.com/83200043 - provisioner starting machines with networks specified13:05
dimiternmgz, poke re status of that getnetworkslist branches?13:06
mgzdimitern: I'll get it landed now-ish I think, and tweak after13:09
dimiternmgz, great, thanks!13:09
rogpeppe1voidspace: here's a 1.16 agent config: http://paste.ubuntu.com/7189587/13:11
=== psivaa-lunch is now known as psivaa
voidspacerogpeppe1: awesome13:26
voidspacerogpeppe1: just updating my coffee - thanks13:26
mgzyour coffee has revision numbers?13:27
mgzwho's branch of coffee are you using?13:27
* fwereade collecting laura13:28
fwereadedimitern, in the provsioner, shouldn't we just accept the error from the provider? StartInstance errors shouldn't take down the task, they should be recorded as machine errors13:28
=== rogpeppe2 is now known as rogpeppe
rogpeppemy internet connection is dodgy currently13:28
rogpeppemy provider's running tests on the line13:28
perrito666hey, is anyone working on "CLI: Ensure deploy --to and add-unit --to reports an error when the selected machine's provisioned networks match the service's" or can I take it?13:36
jamsinzui: so we have a logical conflict about 1.17.7 in the 1.18 branch. Probably some test that needed to be updated for new 3rd party lib locations. I won't be able to get to it tonight, but will work on it first thing tomorrow.13:40
jamwwitzel3, natefinch, perrito666: to help sinzui get it done, is it possible to look into this: https://code.launchpad.net/~jameinel/juju-core/1.18-merges-1.17.7/+merge/21361513:50
jamIt looks like merging the juju/1.18 branch with my branch causes a problem with a bad import13:51
jamI'm guessing we just moved it to a 3rd party lib.13:51
jamyou should be able to reproduce it locally, as it looks like a build failure.13:51
natefinchjam: I'm starting an interview in 5 minutes, or I would look into it.13:55
jamnp, it might still work better for you, since I'm EOD13:55
jambut don't pick it up unless nobody else steps up13:55
jamnatefinch: ^^13:55
natefinchjam: sure13:55
wwitzel3jam, natefinch: I can look as well just want to finish a thought.13:56
wwitzel3natefinch: we can pair on it?13:56
natefinchwwitzel3: sorry, doing an interview, but possibly after, though that may be after noon.13:57
perrito666I can look at it too also, wwitzel3 let me know if that thought becomes too long13:57
wwitzel3perrito666: if you want to hangout while I wrap this up, then we can pair on it13:58
wwitzel3perrito666: I glanced at it, but didn't have any quick ideas13:58
perrito666well, if for a hangout you need my screen shared it will be a problem :) my linux pc is not hangoutable :p13:59
voidspacerogpeppe: so I've pushed the test for 1.16 StatePort parsing based on the data you gave me14:03
rogpeppevoidspace: cool14:03
perrito666wwitzel3: branching 1.18 to test it locally14:04
voidspacerogpeppe: just tweaking the test to write out a 1.18 config file from it so I can push the 1.18 test for the same thing14:04
rogpeppevoidspace: i'm working on changing environs/cloudinit to use StateServingInfo14:04
voidspacerogpeppe: that will be the only missing piece for my branch14:04
voidspacesubject to exhaustive review of course14:04
rogpeppevoidspace: i got the data by bootstrapping a 1.16 local environ, BTW14:04
rogpeppevoidspace: so you could do the same thing with 1.18 potentially14:04
voidspacerogpeppe: ok14:05
wwitzel3perrito666, rogpeppe: pushed up dates for https://codereview.appspot.com/83150043/ when you have time for another review. Thank you.14:05
wwitzel3perrito666: I pulled down jam's branch and will see what I can get from that locally14:06
dimiternfwereade, agreed14:08
dimiternfwereade, but i haven't changed that - just added an extra check before StartInstance14:08
fwereadedimitern, cool14:08
fwereadeoh wait14:08
fwereadedimitern, why would we do that though?14:08
dimiternfwereade, to save time?14:09
fwereadedimitern, it's a whole new code path specifically to avoid setting StartInstance errors in the usual place where people will see them14:09
dimiternfwereade, ok, i see your point14:09
dimiternfwereade, will drop the check and just call start instance14:10
fwereadedimitern, that's great, tyvm14:10
fwereadedimitern, if we want to save provider calls at some point we can do basiacl14:10
fwereadedimitern, actually14:10
fwereadedimitern, if yu can make it clean, I endorse what you're doing -- but please just make sure the errors end up on the machine status as they would have done had you called StartInstance14:11
fwereadedimitern, do not feel obliged though14:11
fwereadedimitern, threading it nicely through the provisioner task might easily not be worth the complexity14:12
voidspaceERROR cannot use 37017 as state port, already in use14:13
voidspacewhen I use netstat it reports that the port is open14:13
voidspacebut for pid it reports "-"14:13
voidspaceah, but "sudo netstat" gives me the real answer14:13
perrito666wwitzel3: do you know anything about  dummy environ state tests must be run with MgoTestPackage ?14:18
wwitzel3perrito666: nope14:21
voidspacerogpeppe2: so I get an error trying to bootstrap with trunk14:28
voidspacerogpeppe2: https://pastebin.canonical.com/107549/14:28
voidspaceerror: --instance-id option must be set14:28
rogpeppe2voidspace: that means you've got a jujud that's not in the same directory as your juju executable, i think14:29
rogpeppe2voidspace: how did you bootstrap?14:29
voidspacerogpeppe2: see the pastebin14:29
rogpeppe2voidspace: ah, sorry. will get me 2-factor auth key14:30
rogpeppe252648714:30
rogpeppe2ha ha14:30
voidspacehah14:31
voidspacerogpeppe2: ah, I've done a "go install" instead of a "go build"14:31
voidspacerogpeppe2: and it might now be working...14:31
rogpeppe2voidspace: ah, right14:31
rogpeppe2voidspace: go build isn't useful for much, generally14:31
voidspacerogpeppe2: yeah, this is taking much longer!14:31
voidspacesorry for the noise...14:32
rogpeppe2voidspace: this change is proving a little invasive. i think it might be better to do it as a followup to yours.14:33
voidspacerogpeppe2: right14:34
voidspacerogpeppe2: except mine has a conflict with trunk14:34
voidspacerogpeppe2: so we can't land mine without it14:34
voidspacestill bootstrapping...14:34
rogpeppe2voidspace: it does take ages to bootstrap - it downloads a whole image, i think14:34
rogpeppe2voidspace: although, this is the local provider and on trunk, right?14:35
voidspacerogpeppe2: I might have an agent.cof though14:35
voidspacerogpeppe2: yes14:35
rogpeppe2voidspace: hmm, that generally completes quite quickly for me14:35
voidspace"Bootstrapping Juju machine agent"14:35
jamespagesinzui, around?14:36
voidspacerogpeppe2: if it's downloading anything it will be sloooow14:36
voidspacerural internet14:36
jamespagesinzui, I have some juju-core CI questions for the Ubuntu MRE14:36
voidspaceI think I can just use this conf though14:36
rogpeppe2voidspace: sgtm14:37
voidspacerogpeppe2: ok to put the real certs straight into the test file? they'll be regenerated next time I bootstrap, right14:37
sinzuijamespage, I just added my first comment, I need to add more14:37
jamespagesinzui, thanks14:37
wwitzel3mgz: ping14:38
rogpeppe2voidspace: yeah, i think so.14:38
voidspacerogpeppe2: hah, the existing test data for 1_18 is for machine-014:39
voidspaceso I actually need a config *without* the secrets14:39
voidspacehmmm... and it's still bootstrapping14:39
voidspaceah, and this is why14:40
voidspacea million log lines saying14:40
voidspace2014-04-01 14:31:22 DEBUG juju.state open.go:101 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused14:40
dimiternmgz, ping14:40
rogpeppe2hmm, does anyone else see a test failure of state/api in trunk?14:41
rogpeppe2the test looks wrong to me14:41
voidspacerogpeppe2: passes for me14:43
voidspacewell, now trying api/...14:44
voidspaceyep - all passes14:44
rogpeppe2voidspace: ah, i think it's probably to do with talktalk14:44
rogpeppe2hmm, not sure actually14:46
rogpeppe2voidspace: could you paste me the output of running go test -gocheck.vv -gocheck.v 'TestOpenMultiple$' launchpad.net/juju-core/state/api14:47
rogpeppe2voidspace: please14:47
rogpeppe2oops14:47
rogpeppe2s/-gocheck.v /-gocheck.f /14:47
rogpeppe2voidspace: ^14:48
rogpeppe2i can't see how it can work - the address from Listen isn't ok to dial AFAICS14:48
mgzwwitzel3, dimitern: hey14:49
voidspacerogpeppe2: yep14:49
dimiternmgz, i'll need that branch soon ;)14:50
voidspacerogpeppe2: 0 passed14:50
perrito666wwitzel3: I got it to fail, that is for sure14:50
perrito666:p14:50
mgzdimitern: just done some fiddling on the maas code, merging it now14:50
dimiternmgz, thanks!14:51
dimiternmgz, did you manage to live test it?14:51
voidspacerogpeppe2: however, if I do14:51
rogpeppe2voidspace: oh, frick. go test launchpad.net/juju-core/state/api -gocheck.vv -gocheck.f 'TestOpenMultiple$'14:51
voidspacego test launchpad.net/juju-core/state/api -gocheck.vv -gocheck.f 'TestOpenMultiple$'14:51
voidspaceI get ok  launchpad.net/juju-core/state/api0.325s14:51
voidspaceand no other output14:51
rogpeppe2voidspace: weird14:52
rogpeppe2voidspace: what if you cd to state/api and do go test -gocheck.vv -gocheck.f 'TestOpenMultiple$'  ?14:52
fwereadedimitern, I am confused... we have StartInstanceParams which has a Networks field; and a MachineConfig field, which itself has Networks fields14:52
mgzdimitern: no, not yet14:52
fwereadedimitern, which one counts? why does the other exist?14:52
voidspacerogpeppe2: a lot of output but  a pass14:52
voidspacerogpeppe2: want a pastebin?14:53
rogpeppe2voidspace: please14:53
dimiternfwereade, StartInstanceParams had this added initially, but the machineConfig one will be used for the cloudinit setup14:53
voidspacerogpeppe2: https://pastebin.canonical.com/107557/14:53
fwereadedimitern, can we drop it from StartInstanceParams then? otherwise it's just a bug waiting to happen14:53
dimiternfwereade, and maas provider uses StartInstanceParams one to call acquireNode with networks, when set14:53
voidspacebrb14:53
dimiternfwereade, i'd like to do that in a follow-up, when integrating with mgz's branch14:54
rogpeppe2voidspace: weird14:54
rogpeppe2voidspace: [LOG] 36.85478 INFO juju.state.api connection established to "wss://[::]:35729/"14:54
rogpeppe2voidspace: that doesn't seem to work on my machine14:55
fwereadedimitern, btw, what led us to try to do network setup in cloudinit? is it *really* easier that an one-shot job in the machine agent?14:55
rogpeppe2voidspace: ahhh, perhaps because i've got ipv6 disabled14:55
dimiternfwereade, it's easier for me at least14:55
dimiternfwereade, and less code i think14:55
fwereadedimitern, what's easier?14:55
wwitzel3mgz: wondering how I would pull down a remote branch and switch to it? without making a whole new folder14:56
dimiternfwereade, do i need to test anything wrt provisioning machines with networks when we have a test that errors from StartInstance are transformed to StatusError?14:56
fwereadedimitern, "easier" is a valid argument, I just can't see how it applies here :)14:56
wwitzel3mgz: can't seem to remember or find the syntax14:56
dimiternfwereade, I need to add 1 API call and a few scripts and everything can be done in the provisioner and cloudinit14:57
fwereadedimitern, don't think so, there's already a test for that14:57
dimiternfwereade, otherwise we'll also need a worker14:57
dimiternfwereade, ok, thought so14:57
mgzwwitzel3: `bzr branch --switch lp:PATH/TO/BRANCH co:BRANCH` in the dir with the colo branch setup14:58
wwitzel3mgz: co: .. that is what I kept forgetting14:58
wwitzel3mgz: thank you14:58
rogpeppe2mgz: what is supposed to happen if you make a tcp connection to an all-zeros IP address?14:58
mgzthe socket library should give you an error14:59
fwereadedimitern, honestly I'm not seeing the complexity in a one-shot worker that ignores Stop() and just uses a tomb for error transmission15:00
rogpeppe2mgz: well, it doesn't (on voidspace's machine, at any rate, and it looks like the gobot machine too)15:00
wwitzel3perrito666: I'm running the tests now, I was accidently merging trunk which was fixing what ever issue this merge is having15:00
dimiternfwereade, i have it mostly done already15:01
fwereadedimitern, whereas every little bit of weight we add to cloudinit worries me15:01
dimiternfwereade, it's a temporary solution until we have the worker15:02
fwereadedimitern, the bulk of it should be identical, right?15:02
fwereadedimitern, it's just when those same scripts happen to run?15:02
perrito666wwitzel3: it blows when merged to jam's branch, running testsuite now, bbl15:02
perrito666Ill go lunch15:02
dimiternfwereade, yeah, and a new api facade and methods15:02
dimiternfwereade, and the worker itself15:03
fwereadedimitern, it's a one-method facade, though, right?15:03
dimiternfwereade, so you're against setting up networks in cloudinit in general?15:03
mgzrogpeppe2: you can use a known-invalid hostname instead optionally15:04
rogpeppe2voidspace: i'm presuming this program passes if you run it on your machine: http://play.golang.org/p/1TD2_F1NTd15:04
fwereadedimitern, somewhat against it, yeah15:04
rogpeppe2mgz: in this case, the tests are relying on it being valid15:04
dimiternfwereade, if you're really feeling that way, i can go with the worker15:04
mgz(still vulnerable to bad dns servers... ideally we don't want bogus connections getting out at all)15:04
rogpeppe2mgz: which is troubling15:04
fwereadedimitern, where are you getting the info about what networks actually exist at cloudinit time?15:04
rogpeppe2mgz: does this code run ok on your machine? http://play.golang.org/p/1TD2_F1NTd15:04
dimiternfwereade, but i can't guarantee the whole lot will be ready by tomorrow eod, as we talked15:04
fwereadedimitern, I'm still talking it through and may yet be convinced15:05
dimiternfwereade, provisioner gets that and passes the needed information to render the appropriate cloudinit15:05
mgzfwereade: from maas /api/1.0/networks/?node=<systemidofnode>15:05
mgzdimitern: sending to bot with version dep bump15:07
dimiternmgz, ah, dependencies.tsv needs updating yes15:08
fwereadedimitern, mgz: so, I may be missing something -- what's the difference between the method on the provisioner facade vs the one on the mooted new one?15:09
voidspacerogpeppe2: trying15:09
mgzdimitern: right, that's why it was a bit more of a dance15:09
dimiternfwereade, so the provisioner one is called before StartInstance to get the networks and pass them in StartInstanceParams/MachineConfig, from which the cloudinit scripts get their params15:10
dimiternfwereade, and the networker api is basically the same thing, but prepares and runs the scripts at startup15:11
dimiternfwereade, in the latter case we don't have the provisioner api call, in the former we don't have the worker or its api15:11
fwereadedimitern, I'm not convinced yet I'm afraid -- that StartInstanceParams/MachineConfig thing feels like a pretty strong sign we're DIW15:12
dimiternfwereade, and also, in the latter case if you specify invalid networks (unknown or not available on the machine) you'll get an error after MA starts and no status error, whereas in the former case the provisioner can set statuserror in these cases15:12
voidspacerogpeppe2: seems to work15:13
voidspace[::]:48575 &net.TCPAddr{IP:net.IP{0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, Port:48575, Zone:""}15:13
voidspaceaccepted15:13
voidspacedialled15:13
fwereadedimitern, surely not? those networks still go into StartInstanceParams, and the provider barfs then if it can't give them to us15:13
dimiternfwereade, DWI=Direct Inside Wire ? :)15:13
fwereadedimitern, Doing It Wrong ;p15:13
dimiternah15:13
rogpeppe2voidspace: right, thought so. otherwise tests would've failed on your machine15:13
rogpeppe2voidspace: but tests were passing on my machine, so i guess something's changed.15:14
dimiternfwereade, well, acquireNode either gives us a node with these networks or returns an error15:14
fwereadedimitern, yeah15:14
dimiternfwereade, so i stand corrected, with a worker we should still have startinstance-time errors, which will be recorded in status15:14
fwereadedimitern, should be, I think15:15
mgzrogpeppe2: well, that does the same on a canonistack machine as it does for voidspace15:15
voidspacegodammit, still can't bootstrap on my machine15:15
voidspace2014-04-01 15:15:23 DEBUG juju.state open.go:101 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused15:15
fwereadedimitern, my big concern with the worker approach is that machine agent tests will remain a godawful fucking nightmare to test by side-effect, and doing it right *there* really will push us past allmanner f deadlines15:15
rogpeppe2mgz: yup, i'm not surprised15:15
voidspacerebooting, something's futzed15:16
rogpeppe2mgz: but AFAICS it should not be working, right?15:16
mgzI'm pretty sure if I write it in C, it doesn't15:16
dimiternfwereade, not sure I'm following you there - why MA tests will suffer?15:16
* rogpeppe2 tries to remember his rusty sockets skills15:16
fwereadedimitern, it's hell testing anything in the machine agent because there's no indirection layer -- we can't test that it starts a Fooer, we need to start the agent and hang around watching other stuff until we get evidence roughly aligned with the notion that it might have done so15:17
fwereadedimitern, and this will try to rewrite config that expects sudo access, I would imagine15:18
dimiternfwereade, yeah right15:18
fwereadedimitern, so all the other tests will start barfing in really weird ways15:18
dimiternfwereade, correct15:18
fwereadedimitern, not necessarily reproducible, etc etc15:18
dimiternfwereade, we can mock IsRootUser or something though, like for the local provider15:18
fwereadedimitern, it still sucks doing that at arm's length15:18
fwereadedimitern, ok, I have convinced myself15:19
dimiternfwereade, :) so?15:19
fwereadedimitern, go ahead with the cloudinit approach, but *please* make sure the code at the sharp end is so nicely isolated you can just move it and be done15:20
fwereadedimitern, and we need to have networks on *one* of MachineConfig and StartInstanceParams :)15:20
dimiternfwereade, ok, will try doing it sensibly15:21
fwereadedimitern, if it happens in a followup I'm not too bothered, so long as it does happen -- add a card maybe?15:21
fwereadedimitern, actually add a followup card for the worker15:21
dimiternfwereade, i'll poke it around some more and might do it now actually15:21
fwereadedimitern, this is mr.right-now, not mr.right15:21
dimiternfwereade, there are several cards re the worker15:21
fwereadedimitern, great :)15:22
fwereadedimitern, I find myself wishing for dependency graphs in kanban and stuff15:22
voidspacedidn't help, still can't bootstrap trunk with the local provider15:22
voidspace2014-04-01 15:21:29 DEBUG juju.state open.go:101 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused15:22
dimiternfwereade, cheers15:22
* fwereade bbiab again15:22
dimiternfwereade, i still need the review though ;)15:22
voidspacerogpeppe2: final test pushed15:32
rogpeppe2voidspace: brill15:32
voidspaceso only resolving the APIServerDetails / StateServingInfo conflict left for my branch15:32
voidspacerogpeppe2: want a review on your branch?15:33
rogpeppe2voidspace: please - trivial: https://codereview.appspot.com/8309004415:34
voidspacerogpeppe2: yep, looks good to me15:34
rogpeppe2voidspace: ta15:34
wwitzel3another for good measure15:35
rogpeppe2mgz: apparently it does work in C (try telnet 0.0.0.0 22)15:35
voidspace:-)15:35
mgzrogpeppe2: even gethostbyaddr doesn't complain, which surprises me15:36
dimiternfwereade, I dropped the networks from startinstanceparams and now only the ones inside machineconfig are used16:13
perrito666wwitzel3: ping16:16
mgzdimitern: branch landed16:17
dimiternmgz, awesome16:18
rogpeppe2voidspace: lp:~rogpeppe/juju-core/mfoord-stateservinginfo16:19
jamwwitzel3: perrito666: I think it is just that the 1.18 branch had a test case in it that needs to be updated to use a new import16:22
jamI would think you could just change to that dir, run "go test" directly, and it should print out the bad imports16:23
perrito666jam: I got two failing here, replicaset and ..16:24
perrito666machine16:25
jamso, for example :FAILlaunchpad.net/juju-core/cloudinit [build failed]16:25
jamcd cloudinit16:25
jamgo test16:25
jamshould just show a bad import16:25
perrito666jam: sadly, here they work16:27
jamperrito666: did you take the 1.18 branch and merge it with mine?16:27
perrito666jam: nope, merge had failed16:28
jamI think I found the problem.... It looks like the build process had created a library for a directory we had deleted, if I just nuke $GOPATH/pkg it works16:29
voidspacerogpeppe2: merged, now running tests16:30
voidspacerogpeppe2: I see a SharedSecret failure already16:30
jamat least, on the bot16:30
perrito666jam: let me check16:30
perrito666jam: same here16:31
jamperrito666: so that isn't what *you* will see. I think the steps to reproduce are: "checkout the 1.18 branch, install it, merge my branch, try to run the test suite". The initial build will have left some cruft behind that go doesn't realize is stale.16:31
perrito666jam: it what i did16:31
perrito666since i first tried 1.1816:32
perrito666a rm of pkg fixed it16:32
perrito666brb16:32
dimiternmgz, fwereade, updated https://codereview.appspot.com/83200043/ - should be much more straightforward now16:34
bloodearnestheya, does anyone know a way to fake a public-address with the local provider?16:42
wwitzel3perrito666: was grabbing some lunch16:44
wwitzel3perrito666: I must be doing something wrong because I pulled down jam's branch and all the tests passed for me after running godeps -u16:46
rogpeppe2mgz: looks like there might've been a failure to update dependencies.tsv16:47
wwitzel3rogpeppe2: when you get a chance, if you could have another look at https://codereview.appspot.com/83150043/16:47
rogpeppe2mgz: i see these failures running tests in provider/maas16:47
rogpeppe2./environ_whitebox_test.go:342: suite.providerSuite.testMAASObject.TestServer.NewNetwork undefined (type *gomaasapi.TestServer has no field or method NewNetwork)16:47
rogpeppe2./environ_whitebox_test.go:538: suite.providerSuite.testMAASObject.TestServer.ConnectNodeToNetwork undefined (type *gomaasapi.TestServer has no field or method ConnectNodeToNetwork)16:47
jamwwitzel3: it appears to be a Go issue. If you branch juju-core/1.18 and then "go get" it to build the dependencies, and *then* merge my branch, your $GOPATH/pkg will have some libs in it16:47
jamthat should be rebuilt16:47
jambut it would seem are not16:47
jamand then it can't link properly16:47
jamwwitzel3: perrito666: I cleaned out the dir on the bot, and the branch looks to be landing now.16:48
wwitzel3jam: I wonder if we should make that part of the build process for the bot?16:49
mgzrogpeppe2: I messed up the edit, only the revno change was applied, not the revid16:49
natefinchmgz: for shame!16:49
rogpeppe2mgz: ah16:52
rogpeppe2mgz: in general, it's a not a bad idea to generate the whole file automatically16:52
rogpeppe2mgz: i.e. godeps -t $(go list ./...) > dependencies.tsv16:53
rogpeppe2(-t should probably be the default actually)16:53
rogpeppe2(as should ./...)16:54
mgzrogpeppe2: stamp on cr 83060044 please16:55
mgzrogpeppe2: that would be a bad idea, because I have serv16:55
mgz*several, branches on other revs16:56
mgzor non-trunk16:56
rogpeppe2mgz: link?16:56
mgztake and16:56
mgz*take an existing code review link and replace the number16:56
rogpeppe2oh, ok then :-)16:56
mgzhttps://codereview.appspot.com/8306004416:57
mgzthere was one up the screen a bit16:57
rogpeppe2mgz: LGTM16:59
jamsinzui: it has now landed17:03
sinzuithank you jam17:06
jamsinzui: so we just need to land the joyent stuff there17:08
sinzuijam, no rush...it doesn' pass qa. I wont accept it unit it does17:08
perrito666jam: wwitzel3 sorry, was having a second lunch17:09
perrito666:p17:10
voidspacerogpeppe2: branch proposed17:10
voidspacehttps://codereview.appspot.com/82960044/17:10
jamwallyworld: when you can, land your stuff into the lp:juju-core/1.1817:17
=== vladk is now known as vladk|offline
sinzuiwallyworld, Juju CI doesn't love the provider. We found several bugs preventing CI from passing. https://bugs.launchpad.net/juju-core/+bugs?field.tag=joyent-provider17:21
sinzuiWe are blocked by bug 130087717:23
_mup_Bug #1300877: joyent fails to bootstrap due to missing shared-secret <bootstrap> <joyent-provider> <juju-core:Triaged> <https://launchpad.net/bugs/1300877>17:23
mgzsinzui: having a look as wallyworld is likely not on yet17:24
sinzuimgz, It's 3:25 AM for him. If he is up, he wont be comprehensible17:26
sinzuimgz, This issue might be more crucial to some devs. trunk is broken: bug 130088917:27
_mup_Bug #1300889: azure and hp cannot deploy as of r2524 <azure-provider> <hp-cloud> <regression> <juju-core:Triaged> <https://launchpad.net/bugs/1300889>17:27
hazmatwhy are we instance polling against the provider?17:28
* hazmat forgot17:28
voidspacesee you all tomorrow17:30
voidspaceg'night17:30
voidspaceEOD17:30
rogpeppe2EOD for me too17:32
rogpeppe2hazmat: because a) we don't know when an instance gets an address without polling and b) addresses can change17:33
rogpeppe2g'night all17:33
natefinchnight rogpeppe217:33
hazmatrogpeppe2, all of which is discoverable from the instance.. yes?17:36
rogpeppe2hazmat: yes17:36
hazmatso no need to poll.17:36
hazmatthe provider.. the instance already knows and can update.17:37
hazmatrogpeppe2, thanks17:37
rogpeppe2hazmat: the state needs to know the instance addresses17:38
hazmatrogpeppe2, machine agents can update state17:38
rogpeppe2hazmat: how does the machine agent find its own addresses without calling a provider method (the instance Addresses method in fact)?17:39
hazmatrogpeppe2, depends on which environment its brought up in.. it can talk to the metadata source in most of those environments.. or it can query its nics addresses.17:40
rogpeppe2hazmat: ah, by discoverable from the instance you mean "discoverable by code running on the instance", not "discoverable from the Instance value" :-)17:40
hazmatrogpeppe2, yes17:40
hazmatmetadata servers are live data streams in openstack, ec2 between instance and underlying iaas17:41
rogpeppe2hazmat: i have no problem with getting machines to update their own addresses - it's compatible with the current model.17:46
hazmatrogpeppe2, and stops some of silliness of dos'ing the user's cloud account on rate limits.17:46
rogpeppe2hazmat: yeah. we do make some effort to avoid making lots of calls now, BTW.17:47
rogpeppe2hazmat: although the constants should probably be checked for reasonableness17:47
hazmatrogpeppe2, its an inherent problem imo to how we're creating iaas resources..17:47
hazmatrogpeppe2, creating machines individually, polling them, creating security groups per machine, checking them all the time ..17:47
hazmatrogpeppe2, working on sprint topics for later this month..17:48
rogpeppe2hazmat: right17:48
rogpeppe2hazmat: creating machines individually probably isn't *too* much of a problem, as you don't create machines that often. but polling them definitely can be.17:48
hazmatrogpeppe2, you may not.. but i do..17:49
hazmatrogpeppe2, which is how i ended up finding the provisioner bug that garbage collecting machines after 150..17:49
hazmatstill want to source dive on that one.. but in meetings all day..17:49
hazmatrogpeppe2, your right though its not as much of an issue as the instance polling or security group polling/per server stuff17:50
rogpeppe2hazmat: i think the provisioner is wasteful because it assumes that something else may be actively messing with the machines under its control17:50
rogpeppe2hazmat: if it assumed an environment largely static apart from through its own intervention, i think it could be a lot better17:51
hazmatrogpeppe2, the entire iaas interaction model hasn't changed from pyjuju days .. i wrote that code at the first juju sprint at my house..17:51
rogpeppe2hazmat: but that's definitely an assumption we'd have to think hard about17:51
hazmatwe've just copied the model forward..17:51
rogpeppe2hazmat: yup17:51
rogpeppe2hazmat: didn't want to reinvent everything...17:51
natefinchhazmat: but at least you're admitting it's your fault ;)17:55
hazmatnatefinch, well some of it.. there were quite a few regressions nonetheless..17:55
hazmati autoretried transient provider errors for example.17:55
hazmatnatefinch, and i never polled provider for addresses, i had the machine agent do it in provider specific manner (ifconfig, metadata) etc.17:56
hazmatnatefinch, but sure i'll take responsibility for my mistakes :-)17:56
natefinchhazmat: I was really just joking.  There's definitely stuff we need to improve. It's just a matter of prioritizing it.17:57
hazmatnatefinch, but i can't talk all the blame for those decisions..17:57
hazmatwe had quite some 'discussions'17:57
hazmatyup17:57
natefinchhazmat: once we get the newbies up to speed, we'll have a lot more throughput.  And once this damn HA stuff lands...17:58
perrito666speaking of newbies going up to speed, I am trying to do "CLI: Ensure deploy --to and add-unit --to reports an error when the selected machine's provisioned networks match the service's" but I am not sure what is it about, hints?17:59
wwitzel3trying to bootstrap trunk and I am getting Unable to locate package juju-mongodb .. what does that seem like I should know about that17:59
perrito666wwitzel3: broken soething when switched to 1.18 and back?18:01
wwitzel3perrito666: yeah, looks like one of the machines in the maas was dirty18:02
fwereadeperrito666, heyhey18:04
fwereadeperrito666, this'll be inside the state package18:05
natefinchperrito666: I presume that is supposed to be "Report an error when the networks *do not* match".  Basically, if you have a machine on a specific network, and the service has a *different* network it requires, we shouldn't let you try to deploy the service to that machine18:05
fwereadeperrito666, yeah, what nate said18:05
jamsinzui: what do you need to get a 1.17.8 out the door? *I'm* not aware of the QA failures that we should be fixing.18:06
perrito666fwereade: natefinch thank you18:06
fwereadeperrito666, in particular take care of the fact that machines have two different sets of networks -- the include/exclude with which they were created, and the *actual* set of networks they're on18:06
sinzuijam, Bug #1300889 is serious for trunk. The brokenness delays CI from testing 1.18. 1.17.8 can be any set of passing revisions. I am not demanding anything new be landed after 1.17.718:09
_mup_Bug #1300889: azure and hp cannot deploy as of r2524 <azure-provider> <hp-cloud> <regression> <juju-core:Triaged> <https://launchpad.net/bugs/1300889>18:09
perrito666fwereade: I presume we are speaking about the actual set18:09
fwereadeperrito666, yeah, desired service networks need to match actual machine networks18:10
jamsinzui: so, AIUI, we'll want to cherrypick wallyworld's Joyent provider changes into the 1.18 branch, and then not create it from trunk.18:10
jamwhich is why I moved 1.17.7 over to the 1.18 branch.18:10
fwereadeperrito666, you might be able to draw inferences about possible matches based on requested machine networks alone,for the situations where the machines don't yet have actual networks, but I don't think that's a particularly major concern18:11
wwitzel3Ok, new issue bootstrapping trunk .. the shared-secret for mongo in /var/lib/juju doesn't seem to be getting created.18:11
wwitzel3"mongod.37017[8686]: Tue Apr  1 18:07:38.932 error getting file /var/lib/juju/shared-secret: No such file or directory"18:11
jamsinzui: which brings us back to r2499 on trunk18:11
jamand then a couple patches on top of that18:11
fwereadewwitzel3, rogpeppe2 was going to move where that was stored?18:11
jamrather than everything in trunk today18:11
sinzuijam, I could do that. But as I said. the joyent test doesn't pass.18:12
wwitzel3fwereade: ok, I will investigate that18:12
wwitzel3fwereade: thaks18:12
fwereadewwitzel3, he said it would be in the agent confg18:12
sinzuijam, CI will not bless the joyent provider in its current state. We have marked the test as not required. I would claim it works18:13
jamfwereade: do you know the source of why we are saying "Joyent should be in 1.18" ?18:13
jam*I'm* personally ok with blessing 1.17.7 as 1.18, but there seem to be conflicting requirements18:14
fwereadejam, so long as we get it into 14.04 it's not a big deal -- the theory was that it was close enough to complete to go in without stress and hassle18:14
jamfwereade: from what I can tell there is stress and hastle :)18:15
fwereadejam, sinzui: this is plainly not the case, so let's not block 1.18 on it18:15
jamfwereade: sinzui: are *you* both ok if we bless 1.17.7 as 1.18.0 ?18:15
jamshould we be marshalling the troops into testing it as such?18:15
jamI know of bug https://bugs.launchpad.net/juju-core/+bug/1299802 but I wasn't able to reproduce it18:16
_mup_Bug #1299802: upgrade-juju 1.16.6 -> 1.18 (tip) fails <juju-core:Triaged> <https://launchpad.net/bugs/1299802>18:16
sinzuijam I am okay with that18:16
sinzuijam, I think we need to address bug 1299802 to say we have 1.18.018:17
_mup_Bug #1299802: upgrade-juju 1.16.6 -> 1.18 (tip) fails <juju-core:Triaged> <https://launchpad.net/bugs/1299802>18:17
jamsinzui: if I could reproduce it, yes. But upgrade just worked for me.18:17
sinzuijam, CI never saw this issue. Clould the bug be invalid18:17
jamsinzui: I was following up on it for rogpeppe2 who filed the bug. I haven't been able to reproduce it (though I've only tried one time) .The symptoms are baffling (as we have 2 requests in a row and the second one is returning an old value.)18:18
=== johnweldon is now known as jcw4
fwereadejam, anything that gets us a stable release with the last cycle's goodness in gets my approval18:18
fwereadejam, +118:18
jamsinzui: so it is sort of "do we run the test N times and see if we can trigger it"? That is what CI has been doing, right?18:19
sinzuijam, right it does.18:19
jamsinzui: https://bugs.launchpad.net/juju-core/+bug/1300877 looks like something new from axw18:19
_mup_Bug #1300877: joyent fails to bootstrap due to missing shared-secret <bootstrap> <joyent-provider> <juju-core:Triaged> <https://launchpad.net/bugs/1300877>18:19
jamat least, I didn't think we needed shared-secret until the recent HA changes.18:20
jamsinzui: which implies it isn't the Joyent provider's fault18:20
sinzuijam, well we will see when 1.18 is tested.18:20
sinzuioh, well we will see when the additions are merged18:21
jamsinzui: well.... do we want to delay 1.18 for the additions?18:21
jamthere is some doubt that it will be worthwhile18:21
jamand we can fix trunk and just have it there.18:21
jamit sounds like fwereade is happy to let the Joyent provider slip18:22
jamI don't know of a specific stakeholder requirement for Joyent in 1.1818:22
jamI'd rather just call 1.17.7 1.18.0 if we are happy.18:22
sinzuijam, The only reason I think we want to extra revisions is because we promised something would be in 1.1818:22
sinzuicmars, does bug 1290824 have to be in 1.18.018:22
_mup_Bug #1290824: juju should ask the charm store to decide the default series for a charm <juju-core:In Progress by cmars> <https://launchpad.net/bugs/1290824>18:22
jamsinzui: "somebody promised someone" but I don't know who to put in those blanks.18:22
jamand it sounds like fwereade isn't one of those people18:23
jamand *I'm* not.18:23
jamso we can wait for Ian to find out where his requirements are coming from.18:23
fwereadejam, arosales cares very much that it lands for 14.04, but that is the only specific stakeholder I am aware of18:23
jamfwereade: right. 14.04 is separate (IMO)18:23
jambecause all the stuff we're doing is critical for 14.04 :)18:23
=== vladk|offline is now known as vladk
sinzuijam, It might be fair to say that 1.18.0 docs is the blocker. I think I need to get the collated release notes together, and update the docs. for the release. I need a day at least. I think 2 days is more realistic18:26
jamsinzui: then we're not in a rush and can sort out the release stuff. There is bug #128269018:26
_mup_Bug #1282690: ensure joyent provider gets included in 1.18 release <joyent-provider> <juju-core:Triaged> <https://launchpad.net/bugs/1282690>18:26
jambut I have the feeling that is "it must be in trusty"18:27
jamnot "it must be in 1.18"18:27
sinzuijam, That is my feeling too18:27
sinzui1.18.1 is easy to make18:27
* arosales reads back scroll18:28
sinzuijam, are stopping odd-even versions with the 1.18.0 release? What do I update trunk to 1.19.a1...1.19.b1...1.19.018:29
jamsinzui: we have to do a 1.20, because 1.18 doesn't know that 1.19 would be a "stable" release.18:29
arosalesjam fwereade: I think this may be some building blocks that cmars is working on. But we can get around it by specifically having users state what the preference is.18:29
fwereadearosales, ah, Iwas talking about joyent18:30
sinzuijam, understood18:30
arosalesjam, fwereade: the only issue is when a charm lives in both precise and trusty and the user does not make a statement on what their preference is.18:30
arosalesfwereade: ah joyent, yes we need that :-)18:30
fwereadearosales, cmars is hard at work on default-series as we speak :)18:30
arosalesfwereade: ack18:30
cmarsyep18:30
arosalesjam what are the concerns with joyent?18:30
jamarosales: does it have to be in 1.1818:31
jamwe have a 1.17.7 release that looks nice and stable18:31
jambut doesn't have it18:31
fwereadearosales, joyent has no *specific* 1.18 requirement, though? AIUI it's 14.04, and we hoped it was already good enough to slot in, but it's not18:31
jamdo we delay 1.18 to get it in.18:31
arosalescan we land the majority, and bug fix post?18:31
arosaleswallyworld: had suggested we don't "turn it on" and land bug fixes post 1.18 to "turn it on"18:32
arosalesbut we would need the majority of code to land, or SRU paperwork is a lot harder18:32
arosalesjam: better question, what is blocking Joyent?18:32
sinzuijam, arosales, we might need to call joyent 1.20.0 if the additional code is not "like* a bug fix to the eyes of Ubuntu18:32
jamarosales: it landed in trunk, trunk is not stable, it did not land in an otherwise-stable branch.18:33
jamso it is "unknown" if there are problems18:33
jamthough we haven't gotten it to work in trunk18:33
arosalessinzui: that is my point for landing it in 1.18. SRU'ing it in will be a lot more since it is a feature, but we can call it enablment18:34
arosalesjam: work required to test joyent in current stable is how much?18:35
sinzuiarosales, we have a test18:35
sinzuiarosales, the test failed because of another bug introduced into trunk a few hours ago18:35
sinzuiarosales, when wallyworld merged joyent into the 1.18 branch, CI will test it. We will know if it works or not18:35
arosalesok, as I understand it that is the issue for landing joyent in 1.18 is the testing18:36
arosalescurrent tests are failing due to a bug outside joyent, that perhaps joyent provides18:36
arosalesso if we take out joyent the bug is still there18:36
arosalesjam: do you have a bug # ?18:37
arosaless/provides/exposes/18:37
sinzuiJuju code and features really grew in the last 5 months. Can I say "Juju is 20% more fucking awesome" in the release notes18:37
arosalesha :-)18:38
arosalesjam sinzui sorry for being dense here, but I'll try to summerize18:38
arosales1. There is a question of landing Joyent in 1.1818:39
arosales2. The reason is Joyent tests are not passing atm18:39
arosales3. Test aren't passing due to a new found bug which Jam is referencing that may or may not be dependant on joyent18:39
jamarosales: so, I think the bigger thing is "why does it have to be in 1.18" vs "it needs to be in trusty"18:40
arosalesjam, sinzui ^ is this correct?18:40
sinzuiarosales, yes.18:40
arosalesif 1.20 is in trusy before final freeze I am ok with that18:40
sinzuijam, 1.18.0 entered CI. I expect CI to love it like it loved 1.17.718:40
* arosales was the understanding 1.18 was the final juju relase before trusty GA18:41
jamarosales: we have a bunch of stuff that is also meant to be for trusty GA18:42
arosalesjam: to your point joyent does not have a hard dep for 1.18, but does have a hard dep for trusty GA18:43
jamsinzui: fwereade: so if it is going to be ~2 days to get the docs together, we can take that time and try for a 1.17.8 w/ Joyent, but be ready to pull the plug and go with 1.17.7, does that sound fair?18:44
jamarosales: I respect that getting it in early if everything looks good is better PR wise18:44
sinzuijam, +118:44
arosalesso as long as we have  plan in place for trusty GA I am ok with that.  Now we should be really transparent to the Ubuntu Archive Admins and let them know what is still planning on being delivered so they are not surprised with the branch post 1.18.18:44
fwereadejam, sinzui: sgtm18:44
sinzuijam, CI really tells us yes or no. It is easy to revert if we get a no18:45
jamsinzui: r18:45
jamright.18:45
arosalesfwereade: jam: sinzui: thanks for trying to get all the stake holder issues in. I know its a tough job.18:45
jamI just mean, 1.18 isn't *delayed* if we try to get Joyent in. If it looks like it would be, we don't delay we just go with 1.17.7d18:46
jamsinzui: another question for you18:46
jamsinzui: arm vs armhf18:46
jamdo we know why the tools we build have armhf in them, but juju internally wants to call them arm18:47
jamhttps://code.launchpad.net/~jason-hobbs/juju-core/fix-armhf/+merge/212014 is a patch towards fixing it18:47
jambut we have to decide if "the tools must be right"18:47
jamso we have to conform to them18:47
jamor if we can change the naming on the tools.18:47
jamsinzui: because I might be wrong, but if you untar one of those juju-1.17.6.1-trusty-armhf.tgz files, and have it run jujud --version18:48
jamI *think* it would spit out juju-1.17.6.1-trusty-arm18:48
sinzuijam, I have never understood the internal names. The tool naming script is convention/guess. Not reason18:48
jamand not juju-1.17.6.1-trusty-armhf18:48
jamjhobbs: do you have an Arm board that can give us an answer?18:49
jamjhobbs: I *can* say that simplestreams uses armhf: http://juju-dist.s3.amazonaws.com/tools/streams/v1/com.ubuntu.juju:released:tools.json18:49
sinzuijam http://bazaar.launchpad.net/~juju-qa/juju-core/ci-cd-scripts2/view/head:/assemble-public-tools.bash18:49
sinzuijam, The see the get_arch() rule18:50
jhobbsdoes this log help answer?18:50
jhobbshttps://code.launchpad.net/~jason-hobbs/juju-core/fix-armhf/+merge/212014/comments/50326218:50
jhobbsthis is from a local bootstrap on an armhf18:50
jhobbsrunning juju-1.17.6-trusty-arm18:50
jamjhobbs: that just tells me the "juju" client thinks it is 1.17.6-trusty-arm, but not what the jujud binary thinks it is inside the tarball.18:51
jamHowever, I think given simplestreams, and other sources of information into this system18:51
jamit is easier to rename all the internal-to-juju stuff to call it armhf18:51
jamso the function18:51
sinzuijam, Ubuntu spits out archs, the script has to decide what to do when it finds one in an archive. The script used to abort. I removed it because powerpc is supposedly legitimate from ubuntu's perspective. I assume if we made a package for the arch, it is fine to make the same tool. But juju/go has it's own thoughts on the matter18:51
jamubuntuArch() which maps from 386 => i38618:51
jamneeds todo the same for "arm" => "armhf"18:52
jamsinzui: and somewhere it is ppc64le and somewhere ppc64el, I haven't quite sorted all that out18:52
sinzuijam, sorry. I mean to say the script used to abort when it found an unknown arch. Now It warns18:52
sinzuijam, exactly the issue that made me choose to warn.18:53
sinzuiThe difference looks like a typo18:53
jamjhobbs: so I think the answer is. The path of least resistance is to get "juju version" to report "juju-1.17.6-armhf", and then tool lookup, etc can just continue using armhf18:53
jhobbsjam ok cool18:54
jhobbsjujud --version?18:54
jamjhobbs: well, they both use the same logic18:54
jhobbsor juju version? or are they same thing?18:54
jamso yes, both of them.18:54
jhobbsok cool, i will try to do that and resubmit the patch18:55
jamsinzui: my understanding is "ppc64el" stands for Power PC 64 Little Endian18:55
jamjhobbs: so it *should* be changing it in juju/arch/arch.go18:56
sinzuijam. I need to increment the rev of the 1.18 branch. CI knows the version is less than what we are working on. I can use 1.17.8 or 1.18.0. I favor the latter.18:56
jamand tracking down any other constants that we're missing (hopefully few)18:56
jamsinzui: I think we're going to try for Joyent, so 1.17.818:56
sinzuijam, so "le" means "endian little"?18:57
sinzuiokay18:57
jhobbsjam yeah, the patch i submitted just changed it in juju/arch/arch.go (and unit tests), which was enough to have it find the right tools18:57
jhobbsbut i didn't check output of juju version18:57
jamjhobbs: so we used to have an "ubuntuArch" function18:59
jamin version/version.go IIRC18:59
jamI thought that moved to juju/arch/arch.go18:59
jhobbsthat maps go arch to ubuntu arch it sounds like18:59
jhobbsi have to get on a call, thanks for the help!19:00
jamjhobbs: NormalizeArch has a bunch of regexes, one of them maps "386" to "i386", and we have "armv.*" mapping to ARM. We just need to map "arm" to ARM19:00
bodie_quick question about this diagram http://blog.labix.org/wp-content/uploads/2013/06/config-changed.png19:43
bodie_we're trying to understand how Set works19:43
bodie_my understanding is that apiclient Call triggers stuff on the state server19:44
bodie_but it's not clear how it gets to Machine 2 and more importantly the unit19:44
bodie_I'm also not certain my understanding is correct19:45
bodie_I thought the units / services query the state server for changes, and download them if there are changes19:46
=== vladk is now known as vladk|offline
natefinchbodie_: sorry, I don't know that part of the code well19:57
natefinchbodie_:  I presume they must poll for changes19:57
bodie_we touched on some of it in my email thread, but how the unit knows when there's new content on the stateservice is unclear.  I believe you are correct19:58
natefinchbodie_: charms have hooks, which are just executable files, which get called when things happen.  Config-changed is a hook that gets called when the config changes.20:00
bodie_I see, so the state service triggers config-changed on the unit?20:01
natefinchbodie_: I'm not sure of the exact mechanism that goes from {data updated in mongodb} to {config-changed hook runs}20:03
sinzuinatefinch, do you have a minute to review a branch that increments the 1.18 branch version https://codereview.appspot.com/8330004320:26
sinzuinatefinch, nm, wrong target20:27
natefinchsinzui: let me know when/if you need me to do that20:30
thumpero/20:31
natefinchthumper: yo20:32
natefinchthumper:  what's accounts.conf?20:33
thumpernatefinch: the idea that we don't have configuration for environments, just accounts, like amazon or hp-cloud20:33
thumperyou then name the environment during bootstrap and use an account20:33
thumperI'm sure there is a blueprint somewhere20:34
natefinchthumper: I get it.  so separating the name from the provider info20:35
thumperacj20:35
thumperack20:35
wallyworldfwereade: i notice in the backscroll there is an issue with the joyent provider? i'd like to know what it is as 1. units tests pass, 2. i tested live and it worked fine with wordpress/mysql20:35
natefinchthumper: so almost like extending what we have to allow you to bootstrap multiple copies of what we now consider a single environment defined in environments.yaml, just giving it an extra name on top of that name.20:36
mwhudsonsinzui: hi, i wanted to ask you about the status of getting juju ci going on arm6420:36
thumpernatefinch: kinda a bit *waves hands*20:37
natefinch thumper: lol, good enough20:37
sinzuinatefinch, https://codereview.appspot.com/83310043 is correct20:37
natefinchsinzui: lgtm20:39
sinzuimwhudson, The experience has been dismal. The AMI is under powered. 2 in 5 attempts to start it and run tests fail because the instance dies while were are using it. 3 out of 5 attempts fail because we cannot compile it. And one of the reasons it takes forever is because we need to update the image with the correct tool chain20:40
sinzuithank you natefinch20:40
mwhudsonsinzui: AMI?20:41
sinzuimwhudson, yes, http://ec2-54-84-137-170.compute-1.amazonaws.com:8080/job/walk-unit-tests-arm64-trusty/66/console20:41
mwhudsonoh, you are using the fast model?20:41
mwhudsoner foundation model20:42
sinzuimwhudson, I cannot say. I am using the AMI that was built by danf20:42
mwhudsonoh20:42
mwhudsonhmf20:42
sinzui^ that instance has been up for 50 minutes and we still haven't been able to ssh in to it to do apt upgrades and installs20:43
* mwhudson CANNOT WAIT for hw that is not nda-ed up the ass20:43
mwhudson50 minutes seems appalling20:43
sinzuimwhudson, The test can accept ssh credentials to an instance that is up or start an AMI20:43
sinzuimwhudson, I haven't been able to keep an instance alive for more than 18 hours. I cannot reuse one that has the current tools :(20:44
mwhudsonok20:44
mwhudsonsinzui: are you managing to run the tests on ppc64 ?20:45
mwhudsonsinzui: also, do you test amd64 but built with gccgo?20:45
sinzuimwhudson, yep they are great. The same test is run by sshing to an instance20:45
mwhudsoncool20:45
mwhudsonso if i can scare some hw up, you could use that?20:46
sinzuiyep20:46
mwhudsonwhich is probably not likely in the short term but oh well20:46
mwhudsoni wonder if qemu system is there enough yet20:48
mwhudsonexport INSTANCE_TYPE=m1.xlarge20:49
mwhudsonthat does seem underpowered20:49
mwhudsonsinzui: could you try, i dunno, c3.8xlarge?20:49
wallyworldsinzui: do you know anything about the discussion in the backscroll about joyent and 1.18? there's a claim joyent tests aren't passing. does that refer to CI tests? unit tests pass cause otherwise it wouldn't have landed. and I tested live with wordpress/mysql. so is the discussion just around CI setup?20:50
sinzuiwallyworld, good that you asked.20:50
sinzuiwallyworld, the main bug is also the bug that broke hp and azure deploy. joyent may be fine20:51
wallyworldah ok. is that a recent bug in trunk?20:51
sinzuiwallyworld, I am merging the version inc into 1.18 now. You can gather your joyent changes and merged them. The joyent test is already setup and it will run20:52
sinzuiwallyworld, yes r2524 landed 12 hours ago is the problem20:52
wallyworldsinzui: i was expecting to be asked to merge joyent into 1.18 once 1.18 was updated with 1.17.7 revision. joyent is pretty much standalone20:53
wallyworldi was xpecting that we would ship 1.18 with joyent20:53
wallyworldi will merge joyent into 1.18 after breakfast20:53
sinzuiwallyworld, we are waiting for gobot to merge my branch. you can prepare merges now20:54
wallyworldok, will do. i was concerned when i saw what seemed to be a joyent problem (or what people were saying was a joent problem)20:55
sinzuiwallyworld, so was I. abentley happened be looking at both issues as I was reporting them in IRC. He reported the root cause in a different channel.20:57
wallyworldsinzui: ok, np. i was worried when stakeholders like arosales might have thought joyent was broken also20:57
wallyworldsinzui: do you have the link for your fancy CI dashbaord? i have misplaced it20:58
sinzuiwallyworld, CI is currently at http://ec2-54-84-137-170.compute-1.amazonaws.com/20:59
wallyworldsinzui: i found that one. you also had a summarised one20:59
sinzuiwallyworld, http://ec2-54-84-218-58.compute-1.amazonaws.com:6543/ci summarises an older version we just ran21:00
sinzuiwallyworld, It it is several weeks behind what CI does since jcsackett has been working on other reporting issues21:00
wallyworldok, np. i liked looking at it :-)21:01
wallyworldi'll use the standard jenkins one21:01
* thumper rants21:02
* thumper takes a deep breath...21:02
sinzuiwallyworld, any test/job running with -devel means we know it can fail, but it wont curse the revision21:02
wallyworldok21:03
thumperanyone know how to have gnuflags accept the same arg multiple times?21:03
thumperlike the python "append" type21:03
thumperso we can go "juju debug-log --include foo --include bar ..."21:03
* thumper wants to match pyjuju21:03
wallyworldthumper: no idea. but i fear it may not be possible21:04
thumperfuzz bucket21:04
wallyworldrog is the best person i think21:04
* thumper ignores for now21:04
thumperand works on the api server side21:04
alexisbhehe fuzz bucket, I am going to start using that21:10
sinzuiwallyworld, Do you have a moment to review a branch that increment trunk to 1.19.0 https://codereview.appspot.com/8306004521:13
wallyworldsure21:13
wallyworldjeez, that was a big one21:14
wallyworldthumper: this is is a backport of joyent into 1.18 so sinzui can run the CI tests https://code.launchpad.net/~wallyworld/juju-core/joyent-1.18/+merge/21372421:17
* thumper looks21:17
wallyworldit's a cherry pick of 3 trunk revs21:17
thumperwow21:17
thumperwallyworld: lgtm21:18
wallyworldthumper: sorry :-(  it's essentiall bzr merge -r 2515..2516 trunk21:18
wallyworld3 times21:18
wallyworldfor rev 2512, 2515, 251621:18
thumperwallyworld: cherry pick is fine IMO21:18
thumperdo it21:18
wallyworldok ta :-)21:18
* thumper goes back to debug-log21:18
thumperrogpeppe2: I don't suppose you are around?21:24
thumperhmm... half 10 at night21:24
thumperperhaps a bit hopeful here21:24
thumpernatefinch: done anything with web sockets?21:27
natefinchthumper: not really, sorry21:28
thumperhmm...21:28
thumperI'm not sure this code works...21:28
thumperah...21:34
thumperfound it21:34
thumperthat elusive line that connects everything21:34
sinzuiperrito666, I got the backup test to work by selecting a slower env/region.21:36
sinzuiperrito666, I think speed is the issue. I am going to change CI to run the test itself with my new Hp env21:37
ahasenackguys, have you seen this error before?21:52
ahasenack2014-04-01 21:41:49 INFO juju runner.go:262 worker: start "lxc-provisioner"21:52
ahasenack2014-04-01 21:41:49 ERROR juju runner.go:220 worker: exited "lxc-provisioner": permission denied21:52
ahasenackI used juju add-machine to add a machine, got it, then I tried to deploy services to it using lxc21:53
ahasenackand it's looping on that error21:53
ahasenackjuju 1.17.721:53
ahasenackand then21:53
ahasenack2014-04-01 21:41:49 INFO juju runner.go:254 worker: restarting "lxc-provisioner" in 3s21:53
ahasenackand it just loops21:53
ahasenackhttps://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/129958821:54
_mup_Bug #1299588: LXC permission denied issue with 1.17.7 <micro-cluster> <juju-core (Ubuntu):Confirmed> <https://launchpad.net/bugs/1299588>21:54
=== hatch__ is now known as hatch
hazmatwhy do we still have m1.* instances defined for ec2..22:11
perrito666sinzui: hey I was answering to you22:11
perrito666sinzui: now I wonder if the problem is in the testing script or in the actual restore22:12
perrito666if it is the second we have another.. bug22:12
sinzuiperrito666, The failure is in the juju-restore. I have run just it repeatedly in the past.22:15
* perrito666 curses out loud in spanish22:15
perrito666ok, as much as I am tempted to add a 1st world problems meme on the bug I will add the new info so the bug is addressed properly and the information remains there22:18
thumperahasenack: with maas?22:23
thumpersinzui: do we have maas in CI yet?22:24
sinzuithumper, no.22:24
thumpersinzui: is there an ETA with that?22:24
thumperor are we still missing the hardware?22:24
sinzuipossibly next month when either hardware or a cloud that lets me run vmaas comes into existence.22:25
=== hatch__ is now known as hatch
wallyworld_sinzui: 1.18 branch now has joyent provider merged in22:44
rick_h_wallyworld_: is that the last bit required to use the joyent provider or is there more to come?22:45
wallyworld_rick_h_: it works. there's some followup needed to make it "perfect"22:45
rick_h_wallyworld_: ok, but we should be able to grab the 1.18 branch and bootstrap a joyent env?22:45
wallyworld_rick_h_: yep. i tested in trunk22:46
rick_h_wallyworld_: cool thanks22:46
sinzuiwallyworld_, fab. 1.18 as 1.17.8 is completing tests now22:47
wallyworld_rick_h_: while i have you - for a while, trunk has has public/private addresses moved off units and onto their assigned machines, even though there's a method on unit that delegates through to the machine to get the info22:47
wallyworld_rick_h_: i'm doing some clean up in trunk, and now i need to change some megawatcher tests22:48
wallyworld_to formalise the fact that the setter methods are now redundant22:48
rick_h_wallyworld_: k, I think frankban had a little heads up but let us know and we'll keep an eye out and see if it effects the api stuff we need for machine view22:48
wallyworld_which means that the tests need to change because there's no event published for units when the underlying machine address changes22:49
wallyworld_i'll send an email - i think it's all good, just want to be sure22:49
rick_h_wallyworld_: yea, not sure without looking into stuff more. If the proxy method is there we should be good22:51
wallyworld_ok22:51
ahasenackthumper: no, manual provider22:52
thumperahasenack: I'll ask axw when he starts22:53
* thumper goes to hit things and think how to fix his filtering problem22:53
ahasenackok22:53
ahasenackthumper: I added a comment and logs to https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/129958822:58
_mup_Bug #1299588: LXC permission denied issue with 1.17.7 <landscape> <micro-cluster> <juju-core (Ubuntu):Confirmed> <https://launchpad.net/bugs/1299588>22:58
ahasenackthumper: news: same thing happened with aws, so no weird setup is needed23:31
ahasenackI'll append to the bug23:31

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!