/srv/irclogs.ubuntu.com/2011/10/10/#juju.txt

hazmatjason_, it can be any string re admin-secret00:18
hazmatjason_, i assume for bootstrap?  if you run juju -v bootstrap .. you should get a traceback on error, that you can paste to http://paste.ubuntu.com and paste the link here00:18
hazmatniemeyer, sounds good00:29
jason_hazmat, http://paste.ubuntu.com/705195/00:32
hazmatjason_, it looks like your orchestra server isn't responding to api requests00:33
hazmatthe traceback is kinda of short.. so its hard to be sure, but its either the orchestra server isn't responding or the webdav server isn't up00:34
jason_I can to ssh to it, and I was able to pxe boot a system from it00:34
jason_now, in the sample, the address is marked off by trios of single quotes00:35
jason_'''00:35
jason_do those not belong -- I tried without, and got a different, longer error00:35
hazmatjason_, yeah.. it looks like its a problem with the webdav server when i look at the code00:35
hazmatjason_, its the first thing talked to during bootstrap to check if a juju node already exists00:36
hazmatjason_, not sure what you mean by the triple quotes00:36
jason_storage-url: '''http://192.168.1.103/webdav'''00:37
hazmatjason_, that's not correct yaml afaics00:38
hazmatjason_, single quotes around it are fine00:38
hazmatelse it parses to something broken for use as an address00:38
hazmatyaml.load("storage-url: '''http://192.168.1.103/webdav'''") -> {'storage-url': "'http://192.168.1.103/webdav'"}00:39
hazmatjason_, it doesn't even need quotes for a string in yaml for this case00:39
hazmatjason_, which example are you referencing?00:39
jason_hazmat, https://help.ubuntu.com/community/Orchestra/JuJu00:40
hazmatjason_, hmm.. ic. thanks, i hadn't realized this was documented somewhere..  first i'd try removing all the triple quotes00:41
jason_hazmat, the error w/o http://paste.ubuntu.com/705202/00:42
hazmatjason_, i'm not really all that familiar with it.. but my understanding is that first you need to define the management classes in cobbler that associate to machines you want to use, and those should match the management classes you have specified in juju's environment.yaml file.. the error is because juju queried the cobbler server and didn't find any machines matching the specified management classes.00:45
jason_hazmat,  mmm, I think I might know what to try next, thanks. I've got to run for a while -- thanks00:45
hazmatjason_, np.. good luck, and feel free to pop by if you have any more problems with it, there will be some folks around tomorrow who have more experience using juju + orchestra00:46
jason_hazmat, cool, thanks00:46
jason_hazmat, hey, got past that step, just had to netboot-enable it00:49
hazmatjason_, awesome00:49
jason_hazmat, heh, meanwhile, my wife is going to kill me if I don't quit messing with this! :)00:50
hazmathehe ;-)00:50
* hazmat knows that feeling00:50
hazmatSpamapS, your updates are breaking the charms.. the revision file is missing01:16
=== ejat- is now known as ejat
SpamapShazmat: so I still have to manage the revision?! :-(04:07
* SpamapS had hoped it was optional04:07
hazmatSpamapS, its in a separate file04:07
SpamapSYeah I was hoping that was an optional file04:07
hazmat'revision' in the charm04:07
hazmatSpamapS,  it is during dev (it will autocreate it for you)04:08
SpamapShazmat: so I need a universal pre-commit that checks for the file04:08
SpamapShazmat: or we have to disallow general direct access to bzr.04:08
hazmatSpamapS, the old way is backwards compatible04:08
hazmatdefined in metadata.yaml04:09
SpamapShazmat: indeed, but it generates *copious* warnings04:09
hazmatSpamapS, yeah.. for the 'charmers' group that might be good04:09
hazmatprobably should have used a deprecation warning.. but that's still once per process.04:09
hazmatand random depending on which one you hit.. i guess the repo.find hits all of them.04:10
SpamapSyep04:12
=== plars is now known as plars-holiday
niemeyerHallo!12:30
rogniemeyer: mornin'12:54
rogniemeyer: i tried to push my doc changes to the URL you suggested (lp:~juju/juju/trunk) and i still get a "read-only transport" error12:57
niemeyerrog: Can you please paste it?13:03
_mup_Bug #871743 was filed: orchestra instance status is not visible <juju:New> < https://launchpad.net/bugs/871743 >13:10
roghttp://paste.ubuntu.com/705380/13:11
rogniemeyer: ^13:11
_mup_Bug #871745 was filed: orchestra: ks_meta not cleared <juju:New> < https://launchpad.net/bugs/871745 >13:12
niemeyerrog: This is wrong in a few different ways13:20
niemeyerrog: You can simply pick a branch and push onto trunk13:20
niemeyerrog: trunk has most certainly evolves since you created this branch13:20
rogcan? or can't?13:20
niemeyerrog: Sorry, can not13:20
rogok13:20
niemeyerrog: The way to go is to have a local trunk13:20
rogi do13:21
rogok, and merge into that13:21
niemeyerrog: Then, bzr pull into it13:21
rogthen push it13:21
niemeyerrog: First pull from the real trunk13:21
rogyup13:21
niemeyerrog: Then, merge onto that13:21
niemeyerrog: and _test_ it!13:21
niemeyerrog: Then, commit and push13:21
rogeven though i've only changed the docs?13:21
niemeyerrog: If you're using a bound branch, you actually don't have to push13:21
rogjust commit?13:22
niemeyerrog: But it's slightly easier to screw things up too13:22
niemeyerrog: Yeah13:22
niemeyerrog: For doc-only changes, build the docs again at least13:22
roghow do i run the juju test suite BTW?13:22
niemeyerrog: and see how it looks in the browser13:22
niemeyerrog: ./test13:22
rogok13:22
rogniemeyer: i still get the same error. i tried it from scratch: http://paste.ubuntu.com/705386/13:33
rogi'm sure i'm still doing something wrong :-)13:34
niemeyerrog: Hmm..13:34
niemeyerrog: Are you not part of the team?13:34
* niemeyer checks13:34
niemeyerrog: LOL, yeah13:35
niemeyerrog: Ok, try now13:35
rogah, that works.13:35
niemeyerrog: Sorry about that13:35
rogBTW what *is* the difference between lp:juju and lp:~juju/juju/trunk13:35
rog?13:35
niemeyerrog: None, assuming that the former has a default series that points to the given branch13:40
niemeyerrog: Which is indeed the case13:40
niemeyerrog: Which series a project or a series points to is config-defined13:40
rogniemeyer: ok. i understood something different from one of your previous remarks13:40
niemeyerErm13:40
niemeyerrog: Which branch a project or a series points to is config-defined13:40
niemeyerrog: Which was?13:40
rogniemeyer: http://paste.ubuntu.com/705389/13:41
rog(i'd used the URL lp:juju there)13:42
niemeyerrog: You were using http13:42
niemeyerrog: or that was my understanding at least13:42
niemeyerrog: if it wasn't, then I looked the URL incorrectly13:42
rogniemeyer: i don't think i was. i just checked. i was using lp:juju13:43
niemeyerrog: Ok, sorry then13:43
rogi woz confuzed13:43
rognp13:43
_mup_Bug #871773 was filed: machine_data needs a schema <juju:New> < https://launchpad.net/bugs/871773 >14:09
_mup_juju/go-store r16 committed by gustavo@niemeyer.net14:21
_mup_Merging from go-new-revisions.14:21
_mup_juju/go-store r17 committed by gustavo@niemeyer.net14:50
_mup_Renamed NewURL to ParseURL, and added MustParseURL.14:50
hazmatSpamapS, fwiw i'm marking bugs for oneiric against the distribution and milestone oneiric updates15:05
hazmatniemeyer, fwereade_ we don't have a separate oneiric series atm.. so merge order is critical to ensure we don't have new featues added before bugfixes for oneiric..15:07
niemeyerhazmat: Agreed15:08
niemeyerhazmat: What's the context?15:08
hazmatniemeyer, getting 399 and local provider storage into oneiric..15:08
fwereade_hazmat: I've just been quietly working away and MPing against florence bugs, I hadn't been planning to merge anything until I had some idea what was going on15:08
hazmatniemeyer, but it also applies to any other bugs we get that should be fixed against oneiric, where things become a bit harder.15:09
hazmatif its post oneiric release, and we're onto florence feature dev15:09
hazmatunless we're saying we're  only going to do one sru update, and we'll save doing a maintained stabled till 12.0415:10
hazmatwe'll at least get the practice in of doing an SRU before 12.04 which is nice15:10
hazmatthe question is if we need or want to do more than one15:11
hazmatprobably better is publishing a stablish ppa15:11
niemeyerhazmat: I don't know, but the focus ATM is indeed on oneiric15:12
hazmati'll ask again on list for wider feedback15:12
niemeyerhazmat: I think it depends quite a bit on how the 11.10 => 12.04 will look like15:13
niemeyerhazmat: There are important things we have to decide on that will modify the way we work on that period15:13
niemeyerhazmat: Regarding local-provider-storage, I wish we had gone with a webdav implementation from day zero15:15
niemeyerhazmat: But if you've tested that branch and it's solving the problem for the release right now, +115:15
hazmatniemeyer, indeed, both i and jim have tested it15:16
hazmatit solves the issue jamespage reported15:16
niemeyerhazmat: Cool, let's go with it then and get the problem fied15:16
niemeyerfixed15:16
niemeyerhazmat: We can reevaluate the approach in the future15:16
hazmatniemeyer, what does webdav bring to the table here? and which webdav impl?15:17
niemeyerhazmat: It brings commonality between multiple providers, and it also brings privacy15:17
niemeyerhazmat: We already have webdav support in orchestra15:17
fwereade_niemeyer, hazmat: kinda-sorta: I only just MPed the version with authentication, and I think that's tied to the apache2 module (I forget what, but it skips one of the possible fields)15:20
hazmatprivacy between multi users on a machine with sudo root access, against atm public resources is  a bit of a red herring, multiple environments on a single machine, means a cross provider resource (ie. host config alteration) or something costly like multiple apache2 webdavs.15:20
niemeyerhazmat: We already have it that code working. Just needed to bring up any existent webdav server properly configured.15:21
hazmatwith the new local provider storage, the fetch side is the same as what're using now against any url.. the push side is the same what we use in tests (disk storage), and is trivial15:22
niemeyerhazmat: Yeah, the fetch side is the same.  The server side is disk store + twistd + wrapper to return URL on twistd.15:25
niemeyerhazmat: I hope that in the future that becomes a single server, for local, for orchestra, and for EC2.15:26
niemeyerLunch, biab15:44
fwereade_later all15:54
hazmatfwereade_, cheers15:55
* hazmat wonders if google's dart aka java+coffeescript is really useful16:10
* rog is quite glad that dart isn't stepping on Go's toes16:11
_mup_juju/trunk r401 committed by kapil.thangavelu@canonical.com16:23
_mup_merge local-provider-storage [r=jimbaker,niemeyer][f=869945]16:23
_mup_Make local provider storage network accessible to allow for unit access, fixes problems16:23
_mup_with charm upgrade.16:23
* hazmat lunches16:44
_Groo_hi/2 all16:47
_Groo_could anyone help me? i want to test juju but i dont have a AWS key...16:47
_Groo_how can i bootstrap juju without sucha  key? can i emulate one or make juju ignore it?16:48
jimbaker  _Groo_ , consider using the local provider setup16:48
niemeyerrog: I'm actually surprised by _how much_ it's not stepping on it16:48
SpamapS_Groo_: you can also use openstack16:50
rogniemeyer: yeah, i thought there might be some influences going on there, but there don't appear to be16:51
rogniemeyer: := and go-order type declarations would have been a nice touch...16:52
niemeyerrog: Interfaces as well, at the very least16:52
rogniemeyer: yeah.16:52
rogniemeyer: from my 30s look at it the type and object model seems substantially that of java16:53
rogwhich does seem a bit... retro16:53
niemeyerrog: Yeah, it feels quite a bit like Javascript+Java16:54
niemeyerrog: Which is unsurprising given the stakeholders' background16:54
rogon the positive side, it means i don't have an urge to waste time looking through it in detail...16:54
rogniemeyer: yeah. seems like they could've been a little bit more radical. but maybe they like that space.16:55
SpamapSSo, we may need to do one last upload to juju in 11.1016:58
SpamapSoh wait, never mind16:58
SpamapSI was just thinking it uses the PPA by default16:58
SpamapSbut it doesn't! w00t!16:58
niemeyerSpamapS: Yeah, it's.. magic! :)16:58
SpamapSniemeyer: I keep thinking that it would be better to have the bootstrap process build a repo with juju in it.. so you always get the same juju regardless of the archive/PPA state.17:00
rogniemeyer: i'm off. i sent you a come back on that review by the way. all done save one query.17:00
niemeyerrog: Cool17:01
niemeyerrog: Thanks, and a good evening17:01
rogsee you tomorrow17:01
jimbakerbtw, juju.ubuntu.com/docs is not being updated17:01
* niemeyer tries to sort out ordering of updates in the store17:02
SpamapShazmat: btw, we have some more bugs to fix in txaws ..17:08
SpamapShazmat: the provisioning agent also needs to be a little more robust when handling errors from txaws ..17:08
hazmatSpamapS, hmm.. this is around the machine termination work?17:08
SpamapSWe had a failure during the demo where sometimes expose would try to list instances, fail, and then get an error raised because it tried to iterate on None17:09
hazmatugh17:09
SpamapSafter that, the provisioning agent would not do *anything*17:09
SpamapSkill/restart it would work17:09
SpamapSluckily we had it a few times in rehearsal so I had Adam watching for it during the demo17:09
SpamapSIt was about 1 in 10 times.. so we just crossed our fingers and went for it. :-P17:10
hazmatglad the demo went well, sounds like it rocked17:10
SpamapSIt went over great17:11
SpamapShadoop w/ 7 nodes in under 5 minutes. :)17:11
jimbakerSpamapS, there's a related outstanding issue (bug824279)17:18
jimbakerbug 824279, please ;)17:18
_mup_Bug #824279: Security group functions for EC2 provider should retry <juju:New> < https://launchpad.net/bugs/824279 >17:18
SpamapSjimbaker: that is definitely related, tho I think the bigger problem is that errors are allowed to disable the provisioning agent17:20
jimbakerfrom the sound of it, openstack occasionally returns a payload txaws can't parse, and this bubbles up inappropriately17:20
SpamapSjimbaker: exactly17:20
jimbakerSpamapS, yeah, i never liked that architecture17:20
SpamapStxaws should be smarter..17:21
SpamapSbut we should be more defensive17:21
jimbakerSpamapS, precisely17:21
niemeyerSpamapS: That's a slightly spread out issue indeed, and it's the sort of thing I hope to get cleaned up in the 11.10 => 12.04 timeline17:21
SpamapSWant to make sure its well reported so it will be easier to fix.17:21
jimbakerSpamapS, i think one possibility here is to consider the provisioning agent, when it does fall over, is something that can be restarted. ideally with ha. but there has to be a last line of defense. not you watching it ;)17:23
SpamapSyeah, what was weird was that it didn't exit.. it just stopped doing anything17:24
jimbakerSpamapS, ahh, so not even failfast17:24
SpamapSMy guess was that some watch/callback/etc. needed to be re-added in a 'finally:' clause somewhere17:24
SpamapSIts quite reproducible..17:24
niemeyerSpamapS: I've seen that happening before.. a deferred that never fires can cause that17:24
SpamapSjust digging through bugs now to see if there's a dupe17:24
SpamapS(while also ISO testing the 11.10 release :)17:25
niemeyerSpamapS: My plan for 12.04 encompasses fixes for all of that, FWIW. We still have to talk about it to see if we're all buying into it, though.17:28
hazmatSpamapS, is bug 863400 addressed already?17:31
_mup_Bug #863400: examples repository is not installed from PPA <juju:In Progress by clint-fewbar> < https://launchpad.net/bugs/863400 >17:31
SpamapShazmat: no, its just blocked on me making the packaging from 11.10 backportable to lucid/maverick17:33
SpamapStrivial, but not done17:33
SpamapSBTW the reason they're not there is a missed file during the rename17:33
hazmatok.. i'm going to move it to the florence milestone.. i'm trying to close out eureka17:35
=== hazmat changed the topic of #juju to: http://j.mp/juju-florence http://j.mp/juju-docs http://afgen.com/juju.html http://j.mp/irclog
hazmatflorence is open17:38
niemeyerWOOHAY17:39
jimbakervery nice17:40
jimbakerit was very clear to me in working on the provisioning agent that it's very difficult to get a complex watch setup that is correct in twisted. so moving to golang is definitely something i continue to support17:44
hazmatjimbaker, umm.. add an errBack ?17:50
hazmatfor the error handlng that is17:50
hazmatSpamapS, do you have any of the logs from the provisoning agents by chance?17:52
SpamapShazmat: no. :(17:53
SpamapSkept meaning to save one off17:53
SpamapSbut its really easy to reproduce17:53
SpamapSjust return None from describe_instances17:53
SpamapScan probably write a test actually17:54
SpamapShazmat: rather, instead of returning None, raise an error17:54
jimbakerhazmat, sure, we could do that. i suspect (but i would need a log to confirm) that the problem would not be caught by the exception handler L461 in open_close_ports_on_machine in juju.agents.provision17:54
jimbakeractually that's just illustrative of where it should be caught, since in the specific case there, it's just to ignore something uninteresting17:55
SpamapSwouldn't the appropriate way be to handle unexpected errors in any underlying library call?17:55
jimbakerSpamapS, yes, to be more defensive, or failfast, when doing something external17:57
hazmatSpamapS, religious backwards compatible will leave important features on the table.. zk security comes to mind as a pending one17:57
jimbakerthat method does isolate any txaws calls related to expose, but it can be called in the context of a watch17:59
niemeyerSpamapS: Yes, that's really all that there is to it. Certain practices make that intrinsic, while others make that error prone.18:00
SpamapShazmat: agreed 100%, I think it will slow down dev a lot.18:06
SpamapShazmat: I'm not sure how we can manage to keep putting new versions of juju in -updates without it though.. otherwise we're going to get angry people who have dead environments.18:07
hazmatSpamapS, i'm not sure why we should try past an initial SRU (which is good experience for 12.04)18:08
hazmathave a stable ppa for people who want new features18:08
hazmatif we want to have additional fixes for 11.10, we should have a release branch18:08
SpamapSThats typically how its done, yes.18:09
SpamapSHowever I think we're being asked to think outside the box here.18:09
niemeyerSpamapS, hazmat: We may well live the entire 12.04 timeframe with a compatible code base18:12
niemeyerSpamapS, hazmat: It really depends on how we're running next18:12
SpamapSThere are two very distinct levels of compatibility to think about too18:13
SpamapSThere's the running environment, and the charms.18:13
SpamapSAnd a third, which is the CLI18:13
niemeyerSpamapS, hazmat: People must be able to trust it by 12.04, so the focus is on making it solid18:13
SpamapSYeah, nobody's arguing that we shouldn't do some radical things to make juju a production ready product for at least a few use cases by 12.04. The current question is what to do about SRU18:14
niemeyerSpamapS: I don't think we need any incompatible changes to make it production-ready.18:16
niemeyerSpamapS: SRUs can flow from trunk before we break compatibility.18:17
SpamapSniemeyer: adding ZK security would probably be difficult to do w/o breaking a running env18:18
SpamapSunless we are careful in making things gracefully degrade on the ZK schema version18:19
niemeyerSpamapS: That's not critical for putting it in production, to be honest, but it'd be possible still18:19
SpamapSniemeyer: alright, I'l have to take your word on both of those, as I'm not entirely familiar with the current security model18:21
SpamapSThe previous understanding I had was that any agent can change and view any part of ZK18:21
SpamapSthats not even close to production acceptible.18:21
niemeyerSpamapS: The main point I'm raising here is that I don't even think we should be addressing zk security right now18:21
SpamapSyeah I believe you that there's no need for it.. I just don't understand it well enough to speak to it.18:22
niemeyerSpamapS: "production" means different things to different people.18:23
hazmatright now the story there is no security, there is an implementation on deck that can be finished up with in an additional week or two18:23
hazmatbut its moot if we go go18:23
niemeyerSpamapS: I'd certainly deploy juju with agents having access to zk18:23
niemeyerSpamapS: In production18:23
niemeyerSpamapS: I'd not deploy it without being able to reboot18:23
niemeyerSpamapS: etc18:24
SpamapSI'd put rebooting above zk security too.18:24
hazmatniemeyer, iotw. there are other issues with higher priority18:24
niemeyerhazmat: You mean in the same words, yeah :-)18:24
SpamapSI'd just be hesitant to deploy something that makes it so one root compromise enables a global root compromise.18:24
SpamapSit can be "production part deux" ;)18:25
niemeyerSpamapS: Precisely18:25
niemeyerSpamapS: It's not that we disagree, it's just that that's critical critical, and critical :-)18:25
niemeyers/that that's/that there's/18:25
hazmati'd still like to fix finish the merge on the security stuff, just so its not pending.. the further away the further the context switch18:27
niemeyerhazmat: I'm not sure it's a good idea, but we should definitely talk about it18:27
hazmati should probably just update it to current trunk and leave it pending18:27
hazmatniemeyer, i'm fine with holding off on it for now, but it is still something i'd like to see for 12.0418:28
SpamapSwouldn't it be possible to simply put a version constraint on it.. if schema_version >= 3: ... else: warn("NO SECURITY!")18:28
hazmatbut agreed reboots and other prod issues are more important for now18:28
niemeyerhazmat: It's something I want to see in too, for sure, but we have to put the work in context of the overall strategy18:28
hazmatniemeyer, we haven't done much overall strategy discussion for what we want to accomplish this cycle18:29
niemeyerhazmat: ROTFL18:29
SpamapSniemeyer: I went ahead and made 'prouction' an official tag for juju's bugs18:30
niemeyerhazmat: We haven't indeed.. but please excuse me while I go back to hacking the store so I can try to get this on time. :-D18:31
niemeyerhazmat: We've been consciously delaying strategy conversations since the strategy is very well known up to now18:32
niemeyerhazmat: Getting 11.10 in shape18:32
hazmatniemeyer, good stuff we can revisit post store/repo launch18:33
* hazmat returns to hacking18:33
niemeyerhazmat: Once we're good on that front (I'm still not), and we breath for a couple of days maybe, we should start more serious conversations on the months ahead18:33
hazmatSpamapS, btw.. pls put in a request to merge status2gource ;-) that's awesome18:33
hazmatSpamapS, is there a screencast of that rocking out?18:33
SpamapShazmat: I'm hoping to just make it part of juju status.  --gource18:34
hazmatSpamapS, nice18:34
SpamapSits pretty simple18:34
SpamapShazmat: we had a few18:34
SpamapShazmat: hopefully we'll have full video of the actual demo18:34
hazmatthat would be awesome... although potentially a long wait18:35
SpamapSIIRC, the OpenStack conf guys are editting18:36
hazmatSpamapS, sure.. but i remember waiting a year for the surge guys to finish up last years videos..18:37
SpamapSdoh18:37
jamespageevening all18:41
jamespageI have a query re public-address/private-address18:42
niemeyerJAMES PAGE!18:42
* jamespage waves at niemeyer18:42
jamespageI've been doing a bit of work on the cassandra charm and I've switched over to using private-address/public-address18:44
jamespagebut I have to configure cassandra to listen on a specific IP address for cluster communication18:45
niemeyerjamespage: Hmm, ok18:45
jamespageI went with `unit-get private-address` - but running in ec2 this give me 'domU-12-31-39-0B-14-11.compute-1.internal'18:46
SpamapSjamespage: I actually already committed changes to use public-address/private-ddress18:46
jamespagewhich binds onto 127.0.1.118:46
SpamapSheh thats interesting18:46
hazmatugh..18:47
jamespageyeah - thats what I thought :-)18:47
SpamapSseems like we should be putting private *address* in that field, not private-hostname18:47
niemeyerjamespage: Looks, buggy..18:47
SpamapSsince we have the collaboration of the provider, addresses should be useful18:47
niemeyerSpamapS: This should actually be the public one for EC2, right now18:47
jamespageSpamapS: I've done some work on the seed management as it was restarting cassandra *alot* when it did not need to18:47
SpamapSjamespage: cool!18:48
SpamapSjamespage: you can just --overwrite lp:charm/cassandra .. I was just seeing how unit-info and private/public addresses work18:48
SpamapSniemeyer: huh?18:48
jamespageSpamapS: wilco18:48
niemeyerSpamapS: It should be the address that allows units to intercommunicate.. I guess we can use the internal 10.*.*.*18:49
SpamapSjamespage: as far as binding a specific IP, is that necessary? can't you use 0.0.0.0 ? Or is it the snitch thing that needs to know its IP?18:49
SpamapSniemeyer: we *must* use the internal address, or people get massive bandwidth bills18:49
jamespageSpamapS: you can for the thrift interface - but not for the peering18:49
niemeyerSpamapS: yeah, cool18:49
SpamapSjamespage: right that makes sense.18:50
hazmatjamespage, that's interesting..18:50
hazmathost domU-12-31-39-0B-E0-59.compute-1.internal18:50
hazmatdomU-12-31-39-0B-E0-59.compute-1.internal has address 10.214.231.16718:50
SpamapSjamespage: I suppose the simple way is to look it up with dig/host, instead of using gethostbyname18:50
hazmatping domU-12-31-39-0B-E0-59.compute-1.internal -> 127.0.1.118:50
jamespagehazmat: bingo!18:50
SpamapShazmat: right, thats because we always put a machine's hostname in /etc/hosts as 127.0.1.118:50
niemeyerhazmat: Cool.. we just need to resolve it differently18:51
niemeyerhazmat: Or rather.. are we resolving it? /me looks at get-unit private-address18:51
hazmatjamespage, if we drop the search domain from /etc/hosts it should also work18:51
hazmatniemeyer, it queries the private address from the metadata server18:51
niemeyerhazmat: But what's the output from the command?18:52
niemeyerhazmat: an ip, or the domain name?18:52
hazmatniemeyer, we can get either, we use address for ec218:52
niemeyerhazmat: Is the address an ip, or a domain name? :-)18:52
hazmater. domain18:52
hazmatniemeyer, its domains for every provider except local which uses ip18:53
jamespageso what should public-address get me in ec2?18:53
niemeyerhazmat: That sounds good then18:53
SpamapSjamespage: public would be less relevant for cassandra18:53
niemeyerjamespage: The internal domain name for the local machine18:53
hazmatjamespage, the public dns name for the machine18:53
niemeyerSorry, s/internal/public/ for public-address18:53
jamespageso that should be a name not an address - OK18:54
SpamapSI think whats important is that the behavior of private-address is well understood. I have to admit, I'd expect it to *always* give me a network address, not a hostname, but if it might do that sometimes, then charms can deal with that.18:54
SpamapSjamespage: I think you have to plan for both18:54
niemeyerjamespage: address is a loose term18:55
SpamapSif unit-info private-addres | grep -q "[a-zA-Z]" ; then resolve_hostname ; fi18:55
SpamapShrm that breaks on IPv6 doesn't it?18:55
niemeyerjamespage: ipv4 address, ipv6 address, mac address, etc, are not loose terms18:56
hazmatSpamapS, that's one reason its hostname for address, to preserve ipv6 compatbility18:56
hazmatie. leave it to dns to resolve18:57
hazmatexcept here dns is effectively broken18:57
SpamapSyeah, my concern would be that sometimes it might be an IP18:57
niemeyerSpamapS: We can certainly polish/improve that over time18:58
hazmatSpamapS, in the local provider it is indeed an ip, since the hostname isn't routable from the host to the container18:58
niemeyerSpamapS: Let's keep an eye on that and learn how people use it18:58
jamespageniemeyer, that's kinda what caught me out; I've been testing in the local provider just fine18:58
jamespage(appreciate its a simpler environment)18:58
hazmatso the underlying problem comes from cloud-init18:59
hazmat# Added by cloud-init18:59
hazmat127.0.1.1       domU-12-31-39-0B-E0-59.compute-1.internal domU-12-31-39-0B-E0-5918:59
SpamapSIts not really a "problem" per se18:59
jamespageswitched to ec2, no peering with cassandra18:59
hazmatif it didn't have the *.internal address it would just work18:59
SpamapSits meant to make sure the machine can resolve its hostname18:59
hazmatthat is in /etc/hosts18:59
hazmatSpamapS, we can do that from the second part of that line18:59
hazmathostname18:59
hazmatdomU-12-31-39-0B-E0-5918:59
hazmatwe don't need the domU-12-31-39-0B-E0-59.internal entry19:00
SpamapShazmat: right, but the FQDN needs to resolve to the local machine19:00
SpamapSits actually something to do with MTA's IIRC19:00
hazmatthat's what causes the problem.. it doesn't need to link back to 127.0.1.1 just to the ip address?19:00
SpamapSsmoser knows better than I do19:00
hazmatif i remove that entry from the line it all works as expected19:01
niemeyerjamespage,hazmat: I think the way the cloud-init stuff is injecting the ip is a bit dubious as well,19:01
SpamapSThat entry is not going away19:01
SpamapSI mean, raise a bug19:01
niemeyer:-)19:01
SpamapSIIRC its there for a good reason19:01
hazmatSpamapS, but the entry would work with just -> 127.0.1.1  domU-12-31-39-0B-E0-5919:01
hazmatafaics19:01
SpamapSWould work for what?19:02
SpamapSYou're assuming you know every way that the FQDN is used19:02
hazmati dunno... probably juju ;-)19:02
niemeyerSpamapS: FWIW, I don't think it's a common convention to use a loopback for the FQDN19:02
hazmati don't think fqdn -> localhost is something that should be assumed19:02
hazmatits already resolvable19:02
SpamapSyou could turn it off19:03
SpamapSWe might even be setting it19:03
hazmatcloud-init is setting it..19:04
* hazmat checks cloud-init config19:04
SpamapSmanage_etc_hosts must be set to skip that bit19:04
SpamapSsmoser: around?19:05
jamespageSpamapS: you might be lucky - think he's on hols today19:05
SpamapS  sanitize hosts file for system's hostname to 127.0.1.1 (LP: #802637)19:05
_mup_Bug #802637: cloud-init needs to check for hostname to resolve to 127.0.1.1 <cloud-init:Fix Released by lynxman> < https://launchpad.net/bugs/802637 >19:05
SpamapSdoh19:06
SpamapSno explanation as to why that is asserted19:06
hazmati don't see any reasoning in there on why fqdn should be aliased to localhost.. that looks like it introduced  abug19:06
SpamapSbut my guess based on the time frame is this was centered around orchestra starting to use cloud-init19:06
hazmatm_3, ping19:07
hazmatwhoops19:07
hazmatlynxman, ping19:07
hazmatlooks like scott committed it in rev 40919:09
lynxmanhazmat: pong19:10
hazmatlynxman, do you know why fqdn needs to alias to localhost in cloud init.. ie the reasoning behing the fix for bug 80263719:11
_mup_Bug #802637: cloud-init needs to check for hostname to resolve to 127.0.1.1 <cloud-init:Fix Released by lynxman> < https://launchpad.net/bugs/802637 >19:11
lynxmanhazmat: SpamapS: we added this to circumvent some instances not having an entry to 127.0.1.1 and follow debian guidelines19:11
lynxmanhazmat: since we found cases of daemons (MTA, rabbitmq, etc) that would refuse to start or delay start due to lack of hostname resolving to 127.0.1.119:11
hazmatlynxman, wouldn't hostname -> 127.0.1.1be fine19:12
SpamapSresolving to 127.0.1.1, or resolving at all?19:12
hazmatlynxman, is fqdn also needed?19:12
lynxmanSpamapS: it was an added requirement, I did hostname then we added FQDN as well, the debian guideline implies both19:12
SpamapSI do recall that rabbit used to be really picky about its fqdn19:12
lynxmanSpamapS: just hostname did the job tbh but we want to be legal19:12
* hazmat remembers that as well19:12
lynxmanSpamapS: btw thanks for packaging juju, I've started the macports work to release it asap19:13
SpamapSlynxman: sweet, I have a mac here running Lion so let me know when you're done and I can test it.19:14
lynxmanSpamapS: will do, I need to create the packages for the new dependencies (pydot and py-apt)19:14
lynxmanbtw is pyapt strictly needed on non ubuntu environments?19:15
SpamapSlynxman: this 127.0.1.1 thing is rather confusing.. I see this reference to it in debian's docs.. but can you point me to the guidelines you guys were following? http://www.debian.org/doc/manuals/debian-reference/ch05.en.html19:15
hazmatlynxman, i don't think that fqdn is appropriate in cases where its already resolvable19:16
hazmatto be aliased to localhost19:16
lynxmanSpamapS: exactly that, point 5.1.219:16
SpamapSlynxman: You may have to patch that stuff out, I don't think anybody had time to think about the ramifications of querying apt data on Mac OS X ;)19:16
lynxmanSpamapS: lol, will do19:16
lynxmanSpamapS: as said, several people have touched it, I did the initial implementation then adam_g and smoser19:17
lynxmanSpamapS: so it would do more stuff like get the fqdn from the metadata and such19:17
lynxmanSpamapS: I just hardcoded domain_name to localdomain to avoid conflicts in long term, but it wasn't usable on some scenarios19:17
hazmatlynxman, its not.. its only used for local provider19:18
SpamapSRight, so..19:18
SpamapSthat paragraph is really unclear to me.19:18
hazmatwhich won't work on osx anyways19:18
SpamapShazmat: isn't it also used for juju-origin ?19:18
lynxmanSpamapS: to me as well, we implemented this in Dublin (city) so we went to the #debian channel to ask :)19:19
hazmatSpamapS, hm.. its not.19:19
hazmatSpamapS, it uses the cli for that one19:19
lynxmanSpamapS: this stuff generates quite a debate so hey, any opinion is welcome :)19:19
hazmatSpamapS, failing to find the cli it defaults to ppa19:19
hazmatactually to distro19:19
SpamapSthats good19:19
hazmatSpamapS, that's only the case if juju-origin is not set19:19
hazmatelse we just use the juju-origin value19:20
SpamapSWell I'd say that there is a requirement for machines to be able to resolve their FQDN19:20
lynxmanSpamapS: and I'd agree19:20
SpamapSI'd also say that cloud-init is in charge of that on some level because it is stepping in for netcfg19:20
lynxmanSpamapS: for me the important part was getting a resolvable hostname, which has bigger ramifications19:20
hazmatand in the case of ec2 that's already true without the alias19:20
SpamapSHowever, I do feel that the order of ops there is backwards when deciding whether or not to write it to /etc/hosts19:21
SpamapSIf the FQDN is resolvable in DNS, it must be kept *out* of /etc/hosts19:21
SpamapSI think the debian reference is right..19:21
SpamapSbut since the resolution goes 1 -> 3, the fulfillment should go 3 -> 119:22
SpamapSI also think this may cause some issues for people using 11.10 in the cloud19:23
lynxmanSpamapS: so I'd ping smoser and ask his input as well, I'll be in Millbank tomorrow in case you need to get ahold of the release team :)19:24
SpamapSIts probably just a high prio SRU at worst19:25
SpamapSnot a release blocker19:25
* SpamapS moves discussion to #ubuntu-cloud tho19:25
lynxmanSpamapS: just sayin'19:25
lynxmananyhow I need to run19:25
lynxmancatch you guys later o/19:25
SpamapSlater19:25
jason_Hey guys, I'm trying to troubleshoot a juju/orchestra setup, which I started with the instructions here: https://help.ubuntu.com/community/Orchestra/JuJu19:31
jason_I ran the bootstrap command ok, but I'm stopped at deploying the mysql example: http://paste.ubuntu.com/705567/19:33
hazmatjason_, that's removing the triple quotes in the addresses given in the example?19:34
* hazmat wanders off to remove the triple quotes from the wiki page19:35
* SpamapS filed bug 871966 to document the cloud-init discussion19:36
_mup_Bug #871966: FQDN written to /etc/hosts causes problems for clustering systems <cloud-init (Ubuntu):New> < https://launchpad.net/bugs/871966 >19:36
jason_hazmat, yeah, removing the triple quotes, then enabling netboot in the profile I had in orchestra got me here19:36
jason_got me past the bootstrap19:36
jason_I'm not 100% sure what the mechanism is supposed to be here -- I have an orchestra server and one vm installed via orchestra19:37
hazmatjason_, can you wget on <your-web-dav-url>/provider-state and paste it19:38
hazmatjason_, the triple quotes are gone from both the webdav url and the orchestra server i assume... but the error is the same as it was with them19:38
hazmatjuju will store the address of the zookeeper server into that web-dav-url19:39
jason_http://paste.ubuntu.com/705571/19:39
jason_oh wait19:39
jason_provider state19:39
hazmatwhich it tries to contact on deploy19:40
jason_hazmat, hmm /provider_state or /webdav/provider_state are 404s19:40
jason_oh19:41
jason_hazmat, it's zookeeper-instances: [MTMxODEwNzQ0NS43NTE2NjE2MS4wNzExNQ]19:41
hazmatso that looks good19:42
jason_is orchestra supposed to be enlisting the system I created through it to be the juju server?19:42
hazmatjason_, no.. juju is going to create its own server through orchestra19:43
hazmatbut yes the system does need to be registered to the managemnt class in orchestra and setup for netboot19:43
jason_Ok, that might be an issue -- orchestra is running on virtualbox... not sure how it'd create a new system19:43
jason_on its own19:43
jason_the system I installed from it, I did creating a vm and pxe booting19:44
hazmatSpamapS, fwereade_ if you have a moment, i'm a bit out of my element on debugging orchestraa setups19:46
SpamapSack19:49
hazmatjason_, yeah.. i'm not sure that setup is going to work19:49
hazmatorchestra + juju via a vm19:49
hazmatmaybe if the machines are off and setup for netboot19:49
SpamapSjason_: so you have a system listed in orchestra, that you know pxe boots from the pxe/tftp/etc that orchestra is providing?19:49
SpamapSit could work w/ a bridge net19:50
SpamapSjason_: can you do a 'cobbler listvars --name=the-system-name' and pastebin it? (note that there may be sensitive stuff in there)19:50
jason_SpamapS, yes, it does pxe boot from cobbler, I'll paste that19:51
jason_SpamapS, No such command: listvars19:53
* SpamapS will RTFM instead of reading his own memory19:53
SpamapSjason_: while I figure that out.. is it in the "available" management class?19:56
jason_SpamapS, under management classes in the left hand menu?19:57
SpamapSjason_: In the system definition itself, the last sub-menu is 'Management'19:58
jason_SpamapS, I have orchestra-juju aquired and available in the selected box19:58
jason_I think one of those had been in the available box, and I moved it while trying things outs19:59
jason_And currently, that system is installing anew -- I kicked that off a little bit ago19:59
SpamapSjason_: so the way juju's orchestra provider works, it will only grab systems that are *netboot enabled* and in the 'available-mgmt-class' from environments.yaml19:59
SpamapSahh this is it20:00
SpamapSjason_: cobbler system dumpvars --name=name-of-system20:00
jason_SpamapS, I get an error there: TypeError: cannot marshal None unless allow_none is enabled20:01
SpamapSjason_: weird, did you run it with sudo?20:01
SpamapSit may be necessary actually20:02
jason_SpamapS, yes, it didn't let me otherwise20:02
SpamapSok how about sudo cobbler system list20:02
jason_SpamapS, oneiric01.ubuntu.lan20:02
jason_that's my guy20:02
SpamapSjason_: ok, so you did 'cobbler system dumpvars --name="oneiric01.ubuntu.lan"' and got the none error?20:03
jason_Ok, I had bad syntax20:04
SpamapSjason_: btw, if you don't have it already, the package 'pastebinit' is useful in these instances. :)20:05
SpamapSyou can just | pastebinit20:05
jason_ah, installing now20:05
niemeyerpastebinit++20:05
jason_SpamapS, http://paste.ubuntu.com/705582/20:06
SpamapSjason_: mgmt_classes : ['orchestra-juju-available', 'orchestra-juju-acquired']20:07
SpamapSjason_: it should only be in 'orchestra-juju-available'20:07
SpamapSjason_: take the other one out20:07
jason_SpamapS, ok I'll move that back20:07
SpamapSjason_: Other than that, it should work as expected20:08
SpamapSjason_: since its already installing, its *possible* that it will come up fine.20:08
SpamapSjason_: actually it most definitely should come up fine20:09
jason_SpamapS, ok, I've got that class straight in here. Install is wrapping up -- another thing, my system currently is on a network where it can only talk to the orchestra server20:12
jason_I can add another nic -- or would it be better to switch that nic to the "public" network w/in my network20:13
SpamapSjason_: when the box tries to install juju, things may go wrong then. Depends on if your orchestra server can get to the internet.20:14
SpamapSjason_: the default profile uses the orchestra server's squid proxy to get to the net20:14
jason_SpamapS, the orchestra server can for sure20:14
jason_ah20:14
SpamapSjason_: so things *should* still work20:14
jason_SpamapS, ok, it's up -- I'm going to try the deploy20:15
SpamapSI've done fully disconnected installs with a local mirror of Ubuntu, so I know it works.20:15
SpamapSjason_: the problem is, deploy now wants *another* system20:17
jason_SpamapS, ah, ok, so if I mint another, then that ought to work20:18
SpamapSjason_: right. Currently there's a 1:1 relationship between deployed units of a service and machines.20:18
SpamapSjason_: so bootstrap runs on the first machine, and then each deploy/add-unit after that allocates another machine20:19
jason_SpamapS, ah, so wordpress takes 3 servers20:19
SpamapSjason_: at the moment, yes.20:19
jason_got it20:19
SpamapSjason_: bug 806241 will hopefully be done soon. :)20:20
_mup_Bug #806241: It should be possible to deploy multiple units  to a machine (service colocation) <production> <juju:Confirmed> < https://launchpad.net/bugs/806241 >20:20
_mup_juju/config-get r392 committed by kapil.thangavelu@canonical.com20:20
_mup_config get subcommand to retrieve current settings or service schema20:20
SpamapSjason_: https://bugs.launchpad.net/juju/+bugs?field.tag=production there's a list of issues deemed necessary for making juju useful in production20:20
jason_SpamapS, cool, thanks. I'm spinning up a couple new vms. It looks like my first vm is complaining about some things -- tough to see the errors as they come up though -- bazaar has encountered an internal error is part of it20:26
SpamapSjason_: did you use the environments.yaml from the wiki directly?20:27
SpamapSjason_: juju-origin: lp:juju/pkgs isn't going to work20:27
SpamapSjason_: suggest removing that line.20:27
SpamapSjason_: also are you using juju from the PPA, or 11.10 ?20:27
* SpamapS realizes its 1:30pm and goes to eat20:27
SpamapSjason_: bbiab20:27
jason_SpamapS, ok -- juju from bazaar20:30
jason_SpamapS, I'll change that enviro bit20:30
niemeyerGood progress today, and in a good break point.. I'll step out and do something outside.. back later.21:11
SpamapSjason_: So you are running juju by checking out lp:juju ?21:14
xerxasHi all21:14
xerxasI have some wonderings ...21:16
xerxasI'm hesitating beween juju, cloudformation , and { chef, puppet } 21:17
xerxasthese tools are somewhat complementary21:18
xerxasbut part of the scope is the same21:18
xerxasis there someone using juju with cloudformation ?21:18
SpamapSxerxas: If I needed to put up critical production systems tomorrow, I'd go with chef or puppet... knowing that I can convert all of my chef/puppet to charms once juju is "production ready"21:19
SpamapSxerxas: I don't think Juju and cloudformation would be compatible together.21:19
xerxasSpamapS:  ok, so for iaas using cloudformation , for application management and it's configuration files,  puppet or chef ?21:20
xerxasSpamapS: ahh , interesting "Juju and cloudformation would be compatible together" , how come ?21:20
xerxasjuju creates some instances , this is why it's not compatible ?21:20
xerxasso cloudformation is kind of "very static" ?21:21
SpamapSxerxas: they both use cloud-init to seed themselves into the instance21:21
xerxasSpamapS: I'm not forced to use cloud-init with cloudformation , do I ?21:22
SpamapSxerxas: I personally wouldn't use cloudformation since its likely to never be available on any other IaaS provider21:22
xerxasSpamapS:  right, this is why I'm searching something else21:22
SpamapSxerxas: cloudformation uses cloud-init to make the instance do what it wants. So does Juju.21:23
xerxasbut puppet , chef , doesn't boostrap infrastructures, and creates ressource (chef knows how to create ec2 instances with knife, but no more , and knife is only client side)21:23
xerxasSpamapS: what about elasticIPs, autoscale, securitygroups ?21:23
SpamapSxerxas: these bugs are all known problems that we think would be issues for using juju in production: https://bugs.launchpad.net/juju/+bugs?field.tag=production21:23
xerxasI mean , with cloud formation , I can go up to "create a whole infrastructure for my application in my continuous integration"21:24
SpamapSxerxas: if you are willing to a) work around them, or b) help fix them, then juju would be a good choice for you today. :)21:24
xerxas;)21:24
SpamapSxerxas: right, thats exactly what we want to do with juju.. and you can do it right now.. but you will be accepting some risk21:25
xerxasok, I'm pretty much ok to accepting risk ;)21:25
xerxasI want to be on the bleeding edge21:26
SpamapSRuby dev? ;-)21:26
xerxasbut have no much time to contribute to juju21:26
SpamapSxerxas: thats ok, these will absolutely be solved by the 12.04 release of Ubuntu21:26
xerxasno , system administrator ;) (using python as much ruby ;) )21:27
SpamapSxerxas: have you played with juju yet?21:27
xerxasyes21:27
SpamapSxerxas: how far did you get?21:27
xerxas2 years administrating 60 servers with puppet on ec2 (from 0 to 60 servers, bootstrapped al the infrastrcutre) , then used chef for 1 year , then now, testing juju and testing cloudformation21:28
xerxasSpamapS:  I could deploy charms ;)21:28
jason_SpamapS, I'm running juju  w/ lp:juju21:28
SpamapSjason_: any reason you're not using the PPA or the one from 11.10 ?21:30
jason_SpamapS, I was using the one from 11.10, I actually had an issue with that where the version I had appeared to mismatch with what the examples needed21:31
SpamapSxerxas: it would be *really* helpful to have some bleeding edge ops feedback with juju, so if you're willing to be patient with us, WELCOME! :)21:31
jason_SpamapS, then with this howto, it suggested running from lp, so I did that21:31
SpamapSjason_: which examples were you reading from? r398 was just uploaded to 11.10 last night, and brings it up to date with most of the upstream docs.21:31
jason_SpamapS, from the /usr/share/docs21:32
jason_SpamapS, this was fri21:32
SpamapSjason_: yeah, the one in 11.10 now is going to be less likely to change out from under your feet. :)21:33
jason_SpamapS, or maybe thurs21:33
jason_SpamapS, I'll install that now21:33
SpamapSjason_: that should also eliminate your bzr branching problem since it will automatically choose 'distro' as your source, and that will let you use the squid proxy in your orchestra server21:34
jason_SpamapS, how do I see what tasks the cobbler server is sending out, and clear those -- all three of my systems came up and tried those broken bzr instructions21:34
jason_cool21:34
SpamapSjason_: juju destroy-environment first21:36
SpamapSjason_: that will clear everything out of the webdav server and should reset all the cobbler system records21:37
theDUBBERwww.thedubber.altervista.org21:37
jason_SpamapS, sweet21:37
xerxasSpamapS: I would like to help and give feedback , I'm just evaluating the solution I'll use ...21:37
xerxasso for , juju seems an intermediate between cloudformation and puppet21:38
xerxasjuju plays on the infrastructure side and application side , this seems interesting to me21:38
jason_SpamapS, so I bootstrapped again, and it's a matter of waiting for my systems to poll for instructions?21:40
jason_or do they need to restart21:40
SpamapSjason_: since you don't have power control defined, you have to manually reboot them21:41
jason_cool21:41
SpamapSjason_: if you had a PDU of some kind that cobbler can talk to, it would have powered them off/on21:42
xerxasSpamapS: anyway, thanks for your answer21:50
xerxas+s21:50
xerxasstill wondering how to use , and how ... ;)21:50
SpamapSxerxas: we're here if you have questions. :)21:52
SpamapShmm.. seems in the run up to 11.10 we have introduced some python 2.7-isms21:52
SpamapSfailing tests on lucid. :-P21:52
hazmatSpamapS, log?21:53
SpamapSstill running21:53
SpamapSbut at least 5 thus far21:53
SpamapSA lot of them seem centered around checking for "too many args"21:53
hazmatSpamapS, got it21:54
* SpamapS vows to get jenkins setup with some LXC slaves soon.21:54
hazmatSpamapS, are you referencing .. https://code.launchpad.net/~clint-fewbar/+recipe/juju-daily-test21:55
hazmati see all kinds of odd things there21:55
hazmatcould not init jvm.. etc21:55
SpamapShazmat: that one doesn't even build yet on lucid because dh_python2 is missing21:55
SpamapSwhich is exactly what I'm working on right now21:55
hazmatah21:55
SpamapSFAILED (skips=7, failures=5, errors=3, successes=1549)22:00
SpamapSwill pastebin the log..22:00
SpamapShttp://paste.ubuntu.com/705630/22:01
SpamapShazmat: is this problems with argparse?22:02
SpamapStwisted.trial.unittest.FailTest: 'juju: error: unrecognized arguments: fum' not in 'usage: juju unexpose [-h] [--environment ENVIRONMENT] service_name\njuju unexpose: error: unrecognized arguments: fum\n'22:02
hazmatSpamapS, odd those tests have been going for a while22:03
hazmatSpamapS, the test is being strict about checking error output22:03
hazmatit looks like a variance to the output22:03
hazmats/juju: error/juju unexpose22:04
hazmatpretty minor22:04
SpamapSyeah its all minor stuff22:04
hazmatwe could just be lest exact about and capture from 'error:'22:04
hazmatcompare that is22:04
SpamapSso yeah just drop the preceding command..22:07
SpamapSlooks like an argparse difference that doesn't matter22:07
jimbakerSpamapS, that's correct, we had to update some of the command tests when we moved to 2.7 because of this22:13
SpamapSjimbaker: so was there a definite decision to drop 2.6 support?22:19
jimbakerSpamapS, i do not believe so. in particular, we would expect these commands to be executed on client running 2.6 like os x22:21
jimbakerhowever, it has been the case for these tests since probably before budapest. i suppose we could use the python version to determine the error text, or relax it22:24
SpamapSLion has 2.722:27
jason_SpamapS, I'm still getting bzr errors when my systems come up -- also, I am right that these need to keep reinstalling in order to get new commands from orchestra?22:33
SpamapSjason_: no, the install is just the way that you get a known-clean environment for juju to work with.22:34
colewut's up charmers!22:34
SpamapSjason_: the idea is once the agent starts, you don't have to reinstall anymore. :)22:34
jason_SpamapS, I commented that lp:juju/pkg line out, but maybe that wasn't sufficient...22:35
jason_My systems all reinstalled, came up, and failed on that22:35
hazmathola cole, tis release time22:36
colehazmat: nice!22:36
SpamapSjason_: can you pastebin /var/log/cloud-init-output.log ?22:37
jimbakerSpamapS, i would be more concerned about ensuring the test suite, perhaps just a subset, runs successfully on os x22:39
SpamapSjimbaker: indeed, would be good to have an OS X VM somewhere running as a jenkins slave22:40
jason_SpamapS, http://paste.ubuntu.com/705647/22:41
coleso this topic came out of the openstack meet up around donate: thoughts? https://blueprints.launchpad.net/juju/+spec/dynamic-juju22:45
SpamapSjason_: hm, that was less helpful than I thought it would be22:45
SpamapSjason_: perhaps use 'juju-origin: distro' in your environments.yaml22:46
SpamapScole: as I've said before.. you can write that now without changing anything in juju and just have it run add-unit/remove-unit based on any number of metrics coming from any number of metric gathering services.22:48
SpamapSBasically I see no roadblocks to just doing that in charms.22:50
jason_SpamapS, ok, I'm making that change22:50
SpamapSjason_: I'm updating that wiki page too.. its woefully off22:50
coleSpamapS: fantastic, i've not actually heard that said.  Last conversation I had was around M-Collective and Gustavo said that it was a roadmap item.22:50
SpamapScole: well we can always improve it.22:52
SpamapScole: but really, how hard would it be to just have a charm that runs some kind of data collector and applies rules to the collected data22:53
SpamapSThis isn't exactly a new idea. :)22:53
SpamapSjuju just makes it a lot more flexible22:53
coleSpamapS: agreed, I should have been more specific.  Basically nebula wants to help with getting information out of ganglia and nagios to automatically do the scaling, or if the direction is agent based…so be it.22:54
SpamapSganglia is agent based. :)22:55
SpamapSand nagios can be22:55
colededicated agent ;P22:55
colemessage here being, less daemons the better22:55
SpamapScole: yeah I'd say JFDI and if juju is getting in your way, thats the time to look at adding stuff to juju.22:56
SpamapSI do think that juju will have a rich plugin arch at some point, and that will be the place where this lives.22:56
SpamapSBut I don't have nearly as much influence as niemeyer. :)22:56
SpamapScole: there are some who would say more daemons means more separation of concerns. :)22:57
SpamapSwhich should lead to more robust systems22:57
SpamapSprobably most important to make sure only *one* daemon does collection than to try and make one daemon to rule them all22:58
SpamapSotherwise I'd say you should look at adding this to upstart :)22:58
SpamapScole: there is one bug that you'll probably need fixed before this becomes easy..23:00
SpamapScole: bug 806241 will allow multiple charms in a single machine/container23:00
_mup_Bug #806241: It should be possible to deploy multiple units  to a machine (service colocation) <production> <juju:Confirmed> < https://launchpad.net/bugs/806241 >23:00
SpamapScole: that would be needed to make sure a single collection service was deployed everywhere.23:01
hazmat cole first step would be to get an api endpoint onto juju23:01
SpamapShazmat: bah, cmdline for the first run. ;)23:01
SpamapSAPI does seem like something that needs to happen *soon* though23:01
hazmatSpamapS, actually the command line would switch to using the ui23:01
hazmats/ui/api23:01
hazmatshould make the cli a bit faster23:02
colei like it!23:03
jason_SpamapS, another thing from my env.yaml -- I have default-series: oneiric-juju -- I think I added that when it complained about a default series23:03
jason_does that look ok?23:03
SpamapSjason_: you need it to be    default-series: oneiric23:04
SpamapSjason_: that has nothing to do with the cobbler profile23:04
hazmatjason_, its more like what release/version of ubuntu do you want to use23:05
jason_yes, makes sense23:05
niemeyerjason_: Hmm.. how did it complain about the default series?23:06
niemeyerjason_: The default value for this should actually work23:06
jason_My systems have started not pxe booting -- does it seem like that's because its what orchestra intends, or some other problem23:06
hazmatniemeyer, that value is never validated23:06
niemeyerhazmat: I mean that the value shouldn't have to be changed23:07
jason_niemeyer, there was no value in the sample I started with, as I recall, juju complained about it when I was trying to bootstrap23:07
hazmatit does have to be set for osx i believe23:07
hazmatsince it can't be inferred23:07
niemeyerhazmat: Ahh, ok, ECONTEXT, sorry23:08
niemeyerhazmat: Hmm.. even though, I'm pretty sure it's part of the default config23:08
* niemeyer checks23:08
niemeyerIt is indeed23:08
niemeyerhazmat: It shouldn't complain anyway23:08
niemeyerSo, more store..23:16
jason_SpamapS, when I pastebinned my cloud-init-output log earlier, it was the wrong log, here it is: http://paste.ubuntu.com/705669/23:17
jason_that's from one that just ran23:17
SpamapSjason_: oh that looks like a bug in the etckeeper package23:21
niemeyerSpamapS: OMG.. the never-going-away UnicodeDecodeError..23:22
jason_SpamapS, should that not be affecting juju?23:22
niemeyerSpamapS: Isn't it bzr itself, actually?23:23
niemeyerjason_: It's breaking the installation of packages23:23
niemeyerjason_: Do you have accents in your current pwd23:24
niemeyer?23:24
niemeyerHmm.. no, it's not the current pwd23:25
niemeyerThe path isn't clear from the traceback23:25
jason_niemeyer, no23:25
jason_it'23:25
jason_it's ubuntu -- the default23:25
jason_oh23:25
jason_yeah, I get you23:26
jason_no23:26
niemeyerjason_: Something like this is whats' going on there:23:30
niemeyer>>> u"é" < "é"23:30
niemeyerTraceback (most recent call last):23:30
niemeyer  File "<stdin>", line 1, in <module>23:30
niemeyerUnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 0: ordinal not in range(128)23:30
SpamapSIts etckeeper23:30
SpamapStrying to bzr add /etc23:31
SpamapSjason_: you can remove 'ubuntu-orchestra-client' from the kickstart/preseed for oneiric-i386-juju .. none of that stuff is needed23:31
jason_SpamapS, will do23:32
niemeyerjason_: Are you consciously setting the encoding to 'ANSI_X3.4-1968'?23:32
SpamapSwe had similar problems with orchestra+juju last week in Boston23:33
jason_niemeyer, no23:33
niemeyerjason_: Ok.. it's likely a default from ascii somewhere then23:33
SpamapSjason_: I think those errors are actually ok and not breaking your install23:33
SpamapSIts something broken with the way cloud-init runs on /dev/console23:35
SpamapSneed etckeeper to be fully seeded or it stops and asks for stuff23:36
jason_SpamapS, there's a $SNIPPET('orchestra_client_package') in /var/lib/cobbler/kickstarts/juju.preseed -- is that the line to remove?23:36
SpamapSjason_: I think so yes23:37
SpamapSjason_: still I think you may be up and running, did you try a 'juju status' ?23:38
SpamapSjason_: you may also see a debconf prompt on tty123:38
SpamapSjason_: if so you have to stop the getty and press enter through that23:38
jason_SpamapS, no, but I'm in the process of reinstalling on all three right now23:38
SpamapSif you see it, let me know, I'll report the bug23:38
* SpamapS 's brain is fuzzy from all the churn last week23:38
jason_SpamapS, it takes forever to keep doing that, but it seems like the only way to get them to try again, maybe I'm wrong there23:39
SpamapSjason_: once you get zookeeper up and running, you shouldn't have to repeat the install23:41
jason_SpamapS, ok, juju status was interesting, complaining that my systems aren't reachable from my client -- they're on a network only with the server, so that's something23:41
SpamapSjason_: yeah you have to be able to reach them by ssh23:41
SpamapSjason_: simplest thing to do is to run the client from the orchestra server23:41
jason_SpamapS, so once bootsrap completes, zookeeper is up?23:41
SpamapSjason_: no, the other way around23:42
SpamapSjason_: bootstrap returns as soon as it has told cobbler to boot the machine in a bootstrap configuration..23:42
jason_got it23:42
SpamapSjason_: then you have to basically poll the machine to see if zookeeper is up and running23:42
SpamapSjason_: hopefully once you have a running environment, you don't have to do bootstrap anymore.23:42
jason_SpamapS, is that with juju status?23:43
SpamapSjason_: thats the simplest way yes23:43
jason_SpamapS, cool -- about orchestra and monitoring, is there a separate nagios web interface?23:44
SpamapSjason_: I believe nagios ends up running on the orchestra-monitoring-server .. which is not necessarily the same box as orchestra-provisioning-server.23:45
SpamapSjason_: but I'm no Orchestra expert. :-P23:45
SpamapSjason_: #ubuntu-server has a few people who are, and also the mailing list will get a lot of answers. Docs are still pretty hard to come by as we're still in tech-preview "best effort" mode.23:46
jason_SpamapS, ok -- yeah23:46

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!