/srv/irclogs.ubuntu.com/2011/11/21/#juju.txt

george_eWhere in the filesystem of a unit does Juju store the hook scripts?05:50
hazmatg'morning11:49
noodles775hazmat, m_3 : Hi! I'm currently using the latest postresql charm (r17), and it still used localhost: http://paste.ubuntu.com/745058/12:06
noodles775hazmat, m_3: But I've just realised that r17 of that charm didn't update the revision... retrying now after manually updating the rev (as I'm still using the same environment)12:07
hazmatnoodles775, good catch12:07
noodles775And that was it indeed, it's getting the IP now. Thanks!12:09
noodles775So the only remaining issue for me seems to be that the postgresql charm uses the relationname as the db name (which psql doesn't like if it contains hyphens): http://paste.ubuntu.com/745066/12:12
hazmatnoodles775, worth a bug against the charm, it should escape them12:23
noodles775hazmat: Will do now... thanks.12:24
noodles775hazmat: is this where bugs are now reported for charms? Or is there somewhere newer: https://bugs.launchpad.net/charm12:29
hazmatnoodles775, each charm has its own bug tracker.. for postgresql its .. https://bugs.launchpad.net/charm/oneiric/+source/postgresql12:29
noodles775Great, thanks.12:30
hazmatnoodles775,  the charm browser at charms.kapilt.com is useful for finding the relevant links12:30
fwereadehazmat, does test_full_run in the base agent test ring any bells for you?13:02
hazmatfwereade, its a test that actually launches the agent afaicr13:21
hazmatfwereade, is it breaking?13:21
fwereadehazmat, yeah, and while it's surely something I'm doing it seems I'llhave to start poking into twisted itself to figure it out13:22
hazmatfwereade, cause might be a missing env var/cli option13:22
fwereadehazmat, hm, yes, plausible13:22
hazmatfwereade, i'd try printing os.environ to a file from an early entry point (cli parse setup)13:23
fwereadehazmat, well in fact it's not technically *breaking*, but it is exiting the whole test run13:24
hazmathuh13:24
* hazmat looks up the test13:24
hazmatfwereade, i don't see anything obvious, even a mismatched mock statement there shouldn't exit the tests, i'd pdb into run().. it doesn't look like it actually forks a process here just simulates the startup.13:27
fwereadehazmat, sounds good13:28
fwereadehazmat, (sorry vague, moved on to something else for a bit, will be back on that in a bit)13:28
hazmatfwereade, no worries13:29
noodles775hazmat: hi again. I created https://bugs.launchpad.net/charm/+source/postgresql/+bug/893088 , but atm am just trying to find a work-around...13:45
noodles775I've re-name my charm to apache_django_wsgi (both the directory and in the metadata), but get:13:46
noodles775Bad charm URL: http://paste.ubuntu.com/745120/13:46
noodles775Let me know if you've seen that before... /me keeps plugging away.13:46
marcoceppiThe postgres charm should probably do a string replace on - with _13:47
noodles775marcoceppi: yep, or something similar that enforces db/user names psql is happy with (there could be other invalid chars?). But atm, I just want to get my own charm working :)13:48
hazmatits this file that needs a mod http://charms.kapilt.com/charms/oneiric/postgresql/hooks/common.sh13:48
marcoceppiYeah, sanitation would probably need to take place in all the db charms13:48
hazmatnoodles775, most of the other invalids are done just by restrictions on the charm/service name13:49
hazmatwhich juju handles13:49
noodles775hazmat: yep, which is how I'm trying to work-around the issue atm (my charm name), but am getting Bad charm URL... digging now.13:49
* noodles775 removed both '-'s and '_'s... now it's accepting it.13:51
hazmatnoodles775, committed a fix upstream14:37
hazmatpostgres charm escapes dashes now14:37
noodles775hazmat: sweet, thanks - I'll rename my charm again so it's readable :)14:38
SpamapSmarcoceppi: regarding the passing of config on deploy, I think you *should* be able to say --set 'x=y z=foo' .. but you can't right now. Maybe open a bug?15:37
marcoceppiSpamapS: Cool, I'll do that and see if I can create a patch for it15:38
jcastromarcoceppi: have you seen george? Last I checked he was mostly there but stuck on a juju problem15:50
SpamapShazmat: is there any reason we aren't using the DescribeRegions AWS API call instead of a static list of regions?15:50
hazmatSpamapS, txaws doesn't support, and schema def is static thing atm, we could fix both, but its been low priority15:51
SpamapShazmat: ok I'll open a low priority bug against both. Just making sure its possible/makes sense.15:58
hazmatSpamapS, i'm not sure it does make sense15:59
SpamapShazmat: I tried using txaws-discover --action DescribeRegions and it fails because of key problems. Is txaws using an outdated API or something?15:59
jimbakernot certain why we don't just use boto + deferToThread15:59
SpamapSjimbaker: +++++16:00
hazmatjimbaker, indeed, or libcloud16:00
SpamapS;)16:00
hazmatSpamapS, the schema is defined to validate environments.yaml, but we need to consult the environments.yaml to make the describe regions call...16:00
jimbakercool, this is widely used. see for example some of the openstack tests. etc16:01
SpamapShazmat: so make sure it is formatted right, and trust that the user isn't an idiot. :)16:01
hazmateasy enough to do a second pass at the cost of a roundtrip16:01
SpamapSif they put in us-beast-1 its ok.. right? ;)16:01
SpamapSthey'll get a failure on bootstrap16:01
marcoceppijcastro: I was talking to him last night for a bit16:02
marcoceppibut then he went to bed16:02
hazmatSpamapS, fair enough, we can yank that part of the schema16:03
SpamapSI'm getting more and more worried about these juju set* commands ... without a way to export the env.. we're making it really hard to reproduce environments.16:03
SpamapShazmat: we can just make it verify that its a valid hostname (starts with a letter, [0-9-]+) right?16:03
hazmatSpamapS,  marcoceppi, you can pass a config file at deploy time16:03
hazmatSpamapS, sounds good16:04
SpamapShazmat: convenience feature though, would be nice to be able to have one command that does the deploy and set's without having to write a config file out.16:04
SpamapShazmat: I can see that being an important part of an autoscaler actually16:04
hazmatjimbaker, i'm pretty convinced of the utility of doing a provider like that, we really need to stop concerning ourselves with twisted bindings to the world16:05
hazmatand just interact with the world16:05
SpamapS"when my database gets 10,000 shards, deploy a new one with this shard hash value"16:05
SpamapShazmat: you would make the rackspace guys *VERY* happy :)16:05
hazmatSpamapS, i think an autoscaler can figure out how to write a file ;-)16:05
m_3noodles775: just catching up with the conversation... is that stack happy with '-'s and '_'s in the charm names now?16:06
SpamapShazmat: mtaylor has been asking me "why not libcloud" for a while now. :)16:06
hazmatSpamapS, the answer was for a while that it didn't have support what we needed, but i had a look again last month, and it does seem to support the basics of everything we'd want16:07
hazmatthe sshscriptdeploy stuff in particular to trigger initialization of the instance16:07
noodles775m_3: I haven't yet tried as I'd re-named my charm, but will do so tomorrow. Looking at the change, I expect it to work :)16:07
m_3noodles775: cool.. I'll spin it up with various names today16:10
marcoceppiSpamapS hazmat I agree, being able to say juju deploy --config="game=tf2" steam is a lot more convenient than having to create a config file :)16:15
* marcoceppi is lazy16:15
jimbakerhazmat, agreed on that. we saw that w/ lxc support by the local provider for example, also a pragmatic usage16:15
* marcoceppi s/--config/--set/16:15
SpamapShazmat: sweeeeet (re libcloud)16:23
* hazmat grabs some food16:24
_mup_Bug #893176 was filed: do not limit ec2 region to static list of regions <juju:New> < https://launchpad.net/bugs/893176 >16:24
_mup_Bug #893184 was filed: Deploy should allow for a "config set" flag <juju:New> < https://launchpad.net/bugs/893184 >16:32
jcastroSpamapS: soon I will be confident enough to file bugs like that instead of asking you if ideas are dumb before hand. :)16:33
SpamapSjcastro: indeed, thanks for the nudge. :-D16:33
SpamapSjcastro: I was thinking the same thing but didn't actually validate my assumptions until you asked. :)16:34
SpamapSjcastro: so please, feel free to continue asking "dumb" questions.16:34
* m_3 hopes SpamapS never tires of answering our dumb questions :)16:40
* SpamapS hopes google never tires of making him look smarter than he is16:55
jimbakerhazmat, looking at libcloud's support for providers, yes that would be very nice: http://libcloud.apache.org/supported_providers.html - no way would we want to do each of these16:55
jimbakeri do assume that http://libcloud.apache.org/driver-features.html#deploy means the same thing as cloud-init ?16:55
SpamapSgogrid and linode.. nice16:56
jimbakermaybe the best thing to do is to support libcloud as a new provider16:56
hazmatjimbaker, basically... we'd either format cloud-init as a script, or transfer and invoke cloud init remotely16:56
SpamapShazmat: seems like it would be worthwhile to work in an extension to libcloud to support cloud-init directly.16:57
SpamapShazmat: or at least, metadata/userdata directly.16:57
jimbakerSpamapS, that makes a lot of sense16:57
SpamapSthe world would probably thank us for that.16:57
hazmatSpamapS, all we really need to support it is remote ssh16:58
SpamapS(and it would also have the nice effect of making Ubuntu a preferred platform for libcloud users)16:58
hazmattrue16:58
SpamapShazmat: heh.. an ssh usurper provider has been on my list of things to hack out for a while.. just feed it a list of boxes and it will ssh in and run the agent. ;)16:59
jimbakerSpamapS, sure, you handle the provisioning with say capistrano, seems feasible17:00
jimbakeranyway, i think it would be nice if we got a bug in for a libcloud provider. i would like to work on it myself. the only thing i see missing here  in libcloud is firewall support, but it's a good reason to machine-based firewalls instead17:03
_mup_Bug #893204 was filed: Support libcloud provider <juju:New> < https://launchpad.net/bugs/893204 >17:09
jimbakerSpamapS, i filed this so we can track and see if this makes sense. seems like the consensus here is that it does17:10
SpamapSjimbaker: yes, I'm going to mark it as Confirmed and Wishlist. Once we've got a handle on it, we may need to break it up into a blueprint.17:11
SpamapSjimbaker: seems like a good thing to start on as soon as the 12.04 stabilization/prod work is done.17:12
SpamapSspeaking of that, how is the "subordinate services" work coming?17:15
jimbakeris bcsaller out this week? (the best person to ask here)17:17
hazmatjimbaker, not per the team calendar17:51
hazmatbut the person who maintains the calendar is out.. so who knows.17:51
hazmathe'll be on shortly, just did a meeting with him re co-lcoation18:06
hazmatjimbaker, ping?18:08
SpamapShazmat: I thought of some charms that need to be available as both subordinate and regular services.. so I'm wondering if that will throw a wrench into the spec18:30
SpamapShazmat: like NFS server.. you want to be able to expose the data dir of a service via NFS.18:31
SpamapSbcsaller: ^^18:31
bcsallerSpamapS: You can define normal relationships from subordinate service outside of the container18:32
bcsallerSpamapS: its only the relationship with the principal service that is special18:33
bcsallerSpamapS: and so in that sense it is both a subordinate service (to the prinicpal) and a normal charm to anyone else18:34
hazmatSpamapS, i tend to think of most of the coordinate services as a head / tail er.. server / client.. where we deploy the clients in co-located fashion, and relate them to the server, this holds for logging, distributed fs, monitoring, etc.18:35
hazmathmm18:35
hazmatso in that case expose the data-dir of a service via nfs.. is deploy an nfs-client, that has a relation to the primary that setups the data-dir as an nfs mount.18:36
hazmatso its not per se exporting data per se as a separate volume nfs style, just using an existing mounted volume for the storage18:37
SpamapSSo another scenario is ceph.. the ceph charm operates as both the client and server for ceph18:54
SpamapSit would be useful to make the ceph client a subordinate of a service that wants to store data in ceph18:55
bcsallerSpamapS: that sounds correct, I don't see an issue though?19:00
SpamapSOk at one point I got the impression that we couldn't subordinate normal charms.19:01
bcsallerSpamapS: the client would be a subordinate charm with a normal relationship to the master19:16
bcsallerand a subordinate relation to its principal service19:16
SpamapSceph is a normal charm, and works as a client or server19:23
SpamapSso I could add a subordinate relation to ceph so it can talk to the.. I don't know the term.. other service in the container?19:24
* SpamapS re-reads the spec19:24
marcoceppiHow can I test juju from the repo?19:28
marcoceppifrom the bzr repo?19:28
bcsallerSpamapS: yes, a subordinate relation is what you'd need there. I think that is all you'd need to define but I'll keep playing with the use-case19:31
bcsallerSpamapS: we had a top level subordinate:true in the metadata, I've taken that out and it only depends on changing the interface now19:34
jimbakerhazmat, hi19:35
hazmatmarcoceppi, bzr branch lp:juju && cd ./bin/juju -h19:36
hazmatmarcoceppi, the ppa is rebuilt daily, if you have a package install of juju, it might be good to remove it to avoid any version confusion19:36
marcoceppihazmat: thanks, I'm just trying to test this patch I've made19:37
SpamapSbcsaller: ahh cool! ok19:39
jimbakerhazmat, thanks for the approval on ssh passthrough. i will write up the new juju scp command shortly, as well as my thoughts on bug 81497419:40
_mup_Bug #814974: config options need a "file" type <juju:In Progress by jimbaker> < https://launchpad.net/bugs/814974 >19:40
jimbakerbiab, time for lunch19:40
hazmatjimbaker, great, i wanted to touch base on what's next, but i'll finish up reviews on your branches first19:40
jimbakerhazmat, i think i'll take a look at the ssh key stuff19:41
hazmatjimbaker, cool19:41
jimbakerthat's an important prod issue19:41
jimbakerhazmat, cool19:41
_mup_Bug #893281 was filed: Subordinate services require topology support <juju:New for bcsaller> < https://launchpad.net/bugs/893281 >19:44
_mup_juju/session-expiration r409 committed by kapil.thangavelu@canonical.com19:58
_mup_add session expiration documentation19:58
_mup_juju/session-expiration r410 committed by kapil.thangavelu@canonical.com19:58
_mup_merge trunk19:58
hazmatsidnei, did your ssd get resurrected?20:54
sidneihazmat, haven't had much time to play with it unfortunately. seems like it's a known issue with sandforce-based drives, and a firmware upgrade might solve it.20:55
sidneihttp://lmgtfy.com/?q=sandforce+cold+start+bug20:57
hazmatsidnei, ic.. good luck with that.. i'm hopeful sandforce controllers will be getting better ootb now that they have much larger testing resources since they got acquired.. just got a new ssd myself (samsung) like 10m ago, tbd20:57
hazmatsidnei, hm.. that's interesting.. i was putting together a nas with my old ocz sandforce drive (won't fit in new laptop).. and noticed it wasn't being picked up the bios, what was odd though is the ubuntu partioner could see the drive.. this might be relevant.. although i'm not convinced its not a mb bios issue21:00
sidneiyeah, if the partitioner triggers a pci rescan or something, it might get the drive to initialize properly21:01
jcastrothis is why I am intel only. :)21:14
marcoceppiI think I'm going to stick to making charms, and leave juju in the capable hands of those who know21:17
_mup_Bug #893332 was filed: Watches are needed for changes to subordinate services <juju:In Progress by bcsaller> < https://launchpad.net/bugs/893332 >21:21
jcastromarcoceppi: the charms are the best part anyway, for the rest we can just whine21:23
jcastrohey guys, what's best practice for SMTP?21:57
jcastrothere's no mail charm21:57
jcastroand I assume on EC2 they just don't allow port 25 or any of that do they? Don't they have like an email API or something instead?21:58
jcastrobut if you use the amazon simple email service then the charm becomes aws specific ...21:59
marcoceppiYou can mail out of port 25, bulk stuff you need to fill out a request22:20
m_3hazmat: is charm.log going away in favor of a combined unit-agent log in /var/log/juju?23:13
m_3(charm.log is there in EC2, but missing in LXC)23:16
_mup_Bug #893379 was filed: inconsistent logging between different providers <juju:New> < https://launchpad.net/bugs/893379 >23:19

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!