| SpamapS | hazmat: does that mean that some degree of polling is necessary? | 00:06 |
|---|---|---|
| hazmat | SpamapS, actually it was a bad test, watches are sent reliably in the event disconnection, when the client reconnects | 00:06 |
| hazmat | SpamapS, i'm trying to tackle our zk error handling with eye to solving disconnect problems | 00:07 |
| hazmat | i think i've got a good game plan, just writing some tests to verify behavior | 00:07 |
| hazmat | i ended up having to create a tcp proxy, else the whole thing is way too timing dependent | 00:08 |
| hazmat | MITM FTW ;-) | 00:08 |
| SpamapS | nice | 00:08 |
| SpamapS | sad reality.. my laptop is slower than EC2 for deploying | 00:38 |
| SpamapS | iterating on a 2 node ceph cluster over and over takes about 3 minutes per deploy/add-unit .. | 00:39 |
| SpamapS | EC2 can do it in 2 | 00:39 |
| SpamapS | (assuming my units go from pending to running in the usual 30 seconds) | 00:39 |
| jimbaker | bcsaller, if we ever have a sprint in boulder: http://www.yelp.com/biz/zudaka-healthy-latin-food-boulder-2 - all vegetarian (and vegan friendly), and it's south american cuisine, which is the unusual part | 01:48 |
| bcsaller | jimbaker: nice | 01:50 |
| _mup_ | txzookeeper/four-letter-client r44 committed by kapil.foss@gmail.com | 02:12 |
| _mup_ | four letter command admin client | 02:12 |
| === _mup__ is now known as _mup_ | ||
| _mup_ | Bug #878114 was filed: launch multiple bootstrap nodes <juju:New> < https://launchpad.net/bugs/878114 > | 11:43 |
| uksysadmin | hi guys | 12:09 |
| uksysadmin | anyone used juju with OpenStack - is it as simple as configuring the environments.yaml and away you go or is there more to it? | 12:10 |
| fwereade | uksysadmin: I haven't used it myself, so I'm afraid I don't know the details, but I'm pretty sure people have | 12:13 |
| fwereade | uksysadmin: if hazmat's around he may be able to tell you more details | 12:14 |
| uksysadmin | cheers - I'm about to have a go, but nice to know any gotchas up front | 12:14 |
| fwereade | uksysadmin: we've certainly fixed bugs related to openstack compatibility | 12:15 |
| fwereade | uksysadmin: please do let us know if you find any more :) | 12:15 |
| uksysadmin | will do | 12:25 |
| uksysadmin | before I start - I'm using 11.10 - do I need to add the ppas as per the documentation or is it ok to use the ones provided in universe? | 12:47 |
| uksysadmin | (ignore - all is going ok so far... :)) | 12:54 |
| fwereade | uksysadmin, sorry I missed you, the ones in universe should be just fine | 13:04 |
| uksysadmin | great cheers | 13:15 |
| uksysadmin | one things (and I'll cross post) - to do a bootstrap of a server under openstack, do I need 11.04/11.10 and if so where can I get suitable images from? | 13:16 |
| HarryPanda | uksysadmin: look at Orchestra | 13:16 |
| uksysadmin | Cheers HarryPanda, I am. just getting the basics going first by being able to do the juju bits | 13:17 |
| uksysadmin | although... that comes with images... | 13:17 |
| uksysadmin | I see your thinking | 13:17 |
| uksysadmin | no dice (if that was what you were implying) | 13:21 |
| uksysadmin | seeing if these work instead: http://uec-images.ubuntu.com/server/oneiric/current/ | 13:35 |
| hazmat | uksysadmin, its pretty much as simple as configuring the environment | 13:56 |
| hazmat | uksysadmin, use euca-describe-images.. to find an image that you can specify in environments.yaml | 13:57 |
| hazmat | uksysadmin, course that has to be set up in openstack glance | 14:08 |
| uksysadmin | sure, cheers hazmat | 14:12 |
| uksysadmin | kim0, (or anyone) I'm trying to get the juju charms as per https://www.linux.com/learn/tutorials/495738-conducting-clouds-the-ubuntu-way-an-introduction-to-juju and I get bzr errors | 15:18 |
| uksysadmin | not only under 11.10 am I getting a warning about bzrlib being different to bzr (fresh installs still get this) it says | 15:18 |
| uksysadmin | bzr: ERROR: Not a branch: "http://bazaar.launchpad.net/~charmers/charm/oneiric/mysql/trunk/sql/". | 15:19 |
| uksysadmin | if I forget the bzr repos and just do a juju deployment it says it can't find store.juju.ubuntu.com | 15:20 |
| kim0 | crap .. principia is now gone, this article has been waiting at linux.com for too long | 15:21 |
| uksysadmin | if it makes anyone feel better my juju bootstrap worked a charm ;-) | 15:21 |
| uksysadmin | d'oh | 15:21 |
| uksysadmin | good article though kim0 - is there a slightly modified version you've done elsewhere? | 15:22 |
| kim0 | uksysadmin: prolly the most updated would be docs: https://juju.ubuntu.com/docs/ | 15:22 |
| uksysadmin | I followed that too/similar stuff -but failed at: juju deploy --repository=examples mysql | 15:23 |
| SpamapS | oh wow it used principia? | 15:23 |
| SpamapS | yeah thats been gone for like 6 weeks | 15:23 |
| uksysadmin | DNS lookup failed: address 'store.juju.ubuntu.com' not found: [Errno -5] No address associated with hostname. | 15:23 |
| uksysadmin | 2011-10-19 16:20:08,676 ERROR DNS lookup failed: address 'store.juju.ubuntu.com' not found: [Errno -5] No address associated with hostname. | 15:23 |
| SpamapS | kim0: will they let us edit it? | 15:23 |
| SpamapS | uksysadmin: the docs haven't been updated in a while.. its supposed to be juju deploy --repository=examples local:mysql | 15:24 |
| * SpamapS is getting rather annoyed that the website still says the wrong thing | 15:25 | |
| uksysadmin | ok I'll see if that makes a difference... though strange if it fixes a DNS error... | 15:25 |
| SpamapS | uksysadmin: its not a "DNS error" .. the store isn't live yet. | 15:25 |
| SpamapS | uksysadmin: though we are pondering changing it so local: is always assumed | 15:26 |
| SpamapS | uksysadmin: bug 872164 if you'd like to comment/track it | 15:27 |
| _mup_ | Bug #872164: [Oneiric] Cannot deply services - store.juju.ubuntu.com not found <juju:In Progress by hazmat> < https://launchpad.net/bugs/872164 > | 15:27 |
| uksysadmin | ta - will do | 15:28 |
| uksysadmin | in the meantime - how do I get those lucky charms? | 15:28 |
| _mup_ | Bug #873907 was filed: Security group on EC2 does not open proper port <juju:New> < https://launchpad.net/bugs/873907 > | 15:28 |
| hazmat | uksysadmin, easiest way is to apt-get install bzr, bzr branch lp:charm-tools, cd charm-tools.. ./charm get-all ../path/to/place-to-store charms | 15:29 |
| hazmat | er.. s/bzr/mr | 15:29 |
| hazmat | that will fetch all the charms of lp | 15:30 |
| hazmat | s/of/off | 15:30 |
| uksysadmin | cheers - no docs mention that (or ones that I'm being referred to) | 15:30 |
| hazmat | juju.ubuntu.com/Charms should mention it | 15:30 |
| SpamapS | hazmat: we're about to get re-flooded.. linux.com article went out with the same problems. | 15:31 |
| uksysadmin | would be good if the tutorial at /docs/ mentioned it then... | 15:31 |
| hazmat | uksysadmin, we've been working on a charm store, that's directly integrated with the client, its not expected that folks will normally have to go down the charm-tools road | 15:31 |
| hazmat | SpamapS, bummer | 15:31 |
| uksysadmin | sorry for the bearer of bad news - was good up until the point about principia | 15:31 |
| hazmat | uksysadmin, we've got a technical problem getting our docs updated that we're waiting on a sysadmin to fix.. | 15:31 |
| uksysadmin | oh dear - I'll not pester you guys. I've probably got enough to get me going, thanks. | 15:32 |
| hazmat | uksysadmin, its very good to know where the bad docs are ;-) | 15:32 |
| hazmat | but the rest should be good | 15:32 |
| uksysadmin | :) | 15:32 |
| SpamapS | uksysadmin: for 'lp:principia' you can replace it with 'lp:charm' and that should solve those problems | 15:40 |
| SpamapS | I think somebody already said that | 15:40 |
| uksysadmin | ok, I'll give that a shot whilst the charms are checking out using the tool | 15:41 |
| SpamapS | kim0: btw, juju.ubuntu.com/docs is actually quite out of date at the moment. We're still trying to figure out why its not updating from the bzr tree. | 15:42 |
| uksysadmin | on my 11.10 machine I did the tools getall, and in the directory I specified I needed to do a quick symlink to the current dir: (ln - s . oneiric) as it was failing with 2011-10-19 16:43:37,007 ERROR Charm 'local:oneiric/mysql' not found in repository ... | 15:45 |
| hazmat | uksysadmin, hmm.. yeah. the charms need to prefix with their release series | 15:46 |
| uksysadmin | after that it seems to be working | 15:46 |
| uksysadmin | one could say its working like a charm | 15:47 |
| uksysadmin | (are there openinings for a PR person? ;-)) | 15:47 |
| SpamapS | uksysadmin: too easy. ;) | 15:48 |
| robbiew | in terms of the docs needed to be updated from bzr....if someone has hosting space and time to setup the docs, we can fix this fast than apparently IS can | 15:50 |
| robbiew | at least until they are able to respond | 15:50 |
| hazmat | robbiew, sure i can do it | 15:53 |
| hazmat | robbiew, i'm tired of waiting | 15:53 |
| * hazmat setups a dns entry | 15:53 | |
| robbiew | hazmat: cool | 15:53 |
| SpamapS | have we tried #is yet? | 15:53 |
| hazmat | SpamapS, i tried them last week, someone (?) took a look around didn't see the cron job | 15:54 |
| hazmat | or where to update, feel to try again | 15:54 |
| SpamapS | on it | 15:54 |
| SpamapS | ticket#? | 15:54 |
| hazmat | SpamapS, 48456 | 15:55 |
| SpamapS | ty | 15:55 |
| uksysadmin | thanks all - apart from environmental restrictions (you try sanely running virtual under virtual) all seems to be good! | 16:03 |
| SpamapS | LXC isn't virtual. :) | 16:03 |
| SpamapS | its just contained | 16:03 |
| SpamapS | but yeah, my box hits a load of 12 quite often | 16:03 |
| uksysadmin | not running under lxc - vbox | 16:04 |
| uksysadmin | temporary issue fortunately | 16:06 |
| uksysadmin | hometime here in the good ol' uk. thanks for your help. | 16:06 |
| hazmat | ugh.. mongodb randomly restarted on me | 16:07 |
| SpamapS | hazmat: chaos monkey support.. disable with --no-chaos-monkey | 16:19 |
| hazmat | SpamapS, lol | 16:20 |
| fwereade_ | I was thinking we should have a chaos-monkey built into juju | 16:20 |
| SpamapS | We do, his name is Ben and he's a vegan | 16:21 |
| jimbaker | :) | 16:22 |
| jimbaker | i'm increasingly vegan. except for honey. or fish. also, i couldn't give up yogurt. and i have a soft spot for cheese, especially parmigiano-reggiano. but perhaps a little more vegan than not ;) | 16:25 |
| robbiew | SpamapS: hazmat: docs fixed with hazmat's workaround until IS can respond | 16:27 |
| robbiew | https://juju.ubuntu.com/Documentation should have the right stuff | 16:27 |
| SpamapS | jimbaker: maybe you just hate dairy cows and bees | 16:28 |
| hazmat | jimbaker, thats awesome ;-) | 16:28 |
| jimbaker | SpamapS, to the contrary, i love them too much ;) | 16:28 |
| SpamapS | robbiew: at least we have somewhere to send them now. :) | 16:29 |
| SpamapS | robbiew: we should really fix that frame to be an iframe so there aren't two scroll bars. | 16:29 |
| robbiew | eh..whatever | 16:29 |
| robbiew | SpamapS: now you | 16:31 |
| robbiew | are just trying to get cute | 16:31 |
| SpamapS | no.. the embedded window is way too small to hold the whole page | 16:35 |
| robbiew | SpamapS: I can change that...one sec | 16:44 |
| robbiew | SpamapS: reload | 16:46 |
| robbiew | ;) | 16:46 |
| SpamapS | robbiew: better than before :) | 16:46 |
| SpamapS | I wonder if there's a way to say "embed this and make it as big as it wants to be" | 16:47 |
| * SpamapS *hates* html | 16:47 | |
| robbiew | probably | 16:47 |
| robbiew | one sec...let me try | 16:47 |
| hazmat | the doc html should scale down pretty well | 16:47 |
| robbiew | bah! I haven't written html in forever....Spamaps, it's a wiki, so feel free to try :D | 16:52 |
| * SpamapS will just use the direct link | 16:54 | |
| robbiew | lol | 16:54 |
| SpamapS | So, my new favorite use for the local provider is to spin up a giant EC2 instance and use it there | 16:54 |
| SpamapS | because it just *kills* my laptop | 16:55 |
| SpamapS | $0.50/hour for an m2.xlarge is better than 40 $0.08/hour m1.small's per hour ;) | 16:55 |
| robbiew | lol | 16:56 |
| * SpamapS wonders if lenovo makes a thinkpad w/ 12GB | 16:56 | |
| SpamapS | just need 8GB of RAM for charms and the rest for compiz | 16:56 |
| SpamapS | heh.. piping 'debug-log' through 'ccze' makes the day a lot more fun I have to say | 17:09 |
| SpamapS | oooooooo | 17:10 |
| SpamapS | juju status | ccze -m ansi | 17:11 |
| SpamapS | *pretty* | 17:11 |
| hazmat | interesting | 17:15 |
| SpamapS | So, with peer relations.. there needs to be something analogous to 'remove-relation ; add-relation' | 17:47 |
| SpamapS | I have all these idempotent hooks, I want to run them again | 17:47 |
| hazmat | SpamapS, i don't follow | 17:59 |
| hazmat | SpamapS, you can remove a peer relation, and add it | 17:59 |
| hazmat | SpamapS, juju does auto activate peer relation is all | 17:59 |
| SpamapS | OH | 18:03 |
| SpamapS | very useful. :) | 18:03 |
| * SpamapS did not actually *try* removing it | 18:03 | |
| SpamapS | so thats how I can get refreshes after upgrading charms | 18:03 |
| SpamapS | Tho that also calls broken.. which will likely take services down | 18:04 |
| hazmat | SpamapS, m_3 made a nice suggestion on how to add relation iteration capabilities | 18:04 |
| hazmat | before we sort of blocked on the anonymous relations from a server provides.. but the easy solution is to just qualifies though during iteration with the end point service name in addition to the local relation name | 18:04 |
| SpamapS | EPARSE | 18:06 |
| SpamapS | huh? | 18:06 |
| hazmat | SpamapS, just thinking of making relations addressable from upgrade hooks | 18:07 |
| SpamapS | *that* is 100% necessary | 18:07 |
| SpamapS | (you may recall, I suggested very early that upgrade would require re-running every hook) | 18:07 |
| hazmat | SpamapS, one of the issues is that for something that provides an interface, it could have multiple relations from things that require to effectively the same named relation interface | 18:08 |
| hazmat | ie. provides creates what are effectively anonymous/non-addressable relations | 18:08 |
| SpamapS | bug 873116 and bug 767195 may be duplicates.. both I think opened by me. ;) | 18:08 |
| hazmat | an easy way to qualify those would be to just suffix the endpoint service name | 18:09 |
| hazmat | so they can be iterated and addressed in non ambigious fashion | 18:09 |
| SpamapS | relation-get variable_name [ unit_name ] [ relation_name ] ? | 18:09 |
| hazmat | mysql charm ... list-relations -> db-wordpress, db-drupal .. to pass to relation-get | 18:10 |
| SpamapS | Oh the active relations | 18:10 |
| SpamapS | yeah thats bug 767195 .. you opened it.. I recall discussing this a while back | 18:11 |
| hazmat | yeah... | 18:11 |
| SpamapS | Very high order stuff.. important, but can be worked around for now. | 18:13 |
| SpamapS | It would be quite useful in the ceph charm. What I have to do there is just store relation data locally and keep regenerating stuff from that. | 18:13 |
| hazmat | fwereade_, any interest in looking at that? or do you want to roll with ha stuff, i can comment on your proposal on the bug | 18:13 |
| SpamapS | fwereade_: btw, great discussion on the SSH key management stuff. I feel like that is going to be really cool when we get to it. | 18:14 |
| hazmat | i just sent out a large mail on regarding conn failure and session expiration analysis and what my plan is | 18:14 |
| SpamapS | hazmat: oh good. :) I just got hit by it | 18:14 |
| hazmat | SpamapS, yeah.. making local provider work through hibernate is a great test scenario ;-) | 18:14 |
| jimbaker | that would definitely be nice | 18:15 |
| SpamapS | for me it just stops working after lunch | 18:16 |
| _mup_ | juju/ssh-passthrough r408 committed by jim.baker@canonical.com | 18:33 |
| _mup_ | PEP8, PyFlakes, docstrings | 18:33 |
| fwereade_ | SpamapS, thanks :) | 18:36 |
| fwereade_ | hazmat, sorry, need to catch up on context, was putting laura to bed | 18:36 |
| hazmat | fwereade_, no worries | 18:36 |
| fwereade_ | ah, I just saw that email, and suspected it would be relevant to my interests :) | 18:36 |
| hazmat | fwereade_, the context for the relation stuff is in the bug links, just responding to your other email re ha, and then going to try and do some reviews | 18:37 |
| hazmat | the review queue is overflowing | 18:37 |
| hazmat | fwereade_, bcsaller, jimbaker if you have some time, we really should get some more reviews in | 18:37 |
| fwereade_ | hazmat, duly noted :) | 18:38 |
| jimbaker | hazmat, will do, just want to get this ssh passthrough stuff done first | 18:38 |
| bcsaller | hazmat: I'll try for a couple today | 18:38 |
| hazmat | thanks guys | 18:38 |
| jimbaker | taking too long but almost there (too many things that should be easy in argparse, aren't ;) ) | 18:39 |
| fwereade_ | and, hazmat, I can happily work on whatever seems most sensible to you | 18:39 |
| fwereade_ | hazmat, the HA stuff is interesting, but whether or not I should be working on it can probably be determined by how much I appear to have been on crack while writing that comment ;) | 18:40 |
| hazmat | fwereade_, we should do a round discussion on it, the bug is probably a decent place for it, we can decide after that.. there's another low hanging but critical task, which is upstartifying all the agents | 18:41 |
| hazmat | currently only local provider uses upstart for the unit agent, but creating an upstart module that can be used for all the agents would be a huge win on the way to ha | 18:41 |
| SpamapS | +100 for that | 18:42 |
| jimbaker | it would seem that the two features are hugely related | 18:42 |
| * hazmat grabs some coffee | 18:43 | |
| jimbaker | i still think just relying on the fact that the provisioning agent can be restarted + a leader election would suffice for provisioning agent HA, for now. not the scalable solution of course | 18:43 |
| SpamapS | The're related in that they both will help with the resiliency of the system | 18:43 |
| SpamapS | jimbaker: ZK is mroe important | 18:43 |
| SpamapS | more rather | 18:43 |
| jimbaker | SpamapS, in terms of upstart of ZK? | 18:44 |
| SpamapS | And as long as you're going to run two ZK's, why not run two provisioning agents? ;) | 18:44 |
| SpamapS | jimbaker: in terms of HA for bootstrap | 18:44 |
| jimbaker | SpamapS, exactly | 18:44 |
| SpamapS | for upstart.. thats more about being able to reboot nodes | 18:44 |
| jimbaker | every ZK should have a corresponding provisioning agent, just makes sense | 18:44 |
| jimbaker | in terms of layout | 18:45 |
| SpamapS | there's a second task for rebooting, which is making sure that agents that are disconnected can recover from a long absence gracefully. | 18:45 |
| SpamapS | but really.. if you can just reboot them and block zk changes while something is gone.. thats a huge step forward. | 18:46 |
| bcsaller | maybe something like: is_bootstrap = fib(num_active_machines +2) while num_active_machines < 4, on all those machines we run a PA and ZK and the lowest machine id is leader | 18:46 |
| jimbaker | i think reboot is fine, certainly that works for the provisioning agent | 18:46 |
| hazmat | for multi pa, i think fine grain locks are preferrable | 18:46 |
| hazmat | their is parallel work to be done | 18:46 |
| hazmat | for zk, its unesc. zk does its own leader election | 18:46 |
| jimbaker | hazmat, exactly, that would support better scalability | 18:46 |
| hazmat | and the clients can connect to all of them and route appropriately | 18:47 |
| SpamapS | bcsaller: simple and elegant.. I would have no problem with that solution. :) | 18:47 |
| jimbaker | hazmat, leader is only for determining whether a given provisioning agent is active, other than the too simple solution i have in mind :) | 18:47 |
| hazmat | upstart is a good first step though | 18:47 |
| SpamapS | true, no need for a leader PA | 18:47 |
| jimbaker | sorry, under the too simple solution | 18:47 |
| hazmat | the zk service and pa just become another service managed by juju is the end goal i'd like get to | 18:48 |
| hazmat | make it just another service managed through juju | 18:48 |
| bcsaller | hazmat: +1 | 18:48 |
| jimbaker | it just removes the SPOF. but i agree with the end goal | 18:48 |
| bcsaller | thought like we've mentioned namespaces for things like status seem even more important then | 18:49 |
| bcsaller | because you don't want to see juju internal services by default | 18:49 |
| SpamapS | I don't know if its that clear | 18:49 |
| SpamapS | some would say they want to see *everything* they are responsible for. | 18:50 |
| SpamapS | I mean, every machine is effectively related to bootstrap | 18:50 |
| hazmat | bcsaller, yeah.. one step at a time though... namespacing might be a nice alternative to do strange internal service name checks for protection... with an option to show all namespaces | 18:50 |
| hazmat | it also helps when we start to exploring hierarchies of services | 18:50 |
| SpamapS | Cars existed a long time w/o seatbelts. :) | 18:51 |
| SpamapS | I don't know if you need safety up front. Just sanity. | 18:51 |
| bcsaller | did rockets ever not have seat belts though? | 18:51 |
| SpamapS | Oh dear.. please don't tell me I've wandered into the rocket science lab? ;) | 18:52 |
| jimbaker | again, wouldn't it make more sense to follow this plan: remove the SPOF by just having one active provisioning agent + some number of standbys. the PA is extensively tested to follow its design, that it can always be restarted | 18:55 |
| jimbaker | then implement a better provisioning agent, which in fact does parallelize work | 18:55 |
| jimbaker | this can also get to the more desirable quality that the PA is just another service | 18:56 |
| SpamapS | Honestly | 18:57 |
| SpamapS | even the most active site with 1000's of nodes | 18:57 |
| SpamapS | I doubt can overwhelm a single PA | 18:57 |
| SpamapS | ZK will be the choke point there | 18:58 |
| jimbaker | SpamapS, agreed. i think we might have some issues in how we iterate the topology, etc. but not in instructing the cloud provider on what to do next | 18:58 |
| jimbaker | SpamapS, for instance, i think we could be smarter about the watch mgmt in the expose logic in the PA. too much duplicate work when it's just operating on the the toplogy node. but that's just a matter of having a better watch setup. (or alternatively, moving expose to the machine agent!) | 19:01 |
| SpamapS | I kind of like how we're taking advantage of the provider firewall | 19:01 |
| jimbaker | SpamapS, sure, and it is transparent in the usage, so point well taken | 19:03 |
| SpamapS | 2011-10-19 19:03:20,032: hook.output@ERROR: + relation-get hostname | 19:04 |
| SpamapS | 2011-10-19 19:03:20,222: hook.output@ERROR: Traceback (most recent call last): | 19:04 |
| SpamapS | Failure: juju.hooks.protocol.NoSuchUnit: The relation 'mon' has no unit state for 'ceph/11' | 19:04 |
| SpamapS | So... | 19:04 |
| SpamapS | in a departed hook.. | 19:04 |
| SpamapS | I can't get the relation data? | 19:04 |
| hazmat | SpamapS, the provider firewall is just an optimization for ec2 at this point, it impl as the sole network security prevents security for other providers | 19:07 |
| SpamapS | Yeah seems like both are useful | 19:07 |
| hazmat | in the future with a machine level firewalls, the ec2 firewall can be maintained just as a provider specific optimization | 19:07 |
| hazmat | i've got another long email in the works on that topic | 19:08 |
| hazmat | time for a doctor's appt, bbiab | 19:08 |
| evandev | does anyone have any experience with installing hbase on ec2? I am trying to find any documentation. I currently have Juju installed with hadoop-master / slave charms and would like to get Hbase running | 19:50 |
| SpamapS | evandev: IIRC, the hadoop master and slave charms only give you HDFS | 19:51 |
| evandev | Correct, I was just wondering if anyone had taken it a step further and installed hbase on top of that | 19:51 |
| SpamapS | Have not.. but if you want to take a crack at it, I'm sure m_3 would be interested in helping. :) | 19:52 |
| SpamapS | m_3: ^^ | 19:52 |
| _mup_ | Bug #878462 was filed: resolved --retry does not retry the hook <juju:New> < https://launchpad.net/bugs/878462 > | 19:55 |
| evandev | cool thanks | 19:57 |
| SpamapS | evandev: can HBase and HDFS share the same set of namenode/slaves ? | 19:58 |
| SpamapS | evandev: if so it might be best implemented as a config option on top of the existing hadoop charms. | 19:58 |
| SpamapS | ugh.. departed hook executes in parallel with unit removal... | 19:59 |
| SpamapS | no way to gracefully remove a ceph monitor node from another one then. HRM | 19:59 |
| SpamapS | I suppose the stop hook would work | 19:59 |
| evandev | Yea that was my next question | 20:00 |
| evandev | I thought about modify the charms | 20:00 |
| SpamapS | evandev: if you have pulled them down with 'charm getall', simplest thing to do is to unbind the charm, commit your changes, and then push to a bzr branch. | 20:00 |
| evandev | modifying* | 20:00 |
| * SpamapS realizes thats not in a wiki page and remedies the situation | 20:00 | |
| robbiew | SpamapS: thnx | 20:01 |
| evandev | ahh I think ill try that | 20:01 |
| evandev | thanks SpamapS | 20:02 |
| hazmat | SpamapS, you mean in parallel across different units i assume, yeah.. | 21:00 |
| hazmat | SpamapS, stop hooks are not executed atm, nother topic for discussion | 21:01 |
| SpamapS | hazmat: so, yeah, we need to provide graceful shutdown for clusters | 21:06 |
| SpamapS | hazmat: I'm thinking that you should not actually destroy the unit until its departed hooks have finished on all related nodes | 21:07 |
| SpamapS | this is already well documented in bugs tho.. | 21:07 |
| _mup_ | juju/ssh-passthrough r409 committed by jim.baker@canonical.com | 21:40 |
| _mup_ | Test for parse errors | 21:40 |
| jimbaker | bcsaller, looks like you meant to do an approve on https://code.launchpad.net/~hazmat/juju/unlocalize-network/+merge/79476 | 22:02 |
| bcsaller | jimbaker: I thought the second person did the approve | 22:03 |
| jimbaker | sure, and i can do that, but your comment was just a normal comment, not an approve comment | 22:04 |
| jimbaker | bcsaller, ^^^ | 22:04 |
| bcsaller | yeah, it should have been an approve then | 22:04 |
| jimbaker | ok, i've just approved it, since it's pretty clear in the merge proposal the intent | 22:05 |
| jimbaker | bcsaller, do you want to propose your branch for bug 873643? it looks good to me | 22:11 |
| _mup_ | Bug #873643: config values are re-set to their default values when only one is changed <juju:In Progress by clint-fewbar> < https://launchpad.net/bugs/873643 > | 22:11 |
| bcsaller | jimbaker: I never got a reply from SpamapS about what he wanted done, I can propose my extension of his branch or he can merge and repush. | 22:12 |
| jimbaker | SpamapS, maybe you can delete your merge proposal for that bug? i don't know what the process should be, but i'm ready to approve bcsaller's work, between your trivial change and the reasonable test, it looks good with just the caveat that there's a grammatical error | 22:12 |
| jimbaker | in a comment | 22:12 |
| hazmat | bcsaller, you can just unlink the old branch and link yours | 22:13 |
| hazmat | its been pending for a while | 22:13 |
| bcsaller | hazmat: that might be best then | 22:13 |
| jimbaker | and it's high | 22:13 |
| hazmat | on life | 22:13 |
| jimbaker | it's really impacting actual usage, so we should get it in | 22:13 |
| SpamapS | Yeah if bcsaller's is complete please do move forward | 22:13 |
| SpamapS | thre | 22:15 |
| SpamapS | handled | 22:15 |
| SpamapS | https://code.launchpad.net/~bcsaller/juju/config-do-not-overwrite/+merge/79890 | 22:15 |
| SpamapS | hazmat: great email about the timeouts. I think I hit that just when my system load gets high because some things take 3+ seconds | 23:22 |
| SpamapS | hazmat: I think this may be another "production" bug.. when this hits.. the agents basically are dead in the water. | 23:40 |
| hazmat | SpamapS, ? | 23:41 |
| SpamapS | hazmat: The weirdness I reported last week seems to be a timeout | 23:41 |
| hazmat | SpamapS, what's the defect? | 23:41 |
| SpamapS | bug 875903 | 23:42 |
| _mup_ | Bug #875903: Zookeeper errors in local provider cause strange status view and possibly broken topology <juju:New> < https://launchpad.net/bugs/875903 > | 23:42 |
| hazmat | SpamapS its two different issues | 23:43 |
| hazmat | SpamapS, one the session expired, so the units are dead | 23:43 |
| hazmat | SpamapS, two status was reporting based on the recorded state instead of taking into account the presence of the connected agent | 23:43 |
| hazmat | the second issue has been addressed by a branch fwereade_ has in the review queue | 23:43 |
| hazmat | the first by the timeout email | 23:44 |
| SpamapS | Ok | 23:44 |
| SpamapS | I have been running into a lot of the weird status.. | 23:44 |
| SpamapS | not suspending/hibernating/anything | 23:44 |
| SpamapS | just using it through the day | 23:44 |
| hazmat | SpamapS, hmm.. with high load / swapping? | 23:45 |
| SpamapS | some load, no swap | 23:45 |
| SpamapS | disk is definitely *slammed* | 23:45 |
| hazmat | SpamapS, i'd probably attribute it to the same | 23:45 |
| SpamapS | I have no doubt that occasionally some things block for 3 seconds | 23:45 |
| SpamapS | which is why I moved my testing to an m2.xlarge for a while today | 23:46 |
| SpamapS | with a giant tmpfs volume | 23:46 |
| SpamapS | no such issues over there. :) | 23:46 |
| SpamapS | at $0.50/hour, its a bargain compared to dealing with my silly laptop | 23:47 |
| SpamapS | 2011-10-19 23:48:45,173:480(0x7fa28ae7f700):ZOO_ERROR@handle_socket_error_msg@1621: Socket [192.168.122.1:48263] zk retcode=-112, errno=116(Stale NFS file handle): sessionId=0x1331e917b100004 has expired. | 23:48 |
| SpamapS | 16:49:25 up 3 days, 17:12, 2 users, load average: 9.03, 5.04, 3.26 | 23:49 |
| SpamapS | hazmat: so .. yeah.. this is frustrating. | 23:51 |
| * SpamapS realizes he's late to pick up the little one and signs off for the day | 23:52 | |
| hazmat | SpamapS, yeah.. the fix is actually pretty small and straightforward, just needs some good tests | 23:52 |
| hazmat | i'm in progress on it, but trying to take some time today to reviews | 23:52 |
| hazmat | SpamapS, is suspect on ec2 its the vagaries of virtual and the load from the multiple units | 23:54 |
| hazmat | s/is/i | 23:54 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!