| kim0 | raymdt: Morning | 10:06 |
|---|---|---|
| superxgl | hi, is there any one who have successfully configured hadoop on Eucalyptus cloud? | 14:13 |
| superxgl | Does any one know how to do ? | 14:14 |
| kim0 | superxgl: hey, I once configured a hadoop cluster. I don't really think they're related | 14:20 |
| kim0 | i.e. after you get your cloud instances running, you can run hadoop on top like any other application right | 14:21 |
| superxgl | hmm,but.. | 14:40 |
| superxgl | the problem is | 14:40 |
| superxgl | how to make hadoop interact with walrus, instead of copying data from local file system to hdfs? | 14:41 |
| superxgl | and how to start several instances such that each instances runs like a slave node of hadoop? | 14:42 |
| superxgl | how to ensure that hadoop access my private cloud s3(walrus in eucalyptus) instead of the amazon's s3? | 14:44 |
| superxgl | i want to setup a hadoop cluster using the vm instances in the cloud | 14:45 |
| === dendrobates is now known as dendro-afk | ||
| === dendro-afk is now known as dendrobates | ||
| === uvirtbot` is now known as uvirtvot | ||
| === uvirtvot is now known as uvirtbot | ||
| zoopster | superxgl: forgive my ignorance as I've never set it up, but as I understand it you would use it the same as you would in EC2 | 15:13 |
| zoopster | superxgl: the same syntax/usage model applies to hadoop in UEC/eucalyptus as it would in EC2 | 15:15 |
| superxgl | zoopster: thank you. but how cloud i make hadoop interact with walrus? | 15:17 |
| zoopster | superxgl: do you mean how do you change the configuration to point to walrus vs hdfs? | 15:18 |
| zoopster | superxgl: it's the same as changing it to s3, no? | 15:19 |
| superxgl | zoopster: hmm..let me think | 15:20 |
| zoopster | superxgl: so for a basic hadoop implementation you change the details in the hadoop-ec2-env.sh not sure about cloudera's or yahoo's implementation | 15:22 |
| zoopster | superxgl: if you are replacing hdfs with s3 then you need to update the hadoop-site.xml file with the appropriate changes for s3? | 15:23 |
| zoopster | superxgl: looks like whirr is a better option these days...same concepts apply | 15:24 |
| superxgl | zoopster: thank u very much.i will have a try. | 15:25 |
| superxgl | hmm..what is whirr? sorry, i dont know it. i will google | 15:25 |
| zoopster | superxgl: have fun... http://incubator.apache.org/whirr/ | 15:26 |
| zoopster | superxgl: keep in mind that most syntax will be the same in ec2 as in eucalyptus - the naming and paths may be different, but the concepts are similar if not identical | 15:27 |
| superxgl | zoopster: thanks:) u help me a lot today. | 15:28 |
| zoopster | superxgl: glad to help...let us know how it works out! | 15:30 |
| kim0 | whirr looks cool thanks @ zoopster | 15:30 |
| superxgl | zoopster: thanks again. i will have a try | 15:31 |
| kim0 | superxgl: Once you get it running like a champ, and if you're interested about sharing your setup with the community, please let me know :) | 15:31 |
| superxgl | kim0: okay. i will:) | 15:32 |
| kim0 | superxgl: rock on :) | 15:32 |
| superxgl | thanks :) | 15:33 |
| === dendrobates is now known as dendro-afk | ||
| === dendro-afk is now known as dendrobates | ||
| === dendrobates is now known as dendro-afk | ||
| === dendro-afk is now known as dendrobates | ||
| CharlieSu | Anyone setup OVPN on Ec2 before? I'm trying on a Ubuntu instance and anytime I add a bridge interface and bring it up my instance goes dark. No more network connectivity. Any ideas? This is the config I'm adding. https://gist.github.com/e9ed7188be1d1ee04f16 | 20:46 |
| erichammond | CharlieSu: I wrote this a long time ago: http://alestic.com/2009/05/openvpn-ec2 | 21:04 |
| === Nolar_ is now known as Nolar | ||
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!