/srv/irclogs.ubuntu.com/2010/11/24/#ubuntu-cloud.txt

=== erichammond1 is now known as erichammond
=== whaley is now known as SirLoins
=== SirLoins is now known as whaley
=== nickol is now known as Ayman
=== Ayman is now known as AymanTaher
=== dendrobates is now known as dendro-afk
=== dendro-afk is now known as dendrobates
mars__are we starting in a few minutes now?14:56
kim0indeed14:56
nijabao/14:59
zulhi15:00
lckarssenhi15:00
kim0Hello everyone15:00
kim0Welcome to the very first Ubuntu Cloud Community Q+A session15:01
kim0It's very exciting to get in touch with all of you,15:01
kim0can everyone wave please15:01
kim0o/15:02
notgaryo/15:02
nijabao/15:02
dendrobateso/15:02
lckarsseno/15:02
kim0awesome15:02
kim0Any of you already using Ubuntu in a cloud context15:03
kim0can you share your experience .. your setup .. and your questions15:03
* nijaba assumes you exclude openstack and canonical people?15:04
kim0yeah :)15:04
kim0unless there is something interesting you would still like to share15:04
kim0why not15:04
kim0Any questions or comments .. time to shoot15:05
kim0dendrobates: notgary lckarssen you guys already played with Ubuntu in any cloud context ?15:06
nijabakim0: dendrobates = openstack15:06
kim0ah15:06
lckarssennope, not yet.15:07
kim0lckarssen: what interests you ? what would you like more info about15:07
notgaryI'm looking into setting up an Ubuntu server and am currently looking into the feature available. Is it possible to set up my own Ubuntu One cloud to which I can connect the U! client on my desktop?15:08
dendrobatesyes I have:)15:08
zuldendrobates: i would hope so :)15:08
lckarssenWe are working in life sciences and we're looking whether it is feasable to move to the cloud for our high throughput calculations. But as start we'd like to play around with a webserver first :-)15:08
kim0notgary: hmm, not quite sure, but as far as I know .. not all of Ubuntu-One is open-source15:09
nijabalckarssen: to a public or a private cloud?15:09
kim0notgary: you maybe able to setup cloud storage using sparkle share among other solutions15:09
nijabanotgary: quite sure you cannot, unfortunately15:09
lckarssenfor the test webserver we're probably going to use Amazon's free tier.15:10
kim0lckarssen: life science calculations sound like a pretty reasonable workload to offload to a cloud15:10
lckarssenFor the high throughput stuff Amazon's HPC offerings look nice, but our national compute center is also working on a cloud service15:10
kim0lckarssen: assuming it's bursty15:10
kim0lckarssen: so if you would like to play with Amazon's free tier .. and it's your first time15:11
lckarssenindeed, it is bursty. Right now we've only got one server of our own and work on a national cluster. But with new data coming up we need to scale up as well.15:11
kim0lckarssen: check out this guide I've written foss-boss.blogspot.com/2010/10/pointnclick-guide-to-running-ubuntu-in.html15:11
nijabalckarssen: that's will not give you much of an appreciation for the high throughput, though15:12
lckarssenkim0: thanks!15:12
kim0welcome15:12
lckarssenNo, that's true. But before working on that we want to wait until our national HPC center has finished it's tests (of its own cloud). Then we can compare.15:12
kim0lckarssen: I think running an internal cloud that can burst to ec2 as needed would make sense ..15:13
lckarssenA problem there is probably network bandwisth.15:13
lckarssenOr we would have to store all data both locally and in the cloud.15:13
kim0I think you can ship disks to ec215:14
kim0lckarssen: just interested how large is your dataset15:15
lckarssenRight now we're talking about about 5TB of shared data and about 3TB of user files (/home))15:15
lckarssenBefore the end of the year we will be looking at about 6TB of shared data.15:16
lckarssenI've caculated that 20TB EBS space would be kind of pricy, but we would pay only for what is acutally used of course.15:16
kim0unless you store it there permenantly and keep syncing it up15:17
lckarssenAnother issue is privacy. I still have to see whether our data is sufficently anonymised for us to be able to send it out of the country (another reason why our national compute center would be a handy place)15:17
lckarssenWhat would you suggest as management software for say 2-4 cloud instances? puppet? cfengine?15:18
kim0lckarssen: what are you currently using to launch the instances15:19
lckarssennothing yet :-)15:19
kim0hehe15:20
=== marrusl is now known as marrusl_afk
lckarssenI'd probably go for the command line tools in ubuntu's ec215:20
kim0ok basically .. to launch the instances .. yeah you can either use the graphical console or the cli tools15:20
kim0lckarssen: for basic customizations as the instance boots15:20
kim0you can use cloud-init15:20
kim0an ubuntu specific technology that helps bootstrap the instance as it boots15:21
kim0and gives it a "personality"15:21
lckarssenah, great.15:21
kim0once the system is up15:21
lckarssen(reading the cloud-init wiki page now)15:22
kim0puppet, chef are good choices for config management15:22
kim0other options would be bcfg2 and cfengine15:22
kim0vadi2: hey15:22
kim0vadi2: Welcome :)15:22
vadi2hi. I'd like to ask, just started on all of this yesterday - https://help.ubuntu.com/community/EC2StartersGuide says "And, of course, you're being billed as long the host is running" - does that mean as long as the instance is not stopped? There seem to be two options - to either stop or terminate them, and I'm not sure which one would keep billing you.15:23
kim0lckarssen: also landscape might be a good instance management tool since it manages the ubuntu guests as well (more unified). Might want to consider it15:23
vadi2If compared to vms, is terminate = shutdown vm, stop = pause vm?15:24
lckarssenkim0: Yeah, I'll definitely take a look at it. Read good things about ut15:24
kim0vadi2: EC2 offers 2 instance types15:25
kim0vadi2: instance store and ebs15:25
kim0for "ebs" instances .. once they're stopped ..15:25
kim0the machines still presist .. so .. they still consume storage and thus you are still paying for them15:26
kim0to stop paying for them .. you need to "terminate" them .. i.e. completely erase them15:26
vadi2okay15:26
lckarssenkim0: For the deployment of our HPC cloud instances, I'd like to create my own disk images (with all our software pre-installed). Could I prepare these images with vmbuilder, like i do for KVM VMs?15:26
=== daker_ is now known as daker
kim0lckarssen: indeed you can15:27
kim0lckarssen: I can try to locate you some instructions ..15:27
lckarssenkim0: great :-)15:27
* kim0 sifts thru emails :)15:27
nijabalckarssen: in fact, you can even test them with kvm before uploading them15:28
nijabalckarssen: smoser or kirkland have a post on that15:28
lckarssenThat's even better!15:28
* nijaba searches on cloud.ubuntu.com15:28
lckarssenI've found a discussion on the cloud mailing list: https://lists.ubuntu.com/archives/ubuntu-cloud/2010-November/000400.html15:29
smoserhttps://help.ubuntu.com/community/UEC/Images discusses booting ours on kvm15:29
kim0lckarssen: might be interesting on publishing images https://wiki.ubuntu.com/UEC/Images/Publishing15:29
smoserhttps://wiki.ubuntu.com/UEC/Images/Publishing discusses how ours are built15:29
smoseri have to leave15:29
kim0thanks Scott15:29
lckarssensmoser: thanks15:30
kim0lckarssen: if the amount of tools to be installed is not large .. and is updated frequently15:30
kim0lckarssen: it may even make sense to start a prestine image and auto install everything with cloud-init or a similar technology15:30
lckarssenI'll play around with that option as well. with things like the gridengine packages that might even be easier (using puppet or the likes for per-machine configuration)15:32
vadi2Silly question, but I can't find the page where aws would show me my current bill. I'm just starting out in this (using the 15gb ubuntu image, because instructions for 10gb didn't work) and would rather not work anything huge up by accident.15:32
lckarssenvadi2: I'd be interested in that as well :-)15:33
kim0hehe15:33
kim0Visit https://aws-portal.amazon.com/15:34
kim0login ..15:34
kim0click "Account" on the main navigation bar15:34
kim0then "Usage reports"15:34
kim0and continue15:34
kim0actually "Account Activity" is easier to consume15:34
vadi2ah thanks. definitely not something intuitive15:34
lckarssenkim0: thanks15:34
kim0usage reports is much more detailed15:35
kim0cool15:35
kim0Great .. If you guys have any other questions .. feel free to use15:36
kim0the Ubuntu cloud forums: http://ubuntuforums.org/forumdisplay.php?f=39215:36
kim0This IRC channel15:36
kim0the ubuntu-cloud mailing list : https://lists.ubuntu.com/mailman/listinfo/Ubuntu-cloud15:37
kim0If any of you would like to contribute to Ubuntu cloud or has done something cool around it .. please do let me know (kim0 AT ubuntu.com)15:37
vadi2cool, thanks much15:38
vadi2oh, is a 10gb instance planned?15:38
lckarssenthanks kim015:38
kim0vadi2: um, I think for natty it is15:38
kim0vadi2: smoser would be able to confirm15:39
lckarssenAnother question: if you are running an instance in the cloud, could you configure it in such a way that if the load (or some other performance metric) is too high for, say 5 minutes, a second instance is automatically started?15:40
kim0lckarssen: yep15:41
kim0lckarssen: you're talking about amazon ec2 ?15:41
lckarssenkim0: yes (at the moment)15:41
kim0lckarssen: http://aws.amazon.com/autoscaling/15:41
hermeskim0: I think I spoke to personally thru the chat your earlier couple of weeks ago about doing stuff into the CLoud. But due to a major launch at my company I could not do anything into. I remember You also gave me a couple of links to start off with but unfortunately I could not do much. So I think I can buy sometime and would like to resume. How do we go about that15:41
kim0hermes: so what exactly were you interested in working on15:42
lckarssenkim0: thanks again!15:42
kim0lckarssen: most welcome :)15:42
kim0hermes: You are interested in development ?15:44
* kim0 stresses his spectacular memory :)15:44
hermeskim0: yes most definitely development15:45
kim0Awesome ..15:45
kim0I can give a list of links to projects15:45
kim0relating to Ubuntu and cloud15:45
kim0and you can see what interests you15:45
kim0to start working on15:45
kim0https://code.launchpad.net/~ubuntu-on-ec2/ubuntu-on-ec2/cloud-utils15:46
hermeskim0: I remember u telling me something about the Open-Stack and that some stuff can be done but I could not do a lot of reading at that time. B15:46
hermesalright I am on it15:46
kim0Indeed, open-stack is a very active project that you can engage in15:46
kim0I'll keep pasting some links15:46
kim0https://launchpad.net/vmbuilder15:46
kim0https://launchpad.net/cloud-init15:46
kim0https://launchpad.net/eucalyptus15:46
kim0https://launchpad.net/uec-testing-scripts15:46
kim0https://launchpad.net/openstack15:46
kim0https://launchpad.net/awstrial15:46
kim0https://launchpad.net/ensemble15:46
* kim0 enjoys spamming the channel :)15:47
kim0hermes: feel free to engage in bug triaging and feature development in any of these projects15:47
kim0hermes: If you find any Ubuntu cloud related project that's not here, let me know as well15:47
kim0hermes: for any of those projects15:48
kim0you can visit bugs.launchpad.net15:48
kim0and blueprints.launchpad.net15:48
kim0to locate bugs that you can work on15:48
kim0and feature additions that you can start implementing15:48
kim0hermes: sounds good ?15:48
hermeskim0: ok15:48
kim0Awesome :)15:48
hermeskim0: pretty much15:48
kim0hermes: also testing UEC deployments .. reporting bugs15:49
kim0hermes: and trying to fix them is pretty cool15:49
kim0hermes: UEC is based on the eucalyptus project above15:49
kim0So .. anyone else got any question15:50
hermeskim0: Just a little more help I ll have to wrap my head a little bit on Bazaar coz its been a long time I hv been away15:51
lckarssenkim0: nope, you've given a lot of info already :-)15:51
kim0hehe lckarssen thanks15:51
hermesCould u suggest something that shall help to download the code, edit it code and then submit my changes etc15:51
kim0hermes: launchpad can help you with that15:52
hermesok15:52
kim0hermes: so the basic workflow is15:52
kim0hermes: you "bzr branch projectX"15:52
kim0you get the source code15:52
kim0you add a feature or fix a bug15:52
kim0you bzr commit15:52
kim0"bzr push" it to your separate branch15:52
kim0then propose the branch for merge15:52
kim0If your code fixes a bug .. you can link it to the bug it fixes as well15:53
kim0hermes: bzr integrates quite nicely with launchpad, once you learn it .. it's a bliss :)15:53
hermeshmm ok that I have been using GIT so I getting the idealogy is pretty much like that15:53
kim0hermes: indeed .. both are distributed scms15:54
kim0I just like bzr more :)15:54
hermesCool I guess with a little scanning thru I would be able to wrap my head around bzr15:54
hermesI would need to generate some Keys and also have a launchpad account I suppose15:55
kim0hermes: yeah .. you can easily register to launchpad15:55
kim0and upload your ssh keys there15:55
lckarssenhermes: I was quite impressed with the bzr user guide http://doc.bazaar.canonical.com/latest/en/user-guide/index.html15:56
kim0lckarssen: thanks :)15:56
hermeslckarssen: thanks I ll look at that :-)15:56
kim0hermes: most people find bzr more user friendly than git .. at least I did hehe15:56
hermesYEs it is15:56
hermesI have used it long time back during the UBuntu Developer Week15:57
hermesI just dnt remember now, I think the user guide shud help15:57
kim0hermes: since you already played with it .. just running "bzr help command" might be helpful as a reminder15:58
kim0like, bzr help branch15:58
kim0okay, this session is coming to an end ..15:58
kim0Thanks everyone for coming by15:58
kim0Let me mention our main communication channels again15:59
kim0- the Ubuntu cloud forums: http://ubuntuforums.org/forumdisplay.php?f=39215:59
kim0- This IRC channel15:59
kim0- the ubuntu-cloud mailing list : https://lists.ubuntu.com/mailman/listinfo/Ubuntu-cloud15:59
kim0If any of you would like to contribute to Ubuntu cloud or has done something cool around it .. please do let me know (kim0 AT ubuntu.com)15:59
kim0see you next week :)15:59
lckarssenkim0: Thanks again!15:59
hermeskim0: session next week?16:00
kim0lckarssen: You're welcome16:00
kim0hermes: Yep .. it is weekly16:00
kim0#Q+A session ends16:00
* kim0 lurks in the channel16:00
kim0drop me a line should you still need any help16:00
hermeskim0: Sorry but when does this happen weekly, so I could make sure I dnt miss it16:01
kim0same time :)16:01
kim03pm UTC Wed16:01
kim0this is just the very first time16:01
kim0so you didn't really miss any session yet hehe16:02
* kim0 going into a meeting16:02
vadi2kim0: min.us runs ubuntu on amazon, btw16:17
vadi2http://www.reddit.com/r/technology/comments/e9v5c/imgur_has_some_serious_competition_introducing/c16jyxn?context=316:18
=== dendrobates is now known as dendro-afk
=== dendro-afk is now known as dendrobates
=== erichammond1 is now known as erichammond
=== erichammond1 is now known as erichammond
=== erichammond1 is now known as erichammond

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!