/srv/irclogs.ubuntu.com/2010/11/17/#ubuntu-cloud.txt

ernophey guys, got a question - i had an AMI in one region and used cloudyscripts "copy AMI to another region" thing to copy it.  but when I start the new instance, I can't connect - ssl times out.  Is there some step i'm missing?  I can start copies of it in the original region and connect no problem.03:58
ernop(and I am running a modified 10.10 server AMI)04:01
SpamapSernop: my first question would be why are you using a modified AMI? (keep in mind, I'm a novice, but I only ever use cloud-config customized instances)06:46
Makerekind of lost of where to start to get an image dl'd from http://uec-images.ubuntu.com/releases/ to run07:13
Makereany ideas what I should check?07:13
ernopSpamapS - by modified I just mean that I have installed a bunch of my own stuff on it.  Thing is, it worked in the original region.07:22
SpamapSMakere: meaning downloaded to run in UEC (as in, eucalyptus) ?07:40
SpamapSernop: yeah, I think I'd do that by putting all of my stuff in a dir and tarring that dir up, or use a proper config management system like puppet/chef.07:42
MakereSpamapS: yes07:42
Makereand used the uec-publish-tarball07:43
Makereto push it there07:43
Makerefml07:53
ernopSpamapS ok, good idea.08:43
=== nijaba is now known as nijaba_afk
=== nijaba_afk is now known as nijaba
MakereSo I tried creating a new uec image using this guide: http://cssoss.wordpress.com/2010/05/10/eucalyptus-beginner%E2%80%99s-guide-%E2%80%93-uec-edition-chapter-4-%E2%80%93-image%C2%A0management/11:47
Makerethe instances get stuck on pending, any troubleshooting tips?11:48
Makerewhy the store images run13:23
Makerebut I can't get my own images to run13:23
Makerenor images from uec-images.ubuntu.com13:24
Makereok13:43
Makerethe problem I had was that it doesn't work if I bundle on cloud controller13:43
=== zul is now known as ep
=== ep is now known as zul
smoserMakere, i would doubt that its related to where you bundle14:16
smoserremember that when you do a run-instances after uploading, the first time it will have to copy from walrus to node, change format of image (adding a partition table and such), before running14:17
smoserthat is a lot of IO and will be very slow for something large14:17
smoseryou can debug a bit more by figuring out where your instance is going to run (euca_conf --list-nodes) and then looking at the node. top will show you some things. likely there is something in /var/log/eucalyptus or /var/lib/libvirt14:19
Makeresmoser: well I waited for an half an hour, kvm doesn't run on the node14:52
Makerenode logs don't have any errors14:53
smoserhm..14:53
MakereI have nc log upped somewhere14:54
Makereif you want I cna put it to pastebin14:55
Makerebut personally I think to myself as case closed, and will not compile on the cloud controller anymore14:55
Makerebundle* not compile14:55
Makereit worked charmed after bundling on cluster controller14:56
Makerelike a charm*14:56
Makeresorry, a bit tired14:56
MakereI have walrus and cloud controller on same machine14:57
Makereand cluster controller + storage controller on other two14:57
Makereplus nodes14:57
smoserwell, for what its worht, i have a cloud (10.04 right now, but i've used 10.10) with just 2 systems14:57
smoserone is CC CLC and SC, one is just NC14:57
smoserand i do everything from the CC/CLC/SC node.14:57
MakereI think it might have something to do on cloud/walrus controller not having CC on same machine14:58
smoserit won't make any difference, but if you find the bundle and upload process to be a bit obtuse, you can use 'uec-publish-tarball' or 'uec-publish-image'14:58
=== dendrobates is now known as dendro-afk
MakereI did my own image with the publish-image14:59
Makeresame thing as with publish-tarball on official images14:59
smoserah. ok.14:59
smoserjust wanted to make you aware that is there.14:59
Makereyea thanks14:59
smoseronce you've uploaded, i seriously can't see a difference in where the bundle was done14:59
=== dendro-afk is now known as dendrobates
smoserafter bundle, its already loaded into walrus, and the NC will do the get from walrus. no path there would be affected by where the 'bundle' command was run.15:00
Makerehttp://open.eucalyptus.com/forum/i-still-can-only-run-instances-store-images same problem here15:00
Makerefound the answer from there15:01
Makerealthough in the "answer" I got the guy seems to have run CLC CC SC and Walrus on same PC15:02
Makere("Ok, so I really don't know" by seigie) in the middle15:02
Makereweird thing is that I/We reinstalled the cloud 4 times15:03
Makereand everytime same problem15:03
Makerewith diff settings etc15:03
Makereah well, just wanted too put a heads up if anyone gets same kind of problem15:04
smoseryou get the errors like that in the logs ?15:04
Makeredon't have the logs here now15:05
smoserwell, the right thing to do is open an ubuntu bug15:06
Makereyea15:06
smoserso, go through the steps again15:06
smoserwriting down what you do and your setup (CC/CLC and such)15:06
smosersee the failure15:06
smoserthen run 'ubuntu-bug eucalyptus' on the system that has those ERROR messages in the logs15:06
smosersorry to give youthe run-around, but in the end, that is what is most likely to get the problem solved for you.15:07
TritoLux_hello there, anybody?15:31
TritoLux_I am trying to setup a cloud test environment and I managed to get it to work, but it gives random network problems when multiple users run multiple instances. The Eucalyptus team told me that it is a UEC specific problem and I would need some help to troubleshoot. Is there anybody willing to help?15:32
TeTeTTritoLux_: can't promise anything, have you tried connecting via public or private ip? And are the instances really up and running? You can check that with euca-get-console-output16:23
TritoLux_hi there, yes everything seems to work fine, I can administer the instances via hybridfox with no problems, apparently.. but when a second user starts his own instance, then the other users loose the attached volumes from the SC and they even have to reboot their instance in orger to regain connectivity16:25
TritoLux_after rebooting the instances, then nobody can detach the previously attached volumes and I have to reboot the cloud to restore functionality, until the same problem occurs again16:26
TritoLux_thanks for replying btw16:26
TritoLux_I have been troubleshooting this problem with the Eucalyptus team, but after a couple of months they are still puzzled and they said that it is UEC specific16:30
TeTeTTritoLux_: sounds bad. I would recommend opening a bug about this in Launchpad against the eucalyptus package16:31
TritoLux_the Eucalyptus team suspects AoE to be the problem16:32
TritoLux_for instance, when I launch an instance, I get this error message in the livirt log: pci_add_option_rom: failed to find romfile "pxe-e1000.bin"16:33
TritoLux_for instance, when I launch an instance, I get this error message in the libvirt log: pci_add_option_rom: failed to find romfile "pxe-e1000.bin"16:33
TritoLux_I wonder if it is related16:33
TritoLux_I also removed the AppArmor security layer in order to see if it was causing the problem, but pretty much nothing has changed16:34
TritoLux_as a matter of fact, I was never able to have a stable cloud based on UEC16:36
TritoLux_thanks for your responses TeTeT, I will eventually shoot a bug in Launchpad, but if anybody else has any advices in the meanwhile that would great. I can provide you with all logs and configs of course16:39
TeTeTTritoLux_: I think the error is unrelated. it goes away when you add some kvm-pxe package16:41
TeTeTTritoLux_: btw are you on 10.04 LTS or on 10.10?16:41
TritoLux_I started with 10.04 LTS and I performed a dist-upgrade16:41
TritoLux_it is currently running with all latest available packages16:42
TritoLux_the environment is set with 2 machines, one running CLC, CC, SC, Walrus and the other one running the NC16:44
TritoLux_both have dual NIC's, the CLC uses a public NIC and the CC is installed on a private NIC16:45
TritoLux_eucalyptus.conf is set to run both priv and public traffic on the bridge configured on the non public interface16:46
TritoLux_the nic's are configured for multiclustering, even if it is running only one at the moment16:47
TritoLux_the eucalyptus guys had a look at the network config and they said that it is supposed to work fine16:48
TritoLux_however, because both public NIC and private NIC are configured with a static address, then avahi autoregistration failed during UEC installation and it cost me some troubles to arrange a properly registered node. Now the node registration seems fine, but I wonder if the initial failure might have caused more problems16:52
TritoLux_the network mode is MANAGED-NOVLAN16:52
TritoLux_I have no error messages in the logs, until the above problem occurs16:53
TeTeTTritoLux_: I register nodes from hand all the time and have not discovered your problem. But then I just do training and not some pre-production tests16:53
TritoLux_if you try to install a cloud where the CC is running on a private NIC with a static IP then you will reproduce above registration problem16:54
TritoLux_so to have a main IF on the public NIC and the nodes to be discovered on a private NIC, both with static IP's16:55
TritoLux_the UEC installation process allows you to choose a static IP on the main NIC, but the same question is not asked for the secondary NIC and it assumes DHCP on that one16:57
TritoLux_then autoregistration fails16:57
TritoLux_the above problems are preventing us to start our cloud business at the moment and switching to Debian is currently being taken into consideration to be honest16:58
TritoLux_basically, it seems that I cannot run more than a customer onto an apparently working cloud, otherwise the entire network gets messed up, as in connectivity getting lost, attached volumes becoming unaccessible, etc. rebooting the cloud seems the only solution to restore funzionality again.. for a single user, until a second one starts another instance.17:04
TritoLux_I have tried to run more instances from a single user and it seems to work fine. The problems occur mainly or only when a different user starts to interact with the cloud.17:06
TeTeTTritoLux_: not sure if the multi user scenario is well tested. I use it in the trainings, but this cloud only exists for a week17:09
TritoLux_I think that multiuser is essential to a cloud, otherwise we miss the point of having a cloud. But I think that the multi-nic scenario is even less tested.17:10
TritoLux_at least when you have both IF's with static IP addresses17:11
TritoLux_my idea is to have just the CLC facing the public and the rest of the cloud interacting through a private network so that the public cannot even reach the other nodes17:13
TeTeTTritoLux_: sound idea17:16
TritoLux_eheh, it might be a good idea, but I wasn't able to get it to work in practice so far, unfortunately17:18
TeTeTTritoLux_: I believe it's a scenario that should be supported17:18
TritoLux_I am quite sure it is supported indeed, but it hasn't worked for me so far17:19
TritoLux_and I dunno why17:19
TritoLux_as we speak, two more boxes are being setup for a debian testing environment which will be configured in the same way, so to see if it is really an UEC problem or not.. thing is that Debian alred17:21
TeTeTgood luck with that17:22
TritoLux_as we speak, two more boxes are being setup for a debian testing environment which will be configured in the same way, so to see if it is really an UEC problem or not.. thing is that Debian already runs Eucalyptus 2.017:22
TeTeTas does maverick17:22
TritoLux_and UEC is running 1.6.217:22
TritoLux_Maverick is not the dist I have then17:22
TeTeTTritoLux_: hmm, you really should try it then, I believe17:23
TeTeTTritoLux_: it's not an LTS, so support will run out in 18 months time though17:23
TritoLux_I am running the LTS distribution17:23
TeTeTthat's 10.04 LTS17:24
TritoLux_yes17:24
TritoLux_I thought that the LTS was more stable though, that's why my boss set it as a requirement17:25
TritoLux_or at least better tested17:25
TeTeTTritoLux_: it basically is, but with UEC it's still a pretty new product and big improvements are made with each release17:27
TritoLux_that's understandable17:27
TeTeTTritoLux_: the biggest step for 10.04 LTS in regards to UEC was IMO the neat installation via the CD17:27
TeTeTTritoLux_: I know there have been made all kind of tests for stability, but I doubt the multi user and multi nic scenario is one of them17:28
TritoLux_I think that the multiuser and multi nic scenario would be one of the most requested for production environments though17:29
TritoLux_if I remember correctly, the initial tests we run when we approved UEC were run on a single NIC and everything went pretty much ok, but when we had to go in production environment, then things changed of course and more requirements were set.. but UEC didn't work well anymore17:32
TritoLux_when do you think that Euca 2.0 will be available for LTS?17:32
TeTeTTritoLux_: not sure, unless there's a strong business case probably never. I don't see anyone putting resources into a backport17:33
TritoLux_auch, sorry what's the advantage of running LTS then?17:34
TeTeTTritoLux_: security updates for 5 years on the server. It's not about getting the latest software17:35
TeTeTTritoLux_: it's just my 2 cent, but I'd evaluate UEC on Maverick, upgrade that on a six month base and then go with the next LTS for long term production deployment17:35
TeTeTTritoLux_: but not sure if that meets your project specs17:36
TritoLux_mmh.. I thought it was both17:36
TritoLux_that's a good suggestion indeed17:36
TritoLux_thanks for your help, I will have to discuss this with my colleagues and better explain the scenario17:37
TritoLux_there might have been misunderstandings on the LTS concepts17:38
TeTeTTritoLux_: good luck, couldn't provide much though17:38
TritoLux_I appreciate your response anyway, thanks for your effort nevertheless17:39
TritoLux_it's not a simple issue anyway17:39
TeTeTagreed17:40
TritoLux_I'll go for a break now, speak you soon maybe17:41
TritoLux_thanks again17:41
TeTeTwill be off soon, bye17:41
TritoLux_bye bye17:42
=== zul_ is now known as zul
=== xfaf is now known as zul
smosererichammond, you still unable to find anyway to update ami pages, right?19:26
smoserit sure seems like they're just in flux, but i opened a ticket and reopened several times.  iwas told that to edit a page i should "submit an ami" and mention that it is an update to an existing page in the body.19:27
kiallanyone had any luck using the EC2 PHP SDK with euca/UEC?19:37
erichammondsmoser: I guess I've given up on Amazon's AMI pages since I haven't updated them in forever.21:18
smoseri'm somewhat peeved at them over it.21:18
erichammondsmoser: I guess I should put in one more update that just says "this AMI has been superceded by the new recommended official Ubuntu AMIs..."21:18
smoseri recently made an effort on them, to move out of the canonical account (the one that owns our images) to another21:18
smoserso that people who updated those dont have to know credentials that could cause issues.21:18
smoserbut now, i can't even update the ones we have21:19
erichammond:(21:23
smoseri really think that they're probably just in transition. visually there are changes.21:24
smoserbut there is no external announcemnt of such a thing, and its been going on for the better part of a month21:25
kiallhumm, smoser think I just discovered a bug in the UEC API .. Might be normal tho! You know sec group names on describe instances come back as "group" while on run_instances come back as "<uec_username>_group" ..21:32
kiallthat the way EC2 does it? (I havent used their API)21:33
smoserwhat is uec_username ?21:34
kiallthe username you use to login to the CLC web UI21:34
smoseri think its probably a bug.21:35
kiallso desc instances might return "default" while run will return "admin_default" when using the admin account ...21:35
kiallcrap .. time to go digging again ;)21:35
smosersome things are different with admin21:36
kiallAlso .. the only way I've gotton euca to build is on a PPA with updates turned off .. is there some trick to built it after you do a "apt-get dist-upgrade"?21:36
kiallWell, im not using the admin user .. just thought it was a good example ;)21:36
smoserif it fails to build from source, then please open a bug21:38
smoserand you're saying the API lists the user name ?21:38
kiallyes - the group name returned (assuming group = "app" and username = "kiall") by describe is "app" while run instance returns "kiall_app"21:39
smoserkiall, i'd have to look at it more, but i've never noticed differing output in the utility21:53
smoserin euca2ools when working with ec2 verusus uec21:53
smoserso i'd expect that its not different from what comes back from the api21:53
smoserbut i dont use security groups much21:53
kiallI'll dig in a little more and look at the raw output rather than what the PHP EC2 SDK is giving me .. possibly a bug elsewhere21:53
kiallYup - The euca API is def handles group names differently ..21:59
TritoLux_hello there, I would like to upgrade 10.04LTS to 10.10, which means also a major upgrade from Eucalyptus 1.6.2 to 2.0.. is there any particular step to be concerned of? any known problems? would the existing cloud keep all volumes, credentials and configurations? thanks in advance for your answers22:02
smoserkiall, thanks. please do open a bug against eucalyptus22:02
kialljust getting it together now22:03
smoseragain, using 'ubuntu-bug eucalyptus'22:03
kiallhumm?22:03
smoserif you use 'ubuntu-bug eucalyptus' on the system, then it will put some info in the bug about what versions you're using22:03
smoserit will also collect logs if you allow it22:03
smoserthats why i suggested you do that on the machine with the Errors earlier (regariding your fialure to leave 'pending')22:04
smoseri've got to run.22:04
kiallAh that wasnt me ;)22:04
smoseri think it was22:04
kiallNope - last thing we talked about was hairpin NAT22:04
smoserhm.. so it was. i confused you with Makere22:05
smoseranyway.22:05
smosersame deal goes for you :)22:05
smoseruse ubuntu-bug eucalyptus , that collects some system info22:05
kiallI'll see if that works over SSH to the server .. dont have it installed locally..22:06
kiallthanks ...22:06

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!