/srv/irclogs.ubuntu.com/2011/04/06/#ubuntu-cloud.txt

=== dendro-afk is now known as dendrobates
=== dendrobates is now known as dendro-afk
=== dendro-afk is now known as dendrobates
=== gtaylor2 is now known as gtaylor
=== txwikinger2 is now known as txwikinger
=== the-internet is now known as fw0rd
=== dendrobates is now known as dendro-afk
=== orangeac1e is now known as orangeacme
=== daker_ is now known as daker
=== Hussain is now known as Guest6540
TeTeTkim0: thanks for your support of my membership application :)12:17
kim0TeTeT: most welcome ;)12:17
flaccidmembership eek12:21
flacciddebian images away!12:21
flaccidhttp://www.rightscale.com/library/multi_cloud_images/All?search%5Badvanced_search%5D=&search%5Bfilter_value%5D=debian&search%5Bfilter_type%5D=title&search%5Bprice%5D=&search%5Border%5D=date_desc&x=0&y=012:22
=== daker_ is now known as daker
=== kdoandal is now known as nevrax
=== dendro-afk is now known as dendrobates
=== uvirtbot` is now known as uvirtbot
=== dendrobates is now known as dendro-afk
navanjrTeTeT: me again! ... network and disk do not appear to be an issue with my performance.  I have been trying to find a way to run a GFlop test on my instance. no luck so far.15:57
navanjri did notice something interesting in my cpuinfo...  model name: QEMU Virtual CPU version 0.12.515:59
navanjryesterday you asked about QEMU15:59
=== dendro-afk is now known as dendrobates
navanjrwhat does it mean if I find this message in my libvirt logs... Could not initialize KVM, will disable KVM support16:23
navanjrMy instances run, however slow.16:24
TeTeThi navanjr , I think it means you're running with qemu instead of kvm. Are you sure that kvm is enabled in the BIOS?16:24
navanjri thought i was sure...16:24
kim0navanjr: what's the output of kvm-ok on the NC16:24
navanjrnate@nc:/var/log/libvirt/qemu$ kvm-ok, INFO: Your CPU supports KVM extensions, INFO: /dev/kvm exists, KVM acceleration can be used16:25
TeTeTkim0: I had it happen once in an on site training that kvm-ok reported fine, but still qemu was used16:25
kim0:s16:26
navanjrthe line right above... open /dev/kvm: Permission denied16:30
TeTeTnavanjr: on the node, if you just start kvm on the command line, what's the output?16:35
TeTeTnavanjr: if there's none, means you're good16:36
navanjrwell, im not good. :)16:37
navanjropen /dev/kvm: Permission denied, Could not initialize KVM, will disable KVM support, pci_add_option_rom: failed to find romfile "pxe-rtl8139.bin", Could not initialize SDL - exiting16:38
navanjrdo i just need to chown of the /dev/kvm ?16:38
navanjrnate@nc:/dev$ ls -lh kvm,  crw-rw---- 1 root root 10, 232 2011-03-18 11:30 kvm16:40
kim0navanjr: it's root:kvm for me16:41
kim0on natty16:41
navanjrok i changed it....16:42
TeTeTkim0, navanjr : root:kvm for me on Lucid too16:42
navanjrso when i "sudo kvm" on the node16:43
navanjrhere is what i get...16:43
navanjrpci_add_option_rom: failed to find romfile "pxe-rtl8139.bin"16:43
navanjrinit kbd.16:43
navanjrCould not open SDL display16:43
kim0UEC shouldn't really use kvm's SDL interface16:44
navanjrany worries there?16:44
TeTeTnavanjr: install kvm-pxe to let the romfile problem go away16:44
TeTeTnavanjr: looks better than before I'd say16:44
TeTeTnavanjr: maybe time to launch another instance and see if it's any faster16:44
navanjrcool, i really appreciate you help so far!16:44
navanjrill report back16:45
TeTeTbe back later16:50
=== herki_ is now known as herki
SpamapSsmoser: re the udev thing.. I notice now that udev has moved from 165 to 167 since you reported the Connection Refused bug. Are you still seeing problems in the automated tests?17:07
navanjrthanks guys!  my instances are now running in KVM.  I have some new issues now.  Now my console says there are errors in clould-init.  all my new test are without any user-data.17:11
navanjrlast line on the console... landscape-client is not configured, please run landscape-config.17:12
kim0navanjr: r u using the default networking mode, managed-novlan17:12
navanjrmanaged-novlan17:12
kim0navanjr: that one is normal .. ignore it :)17:12
navanjrthe instance is running... virsh list says so17:13
navanjrresponds to ping17:13
navanjrbut cant ssh17:13
kim0It's probably hung waiting for user-data17:13
kim0takes like 20 mins to time out !17:13
navanjroh17:13
navanjrconsuming user data failed!17:14
navanjrTraceback (most recent call last):17:14
navanjr  File "/usr/bin/cloud-init", line 90, in <module>17:14
navanjr    main()17:14
kim0I'm not really sure why the user-data service would have problems in uec17:14
navanjrhere is my console output... (fwiw)  http://pastebin.com/QcJgwFgS17:17
=== cmagina is now known as cmagina-lunch
TeTeTnavanjr: got better performance now?17:26
navanjrsure Do!17:27
navanjrhaving some trouble with cloud-init17:27
navanjrhttp://pastebin.com/QcJgwFgS17:27
TeTeTnavanjr: hmm, that's bad, can you try a more recent image, like the released maverick one and see if that works? If not it might mean that your front-end is not setup correct17:33
navanjrit was all working previously to the chmod17:35
navanjrand the apt-get install kvm-pxe17:36
navanjron the NC17:36
TeTeTnavanjr: maybe a temporary issue, launch another instance and check17:36
TeTeTnavanjr: I believe that very old lucid images had a problem with timeouts and cloud-init, but it was fixed, so I asked for trying out maverick17:37
navanjrok will do!  ill let you know. thanks, TeTeT17:40
=== cmagina-lunch is now known as cmagina
smoserSpamapS, i believe we saw the bug in beta1 testing18:00
SpamapSsmoser: hrm18:01
smoserhttp://jenkins.qa.ubuntu-uk.org/view/natty-ec2/job/natty_ec2_ap-southeast-1_all-zones/3/artifact/ap-southeast-1b/i386/m1.small/instance-store/i-c518d190/3b5d50de-fc22-4e17-88fd-2b3a74e8e63b-timeout.console.txt/*view*/18:01
smoserthat is a beta1 log18:01
SpamapSsmoser: its *really* a bitch to debug udev18:02
smosernow, beta1 was udev 166-0ubuntu618:02
smoserSpamapS, thats why i'm glad i got you to do it18:02
SpamapSudevd[217]: bind failed: Address already in use18:03
SpamapSthat, I think, is relaly the crux of the problem18:03
SpamapSdoes initramfs run a udev?18:03
smoserit might.18:04
* SpamapS can answer that himself18:04
smoserSpamapS,18:06
smoser$ lsinitramfs /boot/initrd.img-$(uname -r) | grep udev18:06
smosersays the answer to your question is "yes"18:07
smoserfrom logs i can't be certain if those error messages are before or after transition to "the real init"18:08
smoserdiff from 166-0ubuntu6 -> 167-0ubuntu1 is18:10
smoser54 files changed, 509 insertions(+), 1003 deletions(-)18:10
smoserSpamapS, http://paste.ubuntu.com/590359/ is the "summary of changes"18:13
SpamapSinteresting.. udevd writes to /dev/kmsg .. didn't know that but it makes sense18:16
SpamapS[    0.630017] udev[59]: starting version 16718:16
SpamapSthat explains that18:16
SpamapSsmoser: this one MIGHT be related:        udevd: initialize fds, for proper close() on exit18:18
SpamapSsmoser: possible that the initramfs udevd wasn't closing its sockets properly leading to them being left open.. but I don't think AF_LOCAL sockets do that.18:18
smoseryeah, that entry stuck out a bit18:19
SpamapSsmoser: do you guys run constant tests like these? 167 has been in for a few days now18:20
* SpamapS hopes nobody picks up on the desperation in his tone :)18:20
smoserwe're not to the point of running daily tests18:20
smoserwe're getting there, thanks to jamespage18:20
=== daker is now known as daker_
smoserSpamapS, http://paste.ubuntu.com/590361/ is the message you were looking for18:22
smoserthats the upstream commit18:22
SpamapS*hm*18:23
SpamapSif thats the case then its very hard to trigger the race artificially.. I have to get udevd to start sooner18:24
RoAkSoAxsmoser: been a long time since I last worked with something this complicated in bash, but finally remembered a few things and learned others. This is what I'm doing so far, but it is just testing as since I started working on it in the past couple hours. Does this look sane to you so far? http://pastebin.ubuntu.com/590364/18:29
smoserregions_array=(${regions#,})18:34
smoserregions has a leading , ?18:34
RoAkSoAxsmoser: yes, kernels too and presumming that initrds too18:35
smoserah, yeah it does.18:35
smoseryou should fix that issue up aabove though.18:35
RoAkSoAxsmoser: ok18:35
smoserjust because it looks confusing18:36
smoseracutally, its probably better if you actually just create the array above18:36
smoserthen you dont have to mess with splitting it back up18:37
RoAkSoAxsmoser: ok cool18:37
smoseryoull have to make a temporary output file18:38
smoser--output "${output}"18:38
smoserif you give them all the same they'll probably truncate each others18:38
RoAkSoAxok cool18:38
* RoAkSoAx takes notes18:38
smoserthe one other thing, is that you're inside an arch loop there18:39
smoserso right now you'd be publishing all regions at the same time for i38618:39
smoserand then for amd6418:39
RoAkSoAxsmoser:  yeah I'm looking into handling that differently18:39
smoserk18:39
smoserthanks , RoAkSoAx18:39
RoAkSoAxsmoser: i was thinking on something like waiting for the PIDS so, remove the wait after the for, and put it right after the arch while18:40
RoAkSoAxand queue all the PIDs, and wait for the queue to be empty18:41
smosereyah. you might be able to use something like gnu parallel for that.18:42
smoserie, you could just collect all the things up that you wan to run and pass it off to something else.18:42
RoAkSoAxok will take a look at that18:49
SpamapSsmoser: I just got the "Connection refused" bug on a vm w/ udev 16719:16
SpamapSactually no!19:17
SpamapSit has 16619:17
SpamapSforgot to upgrade this one19:17
SpamapSdamnit19:17
smoserwell, good news for local recreate19:17
smoseryou can launch kvm with -nographic19:17
smoserin a loop19:17
SpamapSyeah its happened once before19:17
smoserand just kill it after 30 seconds or whatever19:17
SpamapSwell now this is interesting..19:18
SpamapSthe udev from kmsg says version 167..19:18
SpamapSbut dpkg shows 16619:18
SpamapSerr.. udevd is 167 but dpkg -l is 166. Ok well now I've gone cross eyed19:19
=== dendrobates is now known as dendro-afk
=== dendro-afk is now known as dendrobates
navanjrwhats the trick to publishing maverick image?21:18
navanjrnate@nateDesktop:~$ uec-publish-tarball $UEC_IMG.tar.gz $RELEASE-$TIMESTAMP21:19
navanjrWed Apr  6 15:11:29 CDT 2011: ====== extracting image ======21:19
navanjrWarning: no ramdisk found, assuming '--ramdisk none'21:19
navanjrkernel : maverick-server-uec-amd64-vmlinuz-virtual21:19
navanjrramdisk: none21:19
navanjrimage  : maverick-server-uec-amd64.img21:19
navanjrWed Apr  6 15:11:36 CDT 2011: ====== bundle/upload kernel ======21:19
navanjrfailed to register maverick-server-uec-amd64-vmlinuz-virtual.manifest.xml21:19
navanjrfailed: euca-register --name maverick-server-uec-amd64-vmlinuz-virtual maverick-20110406151031/maverick-server-uec-amd64-vmlinuz-virtual.manifest.xml21:19
navanjrImage: Image registration failed because the manifest referenced is invalid or unavailable.failed to upload kernel21:19
=== dendrobates is now known as dendro-afk
=== dendro-afk is now known as dendrobates
=== niemeyer is now known as niemeyer_away
=== dendrobates is now known as dendro-afk
=== Nolar is now known as LawsuitBot
=== LawsuitBot is now known as Nolar

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!