/srv/irclogs.ubuntu.com/2010/04/20/#ubuntu-server.txt

jeeves_Mosscan someone send me a pastebin of a name baised config file please?  for some reason my mind has taken a vacation, and I can't for the life of me figure out WTF is going on00:00
lil_cain;named based config for what?00:01
jeeves_Mosslil_cain, I'm trying to get my v-hosted apache2 install going00:02
lil_cainah. I'm no help I'm afraid.00:03
lil_cainI try and avoid apache where possible.00:04
jeeves_Mossno worries00:04
jeeves_Mosslol00:04
jeeves_Mosswell, I think webmin is just messin' up the configs.00:04
lil_cain!webmin00:05
ubottuwebmin is no longer supported in Debian and Ubuntu. It is not compatible with the way that Ubuntu packages handle configuration files, and is likely to cause unexpected issues with your system. See !ebox instead.00:05
lil_cain:-)00:05
jeeves_Mossyea yea yea00:06
cn1109I need ideas in terms of outsourcing or in house hosting. I'm running a web server (e-commerce site) which is using Joomla. Traffic is high and many of the in house software (customer service, finance, etc) connects to the internal mysql server which also is used for the public site. My concern is if I should outsource both the web and sql server but again how will this impact the CAP placed by the hosting company. The personnel in th00:12
cn1109office does use the mysql connection often.00:12
cn1109so. Should I go with ubuntu server or could computing through Amazon. Any ideas?00:13
erimar77cn1109: are you setup for disaster recovery, if not, what's that worth to you00:13
erimar77cn1109: what's that worth to your customers00:13
cn1109Well..It seems that the company has bot had an IT guy in house for a while. They have many open source OS's that in reality are not needed. Monowall is an example. The customers depend on the site to be up at all times. I would say that by using ESXi and the Ubuntu server edition we would be okay. Again we could be saving some money by focusing on cloud computing and reduce the maintenance cost of in house servers.00:15
lil_cainI'd be shocked if maintenance costs for servers were higher than costs for AWS.00:17
cn1109lil_cain: so what would you recommend?00:18
erimar77cn1109: depends on who you want to blame during outages00:18
cn1109erimar77: that would be me :)00:19
erimar77cn1109: not if you threw it all on a hosted server00:19
cn1109erimar77: true. Just concerned about the bandwidth cap00:20
31NAAPG5Dhas anybody use DEltacopy to make bakups from a windows client to an ubuntu server?00:20
erimar77cn1109: how much bandwidth are you talking about, it sounds like you already have a host chosen00:21
erimar7731NAAPG5D: whats your issue00:21
cn1109erimar77: we are hosting in house with a Sprint T1 line. We are also paying for multiple Ip's we really do not need.00:21
erimar77cn1109: how much would you save by getting rid of all that, would it justify getting a higher bandwidth cap00:22
cn1109it's about 1000 a month for internet. Electricity which comes for the AC unit and powering on the servers. That would eliminate a good amount.00:23
31NAAPG5Derimar77: i whant to make automatics bakups of a windwos folder to a ubuntu server..i am a newbee and have look for a how to and no success00:23
cn1109rsync?00:24
erimar7731NAAPG5D: what are you trying to accomplish?00:24
erimar7731NAAPG5D: ok00:24
erimar7731NAAPG5D: from the windows comptuer can you use an app like putty to ssh to the ubuntu server?00:25
31NAAPG5Derimar77: i have at present moment the folder shared and have the folder mount in ubuntu and resync makes the trick very nicely, the problem is that the shared folder on windows is accesibel buy everybody in my network, that is how i heard about deltacopy./....yes i have access thru putty00:26
erimar7731NAAPG5D: it sounds like you have it a bit backwards, you shouldn't have to mount the shared windows folder in ubuntu for it to work00:28
31NAAPG5Derimar77: well you might be rigth since i am a newbee...but so far works nice..probelm is that the share folder is public to everybody..let me show you how i have it00:30
31NAAPG5Derimar77: //192.168.1.106/Charts /home/rgotten/charts.windows   cifs  credentials=/root/.credentials,iocharset=utf8,file_mode=0777,dir_mode=0777 0 000:32
erimar7731NAAPG5D: give me a sec to install deltacopy00:33
31NAAPG5Derimar77:00:34
31NAAPG5Derimar77: thanks00:34
31NAAPG5Derimar77: i have to take care of somebody in my office , will be back in 30 minutes..it is ok?00:38
erimar7731NAAPG5D: i think i'll be around00:39
31NAAPG5Derimar77: thanks00:40
uvirtbotNew bug: #566971 in samba (main) "package samba-common-bin 2:3.4.0-3ubuntu5.6 failed to install/upgrade: il sottoprocesso vecchio script di post-installation ha restituito lo stato di errore 2" [Undecided,New] https://launchpad.net/bugs/56697100:41
SirStanWhere can I download ubuntu server directly?00:42
SirStanvs using the form on ubuntu.com that doesnt work in ie6 : (00:42
erimar77SirStan: 32 or 64 bit00:42
SirStan32, 8.04 lts00:43
SirStanhttp://mirror.site.com/directory/ is fine00:43
erimar77http://mirrors.us.kernel.org/ubuntu-releases/8.04.4/ubuntu-8.04.4-server-i386.iso00:44
SirStanthx00:44
erimar77SirStan: if that mirror is slow, http://www.ubuntu.com/getubuntu/downloadmirrors#mirrors00:45
njbairdoes ubuntu server cache http output by default?00:48
SirStanits a little slow.. but 1mb is ok00:48
SirStanim not in a rush00:48
smoserhggdh, bug 564924 confirmed here.01:16
uvirtbotLaunchpad bug 564924 in linux "UEC guest sometimes gets kernel OOPS" [Medium,Confirmed] https://launchpad.net/bugs/56492401:16
RoAkSoAxsmoser, the puppet integration with EC2/UEC is only to register the Instances running on the cloud automatically, correct?01:22
smoserRoAkSoAx, best to ask mathiaz.01:23
smoserhttp://ubuntumathiaz.wordpress.com/2010/03/25/using-puppet-in-uecec2-automating-the-signing-process/01:23
smoserhttp://ubuntumathiaz.wordpress.com/2010/03/24/using-puppet-in-uecec2-puppet-support-in-ubuntu-images/01:23
smoseri must admit to knowing little about it.01:23
RoAkSoAxsmoser, oh ok, thought the cloud-init package was part of this. So what is the cloud-init package for exactly?01:23
smoserRoAkSoAx, well, cloud-init enables it01:25
smosercloud-init provides some hooks, the puppet takes advantage of that and does some puppet-y things for it.01:25
smoserhttp://ubuntu-smoser.blogspot.com/ is an entry i wrote about cloud-config01:26
smosermathiaz's work provides cloud-config syntax to get puppet up and running01:26
smosercloud-init has other functions other than just cloud-config though, it can allow you to hook into the boot process very early.01:27
smoserfrom your provided user-data01:27
RoAkSoAxsmoser, I see.01:27
RoAkSoAxsmoser, I'll take a look to your blog post and bug mathiaz about it then  :)01:27
smoseri need to write another blog entry about what else it does01:27
smoserhggdh, i'm going to run a single_config job01:29
RoAkSoAxsmoser, will be waiting for it :)01:29
smoseralright :)01:29
smoserin the meantime, there is doc (admittedly not well exposed)01:29
smoserhttp://bazaar.launchpad.net/~cloud-init-dev/cloud-init/trunk/files/185?file_id=doc-20100127032511-5qfkb7qsglz0tfnn-101:30
* RoAkSoAx reads01:30
smoserhggdh, one featur request for that. i'd like the output log to have what emi- was used01:30
smoser(possibly with its manifest name, to give some human readable context)01:30
=== MTeck-ricer is now known as MTecknology
minitux??01:44
=== erichammond1 is now known as erichammond
=== three is now known as sferry
uvirtbotNew bug: #566995 in postfix (main) "package postfix 2.7.0-1 failed to install/upgrade: subprocess installed post-installation script returned error exit status 128" [Undecided,New] https://launchpad.net/bugs/56699502:16
airliasdesignhello02:17
airliasdesignis anyone here?02:17
lamontthat depends on your definitions02:18
lamontthe best approach is to just ask your question, instead of asking if you can ask your question.02:19
airliasdesignI'm looking to run high capacity web servers, but wasn't sure if I should go with a private Amazon EC2 cloud or to just get the most powerful server I can02:20
=== samferry is now known as sferry
hggdhsmoser: I will print out the emi code at the start, then02:53
hggdhsmoser: first print-out line states the emi in use. I am running a new battery now, and will check on results tomorrow morning03:09
MTecknologyTrue or false? Ubuntu's version of kickstart allows you to pass "pre-­seeding" parameters to the debian installer.03:23
MTecknologyIs that False? I thought it was True03:24
MTecknologyI know two of the answers I got wrong and I can't figure out what the third is :(03:24
smoserhggdh, thanks03:49
smoserhggdh, well, it seems "fixed" with my changes, now its getting "cant find metadata service", just like dustin and I see.03:51
twbMTecknology: Ubuntu uses Debian's "preseeding" technique.  This is ortogonal to RHEL's "kickstarting", which was ported to Ubuntu (and Debian) more recently.03:52
twb*orthogonal03:52
twbAlthough that's not really the right word; preseeding and kickstarting achieve the same result through different implementations.03:53
smoserthats a tricky question03:53
MTecknologytwb: oh - so the correct answer was false - because the same affect is acheived differently?03:54
twbMTecknology: The question is ill-defined.03:54
smoseri'd have to look at the implementation to be sure03:54
twbMTecknology: so really the best answer is 無03:54
smoserbut i had always just assumed that kickstart config came in and was translated to preseed03:54
MTecknologytwb: ok - it was on the serverassessment for UCP03:54
smoserwhich would mean 'true'03:54
smoserbut i've never looked at it03:54
bluethundrI just unmounted a volume known as /dev/sd2a and created a partition on it with fdisk. but when I try to format it with mkfs.ext3 it reports that the partition I created isn't there even tho fdisk reports that it is. I made sure to reboot after using fdisk04:32
bluethundrhttp://pastebin.com/a3XQ3EPM04:32
cn1109is it worth install webmin?04:34
maginotdoes ubuntu servr install prompt for a root password on install screen or I'm just confusing with something else?04:35
cn1109maginot: It did not for me. Asked me for a new username and password04:36
cn1109so...has anyone used webmin or something similar?04:39
twbcn1109: we do not approve of web-based sysadmin wrappers here.04:44
cn1109twb: okay. thx04:44
twbcn1109: if you MUST use one, you should know that Ubuntu nominally supports ebox and definitely doesn't support webmin at all.04:44
twbbluethundr: are you mis-typing /dev/sda2?04:46
twbbluethundr: ah, I see what you're doing.04:46
twbbluethundr: /dev/sda is a disk.  /dev/sda2 is a partition ON that disk.  By calling fdisk on /dev/sda2, you've created a partition on a partition, which linux/udev won't create a device file for by default.04:47
bluethundrtwb: no, actually I am copying / pating04:47
bluethundrs/pasting/pating/04:47
bluethundrah ok04:47
twbbluethundr: in the unlikely case that you actually want a partition table on a partition, you can create a device for it using losetup.04:47
bluethundrtwb: good point, thank you so much for the insight04:48
twbtwb knows all!  Tell your friends!04:48
* bluethundr will!!! :-)04:48
bluethundrhmmm.. I can't seem to fdisk /dev/sda .. but fdisk /dev/sda2 works04:53
bluethundrUnable to open /dev/sda04:53
twbWho owns those devices?04:54
twbAre you running these commands as root?04:54
twbYou should probably be using GNU cfdisk or parted rather than fdisk.04:55
bluethundrok, I just attached an S3 bucket to my Ubuntu 6.06 server on AWS.. I am able to run fdisk on this volume and create partitions, but mkfs claims this volume is in ue even tho I can't see it with df -h05:06
bluethundr/dev/sdf1 is apparently in use by the system; will not make a filesystem here!05:06
Hitiekcan't ssh into machine. can't log in to physical terminal. sudo hangs. existing vnc, screen, irssi all still work. apache is fine. samba share doesn't seem to work.05:08
Hitiekany ideas what would cause all that?  happens once every few months.  I end up rebooting and everything is fine again for a while.05:08
bluethundrI get the same result with cfdisk as with fdisk and I am running the commands as root05:10
twbbluethundr: 6.06 is too old for me to support05:11
bluethundrk05:13
arrrghhhhey does anyone use their server to play music out of the local soundcard?  like with MPD?05:24
=== sourcode__ is now known as sourcode
uvirtbotNew bug: #567043 in php5 (main) "[lucid] php5-cgi crashes in memcpy using lighttpd" [Undecided,New] https://launchpad.net/bugs/56704305:46
nhawdge|workHey anyone got a moment to answer some questions about hard drive recovery?07:27
SandGorgondoes anybody know if /etc/syslog.conf is even used  (9.10 onwards) ?07:40
=== libertiy is now known as libertiy|away
=== libertiy|away is now known as libertiy
_rubenSandGorgon: sysklogd has been replaced by rsylogd, and thus /etc/rsyslog.conf is used instead08:25
jiboumansmorning folks09:00
uvirtbotNew bug: #567104 in openldap (main) "debuild twice fails" [Undecided,New] https://launchpad.net/bugs/56710409:21
lauping jdstrand09:52
=== libertiy is now known as libertiy|away
=== libertiy|away is now known as libertiy
=== libertiy is now known as libertiy|away
lauhello on karmic, if I run /usr/sbin/mysqld --defaults-file=/etc/mysql2/my.cnf --print-defaults I got no parameters10:57
laubut cat /etc/mysql2/my.cnf works ok, any idea ?10:57
=== libertiy|away is now known as libertiy
=== ogra_ is now known as ogra
uvirtbotNew bug: #567179 in mysql-dfsg-5.1 (main) "Update mysql-server-5.1 hangs up" [Undecided,New] https://launchpad.net/bugs/56717911:56
maxagazhow to check the procs (number, speed, type) of my server ?12:29
alvinmaxagaz: sudo lshw12:29
lil_cainif it's just the processer you're looking for, cat /proc/cpuinfo12:30
lil_caineasier to read, and doesn't require root.12:30
maxagazalvin, cat /proc/cpuinfo works fine too12:32
maxagazalvin, thanks12:33
maxagazis it possible to know the brandt of the machine from the console ?12:34
alvinyou're welcome (/proc/cpuinfo is one of the places lshw looks)12:34
lil_cainnot in any portable way that I've ever heard of.12:34
alvinYes, lshw :-) (look for 'vendor')12:35
persiaDepends on the hardware: that works for some vendors, and not for others.12:36
persiaTends to work more poorly for white-label stuff.12:36
alvinProbably. I'm in luck. (vendor: transtec AG)12:37
laumaxagaz: you can try dmidecode too12:41
persiaI get mixed results.  One of my two apples lists Apple, the other doesn't.  My Panasonic only lists Intel and Ricoh.12:41
Italian_PlumberI am searching for an ubuntuforums thread regarding upgrading a server from hardy to lucid. If one exists, I cannot find it.  I'm looking specifically for any discussion regarding recommending not upgrading because hardy is ext3 and lucid is ext4 (by default, I assume).  I have found this post http://ubuntuforums.org/showpost.php?p=8813514&postcount=5 but nothing more.  Do my searching skills suck or should I start13:47
PiciItalian_Plumber: What sort of issues are you expecting to see from a filesystem change?13:52
PiciOr rather, and even then it won't be switching filesystems when you upgrade.13:53
alvinItalian_Plumber: I'm pretty sure ext3 will not be automatically converted to ext4.13:53
Italian_PlumberI don't know; I just saw this post and panicked. :)14:06
smoserttx, copied you on bug 56679214:06
uvirtbotLaunchpad bug 566792 in eucalyptus "UEC guests sometimes fail on consuming user data" [Undecided,New] https://launchpad.net/bugs/56679214:06
=== mathiaz_ is now known as mathiaz
Thkxhi14:22
alvinItalian_Plumber: I wouldn't panic. Lucid isn't 'made for ext4'. I do hope ext4 has good support, but ext3 will most certainly be at least equally well supported. There are far more worse things that can happen during or after the upgrade than staying on ext3.14:25
Thkxi have a question...i have necessity to make a server to manage 3 different email account (for example, @gmail.com, @hotmail.com, etc)...and sort email to each account...how can i do this?postfix + fetchmail?14:25
ttxsmoser: thanks14:28
zulmathiaz: fyi mysql-5.0 is gone from universe14:32
ttxsmoser: I think you make a good case of pinpointing a bug in eucalyptus, let's see how they react14:33
ttxsmoser: any reason to keep the cloud-init task opened ?14:33
smoserprobably not, since i can't even successfully work around it14:33
smoser:)14:33
smoseri tried14:33
ttxsmoser: you reproduce it every single time, or need specific situation ?14:34
smosertiming14:35
smoserluck14:35
ttxok14:35
ttxteam: please do some ISO testing coverage14:37
zulack14:47
zulttx:i was going to say only if you say please but you did ;)14:49
smoserttx, i will start ec2 tests14:53
zulill start the i386 tests15:04
hggdhttx: do we need to go thru the UEC tests?15:17
ttxhggdh: I'll cover the ISO / UEC tests15:28
hggdhttx: the point is we have been testing it. Continuously15:30
ttxhggdh: right15:31
ttxhggdh: I mean, I'll cover the strict "install from ISo" testcases, you should concentrate on feature/stress testing15:38
ttxas it showed some problems recently15:38
hggdhttx: ack15:40
ttxsmoser: targeted the metadata service issue to lucid, added to watch list15:41
xperiahello to all. i have installed dancer-ircd but it looks like i have some permissions problems. most of the files and dirs have dancer as a user for accessing the files and dirs15:43
xperiabut i dont know as what user dancer-ircd is executed15:43
xperiaand what for permissions i need exactly15:43
xperiahow can i prove hat such a user "dancer" with limited access exist on my system15:44
JanCxperia: grep dancer /etc/passwd16:04
xperiaJanC: great thank you. it looks like i have them as users16:05
xperiaJanC: what could be the problem that dancer-ircd report afterthe installing that the MOTD file is missing16:08
xperia"===MOTD File is missing" i have this file in /etc/dancer-ircd16:08
xperiasomehow dancer-ircd report allways after the install that this file is missing even if the file exist16:09
JanCmaybe the permissions are wrong?  or you spelled the file name incorrect (case-sensitive!)?16:09
eric_fCan someone point me to a link that describes why EC2 AMIs have an ubuntu user and how that differs from root?16:12
=== libertiy is now known as libertiy|away
=== viezerd- is now known as viezerd
gzmaskAre there any network configuration information/wiki/tutorial for UEC?16:22
hggdhttx: bug 565101 sounds bad16:22
uvirtbotLaunchpad bug 565101 in eucalyptus "walrus reports java.lang.OutOfMemoryError: Java heap space" [Undecided,New] https://launchpad.net/bugs/56510116:23
=== libertiy|away is now known as libertiy
ttxI'm more concerned about the SSh connection failures, which seem to be getting worse as our images boot faster16:26
ttxI suspect tat's what bug 566792 is about16:26
uvirtbotLaunchpad bug 566792 in eucalyptus "UEC guests sometimes fail on consuming user data" [High,Confirmed] https://launchpad.net/bugs/56679216:26
ivoksshouldn't kvm-pxe put files into /usr/share/qemu, instead of /usr/share/kvm?16:29
ivoksit should.16:32
zuloh bloody hell16:32
ivoks:)16:33
smoserttx, i think you are correct about fast boot causing it16:34
ttxsmoser: it's getting worse as we improve16:35
smoserbut what doesn't seem to collaborate is that attempts to just wait and re-try dont fix16:35
ivokssoren: welcome back :)16:35
ttxsmoser: but you still get a status 200 ?16:35
=== brianherman_ is now known as brianherman
smoserttx, right.16:35
ttxan empty status 200 is plain wrong16:36
smoserits as if an early attempt to get at the metadata service breaks it16:36
smoserobviously, yes16:36
smoserbut it doesn't recover.16:36
smoserie, you get that once, wait 20 seconds, try again, its not fixed16:36
ttxyes, so it's not just "we ask too early"16:36
smoserits not like its populating16:36
smoserand we were just too fast.16:36
ttxit's we break it by asking too early16:36
smoserright16:36
ttxkirkland: could you coordinate a call with eucalyptus and smoser, whenever the west coast wakes up ?16:37
ttxwe need to have them look into that issue.16:37
kirklandttx: nurmi and I have a daily SCRUM call in 20 minutes16:37
kirklandttx: nurmi and I are doing daily SCRUM calls through Lucid release date16:37
ttxkirkland: please introduce that issue16:38
kirklandttx: okay16:38
ttxthat's quite a show stopper.16:38
eolo999hi, i'm trying to install ubuntu server LL on a Dell R410 but i cannot boot the root partition which sits on lsi logic 1068e raid controller. Anyone had some hints?16:56
eolo999A*Anyone faced the same issue?17:02
lil_cainI've had problems with hardy on Dells before.17:03
lil_cainTry dropping to a shell halfway through the install, and installing the generic kernel17:03
lil_cain(rather than the server kernel)17:03
slipper1024hi Guys17:11
slipper1024configuration: Ubuntu server 8.04 LTS, running ispconfig, courier pop, postfix mta, dovecot sasl user authentication, self signed certificate for mail.          issue: Some hosting clients get relay access denied when sending mail, while successfully authenticated. Over TLS, SSL and Login same problem. 1 Shared IP, multiple VHosts.17:16
slipper1024[05:05:20 PM] Mike Hyland: Client host rejected: Access denied', Port: 465, Secure(SSL)17:17
slipper1024The message could not be sent because one of the recipients was rejected by the server. The rejected e-mail address was 'somebody@gmail.com'. Subject 'test', Account: 'mail.thisdomain.com', Server: 'mail.thisdomain.com', Protocol: SMTP, Server Response: '554 5.7.1 <unknown[196.35.255.4]>: Client host rejected: Access denied', Port: 465, Secure(SSL): Yes, Server Error: 554, Error Number: 0x800CCC7917:19
slipper1024 'Somebody' on 2010/04/19 07:53 PM17:20
slipper1024            554 5.7.1 <vc-41-3-207-163.umts.vodacom.co.za[41.3.207.163]>: Client host rejected: Access denied17:20
slipper1024/var/log/mail.warn output:17:21
slipper1024Apr 20 18:09:49 myhost postfix/smtpd[11155]: warning: 190.26.17.145: address not listed for hostname adsl190-2617145.dyn.etb.net.co17:22
slipper1024Apr 20 18:11:26 myhost postfix/smtpd[11155]: warning: 201.86.222.79: address not listed for hostname 201.86.222.79.static.host.gvt.net.br17:22
slipper1024Apr 20 18:12:08 myhost postfix/smtpd[11155]: warning: 62.41.253.74: hostname static.kpn.net verification failed: Name or service not known17:22
slipper1024Apr 20 18:19:01 myhost postfix/smtpd[13459]: warning: 88.247.68.249: hostname dsl88-247-17657.ttnet.net.tr verification failed: Name or service not known17:22
slipper1024Is there anybody that can assist me, have tried everything?17:23
ivokslet's see17:23
slipper1024sorry for all the info, hopefully the more the merrier17:24
ivoksslipper1024: you have unrelated stuff here17:25
ivoksfirst one is, i guess, client pasting outlook issue?17:26
ivokss/issue/message17:26
ivoksnot here? ok...17:26
ivoksdoh17:28
kirklandhggdh: hiya17:31
kirklandhggdh: i think i might have a solution for your heap/memory errors17:32
kirklandhggdh: how easily can you reproduce that one and test a fix?17:32
ivoksi love libvirt17:34
ivoks:)17:34
ivoksam i the only one? :D17:34
kirklandivoks: there's a few of you17:35
RoAkSoAxi love it too17:36
* RoAkSoAx hates packing and moving out17:36
ivoksvirt-install --help outputs strange manual :)17:37
ivoksoh, lol, it's broken17:37
hggdhkirkland: usually after about 300 runs, so ~30min or so17:42
hggdhsmoser: can I use the rig?17:42
kirklandhggdh: sweet ...  let me know when you get to the point you're ready for the fix17:42
hggdhkirkland: roj17:42
kirklandhggdh: should be a one-liner config change in the upstart init script17:42
hggdhkirkland: increasing the heap for the java machine?17:42
smoserhggdh, yeah have at it17:42
kirklandhggdh: basically, we're going to give the jvm running eucalyptus-cloud 384M of mem17:42
smoserhggdh, goog guess17:43
smosergood even17:43
hggdhkirkland: yeah, thought this might be it. I still do not know *why* it does not release the mem17:43
kirklandhggdh: i talked to nurmi about it ...17:43
kirklandhggdh: it will expire it over time17:43
hggdhkirkland: delayed garbage colleciton?17:44
kirklandhggdh: but there can be a limit of the number of instances that can run in a short amount of time17:44
hggdhkirkland: yeah. But we are hitting it pretty hard17:44
kirklandhggdh: right17:44
hggdhkirkland: OK. give me 10 min to check some few changes I made to the script17:44
kirklandhggdh: nurmi says that 384M should put that limit much further out of reach17:44
kirklandhggdh: ack17:44
hggdhkirkland: I just wonder when this is used on a bug cloud farm. We might have to distribute the walruses17:45
hggdhs/bug/big/17:45
gzmaskguys, in UEC, how do I change the mac address of my VM instance?17:46
kirklandhggdh: perhaps, yeah17:46
kirklandgzmask: don't know that that's possible17:46
kirklandgzmask: you'd need to hack the XML of the VM17:46
gzmaskkirkland: where is that XML file located?17:47
slipper1024guys, sorry dropped off there17:48
slipper1024power failure17:49
kirklandgzmask: /var/lib/eucalyptus/instances ?17:49
slipper1024is there a way to recall chat history17:49
gzmaskkirkland: found it at /var/lib/eucalyptus/instances/eucalyptus/cache/, don't think mac address is there or it's encrypted. I though xen can change mac address so does kvm  but apparently not.17:52
kirklandgzmask: kvm (qemu, actually) can definitely change the mac address17:53
kirklandgzmask: http://libvirt.org/formatdomain.html17:53
kirklandgzmask: eucalyptus is just leaving it unspecified17:53
smoserjjohansen, ping17:53
jdstrandjjohansen: hey, I moved bug #567334 to linux, since it is the apparmor_parser hang. please adjust if that is not correct17:54
uvirtbotLaunchpad bug 567334 in linux "apparmor issue delays cloud-init for 240 seconds" [Undecided,New] https://launchpad.net/bugs/56733417:54
jdstrandsmoser: regarding that bug^ does the guest have the latest lucid kernels?17:55
smoserec2 ami tests done. all passed, one new bug (that above)17:55
smoserlatest ec2 kernel as of today17:55
jdstrandjjohansen: ^17:55
kirklandgzmask: see: /usr/share/eucalyptus/gen_kvm_libvirt_xml on your Node17:56
jjohansenhrmm, smoser latest user space too?17:56
smoserjdstrand, note, this happened once in 142 instances.17:57
smoserthe other 141 are identical17:57
jdstrandsmoser: I saw something yesterday about 94.9% instances out of 1000 came up. is this bug the cause for the ones that didn't come up?17:57
smoserjdstrand, no. thats eucalyptus specific (eucalyptus failure)17:57
smoserthis is ec217:57
jdstrandoh yes17:57
jdstrandk17:57
slipper1024can anybody that watched the channel please paste reply's on postfix issue mentioned earlier and any replies17:58
jjohansensmoser: once in 142?17:58
jdstrandsmoser: 11:56 < jjohansen> hrmm, smoser latest user space too?17:58
smoserwell, the latest everything that was in the archive at ~ 1:30 AM UTC today17:58
jdstrandwe've not done any apparmor uploads in ages, so it should be up to date17:59
smoseri ran the automated tests that i have.17:59
jjohansensmoser: okay, and this only happened once in 142 instances, ie not the ec2 kernel bug we talked about yesterday17:59
jdstrandTue, 30 Mar 201017:59
gzmaskkirkland: ah ok, but can I modify that file? It looks like it's a shell script that shows me the xml template and where should this xml template located?18:00
jjohansenjust making sure, I'm not getting mixed up here18:00
smoserthe total of 142 is across 2 arches , 3 regions, 5 instance sizes, 2 root-store types...18:00
smoser6 amis total tested, all use same kernel same user space18:00
smoserjjohansen, i dont remember talking about ec2 kernel bug yesterday.18:00
kirklandgzmask: sorry, i don't know; i'm just giving you a few pointers18:00
smoserbut yeah, its only 1 in 142 instances that saw this.18:00
gzmaskkirkland: ok. thanks for the info18:00
smoserand the number of boots is slightly higer than that (some of them are shut down and then started)... making total of (guess) 175 boots or so18:01
jjohansensmoser: hrmm, I could have sworn it was yesterday but maybe friday.  only failing once in lots and lots of runs18:01
smoserjjohansen, ah... that is bug 56492418:02
uvirtbotLaunchpad bug 564924 in linux "UEC guest sometimes gets kernel OOPS (dup-of: 546458)" [Medium,Confirmed] https://launchpad.net/bugs/56492418:02
uvirtbotLaunchpad bug 546458 in qemu-kvm "kernel NULL pointer in -virtual (-server) kernel" [Low,Confirmed] https://launchpad.net/bugs/54645818:02
smoserthat is linux-server kernel in kvm guest (eucalyptus)18:02
smoserand we/I now believe that to be actually bad (virtual) hardware... see links to lkml discussion from that bug18:03
jjohansensmoser: right, its just that the once in X many boots is a similar symptom18:03
kirklandhggdh: http://paste.ubuntu.com/419361/18:04
kirklandhggdh: that's the patch you'll want to apply (or manually add the option) to /etc/init/eucalyptus.conf18:05
kirklandhggdh: that ups the jvm's heap to 384M18:05
smoserjjohansen, yeah. sorry that my brain is failing18:05
jjohansennp, same problem here18:05
smoserthat one seems racey.18:05
smoseri can't understand why the apparmour stuff would be racy18:06
gzmaskanyone know what is the default acount/password for ubuntu 9.10 32-bit UEC image? I got it running on my cloud but can't ssh in18:06
jjohansensmoser: well its possible something in the initscripts is broken18:07
smosergzmask, there is no password.18:07
smoseryou go in as ubuntu user, but you must specify a '--key' flag to run-instances18:07
gzmasksmoser: that means I can just ssh in with my key file?18:08
smoserthis may ont be the first time i've seen this issue, but it is the first time that i've collected log showing the apparmour message18:08
smosergzmask, thats the theory (ssh -i path/to/your/key.pem ubuntu@x.y.z.y)18:09
gzmasksmoser: thanks, that makes perfect sense18:09
slipper1024Hi guys, having trouble with postfix configuration. Setup: Ubuntu server 8.04, Postfix, Courier mail, Dovecot sasl user authentication, self signed certificate for mail. Single shared IP.     Working: pop over ssl. tls  ,  User Authentication,    smtp over ssl and tls from some domains.   Not Working: SMTP login, tls and ssl from some domains.     Error Message: Pasting below:18:11
smoserjjohansen, jdstrand when i look more at that, i dont think its apparmor specific18:12
smoserlook at the other "blocked" tasks18:12
slipper1024Client error:       The message could not be sent because one of the recipients was rejected by the server. The rejected e-mail address was 'somebody@gmail.com'. Subject 'test', Account: 'mail.thisdomain.com', Server: 'mail.thisdomain.com', Protocol: SMTP, Server Response: '554 5.7.1 <unknown[196.35.255.4]>: Client host rejected: Access denied', Port: 465, Secure(SSL): Yes, Server Error: 554, Error Number: 0x800CCC7918:12
ivoksslipper1024: you again18:13
ivoksslipper1024: look at mail.log, this is outlook message (we don't use and it doesn't provide any info)18:13
ivoksslipper1024: i'd bet your client didn't authorize to postfix18:14
jdstrandsmoser, jjohansen: I think you might be right18:14
jdstrandinit: console-setup main process (62) terminated with status 118:14
jdstrand[  240.805451] INFO: task apparmor_parser:182 blocked for more than 120 seconds.18:14
hggdhkirkland: ready18:14
slipper1024Apr 20 18:48:50 mycomp postfix/smtpd[16781]: warning: 201.19.75.90: address not listed for hostname 20119075090.user.veloxzone.com.br18:14
kirklandhggdh: can you ping me here, and update the bug at https://bugs.edge.launchpad.net/ubuntu/+source/eucalyptus/+bug/565101 when you have results?18:14
slipper1024Apr 20 18:53:26 mycomp postfix/smtpd[17357]: warning: 203.210.156.182: hostname adsl.hnpt.com.vn verification failed: Name or service not known18:14
uvirtbotLaunchpad bug 565101 in eucalyptus "walrus reports java.lang.OutOfMemoryError: Java heap space" [High,In progress]18:14
slipper1024Apr 20 18:57:29 mycomp postfix/smtpd[17406]: warning: 85.105.244.76: hostname dsl.static.85-105-62540.ttnet.net.tr verification failed: Name or service not known18:14
slipper1024Apr 20 19:07:11 mycomp postfix/smtpd[17607]: warning: 117.4.141.93: address not listed for hostname localhost18:14
kirklandhggdh: rock on18:14
jdstrandlet me start over18:15
slipper1024The above is output of /var/log/mail.warn18:15
hggdhkirkland: what did you change?18:15
smoserjdstrand, that one is red-herring18:15
smoserits "normal"18:15
jdstrandhttp://paste.ubuntu.com/419364/18:15
smoser(console-setup)18:15
jdstrandok18:15
kirklandhggdh: i haven't uploaded anything18:15
jdstrandstill, mount and the flush blocked too18:15
kirklandhggdh: you need to change /etc/init/eucalyptus.conf:18:15
kirkland-       opts="-h $EUCALYPTUS -u $EUCA_USER --pidfile /var/run/eucalyptus/eucalyptus.pid -l $LOGLEVEL -L console-log"18:15
ivoksslipper1024: that isn't related to the error you pasted above18:15
kirkland+       opts="-h $EUCALYPTUS -u $EUCA_USER --pidfile /var/run/eucalyptus/eucalyptus.pid -l $LOGLEVEL -L console-log -Xmx384m"18:15
kirklandhggdh: specifically adding: -Xmx384m"18:16
smoserjdstrand, right. regarding mount and flush blocking.18:16
hggdhkirkland: on the wlarus, or everywhere?18:16
ivoksslipper1024: look into mail.log and search for somebody@gmail.com18:16
kirklandhggdh: on the java components18:17
kirklandhggdh: so cloud, walrus, sc18:17
jdstrandunless the other two blocked cause of the first18:17
jdstrandjjohansen: what do you think? ^18:17
jjohansensorry I'm a bit behind have been trying to follow k-t meeting as well18:18
hggdhkirkland: orj18:18
jdstrandjjohansen: http://paste.ubuntu.com/419364/18:18
hggdhroj18:18
jdstrandjjohansen: mount and flush blocked too18:18
jdstrandjjohansen: so maybe it isn't apparmor, or it is and that is why the mount and flush blocked18:19
jjohansenhrmm, yeah that doesn't seem like apparmor18:19
jdstrandjjohansen: consider yourself caught up :)18:19
jjohansenthanks18:19
mcas1hi has anyone tested the preseed test case with virtualbox?18:20
jdstrandsmoser: mount and flush blocking-- doesn't that seem like a disk issue?18:20
smoseri guess it could18:21
jdstrandI don't know, I'm asking :)18:21
smoserjdstrand, i dont know18:22
smoserjdstrand, but, i wonder, would it be possible that the 2nd and third (mount, flush) are a result of the first (apparmor)18:23
jjohansenjdstrand: it could be, or it could be a kernel issue, or a hypervisor issue18:23
jdstrandsmoser: I wondered the same, but jjohansen indicated it didn't seem apparmor related18:23
jjohansensmoser: yes that is possible18:23
jjohansenbut unlikely18:23
smoserone way or another its a race condition somewhere.18:23
smoserit could be hypervisor or even faulty disk, but we have no real way of knowing18:24
slipper1024ivoks: Apr 20 18:37:33 mycomp postfix/smtpd[16281]: NOQUEUE: reject: RCPT from unknown[196.35.255.4]: 554 5.7.1 <unknown[196.35.255.4]>: Client host rejected: Access denied; from=<mike@hisdomain.com> to=<somebody@gmail.com> proto=ESMTP helo=<hylandmnb>18:24
slipper1024Apr 20 18:44:36 itdirect postfix/smtpd[16996]: NOQUEUE: reject: RCPT from unknown[196.35.255.4]: 554 5.7.1 <unknown[196.35.255.4]>: Client host rejected: Access denied; from=<mike@hisdomain.com> to=<somebody@gmail.com> proto=ESMTP helo=<hylandmnb>18:24
slipper1024Apr 20 19:06:51 mycomp postfix/smtpd[17810]: NOQUEUE: reject: RCPT from unknown[196.35.255.4]: 554 5.7.1 <unknown[196.35.255.4]>: Client host rejected: Access denied; from=<mike@hisdomain.com> to=<somebody@gmail.com> proto=ESMTP helo=<hylandmnb>18:24
jjohansennot yet anyway, we need to probe into it more18:24
ivoksslipper1024: don't paste so much output18:24
slipper1024sorry18:24
ivoksslipper1024: now look for 196.35.255.4 before first line18:25
jdstrandsmoser, jjohansen: for now, I removed the apparmor tag and adjusted the title slightly to more accurately reflect the current thinking18:25
jdstrandsmoser, jjohansen: feel free to adjust if apparmor is the culprit18:25
jjohansenthanks jdstrand18:25
ivoksslipper1024: paste it on pastebin.com18:25
uvirtbotNew bug: #565036 in clamav (main) "For a real-time protection in clamav" [Wishlist,Confirmed] https://launchpad.net/bugs/56503618:26
smoseroh. i did the same jdstrand18:26
smoser:)18:26
jdstrandsmoser: do you have any insight into the underlying machine? like an id number or something? I ask cause if you ran your tests again, it might be interesting if the same host had the same problem18:27
ivoksslipper1024: grep 'Apr 20 18' /var/log/mail.log | grep 196.35.255.418:28
smoserjdstrand, you get no such information18:29
jdstrandbummer18:29
slipper1024ivoks: http://pastebin.org/16249518:30
slipper1024pasted connect-disconnect info18:31
ivoksslipper1024: so, as you can see18:32
ivoksslipper1024: there's no sasl_username18:32
ivoksslipper1024: your client didn't set up outlook to authenticate to smtp18:32
ivoksslipper1024: and smtp won't relay host for anyone, only for authenticated users18:33
slipper1024I see, Anonymous18:34
mcas1i need some help with the preseed testcase... i can boot the machine but the ntptime command gives me an error18:34
ivoksslipper1024: http://pastebin.com/aJ22CJz918:34
ivoksslipper1024: you should have something like this18:34
mcas1what can i do what is going wrong here18:35
mcas1?18:35
ivoksntptime?18:35
ivoksah...18:35
slipper1024he is using Outlook express and i watched him enter his login details18:35
slipper1024weird, gonna re-do18:36
slipper1024account setup18:36
ivoksthis is not account setup18:36
ivoksthis is smtp (outgoing) setup18:36
ivoksit's not offered in wizzard, iirc18:36
uvirtbotNew bug: #567269 in mysql-dfsg-5.1 (main) "package mysql-server-5.1 (not installed) failed to install/upgrade: trying to overwrite '/usr/bin/msql2mysql', which is also in package mysql-client 0:5.1.45-2" [Undecided,New] https://launchpad.net/bugs/56726918:36
uvirtbotNew bug: #567369 in samba (main) "package samba 2:3.4.0-3ubuntu5.6 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1" [Undecided,New] https://launchpad.net/bugs/56736918:36
uvirtbotNew bug: #567371 in eucalyptus "NC does not detach created pthreads in KVM driver" [High,Fix committed] https://launchpad.net/bugs/56737118:36
slipper1024sry that is what i mean18:36
ivokscheck again18:37
slipper1024ivoks: thanks man, those errors in mail.warn posted earlier18:37
ivoksslipper1024: http://dnet.net/techSupport/smtpAuthOE.asp18:37
slipper1024any idea?18:37
ivoksslipper1024: ignore them18:37
ivoksthose aren't errors18:37
ivoksthose are warrning, hence the name mail.warn18:38
slipper1024Ok thought it might be a dns misconfiguration on my part18:38
=== brianherman_ is now known as brianherman
ivoksslipper1024: those are spamers18:39
ivoksslipper1024: if configured right, postfix won't accept mail from hostname that's not resolvable18:40
ivoksslipper1024: so, if say 'helo i'm wickedname.google.cn' to you postfix18:40
ivoksslipper1024: it will laugh at me and drop the connection18:40
ivoksand then it will add notice to mail.warn, so you could laugh with it18:41
stephankHello! I'm on Lucid and trying to set up OpenLDAP with TLS and mutual authentication. Whether I use ldaps or StartTLS, the server closes the connection right after the client hello, and logs: “TLS: can't accept: The request is invalid..”. The client and server are the very same machine. I'm not sure where to go from here?18:41
ivoksstephank: self signed cert?18:41
stephankivoks: Yes, but I specified TLS_CACERT, TLS_CERT and TLS_KEY, and it's reading the files (seen in strace).18:42
ivoksstephank: try adding TLS_REQCERT allow to /etc/ldap/ldap.conf18:42
ivoksstephank: just to be sure...18:42
ivoksthis is, of course, client related18:43
stephankivoks: I had it set to demand, but just tried allow and no dice either.18:43
ivoksbut this is very common mistake, so let's try18:43
ivoksok18:43
ivoksmaybe your client isn't trying ssl?18:43
ivoksi like python for debuging ldap connection :)18:44
stephankWell, I'm convinced it's my mistake, on the other hand, it stops at the client hello, so all that's been said so far is which cyphers to use. :)18:44
smoserjdstrand, http://paste.ubuntu.com/419377/18:44
stephankI'm trying with "ldapsearch -ZZ"18:44
stephankand wireshark shows the starttls and client hello, then a connection close from the server18:44
ivoksstart openldap in debuging mode18:45
smoseri see that on a node controller... i think that the too many open files might be a result of bug 567371, and the apparmor errors just fallout18:45
uvirtbotLaunchpad bug 567371 in eucalyptus "NC does not detach created pthreads in KVM driver" [High,Fix committed] https://launchpad.net/bugs/56737118:45
stephankivoks: that's how I got the TLS error “TLS: can't accept: The request is invalid..”. I can't find anything on google related to slapd and that error, but it seems to be an error reported by gnutls.18:46
stephankstrange thing is, it's the same machine, and thus the same gnutls library on server and client18:47
jdstrandsmoser: cool18:47
kirklandjdstrand: have you ever seen: libvirt: cannot create pipe: Too many open files (code=38)18:48
kirklandjdstrand: this is related to smoser's error18:48
jdstrandsmoser: so it was able to launch virt-aa-helper, but then when it went to fork/exec kvm, it couldn't18:48
ivoksstephank: slapd -o openldap -g openldap -d 16383 ?18:48
jdstrandkirkland: sounds like the system is over-taxed, or you need up the ulimit18:49
jdstrandkirkland: but no, I have not seen it personally18:49
kirklandjdstrand: yeah, we're taxing it, by running hundreds (or thousands) of euca instances over a few hours18:49
smoserjdstrand, over time18:50
jdstrandkirkland: maybe you have an fd leak somewhere... or you just hit the limit18:50
smoserright.18:51
smoserin libvirt18:51
smoseri suspect18:51
smoserthe system is not terribly over taxed at the moment18:51
smoseras 114 processes in 4G of memory18:51
stephankivoks: Here's what I get: http://www.privatepaste.com/d0397d251318:51
kirklandjdstrand: yup, <nurmi__> oh yeah, file leak18:51
kirklandjdstrand: <nurmi__> it's holding on to the VM log files18:51
jdstrandupstream fixes fd leaks all the time (it seems) -- maybe check git?18:52
kirklandjdstrand: will do18:52
ivoksstephank: tls negotiation18:52
ivoksstephank: bah... have no clue :D18:52
stephankivoks: no problem, thanks for thinking along. :)18:53
ivoksstephank: no-tls works?18:53
stephankivoks: I'm going to try with gnutls-serv and the same certificates18:53
stephankivoks: well, I've only tried ldapi18:53
stephankivoks: well, gnutls-serv and gnutls-cli report the exact same error :'(18:56
ivoksstephank: try regenerating certificates18:56
ivoksstephank: use openssl18:56
ivoks:)18:56
stephankivoks: Will try that. Maybe I'm just doing something stupid, because I was trying to use the certificates my puppet installation generated18:57
jdstrandkirkland: fyi, I just double checked the security driver, and the one place it doesn't use a libvirt wrapper for managing fds, it dtrt18:57
kirklandjdstrand: smoser spotted http://osdir.com/ml/libvir-list/2010-02/msg00919.html18:57
kirklandjdstrand: smoser: hmm, that looks openvz specific18:58
jdstrandkirkland: that should be unrelated (openvz18:58
smoseryes it does18:58
smoseryeah, thats all in openvx_conf.c18:58
smoserbug 567392 is open now19:01
uvirtbotLaunchpad bug 567392 in libvirt "__virExec:362 : cannot create pipe: Too many open files" [Undecided,New] https://launchpad.net/bugs/56739219:01
jdstrandkirkland, smoser: this could be it: http://osdir.com/ml/libvir-list/2010-02/msg00210.html19:03
jdstrandabsolutePathFromBaseFile() is used by virStorageFileGetMetadataFromFD(), which is used in a few places in the storage driver19:05
Hypnozis anyone here familiar with dsh?19:06
pwnguindancershell?19:07
pwnguinyes19:07
Hypnozdo you know how to use a ' in the command string?19:07
jdstrandthat is actually used by the security driver, but in virt-aa-helper, not libvirtd, so that shouldn't be the cause of the problem19:07
jdstrandbut, virStorageFileGetMetadata() is used in other places as well19:08
jdstrandsmoser, kirkland: ^19:08
pwnguinHypnoz: are you using dsh -f hostlist -- command?19:08
Hypnozyeah. for example, dsh -f machines.list -- 'echo "a ' b"'19:09
pwnguinwell, im only familiar with it19:09
pwnguini ui admin our small renderfarm with it19:09
pwnguins/ui//19:10
Hypnozyeah i use it a lot for admin of a group of servers, but I pass any commands that have a ' in them19:10
Hypnozsuch as things with awk commands19:10
jdstrandkirkland, smoser: commit 53b7dae139f2dd66866aabedca35aa74dad1579d19:10
smoserjdstrand, http://libvirt.org/git/?p=libvirt.git;a=commit;h=53b7dae139f2dd66866aabedca35aa74dad1579d19:10
smoseryeah19:10
smoseri was just typing that19:10
jdstrandkirkland, smoser: I've not looked at it, but that seems as good a place to start as any19:10
smoseryea19:11
pwnguinHypnoz: well, i'm interested to find out the answer myself now19:11
HypnozI'm trying things to escape the ' out like dsh -m web100 -- 'echo "a \' b"'  but still no luck19:12
Hypnozhooray! dsh -m web100 -- 'echo "a '"'"' b"'19:14
Hypnozweb100: a ' b19:14
jdstrandsmoser, kirkland: you guys might want to do something like: watch 'sudo ls -1 /proc/`cat /var/run/libvirtd.pid`/fd | wc -l'19:14
smoserjdstrand, awesome19:15
smoseri was wondering how iw as going to tell if this fixed the problem19:15
smoserwithout waiting till tomorrow19:15
jdstrandwell, shoot19:15
jdstrandthere is a leak19:15
jdstrandif I do a virsh start the fd increments by 2,then a virsh destroy it only decrements by 119:16
jdstrandsmoser, kirkland: ^19:18
jdstrandsmoser, kirkland: fyi, I tested with the apparmor driver disabled and it still leaks19:18
jdstrandsmoser, kirkland: it isn't closing the log:19:20
jdstrand$ diff /tmp/before /tmp/after19:20
jdstrand38a3919:20
jdstrand> lrwx------ 1 root root 64 2010-04-20 13:17 43 -> /var/log/libvirt/qemu/sec-dapper-i386.log19:20
jdstrandI'll update the bug19:20
smoserconsole log ?19:20
smoserthank you19:20
jdstrandsmoser: not the console log, the debug output log.19:21
smoserat the risk of sounding like a fool, debug output log ?19:21
smoserof what19:21
jdstrandsmoser: libvirt19:22
jdstrandsmoser: libvirtd logs stuff like this to files in /var/log/libvirt/qemu/<vmname>.log:19:22
smoserah. ok19:22
smoseryeah, i see it19:22
jdstrandhttp://paste.ubuntu.com/419395/19:22
jdstrandsmoser: which bug is it?19:23
smoserhttps://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/56739219:23
uvirtbotLaunchpad bug 567392 in libvirt "__virExec:362 : cannot create pipe: Too many open files" [Undecided,New]19:23
jdstrandsmoser: I'll update it with what I found19:23
jdstrandcool, thanks19:23
binBASHis there any way to get glusterfs packages from lucid into actual ubuntu server release?19:25
jdstrandsmoser: let me check to see if shutdown is also affected19:26
binBASHI've seen actual release has glusterfs 2 while the lucid has glusterfs 319:26
smoserhttp://libvirt.org/git/?p=libvirt.git;a=commit;h=598a0c00dcc7fa07d226a3f508b517690a9be81919:26
smoserjdstrand,19:26
smoserwait19:27
smoserignore that19:27
jdstrandk19:27
smoserhttp://libvirt.org/git/?p=libvirt.git;a=commit;h=caad0a878337b52c4453444bb227b74cce6e6d5f19:27
smoserthat one19:27
jdstrandsmoser: that has to be it19:27
jdstrandI can almost guarantee it19:28
jdstrandand it is a two line patch!19:28
smoseryeah. stars aligned19:29
jdstrandheh19:29
smoserjdstrand, please do update that bug19:30
smoserat least confirm it19:30
jdstrandsmoser: is this for SRU?19:30
kirklandjdstrand: ideally for RC19:30
kirklandsmoser: jdstrand: back from lunch19:30
jdstrandmy vm died and I couldn't shut it down nicely19:30
jdstrandhold on19:30
smoserjdstrand, sru for lucid ?19:30
smoseras opposed to NOW19:30
jdstrandwell, I have an SRU bug I can squeeze in there so I can prepare the upload if you like19:31
JanCbinBASH: wait 2 weeks, then lucid will be an "actual release"  ;-)19:31
jdstrandsmoser: yes, SRU vs NOW19:31
jdstrandsmoser: I can do the NOW if required19:31
smoserwell, lets verify this fixes first19:31
smoserwhich we think it would19:31
jdstrandof course19:31
smoseri'm so happy that you use quilt19:32
jdstrandsmoser: I'm so confident it will, I'll even do all the work, test it and get back to you :)19:32
smoserjdstrand, fair enough19:32
jdstrandheh-- thank debian :)19:32
smoserok then, build me a deb and i'll test it.19:33
smoserso we think that simply bouncing libvirtd will fix my euca problem19:33
jdstrandk, still checking shutdown. after will update the bug and build a deb19:33
jdstrandsmoser: amd64 or i386?19:34
jdstrand(or both)19:34
smoserthis is amd6419:34
jdstrandk19:34
smoserafter restart: ls /proc/$a/fd | wc -l19:34
smoserwent from 1021 files to 3319:35
kirklandsmoser: lsof should help too19:35
smoserbouncing libvirt (sudo restart libvirt-bin) fixed the euca issue19:36
binBASHJanC: Well, still a bit long19:36
JanCbinBASH: you can always test with the beta for now19:38
binBASHJanC: I had very bad experience in the past at least with the desktop versions of ubuntu. :)19:39
_rubenbinBASH: depending on the dependencies (no pun intended), you could either just install deb lucid .deb file, or backport it (and perhaps some/all of its dependencies)19:40
binBASH_ruben: Yeah I will try it.19:41
binBASHHowever I didn't find 64 bit version19:41
binBASHahh I found it19:42
binBASH_ruben: /usr/sbin/glusterfsd: symbol lookup error: /usr/sbin/glusterfsd: undefined symbol: gf_proc_dump_info19:45
binBASHlooks like it failed19:45
binBASH:/19:46
jdstrandsmoser: building now19:48
JanCbinBASH: I assume that you want to test something like glusterfs before using it for real, so using a beta version for testing shouldn't be much of an issue?19:48
binBASHJanC: I tested the glusterfs already19:49
JanCI mean version 3  ;)19:49
slipper1024ivoks: outlook express and outlook on winxp and earlier doesn't support DHE-RSA-AES256-SHA  encryption19:49
binBASHJanC: I tested version 3 on CentOS ;)19:50
binBASHI tested version 2 as well and I know it was not what I need ;)19:51
_rubenbinBASH: which package(s) did you install?19:52
JanCbinBASH: so, try it on ubuntu lucid beta so you can be sure it works well...19:54
JanCit's not like much will change in the 2 weeks that are left...19:55
smoserkirkland, so you never hit that issue in libvirt because you had multiple node controllers19:55
* RoyK sends some Icelandic ash in binBASH's directoion19:55
RoyKdirection, even19:55
kirklandsmoser: ah, true, i do have 3 NCs right now19:55
kirklandsmoser: <nurmi__> do you have log files from the CLC in the case where the meta-data service is failing in the way scott was descriving this morning?  We've looked at the code and nothing is jumping out19:56
kirklandjdstrand: reading scroll back, looks like you've grabbed that libvirt fix, and you're building a libvirt for smoser to test?19:57
hggdhkirkland: out of memory again. I will add the data in the bug19:57
kirklandhggdh: hmm, even with the 384M fix?19:58
smoserkirkland, its readily reproducible19:59
smoserespecially on datacenter19:59
kirklandsmoser: k, will grab logs19:59
smoserhggdh, maybe we could mark the logs (or rotate them) then start a run19:59
smoserso you've got clean stuff.19:59
kirklandhggdh: did you have any of the metadata service style failures in that last run?20:00
smoserkirkland, the most recent log there single_test.log.2010-04-20_13580720:02
smoserhas loads of them20:02
binBASH_ruben: glusterfs-client and glusterfs-server20:03
binBASHJanC: I don't wanna damage my working cloud structure ;)20:03
hggdhkirkland: yes, a series of them -- the instance waits for the metadata, then barfs when it gets it empty20:05
kirklandhggdh: great, could you tar up /var/log/eucalyptus on the CLC?20:05
kirklandhggdh: and put it somewhere I can get to it and send on to Eucalyptus?20:05
kirklandhggdh: also, could you pastebin /etc/init/eucalyptus.conf for me?20:06
kirklandhggdh: and (silly question), you did restart all of the eucalyptus services after making that conf file change, right?20:06
jdstrandkirkland: I am testing the build now20:07
hggdhkirkland: in reverse order: yes, I restarted the CLC, CC, and SC; I can pastebin, but the 'ps aux' in the bug comments shows the memory allocation20:08
hggdhfor the CLC20:08
\shhmmm..does anyone has experience with an HP lefthand iscsi system + HP StorageWorks x5000 as nfs/cifs concentrator?20:12
kirklandhggdh: got it20:13
kirklandhggdh: now, just a tarball of the /var/log/eucalyptus from the CLC20:13
hggdhkirkland: attaching to the bug right now20:16
jdstrandsmoser, kirkland: packages fix it for me. they are on chinstrap in /home/jamie/uploads/lucid/libvirt20:16
kirklandhggdh: cheers20:16
* jdstrand updates bugs20:17
jdstrandbug20:17
kirklandjdstrand: i'll take a quick look20:17
kirklandjdstrand: i suggest we try to get this into RC ... objections?20:17
kirklandsmoser: ^20:17
smoseri dont know. it is obviously a but, but not one that would be hit in a week or two by someone doing something other than libvirt testing20:18
smosers/obviously a but/obviously a bug/20:18
smoserbut it seems like extremely low chance of regression20:18
jdstrandI'll attach the debdiff and let you decide20:18
jevidlIn the past I have used mem="2048" on the kernel line in grub to limit the system memory. With the advent of grub2, I don't seem to be finding a way to do it anymore. Google is happy to tell me all about how grub uses memory, etc. but not much about the kernel line option. Is this still possible?20:18
smoserkirkland, can you get to cempedak ?20:18
kirklandsmoser: yeah20:18
smoserif so, its in /tmp/eucalyptus-logs.tar.bz220:18
smosereuca logs20:18
kirklandsmoser: strike that, ssh denied to cempedak20:20
hggdhhuh? you cannot ssh there?20:21
ttxkirkland: was bug 567371 something we hit in our stress testing ?20:21
uvirtbotLaunchpad bug 567371 in eucalyptus "NC does not detach created pthreads in KVM driver" [High,Fix committed] https://launchpad.net/bugs/56737120:21
kirklandttx: yes, something that dan hit during stress testing20:22
kirklandttx: i have merged his fix20:22
kirklandttx: i was going to do a brief round of testing, and then propose for upload20:22
ttxok, not something we hit in stress testing, but something they hit in theirs ?20:22
kirklandttx: yes, but i think i've hit it too20:23
ttxok20:23
kirklandttx: though i don't have evidence of it on my cloud at the moment20:23
kirklandttx: basically, there are 3 bugs we're tracking/trying to fix right now ...20:23
kirklandttx: a) a java heap memory error, #56510120:23
kirklandttx: b) a libvirt file leak error, #56739220:24
kirklandttx: c) dan's NC pthreads error, #56737120:24
jdstrandkirkland, smoser: debdiff attached, bug updated with my testing (#567392)20:24
ttxkirkland: hm, what about bug 566792 ? it's pretty high on my list20:24
uvirtbotLaunchpad bug 566792 in eucalyptus "UEC guests sometimes fail on consuming user data" [High,Confirmed] https://launchpad.net/bugs/56679220:24
kirklandttx: all 3 have proposed fixes, we're just trying to verify the fixes now20:24
ttxkirkland: did nurmi comment on that one ?20:25
kirklandttx: right, d) metadata sometimes fails, #56679220:25
kirklandttx: dan is looking into that one, haven't been able to reproduce it20:25
ttxkirkland: ok, that matches my list then :)20:26
kirklandttx: appears to be hardware dependent ... the faster your hardware, the more likely/often you hit it20:26
kirklandttx: which of these do you want in RC?20:26
kirklandttx: which of these do you want in SRUs?20:26
smoseri think its more io speed related20:26
smoserthan just general "fast"20:26
ttxI think you hit it on slow UEC and fast images20:26
ttx(fast to boot)20:26
kirklandttx: so do you want us to target all of these for RC?20:27
kirklandttx: 2 of them are basically "done"20:27
kirklandttx: one of them has a proposed fix that didn't quite work on first round of testing20:27
ttxa b c can be done in SRUs idf needed20:27
kirklandttx: and one is still under investigation20:27
kirklandttx: i think all of these can be done in SRUs ... i'm just concerned about the effort required to do these in RC versus SRU20:28
kirklandttx: i'm looking for your guidance on that20:28
hggdheeek. I also see a JavaStackOverflow in the walrus20:28
ttxat that point the effort is the same. So it depends on the regression risk of the patch. If any, then SRU20:29
ttxbut...20:29
ttxfor (d) we need to come to the bottom of it, make sure its a euca bug and not something we need to fix/workaround in our images20:29
ttx(we can still issue an image update but I thin it's less easy than a package sru)20:30
ttxkirkland: for sru vs. RC fix, I trust the release team to make the right choice... if you want me to assess it, I can have a quick look at the patches20:32
ttxif you point me to them20:32
kirklandttx: https://bugs.edge.launchpad.net/ubuntu/+source/libvirt/+bug/56739220:32
uvirtbotLaunchpad bug 567392 in libvirt "__virExec:362 : cannot create pipe: Too many open files" [High,In progress]20:32
kirklandttx: patch at the bottom;  i just proposed for RC20:32
ttxthat one sounds rather limited, I'd support it20:33
kirklandhggdh: for the heap error, did increasing the memory change the behavior at all?  push out the mem errors further?  anything?20:33
kirklandttx: thanks; i agree20:34
ttxif you want it to RC, you need to push it to release team now and ask them to reroll asap20:34
ttxany other patch ?20:34
* jdstrand is ready to upload20:34
* ttx looks into rev1223 for the NC thread thing20:35
ttxthat one looks slightly more dangerous...20:37
kirklandttx: okay20:37
kirklandttx: so we should start prepping a Day0 SRU?20:38
ttxyes, having something in -proposed would be good20:38
ttxthe walrus thing... I'm ok with -Xmx384m, but that doesn't seem to work so well20:39
kirklandttx: right, i'm hoping this one is easy to fix20:41
kirklandttx: and easy to verify is-fixed20:41
kirklandttx: but that didn't work yet20:41
ttxkirkland: ok, I'll shut down for the day and let all that in your hands20:41
kirklandttx: ack, bon soir20:42
ttx(and the release team ones) :)20:42
ttxcheers20:43
kirklandhggdh: could you "grep -ri pthread /var/log/eucalyptus/*" on each of the lab machines?20:46
kirklandhggdh: tell me if you have any hits?20:46
kirklandhggdh: i don't see any traces of https://bugs.edge.launchpad.net/ubuntu/+source/eucalyptus/+bug/567371 in my test rig20:46
uvirtbotLaunchpad bug 567371 in eucalyptus "NC does not detach created pthreads in KVM driver" [High,Fix committed]20:46
kirklandttx: i have targeted https://bugs.edge.launchpad.net/ubuntu/+source/eucalyptus/+bug/567371 at lucid-updates SRU20:46
_rubenbinBASH: you likely need libglusterfs0 to be upgraded as well21:17
dbernar1I'm trying to set up samba as a domain controller. I was following https://help.ubuntu.com/8.10/serverguide/C/samba-dc.html and my windows client can not see my domain.21:26
dbernar1http://pastebin.com/tKCJ4yEW21:27
dbernar1That's my smb.conf21:29
kirklandhggdh: around?21:38
hggdhkirkland: on call21:43
kirklandhggdh: i'm trying to get onto cempedak21:43
kirklandhggdh: n'mind, i got it21:44
kirklandhggdh: okay, by changing to 384M, we actually "reduced" the amount of memory (turns out it defaults to 512M)21:49
hggdhkirkland: I am back, sorry, was on my 1-on-121:58
kirklandhggdh: no problem; debugging heap mem issue with dan21:59
hggdhkirkland: will check for the pthreads now21:59
hggdhheh. less mem to alleviate memory starvation is fun :-)22:00
kirklandhggdh: did it poop out soon/later/same when you did that?22:00
hggdhkirkland: it changed the behaviour, actually -- instead of refusing any, and all, new requests, it would fail *sometimes*22:03
hggdhkirkland: no pthread in any of the logs22:03
kirklandhggdh: thanks22:03
hggdhkirkland: but, OTOH, I have been unable to register a new UEC image22:03
kirklandhggdh: can you bump it up to 1024 on each of the clc, walrus, sc and restart those services?22:04
hggdhkirkland: roger wilco22:04
kirklandhggdh: don't know if that's going to be acceptable though22:04
binBASH_ruben: Thanks the message dissapeared ;)22:05
dbernar1I'm trying to set up samba as a domain controller. I was following https://help.ubuntu.com/8.10/serverguide/C/samba-dc.html and my windows client can not see my domain. http://pastebin.com/tKCJ4yEW is my smb.conf22:06
hggdhkirkland: it's been a time since I worked on Java, but I have a dim memory it was not acceptable. Will find in a few ;-)22:07
kirklandhggdh: heh22:07
* RoAkSoAx feels like coding...22:09
binBASH_ruben: Thanks a lot again.22:09
uvirtbotNew bug: #567538 in net-snmp (main) "[libsnmp-base] unnecessary dependency on gawk" [Undecided,New] https://launchpad.net/bugs/56753822:11
hggdhkirkland: swallowed hook, sink, and bait. Will do a new sequence of tests22:12
hggdhfrom an instance console: WARNING:INSTANCE i-3C9E0644:rm: cannot remove `/var/lib/urandom/random-seed': Read-only file system22:33
hggdhwhat does that mean? random-seed is static?22:33
hggdhsmoser: which image has the debug on metadata?22:34
kirklandhggdh: if your filesystem has gone readonly, that's globally bad22:55
hggdhkirkland: I see it on some of the failed instances22:56
hggdhkirkland: I only really noticed it due to a completely different (and unrelated) issue involving virtual machines22:58
hggdhkirkland: now, if this should not happen, then we may have yet another issue to look at22:58
mathiazjdstrand: hi - looking at bug 56680322:59
uvirtbotLaunchpad bug 566803 in augeas "/usr/share/augeas/lenses/dist/iptables.aug should use a different path" [Low,New] https://launchpad.net/bugs/56680322:59
mathiazjdstrand: is there a default location for the iptables save file?22:59
jdstrandmathiaz: using standard iptables-save?23:00
mathiazjdstrand: yes23:00
mathiazjdstrand: I don't see an init script or upstart job23:00
jdstrandmathiaz: no-- it just dumps to stdout. You have to redirect it somewhere23:00
mathiazjdstrand: right23:00
mathiazjdstrand: so there is a standard location for the file23:00
jdstrandmathiaz: the iptables tuturial mentions /etc/iptables-save23:02
mathiazjdstrand: what would be recommendation for Ubuntu?23:02
jdstrandmathiaz: Debian used to put it somewhere, I don't recall otoh23:02
jdstrandmathiaz: ufw23:02
jdstrand:)23:02
jdstrandmathiaz: tbh, there are a bunch of iptables frontends. they all do stuff differently23:03
jdstrandmathiaz: /etc/iptables-save seems reasonable enough if you aren't going to use ufw (or shorewall)23:03
mathiazjdstrand: right - /etc/sysconfig/ is definetly not the correct place though23:03
jdstrandmathiaz: no23:04
jdstrandmathiaz: I wouldn't put it in /etc/default23:04
jdstrandeither23:04
jdstrandmathiaz: what is this for?23:04
mathiazjdstrand: bug 56680323:04
uvirtbotLaunchpad bug 566803 in augeas "/usr/share/augeas/lenses/dist/iptables.aug should use a different path" [Low,New] https://launchpad.net/bugs/56680323:04
mathiazjdstrand: the location of the default file for augeas23:04
jdstrandmathiaz: well, technically, it is saving the state of the firewall23:05
jdstrandmathiaz: as such, it should really by in /var/lib23:05
jdstrandmathiaz: however, since this is presumably starting early on boot, /var may be on another partition23:06
jdstrandmathiaz: and thus not available23:06
jdstrandmathiaz: so, you can try to be FHS compliant and put it in /lib/...somewhere (though some interpretations of the FHS wouldn't like that either), or just say /etc/iptables-save23:07
jdstrandmathiaz: since /etc/iptables-save is most discoverable, and in the iptables tutorial, I recommend it23:08
mathiazjdstrand: great - thankls23:09
kirklandhggdh: yeah, if instance filesystems are going readonly, that's another bug :-/23:09
kirklandhggdh: possibly an fsck one?23:09
gzmaskquestion: in UEC, using SYSTEM mode in networking, I start an instance with --addressing private, and I got the private IP 172.19.1.2 from euca-describe-instances, but I can't ping or ssh onto the instance. Is it something wrong here? Also, when I euca-run-instances without using --addressing private, it gives a address resource error which is expected since I need to submit MAC address to get assigned an IP here on campus network.23:11
jdstrandmathiaz: sure, np23:12
kirklandmathiaz: are you planning to take hggdh's recent improvements to the test scripts?23:17
mathiazkirkland: yes23:19
mathiazkirkland: I should create a project for that23:19
kirklandmathiaz: twould be nice23:20
mathiazkirkland: are you also running into bug 567396 while doing your UEC test install?23:25
uvirtbotLaunchpad bug 567396 in partman-base "partman/confirm preseed not taken into account" [Undecided,New] https://launchpad.net/bugs/56739623:25
Rafael_ i am new and try this comand and got the following error, anybody can help: rgotten@myplasticare:~$ sudo /etc/init.d/rsync restart23:25
Rafael_<Rafael__> write: Resource temporarily unavailable23:25
Rafael_<Rafael__>  * Restarting rsync daemon rsync                                                                                                                                                  write: Resource temporarily unavailable23:25
Rafael_<Rafael__>  * rsync daemon not running, attempting to start.23:25
Rafael_<Rafael__> write: Resource temporarily unavailable23:25
Rafael_this was done on my ubuntu server23:26
kirklandmathiaz: i think i just had to add "d-i partman/confirm_write_new_label boolean true"23:27
kirklandmathiaz: well, hmm, i see you have that23:28
kirklandmathiaz: this preseed worked for me yesterday: http://mirror/uec-auto/preseed/preseed-00-24-e8-da-a2-1123:28
\shguys....I have to say "Thank you" to you all...doing jaunty updates (security and updates) and everything works like a charm..no flaws :) thanks for that :)23:29
hggdhkirkland: OK, seems the -Xms1024m did the trick. I have reached 890M on RES, and it is still running23:32
mathiazkirkland: hm - could you post your preseed somewhere that I can access to it?23:39
erichammondjiboumans: Has any progress been made on getting Amazon's Perl package for SimpleDB into CPAN/Debian/Ubuntu? http://developer.amazonwebservices.com/connect/entry.jspa?externalID=1136&categoryID=14823:41
g-hennuxhi!23:43
g-hennuxwhere does ufw store its configuration, in case i want to migrate it from one host to another?23:43
g-hennuxor what's the preferred way of backing up my ufw rules, if you want?23:44
hggdhkirkland: I am in doubt. Against which package should the bug be (for the readonly messages I saw in the instance console output)23:55
kirklandhggdh: hmm, great question :-/23:56
kirklandmathiaz: oh, sorry23:56
kirklandhggdh: start with cloud-init, i suppose23:56
RoAkSoAxmathiaz, I have a quick question. Is the puppet EC2/UEC integration is only the ability to register the instances running to a puppet server automatically?23:57
RoAkSoAx\sh, btw... where you able to setup pacemaker/corosync with puppet?23:57
hggdhthanks23:57
\shRoAkSoAx, nope...we are still working on that23:58
\sh.oO(and more)23:59
mathiazRoAkSoAx: there other alternatives23:59
mathiazRoAkSoAx: you can always create your script to do that23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!