/srv/irclogs.ubuntu.com/2011/09/05/#ubuntu-server.txt

qman__then consider this an important lesson in system administration -- before you change something, take note/save a copy of the old setting00:00
multiHYPoh its messy00:00
multiHYPi didn't know ufw existed even :(00:00
multiHYPout of security concerns rushed it00:01
qman__a rush job is never secure00:01
multiHYPis it harmful to just remove those iptables rule files?00:01
qman__save a copy and try it to find out00:02
multiHYPthis is big responsibility even for my own little things00:03
multiHYP:S00:03
multiHYPlike being a guard at the door of a bank or something00:03
qman__as previously mentioned, ubuntu is secure by default, you should take your time when installing packages and pay attention to the changes you make, as that's where most systems' points of failure are00:05
qman__unless you use a really poor password, even the default SSH is reasonably secure00:06
qman__think about it this way, who do you trust to be better at security00:07
qman__random blogger posting guides on the internet, or the package maintainers00:07
multiHYPwow, im glad rm * didn't remove the .files00:12
multiHYPi was in my ~ directory and wanted to remove those temporary iptables files and used rm *00:12
multiHYPno way, i am trying to learn these for myself, so that if something goes wrong i can rectify the situation, i keep things well documented :D00:13
multiHYPcannot remove my vm and recreate a brand new one. and keeping backups is expensive. at least for now not worth backing up00:14
multiHYPwhy is my ubuntu not having aptitude and what is interpid…?00:33
PicimultiHYP: er, what do you mean?00:35
multiHYPsudo aptitude install nginx00:36
multiHYPsudo: aptitude: command not found00:36
multiHYPam i supposed to install aptitude via apt-get and then use it to install nginx?00:36
Piciaptitude is just another apt frontend, you can us either to install nginx.00:37
multiHYPno, nginx doesn't work with apt-get at all00:37
multiHYPoh wait it did00:37
multiHYPthen it wasn't working with brew on mac00:38
multiHYPim mixing everything up now00:38
multiHYPsorry00:38
Piciits okay, I'm only slightly confused.00:38
tiphareshow to benchmark a server through a shell?00:43
tiphareslike CPU/ram etc00:43
JRWRI am having a issue with mod_shared_roster_ldap - It seems to be crashing, here is a related pastebin with all the info that should help, http://pastebin.com/hkZung2p00:49
multiHYPldap on mac lion has a huge bug00:50
multiHYPbe careful00:50
JRWRubuntu all the way00:51
multiHYPis it possible to set nginx to autostart on startup00:51
multiHYP?00:51
multiHYPJRWR: yep, ubuntu is most solid and hassle free00:51
JRWRmultiHYP: uing init scripts, yes00:51
multiHYPhow?00:52
JRWRmultiHYP: also I am a total ldap newbie00:52
JRWRupdaterc.d (I think) go google it :)00:52
multiHYPi tried using it, but didn't need it really, unless you are in a corporate or something00:52
JRWRlarge project00:52
JRWR100 people authing into 40 differnt programs00:52
multiHYPwow, yeah ldap might be handy :D00:58
multiHYPwhats the advantage of running ntp all the time?01:16
twbmultiHYP: that your clock stays correct.01:18
multiHYPwhy is apt-get remove --purge not cleaning my os from the installed application?01:27
multiHYPi used apt-get install to setup it up anyway...01:27
twbI don't understand the question.01:38
twbmultiHYP: what application?  That is, what package name?01:38
multiHYPi installed nginx with apt-get and tried to uninstall it, but things about nginx are still on my system01:39
twbWhat do you mean "things about nginx" ?01:39
multiHYPapart from having only 0.8.54 on apt-get repository where the latest is 1.0.6, it cannot be removed cleanly as expected.01:39
multiHYPfiles and folders01:39
multiHYPbasically apt-get remove nginx --purge doesn't do what it supposed to on ubuntu 11.0401:40
multiHYP:o01:40
twbpastebin the output of "dpkg -l '*nginx*'"01:41
pmatulismultiHYP: what is this ldap lion bug?01:41
multiHYPyou can login as anybody, as soon as you have the public settings01:41
multiHYPi don't know exactly but its a major embarrassment.01:41
pmatulismultiHYP: so ldap server on lion then?01:42
multiHYPpmatulis: not sure ldap server or just ldap, but yes the bug is related to os x lion implementation.01:42
twbmultiHYP: uh, you got a CVE reference for that?01:43
multiHYPhttp://pastebin.com/ujMtyDby01:43
multiHYPwhat is CVE?01:43
twb!MITRE01:43
twb!CVE01:43
twbUgh, why can't ubottu just have all of dpkg bot's info entries.01:44
twbmultiHYP: MITRE CVEs are a central reference point for vulnerabilities, irrespective of the project they occur in01:44
multiHYPare those applications too?01:44
multiHYPstill unclear01:45
twbhttp://cve.mitre.org01:45
twbAs to your nginx issue, when you ask for a package to be installed, it pulls in all dependencies.  When you ask for a package to be removed, it doesn't (by default) remove obsolete dependencies.01:45
multiHYPso --purge supposed to clean though01:46
twbmultiHYP: what has happened is you asked for nginx, which has pulled in nginx-full (the real program) and nginx-common (the support files), and these have not been removed by your attempt to purge "nginx", which only removed the wrapper package.01:46
multiHYPsomeone tested the same thing on debian01:46
multiHYPand it worked!01:46
multiHYPoh01:46
twbmultiHYP: on an older system, nginx was not simply a wrapper for nginx-full.01:46
twbYou probably want to look into "apt-get autoremove"01:47
twb"purge" is the same as "remove", except that it also removes config files.  Remove will remove everything *but* the config files, but only of the packages you explicitly list.01:47
multiHYPhow can i make sure that its now gone for good?01:48
twbmultiHYP: purge the relevant packages01:52
multiHYPi did, i did autoremove evne01:52
multiHYPthese are the main ones remaining: http://pastebin.com/sGUwrXMW01:53
multiHYPremoved them manually01:56
multiHYPwhat a pain, is apache as bad as nginx?01:56
warning123hi all i have connected to my server through ssh , i started a game server and it had terminal showing me the live processing... but then after ssh disconnected when i relogged in , im back to root , how can i check that live processing again , i dont want to open the same process i want to go back to that window01:58
blsh0pwhat is ubuntu server?01:59
KoolaidJunkieIts used to run web server, game server, etc02:00
warning123blsh0p, http://en.wikipedia.org/wiki/Server_(computing)02:00
KoolaidJunkieOr click that. lol02:00
KoolaidJunkieI need some help with DDCLIENT. Im trying to update my IP with DynamicDNS service. But its sending my local ip (the one behind the router) instead of my external ip02:01
twbKoolaidJunkie: you need to run ddclient on the host that has the public IP address, i.e. the one doing PPPoE or PPPoA.02:02
twbKoolaidJunkie: if this is not possible, you need to find some what for ddclient to learn that address02:02
twbmultiHYP: what depends what you mean by "bad".02:04
KoolaidJunkietwb: how can I make DDCLIENT learn that address. Ubuntu Server is running on a Desktop PC hardwired to the router.02:04
twbI don't know.02:05
multiHYPwell, hard to remove things and reverse to a previous (before installation) state.02:05
warning123KoolaidJunkie, < are u connected > to a < router > then < another router > = then > internet < ? , or 1 router to the internet? if 1 router then activate DMZ on the computer with DDCLIENT to allow it to be the DHCP -CEO which is like connecting from you to the WAN ( internet ) .02:05
* twb thinks: I should stop being so helpful, this channel is getting to be as bad as #ubuntu...02:06
KoolaidJunkiewarning123, there is only 1 router. and the computer running Ubuntu Server is hardwired to the LAN1 port02:06
twbKoolaidJunkie: I usually address it by putting Ubuntu on the router02:07
KoolaidJunkieI don't think ubuntu will run the router. if it can I have no clue how to flash it to it02:08
twbKoolaidJunkie: right; you would probably need a new router and a new ADSL modem or ATM card.02:09
twbKoolaidJunkie: the other approach, of course, is to get a static IP from your ISP.02:09
KoolaidJunkieYeah, thats a little extreme when all I want to do is run a Teamspeak Server02:09
twbShrug.02:10
warning123KoolaidJunkie, does ur router have Dyndns functionality ? if not try editing DDCLIENT to be able to read ur WAN ip and not local , im guessing u will need it to check online and not locally02:13
twb!u02:13
ubottuU is the 21st letter of the modern latin alphabet. Neither 'U' nor 'Ur' are words in the English language. Neither are 'R', 'Y', 'l8', 'Ne1' nor 'Bcuz'. Mangled English is hard for non-native English speakers. Please see http://geekosophical.net/random/abbreviations/ for more information.02:13
warning123ubottu, thanks02:15
ubottuYou're welcome! But keep in mind I'm just a bot ;-)02:15
KoolaidJunkiewarning123, I set DMZ in router. How should I config DDCLIENT now?02:16
JRWRI am having a issue with mod_shared_roster_ldap - It seems to be crashing, here is a related pastebin with all the info that should help, http://pastebin.com/yMVVKN5W02:20
warning123KoolaidJunkie, /etc/ddclient.conf file02:23
KoolaidJunkiewarning123, thanx. i got it now. by changing to use=web, web=dyndns its pulls the external ip02:25
warning123KoolaidJunkie, np02:26
Dravekxhi03:16
Dravekxanyone good with LAMP and ssl certs on ubuntu server?03:16
twb!anyone03:27
ubottuA high percentage of the first questions asked in this channel start with "Does anyone/anybody..." Why not ask your next question (the real one) and find out? See also !details, !gq, and !poll.03:27
DravekxI have LAMP installed on Ubuntu Server  11 and Im trying to install an SSL cert, but not sure exactly where it goes?03:28
delerium_might help: https://help.ubuntu.com/8.04/serverguide/C/httpd.html03:32
Dravekxyeah reading that.03:40
delerium_Also depends if you want to use a self sign or a certificate signed by a vendor (verisign, entrust, etc,etc)03:41
Dravekxvendor. already have the cert. need to install it.03:42
delerium_and I guess it's for Apache. right^03:42
Dravekxyeah. I just did the request.03:42
Dravekxone page says to keep them together in /etc/ssl and the other says to put them in the /certs and /private directory. I'm not sure what is correct.03:43
DravekxI guess it doesnt matter as long as the links are correct.03:43
delerium_I think they can be in wathever path you put in your .conf file (honestly, I never install cert on Apache, only on Netscape / IHS / WAS).  But it should be pretty similar03:44
twbDravekx: read the version appropriate to your install verison -- not necessarily 8.0403:45
delerium_twb: yeah. my bad on this03:45
=== idleman is now known as bicranial
Dravekxhere's two directories: sites-enabled and sites-available. one has default and default-ssl, and the other has 000-default. Everything is running from 000-default. how do I enable both the default and the default-ssl?04:21
DravekxI need the default for port 80 /var/www and the ssl for port 443 /var/www-ssl04:22
qman__Dravekx, sudo a2ensite sitename04:23
Dravekxqman__ ahh right.04:24
qman__then reload or restart apache04:24
twbThe reason it's 000-default is simply because apache has no concept of "default" -- the vhost it defaults to is the first one in the config file04:25
Dravekxtwb if I need default and default-ssl running, would I made one configuration file for both, or keep them separate?04:26
multiHYPwhere is the standard place to install stuff in ubuntu? i have admin privileges but as a normal user where should i install my stuff such as webserver and other applications…?04:27
twbeverything in -enabled is considered part of "the" config file04:27
qman__multiHYP, normal users don't install web servers or applications04:28
qman__normal users use the applications04:28
multiHYPok so this is an admin thing, then i need to know for both, admin as well as normal user application ilocations.04:28
qman__the standard process is to use apt-get, or at the very least, dpkg to install software04:29
qman__compiling from source and manually installing is not recommended04:29
multiHYPbut some packages aren't available or as up to date as one hopes via those methods.04:29
twbThe way normal users get packages installed, is to call the sysadmin and beg him to install it04:29
qman__if you must compile from source, you should build a .deb package and install it04:29
multiHYPhow is that done? i thought .deb was for debian only.04:30
qman__ubuntu is built from debian, and uses debian's package management system04:30
qman__don't take that to mean you can install debian packages on ubuntu, the dependency tree is different04:30
multiHYPoh so why use ubuntu instead of debian anyway?04:30
twbBecause Debian is less forgiving of idiots.04:31
multiHYPi thought ubuntu would make things easier than so many other kinds of linux distros04:31
qman__it's a matter of user preference04:31
qman__as is almost any choice of distribution04:31
multiHYPso okay this seems like a solid idea actually, i get the .tar.gz and make a .deb package out of it for install/deinstall and remove the .tar.gz04:32
multiHYPso later i can reuse the .deb package04:32
qman__the point of packaging a manual compile is so that it can be easily removed from the system later04:32
multiHYPyes, its exactly what i need too. had a hard time manually removing a bad pkg with different dependencies...04:33
qman__again, compiling manually should be a last resort04:34
qman__you lose a lot of benefits04:34
multiHYPi know, there is no .deb package for this application04:34
twbmultiHYP: you should be asking yourself "do I really need this package?"04:35
multiHYPat least this version of the application, also the one i got through apt-get was a bad package, because it wasn't removed cleanly afterwards04:35
qman__incorrect04:35
qman__you simply did not remove all the packages it depended on04:35
multiHYPwell i didn't know that was possible04:36
multiHYPi didn't know it was depending on anything actually04:36
qman__when you install software it informs you of everything which is being installed04:36
qman__this includes dependencies and recommends by default04:36
multiHYPhence, i thought by removing it would know that by itself. kind of counter intuitive, don't you think?04:36
qman__you installed a meta package04:37
qman__meta packages don't actually contain software, they're just there to make it easy to install a set of packages04:37
qman__for example, linux-image04:37
multiHYPhow to identify meta packages?04:37
qman__this is a meta package which gets you the latest kernel packages04:37
qman__look at the dependencies of a package04:37
qman__it will tell you what it installs to do what you told it04:37
multiHYPi didn't even have apt-rdepends :D04:41
multiHYPthey might as well give the kernel.h file and let me figure out the rest of it...04:42
multiHYPi guess im better off using the older 0.8.54 version that is available via apt-get. its at least the standard way of doing things...04:43
multiHYPi mean there is no nginx-1.0.6.deb or something like that.04:44
multiHYPwhich brings me to what i was going to do, either make a .deb out of source or install the old version.04:45
multiHYPwhy is not a single user creating a .deb for that if that is the way things should work? nginx is very popular.04:46
qman__for security and maintenance reasons04:46
qman__each release of ubuntu sticks with a certain major version of a package04:47
twbmultiHYP: 1.0.5 is packaged as a .deb, but it is not in your release, because new versions = new bugs.  Ref. http://paste.debian.net/128442/04:47
qman__the version you have released when 0.8 was considered stable and production ready04:47
qman__so only updates to 0.8 are available in the normal channels for that release04:47
multiHYPso it is even encouraged that i should stick to that because its best for my os04:48
qman__bugfixes and features can also be backported to older versions, and the packages look like software1.2-ubuntu3 in those cases04:48
multiHYPhow is the removal of such meta packages possible without accidentally removing a common dependency that i don't want to remove?04:49
multiHYPdo i have to manually keep a list on paper that checks for packages and their corresponding dependencies?04:49
qman__unless there is a very compelling reason to use a different version, such as a dealbreaking feature or fix, you should stick with the version available in the repositories04:49
qman__that's what apt-get autoremove is for04:49
qman__it removes packages which were installed only as dependencies, but the packages that depended on them are gone04:50
qman__however, if you manually install a package that was installed as a dependency later, it will be marked as one you wanted and won't be removed by this04:50
multiHYPok04:51
qman__example, if you install nginx, then later install nginx-common, then uninstall nginx, then autoremove04:51
qman__nginx-common would stick around, as would its dependencies04:52
qman__because you marked it as one you want04:52
multiHYPbecause i installed it separately?04:52
multiHYPok i see04:52
multiHYPso is this correct if i follow the standard procedure: sudo apt-get autoremove nginx :to remove nginx and all its dependencies?04:53
qman__no04:53
qman__just 'sudo apt-get autoremove'04:53
qman__removes all orphaned dependencies from the system04:53
multiHYPok, see i saw that line on a website and was about to try it out, there are so much mis-information online ...04:54
multiHYPi believe i messed things up during my manual removal process, can i force reinstall something with apt-get again?04:59
qman__you can apt-get install --reinstall05:02
qman__but you need to make sure you get the right package05:02
qman__reinstalling one package won't affect the dependencies05:03
multiHYPsomething doesn't work anymore, i did that yeah. the installation appears to be successful after that but the binary is missing...05:04
multiHYP:(05:04
Dravekxhow do I get bash aliases to work for a specific user? I set with alias command="" but it's not working.05:22
Dravekxoh wait. maybe I need to load screen first.05:22
=== himcesjf2 is now known as himcesjf
KoolaidJunkieCould someone help with a External IP issue? I'm unable to access the server from outside the network, through the External IP06:36
multiHYPhi, is there a command i could use as root to set the sshd_config parameter to allow login via passowrd?08:31
ersiYeah, vim /etc/sshd/sshd_config >_>08:42
jamespageDaviey: I've not actually managed to get a successful PPA build of the new version of jenkins as yet - not due to the issue you found - but due to some other dep changes I had in the PPA09:15
jamespagehowever I did successfully sbuild it on a headless server  - so I really don't understand why your pbuild failed...09:16
Davieyjamespage: So it failed to build in a PPA?09:17
DavieyI didn't check back after the 2 hours*09:17
Daviey * where 2 hours was probably 10.09:17
jamespageit was more like 1009:17
jamespageThe PPA I did the test build in contained the new version of jtidy (waiting for ack on FFE for that)09:17
jamespagewhich broke the build in a different way09:17
Davieyjamespage: Did you push to a different PPA /OR? did it at least get past the issue i thought i saw?09:18
jamespageDaviey: so I'm happy to hold this update back to fix that issue as well09:18
jamespageI have now pushed it to a different PPA09:18
DavieyDoes it need to build against a newer jtidy?09:18
jamespagehttps://launchpad.net/~james-page/+archive/oneiric/+build/276602509:19
DavieyNot that i can even pretend to know WTF jtidy is :)09:19
DavieyStart in 12 hours, seriously?09:19
jamespage:-)09:19
jamespage;-(09:19
jamespage:-/09:19
Daviey... and people wonder why we push untested stuff to the archive.09:20
jamespageyeah09:20
jamespageI should fix the jtidy upgrade issue as well - its not a code incompatibility - its just that the maven artifact moves so the build does not pick it up and fails09:21
Davieyah09:21
Davieywell failing to build because of a dep, i'm less concerned about.09:22
koolhead11hi all09:22
koolhead11RoAkSoAx: hey there.09:22
jamespageDaviey: yes - but I still don't understand the test failure you saw09:22
jamespageI might repro you pbuilder environment to see if I can reproduce09:23
jamespagehi koolhead1109:23
koolhead11jamespage: hey there. need little help09:23
koolhead11the preseed example file is not providing much info to me for manual partitioning09:24
koolhead11https://help.ubuntu.com/8.04/installation-guide/example-preseed.txt09:25
koolhead11d-i partman-auto/expert_recipe string09:25
koolhead11http://paste.ubuntu.com/682443/09:27
koolhead11what is  64 512 300% linux-swap   ??09:27
koolhead11what is this 300%09:27
koolhead11?09:27
* jamespage looking09:28
koolhead11Daviey: hello sir09:28
koolhead11kim0: hey. :)09:29
just-a-visitorhttp://edwardpku.com/cun/2008/05/05/partman-auto-recipe-files/09:32
koolhead11just-a-visitor: awesome. thanks a lot. jamespage lemme read on the url. #awesome :D09:35
Davieykoolhead11: hello!09:35
jamespagethats one to bookmark09:35
* jamespage struggling with ADSL upload killing my Internet performance today09:36
koolhead11Daviey: how have you been? :)09:36
koolhead11jamespage: just going to bookmark it now. :P09:36
Davieyjust-a-visitor: that is a good example!09:36
Davieykoolhead11: Pretty gooooood!09:37
just-a-visitorI'd check the actual source code, since it seems to be quite dated. :-)09:38
uvirtbotNew bug: #841672 in openssh (main) "ssh-add does not unlock ssh keys" [Undecided,New] https://launchpad.net/bugs/84167209:46
Davieyrbasak: hello sir!09:48
DavieyHow did you get on with qemu-system-arm, and the cloud image?09:48
rbasakDaviey: waiting to sync with utlemming!09:50
rbasakHe found another option and went off to work on it09:51
Davieyrbasak: ah! nice.09:51
DavieySadly, he won't be around today09:51
rbasakhmm09:52
Davieyrbasak: I remember you sniffed bug 83250709:53
uvirtbotLaunchpad bug 832507 in nova "console.log grows indefinitely" [High,In progress] https://launchpad.net/bugs/83250709:53
Davieydid you get an idea for a cleaner fix, than my non-ideal one?09:53
rbasakI haven't managed to figure out where exactly the console.log gets written out from09:55
rbasakI think it's in libvirt rather than qemu09:55
rbasakIn which case I think libvirt should be enhanced to provide a ringbuffer option09:56
sorenDaviey: I thought you said you found a solution for that one?09:56
rbasakWould you like me to carry on looking down this route?09:57
Davieysoren: Well my solution cannot be default, as it uses a non-mainline (or -dkms packaged) kernel module.09:58
sorenDaviey: Oh, I thought you went down a different path. Ok.09:59
Davieysoren: I'm hessitant to maintain code i'm not familar with.09:59
Davieysoren: well rbasak seemed to think he'd be able to find a proper fix :)09:59
Davieysoren: The solution in the branch attached, 'works' - but i've not yet decided if to merge propose it.10:00
Davieyif all else fails, at least it's /something/.10:00
rbasakDaviey: OK I'll carry on then :)10:01
Davieyrbasak: That might be useful.. it's a pretty serious bug. :/10:01
sorenDaviey: I think I have a much simpler solution.10:16
sorenDaviey: Give me a couple of minutes to validate it.10:16
Davieysoren: You can't just say that.... need detail man!10:17
Davieyi'm sat on the edge of my chair awaiting detail.10:17
* soren whistles innocently10:18
sorenYup.10:18
sorenit works.10:18
sorenIf we tell kvm to talk to a named pipe, it'll buffer the output if we're not listening.10:19
soren..and if we stop listening, it starts buffering again, and will flush the cache when we start listening again.10:20
sorenSo we can just use the code that I wrote to support Xen.10:20
soren...and add some expiry stuff to it.10:20
sorenThe point is, not listening doesn't block kvm.10:21
sorenI'm not sure how or why it works. When I looked at the source code, it didn't seem to have a buffer mechanism or reconnect handling or anything like that.10:22
soren...but I can see it working.10:22
* soren wonders if Daviey fell off that chair10:22
Davieyi sure did10:23
Davieysoren: Does kvm action the SIG* to terminate if the sink goes away?10:23
sorenI'll let you reread what I just said.10:23
soren:)10:23
sorenAh.10:24
* soren spots the ambiguity10:24
sorenNo, it does not.10:24
sorenWhen I said "if we stop listening" I meant: If I kill the "cat pipe.out" that's been running...10:24
Davieyas in, if you are thinking to just connect to the pipe when i run euca-get-console-output, does kvm die following that command?10:25
soren10:24 < soren> No, it does not.10:25
soren10:24 < soren> When I said "if we stop listening" I meant: If I kill the "cat pipe.out" that's been running...10:25
soren:)10:25
Davieysoren: Okay.. and you can limit the size of the fifo?10:26
sorenWe could connect to the pipe on GetConsoleOutput as well as once a minute (to avoid kvm's buffer for this growing out of hand).10:26
sorenDaviey: I don't think so, no. I don't see the size of the buffer mentioned anywhere much less documented how you can change it.10:26
DavieyIt actually sounds easier to add ringbuffer support to kvm IMO :)10:26
sorenUsing this approach, I can hack this together in an hour or so.10:27
DavieyNote, that in order to be compariable to AWS - it should output the last 64K.10:28
sorenWe can get the EC2 API to chop it off at 64k.10:28
DavieyI don't know what the behaviour is if i push 10TB to the console, sure the instance will hurt; but what does it do when flushed?10:29
sorenI don't want to impose that particular limitation further down the stack. Keeping an MB or even a couple per VM shoulnd't be a problem at all.10:29
soren...but sure, we should have a limit.10:29
sorenI just believe that when you decide to impose arbitrary limits, they should be really high.10:29
DavieyBut does that limit mean that it is chopped in nova-compute?10:29
DavieyPossibly expensive?10:30
sorenHardly.10:30
sorenIn the grand scheme of things, it's miniscule.10:30
Davieynice overcomplicated tail, http://stackoverflow.com/questions/136168/get-last-n-lines-of-a-file-with-python-similar-to-tail10:31
rbasakIf we did use a ringbuffer, we'd want that CPU of chugging through 10TB to be accounted for in the guest properly, ie. the host shouldn't struggle to complete other tasks10:31
* rbasak is still struggling through entirely undocumented code10:31
sorenYou're talking over the internet to an API server that looks things up in a database, sends an AMQP message to a compute server that probably also looks stuff up in a database and then sends a response all the way back. Reading a megabyte from the filesystem and truncating it down to the last 64k isn't a big deal.10:31
Daviey"the code is the documentation" etc10:32
Daviey:/10:32
rbasakAre we talking about the same thing?10:32
rbasakI always assumed that the issue is that the guest can DoS the host by filling up its disk10:32
sorenright10:32
Davieyrbasak: Soren is thinking of using a fifo, which should hurt the instance - not the host.10:33
Davieyas in, the yet-to-be-discovered bugger in kvm filling up and killing the instance.10:33
Davieyerr, buffer.10:33
rbasakwhat would be reading the fifo?10:34
sorenDaviey: Actually, it might just be that kvm does this in a separate thread.10:34
DavieyI always thought fifo's were fragile for this sort of usecase tbh.. but i am happy to be proved wrong.10:34
sorenDaviey: ...so it doesn't block all of kvm, only the thread that is waiting to write to the fifo.10:34
Davieysoren: Stop getting distracted, we can sniff your diff :)10:35
sorenDaviey: Well, they're only fragile if either end thinks it's talking to something else.10:35
Davieyrbasak: Either, when making a request - flush the pipe and/or have a 60s flush process.10:35
rbasakso the thread has an internal buffer of some form that it writes to the fifo from, and other threads in kvm are writing to it?10:35
rbasakwhat happens when that buffer fills?10:35
sorenDaviey: If everyone knows they're taling to a fifo, the semantics are well understood and pretty easy to deal with.10:35
Davieyrbasak: *every 60s flush.10:35
Davieyrbasak: NFI.10:35
sorenAttempts to write to it will err.10:36
Davieysuck it and see.. i'm expecting a blocker, but i'll be more than pleased if not. :)10:37
sorenAccording to pipe(7), the size of the buffer is 65536.10:38
sorenDaviey: Sniff my diff? I'm not writing anything right now. I've got a couple of other pressing matters I need to attend to first, but I'd be happy to answer questions along the way if someone wants to take a stab at this.10:40
Davieysoren: ok10:40
sorenOne thing that would probably be helpful to know from the start: Each server in Nova has a periodic_tasks method that gets called every minute or so.10:40
sorenSo no need to worry about inventing something for that.10:41
Davieysoren: how do you register an event with that?10:41
Davieyjust something to grep for. :)10:41
sorenDaviey: You don't. You just override that method and add more calls to it.10:42
sorenWe don't really have an (internal) events system like that where you can subscribe to particular events or whatnot.10:42
rbasakone thing I find really annoying about ec2 is that it takes ages for it to update console output10:42
rbasakit'd be nice if it was instant :)10:43
sorenopenstack's impl is instantaneous10:43
sorenThat's a particular place where I explicitly don't want feature parity with EC2 :)10:44
soreni10:44
sorenwhoops10:44
Davieyrbasak: Yeah.. would be easier to do post run-instance magic based on console output.10:44
DavieyFor example, smosers ssh fingerprint magic.10:44
* rbasak does something like that on EC210:45
rbasakI patched python-boto years ago10:45
sorenI'm guessing Amazon must store that off of their "compute nodes". Otherwise I don't see why they'd want to limit the number and frequence of console output updates so drastically.10:45
rbasakbut it's too slow due to the console update delay :-/10:45
sorenq10:46
sorenwhoops10:46
rbasakit looks to me like libvirt has some kind of stream abstraction. Is this what it's using to get the console output from kvm?10:49
sorenAre you trying a different approach? Or why are you looking at libvirt code?10:51
rbasakI'm still thinking about a ringbuffer approach, but mainly I'm still trying to find my way round so that I can understand whichever approach better. I don't yet have a full picture of where console output goes currently10:52
sorenAt the moment, the serial port of the virtual machine is configured to go to a file.10:52
sorenThis is done in the XML defining the VM.10:53
sorenrbasak: http://libvirt.org/formatdomain.html#elementsConsole10:53
rbasakyep I'm looking at that thanks10:53
rbasakSo that's read by libvirt - how does it arrange that to happen?10:53
rbasakdoes libvirt open a file and pass kvm the fd, or does it give kvm a pts and read it through to a file, or something else?10:54
sorenFor qemu, I believe all those things are done by passing the relevant arguments to qemu on the command line.10:54
rbasakso it passes the filename directly?10:55
rbasak(and qemu opens it?)10:55
sorenYes.10:56
sorenrbasak: You should be able to just specify a named pipe in the XML and have everything work out.10:57
rbasak<soren> Daviey: If everyone knows they're taling to a fifo, the semantics are well understood and pretty easy to deal with.10:58
rbasakdoes that apply to qemu?10:58
sorenyes10:58
rbasakwhat will qemu do on a SIGPIPE/EPIPE?10:58
sorenIt ignores it, AFAICT.10:59
sorenEr..10:59
sorensorry, no.10:59
rbasakand loses the write?10:59
sorenIt ignores SIGPIPE.10:59
rbasakand is that well defined or might the behaviour change in future?10:59
sorenThis is free software. There are no guarantees :)10:59
rbasak:-)11:00
sorenIf we want it to not change, we just use it and complain if it breaks at some point.11:00
rbasaksoren, what do you think about this named pipe approach vs. modifying something to write out a ringbuffer?11:00
rbasakor even, giving qemu a fifo but reading the fifo and writing out a ringbuffer11:01
sorenringbuffers are kinda hard to "write out" :), but having a ring buffer implementation in kvm would be sort of neat. It's much more work than just using a named pipe, though.11:01
soren...and I think using a named pipe (now that we know it behaves well) is perfectly fine.11:01
rbasakthe bit of ringbuffering into a file that I see as untidy would be the head/tail pointers11:01
rbasakI suppose a couple of integers at the start of the file would do, but then it's suddenly a binary format11:02
sorenThat's why ringbuffers aren't written to files.11:02
* rbasak was thinking about mmapping a file11:02
sorenTruncating files by chopping stuff off of the end of them is easy. Moving their starting point forward isn't.11:02
rbasakthen another process could read out the current state quite easily11:02
rbasakstruct { int head, int tail, char data[] }11:03
rbasakassuming ints are atomic on writes11:03
rbasakthen a writer would just need to order changes carefully11:03
sorenYou'd only need a start ptr, really.11:04
sorenWell, and perhaps a max_length.11:04
rbasakthen the first write run through would have to be a special case11:04
rbasakanyway, that's just the detail11:04
rbasakit's still ugly I admit :)11:05
rbasakI'm thinking of something like <console type='pty'><source path='/tmp/console.log' ringbuffer='16384' /><target type='virtio' port='0'/></console>11:06
rbasakHence looking at libvirt, and if libvirt could manage taking input from qemu and dealing with the ringbuffer, then it would fit in really well11:06
rbasakIf the ringbuffer isn't a file then maybe memory but then it'd need some kind of API to get it out again11:07
rbasakare we allowed to use pthread mutexes in libvirt?11:07
uvirtbotNew bug: #841726 in cobbler (universe) "Unable to netboot with dhcpd managed by cobbler" [Undecided,New] https://launchpad.net/bugs/84172611:11
Davieyjamespage: stop finding issues :)11:13
jamespageDaviey: sorry11:13
jamespagemy preseed seem to be broken now as well - gah!11:13
Davieyrbasak: it has case history, so i assume yes - http://www.redhat.com/archives/libvir-list/2011-January/msg00965.html11:17
Davieyrbasak: Note, that this would probably have to be accepted upstream before we could carry it.11:18
eagles0513875any people well versed with dovecot and postfix running on 10.0411:20
Davieyeagles0513875: many people are probably well versed in this.11:20
sorenrbasak: libvirt has e.g. virMutexLock, which I believe is a thin wrapper around pthread mutexes.11:23
sorenrbasak: Remember, though, that libvirt supports stopping libvirt while letting the VM's keep running.11:24
eagles0513875Daviey: well my issue is this. on 10.04.2 i got everythign working etc and now reconfiguring dovecot and postfix configured the exact same way11:24
eagles0513875Daviey: yet all emails get delivered to /var/mail instead of my maildir11:25
sorenrbasak: So anything you do should either not require libvirt to run for kvm to also keep running.11:25
rbasaksoren: ah, I was wondering about that, thanks. So with your named pipe system, nova would give libvirt a path to a named pipe, and take care of reading it itself? Would that include a persistent process/thread to read, or would you be relying on qemu not breaking when it tries to write to the pipe with no reader?11:50
sorenrbasak: I'd rely on qemu not to break.11:51
rbasakok thanks11:51
sorenWe trust Qemu to do everything else properly. If qemu breaks, we're so utterly screwed anyway :)11:52
Davieysoren: talking of which.. pondering a new upstream version.. 0.15 was released a while ago.11:53
Daviey*very* late in the cycle. :/11:53
rbasakyeah I understand but it's kind of broken to expect a random application to know what to do when faced with EPIPE :)11:55
rbasak(but if it works atm then fair enough I guess)11:55
sorenrbasak: Why?11:56
kvarleyI get "ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)" when I try and login to mysql on my machine. what am I doing wrong?11:56
sorenrbasak: qemu isn't exactly a random application. It's *the* application.11:57
koolhead11kvarley: is this server not on same system11:58
kvarleykoolhead11: I'm running a LAMP server setup on localhost.11:58
koolhead11kvarley: what does mysql -uroot -p <yourpassword> does ?11:59
kvarleykoolhead11: Produces that error11:59
rbasaksoren: because by default applications won't watch SIGPIPE, and it's a special case to have to deal with it. If qemu deals with it by definition because someone considered writing to FIFOs, then fair enough. If we're lucky that it works, then also fair enough but we're still lucky that it works :)12:01
rbasaks/watch/catch12:01
koolhead11kvarley: https://help.ubuntu.com/community/MysqlPasswordReset see if it helps!! :D12:02
kvarleykoolhead11: I got in :) Thanks for the help tho! :)12:03
uvirtbotNew bug: #813317 in asterisk (universe) "package asterisk-config 1:1.6.2.5-0ubuntu1.4 failed to install/upgrade: EOF on stdin at conffile prompt" [Low,New] https://launchpad.net/bugs/81331712:04
koolhead11kvarley: its great the community documentation and take googles help :D cheers!!12:06
=== _ruben_ is now known as _ruben
Ursinhagood morning people13:09
DavieyUrsinha: Hello!13:36
tdnI have installed mysql server using apt-get. Now there is set a password for user debian-sys-maint. How do I get this password?13:40
just-a-visitorTry looking into /etc/mysql/debian.cnf.13:52
aveng3rHi, I'm using ubuntu 11.4 server, is there a way to install xorg?14:32
just-a-visitorhttps://help.ubuntu.com/community/ServerGUI14:35
aveng3rthanks14:38
eagles0513875hey guys i need some help with postfix14:44
Ursinhabug 83349914:50
uvirtbotLaunchpad bug 833499 in nova "virt/disk.py unconditionally inserts  public_keys into /root/.ssh/authorized_keys" [High,New] https://launchpad.net/bugs/83349914:50
eagles0513875hey guys im setting up post fix what should the postmaster and root email be set to the system users email address?14:53
=== Ursinha is now known as Ursinha-lunch
eagles0513875any postfix experts in here i need some help15:30
eagles0513875i changed a line in saslauthd and for some reason it doesnt like said line15:31
eagles0513875its failing to start saslauthd15:31
memoryleakand why does it this?15:33
eagles0513875memoryleak: ??15:38
yabootrying to setup a telnet server on my box, can telnet localhost, but am unable to telnet from another machine15:40
yaboodo I need to activate something?15:40
memoryleakeagles0513875: I can't do some voodoo and guesss what the problem might be. Paste changed lines, and the Error message(s).15:41
eagles0513875memoryleak: i pasted a line from the ubuntu wiki on how to set this up15:42
eagles0513875yaboo: if your trying to telnet to another machine it woudl be telnet IP PORT15:42
memoryleakeagles0513875: Still not enugh info to help you.15:43
yabooeagles0513875, getting connection refused, switched off firewall believe, but still no dice15:43
eagles0513875memoryleak: what info do you need15:43
eagles0513875yaboo: can you ssh into the remote machien and try telnet ip port15:44
memoryleakError message? What you changed?15:44
eagles0513875telnet localhost ip port15:44
eagles0513875memoryleak: in the saslauthd file i changed the very last line to OPTIONS="-c -m /var/spool/postfix/var/run/saslauthd"15:44
eagles0513875when it comes to starting it15:44
yabooeagles0513875, can ssh into the machine, from other machine, I get connection refused15:44
eagles0513875yaboo: are you the admin of the remote machine15:45
eagles0513875memoryleak: i get this error when i try to start it /etc/default/saslauthd: 59: Syntax error: Unterminated quoted string15:45
yabooeagles0513875, yes15:45
eagles0513875yaboo: can you login to the machine and do sudo iptables -L and check that port 22 is open15:45
yabooeagles0513875, iptables -L returns blank15:45
eagles0513875yaboo: then sudo apt-get install openssh-server15:46
yabooeagles0513875, defeats the purpose of telnet15:46
eagles0513875yaboo: what do you need telnet for anyway15:46
eagles0513875its hardly used and not very secure15:46
yabooeagles0513875, a inhouse app using wyse60 emulation15:47
eagles0513875yaboo: you have any routers along the way between  you and ur server?15:48
eagles0513875it could be the router is blocking the port15:48
memoryleakeagles0513875: Look for qoute chars that are not enclosing15:48
eagles0513875or the whole network firewall15:48
eagles0513875memoryleak: it specifically says line 5915:48
yabooeagles0513875, no, same network, netmask15:48
memoryleakeagles0513875: Post the whole file on pastebin.com15:49
eagles0513875memoryleak: found it15:49
eagles0513875yaboo: doesnt matter same subnet or not15:49
yaboook eagles051387515:49
eagles0513875if the entire network firewall doesnt have it opened you wont have access via telnet15:49
memoryleakeagles0513875: Basically, it told you allready what was wrong. You just didn't look.15:49
eagles0513875memoryleak: the way i interpreted it it said line 5915:49
eagles0513875yet the error was further up then line 5915:50
eagles0513875near the top15:50
memoryleakYour'e not the first that thid this mistake in the config :D15:50
yabooeagles0513875, got it working, seems inetd only allowed tcp6, installed xinetd and works in tcp4 and able to telnet into the machine15:59
eagles0513875yaboo: ahh16:02
eagles0513875memoryleak: you did same mistake as me16:02
koolhead17hi all16:30
KoolaidJunkieCould someone help me get a script to start on boot up?17:18
=== Ursinha-lunch is now known as Ursinha
fedupso I have a fresh install of 10.4.3 server, I want it to be a dhcp server and file and LAMP. for dhcp where sould I start? dhcp3-server, dnsmasq, or dhcpd17:58
zoopsterfedup: I'm using dhcp3-server18:08
qman__I also use dhcp3-server, but if you're looking for dynamic DNS on your LAN, dnsmasq is going to be the better option18:20
qman__it can be done with other servers and BIND, but dnsmasq is tailored for that kind of setup18:21
ertyhi18:27
ertyi got pc with pc with 2 disk18:30
ertywith 2 disk 76 GB18:31
ertyi got raid 1 on it18:32
ertywhat it will be the volume of my disk ?18:32
feduphmmm ok18:34
pmatulissounds like homework18:42
ertyyeah  anyone can tell ?18:45
fedupdnsmasq will do dhcp ip's and be able to support a wirelss access point?18:45
qman__your chosen DHCP server really doesn't have anything to do with using a wireless access point18:46
ertyanyione there18:48
erty.?????18:48
fedupk18:49
fedupwasn't sure, I guess not with it just being a static ip18:49
lickalotterty you have a question?18:56
ertyyes of course18:57
erty2 disk of 76 GB with raid how much the total volume ?18:57
ertyraid 118:58
jmarsdenerty: 76GB.  Is this a trick question? :)18:58
ertywell with raid 10 how much it gives ?18:59
jmarsdenWith RAID 10 you ned 4 disks.  so that one *is* a trick question!19:00
ertywell if you create raid 1 on 76 GB19:01
ertyas OS if you got ubuntu19:01
ertyfrom the OS is it possible to check the type of raid created before ?19:02
jmarsdenerty: Software RAID: read /etc/mdadm/mdadm.conf.  Hardware RAID: see how the RAID controller is configured using whatever tool or utility it uses.19:03
ertyif i understand correctl, if it is an hardware raid, from the OS we can't access to type of raid19:05
ertyam i correct ?19:05
jmarsdenYou can get a utility that knows about the hardware RAID controller and use that to look at how the controller is set up.19:06
ertylets take an example of HP SERVER19:07
ertywhat utility knows about the hardware RAID controller and use that to look at how the controller is set up ?19:08
jmarsdenIt is not the server that matters, it is the controller.19:08
jmarsdenWhich controller card do you have?19:08
ertysmart array controller19:09
jmarsdenMaybe, this is relevant to you: http://h18000.www1.hp.com/products/servers/proliantstorage/software-management/acumatrix/index.html19:09
jmarsdenNo, that is not a specific controller name :)19:10
jmarsdenHP makes a bunch of "smart array controllers", I think...19:10
jmarsdenThe Ubuntu package cciss-vol-status  may also be relevant?19:11
ertywell can you give me a clue ?19:12
jmarsdenI just gave you a bunch of clues.  Use them.19:12
ertywell, always with the same disk with raid 119:14
erty2 disk of 76 GB raid 119:14
KoolaidJunkieHey everyone.19:14
KoolaidJunkieHow can I get a script to run on server boot?19:14
ertywhen you booting to the OS, if you do fdisk -l how many disk it will detect ?19:15
jmarsdenerty: try it and see :)19:15
ertydon't have any hardware19:16
ertyto try that's why i m asking you here ? pppl :)19:16
ertyjust want to understand the concept before buying19:18
=== smb` is now known as smb
jmarsden<pmatulis> sounds like homework <erty> yeah  anyone can tell ?19:20
jmarsdenThat does not look like pre-sales evaluation to me...19:20
ertyhomework for myself19:20
ertydon't worry ; There is no ambiguity19:21
ertyso how much it gives with fdisk -l ?19:33
=== nxvl_ is now known as nxvl
=== shennyg__ is now known as shennyg
=== andreas__ is now known as ahasenack
jeeves_mossis there an easy way to send an e-mail from a predefined e-mail account (on the local server), but to have the body of the e-mail pulled from a txt file?21:17
jmarsdenjeeves_moss: mail -f predefined@example.com -s "some subject" recipient@example.com <somefile.txt21:19
jeeves_mossjmarsden, thank you.  that's the simplest21:20
jmarsdenWell, you can leave out the -s "some subject" to simplify it further :)21:20
jeeves_mossthanks.  my ISP's tech support is refusing to fix an issue that's been going on for 6+ months, so I figure an e-mail every 15 mins should get their attention21:21
jeeves_mosssorry, connection issues21:25
jeeves_mossit dosn't like the "-f" command for the "from" user21:25
jeeves_mossjmarsden, are you stil here?21:39
jeeves_mossis there an easy way to send an e-mail from a predefined e-mail account (on the local server), but to have the body of the e-mail pulled from a txt file?21:42
lickalottredirectors i would assume22:24
bcessahi, what software do you recommend to monitor a ubuntu server with: nginx, php5-fpm, mysql ?22:40
=== smb` is now known as smb

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!