/srv/irclogs.ubuntu.com/2010/04/10/#ubuntu-server.txt

hggdhkirkland: still there?01:35
=== swift_ is now known as swift
=== swift_ is now known as swift
steven_theh!01:49
steven_ti installed nginx with aptitude install nginx... and removed it with aptitude --purge remove nginx... but guess what? /etc/init.d/nginx is still there, as is /etc/nginx and all the manpages etc01:49
zulsteven_t: file a bug then01:58
steven_tlol01:59
lamontScottK: sup?02:10
ScottKlamont: I was thinking about the new postscreen tool in 2.7.02:11
ScottKUpstream has clearly labled it "Experimental" in 2.7.02:11
ScottKShould it be split out into a separate binary that's not installed by default?02:11
lamonthrm... possibly02:12
ScottKI was thinking that experiments shouldn't be part of the default mail server task for an LTS.02:12
lamontI would not be averse to such a thing02:12
lamontah, come on.... where's your sense of ADVENTURE??02:12
lamonter, I mean, I agree02:12
ScottKHeh.02:12
lamontyou wanna work up a diff?02:13
ScottKI know that 'experiment' in the default install is now an Ubuntu Desktop tradition, but for Server, I think not so much a great idea.02:13
lamontharsh dude02:13
ScottKAccurate.02:13
ScottKOK.  Let me see what I can do.02:15
cloakablehmmm02:17
cloakableOh, how is spam filtering in the mail task going?02:17
ScottKI lost track of how far we got on that.02:19
ScottKivoks would know, but he's not around.02:19
ScottKIn any case, amavisd-new with spamassassin and clamav is the standard, documentation approach.02:20
cloakableawesome02:22
cloakableI've been trying with dovecot-antispam, because it seems it would give the best result, if I could get it working (:02:22
cloakable(I.e monitors a spamfolder, and on movement out of the folder, calls the spamfilter automatically to mark as 'ham')02:25
cloakableHowever, documentation on it is nonexistent :(02:26
ScottKcloakable: Start with the Ubuntu Server Guide documentation on spam filtering.02:27
ScottKdovecot-antispam would be an advanced part you might bolt onto it later.02:28
cloakableScottK: That's a little clunky to train for nonspam, though.02:28
cloakableNeeds ssh-ing into the server to call manually.02:28
cloakableAnd while I can do that, I'd rather not have to, and there's users on my server that cannot :)02:29
ScottKWith a good set of RBLs + amavisd-new/spamassassin/clamav you get rid of an awful lot of it without having to mess with bayesian filter training.02:31
ScottKI'd get that set up first and then see if you want to bother.02:31
cloakableMmmmm.02:34
cloakableAnd when I get spam in my ham and ham in my spam? :P02:34
ScottKFirst see how much of it is before you solve the problem.02:35
* cloakable finds out what was wrong with dovecot-antispam >.>02:47
cloakableIt's been compiled with the wrong backend :)02:48
* cloakable gets the source, comments out 'mailtrain' and puts in 'dspam'02:49
=== cyphermox_ is now known as cyphermox
cloakableThere, added 'dovecot' to the dspam trusted list03:22
uvirtbotNew bug: #559745 in eucalyptus (main) "NC failed to start a session with a libvirt internal error" [Undecided,New] https://launchpad.net/bugs/55974503:32
uvirtbotNew bug: #559752 in samba (main) "package samba-common 2:3.4.0-3ubuntu5.6 failed to install/upgrade: el subproceso script post-installation instalado devolvió el código de salida de error 1" [Undecided,New] https://launchpad.net/bugs/55975203:41
ScottKlamont: Never mind.  Apparently it's so experimental Wietse didn't include it in the tarball.  No wonder I couldn't find it.03:49
uvirtbotNew bug: #553853 in samba (main) "(Kubuntu) Samba shares (fstab) slow down system shutdown/reboot" [Undecided,New] https://launchpad.net/bugs/55385304:04
lamontScottK: he tends to be more pedantic than me about experimental vs official - which lets me ignore that aspect without thinking much about it04:11
lamontto the point that you made me go "wut, yeah kill that" thinking you'd actually seen it there already04:11
ScottKWhich is a good thing to have in an MTA author.04:11
lamontvery much so04:12
lamonton that note, sleep time.04:12
ScottKI thought I'd seen it referred to as being in the release onthe mail list.04:12
lamonthead->pillow04:12
ScottKGood night.04:12
GhostFreemanI just killed two birds05:50
GhostFreemangood hello05:50
GhostFreemanI wish I would use the right channel05:51
ScottKIt's more fun for us when you don't.06:01
=== swift_ is now known as swift
aetarichey, i added a scsi drive to my live server and it isn't showing up, do i have to reboot it?07:00
=== swift_ is now known as swift
histoZenMasta_: are you there?07:10
ZenMasta_need some help installing pdo and pdo_mysql i get a message sh: phpsize not found07:11
histolooks like pdo is part of the php code now and you should just need to skip to pdo_mysql07:12
ZenMasta_i see, let me try and see what happends07:12
ZenMasta_histo same error07:13
histoZenMasta_: yeah what version of ubuntu are you using?07:13
ZenMasta_9.1007:13
ZenMasta_on a side note, when I try to install pdo_mysql it downloads pdo_mysql and then after it downloads pdo still07:14
histoand you're using sudo pecl install pdo07:14
ZenMasta_yep07:14
histodo you have php5-dev installed?07:15
ZenMasta_I think so how can i find out without trying to install it again07:16
histodpkg -l | grep php507:16
ZenMasta_just decided to install before you typed that07:17
histoshould show a php5-dev package but like I said i think pdo is obsolete07:17
ZenMasta_so we'll see what happends07:17
histoyeah pdo has been moved into the php source07:18
ZenMasta_histo that did it07:18
ZenMasta_installing now so i'll try the web app when its done and hopefully it will progress07:18
histodid you try the webapp prior to running pecl07:18
histo!info php07:19
ubottuPackage php does not exist in karmic07:19
histo!info php507:19
ubottuphp5 (source: php5): server-side, HTML-embedded scripting language (metapackage). In component main, is optional. Version 5.2.10.dfsg.1-2ubuntu6.4 (karmic), package size 1 kB, installed size 20 kB07:19
histoZenMasta_: http://pecl.php.net/package/PDO/php-src/pdo07:20
histosee07:20
ZenMasta_thanks07:21
=== swift__ is now known as swift
=== swift__ is now known as swift
ZenMasta_how do I edit php.ini? when I try to open it with vi it's as if it doesn't exist so it pretends to make a new file07:51
binBASHHi11:59
KristianDKHello - i would like to test out the ubuntu enterprise cloud with more than 1 or 2 nodes, so i was considering if you can run UEC on Amazon Ec2 for testing? It seems this is the only way to "rent" a lot of computers for a short period of time13:10
RoyK^hi all. seems I'm doing something strange here. I try to mount an nfs filesystem on the host from a virtualbox VM, but I get 'mount.nfs: mount to NFS server 'rpcbind' failed: RPC Error: Program not registered' - 'mount.nfs: internal error' - /etc/exports looks right, services are started and ufw has 'allow from x.x.x.x' (the VMs address). The VM runs in bridge mode. Any ideas?13:32
pmatulisRoyK^: is mountd running on the server?14:05
RoyK^hm. no. what starts that? thought that should be in nfs-kernel-server or something14:06
twbStart by checking "rpcinfo -p"14:08
RoyK^http://pastebin.com/98hsiw0x14:14
binBASHKristianDK: You could use public cloud from Eucalyptus14:14
KristianDKbinBASH, but i want to check out the configuration :-) Not how the instances works14:15
twbIsn't the whole point of EUC that it's backwards-compatible with Amazon?14:15
twbEr, UEC14:15
binBASHKristianDK: It's possible to run everything on one node.14:16
binBASHNot really a need for multiple nodes.......14:16
uvirtbotNew bug: #560011 in ntp (main) "Time cannot be fixed with ntpdate" [Undecided,New] https://launchpad.net/bugs/56001114:16
KristianDKbinBASH, both controller and node in one box?14:16
binBASHyeah14:16
RoyK^twb, pmatulis any ideas?14:16
binBASHhave the same here14:16
twbRoyK^: pastebin "exportfs -vra"14:17
binBASHKristianDK: I have 7 nondes, including the one with cluster and cloud controller14:17
RoyK^twb: exporting 213.236.233.67:/var/www14:18
binBASHplanning to have 150 nodes ;)14:18
RoyK^tried with * as well14:18
KristianDKbinBASH, cool :-) Well, i want to test things out before deploying it in a big scale14:18
binBASHLike me then ;)14:19
KristianDKbinBASH, do all your nodes have the VT extension as its recommended?14:19
binBASHyup14:19
binBASHKristianDK: http://www.hetzner.de/en/hosting/produkte_rootserver/eq6/14:19
binBASHhave those as nodes14:20
RoyK^150 nodes??? how many racks?14:20
KristianDKbinBASH, i was actually considering http://www.hetzner.de/en/hosting/produkte_rootserver/eq8/ :-D14:20
KristianDKim already a customer there for some other servers14:20
binBASHKristianDK: It will be a problem with network configuration ;)14:21
binBASHstill stucked at this......14:21
KristianDKyeah, i guess because of the IP adresses being bound the MAC and the limitation of the 100mbit router, right?14:21
binBASHYeah, the ips are bound to server.14:22
binBASHRoyK^: Dunno, this providers does tower hosting......14:22
binBASHKristianDK: With 150 nodes, there will be a lot of ram anyways, don't need eq8 really ;)14:23
RoyK^binBASH: if you need 150 nodes, I'd guess hosting it locally may be a lot cheaper14:23
binBASHRoyK^: Don't think so.14:24
binBASHdon't have money to buy all those servers ;)14:24
KristianDKbinBASH, true :) I think i'll end up with an ESXi more on the EQ8 anyway, since everything else seems complicated with hetzner :(14:24
RoyK^binBASH: but .... 150 nodes? you can run like 10 VMs on a single node - perhaps more - what do you need this for?14:24
binBASHKristianDK: Well, I'll try to start vms now with vnc option and configure networking inside there manually.14:25
binBASHRoyK^: Need them not for the vms, but for storage14:25
RoyK^binBASH: how much storage do you need?14:25
KristianDKbinBASH, i've configured a router VM which the IPs are bound to, it forwards the IPs14:26
binBASHRoyK^: 200 TB14:26
RoyK^binBASH: I just got an offer for such a box - NOK 250k14:26
binBASHKristianDK: I don't want to NAT, because 2 TB Traffic Limit per node14:26
RoyK^binBASH: and storage should be done on zfs imho14:26
RoyK^NOT on a VM14:26
RoyK^but on hardware14:26
binBASHRoyK^: I'll use GlusterFS14:27
RoyK^why not just a big supermicro box stuffed with 2TB drives and a SAS expander and some extra chassises for disks?14:27
binBASHRoyK^: Like I said, I'm limited in Finances ;)14:27
RoyK^it'll be cheaper14:27
KristianDKbinBASH, i dont use NAT, its Ip forwarding, i use the router as gateway in the network config - but i don't think you can get around the 2tb limit anyway? Its bound to the IPs14:28
RoyK^you need 200TB and can't afford it?14:28
binBASHRoyK^: It's a single point of failure.14:28
RoyK^binBASH: then get two of them and use zfs send/receive to keep them in sync14:28
binBASHKristianDK: if you forward to one server it will count there14:28
binBASHRoyK^: Atm I'm using 20 TB Raid 6 NFS Server.14:29
RoyK^binBASH: I REALLY doubt you can get something cheaper from somewhere else14:29
RoyK^binBASH: we bought this box some time back with 30TB net storage - it just cost like USD 10k14:29
binBASHRoyK^: Everything I was looking for was more expensive. like NetApp or Isilon14:29
KristianDKbinBASH, as i understood from hetzner you need one router VM per physical server14:29
RoyK^binBASH: hah - use supermicro hardware, cheap drives, and opensolaris with zfs (with compression and dedup)14:30
RoyK^binBASH: where I work, we have rather high storage demands - windfield and other satellite data takes up space, and we're getting more and more all the time14:31
binBASHKristianDK: If it would be like this, I wouldn't use the vm for routing.14:31
binBASHWould just use the main box itself, because the ip is unusable anyways from within vms.14:32
KristianDKbinBASH, i was told this was the only option - what else would you do?14:32
KristianDKtrue14:32
KristianDKi was thinking ESXi again14:32
KristianDKsorry :P14:32
binBASHKristianDK: I already, started vms manually and they had a usable ip address.14:32
binBASHbut I dunno how to automate it within Eucalyptus, that's the only problem14:32
KristianDKyeah14:32
RoyK^binBASH: really, using VMs for storage is a BAD idea14:33
binBASHRoyK^: I don't wanna use vms for storage ;)14:33
binBASHthe storage will be on the real server itself, though I will embedd it from inside the vms14:34
RoyK^binBASH: but - please - give opensolaris+zfs a try - it's well worth it. no raid controller, just zfs doing it all14:34
RoyK^zfs rocks rather loudly14:34
binBASHRoyK^: If I would use opensolaris on some boxes I wouldn't be able to use their processors.14:35
binBASHI have rather high demand on cpu14:35
binBASHstorage speed is not that important14:35
RoyK^for your needs, I would say separate storage and computation14:36
RoyK^use storage computer cpu for compression and dedup14:36
binBASHDon't need compression14:37
RoyK^depending on the data, both can give you quite a bit of gain without much cpu use14:37
binBASHfor jpgs it's useless14:37
RoyK^what sort of data is this?14:37
RoyK^indeed14:37
binBASHRoyK^: We're hosting image agencies.14:37
binBASHThings like www.gettyimageslatam.com14:37
RoyK^but stuff like zfs snapshotting is quite priceless14:37
twbbtrfs and LVM do snapshotting14:38
RoyK^btrfs is NOT stable14:38
twbGranted14:38
RoyK^LVM snapshotting is crap14:38
twbLVM snapshotting is adequate for my purposes14:38
RoyK^LVM snapshotting moves data out of the original place for each write instead of writing new data and moving pointers14:38
RoyK^meaning if you have lots of snapshots, everything will be very, very slow14:39
twbUm, both LVM and ZFS snapshotting are block COW.14:39
twbI grant you that LVM is probably a lot slower.14:39
RoyK^lvm moves data out before overwriting them - not like zfs, which writes new data14:39
twbShrug.14:40
RoyK^CoW is two different things - either write new data and move pointers, which is what ZFS and NetApp does, or move the old data prior to overwriting the old ones, which is what LVM does14:40
binBASHmaybe I'll take Strato HiDrive Pro for Storage ;P14:40
twbAt the end of the day, ZFS is not enough to make me adopt osol.14:40
binBASH5 TB mirrored = 149 Eur / Month14:40
RoyK^twb: heh - then you really haven't looked into it14:41
twbI'm running a 2TB osol server for ZFS right now.14:41
binBASHRoyK^: If you really can afford a big storage you should go to Isilon ;)14:42
twbBut as soon as btrfs is ready, it will die14:42
binBASHIt's a much better technology14:42
RoyK^btrfs is decent, but lacks a lot of what's in zfs atm. give it a year or two and it might catch up14:43
RoyK^but yes, I will also switch to btrfs once it's there14:43
twbExactly14:43
twbWhich will unfortunately not be until 2012 (for LTS) :-(14:44
binBASHKristianDK: I really don't know how to master that network problem ;)14:45
RoyK^but then, I can't wait two years for a storage solution, and then opensolaris is the way togo14:45
KristianDKbinBASH, i think we need to talk to hetzner14:45
KristianDKthey are kind of blocking for allowing this14:45
binBASH:p14:45
binBASHKristianDK: Like they're blocking gigabit as well14:46
KristianDKexactly, i asked them for gbit14:46
KristianDKand you can actually get that14:46
binBASHKristianDK: You can have it, just costs........14:46
KristianDKyep14:46
binBASHyou need to have flexipack and another nic14:46
binBASHand additionally a switch14:47
binBASHand additionally 69 Eur for moving all your servers so they are beside each other.14:47
RoyK^binBASH: what makes me wonder is why you (or your company) are hosting terabytes of data and can't afford a decent (and quite cheap) storage solution, like the osol-based one we have. It can be expanded quite easily with a SAS expander and won't cost a lot using WD Green drives or so14:49
binBASHRoyK^: Because agencies don't pay that much ;)14:50
binBASHRoyK^: And they pay monthly. Not a year in advance :p14:51
RoyK^well, loan some money and it'll pay back quite quickly14:51
RoyK^for EUR 10k, you get 30-35TB, which I guess will be sufficient for some time14:51
binBASHRoyK^: Like I said we have already 20 TB.14:52
RoyK^no, wait, more - wait...14:52
KristianDKlol14:52
binBASHand we bought it for 9K 2 years ago14:52
binBASHthough it's a single point of failure and not mirrored14:52
binBASHhi leonel14:53
leonelea binBASH14:54
RoyK^binBASH: just got this offer - supermicro box with 36x2TB disk and an ok motherboard, a bunch of memory, some cpus etc, meaning if you use three RAIDz2 groups of 12 drives each, it gives you 20x3=60TB -> price NOK 86k, around EUR 10k, and possibly cheaper outside Norway14:54
RoyK^34 2TB drives, that was, but still (forgot about the root SSDs)14:55
binBASH10K for one box I assume ;)14:55
RoyK^yes, but it's still cheap14:55
binBASHHere we pay 8500 Eur for a box with 24 x 2 TB14:55
RoyK^with 3xraidz2, you can loose six drives in total14:55
RoyK^wierd - that's _more_ expensive :)14:56
* RoyK^ thought Norway was meant to be the expensive place14:56
binBASHthough if a box fails raid is useless ;)14:56
RoyK^binBASH: then get two and use zfs send/receive to mirror the two14:57
RoyK^and when storage fills up, get a SAS expander and an extra chassis and some drives14:57
twbosol not supporting ext2 is a real pain in the arse.14:58
RoyK^over 3-5 years, I would guess you would save LOTS of doing this yourself instead of paying others to do the same14:58
RoyK^twb: why should it???14:58
twbSo that I can seed the osol box by sneakernet instead of our shitty 100baseT and ADSL lines14:58
binBASHRoyK^: Well I would lack then cpu power for video processing14:58
RoyK^binBASH: don't!14:59
RoyK^binBASH: use NFS14:59
RoyK^or iSCSI14:59
RoyK^or CIFS14:59
binBASHRoyK^: We're having NFS already ;)14:59
RoyK^nfs performs well enough for that - for those storage needs, it would be silly to put all services in one place15:00
binBASHhuh?15:00
RoyK^get a storage server with sufficient memory and cpu for the storage alone and get compute nodes to do the ugly stuff15:00
twbRoyK^: what's his use case?  Just normal office documents and such?15:01
RoyK^twb: images and video15:01
binBASHI think getting 150 Nodes which offer 1200 cpu cores + 200 TB Storage is better ;)15:01
RoyK^if planning for 3-6 months, sure, but if you are planning to be in business for a long time, buying hardware will save you a lot of money15:02
twbYeah, NFS over 1000baseT to a single NAS or SAN is probably the Right Thing.15:02
binBASHRoyK^: You forget the fact you normally throw out servers every 2 years15:03
RoyK^binBASH: not really - storage servers can last a LONG time15:03
RoyK^especially with zfs - autogrow is nice15:03
RoyK^take a zfs mirror, replace one part with a larger drive, resilver, replace the other, resilver, and zfs says 'oops - I'm bigger'15:04
RoyK^same with raidz volumes15:04
binBASHRaid rebuild will take ages15:04
RoyK^not really - for 30TB a scrub takes a couple of days15:05
binBASHI already takes 4 hours to rebuild the current raid ;p15:05
RoyK^resilver about the same15:05
RoyK^and replacing drives isn't what's done daily15:05
RoyK^but hey, I've just been working with storage for 10+ years, do as you please15:05
binBASHI think a distributed storage architecture is much better.15:06
binBASHCompanies like NetApp or Isilon doing it as well.15:06
RoyK^how much do they charge you per month for 200TB?15:06
KristianDKbinBASH, have you, btw, checked for hetzner alternatives?15:06
binBASHKristianDK: Yup15:06
binBASHKristianDK: But only in Germany15:07
KristianDKbinBASH, and they have the same sucky setup? :P15:07
KristianDKbinBASH, are you german?15:07
binBASHThey are even mor worse.15:07
RoyK^NetApp is doing quite well, yes, but they charge you EUR 100k for a few terabytes15:07
binBASHKristianDK: I live in Switzerland :)15:07
KristianDKbinBASH, ok - cool :-) I'm from Denmark, so i speak a bit German, but sometimes i really don't get what they are trying to tell me at hetzner :P15:08
binBASHRoyK^: Things like GlusterFS are working like this.15:08
binBASHKristianDK: I moved from Germany to Switzerland in 200715:08
RoyK^does that support stuff like versioning or snapshotting?15:09
KristianDKbinBASH, well, the problem is i've been searching for alternatives to hetzner, but they seem remarkably cheap compared to everything else15:10
KristianDKand im actually satisfied with everything but their network setup :P15:10
KristianDKbinBASH, however - they recently introduced the failover IP thing15:11
KristianDKwhich redirects and IP to another server15:12
KristianDKmaybe we can work something out with this thing?15:12
RoyK^binBASH: but how much for 100T?15:12
RoyK^or 20015:12
uvirtbotNew bug: #560047 in dovecot (main) "new upstream version available" [Undecided,New] https://launchpad.net/bugs/56004715:17
binBASHRoyK^: Like I said each node gives 2,7 TB15:17
binBASHFor mirroring you need 2 nodes.15:17
binBASHA node costs 69 Eur / month15:18
binBASHand provides 8 cpu cores which I can use for video rendering and image processing15:18
binBASHbecause we're a swiss company we don't have to pay German VAT15:19
binBASHso it's cheaper.15:19
binBASHso it costs like 9500 Eur / Month.15:20
binBASHKristianDK: For the failover ip you need flexipack, which is 15 Eur / Month15:23
binBASHRoyK^: I would agree as pure storage it's too expensive.15:24
jondowdgood morning - I have a Dell Precision 650. I want to run SATA drives on it as boot devices. Can I install a 3rd party SATA PCI card and boot from a drive connected to it? thanks15:27
ScottKYou should be able to.15:28
ScottKAbsolute worst case scenario you unplug the installed drives from the built in controller, install, and then reconnect them.15:29
jondowdScottK: how do I get the BIOS to see the PCI card?15:29
ScottKThe one time I've had to worry about it, it just did.15:30
jondowd(never booted from a add-in card) Cool - I'll give it a try - Thanks !15:30
=== martin- is now known as zx
=== zx is now known as martin-
binBASHRoyK^: http://gluster.com/community/documentation/index.php/Main_Page#Gluster_Filesystem15:33
koolhead17binBASH: :P16:06
binBASHkoolhead17: ?16:07
koolhead17gluster16:07
binBASHkoolhead17: It works here without problems so far.16:07
koolhead17binBASH: it rocks16:07
binBASHkoolhead17: are you using it?16:11
koolhead17binBASH: my friend owns the company behind this project :D16:12
binBASHohh :p16:13
koolhead17binBASH: he is the lead developer too :D16:14
binBASHvery cool16:14
binBASHglusterfs is very good design I think.16:14
binBASHToo bad I can use it with 100 Mbit only koolhead17 :p16:15
koolhead17binBASH: heh. poke them16:15
koolhead17i think #gluster16:15
binBASHkoolhead17: It's not a gluster issue, servers only have 100 mbit ;)16:15
twbScottK: absolute worst case is a wincontroller :-P16:16
ScottKtwb: True.16:16
twbOr my boss's favourite trick -- buy a server with hotswap bays, but forget to buy the RAID5 chip for the hardware RAID controller16:17
binBASHlol16:18
twbIn which case I could create up to two RAID0 arrays of one drive each, so I couldn't even make an md RAID516:18
binBASHtwb: Sounds more like epic fail than a trick ;)16:18
twbbinBASH: he has done it TWICE16:18
binBASHtwb: So he didn't learn?16:19
twbAnd we're still running Pentium IIIs, so you can imagine how rarely we buy new gear16:19
binBASHPentium 3 omg16:19
binBASHtwb: How much people you are in company?16:20
twbProbably about ten16:20
binBASHok, more than us then ;)16:21
twbIt's hard to tell because some spend months pimped out, and some ex-employees continue to lurk on the lists16:21
twbWe replaced the LaserJet 4 last month, and the sysadmin deploying it went "oh, cool, the NEW unit has only been EOLd by HP since 2008"16:21
binBASHlol16:21
twbHaving said that, I loved that little LJ416:22
binBASHsounds like a lack of money16:22
twbThere's a policy of handing most of the profits to the engineers instead of the company16:23
twbBut it's also a mindset thing.16:23
twbWe have a pair of Q9550 with 2TB of storage, but one got stolen to run rpppoe.16:24
binBASHtwb: We had such a policy as well twb16:25
binBASHAll money to personal16:25
binBASH;)16:25
binBASHGet a project manager for 100K Eur / Year16:25
binBASHkick him out 9 months later because he sucked16:25
binBASHand have a second boss, which was also not very useful16:26
* cloakable eyes gluster storage platform >.>16:26
pjp3rdhi id like to set up monthly bandwidth quotas for my home network something like http://www.digirain.com/en/trafficquota-overview.html but ive been googling like crazy and i cant find anything like that for ubuntu, any suggestions?17:16
brianhermanpjp3rd: You can use iptables to set a quota17:28
brianhermanhttp://linuxgazette.net/108/odonovan.html17:28
brianhermanpjp3rd:http://linuxgazette.net/108/odonovan.html17:28
brianhermanpjp3rd: https://help.ubuntu.com/community/UFW17:29
pjp3rdbrianherman, thanks that looks like a good place to start17:33
binBASHpjp3rd: why you want quote in home network?17:33
brianhermanpjp3rd: Use the ubuntu one it seems the simplest17:34
brianhermanQuota not quote17:34
binBASHquota yeah ;)17:34
pjp3rdbrianherman, but id need to set up a seperate quota for each user, a way for user to check his quota and to automate it everymonth. so it would be nice if someone has already done that work..17:35
pjp3rdbinBASH, cus the ISP gives me a quota and im sharing it with 16 people, seems like the most sensible way to avoid fights when we are running out after 2 weeks each month17:35
binBASHpjp3rd: If you share the line with 16 people why not limit bandwidth?17:36
binBASHpjp3rd: http://manpages.ubuntu.com/manpages/karmic/man8/tc.8.html17:37
pjp3rdbinBASH, im not sure what you mean?17:37
binBASHpjp3rd: http://manpages.ubuntu.com/manpages/hardy/man8/tc-cbq-details.8.html17:37
pjp3rdbinBASH, im not looking to shape the bandwidth for speed im looking to make sure we dont exceed the monthly limit17:38
binBASHok17:38
sherrpjp3rd: there's something called "bandwidthd" that might help in some way.17:42
brianhermanpjp3rd:http://bandwidthd.sourceforge.net/17:43
pjp3rdsherr, bandwidthd helps half the problem if it can moniter the bandwidth. id like to enforce limit as well17:44
binBASHpjp3rd: At least then all would know who steal the traffic :p17:44
pjp3rdbinBASH, yip it would tell me but too late rather than fighting with people every month id just like to divide it equally and no more worries17:45
binBASHpjp3rd: if you limit bandwidth for everyone it will be equal17:46
binBASHpjp3rd: Think limiting bandwidth is better than having no internet for half of the month ;)17:48
pjp3rdk, based on brianherman's tip ive found www.linuxquestions.org/questions/linux-networking-3/iptables-to-stop-bandwidth-completely-592827 which is what im basically looking for17:48
binBASHbut your decission ;)17:48
pjp3rdproblem is it doesnt seem like such a polished solution17:49
pjp3rdbinBASH, im not sure what you mean17:49
binBASHpjp3rd: You said you have a quota, what if you exceed it?17:49
pjp3rdmy isp enforces a quota when we exceed it the connection is throttled to basically unusable speeds17:50
binBASHpjp3rd: So why don't you distribute a max. bandwidth equally?17:51
pjp3rdbinBASH, what do you mean?17:51
binBASHI mean, I wouldn't accept the fact if I'm amongst the 16 people, and one causing so much traffic, so I would have no internet then for half a month17:51
binBASHpjp3rd: With the tc links I posted, you can assign each user equal bandwidth.17:52
binBASHso it's not possible traffic limit will be exceeded17:53
pjp3rdbinBASH, correct me if im wrong but what i can understand from the link you posted tc/cbq can shape my connection meaning how much is been used by any given user/protocol at a given time, thats not going to help me to stop total monthly usage from exceeding the isp quota is it?17:55
binBASHpjp3rd: With that you can limit the bandwidth for each user. So every user has equal line.17:56
binBASHand you can setup a max. bandwidth rule as well, so with that you can't exceed your providers traffic limit.17:56
pjp3rdbinBASH, oh i didnt see details about that? how can i set up a monthly limit?17:57
binBASHpjp3rd: You don't set a traffic limit. You set a bandwidth limit.17:58
binBASHThe Linespeed will be slower though17:58
pjp3rdbinBASH, can you give me more details?17:59
binBASHpjp3rd: http://www.oamk.fi/~jukkao/lartc.pdf18:00
binBASHread this ;)18:00
RoyK^binBASH: do you really need like 5k cores for this? I thought you were doing storage18:00
RoyK^or 800 cores, that is18:01
binBASHRoyK^: Storage and Processing ;)18:01
binBASH1200 cpus actually18:02
RoyK^yeah, but you were talking about hosting images18:02
RoyK^yeah18:02
RoyK^1200 cores18:02
RoyK^with 1200 cores you can do some rather fancy stuff, but then, what is it you're going to do with them?18:02
binBASHRoyK^: Hosting images, resize them, watermark them, recalculate videos, etc......18:02
RoyK^you might need 8 cores for that18:03
RoyK^not 120018:03
binBASHRoyK^: If you don't wanna wait ages, you need more  ;)18:03
RoyK^a resize normally can't be shared amongst cores18:04
RoyK^and I somehow doubt you have 1200 concurrent resizes18:04
pjp3rdbinBASH, i just skimmed through the whole book can you point me to which chapter should help me?18:04
binBASHpjp3rd: Chapter 918:05
RoyK^binBASH: what are you using for this - imagemagick? can you upload some files for me to test?18:06
binBASHRoyK^: ImageMagick for the images, yup18:07
pjp3rdbinBASH, im sorry i must be misunderstanding you but how is shaping traffic going to limit total usage per month per user?18:07
binBASHRoyK^: One jpg is like 128 MB in worst case;)18:07
RoyK^binBASH: and how often are these uploaded/resized?18:07
binBASHRoyK^: Very often ;)18:08
RoyK^seems to me 1200 cores for this job is like shooting sparrow with heavy artillery18:08
binBASHRoyK^: Getty Images uses it for their editorial press content.18:08
RoyK^binBASH: define 'very often'18:08
binBASHRoyK^: The problem is, the images will be transfered to news agencies.18:08
RoyK^well, it's only resized on upload, so how many images do need to convert per second?18:09
binBASHRoyK^: The faster the better.18:09
RoyK^well, of course, but wasting a ton of money is useless18:10
binBASHlike I said it's editorial press content. Means, someone makes a photo of a football match.18:10
binBASHit should be transfered immediately to news agencies when uploaded.18:10
binBASHtime counts......18:10
RoyK^if you have 1200 concurrent file uploads in general, 1200 cores might be worth it, but 600 will probably do well, even 30018:10
RoyK^then again, I somehow doubt you have 1200 _concurrent_ jobs in such a system18:11
RoyK^most likely 10+18:11
binBASHRoyK^: Yup, though we have some more customers, ;)18:11
RoyK^have you monitored your current system to see its load?18:11
binBASHno18:11
RoyK^it should tell quite easily how much is needed18:12
RoyK^if load average at peak times is 4, give it 4 cores, etc18:12
RoyK^we have a 40 core compute farm at work for doing models, and that's eating some data. 1200 cores must be overkill for your use18:13
binBASHRoyK^: There is another problem as well. The company develops some visual search engine atm. And noone knows what it will consume ;)18:13
RoyK^binBASH: then get a separate box for that as well18:14
RoyK^binBASH: it will probably need a truckload of RAM and fast disk access to its index, but not a lot of cpu18:14
binBASHRoyK^: And how to do it without money? :P18:14
RoyK^binBASH: hey, kid, if you try to make business work, you need to invest. I'm just trying to give you simple advices, but it seems to me you know it all better than the rest of the world. keep on, kid, and you might be wanting to find a new job in a few months18:15
binBASHRoyK^: Boss refuses to take new investors18:17
RoyK^tell your boss you can't do this without EUR 20k18:17
RoyK^that's not really a lot of money18:17
RoyK^tell him it'll cost several times as much even during the first year18:18
RoyK^or perhaps the first year will make it break even18:18
RoyK^binBASH: also, please understand that making large system work well usually means dividing services amongst servers, some for storage, som for computing18:20
RoyK^get a supermicro system for the first 60TB or so and add more disks later with SAS expanders - use it on opensolaris - share it with NFS - it can grow easily18:21
RoyK^then get small 1U boxes for doing the computing - start off with a quad intel or opteron with a bunch of cores, perhaps less, and you might see it's not really very heavily loaded18:22
binBASHRoyK^: There is another problem as well. :-) We need entry points through geoip18:22
RoyK^if it is, add more18:22
binBASHMeans, getty has offices in asia, russia etc.18:22
binBASHso we don't want to send them to german servers18:22
binBASHbut also to servers in usa18:22
RoyK^binBASH: fuck this - you reall don't listen - you've decided to use this or that already - I'm done trying to advice anymore now18:23
binBASHand we really don't want to fly to usa to build something up there in a datacenter18:23
binBASHgood ;)18:23
RoyK^seems to me what you want is to brag about a truckload of terabytes, and you're doing it the wrong way, wasting money and making things worse18:23
RoyK^keep on, kid, but don't blame the ones of us that tried to help18:23
binBASHRoyK^: Really don't wanted advice18:24
RoyK^I can see that18:27
RoyK^binBASH: out of interest - what is your current system's load average?18:27
binBASHRoyK^: It should have a reason that companies like google have a shared storage ;)18:27
RoyK^google uses its own storage18:28
RoyK^for good reasons18:28
RoyK^I'm still curious about this load average of yours18:28
RoyK^also - how do you plan to parallelize that across 300 machines?18:29
* RoyK^ guesses binBASH was in a hurry and perhaps a little drunk when he made those plans18:31
binBASHRoyK^: That is what gearman is for18:35
RoyK^binBASH: what is the load average on your current box?18:37
bogeyd6binBASH, for very large deployments that require lots of storage that is similar you might consider a de-dupe filesystem such as lessfs18:38
bogeyd6sdfs also comes to mind18:39
RoyK^erm18:39
RoyK^does lessfs do dedup?18:39
bogeyd6RoyK, you been around long enough to know what google is for18:39
RoyK^bogeyd6: I've tried hinting on using zfs, but it seems binBASH has already decided and is just here to bra18:39
RoyK^bogeyd6: I've tried hinting on using zfs, but it seems binBASH has already decided and is just here to brag18:39
=== GhostFreeman_ is now known as GhostFreeman
bogeyd6good im glad he is bragging about using Ubuntu Server in large environments and i hope he proudly announces it to his customers18:40
RoyK^bogeyd6: you've been around for long enough to know that to answer a yes or no might perhaps be a little more sophisticated and nice than just barking fgfi18:40
bogeyd6!google | RoyK18:41
ubottuRoyK: While Google is useful for helpers, many newer users don't have the google-fu yet. Please don't tell people to "google it" when they ask a question.18:41
bogeyd6also, condescension is highly frowned upon, please refrain18:41
RoyK^bogeyd6: I know, SIR, but you spent more time on telling me to google it than a yes/no answer would take18:42
bogeyd6* RoyK^ guesses binBASH was in a hurry and perhaps a little drunk when he made those plans << belong in another linux support channel18:42
RoyK^bogeyd6: not really18:42
bogeyd6well i said my peace, i hope you consider signing the ubuntu code of conduct18:42
sherrRoyK^: I thought your discussion with binBASH was quite interesting and useful until you ruined things by being rude and a little obnoxious.18:43
sherrLet's all be civil.18:43
bogeyd6!conduct | RoyK18:43
ubottuRoyK: The Ubuntu Code of Conduct is a community etiquette document to which we ask all Ubuntu users to adhere, and can be found at http://www.ubuntu.com/community/conduct/ .  For information on how to electronically sign the CoC, see https://help.ubuntu.com/community/SigningCodeofConduct .18:43
RoyK^well, people, listen18:43
bogeyd6sherr, agreed and royk should also be congratulated on his level of participation in previous instances18:44
bogeyd6would make a very valuable member of the server community18:44
RoyK^mr binBASH first tried to ask about how to do his storage, and talked about 1200 cores doing image resizing for uploads, at which I asked why, and why not central storage, to which he merely barked that he didn't need my input18:45
RoyK^this is something that can annoy the one (me) trying to help one (him) out18:45
bogeyd6RoyK, zfs is in fact available in opensolaris18:46
RoyK^bogeyd6: yes, and did you know ext3 is available in linux?18:47
bogeyd6which is pretty awesome18:47
RoyK^scroll up :)18:47
RoyK^I was trying to tell him that18:47
bogeyd6wasnt available until 27a18:48
RoyK^but it seems like he wants a truckload of cpu nodes with 2TB each for some reason18:48
RoyK^27a? what?18:48
bogeyd6i thought if you could recommend ZFS you would know a bit of its history and usage18:49
binBASHRoyK^: Looks like you're totally mistaken, I never asked for storage.18:50
bogeyd6binBASH, did you have something you did need help with?18:52
binBASHbogeyd6: originally I asked how I can start vms in ubuntu enterprise cloud with the -vnc parameter.18:52
bogeyd6i personally think that zfs needs to much horsepower and that makes it a disadvantage18:53
RoyK^bogeyd6: I just started using osol at 2009.06 - the old solaris platforms were just something I plaied with18:53
bogeyd6binBASH, that is a good question, i know it can be done on a VPS but in a desktop in a cloud?18:53
RoyK^bogeyd6: I know it needs a lot, but for dedicated storage, it's nice18:53
binBASHRoyK^: If you want details what is the problem with our current setup you can come in query :)18:55
bogeyd6binBASH, https://wiki.edubuntu.org/UEC/Images/Testing18:55
bogeyd6my google-fu is 10th degree master18:55
RoyK^binBASH: I tried asking about the current load, since you insist on needing 1200 cores18:56
bogeyd6i got a load that would blow your mind18:57
RoyK^how nice18:58
bogeyd613:57:15 up 28 days,  5:48,  1 user,  load average: 0.84, 1.38, 2.3918:58
RoyK^well, seems like the system uses a core or two quite well18:58
bogeyd6hah!18:59
bogeyd6single processor18:59
* RoyK^ had a server peaking at load avg 32 the other day18:59
RoyK^something went wrong in freeradius18:59
_rubenonly 32? ... i've reached 100+ on mailservers that were "spammed" :)19:11
RoyK^yeah, but this box was running a single radiusd that shouldn't really have been busy19:13
RoyK^guess it started a bunch of threads that went mad19:14
binBASHRoyK^: You know not only cpu usage causes load19:14
RoyK^binBASH: yeah, but there weren't any funny processes in D or Z state or similar19:15
RoyK^just a truckload of threads that went spinning19:16
binBASHback your question about our sys. Like I told you we're using imagick. Libjpeg doesn't use smp so we could calculate 8 images at once with one server.19:16
binBASHone image takes around 3-6 seconds19:17
binBASHthe images with bigger filesizes take much longer19:18
RoyK^have you tried graphicsmagick?19:18
RoyK^it's said to be faster by far than imagemagick19:18
binBASHyup, it lacks some features we need.19:19
RoyK^ok19:19
RoyK^but still - the time for one image to be resized is ok, but how about the system load over time?19:19
RoyK^that's what you should worry about when designing something new19:19
binBASHif there is high processing the load is like 2519:19
RoyK^can you distribute this load somehow?19:20
binBASHit's already distributed :)19:20
RoyK^I mean, I guess there's a common web front19:20
binBASHwe have dedicated servers for web, for image processing, for sphinxsearch and for exports to partners/ftp ...19:21
binBASHalso database19:21
RoyK^ok19:21
RoyK^with glusterfs, what happens if you remove a node? are nodes mirrored as well as the drives on those nodes?19:22
binBASHRoyK^: every node is backuped by another one19:22
RoyK^ok, so mirroring, somehow?19:23
binBASHyup19:23
RoyK^I guess it still lacks the stuff zfs/btrfs has, though :P19:23
binBASHWell, it's scalabe and a complete different technology.19:24
binBASHI dunno if you know NetApp or Isilon.19:24
RoyK^I do19:24
RoyK^isilton, no, but netapp, yes19:24
binBASHI personally would prefer Isilon over NetApp from what I've heard19:25
binBASHbogeyd6: What does this link have to do with eucalyptus? It's just for testing kvm setup19:27
* cloakable eyes eucalyptus19:27
binBASHkvm works perfectly for me already ;)19:27
cloakableAnyone here use eucalyptus?19:28
binBASHcloakable: Yes ;)19:28
binBASHcloakable: Ubuntu Enterprise Cloud is built on it.19:28
cloakablebinBASH: If I have two four-core nodes in the cloud, can I give, say, six to an instance?19:29
binBASHcloakable: No19:29
RoyK^cloakable: you can't run a vm across multiple machines19:29
cloakableDamn D:19:29
RoyK^get an amd 12-core :D19:29
cloakableWhich would suck up how many hundred watts? :P19:30
binBASHcloakable: http://www.linuxvirtualserver.org/19:30
RoyK^cloakable: not really a lot19:30
cloakableRoyK^: More than 45W?19:30
cloakable:P19:30
binBASHcloakable: I think lvs can do it.19:30
cloakablebinBASH: awesome, will look at19:31
RoyK^erm - iirc lvs is a network thing, not a processing thing19:31
binBASHRoyK^: lvs will let multiple nodes appear as one supernode afaik19:32
cloakableWhat would be really awesome would be a network-aware hypervisor >.>19:33
binBASHcloakable: Too slow19:33
cloakablePossibly19:33
cloakablehas it been tried? ;)19:33
binBASHdon't think so.19:33
RoyK^binBASH: yes, on IP, but not sharing computing tasks19:33
binBASHRoyK^: yeah, could be.19:34
RoyK^lvs is nice for web servers and so on, but not for VMs19:34
cloakableWould like to deploy an LTSP image onto a group of say 3-4 4-core machines :)19:35
cloakableOr just use it as a desktop :D19:35
binBASHimpossible afaik ;)19:36
cloakableWhich is a shame, because it would be awesome :)19:36
binBASHhehe19:36
cloakableAn area Atom would shine in ;)19:37
binBASHRoyK^: The worst thing about that many nodes. Administration overhead. So puppet to the rescue ;)19:37
cloakableheh19:37
cloakableor cluster-ssh ;)19:37
binBASHcloakable: I have it already.19:38
cloakable:)19:38
=== vegar is now known as Guest79698
Guest79698Hi, I have 2 ubuntu desktop machines and 1 ubuntu server machine. Using tcpdump, both desktop machines receive a multicast audio stream on my network, while the server machine does not20:07
Guest79698is there something on the server edition which might block multicast traffic?20:07
histothe only thing that is different should be the kernel as far as I can tell20:31
animeloe[net]Apr 10 15:29:24 server deliver(root): msgid=<20100407105335.E878661D8@$DOMAINt>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2010-04-10 15:29:24]20:36
animeloe[net]Apr 10 15:29:24 server deliver(root): stat(/root/Maildir/tmp) failed: Permission denied (euid=65534(nobody) egid=65534(nogroup) missing +x perm: /root)20:36
animeloe[net]I still haven't figured out how to fix that issue20:36
animeloe[net](not that I've been looking very hard)20:36
jared_1Had a quick question for you guys.  I'd like to build a simple home server since it's something I've been without for way too long (I've been so lucky to never lose data ... yet).  Anyways I'll probably be doing basic stuff... File server, FTP, simple webserver....But I would like a graphical environment (kde, gnome, etc) for VNC.  What hardware would you recommend to run a raid 1 or raid 0+1 (4 drives).  Trying to keep it affordab21:03
jared_1Looking for mobo / raid controller / processor recommended.21:03
animeloe[net]for your data I'd definately say a good raid 521:06
jared_1I'm fine with a raid 5 setup too21:07
jared_1but personally never done really any raid setups21:07
* animeloe[net] only uses hardware raid, so can't help with software raid21:07
jared_1replaced drives in raid arrays and whatnot, but never purchased hardware21:07
animeloe[net]got lots of money to spare?21:08
animeloe[net]get a nice areca or equivelent21:08
jared_1Hah I do, but cheaper the better obviously :)21:08
animeloe[net]well21:08
jared_1more a hobby and for work experience then a necessity21:08
animeloe[net]you want raid, you'll be spending at least a thousand just on a card21:09
histojared_1: you may want to check this out https://wiki.ubuntu.com/ReliableRaid21:09
histojared_1: explains some of the current issues21:09
blue-frogjared_1, if you don't want to lose data, make backups. raid has nothing to do with keeping data safe21:09
RoyK^Guest79698: servers should receive multicast just as clients do - the kernel isn't that different21:12
RoyK^Guest79698: is the server running on hardware or is it a vm?21:12
Guest79698on hardware21:26
Guest79698i vaguely remember an incident with a port mapping to a server which didnt work because there was some form of hardening on the server21:27
RoyK^Guest79698: ufw status21:28
RoyK^if ufw is enabled, it might block multicast21:29
jdstrandthere are rules for multicast in /etc/ufw/before.rules21:30
jdstrandthey are allowed in the default install21:31
Guest79698yeah, it wasn't that.. this is pretty weird, it seems the RTP control traffic(length 220) comes through but the audio traffic itself(length 1292) does not21:34
RoyK^erm - RTCP gomes through but not RTP?21:36
Guest79698seems like it21:36
Guest79698it might be a router problem, i'm not sure.. the rtp traffic pops up on both the other machines regardless of having pulseaudio rtp receive on21:36
RoyK^RTCP is usually imbedded in RTP, though - perhaps RTSP?21:36
Guest79698i'll fix up a paste for you with some info, hold on21:37
Guest79698http://pastebin.com/kzVynkCB21:48
Guest79698note the different port in the traffic on the server machine, which got me thinking it might be RTCP traffic which because of a lot of actual traffic doesnt neccessarily show up on the others21:49
Guest79698both ports are owned by the pulseaudio process21:50
=== vegar is now known as Guest62434
Guest62434i'm Guest79698 btw :)22:17
Guest62434with the multicast issue22:17
RoyK^Guest62434: why not get a proper nick?22:18
Guest62434good question22:18
=== Guest62434 is now known as vegar_
RoyK^vegar uten d og greier22:21
guntbert!no | RoyK^22:21
ubottuRoyK^: Hvis du vil diskutere på Norsk, vennligst gå til #ubuntu-no. Takk!22:21
RoyK^jada :)22:22
vegar_wrong response :p22:22
RoyK^I don't discuss stuff in Norwegian in here, but a short comment or two should be accepted22:23
guntbertRoyK^: it was no reprimand - I wanted to be helpful22:24
vegar_we have feelings too you know guntbert :)22:25
RoyK^I know the rules, thanks :)22:25
guntbertvegar_: why wouldn't you? :)22:26
* RoyK^ hands guntbert a bunch of dried fish to snac on22:26
RoyK^snack, even22:26
* guntbert nibbles22:27
RoyK^mér finns gott að eta harðfiskur í kvölð22:29
vegar_now it's starting to get out of hand22:29
RoyK^:D22:29
RoyK^I'll quit it22:30
RoyK^it'd be nice if someone could fast-forward the btrfs progress so that I could use linux for storage and not having to use friggin' opensolaris22:30
MTecknologyAny of you know how a partition UUID is calcualted?22:32
MTecknologyRoyK^: put your own effort into it :D22:32
guntbertMTecknology: only how you can find it: blkid :)22:32
RoyK^MTecknology: heh - I'm not a coder - it's easier to just use zfs22:32
MTecknologyguntbert: :P - I use ls -l /dev/disk/by-uuid/22:33
guntbertMTecknology: right - but if I remember correctly that is not always correctly populated22:34
MTecknologyguntbert: no, not after you change things before a reboot - I never knew blkid before today :P22:35
guntbertMTecknology: ok22:35
uvirtbotNew bug: #560299 in samba (main) "package samba-common-bin 2:3.4.0-3ubuntu5.6 failed to install/upgrade: Unterprozess installiertes post-installation-Skript gab den Fehlerwert 2 zurück (dup-of: 514963)" [Undecided,Confirmed] https://launchpad.net/bugs/56029922:37
MTecknologyguntbert: how are ya?22:39
GhostFreeman_How do i reset the password on a server using an install CD23:48
animeloe[net]you can use a liveCD23:49
animeloe[net]with the server CD use the rescue mode23:49
vegar_Anyone heard Radiohead - Reckoner and thought.. is this RHCP?23:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!