/srv/irclogs.ubuntu.com/2015/10/22/#ubuntu-server.txt

=== markthomas is now known as markthomas|away
MACscrwhats the proper way to limit the number of kernels installed on my ubuntu servers? I only want to keep the newest one and whatever is installed02:16
MACscrbikeshed seems cool, but for a small server, it it installs way to many packages02:19
pmatulisMACscr: cron-triggered shell script?02:21
sarnoldI thuoght apt had some clever setting about that02:21
MACscri know yum does, but doesnt seem like apt does02:21
pmatulisMACscr: http://askubuntu.com/questions/563483/why-doesnt-apt-get-autoremove-remove-my-old-kernels perhaps?02:38
MACscrpmatulis: oh there are tons of ways to do it, but im quite surprised there isnt an official way that doesnt require scripting02:41
sarnoldpmatulis: YES!02:41
sarnoldpmatulis: now why isn't that in the first three pages of google results? heh02:41
RoyKMACscr: wht the newest kernel?02:50
MACscrRoyK: not sure. why does it matter?02:53
RoyKMACscr: the older ones work well too ;)02:53
MACscrand?02:54
MACscri have limited space for the OS storage02:54
MACscrso want to keep things as minimal as possible02:54
RoyKa new kernel woon't help that02:55
MACscrstill not sure what that has to do with my question02:56
=== _ruben_ is now known as _ruben
=== cpaelzer_ is now known as cpaelzer
k2gremlinHello all, quick and easy question for you guys. I am trying to setup a br0 interface. I have installed bridge-utils and configured in my /etc/network/interface file. When I try to do ifup br0 it tells me cannot find device br0. Thoughts?04:31
ianorlink2gremlin: did you reload the config file?04:43
lordievaderMACscr: Apt should only keep the current and current -1 kernels when running apt-get autoremove.04:58
qman__MACscr, lordievader: it should, but often doesn't, I'm not sure exactly why. I solved the problem for me by writing a script which removes all but the currently running and most recent kernels, and put it in cron.weekly. https://deadface.org/index.php?p=kernelkeeper05:23
qman__it's also variant aware, so if you ahve more than one kernel variant (such as -generic and -rt) it manages both variants separately05:24
MACscrit does seem to work sometimes and other times it doesnt. its weird05:25
lordievaderqman__: Nice ;)05:26
adun153Anybody here experienced with LVM in DRBD?09:36
adun153In DRBD, If I re-create an internal MD, will it delete the data?09:45
=== Lcawte|Away is now known as Lcawte
=== cipi is now known as CiPi
atralheaven_how can I create a user that can do nothing, and access to nothing, only for using ssh socks proxy?11:11
atralheaven_I mean ssh -D port user@ip11:12
jonahHi I just wanted a bit of advice. Upto now I've always rented servers from a datacentre, but I now want to have a pysical office server. I've started building it and have ordered most of the parts BUT before I start installing ubuntu server I just wanted to check about the best options for disk/raid setups. I've read it is good to keep the OS on a seperate disk and then have a raid for the data?12:43
jonahBut the server I'm building is mainly going to be for websites, cloud login storage and basically just a LAMP12:43
jonahso I ordered an SSD to put ubuntu on and then 4 x 5.25" drives for the raid12:44
rbasakWhy do you want RAID?12:44
jonahwill this work, or is it just as well to stick everything on one raid?12:44
rbasakFor reliability or performance or something else?12:44
jonahrbasak: well I already have a big enough backup drive to backup the raid, so I just wanted the speed and the potential to hotswap and expand/repair if a drive goes down12:45
rbasakSo all of the above :)12:45
jonahrbasak: haha yeah12:46
jonahrbasak: but before I put the disks in the server case, I'm wondering if I should just install ubuntu on the raid and then install lamp as normal and leave it that way. Is there an advantage of having the extra SSD drive there? I've read a lot of conflicting things and also don't know how I'd actually get it to work right and set it up12:47
rbasakMy home server runs on two disks with RAID-1 and LVM on top of that.12:47
rbasakI have no need for an SSD on my server. Cache suffices for me.12:47
rbasakYou could look into bcache but we don't have installer support for that yet. Depends on how much you're prepared to do manually, skill level, etc.12:48
jonahso do you think I'm best just leaving that SSD out of there or is there a way I can use it to improve performance. I suppose I thought the OS would be faster and the boot/reboot fast etc.12:49
jonahI don't have that much skills with linux, I use it as a desktop daily and also do a few ssh into data centre and copy the odd thing etc but not too sure about raids, fdisks, partitions, caches and the like12:49
rbasakIf you have enough RAM then you won't get much of an OS speedup with an SSD, except when doing things that you haven't done in a while (presumably non-workload things).12:50
rbasakBoot will be faster but does that really matter on a server?12:51
rbasakI'd stick to what the installer lets you set up. Keep it simple. The closer your configuration is to others, the less likely you are to be on your own for any problems.12:51
shaunoI think one thing to remember putting the OS on a separate disk, is that you've chosen raid for reliability, and then introduced another disk as a single-point-of-failure anyway.  murphy says the non-raid disk will be the one that goes.12:52
jonahok great thanks, so i just put the normal drives in (leave out the ssd) and just use what ubuntu installer offers me and it will set up the software raid and install all the defaults?12:55
jonahthen I just back up the whole raid to my backup drive?12:55
rbasakI'd say so, yes. Though I haven't used the installer in a while so I can't really help with that part.12:57
rbasakI would definitely have RAID-1 at a minimum for a server nowadays though. Disks are guaranteed to fail eventually and it's a very easy way to get continuity.12:58
jonahbaffle: ok thanks I'll opt for just the raid in that case, I was going to use raid 5 as most lamp servers I think use that, will that be ok?13:00
jonahrbasak: sorry sent the last reply to baffle by mistake! oops13:01
rbasakRAID-5 does what it says on the tin. It's just a cost/risk thing.13:01
rbasakBut understand that your disks will fail eventually. If they're both from the same batch and have had a similar workload (eg. by being part of a RAID) then they are likely to fail at around the same time.13:02
rbasakI've seen disks fail during RAID-1 and RAID-5 reconstruction.13:03
rbasakI do not put disks from the same batch into a RAID.13:03
rbasak(well 1 or 5)13:03
rbasakIMHO buying five of one SKU all at once and putting them into a RAID-5 is pointless. Might as well just have a RAID-0 for all the good it does.13:04
Walex2rbasak: that's a bit excessive...13:04
rbasakWalex2: which bit?13:05
Walex2rbasak: anyhow I have seen commercial storate systems with hundreds of identical drives with virtually consecutive serial numbers...13:05
Walex2rbasak: the "five of one SKU ... just have a  RAID-0 for all the good it does13:06
rbasakMaybe those storage systems are doing more to handle concurrent failures?13:06
rbasakIn a previous job we won business due to concurrent RAID disk failures by previous suppliers not doing this.13:07
rbasakIt was a reasonably regular thing, in that I've seen it multiple times.13:07
rbasakWith both commodity SATA and expensive "server grade" SCSI drives.13:07
rbasakOr perhaps they didn't wait for drives to fail before replacing them? I don't know.13:08
Walex2rbasak: I agree that is a bad idea, but concurrent failures can wait years to happen even among hundreds of drives.13:20
Walex2rbasak: I agree that is a bad idea, but concurrent failures can wait years to happen even among hundreds of identical drives.13:20
rbasakWalex2: depends on how the drives are used, and whether they're from the same batch!13:22
rbasakWalex2: having the same usage pattern and the same environmental conditions from the same batch will make it more likely that they will fail close together in time, clearly.13:23
rbasakAs I say, I have seen it happen multiple times.13:23
rbasakSo for a small business buying one server, it makes sense to avoid that risk because there's virtually no cost to doing so.13:24
rbasakIf OTOH you are backblaze or someone similar, then clearly you can't achieve that. But your usage patterns are probably different enough that the risk is lower anyway.13:24
rbasakAnd in any case, you probably aren't using a minimum level of redundancy like RAID-5 that is more at risk.13:25
Walex2rbasak: your level of optimism is astounding... :-)13:32
Walex2rbasak: imagine rows and rows of racks with identical drivess with nearly consecutive serial numbers arranged in 16-wide RAID5s "because it optimizes the space".13:33
jpdsWalex2: Dude, build a Ceph cluster at that point13:34
RoyKWalex2: I remember an email on some zfs mailing list some 4-5 years back. someone had built a raidz1 (similar safety as with raid5) with 30 drives and some drives were failing...13:36
Walex2RoyK: I collect emails like that. The 32-wide RAID5 was particularly amusing, but a 30-wide RAIDZ1 is good too :-).13:39
Walex2http://www.sabi.co.uk/blog/14-two.html#141019 for the 32-wide RAID513:40
jonahsorry to pipe back in but say I use the Raid 5 and have 4 hard drives. My system is running nice but then one fails, how do i hotswap in a new drive and rebuild the array? Won't ubuntu just see a new drive, not a replacement for the failed one if I just whip it out and stick a new one in?13:50
RoyKWalex2: this guy had even added three spares13:57
Walex2jonah: depends on what the RAID system is. Most require you to explicitly label a drive as a spare before it will be added into a RAID.13:57
RoyKjonah: mdadm --add /dev/md0 /dev/newdisk13:58
jonahWalex2: well i mean just a standard ubuntu server install running on software raid513:59
RoyKjonah: that adds a disk to the raid and unless you grow it, that disk is flagged a spare and will work like one13:59
jonahRoyK: I see Roy, so you'd power off and take out the dead one, then power back up with the new one added in it's bay then run that command?14:00
RoyKjonah: then just mdadm --remove the failed drive, unplug it, install a new one and mdadm --add it14:00
RoyKjonah: if you don't have hotpluggable disks, yes, but both SATA and SAS should handle hotplug14:00
RoyKit's part of the specification14:01
jonahRoyK: ah so with mine being sata 3 i can just hotswap with it all still turned on14:01
RoyKshould work14:02
jonahRoyK: so I'd just find the dead one, pull it out and put the new one in and run mdadm14:02
RoyKyou should probably mdadm --remove the dead one first, then mdadm --add the new one14:02
RoyKjonah: are you using partitions? if so, you'll need to create those first, obviously14:02
jonahRoyK: haha I know it sounds silly but how do you know which is the dead one14:03
RoyKhehe14:03
rbasak/proc/mdstat will tell you what the system considers to be alive or dead14:03
rbasak(or hot spare)14:03
RoyKjonah: try smartctl -i /dev/nameofdisk14:03
rbasaketc14:03
RoyKjonah: that should give you the make and serial number14:04
RoyKjonah: otherwise, it should be in /dev/disk/by-id14:04
rbasakRoyK: assuming that the disk isn't timing out on commands :)14:04
rbasak(I agree, but you might want to know your mapping in advance if that might be a problem)14:04
RoyKrbasak: yeah, but the data in /dev/disk/by-uuid should stick14:04
jonahRoyK: well my plan was to just partition 4 drives all with 10% swap partition and the rest free. then set up the raid on the ubuntu server installer. So if I add a label name to them all when I partition them I'll know which has died if one fails?14:05
RoyKjonah: I'd recommend using a pair of smallish (2,5" perhaps) drives for the root and the rest for data with LVM on top14:05
jonahRoyK: ah I see so I just have the serials numbers of each drive on the front of them so I can see when I open the bays up to swap them out14:05
RoyKbetter poweroff first, so you don't unplug something in use14:06
jonahRoyK: well the plan is to just have a big lamp server and then run owncloud and some other cms stuff on there. Do I need the LVM and different drives/partitions or can I just have the bog standard raid5 and just install?14:08
RoyKjonah: I always use LVM - it doesn't hurt and it's more flexible14:08
RoyKjonah: but really - if you have a couple of old drives, use them as a mirror for the root, don't mix root and data14:09
RoyKjonah: some even use USB sticks for the root - it's not much in use anyway14:10
jonahRoyK: ah this is interesting as when I first came into this chat my initial question was whether I should have an SSD for the OS (or two I suppose if mirrored) and then a seperate raid array for the data.14:10
lordievaderLVM ftw :D14:10
jonahRoyK: but I wasn't sure how complex or necessary this was to setup up. Especially if I'm backing everything up anyway14:11
RoyKjonah: I helped a friend of mine to setup her home server, and we chose a smallish ssd and an old laptop HDD for the root, the HDD set to write-mostly14:11
RoyKjonah: that gives you the read speed of an SSD and HDD write speed14:12
RoyKwhich is quite handy :)14:12
jonahRoyK: sounds good, but I'm thinking more of the overall lamp with webmim virtualmim and all the rest of it installed. There is a bit of a mixture of data and config/os - not sure how I could separate it or benefit. For example if the OS drive failed and I had to reinstall, would the data stuff work correctly with it still. Sounds like a minefield.14:16
RoyKdon't use webmin14:16
RoyK!webmin14:16
ubottuwebmin is no longer supported in Debian and Ubuntu. It is not compatible with the way that Ubuntu packages handle configuration files, and is likely to cause unexpected issues with your system.14:16
RoyKjonah: with a mirror of an ssd and a hdd, you can handle a disk failure14:17
RoyKjonah: and no, it's not a minefield, mixing root and data is, though14:17
jonahRoyK: Blimey RoyK - I'm used to cpanel currently but thought webmin was the best open source had to offer if I don't want to pay?14:26
RoyKjonah: use the commandline :P14:27
disposablei'm trying to install 14.04 on hp microserver (n54l). i have a problem with the installer though. as soon as the purple ncurses based interface starts, my usb keyboard stops working. does anybody know a workaround? (it works fine with centos installer and omnios (solaris)) and yes, i have tried a different usb keyboard. same story. i'm installing from a usb2 drive onto a usb3(in usb2 port) drive,14:27
disposable in case that matters. google shows many people with the problem but no solution.14:27
RoyKjonah: it's not that hard, and once you've learned it, you'll never look back14:29
jonahRoyK: yes fair enough. The thing that scares me I suppose is the security, I can probably follow some guides and get something working but if it's served to the outside world hackers could well have a field day. I've just had a cpanel hacked recently and that had all the modsecuirty addons and a firewall running and cloudflare etc - so doing it commandline is really honourable and I'd love that but the last thing I need is a hackfest!14:32
RoyKjonah: just choose good passwords, like http://xkcd.com/936/, setup ufw to block anything you don't want to be open (it's simple, really) and use SSL/TLS whenever possible14:34
RoyKdon't allow ssh login with passwords, only keys, or at least only keys with root (which I think is default now)14:34
rbasakAlso, install and use unattended-upgrades, and pay close attention to anything you don't install from the archive (or even from the archive and in universe).14:34
rbasakWhich also means: be biased against any technology not in the archive. Ask why it isn't packaged as part of Ubuntu.14:35
RoyKjonah: it will *not* be any more secure if you trust som flashy GUI to do the job14:35
RoyKjonah: and at the end, you'll even end up with more linux knowledge, which won't hurt :)14:35
jonahRoyK: you've talked me into it!14:36
RoyKjonah: :)14:42
=== Odd_Blok1 is now known as Odd_Bloke
=== manjo` is now known as manjo
=== teward- is now known as teward
=== DavidDuffey is now known as dduffey
=== agumon is now known as Uptime
=== jeremy_carroll_ is now known as jeremy_carroll
=== Ursinha_ is now known as Ursinha
=== markthomas|away is now known as markthomas
=== fhd__ is now known as fhd
=== alai888 is now known as alai
=== g4mby is now known as PaulW2U
=== wendar_ is now known as wendar
fx159hello, is there anything I can do to debug reboot problems? my server gets stuck after displaying "all processes ended after 2 seconds", I'm using 14.04.318:23
sarnoldfx159: try fiddling with shutdown -H, shutdown -P, shutdown -r, I've heard some systems handle some of those poorly18:24
RoyKfx159: how do you reboot the server? have you checked the logs?18:25
fx159RoyK: I enter reboot into the console18:25
RoyKfx159: should work18:26
RoyKfx159: if you have another linux machine around, try setting up rsyslog to log to that machine as well to see if you get anything useful out of the logs18:26
fx159RoyK: also nothing obvious in the syslog18:26
fx159RoyK: I have a serial console to the machine... it just sits there after "all processes ended after 2 seconds", no further output, also no errors before18:27
RoyKno idea, sorry18:27
fx159too bad, well I can live with it... machine is online 24/7 anyways18:28
TJ-fx159: it's usually a firmware ACPI bug; there are some workarounds, such as matching the expected OSI string with a kernel command-line entry of the form "acpi_osi=Windows XXXX" where XXXX is some Windows version string present in the ACPI DSDT (the most recent Windows version usually). "sudo strings /sys/firmware/acpi/tables/DSDT | grep -i windows" might help you find those strings18:28
sarnoldTJ-: good idea18:29
fx159TJ-: I know it worked with earlier versions of 14.04, before rebooting it displayed a message saying something like "rebooting system now", that message no longer appears, still a firmware bug?18:30
TJ-fx159: maybe a regression in the kernel18:30
sarnoldfx159: there's a 'fwts' package that's supposed to help test firmwares; I haven't used it myself so I can't really say if it is appropriate for end users or just hardware distributors, but it may useful too18:30
sarnoldfx159: ooh, interesting. if you're up for testing the 14.04.2 and 14.04.1 kernels, that might be worthwhile. granted, it'd take some time, but it'd make a bug report more interesting :)18:31
=== markthomas is now known as markthomas|away
fx159sarnold: oh well, already tested a lot of the 3.19 kernels for another bug report, not again hehe18:32
sarnoldfx159: hehehe18:32
sarnoldthere are more fun ways to spend your time, that's for certain.18:33
fx159https://bugs.launchpad.net/bugs/1504909 any ideas regarding this bug? hehe18:33
ubottuLaunchpad bug 1504909 in linux (Ubuntu) "blk_update_request: I/O error when accessing a disk that is spun down" [Medium,Incomplete]18:33
sarnoldfx159: argh. that looks -really- annoying18:35
sarnoldfx159: does a scrub repair it?18:36
fx159sarnold: scrub fixes the errors, yes18:36
fx159sarnold: but I'd prefer spin down to work without data corruption ;)18:37
sarnoldfx159: yes :)18:37
sarnoldespecially since scrubs aren't exactly fast18:37
fx159sarnold: 600M/s is kinda fast, but scanning the pool still takes about 3 hours :/18:39
fx159sarnold: I'm considering going back to the 14.04.2 kernel18:40
sarnoldfx159: There's a few approaches that might be worthwhile, but none of them are fun. maybe try 14.04.1's kernel, see how well that works; try to reproduce on a single drive without zfs; try replacing the controller with something else (funny, I'd heard really good things about the m1015, but perhaps not many people spin them down..)18:41
fx159sarnold: spindown is something that also worked with earlier verions :(18:41
sarnoldfx159: have you asked around #zfsonlinux or filed github issues there? those guys are helpful and might know something that I don't..18:41
fx159sarnold: yes I did, initally there was also a zfsonlinux bug... but that got fixed...18:42
sarnoldfx159: heh18:42
fx159sarnold: https://github.com/zfsonlinux/zfs/issues/378518:42
sarnoldfx159: doing the full bisection is probably the best bet, though that might be dozens of compiles and reboots..18:43
fx159sarnold: too bad, I don't have that much spare at the moment...18:44
fx159*time18:44
fx159sarnold: I believe it has something to do with zfs... error occurs with 3.16 as well now, wtf?18:53
fx159sarnold: I'm 100% it never appeared with 3.16 before ._.18:54
sarnoldfx159: interesting. did you upgrade pool or dataset features? if not you could try an older zfs...18:54
sarnoldbisecting zfs/spl may be easier than the kernel :)18:55
fx159sarnold: upgraded the pool :-(18:55
sarnold:(18:56
fx159sarnold: I always wanted to try out FreeNAS... hm... whatever18:57
fx159sarnold: no more spin down or reboots for me, for now hehe18:57
sarnoldfx159: did you notice any decent power savings or noise savings when spinning down the disks?18:57
=== Caveman is now known as Guest84322
fx159sarnold: noise is not a concern, power draw with spinning disks is about 90 - 100W, with spun down disks something like 45W, so yes, there is potential18:59
sarnoldfx159: wow. thanks. I'm sooner or later going to be putting together my own smallish zfs system and was curious about power draw, heat, and noise from all those drives..19:08
fx159sarnold: I'm using a supermicro 4U server case, 8 bay hot swap in the front, heat is no problem, noise...well... there are system that are quieter, power draw is quite good as you see :)19:10
sarnoldfx159: hehe, yeah, server gear is never going to be -quiet- but it still seems surprising to me that there's not much in the middle ground of ~dozen drives systems for home use. it's all "look! four drives in this nas!" or "this chassis holds 24 drives" :)19:12
fx159sarnold: Yea, four is just not enough, and 24 is overkill...19:28
=== markthomas|away is now known as markthomas
dasjoesarnold: is http://cdimage.ubuntu.com/releases/wily/release/ supposed to contain just powerpc and ppc64el images?19:40
sarnolddasjoe: hah, good question19:40
dasjoesarnold: same for vivid. trusty has some weird images I don't recognize, too: "64-bit Mac (AMD64) desktop image"19:42
OerHeksdasjoe, use the server and install the desktop you want19:42
sarnoldOerHeks: those -are- the server images, and it's only two oddball arches :)19:42
sarnolddasjoe: I've poked infinity in #ubuntu-devel, he seems most likely to know what's going on..19:42
sarnoldoff to lunch..19:43
dasjoeOerHeks: thanks, but that's not what I'm after :) I just noticed cdimages does not contain images for any arch I use19:44
tarpmandasjoe: are you looking for http://releases.ubuntu.com/wily/19:45
OerHeksimages like logos / artwork ?19:45
ObelusProbably disc images...19:46
shaunodasjoe: it seems to be intentional.  the front page of http://releases.ubuntu.com has an explanation.  in all honestly, I'm surprised the root of cdimage. doesn't19:48
dasjoeshauno: thanks, just found that explanation, too19:48
OerHeksoh the regular versions http://releases.ubuntu.com/15.10/ , i was lost in powerpc19:50
dasjoeI finally found what I was looking for in the first place, the netboot minimal ISOs: http://cdimage.ubuntu.com/netboot/20:00
ObelusAh netboot.20:01
=== CiPi is now known as cipi
=== cipi is now known as CiPi
rattkinghello, does anyone know if the grub2 password behavior was suppose to change between precise and trusty? I just upgraded a test node to trusty and its asking for a PW to boot when it use to require a PW to edit or access  grub's cli20:30
rattkingohh yes there was a change in behavior there, and its documented :)20:38
Wicaeedhow long does it take to sync a single image with uvt-simplestreams-libvirt? I'm running the command to sync a single image yet I'm not seeing any noticeable network activity21:00
WicaeedI see it taking a boatload of CPU though21:01
atralheaven_Hello, what tool do you suggest for downloading torrents on vps?21:06
bittinrtorrent21:10
keithzgatralheaven_: Yeah, bittin's suggestion of rtorrent is probably the best one. Although, I remember some time ago having to go with ctorrent instead because of dependencies. That was a while ago and it was on an OpenBSD VPS, though.21:14
atralheaven_I think I've used it before...21:15
atralheaven_im installing it21:15
atralheaven_how can I add a user that can only use ssh socks proxy? nothing more, only ssh socks proxy, is it possible?21:17
atralheaven_the user shouldn't be able to run any command21:18
=== Lcawte is now known as Lcawte|Away

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!