[00:48] <jetole> Hey guys. I'm setting up ipset on ubuntu and wondering about persistence. For example, I set create ipset rules in /etc/rc.local to have them set as persistent however that's run after the iptables-persistence scripts if I'm not mistaken so I'm wondering where or how I should create ipset persistence
[01:23] <jetole> well I wrote my own ipset persistence script based off of iptables-persistent so I guess that'll do for now
[02:10] <Crackz0r> Hello
[04:44] <sudormrf> hey guys.  question.  I want to setup backups on my server, I was thinking dd + cron, but I was wondering if there was a better way to accomplish this
[04:44] <TJ-> sudormrf: never! dd is not a back-up tool for live systems. Use LVM and snapshots for block device backup
[04:45] <sudormrf> TJ-, and suppose I didn't use LVM when setting up the server?
[04:46] <TJ-> sudormrf: use some other form of back-up, such as rsync
[04:46] <sudormrf> hmm, but wouldn't just rsync be a bit messy?
[06:41] <Sachiru> Could someone recommend me a good and free sFlow collector and analyzer that can run on an Ubuntu server?
[06:41] <Sachiru> Basically I need something to collect both sFlow data and logs from my router (Ubiquiti EdgeRouter Lite) for bandwidth monitoring
[06:42] <Sachiru> If not sFlow, NetFlow
[06:50] <lordievader> Good morning.
[06:52] <lordievader> Sachiru: Do you know NFSen? http://nfsen.sourceforge.net/
[06:52] <Sachiru> Thank you
[06:52] <Sachiru> Very much
[06:52] <Sachiru> Exactly what I was looking for
[06:53] <lordievader> Sachiru: Little bit of advertisment: SSHCure is a nice NFSen plugin https://github.com/SSHCure/SSHCure
[08:39] <xperia> hi all. i need to create a filesystem on a ssd disk that will be used for a huge amount of small files in the size of about 500 Bytes to max 1KB stored in a Directory Structure like ./category1/a/aa/aabbcc.file My question is what is best File System for such a case ? I guess Raiser right or does some other File System exist that is much better already for such a case?
[08:41] <salih-emin> xperia, acording to this http://unix.stackexchange.com/questions/28756/what-is-the-most-high-performance-linux-filesystem-for-storing-a-lot-of-small-fi
[08:41] <salih-emin> the best overall is Raiser
[08:42] <salih-emin> but IMO the best filesystem is the one you can troubleshoot or at least you have experience with it if somthing goes wrong
[08:42] <salih-emin> some day
[08:45] <xperia> salih-emin: thank you a lot for your reply. will just checkout our link! yeah i am new to raiser but it looks really when it comes to small files raiser beats all other file systems. there are some negative reports however that people avoid it becouse it corrupt with the time the performance. pity that not that much people use it so more experience can be shared.
[08:47] <salih-emin> yes that is why I prefer ext4 even if I deal with tiny files because the support out there is worth the small amount of performance sacrifice
[08:47] <salih-emin> :)
[08:51] <xperia> salih-emin: well i would stick also with ext4 but the problem with ext4 is the limted amount of inodes. there is a specific amount of inodes you are able to create related to blocksize. also with much more indoes the performance is getting slower i think but i could be wrong. dont think 1 billion inodes is gona work on a ext4 file system that good?
[08:59] <salih-emin> xperia, yes there are some important issues with inodes with ext4. There are som good readings out there to help you determine what suits best your needs http://stackoverflow.com/questions/21397110/how-to-store-one-billion-files-on-ext4
[08:59] <salih-emin> and http://www.redhat.com/summit/2011/presentations/summit/decoding_the_code/thursday/wheeler_t_0310_billion_files_2011.pdf
[08:59] <salih-emin> I wish you best of luck and patience ;)
[09:14] <xperia> salih-emin: thank you i will need it :-) sooner or later i will have to write/hack my own filesystem for the ubuntu server or at least adjust some existing one. wish you a good day and success. thanks.
[09:14] <salih-emin> :)
[09:18] <zetheroo1> I have Ubuntu installed on a server with 4 HDD bays, two of which have disks for data. I would like to remove them from server without rebooting or shutting down the server - is this possible?
[09:19] <Abhijit> explain =  two of which have disks for data
[09:30] <ikonia> explain "remove"
[09:31] <ikonia> as in stop using the disks, or physically remove
[09:31] <ikonia> how are the disks layed out, in lvm ? raid ? flat mount points ?
[09:33] <zetheroo1> physically remove
[09:34] <zetheroo1> the 2 data disks are a Raid1
[09:34] <zetheroo1> I will have no more need of those 2 disks in there
[09:35] <ikonia> in terms of stopping the OS using them, thats easy, break the mirror
[09:35] <ikonia> in terms of physically removing them, that will depend on your server hardware if it's hot swap
[09:36] <zetheroo1> ok
[11:19] <pmatulis> morning
[11:24] <Andy80> hi
[11:24] <Andy80> I've just done a "apt-get upgrade" on my Ubuntu 14.04 server, and mong all the packages, nginx has been upgraded, but now is broken! This is what I get in the error.log http://pastebin.com/eWysMNxa
[11:25] <Andy80> how can I fix it?
[11:27] <pmatulis> Andy80: was working before i presume?
[11:28] <Andy80> yes it was
[11:28] <Andy80> it looks like something has been changed between the previous version of nginx and the current one installed
[11:28] <Andy80> and my config or whatever is not valid anymore
[11:29] <Andy80> but seriously... why relasing an upgrade that breaks stuff?
[11:29] <Andy80> for a crucial package as nginx :/
[11:30] <pmatulis> Andy80: sounds like your config got altered, which is strange.  can you open a bug?  https://bugs.launchpad.net/ubuntu/+source/nginx/+filebug
[11:30] <pmatulis> Andy80: put in the previous version and the current version
[11:31] <Andy80> no, my config has not been altered
[11:31] <Andy80> -rw-r--r-- 1 root root 2120 Aug 30 14:46 andreagrandi
[11:31] <Andy80> before opening a bug on bugzilla I need to fix this sorry
[11:31] <pmatulis> Andy80: do you have backups of the config so you can compare?
[11:31] <Andy80> my website is down
[11:32] <pmatulis> Andy80: sounds like you just need to allow directory listing
[11:32] <Andy80> I nigthly backup with duplicity... so yes, I've backups, but my config has not been touched
[11:32] <pmatulis> Andy80: so you compared the two configs?
[11:32] <Andy80> pmatulis, no I didn't, but if the date is Aug 30, how can be modified?
[11:33] <Andy80> let me retrive the backup copy anyway...
[11:35] <pmatulis> Andy80: maybe pastebin the current one as well.  was anything changed re the files/directories being served up?
[11:35] <Andy80> one momen... I'm getting the backup copy...
[11:36] <Andy80> root@andreagrandi:/home/andrea# diff /tmp/andreagrandi/andreagrandi /etc/nginx/sites-available/andreagrandi
[11:36] <Andy80> no diffs
[11:37] <Andy80> my current config is this http://pastebin.com/JD893aSD
[11:39] <Andy80> where can I get an history/log of what apt-get did so I can look in the changelog of nginx and see if something changed between the two versions?
[11:40] <Andy80> found the changelog http://nginx.org/en/CHANGES-1.6
[11:40] <Andy80> but nothing helps...
[11:44] <pmatulis> it looks like you do not have directory listing allowed.  shouldn't you have 'autoindex on;' under location for that?
[11:46] <Andy80> I've multiple locations... under which one do I have to put it?
[11:48] <pmatulis> Andy80: try under
[11:48] <pmatulis>         # Matches everything.
[11:48] <pmatulis>         location / {
[11:51] <Andy80> tried.... didn't help
[11:51] <pmatulis> Andy80: you might want to enter #nginx , i've never used the software
[11:54] <pmatulis> Andy80: but if it was working before, that exact same client request, it should not have broken in an upgrade.  strange that i do not see a new version in -updates, i only see 1.4.6-1ubuntu3
[11:55] <pmatulis> Andy80: look at your apt logs to be sure nginx was changed, it may be something else
[11:57] <Andy80> it was
[11:57] <Andy80> I saw it upgrading
[11:57] <Andy80> and the ackage is also in the apt cache
[12:42] <fixxxermet> I'm setting up automated installs with cobbler.  Should I be using kickstart or preseed files?
[12:47] <pmatulis> fixxxermet: preseed is debian/ubuntu, kickstart is redhat.  the installer is kickstart-aware for only some basic options, call it kickseed.  best to go with preseed
[12:47] <fixxxermet> pmatulis: exactly what I wanted to know.  That you
[12:47] <fixxxermet> s/that/thank
[14:20] <zul> coreycb,: ill take python-oslo.config i need to fix some stuff anyways
[14:21] <coreycb> zul, ok
[14:25] <zul> coreycb: the xstatic stuff got merged
[14:25] <zul> er...synched
[14:26] <coreycb> zul, ah, good
[14:33] <Kunzem1987> good day people. I hope someone can at point me at least in the right direction. I have ubuntu server backup they are tar.bz2 20 files each of 1.8gB in a parity archive format. My problem is not repairing the parity files i verified them etc . how do i extract the data whithin. i would think it would start by unparitying (don't think that is word) them and then use tar command to extract. I've used multipar on
[14:33] <Kunzem1987>  windoze . i'm at loss with this issue. can see my data there but just can't open :(
[14:37] <dasjoe> Kunzem1987: do you know which tool produced those files? I don't know anything that produces *.tar.par2
[14:44] <Kunzem1987> Unfortunatly I was not with when the backups were made. they have extension file.tar.bz2.aa next file.tar.bz2.ab to file.tar.bz2.at and there is a index file file.tar.bz2 which is small. i assume it was created using par2 package in command line. just don't know how to unpar them
[14:46] <lordievader> Extracting the main file.tar.bz2 does not pull-in the child files?
[14:47] <lordievader> I suppose the a[a-t] files are all the same size?
[14:48] <Kunzem1987> @ lordievader yes the a[a-t] files are the same size except for the last one. i will try to excract from indexed tar.bz2 file
[14:55] <Kunzem1987> the index file has .par2 at end and I tried tar xvjf bras.10.tar.bz2.par2 which obviously didn't work.
[14:58] <lordievader> There is no file with just *.tar.bz2?
[16:08] <arosales> thanks coreycb for charing the server meeting
[16:12] <coreycb> arosales, np :)
[16:13]  * patdk-wk wonders how much he charged for it
[16:15] <Odd_Bloke> Medium-rare.
[17:05] <CarlFK> hmm, ps shows:  Aug21   0:00 /usr/bin/dpkg --status-fd 59 --configure resolvconf:all libcgmanager0:amd64 libudev1:amd64 udev:amd64 .... full list http://paste.ubuntu.com/8301446/
[17:05] <CarlFK> this is a very vanilla box.  it is pretty much just a file server.
[17:06] <CarlFK> any suggestions before I sudo reboot and turn it on again?
[17:14] <lordievader> CarlFK: Why not kill the process? Instead of rebooting.
[17:15] <CarlFK> lordievader: the thought was there might be something else blocking it.. so before I spend time on all that kill them all
[17:16] <lordievader> CarlFK: Unlikely. Apt might be waiting for it. But that is not a problem.
[17:17] <CarlFK> killed.
[17:17] <lordievader> CarlFK: Could you pastebin the output of "ps aux| grep dpkg\|apt'
[17:17] <lordievader> CarlFK: Could you pastebin the output of "ps aux| grep 'dpkg\|apt'"*
[17:18] <CarlFK> um.. even after I killed it?
[17:19] <lordievader> CarlFK: Yes, I'd like to know if something remains.
[17:19] <CarlFK> lordievader: nothing (well, the ps...grep like we always get)
[17:21] <lordievader> Ok, great. Was that the full problem?
[17:22] <CarlFK> I did a apt-get update and got "/var/lib/dpkg/lock in use"
[17:22] <CarlFK> but still having some problem: sudo apt-get update ...  the expected bunch of Hit http://us.archive.ubuntu.com trusty-backports/universe Translation-en
[17:23] <CarlFK> E: dpkg was interrupted, you must manually run 'sudo dpkg --configure -a' to correct the problem.
[17:23] <CarlFK> guessing I should do that?  sudo dpkg --configure -a
[17:24] <lordievader> CarlFK: Jup.
[17:25] <CarlFK> update-initramfs: Generating /boot/initrd.img-3.13.0-34-generic
[17:26] <CarlFK> shouldn't it say "reboot required" ?
[17:26] <lordievader> CarlFK: Reboot is never required ;) Just recommended.
[17:27] <CarlFK> hmm, not sure I see a new kernel.. Setting up grub-pc (2.02~beta2-9ubuntu1) ...
[17:28] <lordievader> CarlFK: Something triggered an update of your initrd.
[17:29] <CarlFK> Processing triggers for initramfs-tools (0.103ubuntu4.2) ...
[17:29] <CarlFK> I 1/2 think it doesn't matter, but given my hickups here I should reboot now when I have time to fix it
[17:30] <lordievader> CarlFK: I'd say there is no need to reboot, unless you want to load the new kernel/initrd.
[17:34] <CarlFK> grumble.  why does root own my bash_history? -rw------- 1 root root 213 May 11 11:08 /home/juser/.bash_history
[17:34] <CarlFK> and -rw-------  1 root  root  1176 May 11 11:11 .viminfo
[17:35] <lordievader> CarlFK: sudo chown -R $USER:$USER /home/$USER
[17:37] <CarlFK> yeah.. but how did that happen?  (only 1/2 care.. its just a local file server box in my house, i don't pretend to do proper deployment stuff to it)
[17:40] <lordievader> CarlFK: Accidental command, improper sudo usage. Don't really know.
[18:30] <ciroingiro> Kunzem1987 i don't know par2 package but tar can not create a compressed multi volume archive and bzip2 can not create a multi volume. I think the creator script have create a multi volume tar archive and compressed every single tar.part with bzip2. You have to try bunzip2 file.tar.bz2.aa for example?
[19:29] <dasjoe> Kunzem1987: googling for ".tar.bz2.aa" gives various results about how "split" can be used to split a .tar.bz2 stream into multiple files. If you checked your files with par2 (which you said you did) you can simply extract the .tar.bz2.[...] files with something like: cat file.tar.bz2.* | tar xjvf -
[19:50] <hallyn> zul: filed bug 1367422
[19:57] <hallyn> ok, with that i consider myself done with that and am moving on to qemu for real
[19:57] <hallyn> (though i'd sort of like to get apparmor-confined containers working...)
[20:00] <zul> ciik
[21:12] <Valarkin> Hello. Noob seeking assistance enabling password protection on a web servable dir
[21:12] <Valarkin> 10.04
[21:12] <Valarkin> oops
[21:12] <Valarkin> 14.04
[22:50] <SP33D> oh holly ubuntu gods
[22:50] <SP33D> plz tell me is that a current bug in trusty with apt-show-versions ?
[22:50] <SP33D> https://www.irccloud.com/pastebin/4rrfBiaK
[22:53] <SP33D> Valarkin password on web server is a web server related question
[22:54] <SP33D> you should ask it the person from that you run the webserver if its apache you can go to #httpd