[08:13] <lordievader> Good morning
[09:22] <Onepamopa> question - /proc/sys/kernel/core_pattern is set to /tmp/core.%e.%p.%t, * soft core 500000 & root hard core 1000000 in limits.conf, the application segfaults and no corefile is found anywhere
[09:22] <Onepamopa> ubuntu server 16.04 x64
[09:23] <Onepamopa> so, how do I go about enabling core dump files ?
[10:04] <Genk1> Hello all
[10:04] <Genk1>  what is the fast  way to backup/recover a mysql database using MyISAM engine ?
[10:04] <Genk1> I've found mysqldump to be very slow
[10:04] <ddellav> with myisam thats kinda all you go
[10:04] <ddellav> *got
[10:05] <ddellav> with innodb you can do incremental backups but myisam is not transactional so your only choice is a full table dump
[10:06] <Genk1> ddellav, I see thanks for your your answer
[10:07] <ddellav> you're welcome Genk1
[11:31] <JanC> also depends on database size how fast it is of course...
[12:34] <patdk-lap> and what filesystem your using
[12:35] <patdk-lap> personally, I had always used lvm snapshots to backup mysql myisam
[12:35] <patdk-lap> but it has been awhile, and use innodb for just about everything now
[12:51] <Walex> patdk-lap: even LVM2 snapshots are not that good for consistent MyISAM state, but they usually work.
[12:52] <Walex> Genk1: you should really ask in #MySQL or #MariaDB for faster alternatives to 'mysqldump'. But that's really the right way to do it. If it is slow that may mean that your MyISAM files need compacting
[12:53] <blackflow> depends on the definition of "slow" and considering database size
[12:54] <blackflow> meanwhile, like Walex said, using fs snapshots to back up the database is illadvised as the database has its own regime of syncing states with the underlying fs, so you might be snapshotting incomplete states.
[12:55] <blackflow> postgres has the ability to do WAL archiving. I don't know if that's possible with MySQL. Also, consider using real time replication for backup.
[12:55] <maswan> eh, if it is an atomic snapshot, it is no more unsafe than handling an unscheduled power loss
[12:56] <blackflow> correct, but "unschedules power loss" is not a "consistent backup state" that you want your data BACK UP to be in :)
[12:56] <blackflow> *d
[12:57] <blackflow> and iirc, "unscheduled power loss" with MyISAM tables leads to "lots of corruption and pain". :)
[12:57] <maswan> well, then i'd certainly not use that for any data i'd like to keep. :)
[12:58] <blackflow> if dumps are inadequate, replication is really the best, consistent form of back up.
[13:00] <maswan> dumps were hard for us, so we setup replication, then tuned that to the point that we could get dumps made on the replica so we had both
[13:36] <patdk-wk> hmm, the database doesn't have it's own syning time, that is what a flush command is for
[13:36] <patdk-wk> now if the filesystem supports flushing also, would be requred for lvm snapshot to work
[13:36] <patdk-wk> but if every level is flushed, it's a perfect usable method
[13:37] <patdk-wk> though personally, using a mysql slave database, and doing your backups on there, is better, if your concerned about downtime
[13:48] <JanC> depending on the dependencies, you could possibly dump some tables separately too...
[13:56] <blackflow> patdk-wk: the files are mmaped and there's no guarantee that at every given moment, data in files represents 100% the in-memory state.
[14:01] <patdk-wk> blackflow, did the default change? it was not using mmap by default normally
[14:44] <blackflow> patdk-wk: afaik it mmaps since 5.1. but now that you mention it, I could be wrong, yes.
[14:45] <patdk-wk> I see support for mmap in 5.1
[14:45] <patdk-wk> but it is not enabled, except for packed myisam files, and those are read-only
[17:04] <erick3k> hi
[17:04] <erick3k> can someone help me with a routing problem?
[17:07] <erick3k> anyone in here?
[17:07] <Pici> kinda
[17:07] <erick3k> haha
[17:08] <erick3k> is there a way to force a different subnet gateway to work instead of using the route command or post up?
[17:12] <erick3k> anyone
[17:12] <erick3k> ?
[17:12] <jelly> what's a subnet gateway?
[17:14] <jelly> show an example.  Explain what it's doing, what the actual results are, what you'd want it to do instead
[17:15] <jelly> eg. pastebin current outputs of "ip a" and "ip r" and your network config (/etc/network/interfaces, or whatever else you use)
[17:15] <maxb> Also, don't say "instead of using (some perfectly reasonable options)" without explaining why you propose not to use them
[17:17] <erick3k> well am going to try
[17:17] <erick3k> the ip and gateway are on different subnet
[17:18] <erick3k> so if i put gateway on the /etc/network/interfaces it can not be bring up
[17:18] <erick3k> now if i remove it and add route add default gw (gw ip)
[17:18] <erick3k> as a command it works
[17:19] <erick3k> now i have to through cloud-init add default gateway to the /etc/network/interfaces due to automation
[17:20] <erick3k> so basically a fix could be adding a command before the network starts to delete the line gateway xxx.xxx.xxx.xxx from /etc/network/interfaces before bringing it up on boot
[17:21] <maxb> This sounds a bit scary and broken
[17:21] <erick3k> i know
[17:22] <erick3k> thats why am trying to find a better solution
[17:22] <erick3k> since ubuntu doesnt allow a different subnet gateway on /etc/network/interfaces
[17:23] <maxb> I think you will need to paste the output of "ip route" if we are to have any hope of understanding your network setup
[17:23] <erick3k> ok am gonna show with pics
[17:27] <erick3k> maxb here is not working
[17:27] <erick3k> https://i.imgur.com/z91hKJR.png
[17:29] <erick3k> hold on
[17:30] <maxb> This is not a sensible configuration
[17:31] <maxb> You can't use an address outside the subnet as a default gateway unless there's some other special routing going on
[17:37] <robert45> hi guys, after a dist-upgrade process my server is unbootable, Im getting this on the screen, any advice? http://imgur.com/a/l1hvV
[17:38] <tomreyn> robert45: press enter and examine?
[17:39] <tomreyn> for a (n entirely blind) guess: zfs related
[17:40] <robert45> tomreyn I appreciate the quick reply, Im now inside the shell. I did a service networking status and this is what I get, ifconfig shows correct network setup: http://imgur.com/a/bY7yz
[17:41] <tomreyn> robert45: you should start examingn the cause of the first error, not the last
[17:43] <tomreyn> robert45: on the screen shot you posted, the first error (which has not scroll off screen, i.e. there may have been others before this one) is about systems-tmpfiles-setup.service
[17:43] <tomreyn> the temporary / volatile file storage service did not start up properly.
[17:44] <tomreyn> it is suggested that you should run "systemctl status systems-tmpfiles-setup.service" to examine this issue.
[17:44] <tomreyn> note how the message right before this is about starting ZFS support via FUSE
[17:45] <robert45> tomreyn tx, Im running that command now
[17:46] <tomreyn> also note that ZFS-fuse is considered deprecated
[17:47] <tomreyn> use the native module instead
[17:49] <Curiontice> Hi! I want to cache HTTPS site contents such as Facebook Images and etc. I have added the following https_port 3126 tproxy ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB cert=/etc/squid3/lib/ssl_db/certs/myCA.pem connection-auth=off. This gives me errors. Is squid can not be run this way?
[17:49] <Curiontice> Please if anyone know the answer, PM me.
[17:52] <tomreyn> you might want to discuss the errors you get there.
[17:53] <MASM> in logs?
[17:53] <Curiontice> It just crashes. Segfault at xx.xx.xx
[17:54] <Curiontice> Can squid be run with Tproxy target for HTTPS traffic?
[17:54] <Curiontice> \
[17:54] <Curiontice> Can you pls confim me that ^
[17:54]  * tomreyn lacks Squid experience, can't tell
[17:54] <Curiontice> MASM: Can squid be run with Tproxy target for HTTPS traffic?
[17:56] <tomreyn> All I can tell is that caching SSL content contradicts with the idea of end-to-end encryption, it is only possible by creating a man-in-the-middle. Some companies and ... ISPs in some countries ... still do it anyways.
[17:57] <MASM> i don't know men, sorry...
[17:59] <tomreyn> http://wiki.squid-cache.org/Features/HTTPS
[17:59] <tomreyn> i assume "tproxy" stands for 'transparent proxy'.
[18:03] <robert45> tomreyn sorry I had some troubles with the systemctl command, this is what I get: http://imgur.com/a/x7p6l
[18:04] <robert45> I assume its because the filesystem is mounted as readonly
[18:05] <tomreyn> robert45: same here
[18:05] <robert45> Im rebooting it again to see if get why its not mounting properly
[18:05] <tomreyn> robert45: i would check syslog, go back to when you booted, then look through those lines until you hit the first error.
[18:06] <tomreyn> or start with "dmesg -T | less" - sometimes this is faster
[18:07] <robert45> tomreyn tx, doing that now
[18:07] <tomreyn> one (of many) possible explanation might be file system corruption on /etc or / (i do not know your partitioning scheme)
[18:08] <robert45> tomreyn ugh! I hope not, its a production server :(
[18:09] <robert45> tomreyn ok I caught the first error, I dont think it could be related, do you? http://imgur.com/a/p0OXS
[18:09] <tomreyn> apparmor failing could be related, yes
[18:10] <robert45> tomreyn well, its the same error, systemctl shows a read-only filesystem
[18:10] <tomreyn> you surely have current backups, and if it's an important system you surely considered a HA configuration?
[18:10] <robert45> when systemctl apparmor thing
[18:11] <tomreyn> so check dmesg + syslog, find out why it's r/o
[18:31] <robert45> tomreyn tx, I was able to bring it online, few service still failing though
[18:34] <robert45> tomreyn for some reason its mounting /dev/sda1 as ro, but if I use mount -o remount,tw it mounts it ok, any ideas?
[18:36] <robert45> tomreyn nevermind, I was able to fix it, it was all fstab related
[18:36] <robert45> its showing 16.04 instead of 16.10, not sure it didnt upgrade all the way through
[18:38] <tomreyn> robert45: so you upgraded from 16.04 to 16.10 recently, or tried to? appartenly it didn't happen if lsb_release -sd still shows 16.04
[18:39] <robert45> tomreyn I upgraded from 14.04, it shows 16.04 now
[18:39] <robert45> first time
 its showing 16.04 instead of 16.10, not sure it didnt upgrade all the way through
[18:39] <tomreyn> this is contradictionary
[18:40] <robert45> tomreyn not sure if I understood. I was looking to upgrade to 16.10
[18:40] <robert45> tomreyn so I upgraded from 14.04, do I need to run another upgrade?
[18:40] <tomreyn> either you last upgraded from 14.04 to 16.04, or from 16.04 to 16.10
[18:41] <tomreyn> only one of them can be correct
[18:41] <robert45> tomreyn I upgraded from 14.04 to 16.04
[18:41] <robert45> Im looking to upgrade to the latest version 16.10, is it possible?
[18:42] <tomreyn> yes, personally i prefer to run LTS releases on servers, whoever, do not like to have to upgrade every 6 months
[18:42] <tomreyn> s/whoever/however/
[18:42] <tomreyn> also LTS releases tend to be a lot more stable
[18:43] <robert45> tomreyn I see. I ran do-release-upgrade and got "No new release found"
[18:43] <robert45> tomreyn oh I just noticed 16.10 its not a LTS release
[18:44] <robert45> tomreyn so you dont recommend to upgrade from LTS to latest non LTS ?
[18:44] <tomreyn> correct, 16.10 is not LTS. and personally i prefer to only run LTS on servers. in even more so in your case. ;)
[18:44] <tomreyn> correct, 16.10 is not LTS. and personally i prefer to only run LTS on servers. and even more so in your case. ;)
[18:44] <tomreyn> ^typo fixed
[18:45] <tomreyn> first of all, i would suggest you ensure your previous upgrade succeeded, and the system is in a good condition.
[18:46] <tomreyn> !lts | robert45
[18:46] <robert45> tomreyn yes I think I wont upgrade it, Im scary to suffer any other downtime like this one
[18:46] <robert45> tomreyn understood, so far everything looks good! :)
[18:47] <patdk-lp> also be very sure of the non-lts support lifetime
[18:48] <patdk-lp> it used to be 18months, but now is like 9 I think, or maybe 6
[18:48] <tomreyn> and system upgrades mean downtime
[18:49] <tomreyn> robert45: if you like i can check your output of "apt-get update", "apt-cache policy", "apt-get -V -f install", "apt-get -V -y --simulate dist-upgrade" later.
[18:49] <patdk-lp> or worse, a broken package during upgrade
[18:49] <tomreyn> robert45: .. post them to a pastebin if so, e.g. using !pastebinit
[18:49] <tomreyn> !pastebinit | robert45
[18:50]  * tomreyn taking a shower now
[18:50] <robert45> sure, running those now
[18:53] <robert45> tomreyn patdk-lap looks like some errors indeed: http://paste.ubuntu.com/23701740/
[18:53] <robert45> how should I proceed?
[18:56] <erick3k> how can i run post-up command outside of /etc/network/interfaces?
[18:58] <andol> erick3k: cut-n-paste to the shell?
[18:59] <erick3k> andol i meant to run on startup outside interfaces,
[18:59] <erick3k> in shell says command not found
[19:01] <MASM> erick3k maybe put link in bin path
[19:03] <MASM> erick3k, maybe create a shortcuts in local/bin
[19:04] <erick3k> MASM can you link me to an example and a little newbie
[19:05] <MASM> erick3k,  shortcuts : http://unix.stackexchange.com/questions/226315/how-to-use-ln-s-to-create-a-command-line-shortcut
[19:05] <MASM> erick3k, program executable everywhere : http://unix.stackexchange.com/questions/3809/how-can-i-make-a-program-executable-from-everywhere
[19:06] <erick3k> MASM am not sure that would work i want  post-up route add xxx.xxx.xxx.xxx dev eth0 to run outside /etc/network/interfaces file
[19:07] <erick3k> just that command
[19:07] <erick3k> because /interfaces will be modified by cloud-init
[19:08] <maxb> If cloud-init is incorrectly changing your config, then fix that, rather than trying to paper over it elsewhere
[19:09] <erick3k> huh if i knew how
[19:09] <erick3k> i would
[19:09] <erick3k> is it possible to run that command outside interface or not?
[19:10] <erick3k> like on centos
[19:10] <erick3k> you just add route-eth0 file
[19:17] <maxb> Ubuntu's network configuration chooses to give you one readable file rather than littering bits and pieces across multiple files like CentOS
[19:20] <tomreyn> robert45: i don't see errors there. I see a notice, "N: Ignoring file '50unattended-upgrades.ucf-dist' in directory '/etc/apt/apt.conf.d/' as it has an invalid filename extension", and i see a lot of no longer needed (due to changed dependencies) packages which can likely be removed (using apt-get --purge autoremove)
[19:21] <erick3k> maxb so only solution is to have a custom script or have cloud-init run it?
[19:21] <robert45> tomreyn ok do you recommend to --purge autoremove or should I kept those for just inc ase?
[19:21] <maxb> yes
[19:22] <maxb> If you're using cloud-init to configure your networking, it needs to do it *right*
[19:23] <maxb> If it isn't, you need to work on addressing that
[19:24] <tomreyn> robert45: yes maybe dont purge immediately
[19:24] <tomreyn> there's zfs-fuse in there
[19:24] <erick3k> got it, maxb what about if i make a file executable here /etc/network/if-up/ with that command?
[19:25] <erick3k> would that work?
[19:40] <robert45> tomreyn sorry got dc'ed, thanks so much for your help, wish you a happy new year!
[22:15] <erick3k> maxb you still here?
[22:16] <erick3k> remember about the network?
[22:16] <erick3k> found a solution :)