[06:20] Good morning === elsheepo is now known as beatzz === JanC_ is now known as JanC [07:29] morning [07:37] is somebody willing to work with me to get old kernels automatically removed? [07:38] i have an old system where this isnt working [07:38] i worked with tomreyn and rbasak yesterday on this: removed most of the old kernels manually [09:06] Greetings all [09:06] Was wondering if someone could help me with a tiny problem. I noticed today that php curl was no longer functioning.. I checked it out and saw that I can't install curl at all: "php7.2-curl : Depends: libcurl4 (>= 7.44.0) but it is not going to be installed" --> But if I install libcurl4, it'll erase my mongodb 4.x server installation. [09:07] Any suggestions? [09:24] friendlyguy: i could help there if you like? if so, post the http address returned by 'dpkg -l | grep ^....linux | nc termbin.com 9999' to get started. [09:36] morning! [09:36] cool, sure [09:37] but i guess ill need to open that port first [09:38] gimme a sec [09:40] https://termbin.com/j4j7 [09:40] opening that port did help :) [09:44] friendlyguy: welcome back. be sure to type "tomreyn" here to raise my attention. what does "uname -r" say is the kernel version currently running? [09:54] tomreyn: its 4.4.0-154-generic [09:56] friendlyguy: sudo /bin/true && ( sudo apt-get update && sudo apt-mark auto linux-image-4.4.0-154-generic linux-headers-4.4.0-154-generic && sudo apt-get install linux-generic ) > /tmp/tomreyn && cat /tmp/tomreyn | nc termbin.com 9999 [09:56] please pass the url and tell me if it prints anything on screen other than the url, too. [09:59] https://termbin.com/95ei [09:59] no errors were shown [10:06] friendlyguy: please keep highlighting me (putting my name in front of what you say). the output looks fine (despite it being in german, but then i personally understand that; you could run "export LANG=C" to get output in english). now: sudo apt-mark manual linux-generic [10:07] tomreyn: thats done [10:07] "has already been marked manual..." [10:11] friendlyguy: sudo apt-mark auto '^linux-(image(-extra)?|(cloud-)?tools|headers)-4.*' | grep -v 'not installed.' | nc termbin.com 9999 [10:16] tomreyn: https://termbin.com/reu6 [10:17] oh, damn. i should have changed "not installed." to its german equivalent [10:17] sorry [10:18] friendlyguy: just run export LANG=C - it will only last for this ssh session [10:18] i created a new one: https://termbin.com/a02g [10:19] did the export also now [10:20] friendlyguy: and no worries. ;) as a reminder, this tells you what your currently running kernel is: uname -r run it to remind yourself. then: sudo apt-get update && sudo apt --purge autoremove and make sure you read the list of software it wants to uninstall. it should not include the currently running kernel. if it does, cancel removal. [10:21] tomreyn: it does not want to uninstall anything [10:21] okay, that's fine, too [10:22] friendlyguy: now: nc termbin.com 9999 < /etc/apt/apt.conf.d/01autoremove-kernels [10:23] tomreyn: https://termbin.com/4k7l [10:29] friendlyguy: hmm this linux-image-extra-4.4.0-142-generic package is not in a good state. let's try to fix this: sudo apt purge linux-image-extra-4.4.0-142-generic and post the output to https://paste.ubuntu.com [10:31] tomreyn: how do you know? i couldn`t see that its in a bad state [10:36] friendlyguy: on what you just posted, there was this line: pH linux-image-extra-4.4.0-142-generic 4.4.0-142.168 amd64 Linux kernel extra modules for version 4.4.0 on 64 bit x86 SMP [10:36] you can produce this line using this command: dpkg -l linux-image-extra-4.4.0-142-generic [10:37] pkg-query: no packages found matching linux-image-extra-4.4.0-142-generic [10:37] tomreyn: thats interesting [10:38] the 'pH' it starts with says this package is in a state where it is to be (p)urged but it is also (H)alf-installed. the p isn't an issue but the H should not be there. [10:38] you could read up on this after installing the manuals [10:38] !man [10:38] The "man" command brings up the Linux manual pages for the command you're interested in. Try "man intro" at the command line, or see https://help.ubuntu.com/community/UsingTheTerminal | Manpages online: http://manpages.ubuntu.com/ [10:38] and running: man dpkg-query [10:39] (to quit this viewer when you finished reading, press 'q') [10:39] tomreyn: Package 'linux-image-extra-4.4.0-142-generic' is not installed, so not removed [10:39] i wonder which output you are looking at? [10:40] right, i'm puzzled as to why it's saying this now. [10:40] i'm looking at https://termbin.com/4k7l [10:40] maybe dpkg -l | grep ^.H will produce this output [10:42] tomreyn: nope [10:42] didnt return anything [10:42] ok, another explanation is that this package was only in this state at the time because it was just being worked on by an automatic background process at the time [10:43] so since it's just uninstalled now we don't need to worry about it [10:43] is rebooting this system an option currently? [10:43] (don't do it, yet) [10:43] friendlyguy: ^ [10:45] yes, sure [10:45] no problem [10:45] tomreyn: i can reboot it anytime [10:47] friendlyguy: okay, let's make sure all the latest software is installed: sudo apt full-upgrade [10:47] tomreyn: it is [10:48] hmm weird, i have a newer kernel version installed. can i see dpkg -l | grep ^....linux | nc termbin.com 9999 again? [10:49] tomreyn: sure, https://termbin.com/bagv [10:50] oh, my bad, i have an extra repository enabled which provides newer versions which are still undergoing testing. [10:50] ah, alright. thats clear then :) [10:51] okay, so just reboot, and then run sudo apt update && sudo apt --purge autoremove and tell me whether it wants to remove anything [10:52] or rather if it wants to remove anything there, please show the full output on the pastebin. [10:56] tomreyn: nothing [10:59] friendlyguy: okay, then run this to hopefully remove the outdated packages: sudo apt purge '^linux-(cloud-tools|headers|image|image-extra|tools)-4\.4\.0-1[0-4][0-9](-generic)?$' [10:59] friendlyguy: if it prompts, don't confirm, yet [10:59] just show the output [10:59] friendlyguy: oh and please also show uname -r once more [11:10] friendlyguy: got busy? [11:37] friendlyguy: i'm gone for ~ 1 hour. in case you'll return in the meantime, make sure no package containing your current kernel version (as reported by "uname -r") is listed by the "apt purge ..." command. if so, confirm it. that should be all that's left to be done. [11:49] tomreyn: you don't know about pastebinit? [11:49] It's a package ;) [11:50] tomreyn: ah, sorry. went for lunch [12:11] tomreyn: https://paste.ubuntu.com/p/2G9vyB9JVP/ [12:17] rbasak: i know ;) but it's not installed by default, and throws warnings which irritate people on 19.04. thanks for the hint, though. [12:18] friendlyguy: welcome back. you can confirm this prompt. [12:18] https://bugs.launchpad.net/ubuntu/+source/pastebinit/+bug/1812232 [12:18] Launchpad bug 1812232 in pastebinit (Ubuntu Eoan) "Deprecation warnings" [Medium,Fix released] [12:18] Disco isn't really Won't FIx - it just needs someone to drive it. [12:27] i agree. :) [12:28] tomreyn: i am done with that, all removed [12:32] friendlyguy: okay, then we're done. you could duble check that there are no old leftover files in /usr/src/ and /boot/ if you like. i expect that older kernels will be automatically marked for removal from now on. if you like to, review the comands we ran and ask about them if you have any questions. [12:34] i understood the commands, but i didnt get the "big picture" totally i think [12:35] we basically removed old kernels, and made sure the current kernel is flagged as automatic, ist this correct? [12:35] friendlyguy: yes, that's really all we did i think [12:36] can you guess what i screwed up to get in this situation? [12:38] friendlyguy: flagging those versioned kernel images as automatic, and, moreover, making sure the non versioned 'tracking' packages (linux-generic, linux-image-generic) are installed should make the automatism defined in /etc/apt/apt.conf.d/01autoremove-kernels work so that older kernel packages will get flagged to be removed by apt autoremove [12:40] this is a not only an issue on your very system but was a more common issue on 14.04 and earlier (but not on 18.04, and i think not on 16.04 fresh installations - so unless it was upgraded to). [12:42] friendlyguy: so i assume you upgraded this system from an earlier release at some point. but i may also be wrong in that it did actually still happen on earlier 16.04 point releases. [12:42] yeah, the vm is about 10 years old [12:42] i run a bunch of websites on it [12:42] nothing critical [12:43] oh, so it went thruogh several upgrades. then i recommend you run https://github.com/tomreyn/scripts#foreign_packages [12:43] also deborphan [12:46] tomreyn: ill do that, thanks [12:46] i was thinking about to do another release upgrade [12:47] 16.04 to 18.04 [12:49] friendlyguy: you'd get TLS1.3, which is nice - faster web browsing on sites you host. [12:50] !releasenotes [12:50] For release notes of a given Ubuntu release, please refer to the 'Docs' column on the 'List of releases' table at https://wiki.ubuntu.com/Releases [13:26] tomreyn: thanks a lot for you help again! [13:27] you're welcome, friendlyguy [16:34] I have a webserver that is accessed by some finnish people that use the ä letter (hex e4) is some filenames that are uploaded to the server [16:35] when I look in the folder I see $344 instead of the letter [16:35] and most importantly I have problems backing up the folders using rsync to a smb mounted NTFS filesystem, it gives an error [16:36] why is this happening? using find, printf and xxd to see the hex values in the filenames it gives the correct hex value [16:37] so my system (ubuntu 18.04 on ext4) is not displaying the character correctly [16:38] and then rsync, smb, or something else in the stack is crapping out moving those files to the smb mount [16:38] Everything needs to be set up to use the same encoding, or be able to determine the encoding correctly [16:38] That includes your locale, etc. [16:40] locale is en_US.UTF-8 [16:41] interesting, if I do a "touch täst" on the server, and check the hex value of ä I get a different value [16:42] if I type it I get hex value c3, but in the filenames its e4 [16:47] it's probably russian cyber-terrorists trying to get in :D [16:47] hehe :-) [16:48] nah, finnish environmentalists ... even worse ;-) [16:52] 0xc3 would by Ã [16:52] in en_US.UTF-8? [16:52] yes. echo -e '\uc3 \ue4' [16:54] even more interesting, I created an empty file with ä (not Ä) in the name, ran it through find . -maxdepth 1 -type f -exec sh -c 'printf "%-10s %s\n" "$1" "$(printf "$1" | xxd -pu )"' None {} \; and that shows 0xc3 for ä [17:01] hmmm ... a bit more convoluted, ./täst gives me 2e2f74c3a47374 ... so its c3a4 that represents the ä [17:04] AKA "LATIN SMALL LETTER A WITH DIAERESIS" [17:04] never got used to the names of all those commas and umlauts over letters [17:08] could be the difference is since I have an icelandic keyboard layout and need to press two keys (one dead key) to get the ä [17:08] it's the (web searchable) description of this character from the unicode standard [17:10] http://www.ltg.ed.ac.uk/~richard/utf-8.cgi?input=%C3%A4&mode=char [17:10] c3a4 is the utf-8 computer encoding, e4 is the iso-8859 encoding (according to https://en.wikipedia.org/wiki/%C3%84) [17:11] so if you see Ã somewhere then it's due to LATIN-1 (i.e. non utf-8) encoding [17:11] meaning you have a character conversion to non utf-8 in place, which is your 'bottleneck' there. [17:11] well, not conversion, lack of conversion really [17:13] yeah, seems that when the files where uploaded to the server the filenames got stored as iso-8859 but now the system is in utf-8 mode and then it doesn't know what to do with the character [17:28] ubuntuserver.wordpress.com deleted? [18:09] jamespage: python3-ceilometerclient BDs have been removed except for vitrage: https://storyboard.openstack.org/#!/story/2006269 [18:10] jamespage: mistral's dependency on python-glareclient may be difficult since glare is at least somewhat maintained still [18:17] coreycb: thanks [18:17] * jamespage ponders glareclient [18:17] I guess we can leave the client package in place for the time being... [18:18] jamespage: alright i'll take a look at updating glare packages to py3 only === Wryhder is now known as Lucas_Gray