lordievaderGood morning06:37
=== Guest99098 is now known as lordievader
coreycbicey: there's a mysql8 + alembic issue with barbican we'll need to look into: https://bugs.launchpad.net/ubuntu/+source/barbican/+bug/189910413:36
ubottuLaunchpad bug 1899104 in barbican (Ubuntu) "barbican-manage db upgrade fails with MySQL8" [Undecided,New]13:36
iceyI saw that come in this morning13:37
* RoyK wonders why people use mysql these days13:39
coreycbicey: it looks like that may be fixed upstream https://storyboard.openstack.org/#!/story/200773213:46
coreycbicey: since you worked on that for groovy do you want to make sure it's fixed in groovy and handle the SRU to focal?13:46
nopnotmeI have an issue when running any *apt* commands. I was originally trying to install nodejs on a Ubuntu 16.04 server that I only use via ssh, however I am getting an error using apt now regarding grub-common versions: https://pastebin.com/UwFi9fdF16:44
tewardnopnotme: is this on an Amazon EC2 instance?17:09
tewardi only asked because the package that's installed (grub-legacy-ec2) is for EC2 instances17:11
nopnotmewhat it be in my interest to purge it?17:13
nopnotmeeven after purging i get the same error17:20
mgedminby "it" do you mean grub-legacy-ec2 or grub2-common?17:26
pgndRunning regular maintenance today on an otherwise stable Ubu bionic server, 'apt update' FAILs with: "UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc9 in position 4: invalid continuation byteError in sys.excepthook:"17:27
pgnddetail -> https://pastebin.com/raw/PVegTn9217:27
pgndWhat do we to workaround/fix that^ in the context of apt updates?17:27
pgnds/we to/we do in order to/17:29
mgedminnopnotme: how can you have a conflict with grub-legacy-ec2 if grub-legacy-ec2 is no longer installed?  pastebin the full error please17:41
mgedminpgnd: I would first report a bug (ubuntu-bug command-not-found)17:46
mgedminpgnd: hmm, what happens if you run `python3 -c 'import apt_pkg'` on that server?17:47
mgedminmaybe this needs to be investigated a bit to rule out local damange before assuming it's a bug17:47
pgndmgedmin: hi.  -> https://pastebin.com/raw/pddKjvbc17:49
pgndsomething's clearly not happy ...17:50
mgedminpgnd: very interesting, I've never seen it before17:50
mgedminpgnd: what's the output of `locale charmap`?17:51
pgndmgedmin: "UTF-8"17:51
mgedminI'd next try `LC_ALL=C python3 -c 'import apt_pkg'` and `LC_ALL=C.UTF-8 python3 -c 'import apk_pkg'`, to see if the locale has anything to do with it17:52
mgedminnext idea: do you have debsums installed?  check with `debsums python3-apt` if the package got corrupted somehow?17:53
pgndmgedmin: -> https://pastebin.com/raw/zF7rFkKm17:55
mgedminwell now!17:56
mgedmin /usr/lib/python3/dist-packages/apt_pkg.cpython-36m-x86_64-linux-gnu.so    FAILED17:56
mgedminmake a copy of that file, then apt install --reinstall python3-apt17:56
mgedminwhen apt is done you may want to cmp the file with the bad copy17:56
mgedminsee if maybe it differs in one bit only?  could indicate hardware problems17:56
* mgedmin can stop browsing https://bugs.launchpad.net/ubuntu/+source/python-apt for similar problems17:57
mgedminI would probably run memtest86 and/or hard disk SMART self-tests with smartctl from smartmontools17:58
pgndmgedmin: the reinstall did the trick. thx!17:58
pgndcmp returns:17:58
pgndsmart tests run nightly.  all's good ... will rerun here shortly, just in case17:59
mgedmincmp returns no output?17:59
pgndhuh?  oh ... ry leading  "/"  :-(18:00
pgnd-> /usr/lib/python3/dist-packages/apt_pkg.cpython-36m-x86_64-linux-gnu.so /usr/lib/python3/dist-packages/apt_pkg.cpython-36m-x86_64-linux-gnu.so.ORIG differ: byte 258055, line 82318:00
mgedminah, cmp -l will show the values of the differing bytes, and won't stop at the first difference18:01
pgndmgedmin: https://pastebin.com/jZCM7dUX (somebody, aka 'me', needs to read up on cmp!)18:03
pgndmgedmin: in any case, mny thx!18:06
mgedminwell that's a lot18:09
mgedmincmp -l -p will also show ascii values, not sure if that's going to be helpful18:09
mgedminconverting file offsets from decimal to hex shows the differences are in the range of 0x3f007 to 0x3ffff18:10
mgedminthat upper value is very precisely aligned18:10
mgedminit's one corrupted 4K block18:11
mgedminexactly one memory page18:11
mgedminoh!  pgnd: in your place I'd run `debsums -c`, to check _all_ installed packages for corruption18:12
pgndmgedmin: good point!  doing that now18:13
pgndmgedmin: only one, "debsums: Error: symlink loop detected in path 'usr/share/doc/module-init-tools/changelog.Debian.gz'. Please file a bug again module-init-tools."18:17
mgedminhuh, on my bionic server /usr/share/doc/module-init-tools/changelog.Debian.gz is a regular file and not a symlink18:18
mgedminand no component in that path is a symlink18:19
pgndre-run of smart tests ... all good here18:19
mgedminmemtest time18:19
mgedminoh, one more trick18:19
mgedminyou can ask the kernel to drop the page caches, then compare the two files again18:19
mgedminthey'll be read from disk afresh18:19
mgedminif they're identical, then you definitely have a memory problem18:20
pgndmgedmin: this server has been upgraded since forever ... not a clean install.  i've seen similar links vs files issues, elsewhere, in the past18:20
mgedminif they're still different, the wrong block got written out18:20
mgedminyou drop caches by doing echo 3 |sudo tee /proc/sys/vm/drop_caches18:20
mgedminthe server will be slow for a few minutes after that, while it reads everything back from disk18:20
pgndmgedmin: re-cmp'd after the drop cache. similarly long output ...18:21
pgndgood news is, currently no more apt* problems that I can see.18:23
pgndneed to find Memtest86+ equivalent for UEFI: "Memtest86+ only works on systems with BIOS firmware. Support for UEFI systems is currently unavailable."18:34
mgedminthere's also apt install memtester18:36
mgedminit runs inside linux, so it can't test _all_ memory, only the parts that are not in use18:36
mgedminbut it's better than nothing18:36
ueberallpgnd: What about https://www.memtest86.com/ ?18:40
pgndueberall: Didn't realize there was a different creature ... had just checked the pkg repos, which offer memtest86+ & memtester. thx, will take a look.18:42
=== genii is now known as genii-o-lantern
=== genii-o-lantern is now known as genii
=== arooni_team_b is now known as arooni

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!