[04:24] good morning to all [06:10] Good morning [06:24] good morning === tomreyn_ is now known as tomreyn [09:12] Hello! [10:55] Howdy al [10:56] err, Howdy all [11:17] hi [11:36] http://www.phoronix.com/scan.php?page=news_item&px=PHP-7.3-Ubuntu-19.10 [13:16] Brr php [13:19] Hello BluesKaj and everyone! [13:20] I am editing video, sorry for not being active [13:54] hi kenperkins [13:54] some commentary in the news today regarding DNS over HTTPS and how browers are going to enable this directly. Any discussion/issues that I can go read up on for native support for this at the OS level in ubuntu? [13:55] https://arstechnica.com/tech-policy/2019/09/isps-worry-a-new-chrome-feature-will-stop-them-from-spying-on-you/ [14:00] OS-level support would probably rely on systemd-resolved, which would need to add support for it first [14:00] https://github.com/systemd/systemd/issues/8639 [14:02] perfect! that's what I wanted to read up [14:04] now that i think about it tho, it doesn't really matter what my os supports, it's my local dns resolvers that need it [14:04] :( [14:08] Considering how firefox handles this case, that doesn't matter. [14:08] (per default it uses cloudflare) [14:09] i believe that can be shut off though [14:10] i guess tho, I don't want my apps making decisions on a per-app basis [14:10] I want it all done at the network level [14:10] correct [14:11] ars had an article about it a day or two ago, or zdnet, one of those [14:11] isn't that what I just linked above? [14:12] yes, sorry [14:13] like you, i use my pi hole and opendns for a backup per my vpn; i dont want an app resetting that [14:14] > i guess tho, I don't want my apps making decisions on a per-app basis [14:14] This is one of the arguments against DoH (and DoT for that matter). [14:14] yes [14:14] as I think about it, what I really want is DNS with encryption, I'm not sure I'm concerned with exactly how [14:15] It becomes even more fun when you consider that different resolvers may give different answers. [14:15] i thought about encryption and the only thing i could come with was a vpn [14:15] as soon as i saw comcast was doing injection of javascript in unencrypted http i switched my resolvers [14:15] The way chrome solved is much more acceptable. Check if your current resolver supports DoH, if so start using DoH with that resolver. (Might have been DoT, not really sure) [14:15] (probably 5 years ago+) [14:16] still tho, I don't want my browser deciding [14:16] chrome is bad though [14:16] i use chrome and ff [14:16] i use brave [14:17] ff for a backup [14:17] i just despise the UX in FF [14:19] switching gears; building a conatiner in docker atm from ubuntu:xenial, and it's taking _ages_ to get throug the apt-get update && apt-get install step. what could be going on? [14:20] How is the io-wait? [14:20] on the host or docker? [14:21] [14:21] With the old build process that would usually let it grind to a halt for me. [14:21] Host [14:21] do I need to install iotop or something? [14:21] kenperkins: `vmstat 1` [14:22] The `wa` column is your interest. [14:22] hovering between 35-90 [14:23] now up to 95-99 [14:23] ok, so i'm waiting a ton [14:23] next step to find out why? [14:24] Yeah, that is way to high. [14:24] iotop or htop can tell you that. [14:24] i mean this is a super hend end machine [14:24] high-end [14:25] You won't notice that if your cpu is busy waiting for IO all the time. [14:25] kenperkins, what drive is this writing to? Is it an SSD? [14:25] lordcirth: yes [14:26] Yeah, try iotop. [14:26] nothing in iotop with much more than ~0.5% io [14:26] well, apt installs do a lot of fsyncs(), you might want to try out libeatmydata? [14:26] (assuming docker builds don't do tricks that would break LD_PRELOAD) [14:26] mgedmin: sorry, I don't quite follow that [14:27] I was wonderin if https://github.com/stewartsmith/libeatmydata#libeatmydata could speed up your apt installs [14:29] ok, before I go do something like that, i'd like to narrow down what's going on first [14:29] i haven't had a literal line of progress in ~15m on my docker build [14:30] so in iotop, what should I be looking for [14:30] kenperkins, have you checked dmesg for errors? [14:31] Also, smartctl on your SSD [14:31] kenperkins: Top talkers, in terms of bandwith or iops. [14:33] almost no disk read/write going on [14:34] tbh I don't know what I'm looking for in dmesg, the rest of my system seems completely normal [14:35] kenperkins, well, mostly that it isn't spamming IO Errors [14:35] If you run 'dmesg -wT' are new entries being added? [14:35] this sounds dubious [14:36] [Mon Sep 30 01:22:01 2019] docker0: port 1(vethb83d919) entered blocking state [14:36] [Mon Sep 30 01:22:01 2019] docker0: port 1(vethb83d919) entered forwarding state [14:37] that's from a while ago, disregard [14:37] if there's no disk io, it might be waiting on the network [14:37] dstat is nicer than vmstat: it shows network as well as disk i/o [14:38] try making the docker build use your local ubuntu mirror instead of the main archive? [14:40] ok dstat shows 0 cpu wait and ~98 idle, vmstat 1 shows idle of 4 and wait of 95 [14:40] something doesn't make sense [14:42] mgedmin: I'm willing to try that, once I figure out why it's not doing seemingly *anything* [14:42] strace? [14:47] and it just finished [14:47] i did see this before it ended [14:47] https://gist.github.com/kenperkins/f8d9705516696760c925c040d764cfeb [14:47] doesn't really tell me anything [14:49] it's waiting on a mutex or some other synchronization primitive [14:51] yea but no insight into why I mean [14:53] I think I want to run it again to see [14:54] then be sure to strace all processes, not just the main one [14:54] (e.g. strace -f -o /tmp/trace.log docker build whatever) [14:54] (note that strace might slow things down considerably) [14:59] ok so I think this is the problem: > 0 upgraded, 403 newly installed, 0 to remove and 4 not upgraded. [14:59] maybe it was just slowly working through the install of 403 packages? (apt-get install was with -qqq) [15:00] @mgedmin > try making the docker build use your local ubuntu mirror instead of the main archive? can you expand or link me to something on that? [15:01] do you mean adding mirror://mirros.unbuntu.com stuff to my apt sources? [15:02] no, I mean using http://COUNTRYCODE.archive.ubuntu.com/ instead of http://archive.ubuntu.com/ in /etc/apt/sources.list inside the docker container before you do the apt update && apt install steps [15:03] I've never seen mirror:// before? does it autodetect the nearest mirror somehow? where is it documented? [15:03] apparently [15:03] > Using mirror protocol as part of your /etc/apt/sources.list entry will instruct apt command to fetch mirrors located within your country only. In order to use mirror protocol update all lines within /etc/apt/sources.list file from the usual eg.: [15:04] from https://linuxconfig.org/how-to-select-the-fastest-apt-mirror-on-ubuntu-linux [15:04] trying to find more official docuemtnation [15:05] I wish https://wiki.ubuntu.com/Mirrors mentioned this! [15:05] the ubuntu wiki feels abandoned at times [15:05] > feel free to join us at #ubuntu-mirrors on Freenode [15:05] brb :D [15:07] huh did you notice that the mirror:// option was the slowest in the "comparing results" section of that linuxconfig page? ;) [15:07] maybe it's not mentioned for a reason [15:07] haha [15:08] interesting that the us mirror was only 8 seconds slower than the au one, while the mirror protocol was 1.5 orders of magnitude slower [15:09] maybe it spent 4 minutes 40 seconds finding the fastest mirror and then 5 seconds downloading the things :) [15:10] opinion: apt install foo failing with 'package foo has no installation candidate' when you tried it in a live session (or a fresh docker container) with an empty /var/lib/apt/lists/ is bad ux === akem__ is now known as akem [20:29] if danielrc14 returns to #ubuntu, please point them to the bottom of https://irclogs.ubuntu.com/2019/10/02/%23ubuntu.html - thanks! [20:30] tomreyn: what should be at the bottom? right now it's lordcirth's unrelated comment.. [20:31] sarnold: my latest comment to them (not yet, but the log file should update soon) [20:31] tomreyn: okay cool :) [20:33] http://paste.debian.net/plain/1103810 [20:33] thanks, ttyl [20:34] tomreyn: nice, thanks, gnight :) [20:34] i'll have. :) [21:27] naughty /dev/urandom https://lwn.net/SubscriberLink/800509/c46eba62a7bda958/ [22:07] OerHeks: I was sort of expecting something like that to happen one day... [22:09] well.. wait [22:09] 2018 ? [22:09] https://www.phoronix.com/scan.php?page=news_item&px=Linux-4.18-Random-Boot-Fix [23:36] good morning [23:42] hi gry [23:44] 01:44 am .. making pancakes .. [23:45] NOOOO! i am not telling you i live on Jan van Zutphenstraat 310, Haarlem, Netherlands ... no way