/srv/irclogs.ubuntu.com/2018/10/25/#ubuntu-server.txt

masonping sbeattie - PM?00:06
masonunping00:39
=== a1berto_ is now known as a1berto
=== joakim_ is now known as joakim
ahasenackgood morning12:05
ahasenackkstenerud: try the server-next tag12:11
ahasenackkstenerud: https://bugs.launchpad.net/ubuntu/+bugs?field.tag=server-next12:11
ahasenackkstenerud: and bite-size12:11
ahasenackkstenerud: https://bugs.launchpad.net/ubuntu/+bugs?field.tag=bitesize12:11
ahasenacknot all are server, though, that query needs to be refined12:12
kstenerudok12:12
ahasenackuse advanced search12:12
ahasenackkstenerud: https://bugs.launchpad.net/ubuntu/+source/fetchmail/+bug/1798786 should not be fix committed12:17
ubottuLaunchpad bug 1798786 in fetchmail (Ubuntu) "can't retrieve gmail emails. fetchmail: OU=No SNI provided; please fix your client./CN=invalid2.invalid" [High,Fix committed]12:17
ahasenackkstenerud: I'm going to add a cosmic task, and we will leave the main task for tracking the progress in the development release of ubuntu once it opens12:18
ahasenackkstenerud: are other releases also affected?12:18
ahasenacklooks like bionic is, that's where the bug was reported12:19
kstenerudI think all previous versions will be affected12:20
kstenerudit wasn't filling out a name field, but server side wasn't checking either before12:20
ahasenackcan you check please and let me know? Then I can add or not more tasks if needed12:21
kstenerudok12:21
kstenerudahaseanck: trusty and xenial work fine12:26
ahasenackkstenerud: good, thanks for checking12:33
kstenerudahasenack: I'm still not clear on what fields are used when in the dep-3 header. They mostly seem to be duplicates of each other13:11
ahasenackkstenerud: yeah, there can be some confusion, and on top of that you will have reviewers with different opinions13:12
ahasenackkstenerud: I can see the intention of applied-upstream, but if the patch origin is upstream already, then it's redundant in my opinion.13:12
ahasenackkstenerud: if the patch is *not* from upstream, but applied upstream, then why wouldn't the origin not be upstream already? Maybe if they were different authors13:13
kstenerudWhat is the Origin field for? I see options for upstream, backport, vendor, other, but no description of what any of those mean13:14
ahasenackupstream is the software author13:15
ahasenacklike samba.org for samba packages, openldap.org for openldap, and so on13:15
ahasenackbackport is if you had to change the patch to fit the particular ubuntu package you are patching13:15
ahasenackand vendor is if it came from redhat, debian, suse, intel, etc. Not upstream, but other distributors of the software. I rarely use that one13:16
ahasenackbecause eventually it gets landed upstream13:16
ahasenacknote also that the presence of one field may make another one optional13:17
kstenerudSo origin will be one of those 4 words, a comma, and then a url?13:17
ahasenacklike author vs origin13:17
ahasenackyes, word, comma, url13:17
kstenerudWhat does it mean when a patch is forwarded?13:18
ahasenackif you created the fix, for example, if you forwarded it upstream or not13:18
ahasenacki.e., if you let upstream know about the fix13:18
ahasenacksometimes a fix only makes sense for ubuntu, for example, in which case Forwarded would be "not-needed" or "no"13:18
kstenerudso "forwarded" and "bug" serve the same purpose?13:19
ahasenackthere are many ways to forward a patch13:20
ahasenacksometimes upstream doesn't have a bugtracker, so you forward by email13:20
ahasenacklike via a mailing list13:20
kstenerudSo if you needed to send via email what do you put in?13:22
rbasakIf you got the patch from upstream, then I think just "Origin: upstream, ..." is sufficient.13:22
rbasakForwarded is useful for if you wrote the patch and sent it somewhere but hasn't been upstreamed (or if a contributor wrote the patch and the same applies)13:23
ahasenackkstenerud: I had to do that once, and it wasn't clear either since it's so rare. I think I just put the words "Emailed Foo Bar <foobar>"13:23
rbasak(plus Bug, Bug-*, Last-Update, etc)13:23
kstenerudrbasak: So Forwarded has allowed values URL or no13:24
kstenerudor not-needed13:24
ahasenackForwarded: <URL|no|not-needed, useless if you have a Bug field, optional>13:24
ahasenackit helps to have a saved-up dep3 template13:24
kstenerudyes I'm looking at the template13:24
ahasenackso it says URL in there :)13:25
ahasenackah, you were making a statement, not a question13:25
ahasenackn/m13:25
kstenerudYes, but if you wrote a patch that hasn't been upstreamed, there wouldn't be a URL to put in...13:25
rbasakI think you can put whatever you like in Forwarded, except that anything apart from "no" and "not-needed" means "yes" so there are only two ways of saying no.13:25
ahasenackkstenerud: the url could be to the mailing list archive showing you emailed the list with the patch13:26
rbasak"The field is really required only if the patch is vendor specific..." -- there you are :)13:26
rbasakOtherwise you'd have an Origin header.13:26
kstenerudSo for an Ubuntu maintainer, does this make sense? https://pastebin.ubuntu.com/p/Wjx2y34Cst/13:33
kstenerudI want to update my document so I can remember13:33
ahasenackkstenerud: bug-<vendor> can also be Bug-Debian, Bug-Fedora, etc13:37
kstenerudWould we put Bug-Debian? Wouldn't that be for a debian maintainer?13:37
ahasenackBug-Debian is super common13:38
smoserahasenack: ?13:38
ahasenackthe point of dep-3 headers is to record patch history13:38
ahasenacksmoser: yes?13:38
smoseri m issed a ping way up13:38
ahasenackthen it's gone :)13:38
kstenerudoh so that means that there's a debian bug report?13:39
smoserwhat was it?13:39
ahasenacksmoser: maybe about the git-ubuntu build{,-source} breakage? We had to revert your branch13:39
ahasenackkstenerud: yes13:39
smoseri think that was it, but what was wrong?13:40
ahasenackkstenerud: if you use dep3changelog to construct the d/changelog message from a patch, it will also record in the d/changelog message the debian "Closes: #nnnn" string13:40
ahasenackkstenerud: sometimes debian grabs our fixes, and that string tells them that this particular ubuntu upload is also fixing a debian bug13:40
ahasenacksmoser: #179930013:41
ahasenackkstenerud: doesn't mean you have to go hunting and searching vendors' bug reports, but sometimes that is recorded in the launchpad bug already13:42
kstenerudahasenack: dep3changelog is similar to git-ubuntu.reconstruct-changelog?13:42
ahasenackkstenerud: yes, but it also checks the syntax of the dep3 header for you, like if you missed a mandatory one13:42
ahasenackor just have an invalid syntax13:43
sam_whi all, a preseed issue: I am loading a preseed config via https which causes certificate verification errors as the busybox installer environment seems to be missing any ca certs. I am aware of the debian-installer/allow_unauthenticated_ssl=true option, but this didn't seem to work as a boot parameter13:48
rbasaksam_w: how are you booting the installer?13:50
sam_ware you aware of any way to either d-i preseed/include an http file from a preseed file included in the boot image, or manually add ca certificates to the install environment?13:50
rbasaksam_w: I ask because the usual ways of doing that aren't secure so https brings little benefit.13:50
sam_wrbasak: usb flash drive13:50
rbasakThen you have a reasonable question :)13:51
rbasakI understand the question, but I don't know the answer, sorry.13:51
rbasakAre you sure the boot parameter syntax is correct?13:51
rbasakI was under the impression that any preseed option could be a boot parameter. If not, perhaps that one should be added to the list.13:51
sam_wrbasak: fairly sure. That was what I was wondering, if it was any or there was some mapping or explicit passthrough13:53
sam_wfrom grub.cfg: `linux/install/vmlinuz noprompt auto=true priority=critical console-setup/ask_detect=false netcfg/choose_interface=auto locale=en_GB debian-installer/allow_unauthenticated_ssl=true url=<snip> quiet ---`13:56
rbasaksam_w: seems reasonable to me. The next thing to do is to dive into the code I suppose.14:06
rbasaksam_w: I'd check first that the key/value is correct, but you obviously can't do that using a regular preseed!14:06
sam_wthe only other thing would be: if it was possible to have a preseed file on the iso with that option, and then include one via https14:08
sam_wbut the impression I got from the docs was that preseed/include only works for the same scheme that the file it is in comes from14:09
kstenerudahasenack: I was unable to reproduce the fetchmail bug on bionic14:29
ahasenackkstenerud: but that's where it was reported14:31
ahasenackkstenerud: and bionic and cosmic have the same exact versions14:32
ahasenack fetchmail | 6.3.26-3build1 | bionic  | source, amd64, arm64, armhf, i386, ppc64el, s390x14:32
ahasenack fetchmail | 6.3.26-3build1 | cosmic  | source, amd64, arm64, armhf, i386, ppc64el, s390x14:32
ahasenackyou must be using the fixed package by mistake14:32
kstenerudI'll do a fresh install and see14:32
kstenerudNope... Won't trigger on bionic, but triggers on cosmic14:36
ahasenackis it up-to-date?14:37
ahasenackapt dist-upgrade wise14:37
kstenerudyup14:37
kstenerudand both report the same version of fetchmail14:37
ahasenackwhat remains is the ssl version14:38
kstenerudI basically lxc launch ubuntu:cosmic or ubuntu:bionic and then https://pastebin.ubuntu.com/p/G9xHNGtQ9c/14:38
ahasenackkstenerud: oh, wait, the reporter was using 18.10, not 18.0414:38
ahasenackInstallationMedia: Ubuntu 18.04 LTS <-- he originally installed 18.04, but is now on 18.1014:39
kstenerudok14:39
ahasenackstill weird though14:39
ahasenackmaybe bionic doesn't support that tls version that this triggers?14:39
ahasenackwhat was it, tls 1.2?14:39
kstenerudmaybe. Google only does this weird stuff if you ask for TLS 1.314:39
ahasenackcan you check the ssl or gnutls library fetchmail is linked to in both cosmic and bionic? use ldd14:40
kstenerudwhat args do I use?14:40
ahasenackldd <binary>14:40
kstenerudthey're both the same14:44
ahasenackyour test forces the tls version?14:44
kstenerud--sslproto TLS1.2+14:47
kstenerudthat's as high as it goes in both versions14:47
kstenerudbionic succeeds, cosmic fails14:48
kstenerudfetchmail -d0 -vk --sslcertck --sslproto TLS1.2+ pop.gmail.com14:48
smoseri cant rbasak ping14:51
smoserso what do you want me to do. fix is this:14:51
smoser http://paste.ubuntu.com/p/Vf2RfST58Q/14:51
rbasakThat's fine if it works.14:52
smoserso just rebase my old branch?14:52
rbasakYeah, on origin/master please. Then we can do another CI run and ahasenack can test his use cases from it too, and if all happy we can merge.14:53
smoserk14:53
ahasenackkstenerud: there is an openssl difference between bionic and cosmic15:04
ahasenackkstenerud: bionic has openssl 1.1.0, cosmic has openssl 1.1.115:04
ahasenackubuntu@bionic-fetchmail:~$ dpkg -S /usr/lib/x86_64-linux-gnu/libssl.so.1.115:05
ahasenacklibssl1.1:amd64: /usr/lib/x86_64-linux-gnu/libssl.so.1.115:05
ahasenackubuntu@bionic-fetchmail:~$ dpkg-query -W libssl1.115:05
ahasenacklibssl1.1:amd641.1.0g-2ubuntu4.115:05
sdezielI think that openssl 1.1.1 on cosmic has support for tls 1.315:05
ahasenackit's not just that, I think some default might have changed15:06
ahasenackI can reproduce the error on cosmic with just this: openssl s_client -connect pop.gmail.com:995 -noservername15:06
ahasenackwith -tls1_3 it doesn't finish the handshake15:07
kstenerudAccording to upstream reports it's due to Google's bizarre behavior of passing back a self-signed cert in some circumstances15:07
kstenerudsuch as the SNI missing in a 1.3 connection15:07
kstenerudit downgrades to 1.2+, but also sends back a completely different cert15:08
ahasenackanother thing I'm thinking is that openssl 1.1.0 is setting a default sni, if none is given15:08
ahasenackthere is no -noservername in openssl 1.1.0's s_client command15:08
ahasenackfetchmail's --sslproto TLS1.2+ means 1.2 *or* newer, not > 1.215:09
ahasenackdoesn't mean it's negotiating 1.315:09
ahasenackand the output of openssl's s_client -tls1_3 suggests that 1.3 is not supported15:10
kstenerudyeah, not sure what it's actually doing under the hood. That's just the chatter from the upstream bug reports15:10
ahasenackthat being said, using --sslproto TLS1.2 (which asks for 1.2 exactly) works15:10
smoserqhttps://code.launchpad.net/~smoser/usd-importer/+git/usd-importer/+merge/35782615:10
ahasenackso ok, let's leave bionic out of it15:10
smoserahasenack, rbasak15:10
rbasakThanks!15:11
smoseryou can test ust by adding 'usd-importer/bin' to your PATH and running 'git-ubuntu build'15:11
rbasakahasenack: once CI has passed, would you mind grabbing the built snap from CI and testing it please?15:11
ahasenackkstenerud: set the bionic task to invalid and add a comment about these tests you did, saying you couldn't reproduce it there or something lke that, even if the code is affected15:11
rbasakOr that.15:11
ahasenackyes15:13
sdezieltcpdump would tell you if SNI is used15:14
ahasenackkstenerud: it might boil down to just the fact that openssl 1.1.1 is the one implementing tls 1.3, and 1.1.0 isn't15:15
ahasenackhence, bionic not affected15:15
Kabrielis there a way to setup my ubuntu server to be a middle man for ubuntu updates, such that other machines I have query that server and if the update is not already cached, it retrieves it, otherwise it uses the cached version.16:02
xnoxKabriel, you can setup transparent squid proxy; and install a client machines to query local net providers over avahi first....16:04
xnoxKabriel, https://packages.ubuntu.com/search?suite=default&section=all&arch=any&keywords=squid-deb-proxy&searchon=names16:05
xnoxsquid-deb-proxy & squid-deb-proxy-client16:05
KabrielThanks for the hint. This seems like a good tutorial: https://fabianlee.org/2018/02/08/ubuntu-a-centralized-apt-package-cache-using-squid-deb-proxy/16:15
KabrielIt lead me to apt-cacher-ng, which also looks interesting.16:16
UberPopeHiya folks! I'm on my first attempt to install Ubuntu Server on a refurb. T41016:25
UberPopeThe goal is to have a prototype to offer to local clients: Office server, ERP, File server, Ecommerce+WooCommerce, integrated with the ERP on the LAN.16:26
xnoxKabriel, yeah, apt-cacher-ng is the other one.16:31
xnoxKabriel, there is also a cloud-mirror proxy, as a juju charm, which is deployed typically in cloud-regions. But it's slightly more heavier to use.16:32
xnoxKabriel, that one rsyncs dists/, and caches or proxies for the pool/16:32
xnoxKabriel, or you can run a local ubuntu mirror using ubumirror scripts.... and just point all your clients to your mirror.16:33
xnoxKabriel, there are many options =)16:33
KabrielI have a small setup -- 10 machines all running 16LTS (1 server, rest desktops). Cloud system doesn't sound right, or the mirror. I like the caching idea.16:38
KabrielAny experince with squid vs cacher-ng16:38
Kabriel?16:38
sdezielKabriel: I've been a happy user of apt-cacher-ng for many years16:52
kstenerudwow weird... sudo in cosmic always respects -p '', even if I copy the sudo from bionic (which doesn't respect -p '')16:58
kstenerudso there's some environmental issue maybe...16:58
ahasenackkstenerud: could be PAM-related, and default config related16:59
ahasenackkstenerud: the sudo manpage mentions an option about prompt overriding in /etc/sudoers16:59
kstenerudyeah, already looked in that, and sudoers.d. didn't see anything different17:00
ahasenackrbasak: dwnloading that snap from jenkins:17:06
ahasenackgit-ubuntu_0+git.30720a7_amd64.snap                    2%[++                                                                                                                    ]   2.53M  63.6KB/s    eta 28m 3s17:06
ahasenack:(17:06
kstenerudwow...17:06
mybalzitchzoom zoom17:09
kstenerudhmm ok timebox up for sudo. The only ways it's supposed to override the prompt is if passprompt_override is set in sudoers (it isn't), or SUDO_PROMPT env is set (it isn't). It's not a problem with the binary because taking the bionic binary and running it from a cosmic machine works perfectly :/17:10
ahasenack+117:11
rawcohi all17:26
rawcohow’s people’s day going17:26
ahasenackit's good here17:28
ahasenackthanks17:28
rawcoso, i’m trying to expand my main partition, for some reason the ubuntu installer created a 4G partition17:29
rawcoand it keeps getting filled17:29
rawcohttps://pastebin.com/keXBG0b117:30
rawcothere’s a bunch of available space on that sdi drive17:30
ahasenackdid you use lvm?17:30
rawcoyes17:30
ahasenackyeah, known bug :/17:30
rawcoyeah, i did have some problems when installing, had to test a couple of installer isos17:31
ahasenackhttps://bugs.launchpad.net/subiquity/+bug/178532117:31
ubottuLaunchpad bug 1785321 in subiquity "LVM Entire Disk option does not use entire disk" [Undecided,New]17:31
rawcoyep, das it17:32
rawcoso, i was wondering if i can do the expanding of the volume online17:32
rawcowith growpart and resize2fs17:32
rbasakSee comment 2 there in that bug17:33
rbasaklvresize has a --resizefs option17:33
rbasakSaves a call to resize2fs, though that's more useful when shrinking rather than expanding17:34
rawcorbasak: thanks, i’ll read over the bug page17:34
rbasakYou can increase ext4 size online, so it should be straightforward. Note that shrinking can only be done offline, which is more of a pain for a root filesystem.17:34
jellynot using the space is a lot better bug than debian's default of "using everything, the whole VG, for last created LV and filesystem, leaving no space at all for snapshots or resizing"17:35
rawcorbasak: all done: /dev/mapper/ubuntu--vg-ubuntu--lv  108G  3.3G  100G   4% /17:37
rawcothank’s to everyone :D17:37
jellylooking at that bug report, this is in fact exactly how I'd want the "use entire disk for LVM" to work in Debian ;-)17:39
lotus|NUCrawco: can you still recall wich iso you used for install?17:40
rawcolotus|NUC: sorry, i don’t really remember what iso i used17:40
rawcoi think i had to use the 18.04 iso, because 18.04.1 iso was not working with my hardware setup17:41
rawcoit was a couple of months ago, sorry :(17:41
rawcoi thought it was me and not the iso lol17:41
rawcoso i just ignored17:41
lotus|NUCrawco: yeah might be relevant info for the channel here17:41
rawcoi will lurk more here, since ya’ll are awesome17:42
lotus|NUCi have a gf already :p17:43
rbasakahasenack: I can grab historical git-ubuntu snap binaries for you if it would help17:46
ahasenackrbasak: do you still have 439 installed? Should be trivial to reproduce the bug. kstenerud or do you have it perhaps?17:46
rbasakI'm on 44017:47
jellyahasenack, the mind boggles, why is this a bug!  This is precisely how "use whole disk for LVM" ought to work -- PV indeed uses whole disk (apart from /boot partition)17:47
rbasakI might be able to revert.17:47
=== rawco_ is now known as rawco
ahasenackjelly: it was unexpected, or at least not clear enough that this would happen. Some people were surprised to get "disk full errors" after installing a few more packages17:48
ahasenackat least expanding is easier than shrinking17:48
jellyit's a lot better than what d-i does.  expanding is a fully online process.  shrinking of xfs is impossible, shrinking of ext4 is offline (and unoptimized, up to 4 times slower than copying, reformatting and copying back the data if there's more than 25-50% space used)17:51
rbasakahasenack: http://people.canonical.com/~rbasak/VAGSRAriUyDDlqsLunShJTe7503Uw4GF_439.snap.zsync and http://people.canonical.com/~rbasak/VAGSRAriUyDDlqsLunShJTe7503Uw4GF_439.snap17:51
jellyno functional change seems required, just document things and maybe put up a notification17:52
rawcowhat do ya’ll use for monitoring your servers18:07
rawcoELK stack?18:07
ahasenackkstenerud: remember to create a card for fetchmail, if you haven't already (I didn't find it after a quick look)18:18
ahasenackdepends on how many servers, and if you have a raspberry pi3 or a 16Gb machine for monitoring :)18:23
ahasenackelk is heavy18:24
rawcoi have a nice hp proliant server with sas drives and bells+whistles18:30
rawcoall the gigs18:30
ahasenackgrafana is pretty for the graphs18:32
ahasenacknegios (or its replacement, forgot the name) is good for alerts18:32
nacc_ahasenack: icinga18:33
ahasenackthat one18:33
nacc_(icinga2 i think technically)18:33
sarnoldthere's too many choices18:38
sarnoldif there were one that sucked but it was the only one available, it'd still be the obvious choice18:38
sarnoldbut there's dozens :)18:38
rawcowell, what do you use sarnold19:10
ahasenackI use munin on a small server, but I'm not very happy with it. I think that machine can take more. It only has 3Gb of ram and runs zfs, and that's stretching it already according to docs, but real world usage shows it has some memory free19:12
ahasenackMem:          3.2Gi       2.1Gi       166Mi       2.0Mi       913Mi       890Mi19:12
sarnoldrawco: I'm currently suffering from analysis paralysis -- where I use nothing because I can't decide what to do :(19:12
rawcosarnold: that’s my current mood lmao19:12
rawcowe’re already paying for connectwise, but it’s trash for monitoring19:13
tewardsarnold: Landscape.  *shot*19:15
teward(just kidding)19:15
tewardsarnold: analysis paralysis is bad.  :P19:15
sarnoldteward: tell me about it..19:15
rawcodehumanizing, i would say19:22
rawcoi wanna surveil this goddam servers19:22
rawco24/719:22
sdezielNagios3 serves us well but we don't have a huge park (~200 machines with 2k service checks)19:24
sdezielthe webUI makes your eyes bleed so we use check-mk-multisite instead19:25
sdezielmunin is for collecting performance data (no alerting capabilities that I'm aware). For perf data and some alerting netdata is pretty nice and comes with a nice webUI19:26
rawcosdeziel: that makes sense, monitoring != performance data19:26
rawcoi wonder is there’s anything out there that does everything + looks nice19:26
sdezielrawco: well, with nagios3 we also collect perf_data for quick graphs19:27
rawcosplunk ony collects logs/files and graphs them , right?19:29
rawcono actual “monitoring"19:29
shubjerorawco: zabbix, elk, grafana19:36
rawcothanks shubjero19:43
waveformactually munin does have some rudimentary alert facilities but they're not configured by default (or rather, they're configured to report via nagios by default on ubuntu - but they can be configured to report directly via e-mail)19:56
waveformhere we go: https://munin.readthedocs.io/en/latest/tutorial/alert.html19:56
sdezielgood to know, thanks waveform19:57
shubjerorawco: zabbix for active monitoring of hardware and os metrics. ELK for massive log aggregation. Grafana helps fill some gaps with zabbix for us19:59
shubjerorawco: so on any server we monitor we would have a zabbix-agent and a filebeat client running19:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!