/srv/irclogs.ubuntu.com/2017/11/17/#ubuntu-server.txt

naccrbasak: with the importer-rework branch as of right nonw, the ipsec-tools reimport is down to 35 minutes pretty consistently06:27
lordievaderGood morning07:49
=== MannerMan_ is now known as MannerMan
cpaelzerrbasak: could it be that if something is only pushed in -security the importer misses it?10:34
cpaelzerrbasak: take a look at iscsitarget in trusty10:34
cpaelzernacc: ^^10:35
rbasakcpaelzer: could be. But we're in the middle of quite a bit change in logic around how the importer picks up on changes, and the importer is still running the old code currently. So let's see if the problem remains after we've landed our changes :)10:39
=== led_ir23 is now known as led_ir22
rbasakWe don't currently have tests for this area of code (not yet faking Launchpad publications for testing)10:39
cpaelzerrbasak: is there abug on the rewrite that I could register a "please test this after the rewrite" on?10:40
cpaelzerrbasak: I know we have a set of known to import with issues - I assume you'll look at those10:45
cpaelzerjust would want to add that there10:45
cpaelzerso that we remember10:45
rbasakcpaelzer: we don't have a bug for the rewrite. It's part of our "LP beta" milestone. We could create a bug, but would it be better to have a bug for this distinct issue?10:49
cpaelzerI'm fine to open one10:49
cpaelzerit is mostly a reminder to check10:49
rbasakIt's a good idea10:49
ali1234right, who can tell me exactly why unattended-upgrades is not doing anything on my 16.04 server?12:25
ali1234it runs twice every day but never installs anything12:26
ali1234if i run it manually with --dry-run it outputs a list of packages to upgrade, in all other cases it outputs nothing12:27
ali1234that is, when run automatically12:28
ali1234actually, last thing it outputs is "allowed origins:..."12:28
=== petevg is now known as petevg_afk
jamespagecoreycb: btw I'm tending the addtional backports needed for Queens UCA...14:32
coreycbjamespage: ok14:37
naccrbasak: it depends on timing15:42
nacccpaelzer: --^15:42
nacccpaelzer: rbasak: so ... i'm not 100% on this, but this is my theory: iscsitarget was published on 7/17. It's possible we missed that evet. We don't catch it up again, because it's no longer published. The linear script walker would catch this, but the version we ran didn't look in older releases (the new one does for all active series).15:49
naccso i thinnk it's fix released a la the new scripts15:49
nacccpaelzer: were you asking re: LP: #1732918 ?15:52
ubottuLaunchpad bug 1732918 in iscsitarget (Ubuntu) "iscsitarget-dkms 1.4.20.3+svn502-2ubuntu4.4 doesn't build for Xenial hwe (4.10) kernel" [Undecided,New] https://launchpad.net/bugs/173291815:52
faekjarzHi! I'm anoyed, is it normal to take over 3 minutes to draw all the lines, at about 0.3 - 0.5 lines per second, of a "dmesg" on an ASPEED AST2400? Can i accellerate this? …modprobe …somethingsomething17:42
faekjarz…i'm not even doing IPMI (iKVM) over a slow connection …i'm directly connected to the box (VGA & USB) …this is my 1st time using a mobo with an Aspeed AST2400 BMC / GPU …is this normal?17:58
naccfaekjarz: not sure why that'd be an ubuntu issue?18:00
naccfaekjarz: do you know the BMC can dispaly faster? BMCs are not often about speed (ime)18:01
faekjarznacc: because i'm not sure what distros include what drivers, and because i'm using Ubuntu …tadaah, here i am, asking whether i might have missed modprobing something18:03
naccfaekjarz: i meant, do you know it's not a hardware limitation?18:04
faekjarzi'm not sure, it's my 1st time using an A-"SPEED" thing (it's an Asus P10S-M) …seems like a misnomer, haha …i'm just double-checking18:06
faekjarzmaybe i sould specialise in Aspeed based boards and enjoy all the free waiting time while getting paid for tech support18:13
BlessJahis AWS image naming convention ducumented anywhere?18:15
naccOdd_Bloke: rcj: --^ maybe you know?18:15
BlessJahrelated: https://bugs.launchpad.net/cloud-images/+bug/145882518:16
ubottuLaunchpad bug 1458825 in cloud-images "Please explain "root store" terms (hvm-io1, hvm, ...)" [Undecided,New]18:16
=== jelly-home is now known as hurtigbuffer
=== hurtigbuffer is now known as jelly
naccBlessJah: is that bug actually accurate. I do't see the term "root store" on that URL.18:18
BlessJahnacc: there is "Instance type" field in image locator, it takes values listed in the bug18:32
BlessJahAnd the AMI name has cryptic "ebs-ssd": ubuntu/images/ebs-ssd/ubuntu-xenial-16.04-amd64-server-20171026.118:32
BlessJahIt's more or less obvious what it means, but there is lot of other images that do not follow the convention.18:33
naccBlessJah: i'd say the bug needs to mention that, imo. Right now it says the "cloud images" download pages ... and then gives a URL that is not about AMIs.18:34
naccBlessJah: if the issue is with the AMIs, that should be specified in the bug, right now it reads like the cloud-images page is wrong.18:34
BlessJahI'll talk to Faux to get that clarified.19:51
naccBlessJah: not super urgent, i suppose :)19:51
BlessJahAnd what about thr documentation regarding image name conventions?19:51
naccBlessJah: i mean your request might be orthogonal to that bug report19:51
naccBlessJah: i pinged who i thought might help, i'd just wait19:52
naccBlessJah: i'm not personally involved19:52
naccrbasak: fyi, running the gnome-shell import locally from beta/edge snap, it does what it should (braches are being updated) so i assume cpaelzer did a skip-applied import19:53
BlessJahnice try, you're already knee-deep in this19:53
naccBlessJah: :)19:53
BlessJah;>19:53
naccsmoser: --^ do you possibly know?19:54
naccsmoser: how the AMIs get named and why they are named as they are19:54
smoserBlessJah: well, if you want to convert the values we have on cloud-images.ubuntu.com to whatever amazon's official values are just use DescribeImages on the image19:58
BlessJahI want to know how what different names (image/milestone/image-dev) mean and what filter to write to get image I want20:00
smoserBlessJah: well, milestone ?20:02
smoseri think you mean label20:02
smoserwhat is image-dev ?20:02
BlessJahprefixes for trusty: ubuntu/images/ubuntu-trusty-..., ubuntu/images/ebs/ubuntu-trusty-..., ubuntu/images/ebs-ssd/ubuntu-trusty-..., same for ebs-io1, ubuntu/images-testing/ubuntu-trusty-...,20:07
BlessJahbut yes, there is no -dev20:07
smoserah20:07
smoserignore taht20:07
nacclol20:08
naccsmoser: did you see the bug referred to above?20:08
smoseryeah.20:08
naccsmoser: ok, just wanted to check20:08
BlessJahubuntu/images/ubuntu-xenial- ubuntu/images/hvm-ssd/ubuntu-xenial- ubuntu/images/hvm-instance/ubuntu-xenial- ubuntu/images/ebs-ssd/ubuntu-xenial- ubuntu/images-testing/ubuntu-xenial- ubuntu/images-testing-dev/ebs-ssd/ubuntu-xenial-20:09
BlessJahxenial, that's where I've seen dev20:09
BlessJahsome documentation somewhere explaining why images have names that they have and a promise that convention won't suddenly change, would be nice to have that20:11
smoserhttp://paste.ubuntu.com/25983212/20:12
smoserdont use names.20:12
smoseruse the stream data.20:12
smosersstream-query  --keyring=/usr/share/keyrings/ubuntu-cloudimage-keyring.gpg  --max=1  "--output-format=%(release)s  %(label)s  %(root_store)s  %(virt)s  %(id)s"  http://cloud-images.ubuntu.com/daily/streams/v1/com.ubuntu.cloud:daily:aws.sjson  region=us-east-1  release~(trusty|xenial|zesty|bionic)20:13
smoseror i guess easier if you use https20:13
BlessJahHow do I glue that to terraform?20:13
smoseri'm sorry i dont know.20:15
smoserbut that is how you "find the right ami".20:15
smoserthe only variables currently supported (xenial+) are20:16
BlessJahWhat is that data stream thing?20:17
smoserroot_store=(instance|ssd) virt=(pv|hvm)20:17
smoserit is "simplestreams" format. which is horribly documented.20:17
smoseri'm the author, so its ok for both you and i to say that.20:18
nacchttps://help.ubuntu.com/lts/serverguide/cloud-images-and-uvtool.html ahs some mention20:18
smoserbut that is how we publish data bout clouds20:18
naccand there is a launchpad project20:18
smoserand that is how juju finds image ids20:18
BlessJahwhat was wrong with tags and naming conventions?20:18
smosera.) naming conventions and you parsing strings sucks (and as you can see over 10 years that kind of fell apart).20:19
smoserb.) we publish data on all public clouds on ubuntu.com20:19
BlessJahI get that it's very convenient for juju devs, but it breaks other tools like terraform20:20
smoserwe definitely could tag on amazon, an there might have developed conventions there over time20:20
smoserso there is some convetion on tags ?20:20
smoserand that only works on amazon20:20
smosernot on azure20:20
smoseror gce or bobs-cloud20:21
naccoooh bobs-cloud20:21
nacclike bobs-burgers20:21
nacci'd cloud there20:21
smoserthere are definitely improvements (very much so for doc) that we could make and should  make.20:21
smoserbut we set out to provide information about getting ubuntu wherever you need it.20:22
smoserthe data is available over https or http with gpg signatures inline.20:22
naccthe poitn being it's not contingent on the cloud provider to be consistent with ubuntu20:23
naccubuntu is consistent with itself :)20:23
smoserBlessJah: is there some convention for tagging images now ?20:23
smoserthat terraform can read ?20:23
BlessJahsmoser: terraform uses same API as other tools20:24
BlessJahBTW, it's hilarious how AWS is inconsistent with itself, like when API filter for name accepts globs anchored at both beggining and end, while search in browser uses regexes instead20:25
smoserYou can parse our names on amazon, but really, doesn't it make more sense to *not* ?20:26
smoserand have sane well formed data ?20:26
BlessJahIt's not about parsing to extract information, but knowing what string will give me latest, production grade image.20:35
smoserBlessJah: well how is that done for other images?20:46
smoseri updated that bug20:47
smoser ami-0309a87920:47
smoseroops20:47
smoserpaste fail20:47
smoserhttps://bugs.launchpad.net/cloud-images/+bug/145882520:47
ubottuLaunchpad bug 1458825 in cloud-images "Please explain "root store" terms (hvm-io1, hvm, ...)" [Undecided,New]20:47
smoserBlessJah: we *did* originally start out with a well formed naming convention on EC2.20:48
smoserbut bucket limitations , ebs, many different things ultimately made changes necessary and inconsistent. but we have tried to provide that data in a consistent format over http on cloud-images.ubuntu.com20:49
sveinseI'm running 16.04 on a server, and I'm constantly bothered with that smbd requires a manual restart for samba to work21:04
sveinsesystemctl status smbd reports active (exited) with status=0, and the logs simply sais "* Starting SMB/CIFS daemon smbd", "...done" and then its out.21:05
sveinseRestarting smbd fixes everything21:05
sveinseFamiliar to anyone?21:05
sarnolddoes journalctl or /var/log/*samba* something have more details?21:06
sveinsesarnold: ah, yes it does. "no network interfaces found", then "No sockets available to bind to." and a subsequent stacktrace and coredump21:09
sarnoldsveinse: eww :)21:09
sveinsethat kinda explains it thou21:09
sarnoldsveinse: but at least you've got something to work with.21:09
sarnoldjeeze, what an impenetrable page.. https://www.freedesktop.org/wiki/Software/systemd/NetworkTarget/21:10
sarnoldsveinse: I think, try the systemctl to change the samba service, "to include After=network-online.target and Wants=network-online.target."21:11
sveinseMy turn to eww: samba is still started through /etc/init.d, so it does not help to change the systemd start prereqs :(21:12
sveinseAnyone knows if the upcoming 18.04 LTS will have changes this?21:12
sveinseI'm willing to live with this until the next LTS arrives21:12
sveinsesarnold: thanks21:13
sarnoldsveinse: well, at least -a- debian samba package has some smb.service, nmbd.service, etc files, http://sources.debian.net/src/samba/2:4.6.7%2Bdfsg-1/debian/rules/#L17621:16
naccsveinse: i'm 99% sure the init.d script source lsb-functions, which then switches to systemd21:16
sarnoldsveinse: .. and if kind of looks like that version should be in the next LTS21:17
sveinseYeah, I'm looking at the package manifest for my samba. I'm having 2:4.3.11+dfsg-0ububut0.16.04.11, and it does not have any native systemd units it seems21:19
naccsamba: /lib/systemd/system/samba.service21:20
naccsveinse: --^21:20
sveinsenacc: yup, that is in the newer packages, right?21:21
naccthat's in xenial.21:21
sveinsewierd. what version is that?21:21
naccsveinse: i don't know what 'manifest' you were referring to?21:21
sveinsenacc: heh, mine. That is list of the files installed the package, dpkg -L samba21:22
naccsveinse: i'm going off the apt-file output21:22
* nacc spins up a container21:23
nacccan't trust anyone21:23
naccsveinse: samba.service is admittedly not the same as smbd.service21:23
sveinsenacc: my /lib/systemd/system/samba.service is a symlink to /dev/null :O21:24
naccsveinse: which means it's been masked21:24
nacc(iirc)21:25
nacchrm, and can't enable it because the inits cript has no runlevels21:26
naccsveinse: ok, nmbd.service and smbd.service are generated21:28
naccsveinse: which means they can be ordered21:28
nacc*i thikn21:28
sveinse/lib/systemd/system/samba.service is owned by the samba package. Reading samba.preinst and .postinst, shows that it is apparently is doing init.d manipulation and not any .service stuff21:28
sveinsewhich is wierd, if you're getting other results21:29
naccsveinse: what other results?21:29
naccsveinse: i agree samba.service is masked21:29
naccsveinse: smbd.service and nmbd.service exist21:29
naccthey are generated21:29
sveinsenacc, you mentioned nmbd.service and smbd.service. On my system they don't exist, neither in /lib/systemd nor /etc/systemd21:30
naccsveinse: i just said, agai, they are generated21:30
sveinsenacc: so, what version are you getting in your container?21:30
naccnot on the filesystem21:30
naccthey still exist and are systemd services21:30
sarnoldoh my21:31
naccsee `man systemd-sysv-generator`21:31
sveinsenacc: oh, yes, ah, yes yes. systemd makes services out of init.d items, true. That is the service I need to restart to get smbd working21:32
naccsveinse: right, and i think above you were just saying you need to order it? or sorry, missig context21:32
sarnoldI was suggesting it needed to be ordered21:33
naccsarnold: ah ok21:33
naccso the problem is smbd starting before network?21:33
sveinsenacc: for some reason, systemd starts smbd too soon when network isn't available yet (so it coredumps), so I wonder how I can order it when it does not have a service file21:33
sarnoldafter seeing https://anonscm.debian.org/cgit/pkg-samba/samba.git/commit/?id=61eaeba2a7a2df61b681b4ea545811569de421d0 earlier I assumed we had systemd unit files for samba...21:34
nacci think we do now21:34
naccbut not in xenial21:34
naccso it might need a bug21:34
sarnoldsveinse: it -coredumps- on interface-not-available?21:34
sarnoldthat sounds like another bug report too, heh21:34
sveinsesarnold: I get this in /var/log/samba/log.smbd, https://bpaste.net/show/7e92863d266121:36
sveinsebut no core in the mentioned directory (perhaps ulimit is too low)21:37
sarnoldsveinse: hrm. I'm _guessing_ that they chose to dump core on a huge number of issues, just so they could have something to debug with :)21:37
sarnoldsveinse: apport might have eaten the core21:37
naccsveinse: pulling up the git repo so i can try help a bit better21:39
nacc2:4.4.4+dfsg-1 is when it was fixed in debian21:40
nacchttps://git.launchpad.net/~usd-import-team/ubuntu/+source/samba/commit/?id=28a135855171ad2b00821c23e5b4e6b589cd7e1b21:41
naccpresumably exactly for this problem21:42
naccas those are all After=network.target21:42
sarnold.. which might be before the network is online21:42
sarnolddid samba switch to IP_FREEBIND or whatever the option is?21:42
naccsarnold: above my pay grade21:43
naccahasenack: --^21:43
nacc(i thinkn he's out right now, though)21:43
sarnoldnacc: and with the weather as nice as it is right now, this might be the last we see the sun until july 5th21:43
naccsarnold: yeah21:43
nacchttps://www.freedesktop.org/wiki/Software/systemd/NetworkTarget/21:44
naccso it seems like *maybe* that hsould be network-online.target21:45
sveinsenacc: yes, seems it would21:45
naccsveinse: the "right" fix (least sensitive/invasive) for 16.04 is to put the right headers i the lsb file21:45
naccwith a $network depedency21:45
naccwhich will translate to a Wants/After network-online.target21:45
sveinseYou guys think its safe to pick a backported samba in a production server?21:46
naccno21:46
nacc:)21:46
sveinse(horrible question)21:46
naccbut i also don't think it's safe to run samba ;)21:46
sveinsetell that to all the win guys who think they rule the world21:46
naccsveinse: intneresting21:46
nacc /etc/init.d/smb *does* have $network21:47
naccerr, smbd and nmbd21:47
sveinseOur router is handing out DHCP IPs, even to servers with "fixed" IP. Could it be that assumption? Because $network in that context is when ip is up, not when dhclient has done it's job, right?21:48
nacchttps://www.freedesktop.org/wiki/Software/systemd/NetworkTarget/ syas $network gets intnerprted by systemd to mean wait on network-onlinne.target21:49
sveinsehorrible failure mode from smbd thou21:49
sarnoldthat could sure explain why you see it and yet we're not over-run with this complait on irc every day...21:49
naccsveinse: ah but yeah, that could imply you are in network-online already21:50
naccbefore you actually are :)21:50
naccsveinse: check `systemd-analyze critical-chain smbd.service`21:51
naccsee if it is ordered correctly21:51
sveinseinterestingly its after network-online.target21:51
sarnoldnacc: nice :)21:51
naccyeah21:52
naccso it did it "right"21:52
naccthe issue is your system thought it was 'online' before it was, for some meaning of 'online' and 'think'21:52
naccwell, 'thought', but conjugated21:53
sveinseyes21:53
sveinsewell, then it's time to argue with the router infra guys about why I need to set a fixed ip and not run dhcp :D21:53
naccsveinse: i guess you could trawlt he log and see 'when' you got "Reached target Network is Online" and see if it is correct21:54
sveinsehmm. the journal does not mention "online", but systemd-analyze said it happened at 24.227s. I wonder if I can get journal -b0 to dump with entries in seconds since startup rather than using wall clock21:56
naccsveinse: hrm, my journalctl does show the line21:58
naccsveinse: in a 16.04 lxd21:58
sveinsenacc: It does. My bad. grep online does not find "Online"21:59
naccsveinse: ah :)21:59
naccsveinse: if you don't mind, before you EOD, can you check if there is a bug for the samba systemd units as they currently are (ref the commit i gave above) and that it's a behavior change to depend on network.target when 16.04 depended on network-online.target (implicitly via $network)22:00
sveinsenetwork online is 1 second after getting dhcp address.22:00
sveinsenow here is an interesting thing: I see that nmbd starts after network online. But smbd starts well before network online and "network"22:01
naccsveinse: even in the critical chain output?22:01
sveinsehttps://bpaste.net/show/44fad5355fa922:02
naccthat's after nmbd.service22:03
sveinseDo I read that smbd is depending on nmbd?22:03
naccso if nmbd.servic is after nnetwork-online, so is smbd :)22:03
naccsveinse: top-level is the one you asked for, then each little down is a dependency22:03
naccsmbd.service depended on nmbd.service depended on network-online.target depended on ...22:03
naccand if you depend on something (in this parlance) we mean it started after22:04
sveinsesnipping parts of the journal logs: https://bpaste.net/show/722f3f847e6822:05
naccvery strange22:08
nacci suppose it's possible for systemd to start a unit twice and only emit the second one22:08
naccbut that would imply you've done some local config to force smbd to start22:08
sveinsenacc: not deliberately...22:08
naccsveinse: hrm, i genuinely don't know22:09
naccsveinse: i would file a bug -- it feels like something is wrong, but i don't know what22:09
nacci would file against both samba and systemd, tbh22:09
naccsveinse: that log does imply a race, for some reason, between dhclient starting and finishing and smbd starting22:10
naccsveinse: which does read like ad ependnecy on network rather than network-online22:10
sveinseI've got /etc/init.d/samba AND smbd and nmbd. Do you have this in your container?22:10
naccsveinse: yeah22:11
sveinseok, thanks22:11
naccsamba is like the meta-service22:11
naccit makes sure smbd and nmbd are running22:11
naccoh and samba-ad-dc22:11
sveinseyes, you'll see that in the journal paste as well. In proper relationship to "network online"22:12
naccyeah22:12
naccit's clearly a bit of a thundering herd there22:13
naccall that gets logged in the same secod :)22:13
naccand given logging, it's also possible we are seeing weird output that is not related to the actual order22:13
nacci mean it coudl be racy writing to the journal22:13
sveinsenacc: isn't the journal race safe? I.e. it writes the entries "mutex"-wise in the order they're received?22:19
sveinsebut granted, the services might be out of orders over the cpu cores22:19
naccsveinse: i'm not sure, i meant simply that i'm not sure what guarantees the order things are written is the order in which they are received22:25
nacce.g., it might have receive 4 parallel service starts22:26
naccthose all get shown as starting, in some order, because ... well, we can't read parallel22:26
naccbut they really all started simultaneously22:26
nacci don't trust the timestamps of the journal to tell me that :)22:26
sveinsenacc: no, agreed22:27
sveinsethe timebox for fixing this thing is up soon, but what exactly do you want me to do with this? I suppose report it, but with what data?22:28
naccsveinse: yeah, `ubuntu-bug samba`, with whatever you can summarize out of the above22:29
naccahasenack: should see this in his backlog whenn he's back too22:29
naccsveinse: i'm out for a while, so he's likely to be the one to help22:29
sveinseheh, ubuntu-bug samba asks "How would you best describe your setup?" 1) I am running a Windows File Server, 2) I am connecting to a Windows File Server, C) Cancel... Eeehh. None of the above. :P22:31
naccsveinse: it *might* just be easier to do a https://bugs.launchpad.net/ubuntu/+source/samba/+filebug22:32
naccsveinse: and maybe mentio that the above options are a bit limited :)22:32
sveinsenacc: https://bugs.launchpad.net/ubuntu/+source/samba/+bug/173301122:47
ubottuLaunchpad bug 1733011 in samba (Ubuntu) "smbd crash after reboot" [Undecided,New]22:47
=== ptx0_ is now known as ptx0
naccsveinse: thakns23:00
sveinsenacc: thanks yourself23:00
sveinseNow I need to fix something else23:01
naccsveinse: yeah that's *really* weird, but you did a good job summarizing it ...23:01
drabis there some kind of very small ubuntu based distro to be used for rescue?23:19
drab(I know I asked about this already, bust still looking)23:19
drabdamn small linux seems discontinued, ubuntu is huge (1.5GB)23:19
drabideally I'd use mini.iso, but it doesn't provide a bootable system, only install (same for server)23:19
gun1xis docker foss ?23:40
naccgun1x: a question for docker, presumably.23:45
gun1xnacc: nevermind, found my answer23:46

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!