/srv/irclogs.ubuntu.com/2017/03/10/#ubuntu-devel.txt

=== _salem is now known as salem_
=== gavinlin is now known as Guest34349
=== salem_ is now known as _salem
pittibdrung_work: I suppose you could use python3-apport or a tool of your own to construct a .crash file with the data you have07:19
pittibdrung_work: it doesn't require ProcMaps and other bits, but it does require the exact ExecutablePath07:20
bdrung_workpitti, thanks. i will have a look at python3-apport. how does apport get the ExecutablePath?09:12
pittibdrung_work: readlink /proc/<pid>/exe09:13
pittibdrung_work: there's some extra magic that it does for interpreters though09:13
pittibdrung_work: i. e. if ExePath is /bin/sh, /usr/bin/python and so on, it dissects teh command line instead to find the "real" program (i. e. the script)09:14
pittiif that's not an use case for you, you can ignore that09:14
pittiyou won't need it for retracing indeed, this is just for filing correctly targetted bug reports09:14
bdrung_workinterpreter are not our issue09:14
bdrung_workpitti, which file format is the apport crash file?09:17
pittibdrung_work: essentially RFC-822, see http://bazaar.launchpad.net/~apport-hackers/apport/trunk/view/head:/doc/data-format.tex09:18
pittibdrung_work: if you can use python3, it's easier to use apport.Report(), this is more or less a dictionary with a write() method to spit out the .crash file format09:19
bdrung_workpitti, is there a rendered version of that tex file?09:20
pittiI was meaning to ship the PDF in apport, but apparently I missed to package it09:20
pittibdrung_work: http://piware.de/tmp/data-format.pdf09:21
bdrung_worki can (and prefer) to use python3 for retracing, but the host (where the crash happens) should be kept simple. we use this script (or at least something similar): https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=85730009:21
ubottuDebian bug 857300 in makedumpfile "makedumpfile: Please add a dump-core script" [Wishlist,Open]09:21
pittibdrung_work: look at the various /usr/share/aport/ scripts like gcc_ice_hook or kernel_crashdump for examples how to use the api to generate .crash files09:22
bdrung_workpitti, what exactly happens when the kernel crashes (regarding the workflow with apport)?09:24
bdrung_workwe have the contrain that the servers do not have a disk09:24
pittibdrung_work: it calls /usr/share/apport/apport like in /proc/sys/kernel/core_pattern, see man core(5)09:25
pittiand feeds the core dump to its stdin09:25
pittiand apport then creates an apport.Report(), sets the report['CoreDump'] to stdin, and adds a few other fields from /proc and its CLI arguments (pid and signal number mostly)09:26
bdrung_workpitti, /usr/share/apport/apport looks interesting. the missing bits for our use case is support for directly uploading the coredump09:45
bdrung_worksince the whole system runs on tmpfs09:46
pittimount a tmpfs on /var/crash? :-)09:46
bdrung_workthat needs ram too.09:47
pittiprocessing a core dump needs a lot of ram09:47
pittiwith pipelining it directly to a remote server it might work better, but you probably want to do the .crash file assembly on the server then09:48
pitti(still need to compress the core dump in the pipeline)09:48
bdrung_worki know. that is why set /proc/sys/kernel/core_pattern to pipe to a core-dump script that pipes stdin into a compression into a busybox ftpput09:48
bdrung_worki would want to have the .crash metadata in a separate file09:49
bdrung_workthen upload the metadata first and then pipe the compressed dump09:49
pittiah, so replace CoreDump: in the local .crash file with some identifier that relates it to the ftpput, so that you can match it up on the server?09:49
pittior CoreDumpID:09:50
bdrung_workyes. thinking of CoreDumpFile: foo-20170310.lz409:50
bdrung_workthe file will be in the same place09:50
pittibdrung_work: I suggest using gzip, then you don't need to uncompress/recompress on the server09:51
bdrung_workgzip is too slow09:51
bdrung_workand the retrace would happen on a different host09:52
bdrung_workcan gdb work with a gzipped crash dump?09:52
pittino09:52
pittiit mmaps, so apport-retrace always unpacks it first09:53
acheronukodd http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#rocs09:53
acheronukvirtual memory exhausted: Cannot allocate memory09:53
acheronukon amd6409:53
acheronukand on ppc64el09:54
acheronukdotgrammar.cpp09:54
acheronukc++: internal compiler error: Killed (program cc1plus)09:54
acheronukonly on the autopkgtest rebuilds. builds fine normally09:55
pittiprobably needs to be added to bigtests09:57
Laneytake the opportunity to figure out how to not have to rebuild the whole thing each time09:58
acheronukpitti: to me? that allocates extra resources?09:58
pittiyes, that needs to be added to Ubuntu's CI config09:58
pittibut yes, if you can't build that with 1 GB of RAM, that's a bit evil :)09:59
acheronukhmmm. longstanding issue it seems: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=73017010:01
ubottuDebian bug 730170 in src:rocs "rocs: FTBFS: virtual memory exhausted in DotGrammar.cpp" [Important,Open]10:01
acheronukLaney: well as as far as I can see, the build at test time is not really avoidable. So could that maybe added to 'bigtests' as Martin suggested?10:16
Laneyacheronuk: The autopkgtests are really meant to test against the already built packages that are in the archive, and here I bet you're testing against the thing you just built.10:30
LaneyPerhaps you can build the tests against the system libraries, or perhaps you can ship them in a binary package like some GNOME stuff does. That would likely require some upstream work though.10:30
acheronukLaney: yes, it would require upstream changes that are likely beyond me/us to work out and submit. I get what you are saying, but this is an interesting but not core/crucial KDE app, so time/benefit there means is not going to happen I think10:45
Laneyacheronuk: Ok, but basically all of the KDE applications have the same problem AFAICS10:49
LaneyIn addition to not telling you if the packages in the distro are broken, they are a serious strain on the infrastructure10:49
acheronukLaney: yeah, quite aware of that :/10:51
acheronukgotta go. thanks10:53
Laneyacheronuk: I put it in big_packages for you10:59
LaneySome attention to the wider problems would be appreciated10:59
=== hikiko is now known as hikiko|bbl
=== _salem is now known as salem_
bdrung_workpitti, do you collect just the dependencies of the package or do you also collect recommends/suggests?12:06
pittibdrung_work: backends/packaging-apt-dpkg.py get_dependencies() → Pre-Depends:, Depends:, Recommends:12:08
pittibdrung_work: normally that doesn't matter that much for retracing though, as it prefers ProcMaps12:08
pittithat will skip irrelevant packages, and more importantly, also catch plugins or other dynamically loaded stuff12:08
pittibut it falls back to Dependencies: if there is no ProcMaps field (for your case)12:09
bdrung_workah, cool. and how does it map from ProcMaps to the package with the debug information?12:09
pittibdrung_work: apport-retrace downloads Contents.gz for that12:10
pittiand from there, try to install -dbg, or -dbgsym12:10
pitti(but you need both the package and the symbols)12:10
bdrung_workso with contents you can map the file to the package12:11
bdrung_workhow do you map the package to the -dbg or -dbgsym package?12:11
pittiwith string concatenation :)12:11
pittiand then asking apt.Cache() if that exists12:12
bdrung_workheuristics :D12:12
pittibdrung_work: http://bazaar.launchpad.net/~apport-hackers/apport/trunk/view/head:/backends/packaging-apt-dpkg.py#L67212:12
bdrung_workI am collecting some more information now: http://paste.ubuntu.com/24151344/12:13
bdrung_workthanks for the documentation of these fields.12:13
pittiyeah, these days we migth actually use the debug links that are part of -dbgsym packages, but this was all written way before that existed12:13
pittibdrung_work: btw, apport itself doesn't collect the expensive stuff (Package:, Dependencies: etc.) at crash time12:14
pittionly after you actually agree to send a report12:14
pittijust the stuff that's absolutely required to collect while the process is core dumping (/proc and the core dump)12:14
pittibut for automatic submission you need to do it, I agree12:14
bdrung_workhow do you make sure that the packages haven't been updated in the meantime?12:14
pittiit compares time stamps12:14
pittibut since the popup is triggered via inotify, that rarely happens12:15
bdrung_workwhich timestamps?12:15
pittiof the executable file12:15
bdrung_workand what about the libraries?12:17
pittino timestamp for those12:17
bdrung_workwould you notice changes for them?12:18
pitti(it has never been a practical problem)12:18
pittidue to the inotify popups12:18
mdeslaurcould someone please push gnutls28 and pcsc-lite out of proposed, please? The failing tests are unrelated.12:21
=== hikiko|bbl is now known as hikiko
Laneymdeslaur: I retried them with --all-proposed, think that'll work12:41
mdeslaurLaney: thanks12:42
Laney(any uploader can do that, BTW)12:43
Laneymmm, not for pcscada apparently12:43
mdeslaurLaney: what tool do you use?12:45
Laneymdeslaur: retry-autopkgtest-regressions with --all-proposed from lp:ubuntu-archive-tools12:46
mdeslaurLaney: cool, thanks12:47
jbichatseliot: hi, I'm pinging again about bug 1559576, a very serious bug for Ubuntu GNOME that looks like it has a very simple fix14:34
ubottubug 1559576 in gdm3 (Ubuntu Xenial) "Ubuntu GNOME boots to black screen when using proprietary Nvidia drivers" [Critical,Triaged] https://launchpad.net/bugs/155957614:34
=== salem_ is now known as _salem
tseliotjbicha: yes, sorry but I've been extremely busy with other stuff15:24
jbichatseliot: ok15:26
=== balkamos_ is now known as balkamos
bdmurraypowersj: Have you identified a patch which fixes bug 349913?15:52
ubottubug 349913 in openssh (Ubuntu) "sftp: cannot enter umlauts like ä, ö, ü" [Medium,Fix committed] https://launchpad.net/bugs/34991315:52
powersjbdmurray: not yet15:53
bdmurraypowersj: but you thought it was worth adding a Trusty task?15:54
powersjbdmurray: sorry if I did this the wrong way, I wanted to work on the bug to fix in trusty, and wanted to assign to to myself, however since it was marked fix committed I thought adding trusty and assigning it to me would be the way to track that15:55
powersjif I found the backport to be too large or crazy then could note that, otherwise work on an SRU15:56
bdmurraypowersj: no, adding a task if you going to assign yourself makes sense to me.15:56
bdmurraypowersj: there, its been approved15:56
powersjbdmurray: thank you!15:57
cjwatsonpowersj: I've suggested some likely commits in the bug, but personally I would consider this too invasive for backporting.16:10
cjwatsonEspecially since it did go wrong.16:11
powersjcjwatson: thanks for looking at it! I will happily take your advice :)16:11
barrywhy did the recent chromium browser upgrade *again* forget all of my passwords?  this is the second or third time during zesty that it's done that.  I'm glad i haven't upgraded my other machine yet or i'd have to do password resets for every site i generate random passwords for.  now i have to pick them out of my other browser instance, but some of my passwords are loooongggg16:20
jackpot51Hey guys - does anyone have a lead on Gnome Software not installing dependencies for .deb packages?16:36
jbichajackpot51: did you file a bug yet?16:41
jackpot51I think https://bugs.launchpad.net/bugs/157320616:45
ubottuLaunchpad bug 1573408 in gnome-software (Ubuntu Xenial) "duplicate for #1573206 GNOME Software does not install third-party .deb packages" [High,Fix released]16:45
jackpot51https://bugs.launchpad.net/ubuntu/+source/gnome-software/+bug/1573408 says fix released, am I missing something?16:46
ubottuLaunchpad bug 1573408 in gnome-software (Ubuntu Xenial) "GNOME Software does not install third-party .deb packages" [High,Fix released]16:48
naccjackpot51: fix released refers to the development release at hte time16:48
jackpot51Oh, hope to see it in 17.04 then16:48
naccjackpot51: oh but i see that bug also has the 16.04 task as FR16:50
naccugh, that bug is hard to read16:52
ginggsfixed in https://launchpad.net/ubuntu/+source/gnome-software/3.20.1+git20160426.1.a976144-ubuntu-xenial-0ubuntu116:55
jackpot51Thanks ginggs16:56
naccginggs: confused, though, people kept saying they saw it after that was released?16:58
ginggsmaybe that release didn't really fix it, or it was subsequently broken again16:59
naccginggs: ack, it's very unclear from the bug itself17:00
* nacc is glad not to really work on desktop stuff :)17:00
dobeybarry: ugh, really?17:11
dobeybarry: i don't see how it would forget passwords, since it uses gnome-keyring as the storage17:11
tyhicksmwhudson: hi - the docker-in-lxd test is broken with recent lxd uploads17:11
tyhicksmwhudson: you seem to be tending to that test so I wasn't sure if fixing it was something that you're already working on17:12
tyhicksstgraber: it looks like lxd-bridge unit went away recently - what's the correct way to apply configuration that is manually written to /etc/default/lxd-bridge? (asking because the docker-in-lxd docker autopkgtest is stopping lxd-bridge, writing to that file, and then starting lxd-net)17:18
tyhicks(I meant "and then starting lxd-bridge")17:19
jackpot51nacc ginggs: I will test it again with a clean install17:20
nacctyhicks: iirc, that is now stored in the lxd database17:22
nacctyhicks: and there is a script to migrate, but fresh users don't have any /etc/default/lxd-bridge17:22
nacctyhicks: i believe this changed with `lxc network`17:22
jackpot51ginggs nacc: Clean 16.10 install, Chrome installation fails silently with the Software Center17:23
tyhicksnacc: ah, I'm starting to remember that now17:24
tyhicksnacc: thanks!17:24
naccjackpot51: there does appear to be a version in yakkety-proposed that might be worth testing17:24
jackpot51nacc: Ok, I will update, purge the half-installed google-chrome-stable, and retry17:26
stgrabertyhicks: yeah, on LXD 2.3 or higher (whichever advertises the "network" extension), you should use the "lxc network ..." commands instead.17:26
stgrabertyhicks: we have code that deals with that in the autopkgtest package and also deals with the new storage API from 2.9+17:27
stgrabertyhicks: let me get you a link17:27
stgrabertyhicks: that's the LXD test setup logic in autopkgtest: //paste.ubuntu.com/24152739/17:27
stgraber*http://paste.ubuntu.com/24152739/17:27
naccjackpot51: and the i'd check the chagnelog of the yakkety-proposed one to see if it's also got a bug referring to ti17:28
stgrabertyhicks: in the autopkgtest case, it doesn't bounce lxd-bridge because it knows that it's not going to be running at the time (clean setup) and so just relies on the socket activation to bring up the unit afterwards17:28
tyhicksstgraber (cc mwhudson): thanks but I now see what's going on with this docker.io autopkgtest...17:29
tyhicksstgraber (cc mwhudson): it already knows how to deal with `lxc network` but it doesn't know how to compare software versions17:29
jackpot51nacc: Works with updates, just not with the default ISO17:29
stgrabertyhicks: ah, it shouldn't compare versions, it really should check for the LXD extensions instead17:30
naccjackpot51: yes, that's sort of expected -- that is with -updates (and not -proposed0?17:30
tyhicksstgraber (cc mwhudson): it thinks that version 2.10 is less than 2.2 and is going back to the old way of configuring the bridge17:30
naccjackpot51: as the we don't respin the ISO; were you using a daily?17:30
stgrabertyhicks: haha, funny :)17:30
tyhicksyeah :)17:30
stgraberI think there was a similar but in Juju a while back17:30
tyhicksthe extension check is the fix - thanks!17:31
jackpot51nacc: Complicated - I work for System76 so we do OEM install and keep the install image up to date. ISO failed, but our install doesn't17:36
naccjackpot51: got it!17:38
naccjackpot51: does your install image use -updates?17:38
naccjackpot51: the 16.10 ISO (release ISO) i think never gets updated17:38
jackpot51nacc: Yes, the computers will ship with updates17:38
naccjackpot51: but the 16.10 daily would have updates applied (i think?)17:39
jackpot51Right17:39
naccjackpot51: so it's not surprising (at least to me) that there is a bug int he release version that's later fixed17:40
naccjackpot51: same would be true of 16.04.0; but 16.04.1 (and i think 16.04.2) have the fix17:40
jbichajackpot51: if you have a good test case, please file a new bug17:49
jbichaif the problem is with Google Chrome, I think I heard that there might be a problem there but I don't think there's a bug yet17:49
jbichabut the original xenial "can't install a .deb" bug was fixed17:50
jgrimmnacc, fwiw i have a debdiff up for the tc man page bug you pointed me at if you'd want to sponsor it. https://bugs.launchpad.net/ubuntu/+source/iproute2/+bug/166881317:51
ubottuLaunchpad bug 1668813 in iproute2 (Ubuntu Xenial) "The tc man page references tc-index man page but tc-index man page does not exist" [Low,In progress]17:51
jgrimmnot urgent at all17:51
naccjgrimm: ack17:52
naccjgrimm: i believe your version is incorrect?17:52
naccjgrimm: should be 4.3.0-1ubuntu3.1 ?17:52
jgrimmbah17:53
jgrimmnacc, i'll fix17:53
naccjgrimm: and, unfortunately, we'll need to fix yakkety too :/17:53
naccotherwise current upgrades who get the fix from xeniall will not update in yakkety17:53
naccwell, i guess that's not 'fatal', but it's unexpected17:53
nacc(x and y have the same version)17:53
jgrimmnacc, agreed, and trivial17:53
jgrimmto do17:53
naccjgrimm: yep, should be easy -- will need a bit of version love :)17:54
nacc4.3.0-1ubuntu3.16.{04,10}.1 i think17:54
naccjgrimm: also, would you mind using `dep3changelog` ?17:56
naccjgrimm: that way "Phil Sutter" gets attribution in the changelog :)17:56
jgrimmnacc, apologies for not thinking through the versions, was juggling multiple things yesterday17:56
naccjgrimm: not a problem! nothing to apologize for17:56
jgrimmah, dep3changelog is new to me. cool, i was just adding based on looking a debian docs17:57
jgrimmbut \o/ for tooling17:57
naccjgrimm: yep! :)17:58
barrydobey: yep, definitely.  maybe it's gnome-keyring that got updated and somehow zeroed out its db.  or maybe it just hates me18:29
dobeybarry: could be maybe the back-end in chromium got flipped to the native thing18:31
dobeyor something weird18:31
* barry votes for something weird18:31
barrydobey: yeah, it's happened at least twice during zesty18:32
dobeyhmm18:32
dobeysomeone should write an autopkgtest :)18:32
barry;)18:32
chilukbarry is there a way to get launchpad mail for all bugs that contain a specific tag?  in my case sts-sponsor?20:27
chilukbarry I only picked on you since you were last to touch the channel.20:27
* barry quit:20:27
chiluklol.20:27
barrychiluk: i'm not sure, but there may be an option in your bugmail20:28
chiluki'll go ask in launchpad20:28
barryyeah20:28
barryprobably best20:28
=== zul is now known as zulVacation
xnoxinfinity, libc postinst hangs upgrades to yakkety when doing trusty->xenial->yakkety without rebooting21:21
xnoxapperantly telinit doesn't handle well, when telinit u causes one to reexec upstart into systemd21:22
xnoxi thought you might find it funny =) i have killed hung telinit, and continue with upgrades.21:23
xnoxit is a lot of fun.21:23
jgrimmnacc, i'd think it would be 1:4.3.0-1ubuntu4 for yakkety, and 1:4.3.0-1ubuntu3.1 for xenial?22:52
jgrimmsorry, just getting back to this finally today22:53
mun24how to make ssh connection using an existing tcp/ip connection23:03
naccjgrimm: fwiw, ubuntu4 would not be typical for a released version23:09
naccjgrimm: my suggestionearlier was off of https://wiki.ubuntu.com/SecurityTeam/UpdatePreparation#Update_the_packaging23:09
* jgrimm goes off to read. thanks23:10
jgrimmnacc, ok i see. invoking the >1 release with common version. thanks.  indeed then would be 1:4.3.0-1ubuntu3.16.10.1 and 1:4.3.0-1ubuntu3.16.04.123:13
naccjgrimm: yep23:17
jgrimmi was looking for a page like that yesterday, thanks for the pointer23:17
naccjgrimm: from a review perspective, as well, it means i don't really need to check if ubuntu4 is already used or published or whatever in the devel release23:17
naccjgrimm: as those versions are so distinct23:17
jgrimmindeed, i can totally see that23:18
naccjgrimm: that's on my list of things to broadcast wider in :)23:18
jgrimmgood cheatsheet!!23:18
naccthat page, that is23:18
jgrimmindeed, and dep3changelog was cute23:18
jgrimmi'll definitely use that again23:18
naccyeah, it simplifies one step (IMO) and makes it repeatable23:19
jgrimm+123:19
jgrimmnacc, y and x debdiffs attached to bug fwiw23:26
naccjgrimm: thanks, i'll probably review them early next week23:26
jgrimm+1 no urgency at all23:26
Unit193cjwatson: Have you seen https://launchpad.net/bugs/1668093?  It'd likely be pretty useful considering https://launchpad.net/bugs/1670745 (https://bugzilla.mindrot.org/show_bug.cgi?id=2692)23:40
ubottuLaunchpad bug 1668093 in openssh (Ubuntu Yakkety) "ssh-keygen -H corrupts already hashed entries" [High,Triaged]23:40
ubottuLaunchpad bug 1670745 in openssh (Ubuntu) "ssh-keyscan : bad host signature when using port option" [Undecided,New]23:40
ubottubugzilla.mindrot.org bug 2692 in ssh-keyscan "Hash does not include the port" [Minor,Resolved: fixed]23:40
cjwatsonUnit193: I replied to it ...23:44
Unit193Well dang, I missed that part.  Wasn't subbed. >_<23:45
Unit193Sorry for the ping.23:45
cjwatsonnp - might be worth me cherry-picking the fix for bug 1670745 too though, from the sounds of it23:46
ubottubug 1670745 in openssh (Ubuntu) "ssh-keyscan : bad host signature when using port option" [Undecided,New] https://launchpad.net/bugs/167074523:46
Unit193Yeah I just saw 8a2834454c73dfc1eb96453c0e97690595f3f4c2 too, that'd be greatly useful, though if the first is fixed at least there's a workaround.23:47

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!