/srv/irclogs.ubuntu.com/2017/04/25/#ubuntu-devel.txt

=== boiko__ is now known as boiko
hloeungjuliank, mvo, xnox: added my comments to bug 161548200:16
ubottubug 1615482 in apt (Ubuntu) "apt-daily timer runs at random hours of the day" [High,Fix committed] https://launchpad.net/bugs/161548200:16
=== mbarnett_ is now known as mbarnett
=== tsimonq2alt is now known as tsimonq2
arune_rbasak, I uploaded the patches I've tested on bug #1641203, I can't get a debdiff working06:49
ubottubug 1641203 in sssd (Ubuntu Xenial) "SSSD can't process GPO from Active Directory when it contains lines with no equal sign" [Medium,Triaged] https://launchpad.net/bugs/164120306:49
=== arune_ is now known as arune
juliankhloeung: Let's see how 1 hour delay works out (it's still twice as much as before) for a few weeks. If I'd guess the peak would be around 50% to 75% of where it used to be (it really depends on how long the update is). The only way to solve bandwidth issues and really still maintain a sensible time window is to provide pdiff support on the archive (which reduces download size by like 90%).06:58
Unit193https://lists.ubuntu.com/archives/ubuntu-devel-discuss/2014-February/014793.html (Continued into the next month.) - LP 21461207:12
ubottuLaunchpad bug 214612 in Launchpad itself "Provide pdiffs for apt-get update" [Low,Triaged] https://launchpad.net/bugs/21461207:12
cpaelzerI like this bug description "There's a glitch in binaries."07:21
cpaelzer:-)07:21
juliankUnit193: There are a lot of difficulties with pdiffs here, basically.07:22
Unit193juliank: Just pointing to it, though might be helpful to some during the dev cycle.07:23
xnoxhloeung, juliank, mvo: end-users care about predictable times when the upgrade happens; end-users do not care (usually) about mirror spikes. mirror administrators care about mirror spikes... but not when the end-user upgrades happens. I fight for the user!08:52
xnoxhloeung, about the mirrors. Could you elaborate as to how they are deployed. I would have thought that for example on big clouds, there would be a local bucket/cdn used to serve the mirror at blazing speeds with no need to spin up any instances.08:53
hloeungxnox: heh except when it's heavily loaded, end users will most likely miss out on important updates08:54
mvoxnox: I think we need input from IS here (you are seeking it already so +100 for that). my understanding is that we have a lot of mirrors on ISPs, univesities etc that care about spikes08:54
hloeungxnox: they're deployed using juju, ubuntu-repository-cache charm (which is basically squid-deb-proxy)08:55
juliankThese things are easily changeable via a drop-in unit. Large organizations that can tolerate more variance can easily roll out a config file choosing whatever they want.08:56
mvoxnox: note that I don't really mind either way, we need to decide what is more important and if we can find a middle ground. in the old days before systemd iirc the randomization was 6am + 2h so maybe we could go back to something like that. i.e. not spread over the entire day but only within ~2h or 4h or something08:56
xnoxhloeung, mvo: we had a customer outage were mid-day upgrades killed customer workloads in a dedicated ($$$) hosting provider. The change from one hour window, to unpredictable window is streated as a severe regression and has been escalated to me.08:56
xnoxhence we are reverting back to previous behaviour for now.08:56
juliankmvo: xnox: It was 30 minutes, 6:00-6:30, actually08:56
juliankAFAICT08:56
xnoxright.08:56
juliankNow it's 6-708:57
xnoxand i think 1h is accetable, random throughout the day is not.08:57
hloeungxnox: all we, IS, asked for was a larger window than the 30m08:57
juliank1 hour is larger08:57
xnoxhloeung, but e.g. debian has an archive mirroring onto aws cloudfront these days. I'll try to find if that code is available, and if we can jujufyit.08:57
hloeungjuliank: ok then, we'll see how 1hr goes. Thanks!08:57
juliankNow, assume an update takes 4 minutes, you can calculate how much the load will be relative to 30 minutes08:58
mvojuliank: you are right, I misremebered08:58
xnoxhloeung, it's blazing fast, at least for me.08:58
juliankThough 4 minutes is probably too much. Most updates take like 90s I'd think08:59
juliankand with a local mirror, things are even faster09:00
juliankOur accuracy is 1 minute, so we have 60 options at which to start updates09:00
juliank(could improve accuracy to 1s or so, but given the duration of an update, there's likely no benefit)09:01
juliankLet's assume you have 10,000 clients, each taking 2 minutes to update (for ease of calculations). How many clients will be active at the same time?09:02
xnoxhloeung, should the clouds with spikes problems have their cloud images modified with a larger update window? e.g. we can totally make cloud images for cloud $foo region $bar to have a larger update window.09:02
xnoxhloeung, but my preference is to actually use cdn-like mirrors rather than instance-cpu powered ones.09:03
hloeungxnox: yeah, if you can do that, then that will definitely help09:03
hloeungxnox: costs $$$ :(09:03
xnoxhloeung, former / latter / both?09:03
xnoxah.09:03
hloeungxnox: if it's easy to have cloud images randomise over a larger window09:04
juliankI thought about providing a package for changing the default to a longer period09:04
juliankLike apt-config-long-maintenance-window09:05
juliankCould do updates between 0 and 709:05
juliankIt's a bit silly as it's one file with like 5 lines, but people apparently can't figure that out themselves, so maybe that's what is needed09:06
cjwatson_I'd love to do pdiffs, but I've never been able to sort out how it would work with the much faster archive cycle we have than Debian.09:06
=== cjwatson_ is now known as cjwatson
cjwatsonI don't want to end up having to keep a zillion little files around.09:07
juliankcjwatson: Yeah, that's really the main issue. You gotta do merged pdiffs then, and keep less ones around.09:07
xnoxjuliank, well, imho cloud-init for the cloud should realise that X UTC is not the best time to update the whole world, and that it should figure out the cloud/region it is in, and use "machine-local timezone; cloud-region timezone; utc" to spread the update load.09:07
juliankWhatever works for you, I was just thinking about the general case.09:08
juliankWhat I realised yesterday is that 6-7 might not be the best time for Indian users. IIRC, they have a lot of cheaper-at-night data stuff, and would prefer something more midnighty?09:09
juliankAh yes, 0-609:09
xnoxjuliank, there is a bit of information about the mirror spikes problem. For a few clouds, canonical operates the mirrors - which all fallback to the Canonical UK country mirror. Meaning a DDOS at 6:00am =)09:10
xnoxjuliank, yes, as soon as i saw the 6am-7am UTC i was like that's a bad time for anybody between Moscow, India, Oceania.09:10
juliankMaybe we should have picked 5-609:10
xnoxbut the argument there is that 6am-7am localtime is good enough, and is close enough to a revert.09:10
xnoxfor a general case; and people on metered connections probably also have their devices off; or specifically schedule things overnight (e.g. torrents, updates, what not)09:11
juliankWe can still have apt-night-update which configures a 0-6 time or something.09:11
xnoxbecause it's a lot more hands-on.09:11
juliankSure, it would be interesting to get some feedback on that.09:11
xnoxjuliank, as a command maybe, rather than a package with one drop in.09:11
juliankxnox: I am close to thinking about a debconf question: When do you want automatic updates to occur?09:12
xnoxjuliank, at the moment the feedback is that mass majority uses the default; for a niche users that causes mirror spikes / slow apt update; for another niche of users it causes sysadmin stress over not knowing when the updates will strike.09:12
xnoxjuliank, no such prompt will be in ubuntu; we default to automatic updates, because we want our users to be secure.09:13
xnoxplus cloud images do not do debconf =) they are all non-interactively launched and configured, and are by far the largest % of users.09:13
juliankxnox: Well, it would still have automatic updates, it just asks you at which time :D09:13
juliankOn the cloud, you'd set the selection and reconfigure the package.09:14
* xnox giggles09:14
juliankBut well, we can ship a bunch of drop-ins in /usr/share/apt and build a selector that looks at the descriptions, lists them all and allows you to choose one.09:15
xnoxjuliank, the cloud provider, should be dictating imho cloud policy via the vendor meta-data in the config drive; such that cloud-init can read it and dictate the policy. The cloud guests, have ability to disable vendor data and place their own overrides.09:15
juliankOr, well, just use update-alternatives for that09:15
xnoxjuliank, most people never login to reconfigure a package in the cloud. Most deploy their workloads via things, and scale up/down.09:16
juliankxnox: This is just a way to give systemd its config files. How you start that is another topic09:16
xnoxjuliank, whilst nice for end users on the console, most people will be annoyed by it, and it will not at all mitigate mirror spike from large clouds. I don't think.09:16
xnoxjuliank, imho for regular people; solving the running of apt-updates on resume with networking is imho a much larger priority than debconf prompts to assist people on how to update systemd timers schedules =)09:17
juliankThat's true I think.09:18
juliankxnox: So, the plan is to go ahead with the 6-7 SRUs, then and do something special for cloud? I'd prepare them later today then.10:41
xnoxjuliank, yes.10:42
juliankAlright :)10:43
xnoxjuliank, mean while i'm trying to reproduce and/or fix the autopkgtest failures that are blocking the release of the SRUs.10:43
xnoxthere are "regressions" one down, one to go.10:43
juliankxnox: They alway happened, we always ignored them10:43
xnoxhttps://bugs.launchpad.net/ubuntu/+source/sbuild/+bug/168606410:43
ubottuLaunchpad bug 1686064 in sbuild (Ubuntu Artful) "sbuild ADT test can only pass in devel series" [Undecided,New]10:43
juliankxnox: yep, that's the issue :)10:44
juliankxnox: Fixing that will make all SRUs faster :D10:44
xnoxand i am retrying the autopkgtest package adt failure, triggered by apt in xenial. as i cannot reproduce it.10:47
juliankxnox: The AssertionError: 16 != 0 ?10:47
xnoxyeah10:48
juliankxnox: that has been happening in all previous SRUs as well, so a retry should not fix it :(10:49
juliankxnox: Did you just see what harry33 did it in the timer bug report?10:52
juliankpeople these days10:54
xnoxjuliank, yeah well done.10:55
xnoxjuliank, also i think it is wrong that systemd doesn't do login before everything is up; they argue everything should be up before one is allowed to login.10:55
juliankMaybe there is some dependency somewhere between multi-user target or dm and the timer target?10:56
juliankor something.10:56
juliankIt should not block at all on timer services, that's silly10:56
* xnox laughs10:57
xnoxjuliank, systemd is silly..... =)10:57
juliankxnox: I like systemd, just some minor issues here and there10:58
juliankxnox: Also does not happen on my (Debian) system11:02
juliankI could not login though, but that might be unrelated11:05
Laneyxnox: https://paste.ubuntu.com/24453611/ I call BS on does not reproduce :-)11:06
juliankLaney: Oh, if you can reproduce it, you can probably also fix it :D11:06
LaneyNo.11:07
juliank:(11:07
LaneyIf I can reproduce it, someone else can was my message11:08
xnoxhorum.11:53
xnoxLaney, to counter your reproducibility - sudo ./tests/adt-run ChrootRunner.test_setup_commands_string passes on xenial =)12:03
xnoxclearly the autopkgtest infra interferes with autopkgtest test suite =) i wonder if there are environment variables that leak into the tests, causing it to fail.12:03
Laneyrun it in the same way that the testsuite runs it?12:04
xnoxtrying $ autopkgtest -s autopkgtest -- lxd autopkgtest/ubuntu/xenial/amd6412:24
LaneyI have -s -U --apt-update=proposed=src:apt autopkgtest12:27
Laneyoh and --test-name adt-run to just run that one12:27
Laneybut if it's ~always failed then the SRU team might be willing to overlook it12:29
=== JanC_ is now known as JanC
xnoxso doing it without -U and without --apt-update, but with -s12:33
xnoxi get the failure, but the temp dirs are cleaned up already12:33
xnoxrerunning ./tests/adt-run ChrootRunner.test_setup_commands_string passes....12:34
xnoxso i am confused a bit. and the temp dirs have been cleaned up by the test =(12:34
Laneyyou can past -B and run autopkgtest from within the source package to run the tests from there12:39
Laneylike hack the script to delete all the other tests and any teardown stuff you don't want12:40
Laney(delete 'autopkgtest' from the commandline to do that)12:40
xnoxyeah =/12:44
xnoxlet me finish sbuild tests first, to sru that (that is a simple cherrypick)12:44
tinoco libelf-dev : Depends: libelf1 (= 0.166-2ubuntu1) but 0.168-0.2 is to be installed12:53
tinocolooks like some binary packages aren't ok in zesty ?12:53
tinocosource package makes -dev depend on same binary version12:53
juliankxnox: the timer "adding random time" messages are still a bit much in the log: https://paste.debian.net/929242/. Why oh why does it pick a new delay every 10,20, or 30 minutes?12:58
tinocosomehow my libelf1 was from artful (even using zesty only repository), weird. fixed.13:02
xnoxjuliank,  i have opened a bug report about that to investigate. honestly crap like that does not belong in kern.log / dmesg.13:04
juliankI know13:05
julianknot in my kernel log, though, I don't think that's normal :D13:06
rbalinthow can i get an ubuntu source package with history in bzr/git?13:25
rbalinthttp://packaging.ubuntu.com/singlehtml/ says : bzr branch ubuntu:flash-kernel13:26
rbalintbut it does not work13:26
rbalinti'm about to review all the Ubuntu deltas and seeing the accurate history would be helpful in some cases13:27
juliankrbalint: I don't think it's possible? The bzr one stopped a year or two or so ago13:28
juliankThere are some git repos, but I don't know if they are ready yet?13:28
juliankxnox: My boot test was flawed actually. I did not have anything in the network-online.target - my NetworkManager-wait-online.service was disabled. Will reboot later and see what it actually looks like13:28
rbalintjuliank: will the bzr one be restarted?13:29
julianknah13:29
rbalintjuliank: i would cut that part from the howto then13:29
xnoxjuliank, you are racing with udev, as our networking does come up udev based on resume, i am suspecting. at least ifupdown is triggered by udev on resume.13:30
juliankInteresting13:30
rbalint http://lintian.ubuntuwire.org is also down13:30
rbalintjuliank: is there anyone who i can ask regarding the git repos?13:31
juliankidk13:31
juliankxnox: Just suspended and resumed, but status (on Debian) says: "Active: active since Tue 2017-04-25 13:01:24 CEST; 2h 30min ago" - not sure if anything is changed in the Ubuntu version of systemd :)13:32
juliankBut I think it would be easy to just stop and resume that target, but that's really something for upstream to decide :)13:33
=== alan_g is now known as alan_g_
sil2100nacc: hey! Do you know who could help verifying the LP: #1564778 SRU? It's in -proposed for 25 days already with another SRU waiting in queue already13:50
ubottuLaunchpad bug 1564778 in sane-backends (Ubuntu Yakkety) "package libsane-common 1.0.25+git20150528-1ubuntu2 failed to install/upgrade: trying to overwrite '/etc/sane.d/hp.conf', which is also in package libsane:i386 1.0.23-3ubuntu3.1" [Undecided,Fix committed] https://launchpad.net/bugs/156477813:50
Laneyxnox: try cbac10714:00
xnoxLaney, hm?14:01
Laneyit's a commit14:02
LaneyI bet it works14:02
xnoxah14:02
xnoxok14:02
xnoxLaney, yes, that sounds right.14:04
Laney:D14:04
LaneyI guess the problem when you ran it is that you don't set that variable14:04
Laneyand it's the -z thing that fails14:04
xnoxyeap, will sort this out for the sru.14:04
xnoxsbuild yakkety, is in the unapproved queue.14:05
Laneyawesome14:05
Laneyfixing tests, what a thing!14:05
rbalintjuliank:  reported the issues, will see what happens: LP: #1686100, LP: #168609614:05
xnoxsbuild xenial fails - because i bet i need to tweak things for xenial now, and again the thing doesn't reproduce in the fail shell =(14:05
ubottuLaunchpad bug 1686100 in Ubuntu Packaging Guide " bzr branch ubuntu:hello stopped working" [Undecided,New] https://launchpad.net/bugs/168610014:05
ubottuLaunchpad bug 1686096 in Ubuntu Packaging Guide " http://lintian.ubuntuwire.org is down" [Undecided,New] https://launchpad.net/bugs/168609614:05
xnoxLaney, i know, i don't think i like ever done this!14:05
LaneyI ran it with that cherry pick btw14:06
Laneypasses14:06
Laneycould upload if you want?14:06
xnoxLaney, sure. do a bug, sru template, the whole lot. and we need it just in xenial i think, no?14:07
Laneyit's in yakkety's version already14:07
tacocatdo I have to explicitly request syncs from experimental->artful if one was done before, or will they happen automatically?14:09
rbasakExplicit every time.14:10
tacocatah, thanks14:10
juliankdoko: Whatever happened to bug 1644363 - the linker crashing on arm64 in trusty? It's been 4 months now, and the SRU for bug 1422795 is blocked by this (not to mention other SRUs that might be linking the wrong code because ld failed in some configure tests)14:46
ubottubug 1644363 in binutils (Ubuntu Trusty) "[trusty/arm64] binutils segfaults on bash gettext configure test" [Undecided,Confirmed] https://launchpad.net/bugs/164436314:46
ubottubug 1422795 in bash (Ubuntu Trusty) "bash crashes often if inputrc contains revert-all-at-newline" [High,In progress] https://launchpad.net/bugs/142279514:46
juliankIt should just be a matter of bisecting eglibc between the broken and working versions, and fixing it?14:51
juliankAlthough, maybe it is indeed a bug in binutils, and fixed by this commit: https://sourceware.org/git/gitweb.cgi?p=binutils-gdb.git;a=commit;h=99d190fac4d2aab238cfc798dc5c28ab4145688214:53
juliankAt least that's what https://git.busybox.net/buildroot/commit/?id=4210c49357b216705a85734293023d8d5683bb49 says14:53
* juliank added that as a comment. Not sure if it helps - don't know if the patch even applies :)14:56
juliankinfinity: ^ (since you were the one doing the initial debugging)14:56
* juliank does not have an arm64 to test this on :/14:57
naccsil2100: i can try today, yeah -- i was never affected14:57
juliankI guess I'll just try applying the patch15:00
juliankPatch applies :)15:01
sil2100nacc: thanks!15:04
naccsil2100: np, thanks for the poke15:07
juliankUploaded binutils to https://launchpad.net/~juliank/+archive/ubuntu/lp1644363+1422795, let's see if that works out15:09
juliankIf it does, I'll re-upload it to trusty proper, and then we can finally build bash on arm64 :)15:10
infinityjuliank: Oh shiny.15:17
infinitytinoco: From artful-proposed, even. Well done.15:20
seb128infinity, is anybody going to announce the opening of the new serie on the devel list?15:20
infinityseb128: Oh, I suppose I could send the email.  I think after opening on Friday, my carefactor was low. :P15:21
juliankinfinity: Regression potential = "ld will stop crashing in some cases, which could potentially change some dependencies for SRUs (if their configure test failed due to an ld crash)."?15:21
infinityjuliank: That's more of a progression potential.15:22
juliankTrying to SRUify the bug report15:22
seb128infinity, that would be nice, thanks15:23
infinityjuliank: "[Justification/Impact] Fixes stuff [Regression Potential] Might break other stuff."15:23
infinityjuliank: There, I've just written all your SRU bugs for the next decade.15:23
juliankLol15:23
juliankShould have went for a walk while binutils was building :/15:24
juliankAh well, I can go now, it will take some time before its published anyway. So I'll upload bash to the PPA in 50 mins or so then, and then we'll see if it helped15:25
infinityjuliank: Fingers crossed.  It's likely a valid fix regardless, but it would be nice if it fixes that specific bug. :P15:30
naccrbalint: yeah, packaging guide speaking quite so loudly about bzr was on my list to look at too -- thanks for doing that! :)15:42
naccrbalint: in what context are you "about to review all the ubuntu deltas"? Do you mean for every source package?15:42
rbalintnacc15:51
rbalintnacc: yes, exactly15:51
naccrbalint: we probably should sync up :)15:51
rbalintnacc: my idea is pulling all Debian Vcs history and all Ubuntu (package?) history to a single git repo15:52
naccrbalint: right, we (server team) are doing that15:52
rbalintnacc: using git, git-remote-svn, git-remote-bzr, etc15:52
naccrbalint: e.g., https://code.launchpad.net/~usd-import-team/+git15:52
naccrbalint: we use the launchpad publishing history rather than the debian vcs, though15:52
rbalintnacc: nice15:52
naccrbalint: since we have it for both (we can eventually add debian as a trusted remote once we get there)15:53
rbalintnacc: is there any doc on the effort?15:53
naccrbalint: always a good question15:53
naccrbalint: i've posted a few times to ubuntu-devel, i plan on posting again soon15:53
naccrbalint: there some generic stuff about the toolling (for merges): https://wiki.ubuntu.com/UbuntuDevelopment/Merging/GitWorkflow15:54
naccrbalint: there is also the SPECIFICATION and some README in the https://git.launchpad.net/usd-importer/tree/15:55
naccrbalint: it's available as a snap now (usd-nacc)15:55
infinityrbalint: "all Debian vcs history" makes some odd assumptions about what's authoritative.16:01
naccyeah, which is why we initially aren't trusting it16:01
infinityrbalint: The only authoritative sources are the Debian archive and the Ubuntu archive, which I believe is what nacc's machinery assumes.16:02
naccwell "trusting"  it -- launchpad shows us what was published in the archive(s)16:02
naccyeah16:02
rbalintnacc: thanks!16:02
naccif we could do some 'rich history' lookup we can parent basically anything in (with some new code) -- but it's not clear how to do it 'right' for all cases, etc.16:02
viral_mutantI am unable to understand the difference between maintainer scripts like postrm v/s postrm.debhelper16:03
viral_mutantwhich one to use and when ?16:03
viral_mutantwhat does .debhelper in the end signify ?16:03
rbalintinfinity: yes, the vcs repo is sometimes outdated, but I'd like to use the result for preparing patches based on the Ubuntu delta16:03
rbalintinfinity: considering a well maintained package the vcs repo is correct and may already contain extra patches16:04
infinityrbalint: It's not a question of outdated, or anything else, really, it's that most packages in Debian (and Ubuntu) don't have a VCS, and even when they do, the only authority on what's actually uploaded is the archive itself, as we do not build from VCS.16:04
mdeslaurinfinity: meeting?16:04
infinitymdeslaur: Err, oh, yes.16:05
rbalintinfinity: i got those16:05
naccrbalint: we want users to be able to rely that what we 'import' as a given version is exactly that version as uploaded16:05
cjwatsonviral_mutant: *.debhelper are autogenerated files that you don't touch manually.  They're removed on clean.16:05
rbalintnacc: this is ok16:05
naccrbalint: everything else is ancillary so far :) (but i'm 100% on board with you filing a bug/feature request for other cases against the importer -- note the 'other vcs' case is already reported)16:05
cjwatsonviral_mutant: General guideline is, wherever possible, try to let debhelper write your maintainer scripts for you by way of its automatically-emitted snippets, but if you have to then you put your own code in debian/postrm (etc.).16:06
cjwatsonviral_mutant: If you do that, you should include a #DEBHELPER# line which dh_installdeb will replace with the collected autogenerated code from various other debhelper commands.16:06
cjwatsonviral_mutant: (see "man dh_installdeb")16:07
viral_mutantcjwatson: so if I have prerm.debhelper and my own prerm.debhelper, both will be executed ? In which order ?16:08
viral_mutantyes, I referred the man page but could not understand the #DEBHELPER# comment16:08
viral_mutantsorry, I meant my own prerm16:09
cjwatsonviral_mutant: You must not write your own prerm.debhelper.16:10
cjwatsonviral_mutant: If you need to write your own prerm code, it goes in debian/prerm, and you put a #DEBHELPER# comment somewhere in it.  Where you put that comment controls what order things go in.16:10
cjwatsonviral_mutant: See https://anonscm.debian.org/cgit/pkg-man-db/man-db.git/tree/debian/postrm for example16:11
cjwatsonviral_mutant: When the package is built, all of the automatic stuff is substituted into that script at the point where it says #DEBHELPER#.16:11
viral_mutantthe #DEBHELPER# comment is mandatory ?16:12
cjwatsonviral_mutant: You would almost always be very foolish to omit it.16:12
cjwatsonviral_mutant: If you have no manual code to write in a maintainer script, though, it's fine to leave it out of your source package entirely (so you don't need e.g. a debian/prerm that basically has nothing but a debhelper substitution comment).16:13
viral_mutantcjwatson: ah I see. actually the task I have at hand is to create DEB package from source. that source has been used till date to generate RPMs only16:15
viral_mutantso I tried 2 methods to generate the deb package16:16
viral_mutantone is using ‘alien’ tool on generated RPM which generates the post/pre inst/rm files16:16
viral_mutantand other is to use settools bdist_deb which generates .debhelper scripts16:17
cjwatsonwtf to both16:17
cjwatsonif it's a python package then just find a reasonable existing python package to crib from; most of that is well-automated by now16:18
viral_mutantI guess the .service files disable/remove etc will be automatically taken care of16:18
cjwatsondh_installinit usually handles that kind of thing in normal packages16:18
cjwatsonI have no idea what weirdo tools like alien or bdist_deb would make of it16:18
viral_mutantI need not write my own post/pre rm scripts, right16:18
cjwatsonin the general case; sometimes there are exceptions depending on exactly how things are laid out16:19
cjwatsonthe design of modern debhelper (dh(1) etc.) is that it handles common cases and you generally only need to tell it about things that are in some way unusual relative to most packages16:20
viral_mutantcjwatson: thanks. that really helps16:25
rbalintinfinity: got curious, actually less than 20% of packages in Debian don't have vcs: http://upsilon.cc/~zack/stuff/vcs-usage/16:27
juliankinfinity: bash built. binutils in trusty-proposed unapproved queue, needs approval!16:27
infinityjuliank: \o/16:28
rbalintinfinity: this is still a significant amount, but not "most"16:28
infinityrbalint: Weeeeeell, it's a more interesting story than that, though.16:29
infinityrbalint: As they don't all use VCSes the same way.16:29
infinityrbalint: debian-dir-only versus full unpack being the biggest difference.16:29
rbalintinfinity: this is true16:29
infinityrbalint: Either way, the VCS is not authoritative, period, is the only point I was making for this exercise.16:29
infinityrbalint: If the VCS and archive don't match, the VCS is by definition wrong.16:30
infinity(And they often don't match... More than you'd think)16:30
cjwatsoninfinity: Still worth including the Debian VCS history though where it matches; in such cases it's going to be a richer source of history than anything we can put together automatically16:30
rbalintinfinity: yes, saw many cases of that16:30
cjwatsoninfinity: (Or even where it doesn't match, as a partial history)16:30
infinitycjwatson: Sure, but that's also a Very Hard problem to solve.16:31
infinityOr, can be.16:31
rbalintcjwatson: and we can cherry-pick fixes from Debian easier16:31
infinitySometimes, it's easy to match tag->tag with ver->ver and say "yup, these are byte-identical, inject the commits", and sometimes... Not.16:31
cjwatsoninfinity: Also a problem that quite a few people have been working on solving for some time :-)16:31
cjwatsonAnd with git it's much easier to get away without being perfect.16:32
infinityIndeed.  nacc being one of them.16:32
infinityHonestly, I just want to get us to a point in Debian *and* Ubuntu where we can release-from-vcs, but I'm also a hippie free love lover of choice in tooling, which complicates things a lot when you can't say "you must use VCS X in layout Y"16:33
infinityHaving the VCS actually be authoritative would be lovely, but until it is, I knee-jerk when people act as though it is, that's all.16:34
naccyeah, the biggest issue i've run into is there is not a canonical (little c) way to do version lookups -- if the maintainer uses dgit without options, i think there is -- but not everyone does16:35
naccso we'd need to store all this metadata about the vcs whenever we add a new one (that doesn't follow some standard) and that gets messy16:36
naccbut it's all on my backburner because what we have is 'good enough' for now16:36
infinityYeahp.16:36
naccwe do have the notion of 'upload tags' as well, which allows ubuntu developers to provide rich history for a given upload to ubuntu16:36
nacc(we being the usd tooling)16:36
infinityAnd I think my pipe dream of anyone being able to upload-from-tag from any VCS and any layout is probably BS, and it'll only work if we impose rigid standards.16:36
naccyep16:36
infinity"dak and LP will scan registered repositories for this exact tag layout on this release branch, and if they find signed tags, you get an upload, if it's not laid out this way, sucketh to be thee" is probably the only way it'll work.16:37
naccinfinity: yep, that's sort of our plan, i think16:40
rbasakbeing able to upload-from-tag> I think this is achievable.16:42
juliankmhm mhm sru-review -s trusty binutils :D16:42
infinityrbasak: Oh, it's definitely achievable.  I was doing in in Maemo almost a decade ago.16:43
rbasakWe're almost at the stage where the imported git tree correctly represents canonical archive history.16:43
* juliank is too excited about this SRU, oddly enough16:43
infinityjuliank: I'm not ignoring you.16:43
rbasakWhen it does, then we could switch Launchpad to primarily taking uploads from signed tags instead16:43
juliankinfinity: That's wonderful :)16:44
rbasakAnd to support old workflows, it could accept dputs still but give that to the importer to resolve into a importer-signed tag that it can trust.16:44
infinityjuliank: I mean, I'm also not running the command.  But I'm not ignoring you!16:44
infinity(running the command)16:44
rbasakIt's not really very far at all from where we want at the moment, apart from perhaps confidence in reliability.16:45
rbasakfrom where we *are* at the moment16:45
infinityjuliank: That update-maintainers mangling of control seems superfluous.16:45
* juliank needs something done before preparing the xenial/yakkety/zesty apt and cracklib2 SRUs16:45
juliank:D16:45
juliankinfinity: It's from the prev upload, actually16:46
infinityjuliank: Oh, then never mind.16:46
naccrbasak: i wonder if `usd build*` needs updating for the .buildinfo files from dpkg?16:47
naccrbasak: as well as our wiki pages16:47
infinityjuliank: This fix is amazingly generic.  I'm somewhat shocked we never saw the issue on other arches.16:47
juliankack16:47
rbasakI've not been following the buildinfo stuff16:47
naccrbasak: just based upon infinity's email today16:47
* rbasak reads up16:47
rbalintrbasak, nacc: do the already existing repositories match the ubuntu uploads?16:48
rbalintrbasak, nacc: i see the bugs with the failed imports16:48
naccrbalint: as of when the importer last run, yes16:48
naccrbalint: i'm catching them up now16:48
rbalintnacc: great! :-)16:48
naccrbalint: and if you need something imported, feel free to ask here16:49
infinityjuliank: My only question now is if we should do this through the security-proposed PPA instead, as this is a regression in security *and* updates.16:49
infinitymdeslaur: ^16:49
rbalintinfinity: the repo/upload mismatch stats in Debian to support your case :-) https://qa.debian.org/cgi-bin/vcswatch16:50
juliankEhm, yes, the last upload already was a no-change rebuild from updates to security16:50
juliankIt might make sense to directly go to security this time around16:51
juliankOn the other hand, I don't really care. I just want to get bash building again :)16:51
naccrbasak: also, i had a side idea for a `usd m-o-m` which i think would work (and wouldn't require any of the clone, etc. steps) -- it would just look at the current repo and see if it can do the next merge automatically -- user would still have to verify the diff, history, etc.16:52
mdeslaurinfinity: you want to just build it there but still go through the SRU process?16:53
juliankIt might not even be a security regression, though. It could be just bad luck16:53
juliankEhm yes.16:54
juliankNo?16:55
naccheh16:55
naccthat covers all your bases, juliank :)16:55
juliankIt certainly only happens with a new enough glibc as well16:55
juliankI think what doko wrote is that it worked with -...14, but failed with the no-change rebuild for -security in -14.116:56
juliankunless he downgraded the eglibc.16:56
juliankBut well, as I said, I just want to finally get this bash upload I sponsored last year building :)16:57
juliankIf you want to push it as a -security regression fix, that's your call16:58
infinityjuliank: AFAICT, 14 had the issue, but it was masked until a glibc update.  Given that glibc and binutils are both high enough in the security pocket to trip this, I think the SRU also belongs in security.17:00
infinitymdeslaur: Yeah, that.  I'll upload it to security-proposed, then copy it to the archive for regular SRUyness.17:01
mdeslaurinfinity: ack, sounds good17:01
xnoxjuliank, current apt sru's should be released soon (i got slangasek on the hook for that later in the day) and we do have sbuild/autopkgtest in unapproved fixing the adt test failures to make future srus less pain.17:23
=== deltab_ is now known as deltab
juliankxnox: Wonderful. New SRUs coming soon :)17:24
bdmurrayjuliank: Is there a workaround for bug 1681231?17:27
ubottubug 1681231 in cracklib2 (Ubuntu Zesty) "package cracklib-runtime 2.9.2-3 failed to install/upgrade: dependency problems - leaving triggers unprocessed" [High,Triaged] https://launchpad.net/bugs/168123117:27
juliankbdmurray: dpkg --configure -a and continue?17:27
juliankbdmurray: I don't really know, but I plan to upload SRUs for that.17:28
bdmurrayjuliank: Okay, I was looking at the bug and somebody had asked how to sort themselves out.17:29
juliankbdmurray: Does the release upgrader include -updates when doing the upgrade?17:30
* juliank has no clue about that17:30
bdmurrayjuliank: Hmm, it might only if they are enabled.17:30
juliankbdmurray: The thing is if we fix this via an SRU; and that's not used, then we can just not fix it17:31
bdmurrayjuliank: It is used, but it doesn't add -updates if people don't have it enabled so we'd want it in -security too.17:32
juliankOh dear17:32
juliankMaybe someone else should do it then. For zesty and yakkety, it's as simple as changing the version in the changelog entry17:33
juliankThis abuse of -security is fun :D17:34
nacccpaelzer: rbasak: for `usd merge` -- do you think we should just avoid the need to drop the empty/redundant commits (pocket copies)?17:48
nacccpaelzer: rbasak that is, i can drop the flags from our cherry-pick17:48
rbasaknacc: yeah could do. I see no need to keep them.17:54
naccrbasak: ack17:56
nacccpaelzer: i've updated the workflow wiki for the new `usd merge` subcommands17:56
=== JanC_ is now known as JanC
naccis there a "right way" to do release upgrade testing with -proposed?18:33
naccfor a specific package fix18:33
rbasakI've always done it with a manual swap of sources.list and dist-upgrade, rather than with do-release-upgrade. I'd love to know if there's a better way too.18:34
naccrbasak: good point, will do that for now, though18:36
naccrbasak: and if that is the 'right way', then i think we should put it on the wiki somewhere18:40
rbasakIt's almost "right". It should work closely enough for most cases, except for stuff that do-release-upgrade does.18:42
naccrbasak: yep18:43
juliankslangasek: xnox: 1.3.6 (yakkety): https://github.com/Debian/apt/compare/1.3.y...julian-klode:1.3.y?expand=1 - 1.2.21 (xenial): https://github.com/Debian/apt/compare/1.2.y...julian-klode:1.2.y?expand=119:01
juliankI think they are actually the same diff...19:02
juliankI can create an additional bug to track the parts not explicitly covered by an LP bug yet, if preferred19:02
juliank(These are one word / one line added, though)19:03
juliankxnox: I assume we can actually drop the config change for xenial, you said the problem with spaces in dirnames and apt-key in bug 1672710 only happens in yakkety19:04
ubottubug 1672710 in apt (Ubuntu Yakkety) "apt fails to verify keys when Dir has space, and set via cmdline" [High,Triaged] https://launchpad.net/bugs/167271019:04
juliankBut then again, maybe something else uses that, and it does create invalid config files it can't read back, so it's probably good to keep it in19:06
juliankAnd zesty just gets the current version re uploaded with ~17.04.1 appended19:07
juliankCI passed19:22
juliankSo I'm ready to go :)19:22
xnoxjuliank, re:spaces yes because xenial uses old gpg and old apt-key and it handles spaces correctly i believe.20:50
xnoxjuliank, push the button.20:50
juliankRockets launching in about a minute20:52
juliankRockets launched.20:55
juliankxnox: All rockets reached their unapproved queue20:56
juliankqueues, even20:56
* xnox shakes fist at the queue20:57
Unit193Launching rockets at launchpad, nice.20:57
juliankUnit193: Yeah, they parked now but will be relaunched their :D20:57
juliankxnox: That was the record for mass APT releasing20:58
=== _salem is now known as salem_
=== salem_ is now known as _salem
juliankxnox: I can say one thing: Ubuntu really needs more people who can approve stuff :)21:01
juliankor rather :(21:02
Unit193s/\ who.*//21:02
juliankWell at least I'm here for APT-related stuff and random other uploads :)21:03
=== _salem is now known as salem_
juliankAlthough I mostly just sponsor stuff if someone comes here begging for it :)21:05
Unit193juliank: Are you core dev?21:05
juliankUnit193: yeah21:05
juliankUnit193: We had a little introduction ceremony at debconf last year :D21:06
Unit193Hah, nice.  My only thing is in the sponsoring queue, and hasn't been in for very long so no reason to complain. :P21:07
juliankLuckily we found a room before someones battery run out so someone could do a DMB meeting21:07
juliank:D21:07
Unit193Hah, meeting at a conf, nice.21:08
juliankUnit193: Not to give a wrong impression, it was only one person involved in this on premises.21:08
Unit193Sure, but he still had to do a meeting at a conf. :)21:09
infinityjuliank: "Ubuntu really needs more people who can approve stuff"... Am I hearing you volunteering for release and/or sru training?21:09
Unit193...Or backports even?21:09
infinityOh, backports is a mess.21:09
juliankinfinity: Do you want that.21:09
juliankUnit193: eww21:09
infinityThat needs staffing for sure, but I stay clear of that team.21:09
juliankinfinity: Ehm, "do you even want that?"21:10
infinityjuliank: I suspect it could be mutually beneficial.21:10
infinityjuliank: Perhaps with a slight tip in my favour. :P21:10
Unit193Thanks to PPAs and personal repo applications, backports isn't much needed.  Though, thanks very much for the debhelper backport!21:10
juliankinfinity: wait, do people usually approve their own uploads?21:12
infinityjuliank: No.21:12
juliankI thought so21:13
infinityjuliank: But you helping with our load gives us more time to review your uploads.21:13
infinityjuliank: A mutual back-scratching.21:13
juliankThat's true21:13
infinityjuliank: Plus, once I've added you to every privileged team in Ubuntu and you spend all your free time doing my bidding, you might eventually have to take that job offer.21:14
infinity(was that my out loud voice?)21:14
Unit193I think it was.21:15
juliankAt least not a shouting voice21:15
juliank;D21:15
juliankhmm, odd letter combination21:15
juliankinfinity: I'd certainly review easy stuff for free, but the nasty ones ...21:16
juliankBut well, that's also a question of learning curve anyway :)21:18
juliankinfinity: And yes, my ultimate goal is to be *everywhere*21:19
infinityjuliank: You might need to put on weight.21:19
juliankI can be in multiple places at once21:21
infinitySounds painful.21:22
juliankinfinity: and re the other thing. i kept delaying my thesis, but I'm close to starting it. Let's see what my load is when I started it :)21:24
juliankand in 6 months the thesis is done anyway and I'm completely free for new things21:25
juliankinfinity: oh, you already retried the bash build?21:27
infinityjuliank: Yep.21:27
* juliank was just about to do the same :D21:28
acheronUKjuliank: PhD in what?21:28
juliankacheronUK: Not a phd, only an msc21:28
acheronUKoh. wait.... 6 months21:28
acheronUKjuliank: yep. just realised on the timescale21:29
juliankacheronUK: You don't believe I could do a Phd in 6 months?21:29
juliankWell, I guess I'd have to be really lucky21:29
juliankLike "Oh shit, I discovered a break through"21:30
juliankinfinity: More importantly, I'm running out of Ubuntu pens. We should get ogra_ to get me some more21:31
Unit193mwhudson: Does https://github.com/golang/go/issues/13191 look related to https://launchpad.net/ubuntu/+source/gocryptfs/1.2-2ubuntu1/+build/12459199/+files/buildlog_ubuntu-artful-arm64.gocryptfs_1.2-2ubuntu1_BUILDING.txt.gz ?21:32
acheronUKlol. always exceptions to every rule.21:32
juliankinfinity: For branding purposes, my room's door here at the dorm has an Ubuntu sticker on the outside.21:34
juliankYay, bash built21:38
infinityjuliank: \o/21:38
juliankThat should make the Google people pushing for that happy, unless they already moved on21:38
juliank:D21:38
mwhudsonUnit193: uh yeah, it does a bit21:39
mwhudsonUnit193: go 1.8 will be default in artful by the end of the day i hope and it should work there21:39
Unit193mwhudson: OK good, I know nothing about golang.  I tried a rebuild against it with no luck.21:39
mwhudsononce i find an archive admin to beat into reviewing artful NEW21:39
infinityOh crap, now I need to remember how to create a new series in the ISO tracker.21:39
Unit193(Eg, added your PPA as a trial for Ubuntu, and forced it in Debian via experimental.)21:40
infinitymwhudson: You know some AAs.21:40
mwhudsoninfinity: i've already pinged you once today and it didn't help yet :-)21:40
infinityDid you?21:40
mwhudsoninfinity: yeah in #ubuntu-release21:40
mwhudsonUnit193: are you saying the build failed with go 1.8 too?21:41
infinitymwhudson: Oh, I don't highlight on mid-line mentions, that way lies madness when your nick is a regular English word.21:41
mwhudsoninfinity: ah ha21:41
* mwhudson files this bit of information away21:41
Unit193mwhudson: https://loki.unit193.net/gocryptfs_1.2.1-0vanir1_i386.build21:44
mwhudsonUnit193: exciting21:45
Unit193(That's not an i386 build, pbuilder names logfiles weirdly when you use qemu-pbuilder.)21:45
juliankinfinity: If you want me in -sru and/or -release, *I* wouldn't mind :)21:45
mwhudsoni was going to say :-)21:45
mwhudsonUnit193: is that qemu-user or system under the hood?21:46
Unit193mwhudson: qemu-debootstrap/qemu-user-static21:46
mwhudsonUnit193: i'm more inclined to blame qemu for that one then21:47
mwhudsonUnit193: i think it's the compiler exploding, not the test suite21:47
Unit193Bah, OK.  I find that believable...Either way, we can find out end of day.21:47
infinityjuliank: I'll ask around for concensus, but I suspect that if you have the time to throw an hour or two at is per week, we'd have no issues with training you up to do so.21:47
Unit193mwhudson: Thanks for chatting!  This build failure keeps emailing me every rebuild. :321:48
mwhudsonUnit193: hee hee21:48
infinityruntime: failed to create new OS thread (have 2 already; errno=22)21:48
infinityUnit193: ^-- Is that the thing you're asking about?21:48
mwhudsonoh eh it fails on ppc64el in the same way?21:49
infinityIf so, qemu-user is notoriously crap at threads.21:49
Unit193infinity: Yeah I saw that, but don't remember if it's a different build or that one..21:49
juliankinfinity: 1-2 hours per week works out fine. I spent more time here today just discussing topics.21:50
mwhudsonwaaait21:50
Unit193mwhudson: Kind of amusing, considering my upload was to fix on all other arches.  And yeah, ppc64el fails too.21:50
mwhudsoni think it's also possible go-fuse is just crap21:50
Unit193mwhudson: This is true.  Debian enabled some tests in git that blows up in pbuilder. :/21:50
juliankAlso, giving me anything to review comes in handy in the 20 minutes between APT CI runs and uploads :D21:51
mwhudson"const PAGESIZE = 4096"21:51
mwhudsonUnit193: yes ok, this is not going to be fixed by the end of the day :-)21:51
Unit193Bleh...Thanks.21:52
juliank(and the time afterwards while I wait and retry failing autopkgtests...)21:52
* juliank sometimes really does nothing else than waiting for autopkgtest results21:52
infinitymwhudson: I can already see jcm flying into an uncontrollable rage.21:54
infinitymwhudson: Assuming that was on arm64. :P21:54
juliankinfinity: The other interesting thing to do is reviewing NEW queues of course, but that's really coupled to an extremely hardcore team :)21:55
juliankAFAIUI21:55
mwhudsoninfinity: i'm sure there's someone at IBM to get angry about it too21:55
infinityjuliank: We're not that hardcore, we just pretend to be on the Internet.21:55
infinitymwhudson: Oh, on behalf of PPC people everywhere, I'm angry any time someone *assumes* pagesize is a constant.21:55
Unit193juliank: Oh, and thanks for the APT SRUs too.21:56
infinitymwhudson: But for arm64, jcm would just be annoyed that you assumed it's not 16k. :P21:56
mwhudsonah haha21:56
mwhudsonwait, 16k?21:56
juliankUnit193: I had to be quick, otherwise xnox would have done SRUs without your patch for ddebs :D21:56
mwhudsoni haven't been paying attention, clearly21:56
infinitymwhudson: 64k.21:57
infinitymwhudson: My fingers don't do well in binary.21:57
mwhudsonok21:57
* juliank always does stuff in 4096 bytes, sorry.21:57
juliankinfinity: The NEW queue for devel is processed by ~ubuntu-archive, right?21:58
infinityjuliank: The NEW queue for all series' is ~ubuntu-archive.21:58
juliankah yes21:58
juliankinfinity: Someone should write that thing up clearly somewhere. and the unapproved queue is a different queue, processed by another team?22:01
juliankIn practice, I only ever deal with the same persons, so I never really see which team is responsible for which part :)22:02
infinityjuliank: unapproved for stables is ~ubuntu-sru and for devel is ~ubuntu-release22:03
juliankthat makes sense :)22:03
=== salem_ is now known as _salem

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!