/srv/irclogs.ubuntu.com/2016/10/27/#ubuntu-devel.txt

mwhudson@pilot out00:03
naccmwhudson: that didn't seem to take? :)00:04
=== udevbot changed the topic of #ubuntu-devel to: Yakkety Yak (16.10) Released | Archive: open | Devel of Ubuntu (not support or app devel) | build failures: http://qa.ubuntuwire.com/ftbfs/ | #ubuntu for support and discussion of precise-xenial | #ubuntu-app-devel for app development on Ubuntu http://wiki.ubuntu.com/UbuntuDevelopment | Patch Pilots:
naccah there it goes00:04
mwhudsonyeah i was wondering00:04
mwhudsonjust slow it seems :)00:05
=== jamesh_ is now known as jamesh
=== hikiko|off is now known as hikiko
cpaelzergood morning05:56
pittiGood morning07:28
Saviqpitti, hey, can you please restart this with all proposed http://people.canonical.com/~ubuntu-archive/proposed-migration/zesty/update_excuses.html#ubuntu-settings-components08:05
Saviqwe're missing a Breaks: there08:05
pittiSaviq: done (you can't use request.cgi for unity?)08:17
Saviqpitti, can I?08:17
pittiSaviq: it checks if you can upload the package -- then you can also retry its tests08:18
Saviqpitti, I think I never had that right - and even if, would it accept all-proposed as a parameter?08:19
pittiSaviq: yes, &all-proposed=108:19
Saviqpitti, ack, don't have the rights to upload anywy08:19
Saviqshould probably work on that08:20
LocutusOfBorgpitti, do you think indicator-location can use a newer llvm? I'm trying to remove llvm-toolchain-3.609:07
pittiLocutusOfBorg: no idea, I'm afraid09:08
LocutusOfBorgack :)09:08
LocutusOfBorghttps://bugs.launchpad.net/ubuntu/+source/indicator-location/+bug/163712809:12
ubottuLaunchpad bug 1637128 in indicator-location (Ubuntu) "please switch to clang-3.8 or newer" [High,New]09:12
LocutusOfBorgdo you know where I can find Mirv?09:16
pittiLocutusOfBorg: normally here, but apparently out today09:20
LocutusOfBorgI asked a qtcreator merge from Debian with a private message, because I want to get rid of llvm-3.609:21
LocutusOfBorgcaribou, hi, did you have time to look at clamav merge?09:22
=== marcusto_ is now known as marcustomlinson
=== hikiko is now known as hikiko|ln
=== hikiko|ln is now known as hikiko
=== Guest21645 is now known as ahasenack
=== ahasenack is now known as Guest91977
rbasakoSoMoN: regarding webbrowser-app in the SRU queue for Yakkety, it seems that there are things in the diff not mentioned in the changelog with no bug reference. Is it bug 1599695 that is missing perhaps?13:25
ubottubug 1599695 in webbrowser-app (Ubuntu) "When running cmake from QtC on a webbrowser-app branch it fails" [High,Fix released] https://launchpad.net/bugs/159969513:25
rbasakoSoMoN: it would be nice if your changelogs made it easier to locate which bits of diffs correspond to which fixes. It isn't at all clear.13:25
barrypitti: ping13:48
barrypitti: i have an interesting autopkgtest question for you13:48
pittihey barry13:51
xnoxbarry, systemd package does boot VMs in the autopkgtest.13:53
pittiok, so xnox knows the answer before barry even asked, well done :)13:54
xnoxpitti, i am speculating =)13:54
LocutusOfBorgis the auto-import from debian working?13:55
pittias for qemu-in-qemu, that works, yes13:55
pittiLocutusOfBorg: not yet enabled; I think it's better to land perl first, to not entangle it with even more transitions13:55
LocutusOfBorgpitti, I guess so, but I would write this in the -release topic13:56
LocutusOfBorgand probably I would transition xapian and boost before :)13:56
LocutusOfBorgxnox, can we have boost1.63 directly? or is it too much work?13:56
LocutusOfBorgthey should have fixed openssl1.1, so we might save some time on the next transition13:57
barryxnox: yeah, no, that's not my question :)13:57
xnoxLocutusOfBorg, boost 1.63 is not released.13:57
barrypitti: is it possible to have different restrictions for different distroseries?  e.g. i needs-root for xenial but nothing newer13:57
pittibarry: no, sorry; a test doesn't actually have a concept of a "distro series" -- it runs in whatever apt config/environment you put it in13:59
pittibarry: you can emulate it by having two Test-Commands: with calling the same test script twice, and then the script runs/skips itself when it's (not) root13:59
pittibarry: but that does sound strange :)13:59
pittibarry: ISTM that this is a decision which should not be done by looking at the release, but at the actual property you need, so that it also works for backports and the like14:00
xnoxbarry, you can have multiple paragraphs in debian/tests/control. one with needs-root, the other one without. And in the test do a check on distro-series, and e.g. exit 0 if run as root.....14:00
barrypitti: i guess the script could test `lsb_release -cs` or some such14:00
pittibarry: I'd strongly advise to not do that14:00
LocutusOfBorgxnox, interesting, the watch file from debian/ picks it up https://qa.debian.org/developer.php?login=smr@debian.org14:01
xnoxbarry, check for the version number of tools that you need to run with root/without root.14:01
xnoxcapabilities, etc.14:01
pittibarry: you can also always start as root, and drop privs to $AUTOPKGTEST_NORMAL_USER if you don't want them14:01
barryxnox: that's what i was thinking but it might not be a good idea.  i know the code is dtrt.  iow, this is a fallback feature14:01
xnoxLocutusOfBorg, up until two weeks ago, we did not have ability to look into subfolders with sourceforge uscan redirector. And hightly builds in boost, use next release final version number.14:02
LocutusOfBorgpicked up by https://sourceforge.net/projects/boost/files/boost/snapshots/develop/14:02
LocutusOfBorgyes indeed sorry for the noise14:02
barrypitti: i really just want to emulate (or maybe actually execute) sudo when in xenial as normal user.  does $AUTOPKGTEST_NORMAL_USER require a password to sudo?14:02
xnoxLocutusOfBorg, read debian-devel =)14:03
LocutusOfBorgxnox, all that spam? :)14:03
pittibarry: that really depends on the testbed; you can of course drop something into sudoers.d/ yourself if you want to guarantee it (but then add breaks-testbed)14:03
barrypitti: i mostly care about a.c.c, but that's not a bad idea14:04
barryor maybe the least bad idea ;)14:04
barrya.u.c14:05
pittibarry: in cloud instances you have passwordless sudo, in lxc you don't14:05
pittibarry: (that's just how it comes by default)14:05
barrypitti: so something i have to arrange to be consistent14:05
barrywhich is okay14:05
pittibarry: but e. g. I sometimes run tests in my sid VM which doesn't have sudo at all (not something you care about, but I don't want to make that kind of assumptions in autopkgtest)14:06
barrypitti: yep, that's entirely reasonable14:06
barrypitti: thanks, that gives me food for thought14:07
rbasakLaney: in your nautilus SRU, AFAICT some UTF-8 in debian/patches/0003-nautilus-canvas-Don-t-lay-down-desktop-icons-if-we-h.patch is unintentionally clobbered.14:49
mpt“ In the ‘C’ locale, the value of decimal_point is ‘.’, and the value of mon_decimal_point is ‘’.”14:51
mptThat can’t be right, can it?14:51
mptAn empty string as a decimal point14:52
mpt(This from <http://www.gnu.org/software/libc/manual/html_node/General-Numeric.html>)14:52
Laneyrbasak: Shucks, I wonder how that happened as I didn't intentionally touch that file14:55
Laneyrbasak: jbicha broke it14:56
Laneyjbicha: I could have pushed my commit if you'd asked, probably just forgot14:56
jbichaLaney: sorry, feel free to overwrite14:56
rbasakThat does look like a documentation bug to me.14:57
LaneyI already pushed another revision14:57
LaneyA documentation bug?14:57
rbasakThat was in response to mpt.14:57
rbasakSorry, I should give more context.14:57
rbasakOops.14:57
rbasakLaney: sorry, I should give more context. :-)14:57
Laneyheh14:57
Laneyrbasak: I fixed it in bzr, can't be bothered to reupload though unless it gets rejected :-)14:57
LaneyThanks for noticing!14:57
rbasakLaney: thank you for the excellent SRU paperwork :)15:00
LocutusOfBorgwow protoc is broken https://launchpadlibrarian.net/291064124/buildlog_ubuntu-zesty-amd64.gobgp_1.12-1_BUILDING.txt.gz15:02
LocutusOfBorgprobably in yakkety too15:02
LaneyI wonder if you can enforce quilt options in the source package15:03
Laney(-p ab reprezent)15:03
jbichaLaney: just patch quilt to change the defaults for everything! ;)15:19
Laneythe xnox method15:20
LaneyI think it was him that was advocating this last week15:20
xnoxyes15:20
rbasakI would appreciate some way of developers using better quilt settings by default.15:20
brendandis launchpad having an issue generating diffs?15:20
jbichaI would like if quilt's patches by default would look more like git's format15:21
mptrbasak, yeah, looks like it15:22
rbasak"-p ab --no-timestamps --no-index" is what I used, from https://wiki.debian.org/UsingQuilt15:22
rbasakIt's the extra diff noise created by no-op quilt refreshes with the default settings that bothers me the most.15:23
xnoxjbicha, GNU patch knows how to apply a few git things; GNU diff does not generate git-format patches; however i wonder if there are low level commands that git exposes such that quilt could use git for diff generation.15:23
rbasakMakes reviewing take longer because I keep having to look up and down past the noise.15:23
jbichayeah, the fact that Step 1 on the wiki is to set those options seems an argument that they should just be made the default15:26
rbasakThere are uses for quilt outside Debian packaging however.15:27
rbasakWe want them the default for packaging uses, but others may want other things for the default when not doing packaging, and they use the package too.15:27
rbasak(presumably)15:27
jbichamake those users set a ~/.quiltrc then! since quilt can't be all that popular outside packaging15:29
xnoxrbasak, i'm all for shipping a sensible /etc/quiltrc or what not.15:30
rbasakFile a bug to change the default upstream? Or in Debian?15:31
sinzuiIs someone about to advise me on a grub configuration to boot an older kernel? http://pastebin.ubuntu.com/23388775/15:41
sinzuirbasak: xnox ^15:42
rbasaksinzui: sorry, all I know is that I've used http://askubuntu.com/a/216420/7808 in the past and it worked for me. You seem to have done it correctly, AFAICT.15:45
sinzuirbasak: Small consolation that I read the docs right15:45
rbasaksinzui: oh, is this on EC2 or something like that?15:46
rbasakIn that case, grub-legacy-ec2 is relevant.15:46
rbasakIf the host is using pygrub or similar.15:46
sinzuirbasak: no, a ppc64el guest on a canonical network15:46
rbasakI don't know if that's also special somehow.15:47
sinzuismoser: ^ any advice on setting  default kernel in a ppc64el guest?15:48
sinzuiOh, I think I need to use the uuid version15:49
smoseri wrote this somewher.e..15:49
smoserwhere did i write it15:49
xnoxsinzui, ubuntu always boots last configured kernel, so you can reinstall/reconfigure the kernel you want to boot and it will boot that by default.15:51
xnox.... until next upgrade15:51
xnoxsinzui, if you don't want to move kernel, and don't want to receive security updates; you can remove the metapackage linux-generic-image or whatever the metapackage you use.15:52
sinzuixnox: yeah, that was the stragey chosen a few months ago. Then I got the problem and want to keep the machine relaibly running15:52
smoseri'm lokign, i wrote this dow. i sear.15:53
Laneypitti: (from #-meeting) b1 calls promote-to-release16:02
pittiLaney: thanks for the hint16:03
pittiLaney: so that's what we'll need to teach about/parameterize for landing to -updates instead of -release16:04
LaneyShouldn't be too hard to poke -updates in there16:04
smosersinzui, https://gist.github.com/smoser/93ba44ed30481df12577#file-boot-kernel is what i have had.16:05
smoserand there is a link in that file to https://statusq.org/archives/2012/10/24/4584/16:07
smoseroh, fudge.16:07
smosersinzui, though, on power8, grub doesnt actually load the kernel16:07
smoserpetitboot does16:07
smoserso i do not know if such mechanisms would work.16:08
sinzuismoser: oh! that explains a lot16:08
naccsmoser: so i think at least some of the backoff you are doing would be specific to the environment; e.g., if `git fetch` fails, retry via a wrapper script to the importer?16:08
smoserit may be a bug in petitboot if it does not.16:08
smosernacc, i'm not working on backoff, just suggested that we shoudl probably do that.16:08
naccsmoser: right, but i mean in at least some cases, it's not an importer issue, but a how-you-run-the-importer (or where) issue16:09
rbasaksmoser: should the grub package even be installed in that case?16:10
rbasakSeems a bit misleading.16:10
naccpetitboot is only the bootloader in powernv mode16:11
smosernacc, i'm not convinced that i have a flakey network16:16
oSoMoNrbasak, sorry if it’s not clear. the changelog mentions two bugs, which correspond to the two revisions in the SRU branch: https://code.launchpad.net/~osomon/webbrowser-app/16.10-SRU1/+merge/30848716:16
smoseruntil someone shows me other wise.16:16
smoserie, if reliability is an issue on the launchpad api side,then we shoudl fix better16:16
oSoMoNrbasak, https://bazaar.launchpad.net/~osomon/webbrowser-app/16.10-SRU1/revision/1543 fixes https://launchpad.net/bugs/1632620 and https://bazaar.launchpad.net/~osomon/webbrowser-app/16.10-SRU1/revision/1544 fixes https://launchpad.net/bugs/163343916:16
ubottuLaunchpad bug 1632620 in webbrowser-app (Ubuntu Yakkety) "No audio from webbrowser-app in 16.10" [Undecided,Confirmed]16:16
ubottuLaunchpad bug 1633439 in webbrowser-app (Ubuntu Yakkety) "FTBFS on yakkety arm64: Invalid chromium version: ''" [Undecided,New]16:16
smoserrbasak, grub is installed because it is what writes the files that petitboot reads16:16
smoserpetitboot parses grub2 config files16:17
rbasaksmoser: ah16:17
smoserto some extent.16:17
naccsmoser: i ran the exact command you ran on my machine at home and it worked without any exception16:17
smoseri'm not sure whether or not it works for the "set default" and stuff.16:17
naccsmoser: i'm not sure it's my responsibility to debug a bad network (given you've seen other network issues)16:17
smosersinzui, so the best thing for you to do on that system that has to stick on a kernel is probably just to only install that kernel or remove the meta-packages tahtt woudl get you new ones.16:17
rbasakoSoMoN: where, for example, do all the changes in ua-overrides-desktop.js.in come from?16:17
naccsmoser: what i'm asserting is that it's not appropriate for the improter to generically retry `git fetch` 3 times16:18
smosernacc, no. i've not seen any other network issues.16:18
smoseri said the networking is not straight forward, we're using http proxy and such16:18
smoserbut i've never seen other things error as a result16:18
naccok16:18
sinzuismoser: yeah, I am doing that as xnox suggests. Not the best solutiuon, but it guarantees repeability16:18
smosersinzui, you maybe shoudl file a bug against petitboot16:19
smoserhttps://github.com/open-power/petitboot16:19
sinzuithank you for the pointer smoser16:20
oSoMoNrbasak, that’s https://bazaar.launchpad.net/~osomon/webbrowser-app/16.10-SRU1/revision/154416:20
smosersinzui, 'grep -r grubenv' on that git checkout *does* show some hits16:20
smoserso maybe they're  trying.16:20
smoserhave you actually tried the grub-set-default path ?16:20
rbasakoSoMoN: I don't understand why that fixes an FTBFS.16:21
rbasakoSoMoN: and I feel that this should be explained somewhere, eg. in a commit message, or in the SRU paperwork.16:21
oSoMoNrbasak, running qmlscene inside xvfb at build time to determine the chromium version oxide is built upon proved to be unreliable, this change dynamically replaces the chromium version at runtime instead16:22
rbasakoSoMoN: so you're changing runtime behaviour? I feel that this should be called out in the "Regression Potential" section of the bug!16:24
oSoMoNrbasak, bug #1633439 mentions the original issue which was bug #1599695. I filed a new bug report precisely to make it clearer in a SRU context16:24
ubottubug 1633439 in webbrowser-app (Ubuntu Yakkety) "FTBFS on yakkety arm64: Invalid chromium version: ''" [Undecided,New] https://launchpad.net/bugs/163343916:24
ubottubug 1599695 in webbrowser-app (Ubuntu) "When running cmake from QtC on a webbrowser-app branch it fails" [High,Fix released] https://launchpad.net/bugs/159969516:24
rbasakoSoMoN: OK, so IMHO, that should be one bug with a task for each release. I think I follow now, thank you for the explanation.16:25
rbasakbdmurray is sponsoring my SRU work so I'm not sure what exactly to ask for next.16:25
rbasakI think I'd want clarity in the bug for whoever handles the SRU next.16:26
oSoMoNrbasak, sorry for the confusion, I can see how it’s far from being obvious16:26
oSoMoNrbasak, I’ll update the bug description to hopefully make it clearer16:26
rbasakPerhaps dupe the bugs? I'm interested in bdmurray's opinion first though, before I ask you to make changes - since I won't be the one accepting it.16:26
rbasakThanks16:26
naccsmoser: is it easy for you to retry the failures with master? (has a more generic retry on pull failure)16:29
bdmurrayoSoMoN: I think just using bug 1633439 is fine, but it'd be good to add test case information with sites to test that need the UA changes working.16:30
ubottubug 1633439 in webbrowser-app (Ubuntu Yakkety) "FTBFS on yakkety arm64: Invalid chromium version: ''" [Undecided,New] https://launchpad.net/bugs/163343916:30
smosernacc, sure. i can just rm -Rf * and go again16:30
naccsmoser: ok, let me look at a few more of the cases here, but that should, i think, catch the OSError ones if they are transient16:31
smoserdoes master have my fix ?16:31
smoserfor utf-816:31
naccwe could bump the retry limit, too16:31
naccsmoser: no, let me merge it if you've tested it now16:31
smoserdefinitely need *some* sort of backoff16:31
smoserwhat is there shoudl be good. i've tested it with 'gmp' which is what originally failed16:31
naccack16:32
smoserlet me check though16:32
smoserthat it has commit messages :)16:32
smoserrather than ''16:32
naccour current 'retry' is just to try 3 times, do you want me to add a sleep in between each retry?16:32
oSoMoNbdmurray, I’ve just done that, in the [Regression potential] section of the description I’ve explained how to verify16:35
naccsmoser: e.g., http://paste.ubuntu.com/23389014/ ?16:38
smosernacc, looks fine. http://paste.ubuntu.com/23389019/16:38
smosernacc, how long is that sleeping ?16:39
smoserwhats the range there16:39
naccsmoser: the iteration count (i in 0-2)16:39
naccsmoser: so a second to 4s, with fuzz16:39
smoseri dont thin it has to be random. but some sleep is important for sure.16:39
naccwe can start with this, let's see if it helps a bit16:40
naccsmoser: looks good, the MR is good to merge then?16:41
smoseryeah16:41
smosernacc, one random feature i'd like..16:42
smoseris for a download cache outside of the workign directory for the package16:42
naccsmoser: yes, that's one of the things we've talked about adding to the repository itself16:42
smoserso that i could have a directory full of the thign that got downloaded (.dsc and .tar.gz and such) elsewhere.16:42
smoserto the repository ?16:42
smoseri personally do *not* want pristine-tar16:42
smoseras i think that makes size of git repo go up dramitically16:43
naccthere are ways, i believe, of caching recent versions in .git16:43
slangaseksmoser: have you measured this?16:43
slangasekpristine-tar should provide very small deltas vs. the branches16:43
smoserslangasek, no.16:43
smoserslangasek, thats possible. its also possible that it doesnt really work.16:43
naccsmoser: the other reason to go the pristine-tar route is compatibility with other tools16:43
naccsmoser: but i'd file a bug (agains the importer) :)16:44
smoserand i've pulled enough massive bzr trees to have non-scientific data making me think it sucks.16:44
naccsmoser: master updated16:44
sinzuismoser:  virsh is unhappy still on borbein: I see mesages about SMT. Do you have any insights http://pastebin.ubuntu.com/23389036/16:44
smosersinzui, http://bazaar.launchpad.net/~smoser/+junk/powerkvm-install/view/head:/setup-ubuntu16:45
smoserrun that16:45
slangaseksmoser: bzr itself seems to have never been as tight as git; I wouldn't attribute this to pristine-tar16:45
naccsinzui: smt needs to be off in the host to start the VMs16:45
smoserslangasek, i said non-scientific data.16:45
smoser:).16:45
smoserif we want to add support to the importer, i'll run a big batch of uploads and compare .git16:45
slangasekyeah, which is why I'm pushing back against the pristine-tar hate ;-)16:45
smosereven if it were a small delta16:46
smoseri'd be bothered.16:46
slangasekheh16:46
smoseri need to pull exactly one tarball, not the entire history of them16:46
smoserbut yeah, i'd be happy to be shown wrong by data16:46
slangasekpulling a tarball + pulling a git branch, vs. pulling a git branch + pulling a set of small deltas16:46
smosertheories are nice . you have one , i have one :)16:47
sinzuithank you nacc I am setting it off16:47
smoseri very well could be wrong.16:47
slangasek:-)16:47
smosernacc, i committed 'returning ...' a debug message i think16:47
smoserdid you pull that?16:47
naccsmoser: bah, can i elide that line?16:48
naccsmoser: master updated16:50
smosernacc, you should print the error message at very least16:51
smoserand WARN it16:51
smoserso we can look for the actual error message even if we recover16:51
naccsmoser: so next time when i ask if your MR can be merged, just say no.16:52
nacc:)16:52
rbasakslangasek: I thought pristine-tar was considered fundamentally broken and deprecated?16:52
naccsmoser: what error message are you referring to? that's just printingout the changelog entry extracted from the tree?16:52
slangasekrbasak: it has fundamental limitations; joeyh "deprecated" it, but it still has a maintainer and is widely used and the limitations haven't been a problem yet in practice16:53
smosernacc, sorry... in your 'except Exception'16:56
smosershoudl warn that16:56
smoseron the retry16:56
naccsmoser: oh duh, yeah16:56
* smoser notes how slangasek was quite on the whole "fundamentally broken" front when smoser was throwing hate16:57
smoser:)16:57
naccsmoser: what do you want me to warn? that we are retrying? so make that warn rather than print?16:57
naccsmoser: or do you want the actual exceptoin?16:57
naccwe'll raise it eventually if we can't recover16:57
slangaseksmoser: it's not fundamentally broken; it has a fundamental /limitation/16:58
smosernacc, 2 things16:59
smosera.) you might catch different onces16:59
smoserb.) you might recover16:59
smoserin both cases i want to see all the possible failure paths, not just the last.16:59
naccand i was going to say in b) i'd rather we didn't print anything :)17:00
naccit's irrelevant to an end-user if we do recover17:00
smoseryou can log.debug it if you want17:00
naccso i'd say it should be debug , if that's good by you?17:00
smosersure.17:00
naccsmoser: is logging.debug(e) sufficient (given Exception as e)? Or do i need to format a string?17:02
slangaseksmoser, nacc: that limitation is that to reconstitute the orig.tar.foo from the pristine-tar branch requires a version of tools (tar, xz, gzip, ...) whose output is byte-for-byte equivalent to the one that was used at the time the pristine-tar delta was generated.  However, /in practice/, there haven't been any changes in any of the outputs since pristine-tar use began; and if there were, I17:03
slangasekunderstand the pristine-tar maintainer is committed to providing the necessary glue (probably bundling older versions of the tools, or something)17:03
smosernacc, logging.debug("Source Package Download Error: %r", e)17:04
smoser?17:04
naccslangasek: yeah that's what i've read as well (in learning about the debian tools)17:04
naccsmoser: ack on that17:04
naccsmoser: master pushed17:21
smosernacc, i got to run for a bit. will try later.17:30
naccsmoser: ack17:31
smosernacc, i thought you were saying you didnt want to print anything.18:22
smoseroh... i see you didnt print the error message. only logged that. you did print a 'Failed to pull'...  i thought you were suggesting only do anything like that on failure (2 fails)18:23
naccsmoser: i see what you meant earlier, which was the reason for failure could vary19:37
naccsmoser: so i compromised :)19:37
smosersinzui, just for completeness https://github.com/open-power/petitboot/issues/2420:51
smoserthat fix would have to get into our firmwares, so its not coming any time soon20:51
sinzuithank you smoser20:51
roaksoaxsmoser: you should scalate that to push for a fix21:07
smoserroaksoax, i'll scalate that!21:09
pittirobru: did you change something in bileto wrt britney integration since yesterday or so?21:16
robrupitti: maybe, why, what's up?21:17
pittirobru:  the infra is getting bombarded with hundreds of identical content-hub and unity8 requests21:17
robrupitti: for zesty?21:17
pittiI killed the content-hub ones this morning and just now the unity8 ones (both are very expensive and block the infra, and we need it for zesty)21:17
pittirobru: all releases21:17
pittirobru: e. g. look at http://autopkgtest.ubuntu.com/running#queue-ppa-zesty-i38621:17
pittiand the following ppa xenial amd6421:18
robrupitti: I've been iterating at the db schema for the last few days, nothing that should really impact britney so much...21:18
robrupitti: https://bileto.ubuntu.com/static/britney/last-run.txt one thing I noticed is that zesty results.cache 404s so maybe it's retriggering tests that it doesn't know already started?21:18
robrupitti: should I turn on debug logging?21:18
pittifour identical ubuntu-settings-components requests, three content-hub on amd64 (the fourth has a different trigger)21:18
pittirobru: ok, that would explain zesty, but why v/x?21:19
robrupitti: I dunno, did your autopkgtest-as-policy thing land yet? that would be my only guess, if there was a bug in that21:19
pittirobru: and that's not the state of "I already requested this test", that's pending.json and your britneys  have their own21:19
pittirobru: it did land, yes; it didn't change the pending.json, but it could be the time when this started21:20
pittirobru: anyway, I'll symlink a zesty results.cache for now21:20
rcjslangasek, Could you take a look at a livecd-rootfs mp? https://code.launchpad.net/~rcj/livecd-rootfs/zesty_grub/+merge/309517 It resolves a cpc zesty images build breakage for amd6421:22
pittirobru: so, too late to debug this now, but if you could turn on verbosity that'd be useful; I killed all PPA test requests for now, but I have a feeling they'll come back by tomorrow..21:23
pittiso I could check in the morning21:23
rcjcyphermox, ^ in bug #1624096 it says you're backporting from zesty.  Will the shim/shim-signed file names remain constant during the backport?  Hoping so.21:23
ubottubug 1624096 in shim (Ubuntu) "yakkety: backport (or rebase to) fix eliminating a double-close in shim" [High,Fix released] https://launchpad.net/bugs/162409621:23
robrupitti: ok will do. I'm reviewing my recent changes in iterate.py and I don't see anything substantial (it's just changing what json dict key names it accesses)21:24
rcjOr maybe I got the root cause incorrect.21:24
pittirobru: ok, not that then I figure; it looks like britney would lose/not write her pending.josn21:24
pittibut verbose log should tell21:24
robrupitti: ok, just turned it on. should see verbose logs in an hour or so. goodnight!21:25
pittirobru: cheers!21:25
pittiuntil then it hopefully chewed through the zesty queues21:25
slangasekrcj: the filenames will change in the backport.  maybe we should try to figure out how to make this hook use grub-install, instead of hard-coding the filenames?21:32
pittirobru: they come back faster than I can kill them; I temporarily disabled PPA queue consumption in the workers, this needs to be sorted out first21:34
robrupitti: ok so no autopkgtests for bileto for today?21:35
pittirobru: it's zero or infinitely many :/21:35
pittino updated last-run.txt yet, need to wait for that21:35
pittirobru: actually the policy refactoring happened on Monday already21:41
pittirobru: what did change yesterday was the removal of the backwards compat "tests/autopkgtest/" in the JSON21:41
robrupitti: ah ok, got busy with other stuff, I'll try to finish up sourceppa quick21:41
pittibut I thought that wouldn't have an effect on bileto as it was only grepping the .json for REGRESSION or RUNNING21:42
pittiand it shoudln't affect the pending.json handling anyway21:42
robrupitti: well bileto only uses the json to summarize it, there's no code in lp:bileto that would trigger autopkgtests from the json21:42
pittiright21:42
robruor yaml rather21:43
pittiso, anyway, let's wait for the log; I don't have an off-hand idea what's wrong21:43
rcjslangasek, I don't have history here.  I thought we had issues doing that in the build environment for grub uefi?21:46
robrupitti: ok it's starting: https://bileto.ubuntu.com/static/britney/log_2016-10-27_21:40:02.txt21:46
robrupitti: indeed the log says pending.json doesn't exist, it doesn't indicate writing one though21:48
slangasekrcj: grub-install --target=x86_64-efi --no-nvram and your uncle is your namesake21:48
rcjslangasek, I'll give that a go then.  Thanks.21:49
slangasekrcj: oh, --uefi-secure-boot in there also21:49
rcjslangasek, We do that not 10 lines later.  Hmmm.21:50
slangasekhuh ;)21:50
pittirobru: hm, that's bad -- in e. g. http://people.canonical.com/~ubuntu-archive/proposed-migration/log/zesty/2016-10-27/21:12:07.log it does say that ("Updating pending requested tests in data/zesty-proposed/autopkgtest/pending.json")21:51
pittirobru: oh, maybe it calls save_state() in the second stage only, which gets shortcut in bileto?21:51
robrupitti: second stage?21:52
pittirobru: that would make sense, given where it appears in ubuntu's logs21:52
rcjslangasek, Do you think we can just drop the cp's on lines 73-75 since we're running grub-install on line 85 http://bazaar.launchpad.net/~ubuntu-core-dev/livecd-rootfs/trunk/view/head:/live-build/ubuntu-cpc/hooks/033-disk-image-uefi.binary#L6421:52
robrupitti: well I guess I configured britney wrong then? Can you find a problem here: https://git.launchpad.net/bileto/tree/britney/britney.conf.in21:52
pittirobru: no, you didn't configure it wrong, it's just that the save_state() policy isn't being called with your config21:53
pittirobru: but we actually want that to work (like before) to not run the seocnd-stage installability tester for you21:53
slangasekrcj: yes, as that's exactly what grub-install is supposed to do for you21:53
pittirobru: (care to take the BOOTEST out of that :) )21:53
slangaseks/do for/encapsulate for/21:53
robrupitti: ok. not clear to me why save_state isn't being called21:54
pittirobru: so I think I know how to reproduce; setting UPGRADE_OUTPUT and HEIDI_OUTPUT to an empty value is how we agreed to disable those21:54
pittirobru: thanks for your help, I think I have enough info now21:54
rcjThat's what I would think. So only explanation was that it wasn't odd in this env.  Where did this cp come from?21:54
slangasekrcj: NB the grub_modules line is also pointless for amd64, a secureboot install doesn't let you add extra modules21:54
slangasekrcj: also that shim copy never worked right, /boot/efi/EFI/BOOT/shimx64.efi would never be used (the right filename is bootx64.efi)21:55
rcjhah21:55
rcjEnlightening.21:56
rcjI'll have a proper MP over tomorrow after running it through.  And thank you slangasek.21:56
pittirobru: reproduced22:01
robruyay22:01
pittirobru: i. e. you can flip off verbosity again (if you care about the space, etc.)22:02
robrupitti: ok thanks, I may leave it for a bit.22:02
pittirobru: or you can as well halt the britneys for now, as they'll just wreak havoc22:02
robruoh right22:03
robruok22:03
pittirobru: so at least we won't lose anything -- for rollout we: (1) clear all current test requests, (2) roll out new britney, (3) next run (without pending.json still) will regenerate all requests22:03
pittiI can do (1) easily, (2) happens automatically on your side22:04
robrupitti: ok britney will be disabled shortly22:04
pittiI have a fix22:06
cyphermoxrcj: sorry, I was distracted doing confusing work -- let me know when you have your livecd-rootfs change ready tomorrow and I'll be happy to review / merge it.22:15
cyphermoxfwiw I'm very much considering installing shim to /boot/efi/EFI/BOOT/BOOX64.efi by default as well as to the standard path, so that most setups work; but it will need to be done carefully22:15
cyphermox(bootx64.efi and fbx64.efi along with a boot.csv in the right place will make fallback work correctly, but I'm worried about breaking Windows dual-boot)22:15
pittirobru: fix pushed; you can update britney (needs reset-hard, I force-pushed) and let it run22:16
pittirobru: sorry for the trouble22:17
robrupitti: no worries, thanks for the fix22:17
pittirobru: queues are clear; are there any currently running britneys after which I'll need to clean up again?22:18
pittirobru: I also must remove the "ignore PPA queues" hack from the workers, once everything is in place22:19
robrupitti: uh, yeah, https://bileto.ubuntu.com/static/britney/log_2016-10-27_21:40:02.txt is still going, not sure how many more it will trigger...22:19
=== grumble is now known as zomble
pittirobru: it now says "2016-10-27 22:21:08.969906 Completed in 0:41:06.929510."22:23
pitti?22:23
robrupitti: ah ok, it's disabled now, but the last run shown happened after you asked22:24
pittirobru: ok, seems quiet enough now; I put everything back to normal and drained the queues once more22:29
pittirobru: I don't really want to wait another hour for the next run, but if we get a handful of duplicated tests now, it's not the end of the world22:29
robrupitti: ok, safe to reenable?22:29
pittiI'll check tomorrow morning22:29
pittirobru: yes, as long as that updates britney22:29
robrupitti: yeah that's automatic22:30
robrupitti: HEAD is now at 4bc71e0 Drop backwards compatible autopkgtest excuse YAML structure22:30
pittirobru: that's the one22:31
pittirobru: the tame version of britney :)22:31
pittirobru: cheers!22:31
robrugreat22:31
* pitti waves good night22:31
robrupitti: goodnight22:31
mwhudsoncan someone set me straigh on how long i have to wait after publication before a build will use the built packages?22:35
mwhudsonhttps://launchpad.net/ubuntu/+source/golang-1.7/1.7.3-1ubuntu2 <- published an hour ago22:36
mwhudsonhttps://launchpad.net/ubuntu/+source/golang-context/1.1-1ubuntu4/+build/11088333 <- started 5 minutes ago but built with 1.7.3-1ubuntu122:36
mwhudsonslangasek: ^ ?22:36
slangasekmwhudson: you don't have to wait at all, after /real/ publication; but launchpad reports "published" at the start of the publishing cycle on ftp-master, which is $time before the new version is visible on the internal ftp mirror22:36
sarnoldmwhudson: I've heard "over two hours" earlier today...22:36
mwhudsonslangasek: hnngh22:37
slangasekmwhudson: so if you care about this you should either poll your local ftp mirror to check it's availability, or (slower to update but a less expensive poll) check rmadison, or add a versioned build-dep so that the package dep-waits22:37
mwhudsonso i should wait until i see a "published" time on lp that's more recent than the published time for the builds i care about22:37
slangasekhowever, 2 hours is unreasonably long, there must be something wrong on the infra side - sarnold who was discussing this?22:38
mwhudsonwhich would imply another publisher cycle has begun22:38
mwhudsonslangasek: yeah, i guess i should be adding a versioned dep really22:38
slangasekinfinity: do you know of any problems with pepo today? ^^22:38
slangasekmwhudson: if it's working around a bug in a previous toolchain, that's usually not the preferred way, but it's better than nothing22:39
sarnoldslangasek: chris coulson, he said he was waiting ~two hours for firefox and thunderbird earlier today22:39
slangasekhmm22:39
mwhudsonwould make my shell script considerably more frigtening though...22:39
slangasekthere ought to be a way for us to set dep-waits explicitly through the API22:39
sarnoldslangasek: mdes laur also mentioned his nginx regression fix took a long time but he didn't give any numbers22:39
slangasek(maybe there is and I just don't know it)22:40
infinityslangasek: pepo's in the process of deleting lucid from /pool/, so it's likely in deep iowait.22:40
mwhudsonslangasek: yeah, it's a toolchain bug, adding versioned deps for this seems like it would be noisy22:40
slangasekinfinity: aha22:40
infinityslangasek: A publisher run is just finishing up right now.22:40
sarnoldouch that's a big delete :)22:40
infinityBut the load is through the roof, unsurprisingly.22:41
mwhudsonwe don't have PCI flash for our archive mirrors yet? :)22:41
mwhudsonor one of those PCI-attached DRAM things22:41
infinityLooks like this current publisher cycle is going to clock in at just over an hour.22:42
slangaseksomeone told IS disk is cheap; so they gave us cheap disks to teach us a lesson22:42
mwhudsonhahahahaha22:42
sarnoldmwhudson: funny enough, pcie nvram is still quite slow onthe scale of things.. only like five times faster than regular sata ssd. 2.5 GB/s rather than RAM's 40-60 GB/s ...22:42
infinitymwhudson: The mirrors have all sorts of fast, pepo itself doesn't.22:42
sarnoldslangasek: lol22:42
infinityslangasek: build.dependencies is writeable, so it is in theory one could twiddle them via the API.22:44
naccsmoser: do you have an updated set of the import-the-world failures with master?22:44
infinity(This didn't used to be true when the feature was first implemented, I've never tried since)22:45
slangasekinfinity: ok now I know for the next time I have to do a ghc transition, ugh :)22:45
infinityslangasek: Note that I've never attempted to write it from the API, I'm only trusting the docs to be accurate. :P22:45
nacccpaelzer: smb: do you have any patches pending for sru of qemu to xenial?22:46
infinityslangasek: And "writeable" is pretty ambiguous, as it likely has strict permissions set as to *who* can write it.22:46
slangasekphooey22:46
infinityslangasek: But worth a try on a pending build somewhere.22:47
mwhudsoncan you specify it when you create the build?22:47
mwhudsonor would you have to race the build starting?22:48
mwhudsonis there an ETA for debian autosync starting again?22:48
slangasekor cancel the build, then set it?22:48
infinitymwhudson: Well, you don't create the build...22:48
mwhudsoninfinity: true22:48
infinityslangasek: cancel/set/retry won't work, because of the way retry is implemented currently.22:48
slangasekinfinity: it wouldn't auto-retry once the dep-wait clears?22:49
infinityslangasek: (retry pretty much blats the record to fresh, it's the thing we need to fix/mangle a bit to satisfy the wishlist for log history too)22:49
infinityslangasek: Oh, ISWYM.  So, buildstate is also writeable (likely by the same permissions as dependencies), so you could cancel the world, then set the state to depwait and set dependencies, and that would likely DTRT.22:50
* mwhudson tries to remember how launchpad permissions works to figure out who can write to build.dependencies, gets lost, gives up22:55
slangasekand dependencies is a flat string?22:58
slangasekwell, 401 for me23:01
naccsmoser: fyi, timestamps adding to logging23:02
nacccpaelzer: fyi, usd-merge now should report a proper RC for that case23:02
naccsmoser: the apt issue is that the usd-import-team repo is missing all the tags23:39
naccand i think the older pygit2 doesn't handle that as well23:39
naccsmoser: im going to reimport apt and refresh the import-team repository23:54
mwhudsonwhat now?23:59
mwhudsonhttps://launchpadlibrarian.net/291117596/buildlog_ubuntu-zesty-ppc64el.golang-context_1.1-1ubuntu5_BUILDING.txt.gz23:59
mwhudson-> Depends: debhelper (>= 9) but it is not installable23:59
sarnolddoesn't -everything- depend on debhelper (>=9)?23:59
mwhudsonand it built on amd64 against 1.7.3-1ubuntu1 even though i checked on archive.ubuntu.com23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!