/srv/irclogs.ubuntu.com/2016/04/27/#ubuntu-release.txt

cjwatsoninfinity: I think actually three busted nodes.  The thing with Cleaning is that if a lot of instance resets are sitting there for minutes failing to boot, then they can starve the instance reset workers of resources.00:00
* infinity nods.00:01
infinitycjwatson: Has anyone managed to come up with a reproducer that we can throw at IBM and say "fix, pls"?00:01
cjwatsonNot to my knowledge.00:02
infinitycjwatson: Like some sort of "run qemu in a loop really fast and watch the world burn" thing?00:02
tewardinfinity: are autopkgtests taking eons or is it just me?00:02
cjwatsonI believe William tried that kind of thing and failed to come up with a reproducer.00:02
infinityteward: Everything is taking eons, welcome to autosync.00:02
cjwatsonteward: Look at the queue lengths on http://autopkgtest.ubuntu.com/running.shtml00:02
tewardheheh00:02
infinityteward: You'd be better off ignoring reports and migrations and such for a couple of days, it's lower stress that way.00:03
tewardcjwatson: eww00:03
cjwatsonDon't expect stuff that lands on the end of it to come out very soon00:03
tewardinfinity: ack, thanks for accepting the SRU (with the pending yakkety-proposed -> yakkety migration being stuck)00:03
infinityteward: yakkety'll get there eventually.  Just stop babysitting and find something more fun to do. :)00:03
cjwatsonI would be astonished if migrations weren't mostly stuck right now. :-)00:03
tewardinfinity: was actually just checking is all, though what the running page shows and proposed migration excuses show don't match :p00:04
* teward was just curious00:04
tewardI was more concerned about that SRU than I was yakkety, 'cause Yakkety will land eventually :p00:04
infinityteward: excuses shows the state as of the last time it was generated.  Which was a while ago.00:04
infinity(Because everything is slow right now, blah blah)00:04
tewardheheh00:06
tewardindeed00:06
cjwatson[6~[6~$ curl -s http://people.canonical.com/~ubuntu-archive/auto-sync/2016-04-26/20:00:02.log | grep Updated: | tr -s ' ' | cut -d' ' -f200:10
cjwatson282400:10
cjwatson$ curl -s http://people.canonical.com/~ubuntu-archive/auto-sync/2016-04-26/20:00:02.log | grep Updated: | tr -s ' ' | cut -d' ' -f200:10
cjwatson282400:10
cjwatsonSigh, sorry for the dup00:12
=== Patrick is now known as DrunkPat
Laneyxnox: I should say it's because there are NBS packages in yakkety which are bad, for example libboost-context-dev.01:53
=== DrunkPat is now known as Patrick
mapreriinfinity: ! thank you ♥08:41
xnoxLaney, found it09:18
xnoxdoko, pitti - please cleanup NBS of boost-defaults on s390x, as in please remove09:19
xnoxlibboost-coroutine-dev 1.58.0.1ubuntu1 s390x09:19
xnoxlibboost-context-dev 1.58.0.1ubuntu1 s390x09:19
pittixnox: hm, that's not on http://people.canonical.com/~ubuntu-archive/nbs.html ?09:19
xnoxpitti, it's NBS on some arches only. It is built practically everywhere, apart from a few niche arches.09:20
xnoxpitti, e.g. it is valid on all other arches....09:20
pittiwell yes, but the nbs report is supposed to have that09:20
xnoxpitti, there is libboost-doc 1.58.0.1ubuntu1 yakkety all too09:22
xnoxfrom rmadison09:22
pittixnox: removed09:28
xnoxdoko, pitti, infinity - could you please promote libboost-random1.60.0 and libboost-regex1.60.0 to main?10:12
xnoxotherwise ceph will not migrate...10:12
xnoxhttp://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#ceph10:12
pittiah yes, it's on http://people.canonical.com/~ubuntu-archive/component-mismatches-proposed.txt10:12
dokopublisher runs are slooowwww10:13
pittierr, wait -- libboost-random1.60.0 does not exist at all in rmadison10:13
pittisorry, looked in xenial10:14
xnox>_<10:14
* xnox was like surely the world would be on fire10:14
pittiyeah, publishers, testing, everything will be a tarpit for the next days10:14
pittirmadison is also dog slow, FWIW10:14
pittixnox: so why is change-override yelling at me10:15
pitti$ change-override -s xenial-proposed -c main libboost-random1.60.0 libboost-regex1.60.0 libdatrie1-udeb libthai-data-udeb libthai0-udeb10:15
xnoxpitti, s/xenial/yakkety/ ?10:15
pittidon't say anything10:15
pittixnox: same error, though10:15
pittilputils.PackageMissing: Could not find binaries for 'libboost-random1.60.0/None' in yakkety-proposed10:15
pittiah, that's already in yakkety10:15
pittithis is utterly confusing10:15
pittipromoting some binaries in -proposed, some in -release, and hoping that LP/britney will DTRT on landing -proposed packages10:16
dokooutdated reports?10:16
pittixnox: ok, promoted the lot in y-release; I hope that shines through to yakkety-proposed, let me know if it still doesn't work in an hour or so10:17
xnoxdoko, not really. thanks to my patches to britney components missmatches must be satisfied before things migrate.10:17
xnoxthus e.g. one has to promote things in -release, for packages to migrate from -proposed to -release if they pull new things into main.10:18
xnoxpitti, ok, thanks.10:18
=== s8321414_ is now known as s8321414
mdeslaurinfinity: did anyone answer you yesterday? it's scrolled out of my scrollback buffer, what was it for, apt?11:05
mdeslaurinfinity: oh, looks like you did it, never mind11:05
Odd_BlokeIf someone could migrate gce-utils from (partner) xenial-proposed to xenial, it would be much appreciated. :)11:06
xnoxErr:11 http://ddebs.ubuntu.com yakkety-updates Release12:44
xnox  404  Not Found12:44
xnoxpitti, ^ is that normal? =)12:44
pittixnox: I'm getting similar errors from the ddeb-retriever builders since yakkety's creation; I haven't investigated that yet12:51
pittii. e. ddeb-retriever cannot find yakkety-updates indexes on the archive (which I don't understand, they are there)12:51
xnoxack.12:51
xnoxpitti, ceph looks good now, it now progressed to scheduling autopkgtests....12:52
pittixnox: so, on my list, but not top prio12:52
xnox600 more armhf builds to go, 2k autopkgtests and can start investigating fall out =)12:52
pitti600? that was quick12:53
pittixnox: ah, it's more like 1900 :)12:54
xnox600 builds to go on https://launchpad.net/builders =) 2k autopkgtests pending ;-)12:54
pittioh right, sorry12:55
pittixnox: yeah, isn't opening week fun :)12:55
pittixnox: we had > 5000 tests per arch this morning, I already short-circuited most of the perl ones12:55
xnoxcheat12:56
pittiwell, it wasn't a new upstream release or so, just a debian rev with three relatively small chagnes; so running only some tests was good enough12:56
pittiotherwise doko would haunt me for not landing anything at all any more :)12:57
=== s8321414_ is now known as s8321414
=== Laney is now known as seb128smum
=== seb128smum is now known as Laney
Odd_BlokeShould amd64/i386 be absent from http://cdimage.ubuntu.com/releases/16.04/release/ ?13:40
xnoxyes13:41
xnoxOdd_Bloke, amd64/i386 is on releases.ubuntu.com13:41
Odd_Blokexnox: Of course, how silly of me. ;)13:41
xnoxOdd_Bloke, think [archive|ports].ubuntu.com13:41
Odd_Blokexnox: Ack, that's helpful, thanks.13:43
cjwatsonpitti: it occurred to me that the ddeb-retriever errors are maybe it complaining about its own archive, not archive.u.c?13:50
cjwatsonpitti: since it is indeed true that /srv/ddebs.ubuntu.com/www/dists/yakkety-updates/ doesn't exist13:50
=== s8321414_ is now known as s8321414
xnoxcjwatson, pitti - my compaint is about ddebs.ubuntu.com missing yakkety-updates initialisation.14:19
xnoxalso xenial-security is missing14:19
pittixnox: yes, understood14:19
xnoxhuh, -security is missing on all after trusty14:20
pittixnox: -security isn't a thing on ddebs14:20
xnoxok14:20
pittiwe always immediately copy -security to -updates14:20
pittifor better mirror load14:20
xnoxthen just yakkety-updates was not (yet) created on ddebs.14:21
pittiinfinity, slangasek: can you please have a look at my last comment in bug 1547466 ? i. e. do you agree that we should just SRU grep 2.25 wholesale or should I continue monkey-patching this?14:53
ubot5bug 1547466 in grep (Ubuntu Xenial) "grep switches into binary mode while processing a text file" [Undecided,In progress] https://launchpad.net/bugs/154746614:53
stokachuis getting a MRE for my packages the way to go in order to have newer features (in addition to bug fixes) approved for xenial? packages im referring to are in universe (conjure-up, bigdata, openstack)14:55
infinitypitti: I'm inclined to agree with the "just update to 2.25" position.15:59
slangasekstokachu: an MRE is specifically intended for upstreams that do bugfix-only releases.  We do make other exceptions for featureful upstream releases but they are more exceptional16:00
slangasekpitti: given that we seem to have landed on a lemon of a release with grep 2.24 I'm ok with 2.25 in principle, but how do you propose to regression-test this?16:01
stokachuslangasek: ok, specifically in conjure-up, openstack case is there something I need to file with the TB to get an exception for new features?16:01
stokachuthey are listed as part of juju's exception process so i wasn't sure if i needed to do anything else16:02
slangasekstokachu: "listed as part of juju's exception process"?16:04
slangasekstokachu: the TB has ruled that the SRU team has the authority to make their own decisions about these exceptions without them going to the TB.  However, there is no structure in place within the SRU team to review these.  So I do think the TB is still the best place for now to get these things done16:05
stokachuslangasek: sorry looks like it was just an SRU that included enhancementshttps://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/157317616:05
ubot5Ubuntu bug 1573176 in juju-core (Ubuntu) "[SRU] Juju 2.0 for Xenial" [Undecided,Fix released]16:05
=== mcasadevall is now known as NCommander
pittislangasek: grep has tests itself and for these changes, but of course that doesn't tell us if anyone was relying on the grep 2.2[34] binary behaviour under C by now; although that's rather adademic IMHO16:42
pittislangasek: beyond that, I don't have a good idea myself how to define regression tests for that other than the obvious test for fixing that bug (i. e. whether it causes new FTBFS)16:43
pittiit could just equally be that the regression in .24 (grep -Pz) breaks stuff16:44
pittiso in summary having the fixes seems better to me than keeping the current broken behaviour16:44
pittibut yeah, difficult :(16:44
slangasekpitti: I don't consider an upstream testsuite sufficient regression testing for such a core tool.  Maybe an archive rebuild, yes16:46
pittiwrt. regression testing backporting that (huge) fix vs. taking the full release doesn't make much difference either16:46
slangasekand a longer aging?16:46
pittii. e. maybe we should step back and rather ask us "do we want to fix this bug at all"16:46
slangasekI think we do16:46
slangasekit's a huge and problematic interface change16:46
pittiI think we should, but saying "no" would be policy compliant too)16:47
slangasekand if we had C.UTF-8 as default everywhere already then we could ignore it16:47
slangasekbut as it stands this has a big negative impact on the LTS16:47
pittiyeah, folks upgrading from trusty who then find their usages of grep broken won't be amused16:47
pittiso back then when we fixed all the ftbfs fallout that actually sounded like a deliberate (although painful) behaviour change, so I'm glad that it wasn't after all16:48
pittislangasek: an archive rebuild sounds good (maybe on amd64 only), but we build under C.UTF-8 now16:49
slangasekit is a misfeature that users' locale is not UTF-8 by default.  infinity had aspirations to fix this for 16.04 but it didn't make the cut16:49
pittiif we could do a test rebuild under C, that might help16:49
pittihow do you mean? user's locale for a normal install always ought to be a real UTF-8 one, not C (nor C.UTF-8)16:50
slangasekpitti: reverting the locale isn't relevant for regression testing, which is what we'd want the archive rebuild for16:50
slangasekpitti: "for a normal install" - only for a desktop install16:50
slangasekif you do a C locale install, e.g. on a server image where you select no locale at all, you get ASCII where you should get UTF-816:51
pittifor server and cloud too16:51
pittiah, does server allow you to choose C? (it's been a while since I did a d-i server install, but I don't remember that)16:51
pittisorry, time for basketball, will be back in a few hours16:52
slangaseknot only that, but there are environments (chroots, etc) where by default you're never selecting a locale, period16:53
pittiwgrant, doko: how difficult would it be to do an archive rebuild (one arch only) against xenial plus grep from xenial-proposed?16:53
pittiyes, sure16:53
slangasek(and schroot's handling of LANG has been making me mad for some time, besides)16:53
pittiI'm not saying it doesn't happen, I just disagree that it can be considered "our normal default"16:53
pittiin the end stuff needs to work in both16:53
slangasekWhen you don't configure a locale, the default is C.ASCII.  That we have installers which guide you to choose a locale doesn't change this16:54
cjwatsonpitti: copy it to a PPA and then it's easy16:55
pittislangasek: right (not sure what we're actually debating now)16:55
pitticjwatson: ah, that's even easier16:55
slangasekpitti: the meaning of the word "default" ;)16:55
slangasekpitti: enjoy basketball :)16:55
pittiah :)16:55
cjwatsonpitti: though I'd like to wait until the current librarian expiry situation is sorted out a bit better, if that's possible16:55
pitticjwatson: oh, absolultely16:55
slangasekbut in fact, maybe this highlights misunderstanding between infinity and myself about how this should be fixed... he may be assuming that it's a sufficient fix to set C.UTF-8 in all environments by default, and I may have just argued that this is not sufficient16:56
pittiok, will copy to a PPA when I'm back16:56
=== rcj` is now known as rcj
=== rcj is now known as Guest12905
infinityslangasek: If you're arguing for redefining the libc C/POSIX as C.UTF-8, that could be rather surprising to people who actually expect it to be ASCII.17:17
infinityslangasek: I think the best we can do is attempt to make all system/user login environments default to C.UTF-8 (when not otherwise specified) and call it good enough.17:18
slangasekinfinity: I'm arguing that when no locale env vars are set, C.UTF-8 should be used instead of C17:19
infinityslangasek: But POSIX says otherwise.17:19
infinityslangasek: If you mean that when nothing is specified, a login session should SET C.UTF-8 (ie: mangle pam_env to do this), I could get behind that.17:20
=== Guest12905 is now known as rcj
infinityslangasek: But when you explicitly unset it all after that, it should come out POSIX.17:20
slangasekpfft17:20
xnoxslangasek, given that C.UTF-8 is a superset of POSIX....17:20
xnoxinfinity, that is ^17:20
infinityxnox: Yes and no.17:20
slangasekinfinity: can you point me to the bit of POSIX that specifies this?17:21
slangasekI'd like to spend the next half hour of my life rules-lawyering you17:21
xnox=)17:21
infinityxnox: C.UTF-8 contains the same characters at the beginning of the codeset as C, yes, but UTF-8 still isn't ASCII, and pretending it is is surprising if you expected ASCII.17:21
cjwatsonPOSIX actually contradicts infinity, although I think I still agree with infinity that keeping it ASCII is a safer choice17:24
cjwatsonhttp://pubs.opengroup.org/onlinepubs/9699919799/basedefs/V1_chap07.html#tag_07_0217:24
cjwatson"This default locale can be the POSIX locale or any other implementation-defined locale"17:24
mdeslaurheh, was about to paste that :)17:25
* mdeslaur loves butting into other people's arguments17:25
infinity"For C-language programs, the POSIX locale shall be the default locale when the setlocale() function is not called."17:25
infinitycjwatson: It seems to contradict itself. ;)17:25
cjwatsonOoh, now that's subtly different17:25
infinityOr, we're arguing what "default" means again.17:26
cjwatsonsetlocale() not called != setlocale() called but no locale env vars present17:26
cjwatsonI would certainly argue that it is less confusing for those two situations to result in the same thing17:26
infinityIndeed.17:26
slangasekI would argue that if you're calling setlocale(), you're i18nized and expecting to deal with non-asciiness at some level, and if you're not calling setlocale() you're not, so a difference in behavior there is actually o17:27
slangasekk17:27
infinityslangasek: I agree that it's "ok", but it's still confusing from a user perspective.17:28
slangasekespecially when the only difference we're actually talking about is whether or not to choke on utf-817:28
infinityAnyhow, we could indeed change the setlocale() with empty vars behaviour.  I've never been super comfy about doing that because C.UTF-8 isn't actually a builtin (ie: it requires an external locale def), but we try really hard to make sure it's always on disk and built.17:30
slangasekinfinity: supposing we don't change the default locale under setlocale().  can you tell me how to make the behavior of my schroot not suck?  Because pam_env on the host already sets my desired locale for the host, which is not C.UTF-8; that is /not/ the correct locale for use inside the chroots, where I should not have to install langpacks or have matching locales configuration; and I believe17:34
slangasekschroot currently deals with this by unhelpfully nuking any locale env vars.17:34
infinityslangasek: schroot invokes pam, it could be pam_enving as well.17:36
infinityslangasek: But you bring up a valid point for bare chroot(1) perhaps.17:36
infinity(Though, it's never bugged me that those are POSIX)17:36
slangasekinfinity: it invokes pam on the host. pam_env already sets *the correct locale for the host*.17:36
infinityOh, I was just grepping code.  It doesn't call into pam in the chroot?  Check.17:37
infinityI guess that would be a nonsensical thing to do if you're not "logging in" to the chroot.17:37
infinityslangasek: Anyhow, for individual tools like schroot, the answer could as easily be "set LANG=C.UTF-8".17:38
slangasekyeah; if it did call pam in the chroot, I would expect that to be busted in various other ways17:38
infinityslangasek: But the larger question is if we should have to, and I get that.17:38
* slangasek nods17:38
infinityslangasek: Though, arguably, schroot should be doing something clever to read /etc/environment and /etc/default/locale (ie: emulating pam_env, if it can't call it).   It's meant to be a much smarter tool than dumb ol' chroot(1).17:41
infinityslangasek: So the real question is if the behaviour of chroot(1) is correct, and I'm sort of on the fence there.17:41
slangasekinfinity: if I have to configure /etc/environment and /etc/default/locale inside each schroot chroot to get sane behavior, that is also full of fail17:42
slangasekschroot setting LANG=C.UTF-8 by default is saner, but still has the problem that we have to individually touch each tool whose behavior we want to make sane17:43
infinityslangasek: Why?  I treat my schroots as individual "systems", not unlike a container or a VM.  Those are configured via /etc/default/locale17:44
infinitychroot(1), on the other hand, just gets spillover from your environment and no guarantee of cleanliness, which is entirely correct, if gross.17:44
slangasekinfinity: the whole point is that this should *not* be "configuration". This should be "don't be stupid by default".17:44
apwisn't that down to making the chroots sane when we deliver them17:45
xnoxslangasek, i thought glibc doesn't default to C.UTF-8 because it was not compiled-in locale into libc.so|a binary itself, unlike posix. the point of posix/c locale was that it doesn't need any external files. has that been fixed now, and c.utf-8 is compiled into libc.a ?17:45
infinityslangasek: Okay, sure.  schroot should set C.UTF-8 if there's no existing config, but I'd argue it should also be honoring /etc/* in case we have an /etc/default/locale that says otherwise.17:45
infinityxnox: c.utf-8 is still external.17:45
infinityxnox: Even in our talks about integrating it upstream, no one's yet gone down the scary road of trying to make it a built-in.17:46
xnoxright, then it can't be universally default.17:46
xnoxinfinity, i tried and failed when working on clearlinux17:47
infinityWe do always ship it pre-compiled with libc.so, so for the dynamic case, it's basically as good as builtin (though, we'd need to make sure to pull it into the initrd, etc).17:48
infinityBut for static, it's a bit more of a crapshoot.17:48
infinityEspecially with craptastic Built-Using tracking, which we need to fix.17:48
infinitySince the compiled version on disk may not match what the setlocale() you compiled into your binary expects.17:49
infinityWell, also means the concept of a portable 100% static binary dies.17:49
infinityBut hey, libnss broke that more than a decade ago.17:49
infinityIdeally, I'd like to figure out how to make the upstream build system let you pick a --setlocale-default and build that locale into libc.{so,a} at build time.17:53
infinityThat would make this less scary.17:53
infinityThat would also let embedded vendors build, say, a C+ru_RU system without the overhead of external locales.17:56
infinityWhich would be neat.17:57
dokopitti, pretty easy. is this urgent? I'm planning to do one with an updated gcc too, but not yet19:13
pittidoko: not "this week" urgent for sure, the buildds are aching enough as they are20:47
pittidoko: perhaps next week or so, when the dust settles20:47
pittifor now, just discussing options how we could verify the new grep20:47
pittislangasek: if doko wants to do a test rebuild with gcc-6+the new grep, would you consider this a close enough approximation? doing two rebuilds at the same time seems a bit wasteful20:48
pitti(grep 2.25 is in yakkety already)20:49
pitti♩ ♪ 5.500 tests on the wall, 5.500 tests -- break one cloud, upload one perl, 8.800 tests on the wall ♫ ♬20:50
slangasekpitti: yes, that's fine by me20:54
slangasektests> heh20:56
slangasekqueue under 2k!  fancy20:56
pittislangasek: btw, there are 8 extra armhf workers on scalingstack now20:57
slangasekpitti: excellent :)20:58
pittislangasek: of course I get a watchdog email every 15 minutes or at least 2 hours which hard-reboots them, so I'm not entirely sure how much load they actually take off20:58
pittias each hang causes the client side to hang for a fair while too (until commands time out)20:58
pittibut I think the net result between taking off load and introducing hangs is still positive, armhf was a lot furhter behind yesterday (relative to x86)20:59
pittislangasek: can you exercise your magic management powahs to make cking available to me for half a day or so on our sprint? :-)21:00
pittihe's a miracle on figuring out such stuff, and I don't have a clue how to debug this any further :(21:00
pittispeaking of breaking clouds -- wgrant, cjwatson: https://launchpad.net/builders → quo vadis, lcy01 buildds?21:04
pittiFWIW, on my side I keep running into "ERROR" states recently again, but it's by and large running21:05
slangasekpitti: cking isn't mine to give you, put something on the sprint agenda and ask ogasawara ? :)21:05
ckingi am sure that is doable21:06
pittiah, there's not a list, but a timetable; I'll pick some random time and let ogasawara move it around or slap my fingers then :)21:07
pitticking: that'd be great, thanks21:07
pittiah no, there's a link to "kernel agenda", found it21:08
pittir/o21:08
=== s8321414_ is now known as s8321414
slangasekinfinity: apparently we've had cloop as a "supported" "desktop" package in main since 2008 to support mounting livecds.  But I'm pretty sure that's not compatible with any format we're currently using. ;)  Should we drop that from the seed?22:45
infinityslangasek: Oh, it was manually seeded?  Oops.  Should have dropped out when we dropped the dep from livecd-rootfs.22:47
infinityslangasek: Kill mit fire.22:47
slangasekinfinity: gekillt und gepusht22:47
=== s8321414_ is now known as s8321414

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!