/srv/irclogs.ubuntu.com/2016/03/31/#ubuntu-release.txt

bluesabrePlease approve the above blueman upload. Fixes a crash on first login for systems without bluetooth00:59
cyphermoxbluesabre: thanks! :)02:02
bluesabrecyphermox: np, glad to be able to help with some of these things :)02:02
=== marlinc_ is now known as marlinc
=== xnox_ is now known as xnox
=== stokachu_ is now known as stokachu
=== stgraber_ is now known as stgraber
=== maclin1 is now known as maclin
jamespagehey arges - could we get the keystone upload associated with bug 1559935 accepted into wily-proposed alongside the nova update pls ?12:07
ubot5`bug 1559935 in keystone (Ubuntu Wily) "[SRU] nova 12.0.2, keystone 8.1.0" [Medium,Triaged] https://launchpad.net/bugs/155993512:07
argesjamespage: sure12:22
argesjamespage: didn't see that yesterday as I usually try to keep those together12:23
=== fabo_ is now known as fabo
=== enyc_ is now known as enyc
=== _bjf is now known as bjf
xnoxinfinity, i think my s390-zfcp and s390-dasd uploads should have been held in the queue, instead of auto-accepted. They are priority-standard d-i things.13:26
xnoxand thus totally affect images =)13:26
cyphermoxflexiondotorg: do MATE installs have software-center or gnome-software? it's not immediately obvious in the seed? if it's gnome-software, you may want to update your slideshow13:50
tewardany chance I can get https://bugs.launchpad.net/ubuntu/+source/nginx/+bug/1563393 reviewed for a freeze exception approval?15:06
ubot5`Launchpad bug 1563393 in nginx (Ubuntu) "[FreezeException Needed] Update nginx to 1.9.13." [Wishlist,Confirmed]15:06
stokachurbasak: ping15:16
rbasakSkuggen: pong15:16
rbasakSorry15:16
rbasakstokachu: pong15:16
stokachurbasak: hey so we've finish the juju ffe for 2.0 here: https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/154591315:17
ubot5`Launchpad bug 1545913 in juju-core (Ubuntu) "[FFe] juju-core 2.0" [Undecided,Confirmed]15:17
stokachuand we have packages uploaded for conjure, bigdata, just needing an archive admin to review15:17
rbasakI have NFI what is going on.15:17
stokachuanyone you know of that has some time to get these pushed forward15:17
stokachuheh15:17
rbasakAre all the Juju-related FFEs approved?15:17
stokachuok15:17
stokachuwell we're trying to get the FFe's approved15:17
rbasakI edited the description in bug 1545913 to link to them.15:17
rbasakWell, you can't really upload and ask for AA approval without FFEs approved.15:17
stokachufeedback was given by security team and those were incorporated15:18
stokachumy packages aren't installed by default and are new so they didn't  need FFes15:18
stokachujuju 2 is the one that needs the FFe approval15:18
rbasakIMHO, all of these packages need to be considered for FFe as a whole.15:19
rbasakinfinity: ^15:19
rbasakI summarised in the description of the main Juju FFe bug 1545913.15:20
ubot5`bug 1545913 in juju-core (Ubuntu) "[FFe] juju-core 2.0" [Undecided,Confirmed] https://launchpad.net/bugs/154591315:20
rbasakGoing in uncoordinated is crazy, and giving half the release team half the information isn't helpful either.15:20
stokachudoing best i can with what ive got15:20
rbasakSure, nothing against your work.15:20
stokachui think that FFe summarizes everything though15:20
infinityxnox: Ahh, hrm.  seeded-in-ubuntu (which is what drives the bot) doesn't know about udebs.15:20
jcastroI am in the same boat as stokachu with the accompanying charm-tools15:21
xnoxinfinity, brilliant!15:21
rbasakThe lack of coordination suggests that we're not ready for an FFe to me though.15:21
stokachurbasak: what else is missing from that FFe bug though?15:22
stokachui see the links to the packaging in the description and what has been done in response to the upgrade path15:23
infinityrbasak: I've handed off juju2 to slangasek, cause he was super keen on joining the discussion.15:23
stokachuive got packages from juju-qa team uploaded to my ppa for review as well15:23
slangasek<eyebrow>15:23
rbasakslangasek: there just seem to be a growing number of packages impacted and every few days I learn of more.15:24
rbasakI linked all the known ones in the bug.15:24
rbasakThere's also MAAS, but that's described in the bug description already though I don't see a bug on it.15:25
slangasekrbasak: thanks15:25
rbasakslangasek: there's also the complication that Juju 2.0 requires mongodb 2.6 and 3.2 to work, but won't have a dependency on those packages because Juju installs them manually. On the server side only, though.15:25
rbasakBut, AIUI, Juju 2.0 beta3 will be unusable to deploy Xenial until those are in.15:26
slangasekrbasak: "until those are in" - I haven't seen any upload in NEW for this?15:28
rbasakslangasek: they're blocked on my review feedback.15:28
slangasekok15:28
rbasakslangasek: I'm interested in your opinion on some of that actually. https://bugs.launchpad.net/ubuntu/+source/juju-mongodb/+bug/1557852/comments/615:29
ubot5`Launchpad bug 1557852 in juju-mongodb (Ubuntu) "[needs-packaging] juju-mongodb3.2 in xenial, wily, and trusty" [Wishlist,Incomplete]15:29
jamespagebug 1546776 for all of those NEW packages16:23
ubot5`bug 1546776 in charm-tools (Ubuntu) "[FFe] charm-tools 2.0" [Undecided,Triaged] https://launchpad.net/bugs/154677616:23
bdmurrayany guesses on why the walinuxagent diff is using 2.1.2-0ubuntu1~14.04.2? https://launchpad.net/ubuntu/trusty/+queue?queue_state=116:34
infinitybdmurray: Because LP isn't smart.16:36
infinitybdmurray: Just diff by hand.16:36
infinity2.1.2-0ubuntu1~14.04.2 was in proposed and then deleted, and LP will forever consider it the "last upload" now, because of the higher version.16:36
bdmurrayokay, I didn't see 2.1.2 for Trusty anywhere hence the confusion16:37
flocculantcyphermox: what's the current state on upgrading from 14.04?17:01
cyphermoxflocculant: very close to fixed17:09
flocculantcyphermox: nice one :)17:09
cyphermoxI know exactly what fails, I'm just figuring out the correct way to fix it17:09
flocculanteven better :p17:09
flocculantI did see the upgrade getting compix removed - which was good - I know we don't have that :)17:10
cyphermoxflocculant: well, the compiz crash I think was because of an issue in dbus17:11
flocculantyea - wouldn't know, I just know that compiz wouldn't affect xubuntu upgrade failing :)17:12
cyphermoxthe dbus-daemon-launch-helper lost its setuid bit when extracting, and the postinst wouldn't fix it until very late17:12
cyphermoxI still haven't managed to successfully build a source tarball for ubuntu-release-upgrader though, I keep getting incoherent hash sums from the archive17:12
infinitycyphermox: Moving that dpkg-statoverride from postinst to preinst (or, keeping it in both) would likely do the trick?17:16
cyphermoxinfinity: not according to changelog17:16
infinitycyphermox: Pointer?17:17
cyphermox- preinst: partially revert change from 1.9.4-2. It seems that the17:17
cyphermox      preinst is too late to add a useful dpkg-statoverride entry: dpkg has17:17
cyphermox      already loaded the statoverride database by this point, and if we add17:17
cyphermox      the entry in the preinst, dpkg-statoverride won't run and have17:17
cyphermox      its --update side-effect in the postinst. (Closes: #773107, #773838)17:17
cyphermoxthat was in 1.9.6-117:17
infinityHuh.  That seems suboptimal.17:18
cyphermoxyeah17:19
cyphermoxso my also suboptimal solution for now was in u-r-u17:19
cyphermoxexcept I can't seem to build it ;)17:19
infinityI'm less than pleased with it being hacked around in u-r-u. :/17:19
cyphermoxsuggestions?17:19
cyphermoxthis may be a dpkg bug if statoverride isn't happening at the right time17:20
cyphermoxmaybe for our interest preinst would be sufficient17:21
infinityIt's definitely a dpkg bug, but I can understand exactly why.17:21
infinitystatoverride should be loaded/parsed on each unpack, to get the expected behaviour, but it's obviously easier and more efficient to load it once at startup.17:22
* infinity ponders.17:23
infinityA purely dpkg/deb workaround would be to divert --copy the helper binary in preinst and put it back in postinst.  But that only works if the old helper works with the newly-unpacked dbus.17:25
infinityOr a more gross hack would be to divert it and replace it with a shell script that does a chmod && exec helper.real. :P17:25
infinity(And then undo that in postinst)17:26
infinityObviously, version-guarded, so we only do that insanity on upgrade to xenial.17:26
infinityOh, but the helper is called by users, hence suid, so shell script no workie.17:26
infinityDerp.17:27
infinityDerpity derp.17:27
infinitycyphermox: I'm not against throwing the statoverride in u-r-u (I assume that was the intended hack) as a "fix it today" plan, but if we can fix the apt-get dist-upgrade scenario too, that would be nice.17:28
infinityI'll think about it some more.17:28
cyphermoxI kind of expected the issue with u-r-u to be that it unpacks nearly everything and then runs all the postinsts later, in a very different order than dist-upgrade17:29
cyphermoxor at least, different enough that it's annoying17:29
infinityOh, as in maybe people don't hit this bug at all with apt-get?17:29
infinityThat would be a pleasant discovery.17:29
cyphermoxI don't think they do, but I'll re-test17:29
rick_h_slangasek: howdy, is there a list of the team's concerns with the juju packages I can go through and make calls on if we can pull/reduce risk there? I'm looking for the list of things to address in #1545913 that I can either put the team on to remove any remaining blocks.18:00
stgraberrick_h_: so the bug now claims that we will have a Juju 2.0 final ready before 16.04 ships, is that correct? That's now what I was told before so that kinda surprises me.18:10
rick_h_stgraber: yes, we're cutting an RC1 in the next week and solidifying to have juju 2.0 available to users on release day for 16.04.18:11
rick_h_stgraber: juju 2.0 has to go with maas 2.0, lxd 2.0 as it's built on top of both of those18:12
stgraberboth maas and lxd have betas or rcs in the archive right now, so presumably you're not blocked on those18:12
rick_h_stgraber: no, we're not blocked on that at this time. We didn't put our alpha in because there was some confusion in the 'best path' to get juju2 in and allow side by side installs in trusty/xenial.18:13
rick_h_stgraber: we've engaged with folks on your team to iron out that upgrade/side by side install process as we try to get juju 2.0 in18:14
rick_h_stgraber: and my understanding is the team has addressed that path and made changes to the packages to make sure it works smoothly18:14
stgraberso if I read the FFe right, you're basically saying that all existing juju users will be broken by the upgrade as juju will now point to juju2 and juju2 can't talk to juju118:14
rick_h_stgraber: no, when a user upgrades they'll keep juju 1, juju 2 will be installed along side, and juju will be update-alternatives pointed to juju 218:16
rick_h_stgraber: it's all supported in update-alternatives and juju 2 is the higher priority18:16
rick_h_stgraber: so I don't think they're 'broken'18:17
rick_h_stgraber: that was some of the good feedback my team got and addressed18:18
stgraber"""18:18
stgraberUsers upgrading from trusty will find their juju version updated. The current juju-core package will be provided as juju-1.25. Update-alternatives will provide support for toggling /usr/bin/juju between juju-1.25 and juju-2.0 binaries.18:18
stgraber"""18:18
stgraberI read this as, "juju" will point to version 2 after upgrade.18:18
stgraberand user can change it back to version 1 with update-alternatives18:18
rick_h_stgraber: yes, it's the higher priority.18:18
stgraberok, so someone using the juju command will be broken then18:18
stgraberor does juju2 somehow know to call juju1 instead in such case18:19
stgraberoh, I meant to quote:18:19
stgraber"""18:19
stgraberUpgrading Trusty/Wily/old Xenial:18:19
stgraberAlready installed juju 1.X, upgraded to latest 1.25.4, 2.0 also installed and is the default juju, update-alternatives used to switch between the two.18:19
stgraber"""18:19
rick_h_stgraber: what we've talked about doing in response to this is having juju 2.0 detect that you have a juju 1 config directory w/o a juju 2 directory and messaging the update-alternatives command18:19
rick_h_stgraber: would that be an ok path? Or I can investigate what impact having juju 1 the higher prority would be?18:20
stgraberbut juju doesn't run as root so it can't call update-alternatives and changing symlinks under the user like that isn't too good.18:21
rick_h_stgraber: well we can give the user the copy/paste command to swich if they desire?18:22
stgraberYou could probably have your postinst set the alternative to juju1 if it's installed though but then users will still be confused, just the other way around.18:22
rick_h_stgraber: or we can go the juju 1 higher priority18:22
stgraberI think the best as far as user experience goes would be:18:22
stgraber - If juju1 is detected on installation of juju2, set the alternative to juju118:23
stgraber - Patch juju1 to show a one-time message to the user saying something along the lines of "we've noticed you were using juju1, juju1 is incompatible with juju2, when you're ready to switch, run: sudo update-alternatives --config juju"18:23
stgraberor something along those lines18:23
rick_h_when would that message show to a juju 1 user?18:24
stgraberso don't break folks on upgrade, don't have an unprivileged process mess with systemd-wide settings but still make it easy for the user to figure out how to switch18:24
* rick_h_ is thinking of the preferred injection point for a thing18:24
stgraberfirst run of the juju command I'd guess, then touch a stamp file and don't show it again18:24
rick_h_stgraber: ok18:25
rick_h_stgraber: is that the only remaining concern or are there other ones we can/should address?18:25
stgrabernot quite18:26
stgraberI see you list 3 packages that are needed for juju, juju-mongodb3.2, juju-mongodb2.6 and juju-mongo-tools3.218:27
stgrabernone of which are in the archive yet and I believe all of which received some kind of negative review feedback18:27
rick_h_stgraber: yes, so the current juju-mongodb in trusty/xenial to date is an old version that is out of support from mongodb. We'd like to get a supported mongodb in and have juju use that.18:28
stgraberbefore we really consider the juju FFe, we need to have any required dependencies in the archive and if needed, promoted to main. Then we can see how much time we have left after that and consider the risks that come with the new juju.18:29
rick_h_stgraber: the team's writing up the reply to that negative feedback and filling in the details on the decisions there.18:29
rick_h_stgraber: so juju can work with the mongodb that's there currently, but it's less than ideal as it's not supported upstream any more.18:29
stgraberI also see in one of those linked bugs a mention that juju 2.0 will be 64-bit only, yet I'm not seeing any mention of that in the Juju FFe18:30
rick_h_stgraber: so we feel we can go whichever path forward your team would prefer.18:30
stgraberthis seems like a rather big change that should have been mentioned with details on your upgrade path for 32bit users going to 16.04 (getting them to juju1 only with some kind of notification I guess)18:30
rick_h_stgraber: the client tools build on all architectures. THe mongodb case is juju remote's server which is not a package in qustion18:31
stgraberok18:31
rick_h_stgraber: so this is something that's a bit of a line in that the juju client does not need mongodb, so it's all archs including 32bit18:31
stgraberok, so those 3 packages are only needed for the juju server18:32
stgrabermight be worth clarifying in the FFe18:32
rick_h_stgraber: sure thing18:32
infinitystgraber: No need for juju2 to mangle the alternative conditionally, if juju1 is the higher priority it "just works" for upgrades.18:32
infinity(Well, assuming there's also a plan that keeps both packages around.... The last upload I saw was replacing 1 with 2...)18:33
stgraberinfinity: true but what happens if someone apt-get install juju1 after the fact?18:33
infinitystgraber: Then juju1 would take priority.  *shrug*18:33
rick_h_infinity: right now we will have juju 1 until trusty EOL's and then we'll remove it from xenial18:33
infinityrick_h_: Err, no you won't.18:33
infinityrick_h_: We don't remove things from xenial.18:33
infinityNot after it's released.18:33
rick_h_infinity: no? my understanding is that since 1.25 is in universe it can be removed?18:34
infinityYour understanding was incorrect.18:34
stgraberit's impossible to remove a package from the release pocket18:34
stgraberyou can SRU an empty one though18:34
rick_h_stgraber: infinity ok, folks are clarifying me that the package is still there but we can say "it's no longer supported' which is what I was asking them about18:35
infinityWe could, in theory, 0-day SRU it to xenial-updates and not actually ship a copy in the release pocket at all.18:35
rick_h_my apologies for the confusion there18:35
infinityBut that would take some fun coordination.18:35
stgraberbut then your users may be a bit surprised that a package in main with a 5 years support commitment from Canonical is removed18:35
rick_h_stgraber: infinity we have a support window that's documented for 1.25 until trusty EOL but it's support specific18:35
infinityrick_h_: So, how does the upgrade get people both versions?18:36
rick_h_infinity: that's in the juju ffe #1545913 under upgrades and we've tested this as the feedback18:37
rick_h_we got around those issues18:37
rick_h_infinity: so there's some metapackage foo that makes it 'just work' and tests well18:37
infinityrick_h_: The upgrade scenario I saw assume the metapackage is installed.18:38
infinityrick_h_: Users with juju-core installed get no upgrade, then?18:38
rick_h_infinity: yes, all users have the juju metapackage currently18:38
infinityThat's a bold statement.18:38
infinityThere's nothing requiring them to.18:38
rick_h_infinity: true, but all of our documentation and practices going back pre-trusty has the juju metapackage.18:38
infinityAlso, that package was never actually a metapackage (ie: in section: metapackages) which means its deps are marked auto-installed.18:39
rick_h_infinity: worst case, if they don't have the metapackage they end up with just juju 1 they were using, and have the option of installing juju2 by installing the metapackage or the juju-2 package18:39
infinitySo, assuming they have it installed "apt-get dist-upgrade && apt-get autoremove" will remove juju-core.18:39
infinityAnd we're enabling autoremove by default.18:40
infinityIn unattended-upgrades.18:40
infinitySo, you still have a bit of a problem there.18:40
rick_h_infinity: ok, that's good to know. We weren't aware.18:40
infinityrick_h_: Of which part?  Your pastebin clearly shows juju-core as an autoremove candidate.18:40
mgzinfinity: I have slightly changed the packaging since then, but am interested if there's a neat way of avoiding that problem18:41
rick_h_infinity: that we either update the current trusty package and try to fix the section metapackages?18:41
rick_h_or something else?18:41
infinityIt's too late to fix it in trusty.18:41
infinityYou can't guarantee all users will be fully-upgraded to trusty-updates before upgrading.18:41
rick_h_infinity: agreed, hoping that we might not be alone in this and there's a known path that makes it non-fugly for users?18:42
infinitymgz: My best recommendation would be to have the metapackage depend on both until juju-core is EOL.18:43
infinityUnfortunately, you can't write to the apt autoremove database while apt is running, so you can't fix it up in a maintainer script.18:43
mgzinfinity: okay, so, for instance, the initial version of the juju 2.0 source package can say, have juju depend on juju-2.0 and recommend juju-1.25 maybe?18:44
rick_h_infinity: can it depend on both though as one is meant for main and one for universe?18:44
* infinity thinks a bit about how best to solve this.18:44
infinityrick_h_: Oh, nope.  Not if the meta is in main.18:44
mgzyou can recommend into universe right?18:45
infinityNope.18:45
infinityOnly Suggests.18:45
infinityWhich might not be enough to pin it in, I can't recall the mechanics there.18:45
mgzmeph, which isn't enough to prevent the autoremove18:45
mgz...I think18:45
mgzinfinity: I'm open to cunning plans18:51
infinitymgz: Suggests is enough to keep it in.18:51
mgzinfinity: okay, that is excellent. I can do that.18:51
infinityhttp://paste.ubuntu.com/15570328/18:51
infinity^-- example/proof.18:51
mgzinfinity: thank you very much18:52
dokoinfinity, did you find out more about glibc2.0 on s390x? If not, I'd like to upload a build which doesn't run the tests, so that we can get the package into the release pocket for the test rebuild18:52
infinitymgz: And that's actually appropriate anyway, as a Suggests implies the need for juju1 for transition/upgrade purposes.  So, yay for that.18:53
mgzyeah, it's great that it makes sense and actually does what we want :)18:53
rick_h_stgraber: infinity ok, so we're adding a comment to the FFe on the 32bit question and moving to suggest, and making juju1 the higher update-alternatives priority.18:53
infinitydoko: Not yet, no.  But if you want to disable for a build, I can revert when I've found something.18:53
dokook18:54
rick_h_stgraber: infinity are there other concerns/issues the team needs to address? If not, can I put those notes into the FFe that based on our conversation those are the conditions and upon meeting those it will be acceptable?18:55
infinitydoko: (Alternately, disable for a PPA build and make your test depend on that PPA, but I think a bunch of other stuff is also blocked on glib, like gtk...)18:55
dokoright18:55
infinityrick_h_: To me, the key points are that juju2 be considered feature-complete and fully-functional by release, because that's the thing you're telling users is the Way and the Light, and that upgrade scenarios don't leave users busted on upgrade.18:56
rick_h_infinity: understand, we're moving the one feature not complete behind a feature flag that is not enabled by default for release18:56
rick_h_infinity: juju 2.0 is fully functional, our next release is RC1 with bugfixes from then on.18:57
infinityrick_h_: I haven't reviewed the actual package yet, but apw had some concerns there too, like why is it shipping 250MB of binaries, much of which seem to be duplicated code? (could it be a single binary that switches on argv[0] and cut the install-size in 1/4?)18:57
rick_h_mgz: do you know the background there? ^18:58
infinityGiven that there are powers that be that want to see juju eventually installed by default on every Ubuntu device, 250MB is pretty huge.18:58
infinityLike, very huge.18:58
infinityGuessing there may also be a lack of stripping.  A combination of argv-switching and stripping would help a lot. :P18:59
infinity(If that 250MB is stripped, I'll be both surprised and even more annoyed at Go than before)18:59
rick_h_infinity: mgz is pulling up the bug on this for reference. one sec19:00
mgzinfinity: see https://bugs.launchpad.net/ubuntu/+source/golang/+bug/1200255/comments/819:00
ubot5`Launchpad bug 1200255 in golang (Ubuntu) "go get ... fails with SIGILL on armhf" [Undecided,Fix released]19:00
mgzinfinity: tldr, upstream golang doesn't support stripped binaries, things break when you do it19:01
stgraberhmm, pretty sure mwhudson said it's all fine and supported now19:02
stgraberexcept for binaries built with gccgo, those are still busted19:03
mgzit may be something we've made progress on upstream, but it's not been tested by us19:03
mgzI shall ask mwhudson later.19:03
infinityYeah, I've heard that was sorted, or at least there was a workaround where you could strip mostly, but leave a section intact.19:03
infinitymgz: stripping aside, the 4 binaries that mostly link the same objects thing seems like it would be served better with one binary and 3 hardlinks and argv[0] switching.19:04
mgzinfinity: I'm open to filing a bug on that, but thought the way forward was more likely to be shared objects for go19:07
infinitymgz: Sure, libraries would be wonderful, but we're not there yet.19:08
infinitymgz: When most of your binaries are 90% shared static objects, though, the busybox approach makes some sense.19:08
rick_h_infinity: so to my list you'd like us to add that we argv switch in there as a gate to get the acceptance?19:09
infinityrick_h_: Well, reduce the package size considerably.  How that happens is an implementation detail, I'm just suggesting an option. :P19:10
infinityrick_h_: Obviously, sorting out the stripping situation will also help a lot.  But even then, you'll still have 4 giant almost-identical binaries.19:11
infinityJust slightly less giant.19:11
rick_h_infinity: understand19:11
rick_h_infinity: I'm working to get a list of things that are preventing this so I can get the team to address them and hopefully have a complete action plan19:11
rick_h_infinity: to date I feel like we've gone back/forth and the lovely manager in me is wanting to get a plan in place19:11
infinityrick_h_: Well, it's not helping that this is all landing very late and (frankly) the default answer from both the Release Team and the Tech Board (if escalated) should be "no".19:12
stgraberrick_h_: would also be useful to have a section in that FFe which highlights how that mess happened in the first place and explaining how you intend to deal with pushing juju to the Ubuntu archive in future releases so that kind of situation doesn't happen again19:13
infinityrick_h_: So, working towards a slightly less violent "no" is a good first step, but it may still warrant a sabdfling if we can't dot every i and cross every t.19:13
rick_h_infinity: ok, I can add that section and the plan we've put together on our end.19:13
infinityrick_h_: And I understand that there was a belief that the standing SRU exception would let this slide right in, but the SRU exception is predicated on intense regression testing and sane upgrade paths, so that certainly hadn't been met the last time I looked at this.19:14
rick_h_infinity: understand, we had the mandate that there's not a current upgrade path from a juju1 environment to a juju2 one. However, that's the remote end vs the client that this is about.19:15
rick_h_infinity: and I think that confused the issue a bit19:15
rick_h_infinity: which is why the feedback from your end on the upgrades with the packages is <3 and I'm happier we did those updates19:16
infinityrick_h_: Right, the client upgrade path is what's of concern for the distro.  ie: I can't upgrade my distro and break my client.19:16
infinityrick_h_: The network upgrade path is something apt obviously can't fix, so that's up to good documentation of migration strategies for the server side.19:16
rick_h_infinity: definitely19:17
rick_h_infinity: stgraber so we'll process these items per https://bugs.launchpad.net/ubuntu/+source/juju-core/+bug/1545913/comments/1419:20
ubot5`Launchpad bug 1545913 in juju-core (Ubuntu) "[FFe] juju-core 2.0" [Undecided,Confirmed]19:20
rick_h_infinity: stgraber if there are any other items to add to that list please let me know so I can make sure I'm aware and handling them19:21
stgraberrick_h_: document your plan for the next ubuntu release on how you'll adapt your process so we don't end up in the same situation again19:22
rick_h_stgraber: right +119:22
stgraberrick_h_: we really should have had juju2 alphas or something in xenial way before feature freeze, incremental changes and FFes are far easier for us to review and way easier to get19:22
stgrabermost of our other upstreams have figured it out and maas and lxd within Canonical also managed it, so surely Juju could have done it too19:22
rick_h_stgraber: understand, I think this was a miscommunciation in that we had the feeling an alpha should not go in19:23
stgraberif you intend for the final version to go in, an alpha can absolutely go in19:24
infinityrick_h_: It's a development release, all bets are off.  The key is to have something decently final by release.19:24
rick_h_stgraber: we've had packages and been delivering to stakeholders alphas and betas for months19:24
stgraberrick_h_: right, just not in the Ubuntu archive, which is what matters to us :)19:25
rick_h_infinity: yes, agree. We've got commercial engagments where my head's on the line so a final will be in for release19:25
* rick_h_ steps away for lunch and to assign folks to tasks19:25
infinityrick_h_: Threat of decapitation isn't my ideal motivator, but whatever works for you.19:26
* rick_h_ tosses the obligatory "I'm rather attached to my head" joke19:26
stgraberspeaking of golang stuff, I don't suppose any archive admin is willing to look at those 3 golang-XYZ packages I uploaded back in December?19:26
stgraberthey are the only bits left (well, once promoted to main) which we'd need for LXD not to use any bundled sources, so that would make the security team happy (apparently)19:27
stgraberit's not blocking us since we just use the bundled copies when we can't find the source in the archive but it's something we've been asked to do as part of being in main19:28
stgrabera couple of those I uploaded before have since landed in Debian so I've synced them from there instead, but those 3 aren't in Debian and won't be before release (no ITP for them even)19:29
infinitysuperm1: Why is fwupd arch:any?19:35
superm1infinity: linux-any IIRC19:36
infinitysuperm1: Oh, I see.  The intent is to someday extend it for non-EFI systems?19:36
superm1it can support all sorts of firmware flashing types19:36
infinity(Though, that doesn't seem to be the case right now)19:36
superm1raspberrypi, DFU, colorhug19:36
infinityHrm.  Kay.19:36
superm1of course the main one I care about is EFI, but i'm also hoping to get other interesting pieces of firmware pushed that route too19:36
infinityGPGME needs this for proper building on i386, armhf, powerpc19:41
infinityifeq "$(DEB_BUILD_ARCH)" "i386"19:41
infinity        export DEB_CFLAGS_MAINT_APPEND = -D_FILE_OFFSET_BITS=6419:41
infinitysuperm1: Is "dpkg-architecture -qDEB_HOST_ARCH_BITS" what you're looking for?19:41
superm1infinity: possibly19:42
infinitysuperm1: Also, you've confused HOST and BUILD there.  HOST is the one you're building *for*, BUILD is the one you're building *on*.19:42
ginggsis there anything wrong with just adding -D_FILE_OFFSET_BITS=64 for all arches?19:43
slangasekmgz, rick_h_: yes, per mwhudson, stripping of go binaries is now supported; we should ASAP start stripping juju binaries to get the install size under control19:43
slangasekginggs: there is not, it's just superfluous on some archs19:43
ginggsslangasek: thanks, i was pretty sure i've done that in a couple of my packages19:44
slangasekso the usual approach for this is $(shell getconf LFS_CFLAGS)19:44
slangasekbut of course that's not cross-friendly, so ymmw19:44
slangasekv19:44
superm1infinity: dpkg-architecture -qDEB_HOST_ARCH_BITS should return 32 on the ones I was adding the flags?19:45
infinitysuperm1: Yes.19:45
infinitysuperm1: And many more, in the case of Debian.19:45
infinityYou probably also want -D_LARGEFILE_SOURCE19:45
infinityAnd, as mentioned, it's not harmful to just unconditionally add both, even on 64-bit arches.19:46
infinityBut if you want to conditionalise it, -qDEB_HOST_ARCH_BITS is the way to go.19:46
superm1ok thanks19:46
infinitysuperm1: I look forward to your engagement with IBM (if they don't blackhole @dell.com) on making this work for PPC systems too. :)19:48
infinity(They have live firmware updating tools, it would just need to be hooked in and prettified)19:48
infinitysuperm1: Mostly sarcasm, FWIW.  But I might suggest they look at the project and contribute.19:49
superm1Heh, well if they have specs that are open on this stuff they should definitely participate19:50
infinitysuperm1: Their firmware updating (and firmware itself) are open, the problem they need to fix is sane distribution channels for their signed firmware images.19:51
infinitysuperm1: If they can plug that all in reasonably, so there's no manual click-wrapping and shuffling of files, this would all be quite slick.19:51
infinitysuperm1: I assume fwupd supports the concept of A-side/B-side/Commit somehow?19:52
* infinity puts it on his list of things to learn about $later.19:53
superm1Anything is possible with the plugin architecture. Even if their stuff doesn't follow standards, it can fit into fwup-provider-ibm or something like that that does any crazy stuff19:53
infinitysuperm1: Shiny.19:54
infinitysuperm1: I'll bring it up with Jeremy Kerr when I have a spare few minutes.  I'd love to see the fwupd story improve on those machines, given the open nature of both the tools and the firmware.  It's a shame they haven't glued the last little bit together to make it stupid-proof.19:54
superm1And LVFS is open to any OEM. If they would distribute their firmware images though that, it solves a lot of mess too19:55
superm1Cool19:55
Beretinfinity, haha20:00
Beret"Threat of decapitation isn't my ideal motivator, but whatever works for you."20:00
mwhudsonmgz: strip go pls20:21
mwhudsonmgz: not gccgo tho20:21
rick_h_mwhudson: how confident are we on that? I'm concernede about sneaky issues that it might expose.20:22
infinitymwhudson: golang vs gccgo, does dh_strip DTRT, or does one need to do conscious debian/rules hackery?20:23
infinitymwhudson: (I assume you meant "strip binaries produced by golang, but not binaries produced by gccgo")20:23
mwhudsonrick_h_: the failures we've seen before are of the "process crashes instantly on startup"20:23
rick_h_mwhudson: ok20:23
mwhudsonvariety20:23
mwhudsoni can't see the scope for subtle breakage20:23
mwhudsoninfinity: no, no smarts in dh_strip20:24
infinitySo some icky ifeq magic on dpkg -S $(readlink /usr/bin/go)?20:25
infinityThat might want dh_strip involvement. :P20:25
rick_h_mgz: ^ for the bug20:25
mwhudsonyeah20:25
infinityCan we tell by examining a binary if it's produced by one or the other?20:25
mwhudsonprobably not stripping binaries linked to libgo.so.X is the right heuristic20:25
dokoone has a proper shared lib20:25
mwhudsonalthough there are some gccgo-compiled static things too20:26
dokoinfinity, depends on libgoN20:26
mwhudson(jujud, dockerinit)20:26
infinityThat seems odly backwards that a GCC-produced binary can't be stripped.20:26
mwhudsoni've been meaning to pester ian about this for ages20:26
dokoinfinity, fix libbacktrace20:26
mwhudsonit would still seem better to get no tracebacks if there is no debug data20:26
infinitydoko: No thanks.  It was an observation, not a demand for work. ;)20:27
mwhudsonrather than fall over on startup20:27
slangasekmwhudson: in the past, I thought stripped binaries would crash at the first use of go reflection, which is not necessarily at startup20:27
mwhudsonslangasek: don't think so?20:27
slangasekmwhudson: hmm, well, at least in one iteration of the bug, it was the reflection info that was disappearing when stripping :)20:27
mwhudsonoh maybe you're right20:27
mwhudsonuhh20:28
* mwhudson is stripping gccgo binaries on his system and things are working20:28
rick_h_mwhudson: yea, the big thing is that juju seems to push things a bit and making that change at this point seems potentially risky.20:28
slangasekanyway, at this point we *ought* to be using golang consistently across all architectures in xenial, which means no reason to special-case in the packaging20:28
mwhudsonslangasek: except powerpc20:29
slangasekrick_h_: whether or not it fails at startup, it should be the sort of breakage that's easy to regression-test20:29
slangasekmwhudson: oh that old thing20:29
infinityYeah, except powerpc.  But the right answer is special-casing in dh_strip, not in individual packages.20:29
infinityJust as we special-cased golang-go in a metapackage, not in package build-deps.20:29
infinityPackages should be blissfully unaware of their toolchain.20:29
slangasekmwhudson: apt-get install qemu-user-static; apt-get install juju-core:amd64; done20:30
slangasekrunning amd64 go binaries under qemu-user-x86, should work GREAT20:30
mwhudsonslangasek: i bet juju tickles no bugs in qemu-user-static at all20:30
slangasekmwhudson: last time I tried qemu-user-x86, it didn't do nptl20:30
slangasekso20:30
infinityqemu-user-static is notoriously crap at all things threaded.  Good thing Go doesn't ever do anything in paralle.20:30
infinityl20:30
mwhudsonrick_h_: i can understand the reticence, but i reallllllyyyyy think the scope for subtle breakage is v minro20:32
infinitySurely there's a testsuite we can exercise to see if it breaks.20:32
rick_h_mwhudson: ok, I'm not familiar enough to help but just wanted to make sure.20:32
rick_h_infinity: yes, but if it's subtle there's risk it's something that would be provider specific/etc that scares me.20:32
infinityIf the entire juju testsuite is "run the binary to see if it crashes", we have much bigger problems than stripping. :P20:32
rick_h_lol20:32
mwhudsonoh good juju doesn't build with gccgo on my system?20:33
mwhudsonjuju tip20:33
mwhudsoni'm on wily thouhg20:33
stgraber+1 on having dh_strip DTRT20:34
infinityThe 2.0 test PPA was only x86 too.20:34
stgraberFWIW, lxd doesn't override dh_strip, so I guess it means it's getting called and AFAICT our powerpc binary still works :)20:34
infinitystgraber: Do you have stripping logic in lxd you'd like to move to dh_strip? :)20:34
infinityAhh.20:34
infinityNeat.20:34
stgraberthat or dh_strip is skipping all go binaries which would be kinda bad :)20:34
infinitystgraber: Are your binaries a bazillion whosibytes?20:35
infinitystgraber: Cause if not, they're probably stripped.20:35
stgraberwe have a powerpc box I use quite a bit for testing and to build various images, haven't had any problem on it20:35
infinitystgraber: powerpc or ppc64el?20:35
infinityI mean, I know you know the difference, but... Why would you have the former?20:35
stgraberwe've got both20:36
infinity(says the man with several powerpc boxes...)20:36
stgraberbecause powerpc keeps breaking and I wanted to be able to test things before they break :)20:36
infinityHeh.  Fair.20:36
infinityDo you use this reflection thingee vorlon speaks of?20:36
stgraber/usr/bin/lxd: ELF 32-bit MSB executable, PowerPC or cisco 4500, version 1 (SYSV), dynamically linked, interpreter /lib/ld.so.1, for GNU/Linux 3.2.0, BuildID[sha1]=923cbfc4794ecc86c35469418558d3146718e68c, stripped20:36
stgraberyup, we use reflection in a few code paths20:36
infinitymwhudson: So, maybe it all works now?  Somehow?20:37
stgraberour biggest user of reflect appears to be our /dev/lxd interface, let me poke at it a bit to make sure it works as expected20:37
mwhudsoninfinity: maybe!20:37
mwhudsoninfinity: i'll ask upstream20:37
infinityCan the next new language we adopt have THREE differently-broken toolchains?  Two isn't enough hassle.20:38
mwhudsoninfinity: i'll use common lisp for my next r20:39
mwhudsoninfinity: i'll use common lisp for my next project20:39
mwhudsonah stripping gccgo-built juju still breaks20:40
slangasekmwhudson: I thought the traditional exit strategy was haskell20:40
stgraberroot@test:~# curl --unix-socket /dev/lxd/sock http://a/1.0/config20:40
stgraber["/1.0/config/user.this-works"]20:40
stgraberthis particular code path definitely runs through reflect.Indirect and a bunch of similar fun code20:40
mwhudsonslangasek: but that only has one toolchain? (that anyone actually uses)20:40
infinityCurious.  So something different breaks for juju.  Good(?) to know.20:40
slangasekright :)20:40
stgraberas far as numbers, unstripped lxd is 21M, stripped lxd is 13M. That's the golang numbers.20:41
stgrabergccgo is smaller at just 6.2MB stripped20:41
infinitymwhudson: I'm kinda curious what breaks for juju and why it doesn't for lxd, but not curious enough to skip lunch any longer.20:44
* infinity lunches.20:44
mwhudsonyeah, me too, except for the time of day20:45
infinitymwhudson: Although, stgraber's builds are on up-to-date xenial, you implied you were wilyish.20:46
rick_h_mwhudson: all good, it's good to know we should look into it and explore it on our end20:46
rick_h_mwhudson: everyone still thought it was a 'thou shalt not do'20:47
mwhudsoninfinity: i was trying juju in a xenial lxd20:47
mwhudsonrick_h_: one myth at a time :-)20:47
infinityThere was an LP bug about this a long time back that implied a less aggressive strip would work too.20:48
infinityMaybe that could be built into dh_strip, if I can figure out how to identify that a binary is Go.20:48
infinityAnd if I can remember the bug report. :P20:48
infinityBut yes, lunch.  Hungry, hungry hippo.20:48
slangasekrharper: so I'm taking a closer look at squid3 now; I do not like what I am seeing, and I'm not sure how much of it is Debian vs. Ubuntu delta.  Do you know why we have extensive maintainer scripts for both the squid3 and squid binary packages?  Do you know why the squid3 dummy package declares a pre-depends on squid instead of depends?  Are you the right person for me to be pestering about these21:12
slangasek things?21:12
rharperslangasek: rbasak did the merge; so he's most intimate with the details21:13
slangasekok21:13
rharperslangasek: if you put the questions in the FFE bug, rbasak will see them and can reply as he sees; I'll actively research and help until he's online tomorrow21:14
slangasekrharper: yeah, if you don't have the answers to hand, given the tz difference this is going to end up being a matter of me taking a machete to the packaging21:15
slangasekthanks, though :)21:15
rharperslangasek: my gut feeling is that most of the package stuff is from debian as our goal has been to drop delta21:15
slangasekyeah, it is21:15
slangasekthere's some delta to each of the scripts from Ubuntu, but the fact that there are two sets of maintainer scripts is Debian-induced braindamage21:16
rharperyuck21:16
mwhudsonAND the package uses cdbs!21:16
rharperand folks ask why we've not merged in so long21:17
slangasekyes21:17
slangasekand now is the time to fix up these maintainer scripts, *before* they dump a pile of orphaned config files onto users' systems in the LTS21:17
dokopromoted libdata-alias-perl, blocking lintian migration21:17
infinitydoko: It was already promoted once (by you).  I guess someone demoted it again? :P21:17
dokoyeah, not me ...21:18
dokofoundations was also subscribed21:18
rbasakslangasek: the Debian situation isn't great. The Ubuntu delta isn't that large.21:18
slangasekdoko: is that a new dep, then?21:18
infinityOh well.  My kingdom for auditing, so I can see who demotes without checking proposed.21:19
rbasakslangasek: it's complicated by the fact that Ubuntu carried a delta from Trusty from squid -> squid3, and Debian is going the other way now.21:19
dokohow much do we care about mariadb-10.0 ?21:19
slangasekrbasak: yeah, I'm seeing that.  Nothing I fault you for as part of the merge, but I'm reaching for increasingly large bladed weapons now ;)21:19
rbasakSo there are various use cases such as Trusty -> apt-get install squid -> do-release-upgrade to Xenial being different from Trusty -> apt-get install squid3 -> do-release-upgrade to Xenial.21:19
infinityslangasek: Was a new dep, yeah: https://bugs.launchpad.net/ubuntu/+source/libdata-alias-perl/+bug/156408221:19
ubot5`Launchpad bug 1564082 in libdata-alias-perl (Ubuntu) "[MIR] libdata-alias-perl" [Undecided,Fix released]21:19
slangasekk21:20
rbasakStuff breaks in strange ways because the dpkg-maintscript-helper calls are essentially a hack.21:20
rbasakThe duplicate calls from both squid and squid3 maintainer scripts work around it.21:20
rbasakI'm not sure if that's what Debian intended, but it seems to work for us.21:20
slangasekinfinity: without checking -proposed> well, I *did* point out that having one c-m report would be cleaner, but I got voted down.  I didn't do the demotion though :)21:20
dokoslangasek, https://bugs.launchpad.net/ubuntu/+source/libdata-alias-perl/+bug/156408221:20
rbasak(hack as in more of a hack than usual, since sometimes the prerm in squid might never run, etc)21:21
rbasakslangasek: if it helps, https://git.launchpad.net/~racb/ubuntu/+source/squid3/log/?h=merge breaks down the current Ubuntu delta (my merge)21:21
slangasekrbasak: at this point I assume the last time the squid3 maintainer looked at a package was 200321:21
rbasakslangasek: upstream have been quite involved recently, and he doesn't have much packaging experience I don't think.21:22
dokorbasak, are all those block-proposed tags really helpful? these prevent testing by a much larger community21:22
rbasakslangasek: his sponsor seems to be less involved nowadays, AFAICT.21:22
infinityslangasek: Other than the Debian packaging being insane, there's the added bonus that we and Debian were inverted on package names for a while, which makes it even more fun.21:23
rbasakdoko: mysql-5.7 block-proposed was to prevent breaking mythtv during beta week. I guess that can be removed now, though I think there's still a dep8 fix to upload so it wouldn't migrate yet anyway.21:23
slangasekinfinity: I know, I know21:23
infinitySo, crazy on top of crazy.21:23
infinityWith a side of delicious crazy.21:23
rbasakdoko: squid's tag was suggested to me I think. I'd be fine to remove that now, but no need to break users until the current known bug is fixed I think.21:23
dokok, thanks21:24
slangasekoh good, adduser in the preinst without a pre-dep21:27
slangaseknot like the maintainer had never heard of a pre-dep, he just apparently has no idea what they're fore21:28
slangasek-e21:28
slangasek        adduser --system --home /var/spool/squid --group proxy21:30
slangasek        chsh -s /bin/sh proxy21:30
slangasek>_<21:30
tewardinfinity: any chance you or someone else on the release team can review the nginx freeze exception request bug before tuesday?  happy to give specifics as to why i say tuesday off-channel but...21:43
slangasekrbasak, rharper: looks like the upgrade also doesn't migrate /var/spool/squid3 to /var/spool/squid; do you know if there was a specific reason this wasn't done?21:48
rharperslangasek: no, guessing it was missed;  I assume we want to move all squid3 -> squid where ever ?21:50
rharperslangasek: rbasak may know of a specific case; but I;m not aware of one21:50
slangasekrharper: well, the maintainer talks in NEWS.Debian about it not being automatically moved, which seems strange to me21:50
rharpermaybe they didn't want to test it out21:52
dokoafk now21:54
mwhudsonslangasek, infinity: https://groups.google.com/d/msg/gofrontend-dev/WAl16EmuxyE/WXktcXJ8CAAJ re gccgo stripping21:54
mwhudsonso it's not reflection per say, but other introspectiony thing21:54
slangasekah, k21:54
slangaseksuperm1: is there an FFe bug for gnupg2 2.11-6ubuntu1 (not listed in the changelog)?22:02
dokoslangasek, I discussed this today with him, including the MIR report for fwupd22:04
slangasekdoko: what does that mean, you discussed it?  I don't see an FFe bug22:05
stgraberthat lxd upload should be trivial to review ^ it's just using the now promoted archive copy of go-colorable instead the embedded copy22:07
slangasekah, now I get to the unnoticed bit where we're both removing and migrating /etc/init.d/squid3, heh ;)22:11
superm1slangasek: no an FFe bug was not created, based on the conversation that happened in -devel and that MIR bug I was under the impression it wouldn't be necessary22:14
superm1if it is, I can file one now22:14
dokoslangasek, the MIR issue is https://bugs.launchpad.net/ubuntu/+source/fwupd/+bug/1536871, the discussion was today on #ubuntu-devel, and the update fixed an issue in gpgme1.0 which was already in the release pocket22:14
ubot5`Launchpad bug 1536871 in npth (Ubuntu) "[MIR] fwupd" [Undecided,Fix released]22:14
slangaseksuperm1: what MIR bug are you referring to?22:14
slangasekok22:14
slangasekdoko: none of which excuses bypassing the release team and FFe review22:15
dokothe gnupg1.0 issue is LP: #156423422:15
ubot5`Launchpad bug 1564234 in gnupg2 (Ubuntu) "gpgme1.0 doesn't work properly with gnupg 2.0" [Undecided,Fix released] https://launchpad.net/bugs/156423422:15
slangaseksuperm1: please do - from previous proposed-migration investigations, I understand that the behavior of the newer gnupg2 differs from the previous one in various ways that may or may not impact other things up the stack22:16
dokopretty please can we have a FFe for https://mail.python.org/pipermail/python-dev/2016-March/143603.html ?22:46
slangasekdoko: I suppose you want this in for the next rebuild test?22:49
dokoslangasek, I didn't expect you would volunteer for the packaging ...22:49

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!