/srv/irclogs.ubuntu.com/2014/03/10/#ubuntu-release.txt

=== Guest28960 is now known as NCommander
=== NCommander is now known as Guest30460
=== mlankhor1t is now known as mlankhorst
=== tkamppeter__ is now known as tkamppeter
=== maclin__ is now known as maclin
sergiusenscan someone please look at https://bugs.launchpad.net/ubuntu/+bug/129035113:15
ubot2`Launchpad bug 1290351 in Ubuntu "[FFe] Sync golang-go-xdg 0~bzr20140219-1 (universe) from Debian unstable (main)" [Wishlist,New]13:15
Laneysergiusens: you don't need to immediately ping ...13:20
sergiusensLaney, right; sorry 'bout that13:21
LaneyI'll spend some time on the queue later on today13:22
Laney(not to say that someone else can't process things)13:22
ogra_stgraber, so i had some massive probs today to promote images ...14:09
stgraberogra_: ah, what kind?14:09
ogra_stgraber, it took endlessly long .... and it seems it deleted the tarball for some arches during the process14:10
stgraberogra_: hmm, I really need to figure out a better way to deal with that case...14:13
stgraberogra_: what happened is that as you didn't promote an image in quite a while, the 194 image in trusty-proposed was expired a while back including all deltas it had14:13
stgraberso when you did the copy earlier, there wasn't any of the 194 => 226 pre-generated deltas which make the copy very quick and they all had to be regenerated during the copy14:14
stgrabertrusty-proposed stores the last 20 images, 226-194 = 32, so that indeed seems to be the problem14:15
ogra_stgraber, sorry, doorbell14:16
stgraber(back when we set those values, it seemed unimaginable that it'd take us more than 20 tries before we get a promotable image, guess we were wrong...)14:16
ogra_stgraber, http://paste.ubuntu.com/7067819/14:16
ogra_thats my full terminal log from trying to promote all images14:17
stgraberhmm, still looks like import-images running cleanup_tree under our feet, though the lock should prevent that from happening... I guess I'll have to do some tests of the locking mechanism, something seems wrong there14:20
ogra_yeah, i could see the tarballs actually show up and vanish again on system-image.ubuntu-com in the browser14:23
ogra_i show down the cronjob in the end14:23
ogra_stgraber, i messed up the flo release by missing -k to copy-images, can we fix that ?14:24
stgraberogra_: yeah, give me a minute I'll fix it14:25
ogra_no hurry :)14:25
stgraberogra_: should be good now14:30
stgraberogra_: http://paste.ubuntu.com/7067901/14:31
ogra_stgraber, gracias !14:33
=== apachelogger_ is now known as apachelogger
bdmurrayCan I get the release of ubuntu-release-upgrader in saucy-proposed fast tracked to -updates?16:21
=== PaulW2U is now known as G4MBY
infinitybdmurray: Seems likely.16:24
infinitybdmurray: Done.16:27
bdmurrayinfinity: thanks!16:27
infinitybdmurray: Is the Ubuntu task on #1289604 valid?16:28
infinitybdmurray: If not, maybe that should be marked Invalid instead of In Progress...16:28
infinitybdmurray: Or, if this needs fixing in trusty, please do. :P16:29
bdmurrayinfinity: I did fix it but I'm not sure it really needs it, since we can convert the release upgrader to use python3 when development on U starts.16:30
infinitybdmurray: But isn't this about new release-upgraders needing to run on old systems?16:31
infinitybdmurray: And the trusty one needs to run on precise...16:31
infinityOr, oh.  I guess the trusty tarball will work on precise, but doesn't need the dep.16:31
bdmurrayright because the tarball doesn't install deps16:32
infinity(But then, yeah, it needs python2.7 because it's not python3, because it needs to run on precise...)16:32
infinitybdmurray: So, is this *only* about the tarball contents, and not at all about any tools that might be run on a trusty system?16:32
bdmurrayNo, this is about python-apport not being installed on saucy and the special traceback handler in the upgrader not working because it can't import python-apport code.16:33
infinitybdmurray: Right, but will that be invoked at py3 on a trusty system then?16:34
infinitys/at/as/16:34
infinityI guess the release-upgrader deps on trusty certainly imply that.16:35
bdmurrayWhen a Trusty system tries to upgrade to U, then it could and should be invoked as python3 provided we change the U tarball creator.16:35
bdmurraySo that's why I think the Trusty change to depend on python-apport is unnecessary.16:35
infinityRight, unnecessary, and bloaty.16:36
bdmurrayOkay, I'll remove that then.16:36
infinityI had a buildd install a bunch of python2 stuff on upgrade the other day, I guess that's why?16:36
bdmurrayIf the other day was Saturday or Sunday, probably.16:37
infinityIt was yesterday, yeah.16:37
infinityBrought in python-apport, launchpadlib, etc.16:37
bdmurrayyep16:37
infinitySo, yeah, if you want to maybe prep a branch in advance of "the first U upload of release-upgrader" that flips all the right switches to py3 tarballs, and keep that rebased until T releases, then we can stuff it in as soon as we open, and everyone wins.16:38
infinitySince some strange people always pester us until do-release-upgrade works, even when no packages have changed yet. :P16:38
bdmurrayheh, did you you see my email about the pgp signature for the release upgrade tarball?16:39
infinityI did, and it confused me.16:39
infinityThat should be atomic, from a mirror's POV, why do you care if the times are mismatched?16:39
infinity(ie: it hits disk, some other publisher stuff happens, then it's signed, but at no point is that intermediate step mirrored to the world)16:40
bdmurrayThere is a period of time where there is an upgrader and no signature, then upgrades fail.16:40
infinityIf the timestamp mismatch is an issue, we can fudge it with touch, but I don't see why it would be.16:40
infinitybdmurray: That's the part I don't believe.16:40
infinitybdmurray: This all happens in dists.in-progress during the publisher, and is atomicly copied to dists before we push mirrors.  Unless we have a bug where we're signing in the NEXT publisher run, but that seems unlikely.16:41
bdmurrayinfinity: I'm sorry you don't believe that upgrades fail or that there is a lag?16:41
infinitybdmurray: I don't believe that upgrades fail because of the lag, because the lag shouldn't be visible to anyone outside the datacentre.16:42
bdmurrayinfinity: okay, I was trying to upgrade on Friday and it failed because the .gpg file was missing. If I make this change to the upgrader and upload it soon, you should see it.16:43
bdmurrayIt being the issue.16:43
infinitybdmurray: I'm not discounting that upgrades fail, nor am I implying there's no lag between writing to disk and signing, I'm saying that I'd like some evidence that you actually see the disparity on a mirror, except if you literally catch them mid-rsync, and they don't do atomic dists mirroring.16:44
infinity(And people who don't do atomic dists mirroring are people we can't fix)16:44
cjwatsonAlso, the signing is done strictly before the mirror push16:45
infinitycjwatson: Yeah, I covered that.16:45
cjwatsonOh yes16:45
bdmurrayI'm still verifying but I don't think mirrors are used to get the release upgrader.16:54
cjwatsonopaque proxies are possible though16:55
infinitybdmurray: Everything is a mirror, but I assume you mean "no mirrors other than archive/ports".16:57
bdmurrayinfinity: yes, it just uses archive.ubuntu.com16:59
infinitybdmurray: Right, so those mirrors should be completely "safe" from a mirrors-not-doing-stupid-things perspective.16:59
infinitybdmurray: They should never get one half of dists without the other, etc, unless something goes wildly wrong.16:59
bdmurrayinfinity: well, I'll do this upload and ping you if I see the disparity.17:00
bdmurrayinfinity: if you look here you'll see it http://archive.ubuntu.com/ubuntu/dists/trusty-proposed/main/dist-upgrader-all/current/17:21
infinityHrm.17:22
infinityMaybe that's being published early in the security-only run, but not signed until the full run.17:22
ogra_stgraber, can we bump the amount of kept images on s-i to 50 (for -proposed) ? if we get into situations like today and people try to bi-sect back to the last promoted image 20 is not enough17:22
infinityYup, that's what's happening.  Erk.17:24
ogra_(we do two images per day, keeping 20 means 10 days only)17:24
cjwatsonI guess it's published by process-accepted at the start17:24
cjwatsonBecause custom uploads17:24
infinitycjwatson: Yeahp, that's what the log implies.17:24
infinitycjwatson: Maybe we need to build a signing run into the security-only pass.17:25
cjwatsonSeems odd for security-only to run finalize but not publish-distro though17:25
stgraberogra_: done. I was vaguely concerned by the disk usage but we're only at around 30GB now out of the 160GB we have on the target server, so that should be fine.17:25
ogra_yeah17:25
infinitycjwatson: Maybe it only runs publish-distro if *-security was actually dirty.  Which it usually isn'y.17:26
ogra_stgraber, theoretically having some function that simply keeps all proposed builds between two promoted images would be the best17:26
cjwatsoninfinity: I'd just got there, yes17:26
cjwatsonSo it needs to run publish-distro either way, I guess17:26
stgraberogra_: yeah, that'd be the proper fix, I'd have to add some more channel relationship knowledge into the expiring code, should be doable though17:27
infinitycjwatson: Or, more sanely, we don't need the security-only run at all if *-security isn't dirty (do we have a way to check that at the beginning and just not run?)17:27
ogra_right, just sounds like a bunch of code17:27
=== Ursinha is now known as Ursinha-afk
cjwatsoninfinity: It might be least invasive to have the various publish methods return a bool to say whether they did anything17:31
cjwatsonum, except that sometimes it'll do nothing else depending on options - not sure I have time/brainspace to work this out right now17:32
cjwatsonlib/lp/archivepublisher/scripts/publish_ftpmaster.py anyway, it's not horribly complicated17:33
infinitycjwatson: I think I'll toss to cprov and wgrant.17:42
* cjwatson nods17:43
=== Ursinha-afk is now known as Ursinha
bdmurrayslangasek, infinity: could one of you review that?18:03
infinitybdmurray: Is that byte-for-byte the same patch I just released to saucy?18:17
bdmurrayinfinity: aside of the fact that it is the apport hook for update-manager due to the package split yeah.18:18
infinityOh, with s/ubuntu-release-upgrader/update-manager/18:18
infinitybdmurray: Let me double-check the sameness of it, and wave it through.18:19
infinitybdmurray: No "import re", was it already there in the precise version?18:20
bdmurrayinfinity: yeah to get some aptdaemon log stuff18:21
infinityAhh, indeed it is.18:22
infinitybdmurray: Accepted.18:23
* infinity goes to hunt for... Whatever meal this is.18:23
slangasekI hope it's not fourthmeal18:25
infinityslangasek: I run all my meals in OF.18:27
slangasektwitch18:28
=== jackson is now known as Guest57400

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!