/srv/irclogs.ubuntu.com/2018/02/16/#ubuntu-release.txt

bdmurrayslangasek: "I think it's better" so bdmurray should do it?00:02
slangasekbdmurray: I'm willing to push the button if you prefer :)00:05
bdmurrayslangasek: I have no preference lets just get it doen00:05
slangasekbdmurray: ok, done00:06
slangasek(modulo the delay of updating 22 bugs)00:06
jbichaslangasek: do you have time to review libreoffice & gnome-desktop3 in the bionic NEW queue?00:07
slangasekjbicha: no, because I'm currently reviewing older stuff in said queue00:08
jbichacool, thanks00:08
-queuebot:#ubuntu-release- New: accepted nm-tray [source] (bionic-proposed) [0.3.0-0ubuntu1]00:10
tsimonq2\o/00:10
-queuebot:#ubuntu-release- New binary: nm-tray [amd64] (bionic-proposed/none) [0.3.0-0ubuntu1] (no packageset)00:12
-queuebot:#ubuntu-release- New binary: nm-tray [s390x] (bionic-proposed/none) [0.3.0-0ubuntu1] (no packageset)00:12
-queuebot:#ubuntu-release- New binary: nm-tray [ppc64el] (bionic-proposed/none) [0.3.0-0ubuntu1] (no packageset)00:12
-queuebot:#ubuntu-release- New binary: nm-tray [i386] (bionic-proposed/none) [0.3.0-0ubuntu1] (no packageset)00:13
-queuebot:#ubuntu-release- New binary: nm-tray [armhf] (bionic-proposed/none) [0.3.0-0ubuntu1] (no packageset)00:14
-queuebot:#ubuntu-release- New binary: nm-tray [arm64] (bionic-proposed/universe) [0.3.0-0ubuntu1] (no packageset)00:15
sarnoldfor the unity / compiz thing I've duped a few bugs to 174984000:17
tsimonq2thanks00:17
-queuebot:#ubuntu-release- New: accepted nm-tray [amd64] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted nm-tray [armhf] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted nm-tray [ppc64el] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted nm-tray [arm64] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted nm-tray [s390x] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted nm-tray [i386] (bionic-proposed) [0.3.0-0ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [amd64] (bionic-proposed) [3.27.90-1ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [armhf] (bionic-proposed) [3.27.90-1ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [ppc64el] (bionic-proposed) [3.27.90-1ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [arm64] (bionic-proposed) [3.27.90-1ubuntu1]00:28
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [s390x] (bionic-proposed) [3.27.90-1ubuntu1]00:29
-queuebot:#ubuntu-release- New: accepted gnome-desktop3 [i386] (bionic-proposed) [3.27.90-1ubuntu1]00:29
-queuebot:#ubuntu-release- New: accepted php-horde-passwd [sync] (bionic-release) [5.0.7-1]00:29
-queuebot:#ubuntu-release- New: accepted libreoffice [amd64] (bionic-proposed) [1:6.0.1-0ubuntu1]00:29
-queuebot:#ubuntu-release- New: accepted libreoffice [armhf] (bionic-proposed) [1:6.0.1-0ubuntu1]00:29
-queuebot:#ubuntu-release- New: accepted libreoffice [ppc64el] (bionic-proposed) [1:6.0.1-0ubuntu1]00:30
-queuebot:#ubuntu-release- New: accepted libreoffice [arm64] (bionic-proposed) [1:6.0.1-0ubuntu1]00:30
-queuebot:#ubuntu-release- New: accepted libreoffice [s390x] (bionic-proposed) [1:6.0.1-0ubuntu1]00:30
-queuebot:#ubuntu-release- New: accepted libreoffice [i386] (bionic-proposed) [1:6.0.1-0ubuntu1]00:30
dokowho's accepting binaries before they are built on all archs?00:33
naccdoko: which one?00:34
-queuebot:#ubuntu-release- New: accepted mbedtls [armhf] (bionic-proposed) [2.7.0-2]00:34
dokothat one00:34
slangasekpossibly me00:38
slangasekbecause I don't see that it matters to not do so, or warrants spending the attention instead of just running new-binary-debian-universe00:40
dokowell, the next one looking at the NEW queue spends that attention why there is only a binary on one arch. not that efficient00:47
slangasekyou could also run new-binary-debian-universe ;)00:51
tsimonq2up to seven dups: https://bugs.launchpad.net/ubuntu/+source/compiz/+bug/174984001:25
ubot5Ubuntu bug 1749840 in compiz (Ubuntu) "apt-get install ubuntu-desktop doesn't work" [Undecided,Confirmed]01:25
tsimonq2argh, I accidentally uploaded calamares-settings-ubuntu without running dch -r so it looks like it's from November...01:54
-queuebot:#ubuntu-release- New source: calamares-settings-ubuntu (bionic-proposed/primary) [1]01:54
tsimonq2Can someone reject please?01:54
tsimonq2(There's an associated lintian warning with using a Standards-version newer than the changelog entry...)01:54
-queuebot:#ubuntu-release- New source: calamares-settings-ubuntu (bionic-proposed/primary) [1]02:23
-queuebot:#ubuntu-release- New: rejected calamares-settings-ubuntu [source] (bionic-proposed) [1]08:21
apwtsimonq2, ^08:21
-queuebot:#ubuntu-release- Unapproved: rejected fwupdate [amd64] (bionic-proposed) [10-2build1]08:37
-queuebot:#ubuntu-release- Unapproved: rejected fwupdate [armhf] (bionic-proposed) [10-2build1]08:37
-queuebot:#ubuntu-release- Unapproved: rejected fwupdate [arm64] (bionic-proposed) [10-2build1]08:37
-queuebot:#ubuntu-release- Unapproved: rejected fwupdate [i386] (bionic-proposed) [10-2build1]08:37
-queuebot:#ubuntu-release- Unapproved: accepted fwupdate [amd64] (bionic-proposed) [10-3]08:37
-queuebot:#ubuntu-release- Unapproved: accepted fwupdate [armhf] (bionic-proposed) [10-3]08:37
-queuebot:#ubuntu-release- Unapproved: accepted fwupdate [arm64] (bionic-proposed) [10-3]08:37
-queuebot:#ubuntu-release- Unapproved: accepted fwupdate [i386] (bionic-proposed) [10-3]08:37
dokowho is working on Kylin these days?10:39
dokoasking for https://launchpadlibrarian.net/357258908/buildlog_ubuntu-bionic-amd64.ubuntu-kylin-sso-client_0.1.2.4_BUILDING.txt.gz10:40
dokohttps://bugs.launchpad.net/ubuntu/+source/ubuntu-kylin-sso-client/+bug/174992410:45
ubot5Ubuntu bug 1749924 in ubuntu-kylin-sso-client (Ubuntu) "ubuntu-kylin-sso-client ftbfs in bionic" [High,Confirmed]10:45
rbasakCould an AA review libzstd in Xenial binNEW please? It's related to maintaining the upgrade path in an SRU.11:24
sil2100rbasak: you ACKed the SRU, right?11:27
rbasaksil2100: yes11:27
sil2100rbasak: in that case I can do that, one moment11:28
rbasakahasenack: ^11:35
ahasenackthx11:36
sil2100rbasak, ahasenack: done11:38
-queuebot:#ubuntu-release- New: accepted libzstd [amd64] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [armhf] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [powerpc] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [s390x] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [arm64] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [ppc64el] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
-queuebot:#ubuntu-release- New: accepted libzstd [i386] (xenial-proposed) [1.3.1+dfsg-1~ubuntu0.16.04.1]11:38
ahasenackthanks sil210011:38
ahasenackhi, I need a component-mismatch fix for http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#sssd11:38
ahasenackpython-sss is in main, that's the py2 version11:38
ahasenackpython3-sss is in universe11:38
ahasenackboth come from the same source package which is sssd11:39
rbasaksil2100: thanks!11:45
jbichadoko: there is a #ubuntukylin-devel channel12:09
tsimonq2apw: Thanks :)14:05
apwahasenack, have you found the MIR for that, that let the py2 in ?14:16
ahasenackapw: I didn't check, since it was in main already (as is sssd itself)14:17
apwahasenack, ok found it14:35
apwahasenack, ok poked14:37
bdmurrayslangasek: FYI the unity phasing got stopped by the phased updater.16:37
bdmurrayslangasek: Its right - just thought it was worth noting.16:37
tsimonq2Does anto16:38
tsimonq2gerr16:39
tsimonq2Does anyone happen to know what version of apt runs on Nusakan?16:39
slangasekbdmurray: ah?16:39
slangasektsimonq2: I'm not sure apt is run at any point on nusakan as part of the builds16:39
slangasektsimonq2: what are you seeing?16:40
tsimonq2slangasek: Curious about juliank's question on bug 171445116:40
ubot5bug 1714451 in libglvnd (Ubuntu) "please remove libglvnd from the archive" [Undecided,Invalid] https://launchpad.net/bugs/171445116:40
tsimonq2er16:40
tsimonq2wrong one16:40
tsimonq2bug 174680716:41
ubot5bug 1746807 in apt (Ubuntu) "18.04 daily installer fails missing kernel" [Critical,Confirmed] https://launchpad.net/bugs/174680716:41
tsimonq2that :)16:41
* juliank too16:41
juliankprobably there are different version, but I don't remember16:41
juliankI think we jumped from alpha5 to alpha716:42
slangasektsimonq2: the version that's relevant there is the version run from inside the install target16:43
juliankalpha6 introduced retrying for acquire items and the new mirror method, so it's possibles something got broken.16:43
slangasekwhich is the version on the image16:43
slangaseknot on nusakan16:43
juliankalpha5 was superseded on 2018-01-31 19:37:29 CET16:43
tsimonq2slangasek: Ohhh and the timing matches up too, apt in Bionic got updated on 20180131 as well16:44
tsimonq2juliank: It's likely that then I think16:44
juliankWell, cdrom support is basically unmaintained and does not have much tests, so it breaks a lot16:45
xnoxmost no longer have cdroms....16:45
juliankBut well, something must have broken.16:46
tsimonq2OK16:46
juliankBest next would be to get the image, and bisect apt-cdrom16:46
tsimonq2I can do that if we know it's apt-cdrom.16:47
tsimonq2(That would make sense.)16:47
juliankWell, it's somewhere in the apt-pkg library probably16:47
juliankbut anyway, bisecting should be relatively easy I guess.16:48
slangasekxnox: we use apt-cdrom also for USB sticks at install time16:48
juliankyes, we do.16:48
juliankunfortunately installs are not a common thing :D16:48
* tsimonq2 volunteers to do the bisecting16:48
juliankat least for developers - so it's good to have testing for it :D16:48
tsimonq2:D16:49
xnoxslangasek, because file:// would not do?16:49
juliankcorrect16:49
slangasekxnox: file:// semantics are wrong for removable media16:49
juliankxnox: file:// has a fixed path, that does not really work16:49
juliankcdrom:// looks up based on some media id label thingy16:49
xnox..... which systemd .mount unit could do too....16:50
juliankWe should probably symlink it to usb :D16:50
xnox%i too16:50
juliankit's a weird file in .disk-info  or something, and then it hashes the files to make sure it's the correct disk16:50
juliankit's all fairly weird, but it makes sure you don't accidentally update/install something different just because it has the same name16:51
xnoxstart an http server to serve cdrom:// over http?! =) as a mirror?! =)16:51
slangaseklast I knew, there were error code differences w/ absent cdrom sources as well16:52
juliankprobably16:52
juliankanyhow, it's the right thing to do16:52
juliankmaybe we should allow usb:// as an alias? :D16:52
juliankor disk://16:52
juliankand disc://16:53
slangasektwitch16:53
juliankI don't know16:53
julianktsimonq2: I'll ask DonKult if he has an idea, he made all those big changes :/16:54
bdmurrayI think its .media-info16:54
juliankah16:54
xnoxjuliank, hokey-rink:// too then!16:55
xnoxhttps://en.wikipedia.org/wiki/Bootable_business_card16:55
juliankNah16:55
juliankbbc:// sounds nice, though16:55
juliankPackage it as apt-transport-bbc16:55
juliankIf only to annoy BBC folks16:56
* xnox suspects juliank is not trolling; and simply has no idea what bbc stands for on urban dictionary16:57
juliankI meant the British one16:57
juliank:D16:57
-queuebot:#ubuntu-release- New binary: python-skytools [s390x] (bionic-proposed/none) [3.3-2] (no packageset)17:11
-queuebot:#ubuntu-release- New binary: eo-spell [amd64] (bionic-proposed/main) [2.1.2000.02.25-55] (ubuntu-desktop)17:12
-queuebot:#ubuntu-release- New binary: quaternion [s390x] (bionic-proposed/none) [0.0.5-1] (no packageset)17:13
-queuebot:#ubuntu-release- New binary: radare2 [s390x] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:13
-queuebot:#ubuntu-release- New binary: dxf2gcode [amd64] (bionic-proposed/universe) [20170925-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: golang-github-nvveen-gotty [amd64] (bionic-proposed/universe) [0.0~git20120604.cd52737-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: londiste [amd64] (bionic-proposed/universe) [3.3.0-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: python-coverage [amd64] (bionic-proposed/universe) [4.5+dfsg.1-2] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: radare2 [amd64] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: emacs-fossil [amd64] (bionic-proposed/universe) [2018.02.15-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: pytest-forked [amd64] (bionic-proposed/universe) [0.2-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: golang-github-opencontainers-go-digest [amd64] (bionic-proposed/universe) [1.0.0~rc1-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: python-skytools [amd64] (bionic-proposed/universe) [3.3-2] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: pokemmo-installer [amd64] (bionic-proposed/multiverse) [1.4.5-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: python-skytools [i386] (bionic-proposed/universe) [3.3-2] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: pokemmo [amd64] (bionic-proposed/multiverse) [1.4.3-1] (no packageset)17:15
-queuebot:#ubuntu-release- New binary: lua-ljsyscall [amd64] (bionic-proposed/universe) [0.12-1] (no packageset)17:16
-queuebot:#ubuntu-release- New binary: python-skytools [arm64] (bionic-proposed/universe) [3.3-2] (no packageset)17:18
-queuebot:#ubuntu-release- New binary: quaternion [amd64] (bionic-proposed/universe) [0.0.5-1] (no packageset)17:18
-queuebot:#ubuntu-release- New binary: python-skytools [armhf] (bionic-proposed/universe) [3.3-2] (no packageset)17:18
-queuebot:#ubuntu-release- New binary: radare2 [i386] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:18
-queuebot:#ubuntu-release- New binary: quaternion [i386] (bionic-proposed/universe) [0.0.5-1] (no packageset)17:19
-queuebot:#ubuntu-release- New binary: radare2 [arm64] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:19
-queuebot:#ubuntu-release- New binary: radare2 [armhf] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:22
-queuebot:#ubuntu-release- New binary: radare2 [ppc64el] (bionic-proposed/universe) [2.3.0+dfsg-1] (no packageset)17:22
-queuebot:#ubuntu-release- New binary: python-skytools [ppc64el] (bionic-proposed/universe) [3.3-2] (no packageset)17:23
-queuebot:#ubuntu-release- New binary: quaternion [arm64] (bionic-proposed/universe) [0.0.5-1] (no packageset)17:25
-queuebot:#ubuntu-release- New binary: quaternion [ppc64el] (bionic-proposed/universe) [0.0.5-1] (no packageset)17:27
-queuebot:#ubuntu-release- New binary: quaternion [armhf] (bionic-proposed/universe) [0.0.5-1] (no packageset)17:29
-queuebot:#ubuntu-release- Unapproved: supermin (xenial-proposed/universe) [5.1.14-2ubuntu1 => 5.1.14-2ubuntu1.1] (no packageset)18:41
naccchrisccoulson: infinity: glibc in bionic is versioned less than artful18:58
naccand i think is breaking some folks in #ubuntu+118:58
nacci'm assuming the artful package should be copied forward?18:59
nacci think if a user did artful with the security update -> bionic, many packages with libc dependencies will fail to install in bionic19:05
naccthey can manually workaround with libc6= libc6-dev= libc6-i386= to downgrade to the bionic version, but that's not great UX :)19:06
naccslangasek: --^ maybe you can help as i think it will take a AA19:28
-queuebot:#ubuntu-release- New binary: linux-signed-lts-xenial [amd64] (trusty-proposed/main) [4.4.0-116.140~14.04.1] (kernel)19:30
-queuebot:#ubuntu-release- New: accepted linux-signed-lts-xenial [amd64] (trusty-proposed) [4.4.0-116.140~14.04.1]19:43
-queuebot:#ubuntu-release- Unapproved: gnome-themes-standard (xenial-proposed/main) [3.18.0-2ubuntu1 => 3.18.0-2ubuntu2] (ubuntu-desktop)20:18
-queuebot:#ubuntu-release- Unapproved: gnome-themes-standard (artful-proposed/main) [3.22.3-1ubuntu1 => 3.22.3-1ubuntu2] (ubuntu-desktop)20:24
slangaseknacc: it's a known temporary problem until glibc 2.27 is landed in bionic, which I don't have a current ETA on.  We would not normally copy directly to bionic from artful, but would copy to bionic-proposed instead, and I'm not sure the artful version would actually clear autopkgtests so I don't want to do that unless strictly necessary20:27
slangasekinfinity: ^^ what's the current status of 2.27?  are you still in package merge hell?20:27
bdmurrayslangasek: Now that ddebs is fixed - https://code.launchpad.net/~brian-murray/apport/lp-retracer-bionic-updates/+merge/33767620:33
slangasekbdmurray: merged, thanks!20:39
tsimonq2Out of curiosity, I wonder why ddebs.ubuntu.com doesn't have anything for *-security.20:39
slangasektsimonq2: I don't know if this is the rationale, but it would be redundant since everything published to -security is also copied to -updates20:42
tsimonq2slangasek: What about the case where something is released to -updates that updates patch or minor version and there's already something in -security?20:44
slangasekah, the case where -security is non-empty and -updates is ahead20:44
tsimonq2Yeah.20:45
slangasekthat's a good point, indeed20:45
infinityslangasek: I'm fiddling with some theories, and was planning to upload today/tomorrow, but I also have no issues with copying artful-security -> bionic-release and skipping testing entirely.  The security upload regresses autopkgtests on armhf (and the arm64 build is regressed due to binutils), but I know of no other issues that would be worth doing the proposed dance on it.20:45
bdmurrayhunh, I wonder if we have any cases that fail to retrace because of that.20:46
slangasektsimonq2: OTOH, if you're running a system with only -security enabled w/ no -updates, are debug symbols actually useful to you, since you are evidently not going to be deploying any SRUs that fix a crash20:46
slangasekinfinity: I would be inclined to copy to bionic-proposed first, force-skiptest, and flush the autopkgtest requests, so I don't have to think about whether there's a risk of uninstallables20:47
slangasekinfinity: oops, in the time it took me to write that sentence I proved to myself there is no risk of uninstallables20:47
infinityslangasek: If there are uninstallables with a non-version-bumped glibc, we've done something very, very wrong, but sure.20:48
slangasekinfinity: k, copying.20:48
slangaseknacc: ^^20:48
slangasekbdmurray: do you think this is important enough to put on our backlog?20:50
tsimonq2slangasek: I can see a use case for it; I think even security updates have a nonzero potential to break. Even if it's rare, I don't (personally) see a reason why debug symbols shouldn't be available should someone need them.20:51
tsimonq2slangasek: But also note that I don't have a very strong opinion either way, but rather I was wondering out of curiosity why -security ddebs aren't published with -updates et al20:52
bdmurrayslangasek: I think having a backlog item to think about it is a good idea.20:52
tsimonq2slangasek: I also don't think (please correct me if I'm wrong) that there's *many* packages that have non-empty -security with -updates ahead, so while I'm not sure on numbers, adding it there might not impact resources on the server much.20:53
tsimonq2¯\_(ツ)_/¯20:54
slangasekbdmurray: k, please drop me a card :)21:09
slangasektsimonq2: it absolutely isn't going to be a space issue for us - it's only the effort to implement and maintain21:09
bdmurraytsimonq2: I'm pretty sure the debug symbols are available on LP if someone really needed them.21:10
tsimonq2bdmurray: You can say the same for all other packages ;)21:14
tsimonq2slangasek: right, ok21:14
naccslangasek: infinity: the user in question was on bionic and was unable to install nvidia-38421:37
naccslangasek: infinity: with forced apt versioning, it installed fine21:37
naccpossibly because only libc6 was already installed and then libc-i386 was going to be installed? but only the bionic version was available and conflicted with the artful-security version?21:38
slangasekyes21:38
slangasekforced apt versioning> speewwwww21:38
naccslangasek: yeah, i mean apt install nvidia-384 libc=... libc-i386=... etc21:39
naccjust to get them to the bionic packages21:39
slangasekoh ok21:39
naccso it's not uninstallable in the traditional sense, but the effect to users is the same :)21:39
naccslangasek: and thanks for your feedback here, I have seen other users in the past few days hit it too, I just remembered to dig into it more today21:41
julianktsimonq2, slangasek: only -updates and -proposed are whitelisted in ddeb-retriever, I think all that's needed to enable security again (it's there for trusty) is http://paste.ubuntu.com/p/C4Dr8GmPw5/22:09
juliankoh no22:10
juliankone more22:10
juliankhttp://paste.ubuntu.com/p/JVTHsZv63Z/22:10
juliankthis might cause quite some havoc if enabled since it would suddenly start fetching and scanning all debug symbols for all security releases22:11
slangasekjuliank: are there any assumptions about urls for indices of the base pockets?22:11
juliankI think the reason it's not done is that there's a huge overlap with updates.22:11
slangasekwell, I guess http://archive.ubuntu.com/ubuntu/dists/foo-security/ exists anyway22:11
slangasekjuliank: raise an MP?  maybe ask cjwatson to review it :)22:12
juliankright there's some mirroring22:12
juliankUm, yeah.22:12
infinityjuliank: Overlap shouldn't matter if they share a pool (which they do), surely.22:12
juliankinfinity: It's only a matter of indexing runtime22:13
juliankit's currently about 2 mins per architecture x pocket pair22:13
juliankAFAICT22:13
infinitypost-release pockets should be faster, I'd think.22:13
juliankwe are adding about 33% more22:13
juliank_should_ not matter if apt-ftparchive is using a cache database, but hmm, I'm not sure it does.22:14
infinityjuliank: Is it done in one big apt.conf, or one run per pocket?22:14
juliankinfinity: one run per pocket22:14
infinityPretty sure a-f caching was enabled for that.  It's much faster if you do all pockets in one big apt.conf, though.22:14
infinityOtherwise, you risk flushing the a-f caches between each run.22:15
juliankWe might be able too22:15
juliankIt'd be good to setup a second test instance I guess with a copy view of the current state to play with or something22:16
infinityFor reference, post-release pockets on ftpmaster are seconds per arch/component in the a-f stage.  They're basically free.22:16
juliankinfinity: In any case, this requires some refactoring I've planned to make dists updates more atomic22:17
infinityBut that's because the caches are hot already (the first one is always noticeably slower, while the rest are free).22:17
juliankCurrently dists/<foo> is so slow people get hashsum mismatches a lot22:17
julianklike 2 or 3 times last week I got complaints22:17
juliankI wanted to make dists/<foo> (mostly) atomic, but if I want to do all in one apt-ftparchive run, I guess I'll just create dists.new and then swap it22:18
infinityjuliank: Following the publisher model of "update pool", "rsync dists dists.new", "update dists.new in a single apt.conf pass", "rm dists && mv dists.new dists" probably works best.  But then you also need a stay-of-execution concept to avoid cleaning things from pool too early.22:18
juliankwell, not rm dists && mv dists.new dists, but rather mv dists dists.old && mv dists.new dists && rm dists.old; but that's the goal.22:19
infinityWell, "rm dists && mv dists.new dists" is not actually the model.  We "mv dists dists.old && mv dists.new dists" to narrow the window, plus it gives us a quicker rsync when we mv dists.old to dists.new and resync for the next pass.22:19
infinityjuliank: Jinx.22:20
infinityjuliank: ie: we never 'rm dists.old', we just always have two copies around, and freshen up old to new before the next run.22:20
infinityjuliank: Slight waste of disk space, but huge win on time.22:21
juliankThat's best22:21
slangasekfs juggling22:21
infinity(.old and .new also don't exist in the published tree, obviously)22:21
juliankIt also allows you to do some roll back I guess.22:21
juliankalthough, not with ddeb-retrievers cleanup model22:21
juliankIt currently builds the new dists/ tree, and then goes through pool and removes unreferenced files22:21
infinityjuliank: Right, I alluded to that earlier, that you'd need a stay-of-execution concept to avoid windows where files disappear.22:22
infinityjuliank: But that's not too hard.  You make the cleanup pass mark files for deletion instead of actually deleting, and a second cronjob cleans things with deletion timestamps >> 24h.22:22
juliankWe don't _need_ it.22:23
juliankIt would just behave as it does now22:23
infinityAlso fair.22:23
juliankthe dists.new becomes the dists, and then we do the removal based on the new state.22:23
infinityIt's not a high traffic enough apt archive to worry too much about perfect internal consistency.22:23
juliankbut yes, it would be nice to keep stuff around a bit22:23
infinityOh.  If the removal pass is separate from the update pass, yes, that works.22:24
juliankIt is22:24
infinityadd-to-pool, update-dists, remove-from-pool22:24
juliankexactly22:24
infinityYeah, I'm fine with that.22:24
infinityAnd way simpler than the tricks we have to pull on high traffic mirrors.22:24
juliankThough we can make the pass also just write all files to delete to a list, and then read the list and delete the files at the start of the next ddeb-retriever run22:25
juliankthis avoids some minor issues22:25
infinityNah.  Lists are complicated for other reasons.22:25
infinityNotably the reappearance of versions, so you need to actually compare new published binaries against the list and remove matching lines.22:25
juliankinfinity: Oh, we actually have a keep_days option22:25
juliankso it actually only deletes files older than a few days22:25
juliankcurrently set to 30 days22:26
infinityGross.22:26
infinityThat seems hugely like overkill.22:26
juliankit might make sense to reduce it to like 4 days or something22:26
infinityProbably was due to lagging errors retracers.22:26
infinityWhich now will fetch from the librarian directly.22:26
juliankmaybe two days22:26
julianksince clients do update automatically daily, they should never be more out of sync than that22:27
juliankI'll send some pretty merge proposals in the next days :)22:27
juliankddeb-retriever is very interesting because the code is easy to follow.22:28
juliankbut it's next to impossible to test22:29
juliankarchive_tools in it has unit tests, but a lot of them fail22:30
juliankah just some import messup22:30
* juliank sends MP22:32
naccslangasek: could use some AA love to new packages in LP: #174978322:33
ubot5Launchpad bug 1749783 in php-sabre-xml (Ubuntu) "php-defaults stuck in bionic-proposed" [Undecided,Confirmed] https://launchpad.net/bugs/174978322:33
infinityjuliank: Also, is ddeb-retriever smart enough to only run a-f for suites that changed?22:38
juliankslangasek, infinity: Fixes for test suite & retention: https://code.launchpad.net/~juliank/ddeb-retriever/misc-fixes/+merge/337899  ; add -security: https://code.launchpad.net/~juliank/ddeb-retriever/add-security/+merge/33790022:38
juliankinfinity: yes22:38
juliankinfinity: and since recently for empty ones that do not exist yet :D22:38
slangaseknacc: you were not using 'new' as a verb there, were you22:38
infinityjuliank: Okay, good.  So, yeah, that's the point behind having two copies and the rsync refresh, so we have a complete dists and just refresh the ones that need changing, then switcheroo.22:39
juliankyou can tell it to regenerate all, I accidentally did that earlier22:39
juliankthis week I think22:40
juliankNot by using the option of course, but with a coding bug :D22:40
juliankI specifically requested cjwatson to review the security one, I think the other one is more harmless :)22:41
juliankWe probably want to get rid of vivid, yakkety, and zesty on ddebs too22:42
infinityjuliank: Commit message says "Import urllib.request instead of urllib", code imports both.  Which is it? :P22:42
juliankugh22:43
juliankit should have been instead22:43
juliankbut it does not matter22:43
infinitySpoken like a professional software engineer.22:44
infinityHow quickly you lose your student ideals.22:44
juliankinfinity: I'd care if it was git22:44
juliankI'd rebase there22:44
juliankbut in bzr?22:44
infinityIn bzr, you'd just re-branch and try harder.22:45
infinitySince it's not in trunk yet.22:45
infinityOr stack an oops commit on top, whatever. :P22:45
juliankI just uncommit, shelve, and commit and push overwrite22:45
tsimonq2*cough* https://github.com/mnauw/git-remote-bzr22:46
tsimonq2I never touch Bazaar now thanks to that.22:46
julianktsimonq2: how do you build bzr-buildpackage packages then? :D22:47
tsimonq2Who does that anymore?!? >_<22:48
juliankinfinity: I overwrote the MP misc-fixes now with a nice history22:48
julianktsimonq2: some packages are still in bzr and nobody has time to convert all of them to git22:49
nacc<cough>22:49
tsimonq2juliank: "nobody has time to convert all of them to git" try me :D22:50
juliankyes there's git-ubuntu, but that's a different topic22:50
tsimonq2:D22:50
nacc:)22:51
* juliank out.23:02

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!