[00:04] -queuebot:#ubuntu-release- Unapproved: rejected livecd-rootfs [source] (groovy-proposed) [2.694.6]
[00:04] -queuebot:#ubuntu-release- Unapproved: livecd-rootfs (groovy-proposed/main) [2.694.5 => 2.694.6] (desktop-core, i386-whitelist)
[00:16] -queuebot:#ubuntu-release- Unapproved: livecd-rootfs (focal-proposed/main) [2.664.21 => 2.664.22] (desktop-core, i386-whitelist)
[01:05] -queuebot:#ubuntu-release- New sync: jaraco.collections (impish-proposed/primary) [3.2.0-1]
[05:06] -queuebot:#ubuntu-release- New: accepted jaraco.collections [sync] (impish-proposed) [3.2.0-1]
[05:13] -queuebot:#ubuntu-release- New binary: libchemistry-mol-perl [amd64] (impish-proposed/universe) [0.38-1] (no packageset)
[06:46] -queuebot:#ubuntu-release- New: accepted libchemistry-mol-perl [amd64] (impish-proposed) [0.38-1]
[07:49] -queuebot:#ubuntu-release- Unapproved: neutron (focal-proposed/main) [2:16.3.1-0ubuntu1.1 => 2:16.3.2-0ubuntu1] (openstack, ubuntu-server)
[08:08] -queuebot:#ubuntu-release- Unapproved: python-pipx (hirsute-proposed/universe) [0.12.3.1-3ubuntu1 => 0.16.2.1-0ubuntu3~21.04] (no packageset)
[10:22] <Laney> juliank: check temp/filter-amqp-dupes-upstream on the cloud controller
[10:22] <Laney> what do you think about having something like that in a timer?
[10:22] <Laney> until we have a better solution, we can at least stop old requests piling up
[10:29] <juliank> Laney: looks ok I guess
[10:30] <Laney> alright I'll make a merge request
[10:49] <Laney> testing a tentative fix for the "unknown" ALWAYSFAIL problem
[10:49] <Laney> surprise: we have a hack for kernels
[10:49] <Laney> they basically never report ALWAYSFAIL and that is busted imho
[10:49] <Laney> s/ALWAYSFAIL/REGRESSION/
[10:50]  * juliank is just testing grubs and kernels :/
[10:51] <Laney> good
[10:51] <Laney> feels like there's a slightly shady situation on arm64 somehow
[10:51] <Laney> but not got much more than a feeling
[10:57] <juliank> arm64 is fairly broken
[10:57] <juliank> I could boot bionic, but not xenial
[10:58] <juliank> Laney: did you have more failing logs from arm64?
[10:58] <juliank> Laney: You said it failed on hirsute too
[10:58] <juliank> Maybe it's just different hardware it's failing on
[10:58] <juliank> I don't know
[11:08] <Laney> juliank: bionic in bos01 on the new machines, not bos02 so some config difference which tickles it
[11:09] <Laney> the old ones seem ok (but slow)
[11:09] <juliank> Laney: I was testing this in canonistack, where bionic was good and xenial bad
[11:09] <Laney> lol
[11:10] <Laney> well I think they all have the old (swirlix) hardware
[11:10] <Laney> I didn't notice any particular issues there in scalingstack anyway
[11:11] <Laney> so... yay... another axis?
[11:13] <juliank> something somewhere sometime
[11:13] <juliank> cosmic rays
[11:51] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-460 (hirsute-proposed/restricted) [460.80-0ubuntu0.21.04.1 => 460.80-0ubuntu0.21.04.2] (core, i386-whitelist)
[11:52] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-460 (bionic-proposed/restricted) [460.80-0ubuntu0.18.04.1 => 460.80-0ubuntu0.18.04.2] (no packageset)
[11:52] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-460 (groovy-proposed/restricted) [460.80-0ubuntu0.20.10.1 => 460.80-0ubuntu0.20.10.2] (i386-whitelist)
[11:52] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-460 (focal-proposed/restricted) [460.80-0ubuntu0.20.04.1 => 460.80-0ubuntu0.20.04.2] (i386-whitelist)
[12:05] <ddstreet> Laney is autopkgtest ok? the queue lengths are quite long and it doesn't seem like much is running...
[12:06] <Laney> ddstreet: it's alright as it goes, see last night, I reduced the parallelism temporarily, will increase it later once those libreoffices finish
[12:18] -queuebot:#ubuntu-release- New sync: jaraco.text (impish-proposed/primary) [3.5.0-1]
[12:19] -queuebot:#ubuntu-release- New sync: jaraco.classes (impish-proposed/primary) [3.2.1-1]
[12:32] <ginggs> anyone around to review https://code.launchpad.net/~ginggs/autopkgtest-cloud/+git/autopkgtest-cloud/+merge/403082 please?
[12:39] <Laney> juliank: just seen it on groovy/bos01 too :(
[13:09] <juliank> Laney: cool
[13:25] <juliank> Laney: we gotta collect data on where it fails, I guess grep logs somehow
[13:26] <juliank> Laney: such that we can have a look on both the bootloader on the grub side, kernel on the kernel side, and/or infra on the is side
[13:53] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-450-server (bionic-proposed/restricted) [450.119.04-0ubuntu0.18.04.1 => 450.119.04-0ubuntu0.18.04.2] (no packageset)
[13:53] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-450-server (groovy-proposed/restricted) [450.119.04-0ubuntu0.20.10.1 => 450.119.04-0ubuntu0.20.10.2] (core, i386-whitelist)
[13:53] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-450-server (focal-proposed/restricted) [450.119.04-0ubuntu0.20.04.1 => 450.119.04-0ubuntu0.20.04.2] (i386-whitelist)
[13:53] -queuebot:#ubuntu-release- Unapproved: nvidia-graphics-drivers-450-server (hirsute-proposed/restricted) [450.119.04-0ubuntu0.21.04.1 => 450.119.04-0ubuntu0.21.04.2] (core, i386-whitelist)
[14:24] <Laney> juliank: i'll be afk next week, leave that one up to you :p
[14:24] <Laney> be cool if we had a proper log server wouldn't it, with nice searching
[14:25] <juliank> Laney: We could at least configure journald to log to remote journal and aggregate all journals from all cloud, lxd, web workers centrally :D
[14:26] <sil2100> Laney: oh oh, you out whole week next week?
[14:26] <Laney> yes
[14:26] <Laney> and indeed, I was thinking that would actually be a very good idea with multiple cloud workers
[14:27] <sil2100> Laney: after applying some of your comments, you think I could get the ESM stuff deployed on staging with juliank's help?
[14:27] <sil2100> At least experimentally
[14:27] <juliank> we can do that!
[14:27] <juliank> I do have to do urgent shim grub stuff though
[14:27] <juliank> but if it's not much help that's needed, that's fine
[14:27] <juliank> and breaking it is mostly harmless too :)
[14:27] <sil2100> \o/ No worries, I still didn't address all Laney review points!
[14:28] <juliank> sil2100: If you break it, you get to redeploy it from scratch!
[14:28] <sil2100> I'll poke you next week for sure, at least with some questions!
[14:34] <Laney> sil2100: yes, build a charm from your branch and push it to edge, no problemo
[14:46] <bdmurray> ginggs: I see libflame as passing or am I missing something? https://autopkgtest.ubuntu.com/packages/l/libflame
[14:46] -queuebot:#ubuntu-release- Unapproved: freeipmi (focal-proposed/main) [1.6.4-3ubuntu1.1 => 1.6.4-3ubuntu1.2] (ubuntu-desktop, ubuntu-server)
[14:47] -queuebot:#ubuntu-release- Unapproved: freeipmi (groovy-proposed/main) [1.6.4-3ubuntu2 => 1.6.4-3ubuntu2.1] (ubuntu-desktop)
[14:47] -queuebot:#ubuntu-release- Unapproved: freeipmi (hirsute-proposed/main) [1.6.6-3 => 1.6.6-3ubuntu0.1] (ubuntu-desktop)
[14:47] -queuebot:#ubuntu-release- Unapproved: freeipmi (bionic-proposed/main) [1.4.11-1.1ubuntu4.1 => 1.4.11-1.1ubuntu4.2] (ubuntu-desktop, ubuntu-server)
[14:47] <doko> bdmurray: that was libflame/amd64 on groovy
[14:48] <bdmurray> doko: and then the hint would be for all releases? it doesn't seem to be needed for hirsute or impish
[14:48] <bdmurray> s/hint/big packages change/
[14:49] <doko> bdmurray: https://launchpad.net/ubuntu/+source/libflame/5.2.0-3ubuntu2
[14:50] <bdmurray> okay, that's helpful
[15:01] -queuebot:#ubuntu-release- Unapproved: livecd-rootfs (focal-proposed/main) [2.664.21 => 2.664.23] (desktop-core, i386-whitelist)
[15:13] -queuebot:#ubuntu-release- Unapproved: rejected ubiquity [source] (focal-proposed) [20.04.15.12]
[15:14] -queuebot:#ubuntu-release- Unapproved: ubiquity (focal-proposed/main) [20.04.15.11 => 20.04.15.12] (core)
[15:26] <Laney> ubuntu-release heads up I just pushed a commit to britney2-ubuntu which should make kernel uploads show regressions sometimes, rather than not as it does now (after chatting with apw in private)
[15:26] <apw> +1
[15:26] <Laney> it may mean that some hints are required now, if it turns out we were always hiding problems by doing that
[15:27] <Laney> if it causes lots of issues when i'm off next week, revert and i'll look again when back
[15:28] <Laney> and ubuntu-sru ^^^ fyi, this is because I noticed in hirsute there were some regressions that should be shown next to linux-meta-raspi but aren't
[15:28] <Laney> hopefully this change makes them show up now
[15:30] <Laney> (I suppose the kernel team's tooling would have shown *them* it already)
[15:37] <apw> yes we would already know about things which would be deemed blocking and have them hinted (potentially) in our tools
[15:48] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-460 [source] (hirsute-proposed) [460.80-0ubuntu0.21.04.2]
[15:49] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-460 [source] (groovy-proposed) [460.80-0ubuntu0.20.10.2]
[15:49] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-460 [source] (focal-proposed) [460.80-0ubuntu0.20.04.2]
[15:51] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-460 [source] (bionic-proposed) [460.80-0ubuntu0.18.04.2]
[15:53] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-450-server [source] (hirsute-proposed) [450.119.04-0ubuntu0.21.04.2]
[15:54] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-450-server [source] (groovy-proposed) [450.119.04-0ubuntu0.20.10.2]
[15:55] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-450-server [source] (focal-proposed) [450.119.04-0ubuntu0.20.04.2]
[15:55] -queuebot:#ubuntu-release- Unapproved: accepted nvidia-graphics-drivers-450-server [source] (bionic-proposed) [450.119.04-0ubuntu0.18.04.2]
[16:33] <Laney> hmm
[16:33] <Laney> juliank: ideas for how to write a systemd condition to not run the filter-amqp-dupes thing on lxd worker but only the cloud one
[16:33] <Laney> ?
[16:35] <juliank> Laney: sth with ConditionHost= or ConditionEnvironment?
[16:36] <Laney> HMMMMMMMMMM
[16:41] <Laney> i'll meditate on it while packing
[16:42] <Laney> might need to write a file out from the charm or something, assuming you can get the application name there
=== Laney is now known as awayney
[16:44] <awayney> yes nice, hirsute excuses is showing lots of red against various linux-meta now
[16:45] <awayney> juliank: going to restore autopkgtest #runners, should be over the worst of it now I hope
[16:46] <awayney> if load goes mad again then I guess we need longer in slow mode
[16:46] <awayney> will try to check later
[16:46] <awayney> (I'll stash something in the wendigo checkout to do this)
[19:46] <kanashiro> anyone from the release team could take a look at this MP? https://code.launchpad.net/~lucaskanashiro/britney/+git/hints-ubuntu-1/+merge/403055
[20:04] <tumbleweed> kanashiro: applied https://git.launchpad.net/~ubuntu-release/britney/+git/hints-ubuntu/commit/?id=f18ce1963ec4905ff4b79fa7f02e57799050a9f0 instead
[20:04] <ubot3> Commit f18ce19 in ~ubuntu-release/britney/+git/hints-ubuntu "Badtest fence-agents on i386 in the development release. HEAD devel"
[20:04] <kanashiro> tumbleweed, thanks
[23:14] -queuebot:#ubuntu-release- New binary: gnucobol [s390x] (impish-proposed/none) [5] (no packageset)
[23:15] -queuebot:#ubuntu-release- New binary: gnucobol [armhf] (impish-proposed/none) [5] (no packageset)
[23:15] -queuebot:#ubuntu-release- New binary: gnucobol [ppc64el] (impish-proposed/none) [5] (no packageset)
[23:16] -queuebot:#ubuntu-release- New binary: gnucobol [amd64] (impish-proposed/none) [5] (no packageset)
[23:17] -queuebot:#ubuntu-release- New binary: gnucobol [arm64] (impish-proposed/none) [5] (no packageset)
[23:31] -queuebot:#ubuntu-release- New binary: gnucobol [riscv64] (impish-proposed/universe) [5] (no packageset)