[00:06] Thanks! [05:19] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [amd64] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:22] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [s390x] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:23] -queuebot:#ubuntu-release- New binary: django-graphiql-debug-toolbar [amd64] (jammy-proposed/none) [0.2.0-1] (no packageset) [05:24] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [arm64] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:24] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [ppc64el] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:24] -queuebot:#ubuntu-release- New binary: ignition-msgs [s390x] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [05:24] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [armhf] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:24] -queuebot:#ubuntu-release- New binary: ignition-msgs [ppc64el] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [05:26] -queuebot:#ubuntu-release- New binary: ignition-common3 [amd64] (jammy-proposed/none) [3.14.0+dfsg-4] (no packageset) [05:26] -queuebot:#ubuntu-release- New binary: ignition-common [amd64] (jammy-proposed/universe) [4.4.0+ds-4] (no packageset) [05:27] -queuebot:#ubuntu-release- New binary: ignition-transport8 [amd64] (jammy-proposed/none) [8.2.1+ds-2] (no packageset) === mfo_ is now known as mfo [05:33] -queuebot:#ubuntu-release- New binary: ignition-common [ppc64el] (jammy-proposed/universe) [4.4.0+ds-4] (no packageset) [05:33] -queuebot:#ubuntu-release- New binary: ignition-common3 [ppc64el] (jammy-proposed/none) [3.14.0+dfsg-4] (no packageset) [05:33] -queuebot:#ubuntu-release- New binary: ignition-transport8 [ppc64el] (jammy-proposed/none) [8.2.1+ds-2] (no packageset) [05:33] -queuebot:#ubuntu-release- New binary: ignition-msgs [amd64] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [05:33] -queuebot:#ubuntu-release- New binary: sdformat [amd64] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [05:34] -queuebot:#ubuntu-release- New binary: ignition-transport8 [s390x] (jammy-proposed/none) [8.2.1+ds-2] (no packageset) === ahayzen_ is now known as ahayzen [05:38] -queuebot:#ubuntu-release- New binary: ignition-common [armhf] (jammy-proposed/universe) [4.4.0+ds-4] (no packageset) [05:41] -queuebot:#ubuntu-release- New binary: ignition-common [arm64] (jammy-proposed/universe) [4.4.0+ds-4] (no packageset) [05:41] -queuebot:#ubuntu-release- New binary: sdformat9 [s390x] (jammy-proposed/none) [9.6.1+ds1-3] (no packageset) [05:41] -queuebot:#ubuntu-release- New binary: ignition-msgs [armhf] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [05:43] -queuebot:#ubuntu-release- New binary: ignition-msgs [arm64] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [05:43] -queuebot:#ubuntu-release- New binary: sdformat [s390x] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [05:43] -queuebot:#ubuntu-release- New binary: sdformat9 [ppc64el] (jammy-proposed/none) [9.6.1+ds1-3] (no packageset) [05:44] -queuebot:#ubuntu-release- New binary: sdformat [ppc64el] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [05:47] -queuebot:#ubuntu-release- New binary: erlang-erlware-commons [riscv64] (jammy-proposed/universe) [1.6.0+dfsg-1] (no packageset) [05:52] -queuebot:#ubuntu-release- New binary: ignition-common3 [armhf] (jammy-proposed/universe) [3.14.0+dfsg-4] (no packageset) [05:52] -queuebot:#ubuntu-release- New binary: ignition-transport8 [armhf] (jammy-proposed/universe) [8.2.1+ds-2] (no packageset) [05:55] -queuebot:#ubuntu-release- New binary: ignition-common3 [arm64] (jammy-proposed/universe) [3.14.0+dfsg-4] (no packageset) [05:58] -queuebot:#ubuntu-release- New binary: sdformat9 [amd64] (jammy-proposed/universe) [9.6.1+ds1-3] (no packageset) [06:04] -queuebot:#ubuntu-release- New binary: sdformat9 [armhf] (jammy-proposed/universe) [9.6.1+ds1-3] (no packageset) [06:05] -queuebot:#ubuntu-release- New binary: ignition-transport8 [arm64] (jammy-proposed/universe) [8.2.1+ds-2] (no packageset) [06:05] -queuebot:#ubuntu-release- New binary: sdformat [armhf] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [06:23] -queuebot:#ubuntu-release- New binary: ignition-common [riscv64] (jammy-proposed/universe) [4.4.0+ds-4] (no packageset) [06:25] -queuebot:#ubuntu-release- New binary: sdformat [arm64] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [06:26] -queuebot:#ubuntu-release- New binary: ignition-msgs [riscv64] (jammy-proposed/universe) [8.1.0+ds-2] (no packageset) [06:26] -queuebot:#ubuntu-release- New binary: sdformat9 [arm64] (jammy-proposed/universe) [9.6.1+ds1-3] (no packageset) [07:02] -queuebot:#ubuntu-release- New binary: tiledb [riscv64] (jammy-proposed/universe) [2.5.3-2] (no packageset) [07:06] -queuebot:#ubuntu-release- New binary: ignition-common3 [riscv64] (jammy-proposed/universe) [3.14.0+dfsg-4] (no packageset) [07:29] -queuebot:#ubuntu-release- New binary: ignition-transport8 [riscv64] (jammy-proposed/universe) [8.2.1+ds-2] (no packageset) [07:49] -queuebot:#ubuntu-release- New binary: sdformat9 [riscv64] (jammy-proposed/universe) [9.6.1+ds1-3] (no packageset) [08:00] -queuebot:#ubuntu-release- New binary: sdformat [riscv64] (jammy-proposed/universe) [12.3.0+ds-2] (no packageset) [09:06] Anyone of the ubuntu-release team around to consider accepting https://code.launchpad.net/~paelzer/britney/+git/hints-ubuntu/+merge/414008 ? [09:06] slyon: ^^ FYI as I saw your systemd migration also hit that [10:21] -queuebot:#ubuntu-release- Unapproved: accepted ubiquity [source] (focal-proposed) [20.04.15.18] [11:16] -queuebot:#ubuntu-release- New: accepted libzpc [source] (jammy-proposed) [1.0.0-0ubuntu1] [11:19] -queuebot:#ubuntu-release- New binary: libzpc [s390x] (jammy-proposed/none) [1.0.0-0ubuntu1] (no packageset) [11:20] -queuebot:#ubuntu-release- New: accepted libzpc [s390x] (jammy-proposed) [1.0.0-0ubuntu1] [11:25] vorlon: i really strongly believe we must be doing that. However, it has not yet been implemented. @apw should i look into the scripage that is used to publish kernels, and add "remove-if-exists-in-target-then-copy"? [11:25] where target is Ubuntu primary archive, -proposed suite. [11:27] bdmurray: "xnox: Do you have any plans to verify bug 1940528?" i thought i have verified that at the time. sigh. i will revalidate it again i guess. [11:27] Bug 1940528 in curl (Ubuntu Bionic) "curl 7.68 does not init OpenSSL correctly" [Undecided, New] https://launchpad.net/bugs/1940528 [11:37] xnox, we are doing this with copy-proposed-kernel in the main; does the order matter then? or is catching te NBS and removing it ok? [11:38] apw: the order does not matter. but it would be nice to make it automatic / regular, instead of adhoc manual. As it clogs up proposed-migration a lot. [11:38] apw: i.e. "publish-to-proposed", "check if that produced NBS due to ABI overwrite, remove old ABI build" [11:40] xnox, it will pretty much always produce NBS; so removal of the existing version in there if we are copying in seems easy enough to add. [11:43] apw: it's just i ponder about other copy destinations. For example, this is a problem when copying to Ubuntu main proposed. But not when we copy things to for example our kernel-team proposed PPA. [11:44] and i think we do _not_ want to delete old ABIs from the proposed PPA. [11:44] the copy to 'as-proposed' is a different copy anyhow. though i am not sure why we don't want to clear the old ones there too. else it just gets all big. [11:45] if that ppa has expiry it would get auto garbage collected anyway. [11:46] and those that don't, will not. and it might not result in any increase in publish size, because PPAs / launchpad reuse librarian locations. Especially if the original build was private. [11:46] it's just the mirror / ubuntu main that duplicates space on the master & mirrors; and causes cloggage in britney's brain. [12:27] re-ping ubuntu-release to consider accepting https://code.launchpad.net/~paelzer/britney/+git/hints-ubuntu/+merge/414008 [12:27] jamespage: FYI ^^ that is what OVS/DPDK/... neeed [12:51] -queuebot:#ubuntu-release- New: accepted and [amd64] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted and [armhf] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted and [riscv64] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted django-graphiql-debug-toolbar [amd64] (jammy-proposed) [0.2.0-1] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [arm64] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [ppc64el] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [s390x] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common [riscv64] (jammy-proposed) [4.4.0+ds-4] [12:51] -queuebot:#ubuntu-release- New: accepted and [arm64] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted and [s390x] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [armhf] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common [arm64] (jammy-proposed) [4.4.0+ds-4] [12:51] -queuebot:#ubuntu-release- New: accepted and [ppc64el] (jammy-proposed) [1.2.2-4.2] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [riscv64] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted erlang-erlware-commons [amd64] (jammy-proposed) [1.6.0+dfsg-1] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common3 [amd64] (jammy-proposed) [3.14.0+dfsg-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common3 [armhf] (jammy-proposed) [3.14.0+dfsg-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common3 [riscv64] (jammy-proposed) [3.14.0+dfsg-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common [armhf] (jammy-proposed) [4.4.0+ds-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [amd64] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [armhf] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [riscv64] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [amd64] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [armhf] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [riscv64] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common3 [arm64] (jammy-proposed) [3.14.0+dfsg-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common [amd64] (jammy-proposed) [4.4.0+ds-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [arm64] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [s390x] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [ppc64el] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat9 [amd64] (jammy-proposed) [9.6.1+ds1-3] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat9 [armhf] (jammy-proposed) [9.6.1+ds1-3] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat9 [riscv64] (jammy-proposed) [9.6.1+ds1-3] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [amd64] (jammy-proposed) [12.3.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [armhf] (jammy-proposed) [12.3.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common3 [ppc64el] (jammy-proposed) [3.14.0+dfsg-4] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-msgs [ppc64el] (jammy-proposed) [8.1.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [s390x] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat9 [ppc64el] (jammy-proposed) [9.6.1+ds1-3] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [arm64] (jammy-proposed) [12.3.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [riscv64] (jammy-proposed) [12.3.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted tiledb [riscv64] (jammy-proposed) [2.5.3-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-common [ppc64el] (jammy-proposed) [4.4.0+ds-4] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat9 [arm64] (jammy-proposed) [9.6.1+ds1-3] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [ppc64el] (jammy-proposed) [12.3.0+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted ignition-transport8 [arm64] (jammy-proposed) [8.2.1+ds-2] [12:51] -queuebot:#ubuntu-release- New: accepted sdformat [s390x] (jammy-proposed) [12.3.0+ds-2] [12:52] -queuebot:#ubuntu-release- New: accepted sdformat9 [s390x] (jammy-proposed) [9.6.1+ds1-3] [13:06] -queuebot:#ubuntu-release- New binary: freeipa [s390x] (jammy-proposed/universe) [4.9.8-1] (no packageset) [13:07] -queuebot:#ubuntu-release- New binary: freeipa [ppc64el] (jammy-proposed/universe) [4.9.8-1] (no packageset) [13:10] -queuebot:#ubuntu-release- New binary: freeipa [amd64] (jammy-proposed/universe) [4.9.8-1] (no packageset) [13:11] -queuebot:#ubuntu-release- New binary: freeipa [arm64] (jammy-proposed/universe) [4.9.8-1] (no packageset) [13:11] -queuebot:#ubuntu-release- New binary: freeipa [armhf] (jammy-proposed/universe) [4.9.8-1] (no packageset) [13:11] sil2100: apw: I wanted to ask if one of you could have a release-team look at https://code.launchpad.net/~paelzer/britney/+git/hints-ubuntu/+merge/414008 ? [13:34] -queuebot:#ubuntu-release- Unapproved: horizon (focal-proposed/main) [3:18.3.4-0ubuntu1 => 3:18.3.5-0ubuntu1] (openstack, ubuntu-server) === klebers_ is now known as klebers [14:08] vorlon: sil2100: glibc fails autopkgtest as triggered by binutils, because it uses gcc-10 for test-rebuild during autopkgtest which doesn't know about p9. can we migrate binutils? or should I be uploading glibc that switches to use gcc-11 in the autopkgtest? [14:09] cc: ginggs [14:15] doko: note that we also need either hint, or rebuild of glibc. [14:16] xnox, known, was dicussing already with mwhudson [14:19] -queuebot:#ubuntu-release- Unapproved: gtk+3.0 (impish-proposed/main) [3.24.30-1ubuntu1 => 3.24.30-1ubuntu1.1] (i386-whitelist, ubuntu-desktop) [14:35] doko: cool. [14:41] doko: on salsa it seems that toolchain-team/gcc repository does not allow merge requests. it would be nice if you could turn that on. Otherwise i did prepare git commit of my revert patch, if you want to take it into debian you can do so with $ git pull https://salsa.debian.org/xnox/gcc.git gcc-11-debian [14:41] https://salsa.debian.org/xnox/gcc/-/commit/8d45bceb0c06869d5fe2ace4012f30bb41be0a66 [14:41] Commit 8d45bce in xnox/gcc "debian/patches/gcc-ibmz-plt-revert.diff: Revert PLT changes from gcc-11 branch, as causing kernel dkms missbuilts on s390x. LP: #1954676" [14:44] -queuebot:#ubuntu-release- Unapproved: snapd (xenial-proposed/main) [2.48.3 => 2.54.2] (desktop-core, ubuntu-server) [14:51] -queuebot:#ubuntu-release- Unapproved: snapd (bionic-proposed/main) [2.51.1+18.04 => 2.54.2+18.04] (desktop-core, ubuntu-server) [14:52] -queuebot:#ubuntu-release- Unapproved: snapd (focal-proposed/main) [2.51.1+20.04ubuntu2 => 2.54.2+20.04] (core) [14:53] -queuebot:#ubuntu-release- Unapproved: snapd (hirsute-proposed/main) [2.51.1+21.04 => 2.54.2+21.04] (desktop-core, ubuntu-server) [14:53] -queuebot:#ubuntu-release- Unapproved: snapd (impish-proposed/main) [2.53+21.10ubuntu1 => 2.54.2+21.10] (desktop-core, ubuntu-server) [15:01] xnox: ok, so I suppose mwhudson and doko are on it, right? [15:18] sil2100: the glibc bit - as mentioned by doko - yes. [15:36] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools4 [ppc64el] (jammy-proposed/universe) [4.4.0+ds-2] (no packageset) [15:36] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools [ppc64el] (jammy-proposed/universe) [7.0.0+ds-2] (no packageset) [15:37] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools4 [amd64] (jammy-proposed/universe) [4.4.0+ds-2] (no packageset) [15:38] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools [amd64] (jammy-proposed/universe) [7.0.0+ds-2] (no packageset) [15:38] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools [armhf] (jammy-proposed/universe) [7.0.0+ds-2] (no packageset) [15:39] -queuebot:#ubuntu-release- New binary: ignition-transport [s390x] (jammy-proposed/universe) [11.0.0+ds-3] (no packageset) [15:40] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools4 [armhf] (jammy-proposed/universe) [4.4.0+ds-2] (no packageset) [15:40] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools4 [amd64] (jammy-proposed) [4.4.0+ds-2] [15:40] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools [amd64] (jammy-proposed) [7.0.0+ds-2] [15:40] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools [ppc64el] (jammy-proposed) [7.0.0+ds-2] [15:40] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools4 [armhf] (jammy-proposed) [4.4.0+ds-2] [15:40] -queuebot:#ubuntu-release- New: accepted ignition-transport [s390x] (jammy-proposed) [11.0.0+ds-3] [15:40] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools [armhf] (jammy-proposed) [7.0.0+ds-2] [15:41] -queuebot:#ubuntu-release- New: accepted freeipa [amd64] (jammy-proposed) [4.9.8-1] [15:41] -queuebot:#ubuntu-release- New: accepted freeipa [armhf] (jammy-proposed) [4.9.8-1] [15:41] -queuebot:#ubuntu-release- New: accepted freeipa [s390x] (jammy-proposed) [4.9.8-1] [15:41] -queuebot:#ubuntu-release- New: accepted httest [source] (jammy-proposed) [2.4.23-1.2fakesync1] [15:41] -queuebot:#ubuntu-release- New: accepted mir [amd64] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New: accepted mir [armhf] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New: accepted mir [riscv64] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools [arm64] (jammy-proposed/universe) [7.0.0+ds-2] (no packageset) [15:41] -queuebot:#ubuntu-release- New: accepted freeipa [arm64] (jammy-proposed) [4.9.8-1] [15:41] -queuebot:#ubuntu-release- New: rejected httest [sync] (jammy-proposed) [2.4.23-1.2] [15:41] -queuebot:#ubuntu-release- New: accepted mir [arm64] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New: accepted mir [s390x] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New: accepted freeipa [ppc64el] (jammy-proposed) [4.9.8-1] [15:41] -queuebot:#ubuntu-release- New: accepted mir [ppc64el] (jammy-proposed) [2.6.0-0ubuntu1] [15:41] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools4 [ppc64el] (jammy-proposed) [4.4.0+ds-2] [15:41] -queuebot:#ubuntu-release- New binary: ignition-transport [ppc64el] (jammy-proposed/universe) [11.0.0+ds-3] (no packageset) [15:41] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools [arm64] (jammy-proposed) [7.0.0+ds-2] [15:41] -queuebot:#ubuntu-release- New: accepted ignition-transport [ppc64el] (jammy-proposed) [11.0.0+ds-3] [15:42] -queuebot:#ubuntu-release- New binary: ignition-fuel-tools4 [arm64] (jammy-proposed/universe) [4.4.0+ds-2] (no packageset) [15:42] juliank: hi, coming online I see armhf queues are even worse, and autopkgtest-lxd-worker/0 is unreachable over ssh. do you have any insight on this from your timezone? [15:43] -queuebot:#ubuntu-release- New: accepted ignition-fuel-tools4 [arm64] (jammy-proposed) [4.4.0+ds-2] [15:43] -queuebot:#ubuntu-release- New binary: httest [ppc64el] (jammy-proposed/none) [2.4.23-1.2fakesync1] (no packageset) [15:43] -queuebot:#ubuntu-release- New binary: httest [amd64] (jammy-proposed/none) [2.4.23-1.2fakesync1] (no packageset) [15:43] -queuebot:#ubuntu-release- New binary: httest [s390x] (jammy-proposed/none) [2.4.23-1.2fakesync1] (no packageset) [15:43] vorlon: I have shut it down, I am cleaning up the workers [15:43] juliank: ok [15:44] vorlon: Everything is broken, status updates are in devel, but basically, one node fails with disk I/O, one or two has borked lxd databases, and all of them have stuck old instances [15:44] vorlon: Trying to rebuild lxd workers (lxd-armhf10 so far), but no lxd images are available for impish and jammy, st_graber is working on that today [15:45] vorlon: Have switched lxd storage backend from 'dir' to 'btrfs' on new nodes, as we see a lot of failures just having timeouts during stop - I believe that's lxd trying to delete the rootfs that's timing out here [15:46] -queuebot:#ubuntu-release- New binary: httest [arm64] (jammy-proposed/none) [2.4.23-1.2fakesync1] (no packageset) [15:47] -queuebot:#ubuntu-release- New binary: httest [armhf] (jammy-proposed/none) [2.4.23-1.2fakesync1] (no packageset) [15:47] vorlon: I'm considering switching the other nodes to btrfs storage pool in place, but I probably want to redeploy them all anyway, so not sure (they all use btrfs as the actual storage, just the wrong - slow - backend in lxd) [15:49] -queuebot:#ubuntu-release- New binary: ignition-transport [armhf] (jammy-proposed/universe) [11.0.0+ds-3] (no packageset) [15:50] -queuebot:#ubuntu-release- New: accepted httest [amd64] (jammy-proposed) [2.4.23-1.2fakesync1] [15:50] -queuebot:#ubuntu-release- New: accepted httest [armhf] (jammy-proposed) [2.4.23-1.2fakesync1] [15:50] -queuebot:#ubuntu-release- New: accepted httest [s390x] (jammy-proposed) [2.4.23-1.2fakesync1] [15:50] -queuebot:#ubuntu-release- New: accepted httest [arm64] (jammy-proposed) [2.4.23-1.2fakesync1] [15:50] -queuebot:#ubuntu-release- New: accepted ignition-transport [armhf] (jammy-proposed) [11.0.0+ds-3] [15:50] -queuebot:#ubuntu-release- New: accepted httest [ppc64el] (jammy-proposed) [2.4.23-1.2fakesync1] [15:52] juliank: ok, thanks! [15:52] that's annoying fwiw, as we don't want the lxd workers on swirlix nodes, but the newer arm64 ones [15:55] -queuebot:#ubuntu-release- New binary: ignition-transport [arm64] (jammy-proposed/universe) [11.0.0+ds-3] (no packageset) [16:03] vorlon: So I converted all nodes to btrfs storage backend in place now, they now use /srv/lxd.new for containers, images are still in /srv/lxd, can't migrate the default one. Will redeploy all nodes eventually, hopefully this gets rid of timeouts, though [16:04] rebooting them all now, and then going to boot up the controller again [16:04] juliank: ok, how much of the disk layout stuff is captured in the provisioning scripts/docs? [16:04] -queuebot:#ubuntu-release- New: accepted ignition-transport [arm64] (jammy-proposed) [11.0.0+ds-3] [16:05] vorlon: it's not documented and it's two lines in the userdata file, which is already updated to the intended state (this one being a workaround) [16:05] ok [16:05] So lxd-armhf10 is the first of the clean new nodes, it's just waiting for jammy and impish images right now to be operational [16:10] Ah well [16:10] I also should move /var/snap/lxd off there [16:11] Maybe increase the disk size too, 43 GB for the containers might not be enough [16:11] *** booting up lxd cloud again *** [16:12] (it takes a while to cleanup /tmp) [16:12] juliank: "we ran out of disk space because of orphaned containers left behind" -/-> "let's increase the disk space" ;) [16:13] certainly we should at least not keep the lxd database on the same FS as the container rootfs [16:13] cpaelzer: what's the urgency on dpdk migration? I just commented on https://code.launchpad.net/~paelzer/britney/+git/hints-ubuntu/+merge/414008 to point out it CAN be done with a migration-reference run, but per the above, it's going to take a while to get armhf test results for a while [16:13] so I'm ok with the MP as a workaround if you need it [16:51] vorlon: I can live completing after the weekend [16:52] vorlon: and thanks for the hint, indeed with the binaries removed it might work now [16:52] cpaelzer: ok then let's close this MP out, I've already retriggered [16:52] I'll try and re-open in case it has problems [16:52] thanks for retriggering already === nicolasbock_ is now known as nicolasbock === jamespage_ is now known as jamespage === Trevinho_ is now known as Trevinho === patviafore_ is now known as patviafore === tomreyn- is now known as tomreyn === madhens_ is now known as madhens === ogra` is now known as ogra === tomreyn_ is now known as tomreyn [18:56] hello, could some please kill the autopkgtest for 'libreoffice/1:7.3.0~rc1-0ubuntu0.22.04.1~lo2' on jammy/arm64 === locutusofborg_ is now known as LocutusOfBorg === stgraber_ is now known as stgraber === RikMills__ is now known as RikMills