/srv/irclogs.ubuntu.com/2022/03/29/#ubuntu-release.txt

=== paride3 is now known as paride
=== cpaelzer_ is now known as cpaelzer
-queuebot:#ubuntu-release- Unapproved: linux-firmware (jammy-proposed/main) [20220314.gitcd01f857-0ubuntu2 => 20220329.git681281e4-0ubuntu1] (core, kernel)06:38
-queuebot:#ubuntu-release- Unapproved: gnome-initial-setup (jammy-proposed/main) [42.0.1-1ubuntu1 => 42.0.1-1ubuntu2] (ubuntu-desktop)07:37
-queuebot:#ubuntu-release- Unapproved: screen-resolution-extra (jammy-proposed/main) [0.18.1build1 => 0.18.2] (ubuntu-desktop)08:13
juliankif anything else is stuck for beta in proposed due to waiting for tests please let me know08:50
juliankI can move stuff in the normal queue to the top08:50
juliankand I can move stuff from huge to normal08:50
juliankI already moved up grub2 and u-boot08:50
juliankoh sil2100 ubiquity probably should move up too08:51
sil2100I skiptested ubiquity as we have no arm* consumers right now08:52
sil2100So it's not so critical08:52
juliankAh08:53
juliankSo I'm also running around killing tests that have not produced output for an hour08:53
juliankas we still get significant hangs (we had 8 hour+) on armhf08:54
WimpyTrevinho: Do you want to take up juliank on his offer to speed up the migration of yaru-theme?09:13
juliankyaru-theme has no pending tests, Wimpy09:13
sil2100I can unblock it in that case09:14
WimpyPlease unblock yaru-theme and ubuntu-mate-artwork (which depends on yaru-theme)09:14
sil2100Please remember that we're in beta freeze so uploads need to be manually unblocked!09:14
juliankyep09:15
sil2100Ok, unblocked09:15
WimpyYeah, those uploads were just moments after the  freeze :-)09:15
Wimpysil2100: Thank you!09:15
sil2100Wimpy: just yaru-theme or also some other package is part of that, do you know?09:15
juliankbasically stuff that will be unblocked can be moved up the queue, decision is up to the release team09:16
Wimpyyaru-theme and ubuntu-mate-artwork.09:16
juliankfinal grub2 tests running09:16
sil2100Wimpy: ok, the other I already unblocked, so you should be good!09:17
WimpyThanks very much!09:17
sil2100Ok, I need to go AFK now for a while, but I'll be back later and working into laaate evening09:17
WimpyETA for iso creation?09:17
seb128juliank, sil2100, we would like to get gnome-shell if possible but that's behind atm due to armhf autopkgtest queue09:17
sil2100I would say later afternoon when things finally migrate and stabilize09:18
WimpyThanks.09:18
juliankthat needs to migrate together with mutter it seems09:18
julianksil2100: shall I bump gnome-shell and mutter up?09:18
juliankoh seb128 migrating gnome-shell/42.0-1ubuntu1/amd64 to testing makes gnome-shell-extension-easyscreencast/1.5.0-1/amd64 uninstallable09:19
seb128juliank, I just deleted that one09:19
juliankhmm09:20
seb128juliank, it's an extension which wasn't updated for the new shell, we decided to delete those, that will be sorted out in the next refresh but we still need to clear the tests09:21
seb128sil2100, ideally we would have like the new xorg stack in, which was blocked on azure kernel, do you know what's the status there?09:21
sil2100juliank: I guess you could. When I'm back we can see how things are and unblock things before the RCs09:22
sil2100seb128: sadly, I don't know much. But I'd say this is more unlikely for beta now09:22
seb128:-(09:22
juliankxorg stack is too big to migrate now09:22
seb128it's in proposed for 27 days09:23
seb128it's annoying how we don't get transitions moving09:23
seb128it sort of defeat the point of having a beta if we don't test what is current and going to be in the release09:24
juliankseb128: It can't have been in proposed for 27 days or it would have its tests run09:25
juliankqueues were virtually empty 5 days ago09:25
juliankxorg-server was uploaded a while ago, sure09:27
juliankbut this depends on much newer uplaods09:27
juliankeek it depends on my newer uploads09:27
juliankdon't ask me why09:27
juliankwhy would xorg-server have implicit dependency on xorg, xserver-xorg-video-dummy no-change rebuilds09:28
juliankalso it has a regression in firejail on armhf09:29
seb128juliank, I'm going to retry a migration-reference/0 there09:32
juliankugh09:33
juliankI'd rather not09:33
seb128why not?09:33
juliankit has 167 items in the queue ahead of it09:33
tjaaltonseb128: the blocker is aws kernel now09:34
tjaaltonfor nvidia-390, which has blocked xserver for two weeks09:34
tjaaltonand weeks before that09:34
juliankfirejail never succeeded?09:35
juliankwell 0.9.56-2 once did09:35
juliankbut there's no migration-reference/0 run which is _odd_09:35
juliankAlso I believe we need to adjust release opening procedure for autopkgtests to copy over the latest migration-reference/0 instead of last successful run09:36
tjaaltonfirejail? that's news to me09:36
julianktjaalton: bryce retried firejail in proposed with a hole lot of packages causing it to become a failure instead of neutral for xorg-server and others09:37
juliankdespite the version in release pocket being neutral09:37
juliankbritney is not looking at the right test result09:37
tjaaltonheh, ok09:38
tjaaltonI've been chasing down kernel failures for the past two weeks trying to get nvidia-390 to migrate09:38
julianktjaalton: but now xorg-server seems to have gained implicit dependencies on all sorts of later uploads and I'm not sure wwhat's up with that09:38
juliankor does "Implicit dependency" mean "reverse dependency"?09:39
julianktjaalton: like I rebuild bunch of -video- packages for ppc64el baseline rebuild, and xorg-server now has "Implicit dependency: xorg-server xserver-xorg-video-amdgpu (not considered)" and similar09:40
juliankah so it did really need newer drivers, they were synced same day as the no-change rebuilds, so they essentially got built twice09:42
juliankso it also waits for xserver-xorg-video-dummy to finish running tests09:45
juliankwhich ended up in the huge queue as it was part of the ppc64el rebuilds09:45
juliankwhy don't we have a transition tracker for xorg-video-abi-25?09:51
tjaaltonwe have trackers?09:52
seb128tjaalton, https://people.canonical.com/~ubuntu-archive/transitions/09:53
juliankben needs to learn to track those provides automatically and auto-create transitions09:54
julianksorry about the video nochange uploads those made things a bit nastier09:55
seb128anyway we would really benefit to have the xorg update in betéa09:56
Trevinhohow transitions can be added there?09:56
seb128because without the current nvidia 510 we can't really test wayland sessions09:57
tjaaltonseb128: heh, it's blocked by many kernels09:59
tjaaltonnot xserver09:59
seb128xnox, ^ do you know what's the status for kernel migrations?09:59
tjaaltontseliot should herd his uploads through..10:00
juliankTrevinho: https://bazaar.launchpad.net/~ubuntu-transition-trackers/ubuntu-transition-tracker/configs/changes10:01
seb128tjaalton, also yes10:03
-queuebot:#ubuntu-release- Unapproved: gemmi (jammy-proposed/universe) [0.5.3+ds-1ubuntu1 => 0.5.3+ds-2] (no packageset) (sync)10:42
-queuebot:#ubuntu-release- Unapproved: cd-boot-images-amd64 (jammy-proposed/main) [18 => 19] (desktop-core)10:44
-queuebot:#ubuntu-release- Unapproved: notmuch (jammy-proposed/universe) [0.35-1ubuntu2 => 0.35-2ubuntu1] (no packageset)10:44
-queuebot:#ubuntu-release- Unapproved: cd-boot-images-arm64 (jammy-proposed/main) [14 => 15] (desktop-core)10:49
-queuebot:#ubuntu-release- Unapproved: cd-boot-images-ppc64el (jammy-proposed/main) [11 => 12] (desktop-core)11:04
xnoxseb128:  all our kernels are a mess at the moment =)11:44
-queuebot:#ubuntu-release- Unapproved: cd-boot-images-riscv64 (jammy-proposed/main) [1 => 2] (no packageset)11:44
xnoxseb128:  i'll chat to the team today, to see if we can push out LRM respin, such that all nvidia stuff migrates.11:45
xnoxvorlon:  cd-boot-images-riscv64 says no-packageset but it is seeded in supported-installer-desktop.... does that not get used for riscv64 at all11:46
xnox?11:46
seb128xnox, thanks11:46
xnoxjuliank:  uploaded cd-boot-images-* respins ^^^^11:48
juliankxnox: oops forgot those once again11:48
juliankxnox: I wish we'd not have them and builds just used grub etc directly11:49
juliankxnox: so just to make sure: you say you uploaded them?11:50
juliankah I see them at the top11:50
julianklaunchpad confused me11:50
xnoxjuliank:  held up in the queue.... because freeze11:54
xnoxjuliank:  or like maybe cd-boot-images-* source packages could be generated at the same time as grub2-unsigned.11:55
juliankxnox: why do we have them?11:56
xnoxjuliank:  because debian-cd runs on amd64; cannot easily pull packages for $foreign-arches or execute commands to manipulate them; and we must have one package per arch; if we want to build things natively and publish as arch:all. They are replacement for d-i's tarballs that used to be produced by d-i and then included onto isos by it.12:03
juliankah12:03
juliankbut if it used tarballs before it could still publish tarballs automatically as grub2-signed build artefacts or so12:04
xnoxit would be nice if like it was possible to produce arch-all packages from multiple binary builds.12:04
juliankyes12:04
juliankYou want like12:05
juliankPackage: grub-efi-arm64-bin12:05
juliankArchitecture: all12:05
juliankBuild-Architecture: arm6412:05
xnoxcause ideally i'd want like grub-efi-amd64-signed to be arch:all and grub-efi-arm64-signed arch:all and the bins12:05
juliankyes, that12:05
xnoxand the grub-pc thing should _prebuild_ and _preship_ the three image files we use from it.12:05
xnox(cd, hybrid, and normal one)12:05
juliankgrub-pc-signed basically12:06
juliankjust um not signed12:06
juliankgrub-pc-prebuilt12:06
juliankgrub-pc-images12:06
xnoxat the moment we do have cd-boot-images-$(arch) that does that for a given $(arch) and publishes as arch:all package12:06
juliankstill couldn't we upload those as tarballs and then fetch them from ftpmaster?12:07
xnoxbut also vendors other things too (like shim) and is very static contents without any maintainer scripts etc, i.e. more or less a tarball that one can just unpack12:07
xnoxapt download / pull-lp-deb is easier than custom uploads =)12:08
juliankwell12:08
xnoxplus the theory was that ubuntu-image will be able to use those too to make images12:08
juliankI wish launchpad would just build the -signed and cd-boot-images source packages itself12:09
juliankfrom um some templates12:09
xnoxjust don't go there =)12:09
ricotzhello ubuntu-archive, please let libreoffice/impish-proposed 1:7.3.2~rc2-0ubuntu1 transition to release12:09
xnoxif we had Architecutre:all/build-architecture:$blah that would be good enough.12:10
xnoxbut we only have XS-Build-Indep-Architecture:$arch12:10
xnoxjuliank:  we could merge cd-boot-images-* into grub packaging, to make it more insane (as in have the cd-boot-images-* templates inside it) such that generate-grub2-unsigned would generated 5 source packages to upload12:11
juliankarm64 is somewhat did12:12
juliank* dead12:12
juliank30%-50% of tests fail abnormally12:13
juliank                                                                                                             gpg: requesting key 622CF918 from hkp server keyserver.ubuntu.com12:13
juliank                                                                                                             gpg: no valid OpenPGP data found.12:13
julianklots of those12:13
ricotzoops, of course I meant liberoffice/jammy-proposed :\ , please let 1:7.3.2~rc2-0ubuntu1 transition to release12:14
juliankPPA tests fail Cannot initiate the connection to ppa.launchpad.net:80 (2001:67c:1560:8008::19). - connect (101: Network is unreachable) Could not connect to ppa.launchpad.net:80 (91.189.95.85), connection timed out12:14
julianksalsa doesn't work fatal: unable to access 'https://salsa.debian.org/systemd-team/systemd.git/': Received HTTP code 403 from proxy after CONNECT12:15
juliankI don't know what to do really12:16
juliankarm64 and armhf queues seemingly don't move12:26
juliankI know that armhf is running flawlessly12:26
coreycbcpaelzer: I missed that new upstream release todo for xmlschema. do you want that done in jammy?12:26
juliankwell it runs, but clearly not fast enough12:27
cpaelzercoreycb: it was james who brought it up, and the reason is sounds as the current version is rather outdated and thereby odd to start in main12:28
cpaelzercoreycb: I know we are behind most freezes, but OTOH this has no other deps but yours AFAICS12:28
cpaelzercoreycb: so talk to the release team and then yes if possible update it12:28
juliankxnox: we really need to fix this mess where --apt-pocket=proposed=src:linux-meta-riscv triggers dkms modules on arm64 and then everything faisl because it's not there12:33
juliankxnox: and it fails with "no versioN", and then retries and retries and retries12:34
coreycbcpaelzer: 'reverse-depends python3-xmlschema' is showing nothing so I'm confused12:36
juliankE: Unable to locate package ^linux-image-generic-riscv$12:37
juliankno shit sherlock12:37
cpaelzerit shows nothing because one removed the dep as it couldn#t be in main before12:37
coreycbcpaelzer: python3-pysaml2 still depends on it though12:39
coreycbprobably because it's only an rdepends in jammy-proposed12:45
xnoxjuliank:  i am confused why anything triggers for linux-meta-riscv at all.... it doesn't exist on anything but riscv64 and there are no riscv64 autopkgtests......12:48
xnoxjuliank:  is it britney or kernel's teams adt matrix scheduling that?12:48
juliankxnox: I don't know, I'd think the latter?12:48
xnoxit has automated-testing invalid.... so it shouldn't do that.12:49
juliank{'submit-time': '2022-03-25 23:36:10', 'triggers': ['linux-meta-riscv/5.15.0.1005.5']}12:55
seb128sil2100, could you unblock nautilus? it's ready to migrate, only an application, and there is an annoying segfault in the current version which is fixed by the update13:22
ricotzsil2100, hi, please do the same for libreoffice 7.3.2~rc2 :)13:29
-queuebot:#ubuntu-release- Unapproved: alsa-ucm-conf (jammy-proposed/main) [1.2.6.3-1 => 1.2.6.3-1ubuntu1] (core)13:48
xnoxseb128:  trying to prioritise migrating all the kernels & lrms to jammy-release, before entagling more stuff into it.14:03
xnoxis the conclusion from our standup.14:04
seb128xnox, thanks14:04
xnoxapw ubuntu-release - can you please unblock migration of linux-restricted-modules linux-restricted-signatures nvidia-graphics-drivers-39014:07
xnoxand all other related linux-restricted-* packages14:07
xnoxlinux-restricted-* basically and nvidia-graphics-drivers-*14:07
xnoxas being blocked by ubuntu-release block all14:09
apwxnox, looking into it.14:12
-queuebot:#ubuntu-release- Unapproved: accepted simplestreams [source] (bionic-backports) [0.1.0-48-gb936edd4-0ubuntu1~bpo18.04.1]14:16
juliank** arm64 error rate is down from 40% to 0% **14:17
juliankthis should speed things up14:17
xnoxnicd14:18
juliankI still don't know why queue shrinks by 40 packages in 6 hours and ppc64el by 1000, when ppc64el has double the test throughput14:18
juliankRealistically 4 times the pass rate14:18
-queuebot:#ubuntu-release- New binary: simplestreams [amd64] (bionic-backports/main) [0.1.0-48-gb936edd4-0ubuntu1~bpo18.04.1] (ubuntu-cloud, ubuntu-server)14:18
juliankwell 3 times maybe14:19
-queuebot:#ubuntu-release- New: accepted simplestreams [amd64] (bionic-backports) [0.1.0-48-gb936edd4-0ubuntu1~bpo18.04.1]14:19
juliankarm64 queue went 8993 -> 894514:19
juliankppc64el queue went 1241 -> 18514:20
juliankyou can see how this does not line up with the throughput factor of 2-3x, unless someone pushes new arm64 (and armhf) tests all the time, but no ppc64el/s390x14:20
juliankxnox: how can I find arigi on irc? Queuing a ton of canonical-kernel-team/bootstrap tests *now* is not productive14:22
juliankor constructive14:22
juliankwe should really reject any PPA or upstream tests right now14:22
juliankbecause if only to figure out why those queues are not moving14:22
juliankxnox: so i need to figure out if I can cancel them now and then we can redo them later14:27
juliankthere have been 200 PPA test requests on arm64 today14:29
juliankcompared to 130 on amd6414:29
juliankor about 65 on ppc64el and s390x14:29
juliankthis is a problem.14:29
juliank(requests accepted for processing)14:30
coreycbubuntu-release: I'm seeking a +1 to sync elementpath and python-xmlschema from unstable to jammy. they build successfully on jammy and will be tested with openstack regression. this is a TODO that came out of MIR 1953363. openstack has a feature freeze exception and these are mostly but not specifically openstack dependencies.14:30
juliankor better, requests acted on14:30
xnoxjuliank:  do not reject PPA requests14:32
juliankthings are *not* working14:32
xnoxjuliank:  the ones comming from kernel team are required to pass for us to release kernels. cause we do tests (kernel) X (dkms) X (arch) and they do point to PPAs14:33
xnoxjuliank:  ditto security/embargo14:33
xnoxjuliank:  i think you can reject ci-train requests; but not kernel/security team ppas.14:33
juliankwe shrink the arm queues by 50 packages in 6 hours, this is not working14:33
juliankand we have no idea why14:33
-queuebot:#ubuntu-release- Unapproved: update-notifier (jammy-proposed/main) [3.192.52 => 3.192.53] (ubuntu-desktop, ubuntu-server)14:34
xnoxjuliank:  ..... wow.....14:34
xnoxsounds like fun.14:34
athosHi, could anyone from the SRU team take a look at https://bugs.launchpad.net/ubuntu/+source/postgresql-12/+bug/1961127 ?14:34
ubottuLaunchpad bug 1961127 in postgresql-12 (Ubuntu Focal) "New upstream microreleases 10.20, 12.10, 13.6 and 14.2" [Undecided, In Progress]14:34
juliankxnox: ppc64el moves 20 times faster, but it only has 3 times as many tests exiting14:35
juliankxnox: hence the idea to kill ppa and upstream arm* tests to figure out what goes on14:35
juliankor really any requests14:35
julianksee if that makes things go down14:35
sil2100o/14:38
sil2100Let me unblock nautilus and I want to start looking at kicking the images14:39
seb128sil2100, thanks14:40
seb128sil2100, rico also wanted to see libreoffice in, seems like little risk14:40
xnoxjuliank:  but power is faster arch than our arm nodes.14:41
xnoxditto s390x14:41
sil2100seb128: I think I'll unblock that one as well, since we're anyway waiting14:41
juliankxnox: please read again. they are 3 times slower, but the queues shrink 20 times slower14:41
sil2100uh oh, grub2 still didn't migrate?!14:41
juliankxnox: so something must be adding hundreds of new arm64 autopkgtests every hour14:42
juliank(same for armhf)14:42
seb128sil2100, thanks14:42
bdmurrayjuliank: is there no log of test request submissions?14:43
sil2100Argh, the promotion14:43
sil2100Let me promote grub-efi-riscv6414:43
juliankbdmurray: not _really_14:43
juliankbdmurray: there's the apache access log14:43
bdmurraysil2100: You might look at the update-notifier I just uploaded14:43
sil2100Looking!14:44
juliankSo update-github-jobs.service on the web workers is broken14:44
-queuebot:#ubuntu-release- Unapproved: intel-media-driver (jammy-proposed/universe) [22.2.1+dfsg1-1 => 22.2.1+dfsg1-1build1] (i386-whitelist, kubuntu)14:46
seb128could someone accept ^14:55
seb128the current binary is just not working, that's a no change rebuild14:55
juliankFurhter analys14:55
apwxnox, it looks like we are too close to the wire to achieve that to go into the beta; i've asked ppisati to get all the ducks fed and in a row just in case we need a respin on it (cc: sil2100)14:55
juliank290 arm64 requests,  189 ppc64el requests14:56
seb128it seems the new libva is abi incompatible or something14:56
juliankthis does not account for the difference in tests completed vs queue reduction14:56
-queuebot:#ubuntu-release- Unapproved: rejected yt-dlp [source] (focal-backports) [2022.03.08.1-1~bpo20.04.1]14:57
-queuebot:#ubuntu-release- Unapproved: accepted yt-dlp [source] (focal-backports) [2022.03.08.1-1~bpo20.04.1]14:57
-queuebot:#ubuntu-release- Unapproved: rejected gallery-dl [source] (focal-backports) [1.21.0-1~bpo20.04.1]14:58
juliankif ppc64el is 3 times faster, and gets the same amount of new tests as arm64; then arm64 queues should shrink 3 times slower than ppc64el, not 20 times14:58
-queuebot:#ubuntu-release- Unapproved: accepted gallery-dl [source] (focal-backports) [1.21.0-1~bpo20.04.1]15:00
xnoxapw:  but with some of those packages blocked with freeze, i'm not sure it is easy to tell which ones need lrm respin (if any)15:02
xnoxapw:  as far as i can tell, it's the ubuntu-release block that prevents migration; rather than missing lrm respins15:03
-queuebot:#ubuntu-release- Unapproved: r-cran-openssl (jammy-proposed/universe) [1.4.6+dfsg-1 => 1.4.6+dfsg-1ubuntu1] (no packageset)15:07
sil2100bdmurray: hm, so LP: #1966811 is basically crashing for people for no reason? Or only when they have oem packages installed?15:07
ubottuLaunchpad bug 1966811 in update-notifier (Ubuntu Jammy) "list-oem-metapackages crashed with TypeError in any_oem_metapackages_installed(): 'apt_pkg.Cache' object is not iterable" [High, In Progress] https://launchpad.net/bugs/196681115:07
sil2100bdmurray: I'll accept it into proposed, but not sure if it's something we'll be able to pull into the Beta. I guess it doesn't break the installation, right?15:07
-queuebot:#ubuntu-release- Unapproved: accepted update-notifier [source] (jammy-proposed) [3.192.53]15:08
-queuebot:#ubuntu-release- Unapproved: accepted intel-media-driver [source] (jammy-proposed) [22.2.1+dfsg1-1build1]15:09
seb128sil2100, wasn't that bug fixed in the update-notifier updated that migrated yesterday?15:10
bdmurrayseb128: not completely15:10
bdmurraysil2100: It looks like list-oem-metapackages is called by the update-notifier applet15:10
seb128sil2100, also unsure if you saw the ping a bit early but could you accept intel-media-driver from the unapproved queue? seems like libav got an ABI change which broken the current binary, that's a no change rebuild and the package is in universe15:11
sil2100seb128: I did! As seen above!15:11
seb128sil2100, ah, lol, as I was typing... thanks!15:12
sil2100Ok, let me handle cd-boot-images-riscv64 as we have some changes needed on top15:12
xnoxsil2100:  i just uploaded one to the queue, with just a rebuild. also pushed to repo. not sure what other things you need for it.15:13
xnoxsil2100:  or do you just need the rebuild?15:13
-queuebot:#ubuntu-release- Unapproved: cd-boot-images-riscv64 (jammy-proposed/main) [1 => 3] (no packageset)15:17
sil2100xnox: all good!15:18
-queuebot:#ubuntu-release- Unapproved: rejected cd-boot-images-riscv64 [source] (jammy-proposed) [2]15:19
-queuebot:#ubuntu-release- Unapproved: accepted cd-boot-images-riscv64 [source] (jammy-proposed) [3]15:19
sil2100Basically xypron had some changes made that we need but used the debdiff approach, but I just put that on top of your changes15:19
xnoxsil2100:  cool, commit it to repo as well15:21
xnoxsil2100:  i pushed my changes there.15:21
sil2100xnox: all done!15:21
sil2100bdmurray: so you had concerns regarding the auto-accept script being outdated, yes?15:22
sil2100You think it might be risky to turn it on in the state it is now?15:22
bdmurraysil2100: No, I just wanted to make sure it really was the right script.15:23
sil2100I'll double-check just in case - I'm sure it's the right one, although I never really switched it on. But I think I've been seeing some packages people would normally think should get auto-accepted not being auto-accepted15:25
sil2100So maybe the list was a bit outdated since a while15:25
laneyYou just uncomment the auto-accept line in ubuntu-archive@snakefruit's crontab15:27
laneyhi :-)15:27
bdmurraylaney: I was put off by this https://pastebin.ubuntu.com/p/rR8w6RHFMC/15:28
laneybdmurray: what about it?15:28
laneyapart from being a bit out of date, shouldn't be harmful15:29
laneyI think you could clear out SEED_WHITELIST and PACKAGE_WHITELIST15:29
bdmurraylaney: okay, the out of dateness made me wonder if it was the right thing15:29
laneythose were old exemptions. seeded packages are not auto-accepted with the exception of things mentioned there15:31
laneybut all seem obsolete so it'd probably be clearer to future travellers like yourself to remove them15:31
=== mfo_ is now known as mfo
sil2100bdmurray: can you uncomment the auto-accept line in the crontab then ;) ?15:53
-queuebot:#ubuntu-release- Unapproved: cinder (impish-proposed/main) [2:19.0.0-0ubuntu3 => 2:19.0.0-0ubuntu4] (openstack)15:55
bdmurraysil2100: will do16:01
sil2100Thanks o/16:01
bdmurrayit also seemed weird that the mail from it goes to stgraber16:01
sil2100It's an old line16:02
bdmurrays/old/vintage/16:02
coreycbhello SRU team, I've just uploaded a new version of cinder to the impish unapproved queue that fixes a bug that will help unblock release of another project that depends on it. would love to get a review, thanks in advance.16:03
-queuebot:#ubuntu-release- Unapproved: ppa-purge (jammy-proposed/universe) [0.2.8+bzr63 => 0.2.8+bzr63-0ubuntu1] (ubuntu-budgie)16:04
-queuebot:#ubuntu-release- Unapproved: mesa (jammy-proposed/main) [22.0.0-0ubuntu2 => 22.0.0-0ubuntu3] (core, i386-whitelist, xorg)16:08
tjaalton^ this fixes some apps crashing16:09
-queuebot:#ubuntu-release- Unapproved: elementpath (jammy-proposed/main) [2.3.0-1 => 2.5.0-1] (no packageset) (sync)16:18
-queuebot:#ubuntu-release- Unapproved: python-xmlschema (jammy-proposed/universe) [1.4.2-1 => 1.10.0-1] (no packageset) (sync)16:18
bdmurraysil2100: yes list-oem-metapackages is called by update-notifier regularly16:56
-queuebot:#ubuntu-release- Unapproved: edk2 (jammy-proposed/main) [2022.02-2 => 2022.02-3] (ubuntu-server) (sync)17:04
sil2100bdmurray: so basically will this error pop up for all users constantly after install?17:40
sil2100bdmurray: if that's the case, we might want to include that into the Beta as well...17:40
sil2100grub2, nautilus, cd-boot-images-riscv64 and libreoffice will go in in the nearest britney tick17:40
sil2100But if it's indeed as serious, we might want to get update-notifier in as well17:41
sil2100bdmurray: can you make sure it gets in ASAP? We can try pinging juliank for prioritizing its tests if needed17:41
sil2100Might need an unblock hint17:41
Eickmeyersil2100: +1. I see that error *every time* I boot into Ubuntu Desktop.17:43
sil2100Then this is what one can call a 'release-blocking bug'!17:44
sil2100I'll commit the unblock hint17:44
sil2100Actually17:45
sil2100I know I'm probably drunk on power and overusing this right now, but I'll skiptest it!17:45
Eickmeyerhehehe17:45
bdmurrayI did test the fix and also ran the amd64 autopkgtest17:46
sil2100Because this is literally a one-line change, and I know one-line changes can break as well - but we'll know instantly during beta testing if it regressed anything. If it regressed some tests, this is highly unlikely17:46
sil2100And then we'll just have to live with it17:46
sil2100Although, I need to re-run the ppc64el build as it FTBFSed17:47
sil2100uh, on some weird errors in the unit tests17:47
sil2100https://launchpadlibrarian.net/593747202/buildlog_ubuntu-jammy-ppc64el.update-notifier_3.192.53_BUILDING.txt.gz17:47
sil2100rerunning17:47
EickmeyerYeah, that doesn't look right. Temporary failure, it seems.17:48
sil2100Ok, hinted. Let's make sure the ppc64el build succeeds and then keep an eye out for it to migrate17:49
sil2100With this, image candidates should be building in uh, like 1-2 hours17:50
sil2100We're late, but still not terribly late17:50
EickmeyerI've seen worse.17:50
bdmurrayThe ppc64el build finished already17:51
-queuebot:#ubuntu-release- Unapproved: cctbx (jammy-proposed/universe) [2021.12+ds1-2ubuntu1 => 2021.12+ds1-4] (no packageset) (sync)17:51
-queuebot:#ubuntu-release- Unapproved: softhsm2 (jammy-proposed/universe) [2.6.1-2build1 => 2.6.1-2ubuntu1] (i386-whitelist)18:10
-queuebot:#ubuntu-release- Unapproved: accepted cinder [source] (impish-proposed) [2:19.0.0-0ubuntu4]19:05
juliankTo share this publicly19:55
juliankarm64 diff between 1737 and 2142 CEST: https://paste.ubuntu.com/p/WtkpqqjmyQ/19:55
juliankgrafana shows arm64 queue change from 8.94K to 8.92K19:55
juliankaka 30 tests passed19:56
juliankdiffing queues.json we get 9242-900=242 tests less in the queues19:56
juliankok and ubuntu metrics dashboard: https://ubuntu-release.kpi.ubuntu.com/d/yIC34LpGk/ubuntu-metrics?viewPanel=4&orgId=1&from=1648568220000&to=1648582920000 has the right queue sizes20:01
julianksorry people20:03
ahasenackis this good news or bad news?20:03
ahasenackI mean, I can tell the queue is huge20:03
juliankthis is um good news, the queue size is actually going down at a decent20:03
ahasenackbut did it get better, even though slowly?20:03
juliankrate20:03
ahasenackok20:03
juliank10 times better than the graph showed20:04
ahasenacksounds great20:04
sil2100hmmmm, still the britney run didn't finish20:05
sil2100Guess britney just has a LOT to do20:06
juliankso what happened is I changed the query to use max("count") instead of sum("count"), as sum("count") produces wrong results if you group by an interval larger than the reporting period20:07
julianke.g. you have 10k tests pending at 10 minutes, and 10k tests pending at 20 minutes, and your reporting period is 20 minutes, you get 20k tests reported for that time.20:07
juliankoh I think I see what's going on20:07
juliankIt was reporting progress for the *largest* queue, that is, the huge queue only20:07
juliankwonder how one would fix that20:08
juliankessentially we need to sum up the queues per arch, but then pick the maximum (or median) in the report period20:08
juliankbut this does mean the huge queue is going slowly20:09
juliankbut that's to be expected as arm* have normal queues still20:09
juliankor had20:09
sil2100grrr, update-notifier will only migrate with the next britney run20:14
sil2100I was too late with the hint20:14
sil2100Oh well20:14
ahasenackI uploaded samba on friday, and it's ready to migrate, will the release team go over each package in such state and make a decision, or only if I ping explicitly about this, or something else?20:14
juliankahasenack: if it is seeded, you need the new version on the install media, ping20:16
ahasenackpostgresql-14 ftbfs fix was also uploaded on friday, but still has dep8 tests to run in non-amd64 arches20:16
juliankahasenack: I'm not sure samba or postgresql matter much for install media testing in the beta20:16
bdmurraysil2100: I think update-notifier just migrated20:17
sil2100Oh shit20:29
sil2100Was probably the first thing on the new britney run20:29
sil2100bdmurray: let's wait for rmadison to say it's fully published and I'll be spinning the candidate images20:30
ahasenackjuliank: right, doesn't matter for media testing20:31
ahasenackI was considering a wider audience using them, that's all, but apt-get post-install can do that20:31
-queuebot:#ubuntu-release- Unapproved: accepted horizon [source] (focal-proposed) [3:18.3.5-0ubuntu2]20:33
bdmurraycoreycb: It'd be good to bug 1962582 verified20:35
ubottuBug 1962582 in horizon (Ubuntu Impish) "[SRU] Xena stable releases" [Undecided, Fix Committed] https://launchpad.net/bugs/196258220:35
coreycbbdmurray: yes, we need to get that done20:41
sil2100Ok, kicking first beta candidates!20:45
juliankarmhf now has 33% more workers again, they accidentally got stuck stopped20:49
juliankwill try to improve resilience tomorrow20:49
juliankbut there's a kernel bug on armhf where lxd containers leave around unkillable [defer] processes20:49
juliankbasically the hosts running lxd then need to be hard-reset20:50
juliankit's a bit annoying20:50
sil2100bdmurray, vorlon: triggered most of the Beta RC builds via tracker, all besides the server images - I'll do those from ancientminister as I want to build the riscv64 installer image as part of the set (but separately, so that all the other arches don't have to wait for the riscv64 installer livefs to finish)20:53
-queuebot:#ubuntu-release- Unapproved: rejected ceph [source] (focal-proposed) [15.2.16-0ubuntu0.20.04.1]20:55
bdmurraysil2100: ack20:56
-queuebot:#ubuntu-release- Unapproved: rejected iio-sensor-proxy [source] (focal-proposed) [2.8-1ubuntu2]20:59
bdmurraysil2100: Are you retrying the failures?21:02
-queuebot:#ubuntu-release- Unapproved: accepted lxd [source] (bionic-proposed) [3.0.3-0ubuntu1~18.04.2]21:08
sil2100Argh21:27
sil2100I will now, but the fudge21:27
bdmurrayI can do it too if you want to bail21:28
sil2100bdmurray: did they basically all fail?21:39
bdmurraysil2100: yeah21:41
sil2100bdmurray: hm, I see that possibly most of the amd64 ones have failed to build. Do you know if there's an easy way to only get rid of those from the build queue?21:46
sil2100Since `rebuild-requests -c jammy iso` would cancel all the requests21:46
sil2100And I guess we're not yet sure if the other arches have failed, right?21:47
bdmurraysil2100: No, I don't know of an easy way. Could we check the livefs builds for the other arches?21:49
sil2100bdmurray: I see that all ubuntu-base tarballs have succeeded (riscv64 still building though)21:50
sil2100Xubuntu amd64 succeeded as well, Lubuntu as well21:51
sil2100ARGH21:51
bdmurraySo many flavors it's like Baskin Robbins21:52
sil2100We have a problem...21:52
sil2100I suspect that vorlon's recent change to debian-cd to rip-out unused series has broken debian-cd :|21:53
sil2100This is why we got no indication of success of those builds like Lubuntu and Xubuntu21:53
sil2100===== Building Lubuntu daily CDs =====21:53
sil2100Tue Mar 29 21:11:07 UTC 202221:53
sil2100./build_all.sh: 95: ./CONF.sh: Syntax error: redirection unexpected (expecting ")")21:53
sil2100And I see that CONF.sh has been touched recently by removing a lot of the old series from the case statement21:54
-queuebot:#ubuntu-release- Builds: Ubuntu Desktop arm64+raspi [Jammy Beta] (20220329) has been added21:54
sil2100^ preinstalled work as they do not invoke debian-cd21:54
-queuebot:#ubuntu-release- Unapproved: ubuntu-mate-artwork (jammy-proposed/universe) [22.04.11 => 22.04.12] (ubuntu-mate)21:55
Wimpysil2100: If you could accept and unblock ubuntu-mate-artwork 22.04.12 I'd appreciate it21:57
WimpyOh. Sorry. Just read the back scroll.21:58
sil2100bdmurray: aaaargh, so it seems vorlon's changes caused a conflict in the debian-cd branch on ancientminister and there's basically conflict tags in the CONF.sh now21:59
sil2100bdmurray: ok, let me cancel all the jobs then and start fresh22:00
sil2100bdmurray: ok, cancelled, will now re-run those22:08
sil2100Conflict fixed22:08
sil2100bdmurray: so the situation is as follows:22:09
sil2100Basically due to the debian-cd conflict, none of the installer images could succeed. So now I re-triggered all of those via tracker. ubuntu-base needs no re-triggering as those have passed and are just waiting for riscv64. Server images are still building via ancientminister cmdline, and they should pass as they build sequentially: first preinstalled, then subiquity normal arches and then22:11
sil2100subiquity riscv6422:11
sil2100So the subiquity ones should just finish when the time is right22:11
sil2100The riscv64 image might still fail, as I was testing some stuff on those, but I'll take care of it tomorrow22:12
bdmurrayack and if things fail (due to the networking issues) what is the right way to retry the build?22:12
sil2100hm, I think basically what you can do is just run `rebuild-requests -c jammy iso` on ancientiminster, clear out all of the pending rebuilds and trigger those that need re-triggering again via the tracker22:14
sil2100Since the rebuild requests only matter at the beginning. If a build started and the rebuild request that triggered it gets cancelled, it changes nothing as the build is already started22:15
sil2100So once you're sure all of those actually started, you can clear them all out and just retrigger the ones that failed22:15
bdmurraywhat do you mean by "clear them out"?22:15
-queuebot:#ubuntu-release- Builds: Kubuntu Desktop amd64 [Jammy Beta] (20220329.1) has been added22:39
-queuebot:#ubuntu-release- Builds: Ubuntu Kylin Desktop amd64 [Jammy Beta] (20220329.1) has been added22:39
-queuebot:#ubuntu-release- Builds: Xubuntu Desktop amd64 [Jammy Beta] (20220329.1) has been added22:39
-queuebot:#ubuntu-release- Builds: Lubuntu Desktop amd64 [Jammy Beta] has been updated (20220329.1)22:39
-queuebot:#ubuntu-release- Unapproved: golang-github-hhatto-gorst (jammy-proposed/universe) [0.0~git20181029.ca9f730-2 => 0.0~git20181029.ca9f730-2ubuntu1] (no packageset)22:42
-queuebot:#ubuntu-release- Builds: Ubuntu Desktop amd64 [Jammy Beta] (20220329.1) has been added22:44
-queuebot:#ubuntu-release- Builds: Ubuntu MATE Desktop amd64 [Jammy Beta] (20220329.1) has been added22:44
-queuebot:#ubuntu-release- Builds: Ubuntu Studio DVD amd64 [Jammy Beta] (20220329.1) has been added22:47
Wimpybdmurray: Please can you accept and unblock ubuntu-mate-artwork 22.04.1222:59
bdmurrayWimpy: okay23:05
-queuebot:#ubuntu-release- Unapproved: accepted ubuntu-mate-artwork [source] (jammy-proposed) [22.04.12]23:07
WimpyThanks bdmurray23:09
-queuebot:#ubuntu-release- Builds: Ubuntu Base amd64 [Jammy Beta] (20220329) has been added23:38
-queuebot:#ubuntu-release- Builds: Ubuntu Base arm64 [Jammy Beta] (20220329) has been added23:38
-queuebot:#ubuntu-release- Builds: Ubuntu Base armhf [Jammy Beta] (20220329) has been added23:38
-queuebot:#ubuntu-release- Builds: Ubuntu Base ppc64el [Jammy Beta] (20220329) has been added23:38
-queuebot:#ubuntu-release- Builds: Ubuntu Base riscv64 [Jammy Beta] (20220329) has been added23:38
-queuebot:#ubuntu-release- Builds: Ubuntu Base s390x [Jammy Beta] (20220329) has been added23:38

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!