[06:59] <ricotz> hello :), looks like the builders are having a hard time, I am seeing silently failing builds on all archs :(
[07:14] <ricotz> guruprasad, good morning :), ^
[08:30] <guruprasad> ricotz, let me check and get back.
[08:30] <guruprasad> Can you share a link to a failing build or two that I can check?
=== bittin_ is now known as luna-work
[10:19] <ricotz> guruprasad, I guess the best link is https://launchpad.net/builders
[10:20] <ricotz> I am restarting those builds when I noticed it
[10:21] <ricotz> e.g. https://launchpad.net/builders/bos02-arm64-011/+history see the thunderbird build
[10:21] <guruprasad> ricotz, we have received multiple more reports and are investigating this.
[10:21] <ricotz> guruprasad, thank you
[13:53] <cjwatson> ricotz: Should be fixed now, I think
[13:53] <cjwatson> (bumped a timeout for an authentication request; haven't seen any failures since, though it's only been about 15 minutes)
[13:54] <ricotz> cjwatson, great, thanks! could you bump this libreoffice build again? https://launchpad.net/ubuntu/+source/libreoffice/4:7.5.7-0ubuntu0.23.04.1~bpo22.04.1/+build/26821168
[14:09] <ricotz> cjwatson, https://launchpad.net/~ubuntu-mozilla-security/+archive/ubuntu/ppa/+build/26895468
[16:08] <cjwatson> ricotz: both had finished by the time I saw this (suggesting they didn't _really_ need to have their score bumped)
[16:12] <surfzoid> Hi, there is privilege prob : https://launchpadlibrarian.net/690968046/buildlog.txt.gz?
[16:12] <ricotz> cjwatson, the ubuntu-mozilla-security ppa build was just another silent failure related to the infra problems
[16:13] <cjwatson> ricotz: but it's succeeded
[16:13] <ricotz> cjwatson, regarding the libreoffice riscv64 build it failure due to the infra problems and got its low score again, please bump it again as you did yesterday
[16:14] <cjwatson> ricotz: the riscv64 build is in dependency wait state, that can't be due to those infra problems.
[16:14] <ricotz> cjwatson, it got retried by someone else in the meantime
[16:14] <cjwatson> I was doing lots of bulk retries
[16:14] <ricotz> cjwatson, different topics, sorry
[16:14] <cjwatson> ok, that one's scored back up now
[16:14] <ricotz> thank you
[16:15] <surfzoid> cjwatson could yu please have a look? https://launchpadlibrarian.net/690968046/buildlog.txt.gz?
[16:15] <cjwatson> no, sorry
[16:15] <cjwatson> file a ticket
[16:16] <cjwatson> I have no idea what that is offhand and I've spent the entire day firefighting an assortment of random stuff so I'm not going to pick up another thing just before my end of week
[16:16] <surfzoid> cjwatsoncould you confirm it is a lp issu not my side?
[16:16] <cjwatson> I can tell you it's not "privilege prob" at least
[16:16] <cjwatson> that's all I can say right now
[16:17] <surfzoid> cjwatson  could you confirm it is a lp issu not my side?
[16:17] <cjwatson> it appears to be
[16:17] <surfzoid> cjwatson thank yu
[17:16] <ricotz> cjwatson, libreoffice/riscv64 failed due to connection timeouts :( - https://launchpad.net/ubuntu/+source/libreoffice/4:7.5.7-0ubuntu0.23.04.1~bpo22.04.1/+build/26821168
[17:16] <ricotz> Could not connect to ftpmaster.internal:80 (10.131.215.228), connection timed out
[17:17] <cjwatson> ricotz: oh interesting, I know why that is, let me see
[17:19] <cjwatson> _so_ much looking forward to getting the new riscv64 builders in place
[17:19] <ricotz> thanks for looking
[17:20] <ricotz> virtualized ones for common use? :)
[17:21] <cjwatson> Yeah
[17:21] <cjwatson> As soon as we can get lxd to play ball
[17:22] <ricotz> great :)
[17:22] <cjwatson> (lxd inside the VMs, not lxd to operate the VMs.  it's a long story.)
[17:22] <cjwatson> Once we have those they'll be on more or less normal firewalls and this sort of thing won't happen
[17:28] <ricotz> hopefully you can fix it, I will be afk for some time now
[17:29] <cjwatson> Yeah, I'm just waiting for IS to apply the change.  I'll retry affected builds
[17:38] <cjwatson> Should be retrying now