[08:42] <Laney> tomwardill: hey ho, just wanted to point you to this livefs build failure with no build log since it's the second one I've noticed - I saw the same on gnome-photos/groovy/amd64 earlier but already retried that one so may have destroyed the evidence there.
[08:42] <Laney> https://launchpad.net/~ubuntu-cdimage/+livefs/ubuntu/focal/ubuntu/+build/216234
[08:43] <tomwardill> Laney: that usually means it failed to start building for whatever reason
[08:43] <tomwardill> I'll see if I can see anything in the logs
[08:44] <Laney> I'd retry but since it's the second one I stumbled over, there might be some kind of issue
[08:48] <tomwardill> twisted.internet.defer.CancelledError
[08:48] <tomwardill> err
[08:49] <Laney> there's one more: https://launchpad.net/~ubuntu-cdimage/+livefs/ubuntu/focal/ubuntu-server-live/+build/216253
[08:50]  * tomwardill escalates to a cjwatson, scalingstack troubles?
[09:36] <SpecialK|Canon> Builders are a little unhappy, we're working on diagnosing the issue
[11:20] <ondrej> Is it just me or there's some problem with the launchpad builders?
[11:21] <ondrej> All the builds fail with no logs and no visible error.
[11:23] <moon127> ondrej: I suspect you want to highlight tomwardill per topic!
[11:23] <SpecialK|Canon> ondrej: Just you ;) (I jest, sorry - as per topic, and scrollback if you have it, the builders are unhappy and we're in the process of figuring out why)
[11:24] <ondrej> Damn, I was looking for topic and I missed the one single line.  Thanks, I see it now.
[11:25] <SpecialK|Canon> We've got a lot going on in the topic tbh!
[11:25] <ondrej> Ok, thanks.  I'll be patient then.
[11:26] <ondrej> and WeeChat has this weird color scheme that the topic is shown black on blue (e.g. almost invisible)
[11:26] <ondrej> So, I had to look in the channel log
[13:38] <cpaelzer> cjwatson: hi - you said the arm builders being somwhwat bad is a known case, and I see in the topic that they are "unhappy"
[13:39] <cpaelzer> I just wanted to check - I probably can go on as usual and somewhen e.g. tomorrow hit retry on the failed builds right?
[13:39] <cpaelzer> or did the debugging reach a state were more wide-reaching measures are required
[13:39] <cpaelzer> tomwardill: ^^ FYI
[13:39] <cpaelzer> in case you are involved as the topic states
[13:41] <tomwardill> cpaelzer: the arm builders are even more upset last I heard, but a retry when they're fixed should indeed work
[13:41] <tomwardill> or something along thos elines
[13:44] <cpaelzer> ok, waiting for the topic to tell me about their newfound happiness then ...
[13:51] <cjwatson> It's not really builder unhappiness, it's something more central in the whole system
[13:51] <cjwatson> Haven't figured it out yet
[14:26] <cjwatson> Rolled back buildd-manager to the previous revision and things seem much better now
[14:27] <cjwatson> I think I've bulk-retried most things that were failed as a result
[14:27] <cjwatson> Still leaves me with the problem of figuring out *why*
[14:49] <tomwardill> cpaelzer: fyi ^^
[14:50] <cpaelzer> thanks I see them building again
[14:50] <cpaelzer> not yet dead :-)