[07:38] <RikMills> ilasc: builders on NOT x86 look like buildd-manager is fubar again. or at least usual symptom of things not completing
[07:46] <ilasc> RikMills: looking
[07:47] <RikMills> ty
[08:30] <cpaelzer> ilasc: still seems to be the same, what did you find?
[08:30] <ilasc> cpaelzer: we're working it
[08:31] <cpaelzer> ah still on it, ok then - thanks
[08:33] <ilasc> yes cpaelzer, sorry this is taking a while
[08:33] <cpaelzer> not a problem at all
[08:33] <ilasc> ok RikMills , cpaelzer looking at the logs looks we got it building again
[08:33] <cpaelzer> as long as we know someone is on it there is no need to rush
[08:34] <cpaelzer> I only asked again to make sure it wasn't falling through the cracks
[08:34] <RikMills> thanks!
[08:34] <ilasc> cpaelzer: fair enough
[08:34] <ilasc> :-)
[08:34] <cpaelzer> arm seems to have pciked up again
[08:34] <cpaelzer> ppc and s390x I'm not so sure yet
[08:34] <ilasc> cool, ok
[08:34] <cpaelzer> but let us give it soem minutes
[08:35] <ilasc> cpaelzer: checking logs for them in the meantime
[08:36] <ilasc> cpaelzer: logs look like builds are progressing there
[08:36] <ilasc> let us know when you check if it doesn't look right to you
[08:36] <cpaelzer> I will, but first I'll give it some time to actually have a chance to move
[09:07] <cpaelzer> ilasc: I see builds on all arches again, thanks!
[09:12] <ilasc> cpaelzer: cool, thanks for letting us know
[10:32] <LocutusOfBorg> mmm ppc64el machines seems cleaning too much again? e.g. 001 003 006 007 008 009 010 011 013 018 019 020 022 023 024 026 028 029 looks stuck?
[10:33] <LocutusOfBorg> also s390x look cleaning too much, and queues are rising
[11:18] <ogra> are there known issues with the arm builders ? i have a snap sitting in "Building soon" since 👍h on armhf and arm64
[11:18] <ogra> gah
[11:18] <ogra> since more than 1h
[11:18] <ogra> (silly emoji plugin)
[12:02] <ilasc> LocutusOfBorg: ogra
[12:02] <ilasc> are you still seeing issues with builds ?
[12:02] <ogra> well, i'm still staring at "Building soon" yeah
[12:03] <LocutusOfBorg> ilasc, looks more happy now
[12:03] <ogra> https://launchpad.net/builders seems to be moving though ... but no pick up for me yet
[12:04] <LocutusOfBorg> well, s390x seems still a bit sad
[12:05] <LocutusOfBorg> what really worries me is https://launchpad.net/ubuntu/+source/pyinsane/2.0.13-1build1/+build/19492566
[12:05] <LocutusOfBorg> uploading since an hour or so
[12:05] <LocutusOfBorg> and looks like not a "big package being upload so queue is waiting for it" because other stuff has been processed
[12:07] <ogra> must be the name 🙂
[12:07] <LocutusOfBorg> lol I was tempted to do a joke about it :D
[12:08] <ilasc> 🙂
[12:08] <ilasc> good one!
[12:09] <ilasc> so for that build in particular I'm seeing the right things in the logs: BuilderStatus.BUILDING
[12:10] <ilasc> let's give pyinsane 2.0.13-1build1 a bit and see if it picks up
[12:10] <ogra> https://launchpad.net/~build.snapcraft.io/+snap/cf88364a393ecf672b24716b37f94086/ is mine is that just a big queue ?
[12:11] <ilasc> checking now
[12:11] <ogra> (i wish there was a direct link on the snapcraft.io page so i dont have to fish out the url from a former buils)
[12:11] <ogra> *build
[12:12] <ilasc> 🙂
[12:12] <ilasc> ogra: that looks like a wait in the queue
[12:12] <ogra> ah, well, then i'll wait
[12:39] <ogra> sigh ... just went from "in 45min (estimated)" to "in 1h (estimated)" ... this is really starting to hold up my workday 😕 (i'm 3h in now)
[15:58] <SpecialK|Canon> ogra: I trust that the job eventually completed to your satisfaction?
[15:58] <ogra> it did !
[15:58] <ogra> started about 30min after my last line above
[16:00] <SpecialK|Canon> Good good