[01:25] <poolie> i'm getting a failure like
[01:25] <poolie> keyring.tests.test_core: module references __file__
[01:25] <poolie> Got keyring 0.5.1.
[01:25] <poolie> Getting distribution for 'lazr-js==1.5DEV-r191'.
[01:26] <poolie> i guess this is some kind of dependency out of date thing
[01:26] <poolie> any clues? running update-sourcecode just once did not seem to fix it
[01:31] <poolie> also lazr.restful...
[01:55] <poolie> np, got it
[02:56] <lifeless> \o/
[02:56] <lifeless>  * 201 Time Outs
[02:57] <lifeless> still a long tail
[03:06] <wgrant> lifeless: But 43 of those are already fixed.
[03:06] <wgrant> 450 soft too, wow.
[03:06] <wgrant> We could almost get away with dropping to 9s right now...
[03:26] <wgrant> Surprise surprise, all but one or two of the BugTask:+index OOPSes were from gandwana/potassium.
[03:54] <LPCIBot> Project windmill build #180: STILL FAILING in 1 hr 1 min: https://lpci.wedontsleep.org/job/windmill/180/
[07:15] <wgrant> Oh no, not again.
[07:38] <lifeless> wgrant: windmill or something else ?
[07:38] <lifeless> wgrant: and yes, the better hardware is making quite a difference
[07:39] <wgrant> lifeless: structsub conflict.
[07:40] <lifeless> \o.
[07:40] <wgrant> Submitting now....
[07:42] <lifeless> coolio
[07:42] <lifeless> I think the bug aggregates will need rabbit
[07:42] <wgrant> Oh?
[07:43] <lifeless> unless I get some metric together on the volume of aggregate-field changes in ubuntu bugs
[07:44] <wgrant> Hmmm.
[07:44] <lifeless> I may be jumping at ghosts
[07:44] <lifeless> bbiab
[08:15] <StevenK> wgrant: Structul subscriptions *again*? :-(
[08:16] <StevenK> lifeless: I wonder if we can drop the timeout now due to single-threadness plus new appserver of awesome?
[08:16] <wgrant> searchTasks is an issue :(
[08:17] <wgrant> Apart from searchTasks we can drop 2s (to 9s) without a problem, AFAICT.
[08:20] <LPCIBot> Yippie, build fixed!
[08:20] <LPCIBot> Project devel build #642: FIXED in 5 hr 38 min: https://lpci.wedontsleep.org/job/devel/642/
[08:27] <lifeless> indeed
[08:27] <lifeless> we need to address searchtasks - perhaps by result size estimation
[08:28] <lifeless> or possibly an exception
[08:28] <wgrant> I don't think we can immediately make any vast improvements there :/
[08:30] <lifeless> better search schema
[08:30] <wgrant> "immediately"
[08:34] <lifeless> fsvo
[08:43] <lifeless> tag search is being a pain
[09:13] <LPCIBot> Project windmill build #181: STILL FAILING in 1 hr 0 min: https://lpci.wedontsleep.org/job/windmill/181/
[12:58] <LPCIBot> Project windmill build #182: STILL FAILING in 1 hr 1 min: https://lpci.wedontsleep.org/job/windmill/182/
[13:34] <LPCIBot> Project devel build #643: FAILURE in 5 hr 14 min: https://lpci.wedontsleep.org/job/devel/643/
[21:14] <lifeless> meep
[21:14] <lifeless> 'bug' gets written to 30K times a day
[21:14] <lifeless> for ubuntu alone
[21:14] <lifeless> 60K across the board
[21:18] <lifeless> BugTask:+index is our 10th most popular codepath : 160K hits a day
[21:26] <LPCIBot> Yippie, build fixed!
[21:26] <LPCIBot> Project devel build #644: FIXED in 5 hr 30 min: https://lpci.wedontsleep.org/job/devel/644/
[21:27] <LPCIBot> Project windmill build #183: STILL FAILING in 1 hr 0 min: https://lpci.wedontsleep.org/job/windmill/183/