=== Ursinha-afk is now known as Ursinha | ||
=== Ursinha-afk is now known as Ursinha | ||
StevenK | wgrant: /srv/launchpad.net/builddmaster is also used on mawson by buildd-manager as queue for binaries from the buildds? | 00:57 |
---|---|---|
wgrant | StevenK: Sure, and it should be on alphecca do | 01:05 |
wgrant | too | 01:05 |
wgrant | It's used on builddmaster hosts | 01:05 |
StevenK | Right | 01:05 |
wgrant | But it only exists on other upload hosts because of P-a-s. | 01:05 |
StevenK | Yeah | 01:05 |
StevenK | wgrant: So my QA plan is to destroy the P-a-s checkout on mawson, and upload acpi to my ppa and see what happens | 01:06 |
wgrant | That would be correct. | 01:06 |
StevenK | 2013-06-03 01:13:46 DEBUG Creating PENDING publishing record. | 01:14 |
StevenK | 2013-06-03 01:13:47 DEBUG Created amd64 build of acpi 0.09-3ubuntu2 in ubuntu precise RELEASE [4560808] in PPA for Steve Kowalik (2505) | 01:14 |
StevenK | 2013-06-03 01:13:47 DEBUG Created i386 build of acpi 0.09-3ubuntu2 in ubuntu precise RELEASE [4560809] in PPA for Steve Kowalik (2505) | 01:14 |
StevenK | 2013-06-03 01:13:47 DEBUG Not closing bugs for PPA source. | 01:14 |
StevenK | So that works fine | 01:14 |
wgrant | StevenK: Not quite | 01:16 |
wgrant | StevenK: Only i386 and amd64 chroots exist for saucy | 01:16 |
wgrant | So that's not necessarily a good test | 01:16 |
StevenK | wgrant: But I didn't upload to saucy | 01:17 |
wgrant | Ah, true | 01:17 |
wgrant | And I don't think I cleaned out the precise chroots | 01:17 |
StevenK | wgrant: You didn't, there are 5 chroots for precise on DF | 01:21 |
StevenK | wgrant: Right, I uploaded acpi to a devirt PPA in precise and only get amd64 and i386 too | 01:41 |
=== Ursinha is now known as Ursinha-afk | ||
=== Ursinha-afk is now known as Ursinha | ||
* StevenK nails wallyworld to IRC. | 02:23 | |
wallyworld | i think my wireless router is fighting with my laptop | 02:23 |
StevenK | And which is winning? | 02:24 |
wallyworld | neither :-( | 02:24 |
wallyworld | reboot time, but i'm in the middle of something | 02:24 |
wgrant | Ohhh, clever | 02:46 |
StevenK | wgrant: aoetools to a devirt PPA creates all five build records, too | 02:48 |
wgrant | StevenK: Excellent | 02:48 |
StevenK | wgrant: So, previewdiff work, or shall I create an API to update a chroot like infinity wants? | 02:49 |
wgrant | StevenK: We're not very good about accepting large file uploads atm, but it might work | 02:50 |
wgrant | See if we regularly have apport attachments that are roughly chroot-sized. | 02:51 |
wgrant | Oh Zope | 02:58 |
wgrant | You are so awful sometimes | 02:58 |
wgrant | I just cut 20% off the Launchpad start time by fixing zope.component.registry to not be completely moronic | 02:58 |
wgrant | (registering or unregistering a utility compares each new registration against every existing one) | 03:00 |
StevenK | Haha | 03:03 |
StevenK | wgrant: Still waiting for my terrible query to finish hurting mawson. | 03:04 |
nigelb | < wgrant> You are so awful sometimes <-- sometimes?! | 03:05 |
wgrant | There we go, registerUtility down from 47.73% (7.19%) to 5.29% (0.27%), and I doubt I broke anything. | 03:08 |
StevenK | wgrant: What's the diff, so I can laugh and/or cry? | 03:09 |
wgrant | http://pastebin.ubuntu.com/5728141/ | 03:11 |
wgrant | InterfaceClass.__hash__ is also pretty slow now | 03:11 |
wgrant | 5% of no-op script runtime | 03:12 |
wgrant | Actually, that patch is a bit buggy now | 03:12 |
wgrant | But the fix shouldn't change performance | 03:12 |
StevenK | wgrant: Interesting choice of variable name | 03:14 |
wgrant | I was none too pleased to see the original code :) | 03:14 |
wgrant | Ah, the new code is actually marginally faster, even. | 03:15 |
StevenK | I bet | 03:15 |
wgrant | http://pastebin.ubuntu.com/5728149/ | 03:15 |
StevenK | wgrant: Could it be due to older Python? | 03:15 |
wgrant | StevenK: No | 03:15 |
wgrant | O(n²) is never a good idea :) | 03:16 |
wgrant | Interface.__eq__ was being called a few million times. | 03:16 |
StevenK | WCPGW | 03:16 |
StevenK | wgrant: So, you plan on upstreaming it? | 03:16 |
wgrant | Seeing if I can get start time below 50% first | 03:17 |
StevenK | wgrant: No fair if your patch contains speech like GLaDOS addressing Wheatley. | 03:18 |
wgrant | Ah | 03:25 |
wgrant | Maybe if I drop lazr.restful registrations from scripts | 03:25 |
wgrant | That could give me another 20% | 03:25 |
wgrant | :( | 03:31 |
wgrant | Barely a second | 03:31 |
wgrant | And zope.sendmail adds 3s to shutdown | 03:48 |
StevenK | wgrant: http://pastebin.ubuntu.com/5728202/ | 03:52 |
wgrant | StevenK: That just shows that 16 requests ever exceeded 200MB, which isn't exactly encouraging. | 03:53 |
wgrant | StevenK: Perhaps try uploading some chroots to +storeblob and see if they always succeed | 03:54 |
StevenK | wgrant: Right, hitting up RootObject:+storeblob (I guess) on DF as soon as I can grab a chroot | 03:55 |
StevenK | Oh look, there's on | 03:55 |
StevenK | *one | 03:55 |
wgrant | StevenK: Needs to be prod | 03:55 |
wgrant | DF means nothing | 03:55 |
wgrant | It's likely to succeed on DF/staging but fail on prod | 03:56 |
StevenK | wgrant: I'm a little restiscent to toss a few hundred Mb at prod | 03:56 |
wgrant | StevenK: Why? | 03:56 |
wgrant | +storeblob will get pruned in ~48h | 03:57 |
StevenK | Right | 03:57 |
wgrant | Near-sane test startup time is near my grasp :) | 04:02 |
StevenK | Heh | 04:03 |
wgrant | No-op script time is below 3s | 04:03 |
wgrant | (moving webservice and browser stuff to appserver-only, and with the zope.sendmail and zope.component fixes. zope.interface is also a bit slow, but the slowness was added for a good reason) | 04:03 |
wgrant | It was about 9.8s before | 04:03 |
StevenK | wgrant: 'Sending request to launchpad.net...' -- this could involve a bit of waiting | 04:04 |
wgrant | Quite | 04:04 |
wgrant | It'll probably time out from here | 04:04 |
wgrant | But we'll see | 04:04 |
StevenK | Some way to gauge progress would be nice, but I can't have everything | 04:05 |
wgrant | http://pastebin.ubuntu.com/5728220/ is the zope.sendmail diff | 04:05 |
wgrant | Previously every LP process would have to wait 3s for that thread to shutdown | 04:06 |
wgrant | That's why everything takes so long to finish | 04:06 |
StevenK | Come ON firefox | 04:28 |
wgrant | So yeah, 11.6s to 3.6s for a script run | 04:28 |
wgrant | I mostly want this for less awful test times | 04:29 |
wgrant | librarian start times, subprocess startup/teardown times | 04:29 |
StevenK | Hmmm | 04:29 |
StevenK | 'Waiting for launchpad.net' | 04:29 |
StevenK | wgrant: Is the blob ticket secret? | 04:29 |
wgrant | StevenK: What do you mean? | 04:30 |
wgrant | There's no way to look up the blob from the outside without it | 04:30 |
wgrant | And you can only get it from the response to a POST to +storeblob | 04:30 |
StevenK | wgrant: Your ticket is "2f66004a-cc06-11e2-a37c-002481e7f48a" | 04:30 |
StevenK | From a chroot upload | 04:30 |
wgrant | So it worked? | 04:30 |
StevenK | Yeah, it just took 25 minutes to upload. | 04:31 |
StevenK | wgrant: Shall I repeat the test? | 04:31 |
wgrant | StevenK: Might as well | 04:33 |
wgrant | I wonder if the timeout is 30 minutes | 04:33 |
StevenK | wgrant: Right, that works as well | 05:21 |
wgrant | StevenK: Not sure how well launchpadlib exposes uploads. I'd try to work out that next. | 05:22 |
StevenK | wgrant: In terms of progress or how they're exposed? | 05:23 |
StevenK | IBug.addAttachment() was my plan | 05:23 |
wgrant | There's certainly no progress | 05:24 |
StevenK | wgrant: Current plan is DAS.setChroot(data (exported as Bytes), sha1sum) | 05:25 |
wgrant | StevenK: Why sha1sum? | 05:27 |
StevenK | wgrant: Because infinity would like to be damn sure the client and server agree about a checksum before we set PocketChroot.chroot | 05:27 |
wgrant | OK. | 05:27 |
StevenK | Hmm | 05:28 |
StevenK | wgrant: Going to write a security adapter that limits to the owner of the relevant distribution main_archive, too | 05:29 |
=== tasdomas_afk is now known as tasdomas | ||
=== tasdomas is now known as tasdomas_afk | ||
=== tasdomas_afk is now known as tasdomas | ||
=== alexlist` is now known as alexlist | ||
=== wedgwood_away is now known as wedgwood | ||
=== wedgwood is now known as Guest21017 | ||
=== wedgwood_ is now known as wedgwood | ||
=== tasdomas is now known as tasdomas_afk | ||
=== olli_ is now known as olli | ||
=== dpm is now known as dpm-afk |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!