/srv/irclogs.ubuntu.com/2013/06/03/#launchpad-dev.txt

=== Ursinha-afk is now known as Ursinha
=== Ursinha-afk is now known as Ursinha
StevenKwgrant: /srv/launchpad.net/builddmaster is also used on mawson by buildd-manager as queue for binaries from the buildds?00:57
wgrantStevenK: Sure, and it should be on alphecca do01:05
wgranttoo01:05
wgrantIt's used on builddmaster hosts01:05
StevenKRight01:05
wgrantBut it only exists on other upload hosts because of P-a-s.01:05
StevenKYeah01:05
StevenKwgrant: So my QA plan is to destroy the P-a-s checkout on mawson, and upload acpi to my ppa and see what happens01:06
wgrantThat would be correct.01:06
StevenK2013-06-03 01:13:46 DEBUG   Creating PENDING publishing record.01:14
StevenK2013-06-03 01:13:47 DEBUG   Created amd64 build of acpi 0.09-3ubuntu2 in ubuntu precise RELEASE [4560808] in PPA for Steve Kowalik (2505)01:14
StevenK2013-06-03 01:13:47 DEBUG   Created i386 build of acpi 0.09-3ubuntu2 in ubuntu precise RELEASE [4560809] in PPA for Steve Kowalik (2505)01:14
StevenK2013-06-03 01:13:47 DEBUG   Not closing bugs for PPA source.01:14
StevenKSo that works fine01:14
wgrantStevenK: Not quite01:16
wgrantStevenK: Only i386 and amd64 chroots exist for saucy01:16
wgrantSo that's not necessarily a good test01:16
StevenKwgrant: But I didn't upload to saucy01:17
wgrantAh, true01:17
wgrantAnd I don't think I cleaned out the precise chroots01:17
StevenKwgrant: You didn't, there are 5 chroots for precise on DF01:21
StevenKwgrant: Right, I uploaded acpi to a devirt PPA in precise and only get amd64 and i386 too01:41
=== Ursinha is now known as Ursinha-afk
=== Ursinha-afk is now known as Ursinha
* StevenK nails wallyworld to IRC.02:23
wallyworldi think my wireless router is fighting with my laptop02:23
StevenKAnd which is winning?02:24
wallyworldneither :-(02:24
wallyworldreboot time, but i'm in the middle of something02:24
wgrantOhhh, clever02:46
StevenKwgrant: aoetools to a devirt PPA creates all five build records, too02:48
wgrantStevenK: Excellent02:48
StevenKwgrant: So, previewdiff work, or shall I create an API to update a chroot like infinity wants?02:49
wgrantStevenK: We're not very good about accepting large file uploads atm, but it might work02:50
wgrantSee if we regularly have apport attachments that are roughly chroot-sized.02:51
wgrantOh Zope02:58
wgrantYou are so awful sometimes02:58
wgrantI just cut 20% off the Launchpad start time by fixing zope.component.registry to not be completely moronic02:58
wgrant(registering or unregistering a utility compares each new registration against every existing one)03:00
StevenKHaha03:03
StevenKwgrant: Still waiting for my terrible query to finish hurting mawson.03:04
nigelb< wgrant> You are so awful sometimes <-- sometimes?!03:05
wgrantThere we go, registerUtility down from 47.73% (7.19%) to 5.29% (0.27%), and I doubt I broke anything.03:08
StevenKwgrant: What's the diff, so I can laugh and/or cry?03:09
wgranthttp://pastebin.ubuntu.com/5728141/03:11
wgrantInterfaceClass.__hash__ is also pretty slow now03:11
wgrant5% of no-op script runtime03:12
wgrantActually, that patch is a bit buggy now03:12
wgrantBut the fix shouldn't change performance03:12
StevenKwgrant: Interesting choice of variable name03:14
wgrantI was none too pleased to see the original code :)03:14
wgrantAh, the new code is actually marginally faster, even.03:15
StevenKI bet03:15
wgranthttp://pastebin.ubuntu.com/5728149/03:15
StevenKwgrant: Could it be due to older Python?03:15
wgrantStevenK: No03:15
wgrantO(n²) is never a good idea :)03:16
wgrantInterface.__eq__ was being called a few million times.03:16
StevenKWCPGW03:16
StevenKwgrant: So, you plan on upstreaming it?03:16
wgrantSeeing if I can get start time below 50% first03:17
StevenKwgrant: No fair if your patch contains speech like GLaDOS addressing Wheatley.03:18
wgrantAh03:25
wgrantMaybe if I drop lazr.restful registrations from scripts03:25
wgrantThat could give me another 20%03:25
wgrant:(03:31
wgrantBarely a second03:31
wgrantAnd zope.sendmail adds 3s to shutdown03:48
StevenKwgrant: http://pastebin.ubuntu.com/5728202/03:52
wgrantStevenK: That just shows that 16 requests ever exceeded 200MB, which isn't exactly encouraging.03:53
wgrantStevenK: Perhaps try uploading some chroots to +storeblob and see if they always succeed03:54
StevenKwgrant: Right, hitting up RootObject:+storeblob (I guess) on DF as soon as I can grab a chroot03:55
StevenKOh look, there's on03:55
StevenK*one03:55
wgrantStevenK: Needs to be prod03:55
wgrantDF means nothing03:55
wgrantIt's likely to succeed on DF/staging but fail on prod03:56
StevenKwgrant: I'm a little restiscent to toss a few hundred Mb at prod03:56
wgrantStevenK: Why?03:56
wgrant+storeblob will get pruned in ~48h03:57
StevenKRight03:57
wgrantNear-sane test startup time is near my grasp :)04:02
StevenKHeh04:03
wgrantNo-op script time is below 3s04:03
wgrant(moving webservice and browser stuff to appserver-only, and with the zope.sendmail and zope.component fixes. zope.interface is also a bit slow, but the slowness was added for a good reason)04:03
wgrantIt was about 9.8s before04:03
StevenKwgrant: 'Sending request to launchpad.net...' -- this could involve a bit of waiting04:04
wgrantQuite04:04
wgrantIt'll probably time out from here04:04
wgrantBut we'll see04:04
StevenKSome way to gauge progress would be nice, but I can't have everything04:05
wgranthttp://pastebin.ubuntu.com/5728220/ is the zope.sendmail diff04:05
wgrantPreviously every LP process would have to wait 3s for that thread to shutdown04:06
wgrantThat's why everything takes so long to finish04:06
StevenKCome ON firefox04:28
wgrantSo yeah, 11.6s to 3.6s for a script run04:28
wgrantI mostly want this for less awful test times04:29
wgrantlibrarian start times, subprocess startup/teardown times04:29
StevenKHmmm04:29
StevenK'Waiting for launchpad.net'04:29
StevenKwgrant: Is the blob ticket secret?04:29
wgrantStevenK: What do you mean?04:30
wgrantThere's no way to look up the blob from the outside without it04:30
wgrantAnd you can only get it from the response to a POST to +storeblob04:30
StevenKwgrant: Your ticket is "2f66004a-cc06-11e2-a37c-002481e7f48a"04:30
StevenKFrom a chroot upload04:30
wgrantSo it worked?04:30
StevenKYeah, it just took 25 minutes to upload.04:31
StevenKwgrant: Shall I repeat the test?04:31
wgrantStevenK: Might as well04:33
wgrantI wonder if the timeout is 30 minutes04:33
StevenKwgrant: Right, that works as well05:21
wgrantStevenK: Not sure how well launchpadlib exposes uploads. I'd try to work out that next.05:22
StevenKwgrant: In terms of progress or how they're exposed?05:23
StevenKIBug.addAttachment() was my plan05:23
wgrantThere's certainly no progress05:24
StevenKwgrant: Current plan is DAS.setChroot(data (exported as Bytes), sha1sum)05:25
wgrantStevenK: Why sha1sum?05:27
StevenKwgrant: Because infinity would like to be damn sure the client and server agree about a checksum before we set PocketChroot.chroot05:27
wgrantOK.05:27
StevenKHmm05:28
StevenKwgrant: Going to write a security adapter that limits to the owner of the relevant distribution main_archive, too05:29
=== tasdomas_afk is now known as tasdomas
=== tasdomas is now known as tasdomas_afk
=== tasdomas_afk is now known as tasdomas
=== alexlist` is now known as alexlist
=== wedgwood_away is now known as wedgwood
=== wedgwood is now known as Guest21017
=== wedgwood_ is now known as wedgwood
=== tasdomas is now known as tasdomas_afk
=== olli_ is now known as olli
=== dpm is now known as dpm-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!