/srv/irclogs.ubuntu.com/2010/10/29/#launchpad-dev.txt

wallyworld_rockstar: can you ping me if/when you might have a moment?00:28
lifelessrockstar: so what was up with your template00:29
LPCIBotProject devel build (166): ABORTED in 1 hr 39 min: https://hudson.wedontsleep.org/job/devel/166/00:51
LPCIBot* Launchpad Patch Queue Manager: [r=adeuring][ui=none][no-qa] New utility script,00:51
LPCIBotmassage-bug-import-xml,00:51
LPCIBotthat attempts to repair some commonly seen problems with bug import00:51
LPCIBotXML.00:51
LPCIBot* Launchpad Patch Queue Manager: [r=allenap][ui=none][bug=655242][bug=505304][bug=504126][bug=606866]00:52
LPCIBotFix OpenGPG documentation.00:52
LPCIBot* Launchpad Patch Queue Manager: [rs=me][ui=None][no-qa] Slow the rate of polling the buildd-manager00:52
LPCIBotdoes to reduce the load on the database and cesium (the00:52
LPCIBotbuildmaster host).00:52
StevenKLPCIBot: Shhh, don't tell everyone.00:52
wallyworld_thumper: quick question... ping?00:53
rockstarwallyworld_, what's up gangster?01:09
wallyworld_rockstar: can you skype?01:09
rockstarwallyworld_, I can't, actually.  :(01:13
wallyworld_ok. i just wanted to touch base about your merge queues email01:13
wallyworld_one question - while i wait for your branch to merge in to db-devel, can i merge from your lp copy and later merge from db-devel with no problems?01:14
wallyworld_that way i can start using your stuff now01:14
rockstarwallyworld_, yeah, you certainly can.01:14
rockstarwallyworld_, yeah.  deryck and I have learned some icky edge cases that don't play well with feature flags.01:14
wallyworld_anything i need to know?01:15
wallyworld_also, do turn on the merge queue feature flag, do i need to insert a record into my local db?01:15
rockstarwallyworld_, just do it the way I did it, and you should be good.01:16
wallyworld_ok. i'm also unsure what you meant by merge queue vocabulary and the comments around that01:16
wallyworld_actuallt, to clarify my previous question,  i know how to wrap stuff inside a feature flag, but how do i enable that flag locally for my testing?01:18
wallyworld_inprod, there would be a db record required, no?01:18
rockstarwallyworld_, see my branch:  lp.code.browser.tests.test_branchmergequeue01:20
wallyworld_rockstar: np01:21
LPCIBotProject db-devel build (108): STILL FAILING in 3 hr 55 min: https://hudson.wedontsleep.org/job/db-devel/108/01:21
wallyworld_that is fine for unit tests, but if i want to run up a system to try out, is there a preferred way for that?01:22
rockstarwallyworld_, you don't need to worry about the vocabulary stuff.  I basically just need to be able to get a set of BranchMergeQueue items for a given criteria.  You're currently working on a solution for that.01:22
wallyworld_rockstar: yes. the only methods currently supported are visibleBy() and ownedBy() but the infrastructure is there to extend as required01:23
rockstarwallyworld_, yeah, I can extend it.01:23
wallyworld_rockstar: ok, i'll grab your branch off lp. you can grab my working copy too i guess if you need to. i'll email you a status later today01:25
rockstarwallyworld_, yeah.  It'd be great if you could get it landed though.  Pipes don't like to have merges from elsewhere.01:26
wallyworld_rockstar: ok. the main work left is the visisbleBy() and the tests and merging in your latest once it lands into db-devel01:27
rockstarwallyworld_, cool.  I've got LOTS of other things to work on, so don't feel too much pressure.01:28
rockstarwallyworld_, I'm going to be busy all weekend.01:28
wallyworld_ok. np. thanks.01:28
thumperhey01:43
wallyworld_straw01:44
thumperI've made it to the shared work space01:44
thumpervery interesting01:44
thumperand free for where I'm at :-)01:44
wallyworld_so now everyone else there has to put up with you too and not just us :-)01:44
thumperheh, yeah01:46
rockstarthumper, cool.  I'm interested to see what your experience with it is.01:47
thumperrockstar: sure01:47
thumperrockstar: how's UDS going for you?01:47
rockstarthumper, I'm REALLY tired.  :)01:47
thumperheh, not surprised01:47
rockstarderyck and I are watching football and spending a quiet evening in.01:47
thumper:)01:47
* thumper needs to focus on actually doing something :)01:48
lifelessrockstar: hey02:39
lifelessrockstar: so what was up with the request.features thing the other day02:39
rockstarlifeless, complications in using page fragments.02:40
rockstarIt seems that in some cases, page fragments result in entirely separate request objects than the original request, even though it's technically in the same request.02:40
rockstarI think page fragments are a potential performance problem.02:41
rockstarMaybe not the biggest performance problem, but something we may need to evaluate.02:41
rockstarThat's why we would get those separate "requests" halfway through a pdb of a page: it was getting another page fragment.02:42
lifelessyeah, they've been on my radar already.02:42
lifelesshowever why weren't the request *objects* getting a start_request event ?02:42
rockstarlifeless, I think it's because it wasn't an actual request, but a page fragment.02:43
rockstarThey'd technically already had a start_request event.02:43
rockstarWhen you left, we were checking for "features" in self.__dict__ when we should have been checking for "_features" in that pdb setup we made.02:44
rockstarWhen I fixed that, I found that we weren't ever getting without setting.02:45
rockstarAlthough the request object did some funky things.02:45
lifelessso, you've a work around ?02:45
rockstarlifeless, no, the actual issue was another type poolie found.02:46
rockstarI was missing a semicolon in my tal:define.02:47
rockstarlifeless, so I got it to work when I defined features correctly.02:47
rockstarlifeless, the pdb quest was very eye opening though.02:47
lifeless-ah02:47
lifelesscoolio02:47
rockstarThe branch index page traverses zcml at LEAST 8 times...02:48
lifelessyeah02:48
lifelesswe have a lot of inefficiencies02:48
lifelesswhat we need to do, once we have the coarse performance headaches out of the way02:48
lifelessis to start streamlining the stack,02:48
thumperrockstar: what do you mean traverses zcml at least 8 times?02:53
rockstarthumper, every time we go get a page fragment, we have to look it up in zcml.02:54
thumperrockstar: you mean humans? or machines?02:54
thumperrockstar: because the machine doesn't touch the zcml02:54
thumperrockstar: it is parsed once02:54
rockstarthumper, for context, lifeless and I went on a pdb adventure yesterday trying to sort out a feature flag problem.02:54
rockstarthumper, yeah, but it's stored in an object tree, which gets traversed.02:55
wgrantSurely the adapter lookup doesn't suck too much, though...02:57
thumperI thought that was pretty much optimized at the zope level02:57
lifelessthumper: its about 40 function calls to do a notify()02:58
lifelessmake no assumptions02:58
thumperheh02:58
thumper40?02:58
thumperhmm..02:58
rockstarthumper, easily 40.02:58
thumperthat's kinda shit02:58
lifelessconservative02:58
lifelesstheres a profound degree of indirection in the zope core02:58
lifelesssome bits are highly tuned02:58
rockstarlifeless, yeah, stepping through a whole request life was VERY eye opening for me.02:59
lifelessbut not all, not by any stretch02:59
lifelessrockstar: ;)02:59
rockstarlifeless, kapil also said he made a really good debug WSGI middleware that gets good SQL tracing and such.03:03
lifelesssadly we really don't have a wsgi stack03:03
lifelesswe're glued on the end03:03
lifelessOTOH we have damn awesome sql tracing already03:03
* wgrant likes the Django Debug Toolbar.03:04
rockstarwgrant, I have tried to duplicate that since day 1 at Canonical.03:04
lifelessweb debugger?03:05
wgrant(It hooks into WSGI in a couple of places, adding a toolbar on the right of every page which lets you easily see template contexts, seeing SQL statements and running EXPLAINs and all sorts of other awesome stuff.)03:05
lifelessshould be broadly straight forward.03:05
rockstarlifeless, no, just adds some HTML with information about query times and templates used and performance times.03:05
lifelessrockstar: oh, just make the comment at the bottom visible via a feature flag.03:05
rockstarlifeless, we're not using a WSGI stack?  I thought gary said we were.03:05
lifelessI've been meaning to do it, but after edge going03:06
wgrantrockstar: FSVO stack.03:06
rockstarlifeless, no, you'd never enable this on production.  It'd be a devserver thing.03:06
lifelessrockstar: we're 95% custom publication code incompatible with wsgi03:06
rockstarwgrant, FSVO?03:06
wgrantFor Some Values Of03:06
lifelessrockstar: oh, we have a bunch of stuff that I'd be fine showing to you on prod.03:06
lifelessyou could expand it for lp.dev03:07
rockstarlifeless, yeah, but the query middleware makes things pretty slow.03:07
wgrantAIUI it's not so much a WSGI stack as some Zopeish Launchpaddery with a WSGI frontend glued on.03:07
lifelessright03:07
rockstarwgrant, yeah, that's what I was assuming, but I guess I assumed there was more WSGI-ish stuff than what's there.03:08
wgrantIs crowberry still unwell?03:10
StevenKThis remains to be seen03:10
StevenKwgrant: Why? Do you have an issue?03:11
lifeless    Hard / Soft  Page ID03:11
lifeless     283 /   17  Archive:EntryResource:getBuildSummariesForSourceIds03:11
lifeless     180 /   30  Person:+commentedbugs03:11
lifeless     140 /  203  CodeImportSchedulerApplication:CodeImportSchedulerAPI03:11
lifeless     100 /  251  BugTask:+index03:11
lifeless      98 /    3  MailingListApplication:MailingListAPIView03:11
lifeless      69 /  270  Distribution:+bugs03:11
lifeless      16 /    0  Sprint:+temp-meeting-export03:11
lifeless      13 / 1018  Archive:+index03:11
lifeless      13 /   44  Archive:+packages03:11
wgrantStevenK: Just wondering about the frequent downtime lately.03:11
lifeless      13 /    1  ProjectGroup:+milestones03:11
wgrantlifeless: That top one is a bit odd.03:12
StevenKwgrant: We are clearly only trying to make you think there is an issue.03:12
=== Ursinha is now known as Ursula
* rockstar shuts laptop and concentrates on football03:14
lifelesswgrant: whats odd aboot it ?03:17
wgrantlifeless: I don't recall seeing that one high up before.03:19
wgrantBut I may be wrong.03:19
lifelesshttps://bugs.edge.launchpad.net/soyuz/+bug/66252303:20
lifelesswgrant: I've been nagging you to stab it for weeks03:20
wgrantHmm.03:20
lifelesswell03:20
lifeless11 days :P03:20
wgrantStevenK: Has there been any discussion at UDS about deleting partner?03:21
lifelesssome03:21
StevenKwgrant: Indeed. We have a plan. It will just take 4 years.03:21
wgrantStevenK: ie. until Lucid EOL?03:21
StevenKYes03:21
wgrantCan't we just repurpose commercial-compat to rebrand a PPA as partner?03:22
* StevenK shrugs03:22
wgrantThen terminate ArchivePurpose 4 with extreme prejudice?03:22
StevenKwgrant: Does this mean you have a branch that removes every bit of ArchivePurpose.PARTNER and you're looking for an excuse to land it?03:23
wgrantStevenK: No.03:23
StevenKPity.03:23
wgrantUnlike lucilleconfig.03:23
StevenKHas that all trickled through?03:25
* thumper cries quietly while looking at blueprint code03:25
mwhudsonthumper: i wonder if you look at the code every week, say, it gets less surprising how awful it is03:26
thumpermwhudson: I'm betting not03:26
mwhudson(i doubt it, the brain doesn't remember pain)03:26
thumpermwhudson: as part of my blueprint work I have a herd of yaks to shave03:26
StevenKWhich particular herd is it?03:26
mwhudsoni suppose if you spend an hour improving it each week, eventually it will be ok03:27
mwhudsonin like 150 weeks03:27
StevenKWhich is 3 years03:27
mwhudsonyeah, sounds optimistic03:27
StevenKOptimistic at best. A nightmare at worst.03:28
StevenKthumper: Put the rope down.03:28
* thumper might start soonish with the shaving03:28
* thumper shakes the shaving foam can03:28
thumperis it worthwhile renaming Specification to Blueprint?03:29
wgrantthumper: It's been through three names already... leave the poor creature alone.03:30
lifelessthat would confuse people03:30
thumperwhat, renaming it?03:31
thumperwgrant: three names?03:31
wallyworld_thumper: what's the heritage of the blueprint code> why is it so bad?03:31
wallyworld_s/>/?03:32
thumperwallyworld_: that is a long story03:32
thumperperhaps we can talk about it on Monday03:32
wgrantthumper: Features, Blueprints, Specifications.03:33
wallyworld_ok. sounds like something best discussed with a case of red at close hand03:33
wgrantBut it was renamed to Blueprints long before most people here appeared.03:33
thumperthe word Specification is only mentioned 2699 times in the code03:33
thumpersimple find and replace :)03:33
wgrantHeh.03:33
StevenKWas there a Feature to rename Features to Blueprints?03:33
thumperStevenK: no, it would have been Feature to Specification03:34
thumperand Specs to Blueprints03:34
wgrantI think it was originally specification.03:34
thumperthe UI changed, but not the code03:34
wgrantThen to feature, then specification, the blueprint.03:34
wgrantBut that first transition may be wrong.03:34
StevenKWe changed it *back*?03:34
thumperI just find it a tad annoying in the code03:34
thumperand 100 files would need to be renamed03:36
thumperbut that is a small price to pay I think for some form of consistency03:37
StevenKAnd a 17,000 line diff03:37
thumpersure, whatever03:37
thumperas long as it doesn't conflict :-)03:38
StevenK... more than 3 times03:38
wgrantI'd be against the rename. Most other objects in Launchpad now have sane names.03:38
wgrantSpecification -> Blueprint is the opposite of sane.03:38
StevenKThe URL is blueprints.l.n03:39
wgrantIt is.03:39
wallyworld_i've never used the term Blueprint wrt software. for me, it's always been a Specification Document03:39
wgrantBut most people call them specs.03:39
wallyworld_blueprint are something use use to build a !$%@$ house03:39
wgrantHeh.03:39
StevenKSo now they're blues?03:39
mwhudsoni just try to alternate03:39
StevenKAs in, we have them?03:39
StevenKwallyworld_: No, blueprints are used for a *bikeshed*03:40
wallyworld_:-D03:40
wallyworld_so my vote would be to use the industry accepted term, namely Specifications03:41
wallyworld_why reinvent terms that are in common usage?03:41
wgrantBecause five years ago it was cool.03:41
wgrantOr something.03:41
StevenKwgrant is just bitter because five years ago he was eight.03:41
wallyworld_how could calling something a non-standard term that no-one else uses in that context have been considered cool?03:42
wallyworld_ever?03:42
wgrantwallyworld_: Don't ever go back before r3000 or so.03:42
* thumper snorts03:42
wallyworld_what's lurking there? anything interesting?03:43
thumperFAAARRRRKKKK!03:44
thumperbuildbot is all read03:44
thumperor red even03:44
wallyworld_maybe it's feeling Blue :-)03:45
thumper   lp.registry.windmill.tests.test_distroseriesdifference_expander.TestDistroSeriesDifferenceExtraJS.test_diff_extra_details_blacklisting03:45
thumper   lp.registry.windmill.tests.test_product.TestProductIndexPage.test_title_inline_edit03:45
thumperthat's devel03:45
rockstarthumper, yes, rs=me on deleting all windmill tests03:45
rockstar:)03:46
wgrantwallyworld_: Names were a fair bit less sane back then.03:46
thumperdb-devel: test_uploading_collection (lp.soyuz.tests.test_binarypackagebuildbehavior.TestBinaryBuildPackageBehaviorBuildCollection)03:46
lifelessrockstar: beep, denied.03:46
wallyworld_thumper: you saying those tests are failing?03:46
thumperwallyworld_: failed on buildbot03:46
wallyworld_what's the error?03:46
thumperwallyworld_: did you want to take a look?03:46
lifelessthumper: in terms of names, I think we should do serious user research before doing another rename.03:47
thumperlifeless: ack03:47
rockstarlifeless, I've said this before, but I think their cost outweighs their value.03:47
wgrant*cough* Branches *cough*03:47
wallyworld_thumper: tell me where to look - do i log into devpad to see the logs?03:47
thumperlifeless: there is enough other yaks to shave in blueprints03:47
lifelessthumper: exactly.03:47
thumperwallyworld_: https://lpbuildbot.canonical.com/waterfall - click on summary03:47
rockstarBlueprints mean something very valuable to the core users of blueprints: Ubuntu.03:48
rockstarAlso, of the three things I've sent to ec2 and the two that deryck sent to ec2 today, we have no emails to show for it.  :(03:51
StevenKrockstar: I tossed two branches at ec2 and got 2 mails03:52
rockstarStevenK, lucky you.03:53
wallyworld_rockstar: i've had stuff go missing lately too :-(03:53
rockstarStevenK, still, 2 for 7 isn't great.03:53
StevenKrockstar: Better than 0 for 5 :-P03:53
rockstarwallyworld_, yeah, it really affects my productivity, because now I have to go back and babysit.03:53
rockstarStevenK, not for me it isn't!  :)03:54
StevenKWe should get out of testfix first, though03:54
wallyworld_rockstar: i hear you. i've lost a lot of time as well, also chasing down "failures" which weren't03:54
wgrantStevenK: Better than 0 for 9 :(03:54
StevenKThe last time it happened to me, there was a bug which I had introduced which was killing stuff03:55
rockstarOne of these branches has support for soupmatchers, which I want to use everywhere, so it'd be nice it that landed...03:55
rockstarStevenK, so, there's some layer teardown stuff that's causing hangs in windmill.  deryck and I finally reproduced it locally with my lazr-js branch.03:56
wgrantAh, excellent news.03:57
wallyworld_thumper: well, there's no dog's ball anywhere that i can see. and the code in question hasn't changed recently03:58
lifelessrockstar: interesting03:59
lifelessrockstar: tried with trunk? landed a layer teardown change today03:59
thumperwallyworld_: does it pass locally for you?03:59
wallyworld_trying now, updating as we speak03:59
wallyworld_s/updating/building04:00
wallyworld_have to stop my other db-devel system first and switch schemas @#@^^!$@04:00
lifelessthumper: hey, could you perhaps https://code.edge.launchpad.net/~lifeless/launchpad/edge/+merge/39594 ?04:02
thumperlifeless: there seems to be some waste there04:04
* thumper comments04:04
lifelessoh?04:05
lifelessthanks04:05
rockstarlifeless, well, ec2 merges into trunk, right?04:05
lifelessrockstar: yes, but it would depend on the revno at the time you started ec204:05
thumperlifeless: done04:06
lifelessthumper: thanks04:07
rockstarlifeless, yeah.  I'm sending them back to ec2.04:07
rockstarlifeless, also, it seems that ec2 is still running postgres 8.304:07
lifeless /o\04:07
lifelessthumper: >< our coding standards make your change _longer_04:08
thumper:)04:09
* lifeless ignores the nuts wrapping rules and just does the bzr way.04:09
lifelesshmm, I've added another 80 lines of budget :)04:10
wallyworld_thumper: apart from a LayerIsolationError, WFM04:13
thumperhmm...04:13
thumperwondering if we should just force a build to see if it works this time04:13
wallyworld_that would be my plan of attach. at least the problem will be deffered for a little while :-)04:13
wallyworld_i gotta learn to type better04:14
thumperI've forced devel04:16
wallyworld_let's hope it works04:16
thumperwondering about the db-devel failure though04:16
* wallyworld_ looks04:17
wallyworld_something just doesn't look right with that build server. those errors don't appear coding issues do they04:18
jtvHow can I have a webservice method that I can invoke in a stories test but not with launchpadlib against launchpad.dev?04:19
jtvI thought the one implied the other.04:21
lifelessnight all04:22
wgrantjtv: Are you using launchpadlib in your test?04:23
jtvno, webservice04:23
wgrantYour WADL is out of date.04:23
wgrantmake build04:23
jtv!04:23
* jtv tries that04:24
jtvwgrant: then again, I don't see the method on staging or qastaging either, and the revision's been on there for a while now.04:24
wgrantjtv: You're not checking a frozen version of the webservice?04:25
jtvwgrant: I tried version='devel'04:25
wgrantWhich method?04:25
jtvIHasTranslationImports.getTranslationImportQueueEntries04:26
jtvTested in lib/lp/translations/stories/webservice/xx-translationimportqueue.txt04:27
LPCIBotYippie, build fixed!04:28
LPCIBotProject devel build (167): FIXED in 3 hr 36 min: https://hudson.wedontsleep.org/job/devel/167/04:28
LPCIBotLaunchpad Patch Queue Manager: [r=thumper][ui=none][bug=662552] Re-use POFile edit permission info04:28
LPCIBotacross message sub-views.04:28
jtvwgrant: what I don't get is how that test can pass, yet I can't get at that method using launchpadlib interactively.  I haven't played with launchpadlib much so maybe I'm just doing something wrong there.04:35
wgrantjtv: Old-style webservice tests do not use WADL.04:38
wgrantSo they don't care how broken it is.04:38
jtvwgrant: so I neglected to update the wadl?04:38
wgrantjtv: It's meant to be autogenerated.04:39
jtvgrrr04:39
jtvBut surely there is a way of getting our methods into the API, or else why do we have any04:39
wgrantIt is in the WADL, though.04:39
wgrantOr in my WADL, at least.04:39
wgrantAnd in my apidoc.04:39
jtvSo maybe I'm just doing something stupid.04:40
wgrantWhen did it land?04:40
wgrantIs it deployed?04:40
jtvDays ago.  It should be on staging.04:40
jtvHere's what I do locally:04:40
jtvl=Launchpad.get_token_and_login('gaga', service_root='https://api.launchpad.dev/', version='devel')04:41
jtv(Authorize in browser)04:41
wgrantjtv: It's on qastaging's apidoc.04:41
jtvl.me.getTranslationImportQueueEntries()04:41
jtvAttributeError: 'Entry' object has no attribute 'getTranslationImportQueueEntries'04:41
wgrantjtv:04:41
wgrantgrep -r getTranslationImportQueueEntries lib/canonical/launchpad/apidoc/04:41
jtvNothing.04:42
wgrantDoes 'make apidoc' take forever and say it's generating stuff for all three versions?04:43
jtvI haven't tried that.04:44
jtv(Didn't know it existed)04:44
wgrantbuild depends04:44
wgrant... on it04:44
jtvWell, "make build" does take forever now, after a "make clean."04:44
wgrantBut that's probably buildout automatically sacrificing various items of wildlife that if finds around you.04:45
wgrantNot the WADL generation.04:45
jtvwgrant: it's building that now04:45
wgrantAha.04:45
jtvAnd now my wadl shows the method.  Wonder why "make build" didn't do that before.04:47
jtvAre these files under revision control?04:47
wgrantThey're not.04:47
wgrantBut this may change soon.04:48
wgrantThey take forever to generate.04:48
jtvAh, I did this in an old branch.04:48
wgrantSo 'make build' probably won't regenerate them every time.04:48
jtvI guess the dependencies aren't complete.04:48
wgrantOr make run would take even longer than it does already.04:48
wgrants/aren't/can't be without taking 15 minutes to start an appserver/04:48
wgrantAnyway, hopefully that will all work.04:50
wgrantI need to run off and submit my final project.04:50
jtvwgrant: thanks as always!04:50
jtvFinal… university project?04:50
wgrantThat's the one.04:50
* thumper closes up.04:51
jtvwgrant: good luck—ace it like I did.  :-)04:51
jtvbye thumper04:51
wgrantHeh. Thanks.04:51
wgrantNight thumper.04:51
wallyworld_thumper: quick quest before you go04:51
wallyworld_======================================================================04:51
wallyworld_ERROR: lp.codehosting.vfs.tests.test_transport.TestLaunchpadTransportImplementation.test_win32_abspath (subunit.RemotedTestCase)04:51
wallyworld_----------------------------------------------------------------------04:51
wallyworld__StringException: Text attachment: garbage04:51
wallyworld_------------04:51
wallyworld_[<bzrlib.smart.medium.SmartTCPClientMedium object at 0xc109810>]04:51
wallyworld_does that mean there's something screwed on ec2 wrt code hosting or something04:52
wallyworld_an ec2 test run just failed with 1000 odd errors all like this04:52
thumper?05:03
thumperwallyworld_: ah....05:05
thumpernot seen that before05:05
thumpersounds like something screwy05:06
wallyworld_thumper: no matter. looks like there's something environmental going on05:06
* thumper nods and leaves05:06
wallyworld_i'll resubmit later. not having much luck with ec2 lately :-( have a good w/e05:06
spivlosa fyi: I'm trying to reproduce a bzr/codehosting bug, and I think I may have caused a python process to spin in an infinite loop on codehosting.05:42
spmimpressive05:42
spivspm: if you're not too busy, I'd be quite curious to know if I really have done that...05:43
jtvIs anyone here on first-name terms with the webservice API?06:51
wgrantWhat has it done to you now?06:51
jtvWell my method is documented now06:53
wgrant!!06:53
jtvI mean, it's in the wadl and apidoc now,06:53
jtv_but_06:54
jtvit doesn't appear on the objects that implement it and the interface it's in.06:54
jtvInstead, it appears in a separate API class named after the interface.06:54
jtvWhich I suppose means that, instead of making objects implement the interface, I need to derive the objects' interfaces from my interface.06:55
wgrantThat's right.06:55
jtvPretty unfashionable strong static typing, that.06:55
wgrantIt is unfortunate, but fortunately not difficult.06:56
jtvUnless it goes against the direction of all other dependencies and so is likely to introduce massive amounts of circular imports.06:58
wgrantWell, true.06:58
jtvAnd guess what?  That appears to be the case.  :)06:59
wgrant:D06:59
shadeslayerany ideas if my qtwebkit build was fixed?07:22
adeuringgood morning08:44
mrevellHello09:04
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
=== matsubara-afk is now known as matsubara
=== mrevell is now known as mrevell-lunch
lifelessmwhudson: does anything outside the dc know about guava ?13:06
=== mrevell-lunch is now known as mrevell
=== almaisan-away is now known as al-maisan
jmlhello13:57
mwhudsonlifeless: no14:18
lifelessmthaddon: ^14:18
mthaddonI'm going to assume a whole lot of context there and merge that config change14:19
lifelessmthaddon: there is an rt for getting a view on haproxy; should we add to that a note to get view on this new haproxy ?14:19
mthaddonthat'd probably make sense, yeah14:20
mwhudsonlifeless: although guava is in the dmz for historically daft reasons, so it can't connect to dc machines quite as one would expect14:25
mwhudson(don't know if this is important here)14:25
lifelessmwhudson: I don't think it is14:25
lifelessmwhudson: story is - we're haproxying up codebrowse for no-downtime deploys.14:26
mwhudsonmtaylor: the launchpad/bazaar session has just been moved later, hope that's ok with you14:26
lifelessmwhudson: so we just want to make sure nothing is left using the un-haproxy urls14:26
mwhudsonlifeless: yeah, all real traffic goes via crowberry14:28
mrevelladeuring, Do you have a moment? I have a question about bug pages14:43
adeuringmrevell: sure14:44
mrevellthanks adeuring. I'm working on bug 117460 and I need to add a help link next to "Also affects project" on bug pages. Looking at bug.py I thought I should ask some advice before diving in. Do you have a suggestion for how to do it?14:45
_mup_Bug #117460: "Also affects project" doesn't provide any instructions <better-forwarding> <trivial> <ui> <Launchpad Documentation:Invalid> <Launchpad Bugs:Triaged by matthew.revell> <https://launchpad.net/bugs/117460>14:45
* adeuring is reading the bug repoert14:46
mrevelladeuring, It's quite an involved bug report and some of it has been split off into other reports and those solved separately. I'm going to deal with the "people don't understand what 'also affects project' means" aspect.14:48
adeuringmrevell: right... difficult task ;) shall we talk on mumble about it?14:49
mrevelladeuring, Sure!14:49
mrevelladeuring, You don't hear me?14:50
adeuringmrevell: no, i don't. also, mumble does seems to notice that you are speaking14:50
mrevellLet me check the mic isn't muted14:51
adeuringmrevell: so, the links (actually there are two: "add project" and "add distribution") are defined as objects of class Link in lp.bugs.browser.bug ; they are rendered in lp/bugs/templates/bugtasks-and-nominations-table.pt . That is the template where you can add the "help magic", I think.15:11
rockstarOoh! I think deryck and I have figured out why ec2 instances aren't sending out email.15:15
mrevellThanks adeuring, I shall give that a try!15:15
rockstarmars, ^^15:16
marsrockstar, eh?15:17
rockstarmars, we shutdown automatically after 5 hours, right?  We're 20 minutes into that 5 hours before the tests even start running.  If our tests have any reason to take 4.5 hours (buildbot says 4.4 right now), it shuts down before the tests are done.15:18
rockstarSo any heavy I/O would slow the test suite down, etc.15:18
marsrockstar, ugh, yes, great hypothesis.  "5 hours will be enough"  ("No one will ever need more that 640K of memory")15:19
rockstarmars, if the layer tearDown stuff was really an issue, abentley would be saying something about it.15:19
rockstarmars, but he doesn't have to worry about time limits when he runs his tests.  They're done when they're done.15:20
marsrockstar, darn test run time - do we graph that I wonder?15:20
marsrockstar, it used to be ~3 hours15:20
rockstarmars, deryck and I are cumulatively 0 for 8 on ec2 runs.15:20
marsthat is why we set a 5 hour limit15:20
rockstarmars, it USED to be ~2 hours, 3 years ago.  :)15:20
lifelessup it ;)15:20
mars8(15:20
lifelesswe're working on test perf now15:21
rockstarlifeless, yeah, I'm bumping the timeout on a single run.15:21
abentleyrockstar: I don't use test_on_merge because it times out.  Instead I run bin/test, which runs as long as it takes to finish.15:21
marsrockstar, I think we should up the limit anyway15:21
marsI'll land the branch. rs=lifeless?15:21
rockstarabentley, I'm not sure if ec2 runs on test_on_merge specifically, but even if it didn't time out, ec2 shuts down after 300 minutes.15:21
rockstarmars, rs=rockstar15:21
lifelessmwhudson: yes15:22
lifelessbah15:22
lifelessmars: yes15:22
StevenKmars: We're in testfix15:22
* rockstar facepalms15:22
abentleyrockstar: So, I know test_on_merge dies due to timeouts, but it's a different timeout.  It's a "minutes without output" timeout.15:23
rockstarabentley, yeah, so in ec2, we could be getting output, but the test suite could be taking longer than the ~260 minutes we allot it.15:23
abentleyrockstar: indeed.  Now what's this layer teardown thing?15:24
rockstarabentley, deryck and I reproduced an issue with windmill where it fails to teardown a layer and then just stops dead right then.15:24
abentleyrockstar: Ah.  Not a problem I recall.15:25
rockstarabentley, yeah, I suspect it has a lot to do with windmill's asshattery.15:26
lifelessrockstar: interesting15:27
lifelessrockstar: how do you trigger that ?15:27
rockstarlifeless, I thought deryck sent to output to the list.15:27
lifelessI'm behind on mail just now15:27
rockstarlifeless, he says he didn't send a mail, because he just disabled the test because it was failing spuriously anyway.15:28
rockstarlifeless, bin/test --layer WindmillLayer15:28
lifelessrockstar: did he file a bug? We need to treat our test environment as rigorously as we do our target code15:28
rockstarlifeless, he didn't at the time, but I just asked him to.15:29
lifeless\o/15:29
rockstarlifeless, to be fair, we've been trying to get a new lazr-js landed in launchpad for more than a month now.  We're trying to get it done by hook or by crook.15:30
lifelessrockstar: I'm fine with that15:30
lifelessas long as we record interesting things like such problems as you've encountered.15:30
marsrockstar, would that be the spurious failure Ian said he fixed?15:33
rockstarmars, no idea.  We're getting all manner of spurious failures.15:34
marsrockstar, I ask because I wonder if the test was re-enabled15:34
rockstarmars, I don't think so, since this branch is pretty old.  Of course, we merged regularly, but there's lots of stuff that windmill does stupidl.15:36
StevenKmars: bigjools is landing a testfix15:36
marsStevenK, ok, thanks15:36
* bigjools is literally just landing it15:36
marslifeless, so this is an rs= fix, your new proceedure says I need an MP for it as well?15:37
lifelessmars: my process experiment is for you if you do r=mars15:37
lifelessmars: rs=otherperson is an existing defined process that I didn't touch15:37
marsright15:37
marsrs= is 'land this and skip the MP'15:38
lifelesswe could, if the experiment is successful, further iterate and combine these things15:38
StevenKlifeless: r=trivial will continue to be verbotten?15:38
rockstarmars, for instance, in a test, windmill has recently decided that even though a link is green and has a javascript event connected to it, it would rather just click through.15:39
lifelessStevenK: yes15:39
lifeless'trivia' is not a very useful metric IMO15:39
StevenKlifeless: Okay, good15:39
marsrockstar, timing issue?15:39
rockstarmars, no, not a timing issue, just a bug of some sort.15:39
rockstarmars, something is quite obviously broken in windmill.15:39
marsrockstar, if you can narrow it down, we can take it to #windmill directly15:40
marsthey would really want to know about that15:40
marsrockstar, I assume it was the 1.4 upgrade15:40
rockstarmars, probably, but I'd rather invest no more time in windmill at all.15:40
marsrockstar, show me an alternative that takes less time than fixing what we have, and I'll go for it :)15:40
rockstarmars, I keep meaning to write to the mailing list about this.  :)15:41
marsoh, and that doesn't lose any of the benefits that windmill gives us15:41
rockstarmars, right now, windmill isn't really giving us many benefits.15:41
mars(notice that I did not say what the benefits /are/)15:41
lifelesswho knows how to get to the staging outbound mailbox ?15:41
marslifeless, deryck and team might?15:41
bigjoolsmy fix is in PQM15:42
marsbigjools, ok, thanks for letting me know15:42
lifelessI will hunt deryck15:44
rockstarlifeless, deryck says bigjools has the credentials in an encrypted text file somewhere and can get to it easier than he can.15:50
bigjoolsque?15:50
=== brianchidester_ is now known as brianchidester
=== matsubara is now known as matsubara-lunch
marsbigjools, lifeless wants to access the staging outbound mailbox15:51
bigjoolsmars: ok, I have it15:54
bigjoolskwallet FTW15:55
flacostelifeless: i found ftp://ftp.cs.wpi.edu/pub/techreports/pdf/06-17.pdf16:08
flacosteit describes a space-efficient way to compute an approximation of the median16:08
flacosteworks on streaming data16:08
flacosteshould be fine for us16:09
flacostelifeless: another simpler approach would be to estimate the median using the frequency table16:12
lifelessflacoste: both sound reasonable to me16:13
lifelessand incremental16:13
lifelesswe should be able to do what we want without a DB16:13
lifelesshttps://bugs.staging.launchpad.net/bzr/+bug/64485516:15
_mup_Bug #644855: TestVersion.test_main_version fails run from installed package <easy> <selftest> <Bazaar:Fix Released by vila> <Bazaar 2.2:Fix Released by vila> <Bazaar 2.3:Fix Released by vila> <https://launchpad.net/bugs/644855>16:15
lifelesshttps://staging.launchpad.net/bzr/+milestone/2.2.2/+subscribe16:15
lifelessflacoste: ping16:21
flacostehi lifeless16:21
lifelesscalling you16:21
flacostelifeless: try again?16:22
lifelesson skype... goes to voicemail16:22
flacostehmm16:22
flacosteyeah, same thing if i try to call you16:23
flacoste:-/16:23
flacostelet me restart skype16:23
marsbigjools, did your testfix go through?  Mine bounced on the testfix regex16:24
flacostelifeless: restarted16:24
flacostepfff16:24
flacosteit does ring here16:24
lifelessring me ?16:24
bigjoolsmars: it's in devel16:30
marsbigjools, ok, testfix didn't clear - I thought it would have16:30
bigjoolsme too :/16:30
StevenKI think the poller needs to run to do so16:31
StevenKAnd that will only do so after buildbot builds devel16:31
marsStevenK, gary says the poller runs every 5-10 minutes?16:32
StevenKYes, but I think the last devel build in buildbot needs to be sucessful16:32
* mars opts for empirical evidence16:33
marspqm-submit - play it again!16:33
StevenKlp-land FTW16:34
abentleylifeless: will landing on stable update the cron scripts for qa-staging?16:45
lifelessmm, ask mthaddon / chex16:45
abentleymthaddon, chex: will landing on stable update the cron scripts for qa-staging?16:53
=== matsubara-lunch is now known as matsubara
Chexabentley: are you talking about the /cronscripts/ directory in the root of the LP branch?17:03
lifelessbigjools: hw did you go?17:04
abentleyChex: I'm asking about the behaviour of the whole system.  I haven't actually changed files in that directory, but I've changed files elsewhere that will change their behaviour.  Will I get the updated behaviour on qa-staging the way I would with staging?17:05
bigjoolslifeless: badly, still trying to get staging's inbox to load17:06
lifelessbigjools: :(17:08
poolie_droidjml: do we have any launchpad stickers here?17:08
jmlpoolie_droid: no, we don't.17:08
poolie_droidoh well17:08
poolie_droidvikram was admiring mine17:09
shadeslayerpoolie_droid: bug 66840717:09
_mup_Bug #668407: daily builds hang at pulling qtwebkit <Launchpad Bazaar Integration:New> <https://launchpad.net/bugs/668407>17:09
lifelessI forgot my roll... sorry17:09
Chexabentley: yes you should get the same behaviour that you would on staging with changes17:10
abentleyChex: I know that asuka is the equivalent of loganberry for staging, but what's the equivalent for qa-staging?  Is there a diagram?17:11
abentleyrockstar: I just got a windmill hang.17:13
Chexabentley: staging and qastaging are both like loganberry, the difference being qastaging is using a current copy of prod DB schema17:17
rockstarabentley, ugh.17:17
rockstarabentley, what kind of hang?17:18
abentleyChex: what machine is running the cron scripts for qastaging that loganberry runs for production?17:18
Chexabentley: asuka17:18
abentleyrockstar: The kind where it hangs.17:18
abentleyChex: asuka is handling both staging and qastaging?17:18
rockstarabentley, no traceback or anything?17:19
abentleyrockstar: no, that would be a crash.17:19
abentleyrockstar: It started running, and it never stopped, and it didn't appear to be making progress, and I waited about an hour.17:20
Chexabentley: thats correct17:20
rockstarabentley, yeah, so the one we saw was where it trackbacked in tearing down a layer, and then it just stopping tearing down the rest of the layers.17:20
abentleyrockstar: This was the whole output until I pressed CTRL-C.17:22
abentleyrockstar: http://pastebin.ubuntu.com/522177/17:22
abentleyrockstar: This is the output after I pressed CTRL-C: http://pastebin.ubuntu.com/522178/17:23
lifelessabentley: we haven't enabled all cronscripts on qastaging because of load; if there's one you want to have execute work to do QA, ask a losa to run it (however many times you need)17:25
abentleylifeless: it seems like landing on db-staging would be much simpler.17:26
abentleylifeless: s/db-staging/db-stable/17:27
lifelessabentley: we're going to have to do a similar thing for staging too - the load on asuka is just nuts.17:27
lifelessabentley: or we may find a machine to do scripts on and move staging *and* qastaging scripts to that17:27
abentleylifeless: up till now, we've relied on staging as a place we can test script changes.  It would be a significant loss if we were forced to use losas for our script testing.17:29
lifelessabentley: yes, the current setup is undesirable, see bug ...17:30
lifelesshttps://bugs.edge.launchpad.net/launchpad-foundations/+bug/63371317:30
_mup_Bug #633713: staging is overloaded <Launchpad Foundations:Triaged by canonical-losas> <https://launchpad.net/bugs/633713>17:30
abentleylifeless: Please pursue that second option.  Could we use the internal UEC cloud?17:32
abentleylifeless: Also, we could perhaps significantly reduce the load with a "New Task System" that was event-driven so it wasn't constantly polling.17:33
lifelessthe polling ones aren't the problems AIUI17:35
lifelessanyhow, yes, am pursuing things17:35
abentleylifeless: if the polling ones aren't the problems, you shouldn't need to disable them, right ? ;-)17:39
lifelessabentley: it was simpler to just not turn anything on - we have /lots/ of cronscripts.17:40
=== al-maisan is now known as almaisan-away
lifelessabentley: feel free to ask for specific ones to be enabled17:40
lifelessgary_poster: are you here today?17:40
lifelessgary_poster: I'd like to talk about that overload bug with isf/iso17:41
=== beuno is now known as beuno-lunch
=== benji is now known as benji-lunch
henningematsubara: hi!18:04
matsubarahenninge, hi18:04
henningematsubara: where does the code live that turns our script output into on oops?18:05
henningematsubara: or more specifically, can I avoid an oops by reducing a log message from "warn" to "info"?18:06
henningematsubara: or are you the wrong guy to ask? ;-)18:06
matsubarahenninge, lib/canonical/launchpad/webapp/errorlog.py and lib/lp/services/scripts/base.py18:10
henningematsubara: thanks, I'll look into those18:11
matsubarahenninge, yes, you can avoid an oops by reducing the log message to info only. See https://bugs.launchpad.net/malone/+bug/661441 where Robert suggest that approach to silence some checkwatches oopses.18:14
_mup_Bug #661441: Duplicate oops reports logged for each checkwatches oops <oops> <Launchpad Bugs:Triaged> <https://launchpad.net/bugs/661441>18:14
henningematsubara: yup, it's in there. WARN and higher get turned into OOPSes.18:14
henninge:-D18:14
matsubara:-)18:14
henningematsubara: thanks18:14
matsubaranp henninge18:14
=== beuno-lunch is now known as beuno
gary_posterlifeless, here, was at lunch, 1 sec18:53
gary_posterlifeless, dunno what isf/iso is, but back18:54
=== benji-lunch is now known as benji
lifelessjml: hi20:04
jmllifeless: hello20:04
lifelesswhere are you ?20:04
lifelessbigjools: we're still blocked on that qa right20:04
lifeless?20:05
StevenKjml: O hai, can haz mentor review for https://code.edge.launchpad.net/~henninge/launchpad/devel-bug-666660-poimport-oops/+merge/3965320:05
jmllifeless: curucao 420:06
jmlStevenK: granted20:06
henningejml: thanks!20:07
bigjoolslifeless: yes, I am unable to view the staging inbox20:11
jmllifeless: do you not care?20:19
=== mtaylor_ is now known as mtaylor
LPCIBotProject devel build (168): SUCCESS in 3 hr 58 min: https://hudson.wedontsleep.org/job/devel/168/20:24
lifelessjml: I care a lot20:24
lifelessjml: I need to talk to you :)20:24
lifelessbigjools: what were the details again ?20:24
lifelesslike20:24
lifelessnot the password20:24
lifelessthe other stuff20:24
bigjoolslifeless: ->ops20:25
gary_posterlifeless: was @ lunch; appear to have replied when you were offline.  here now.  dunno what isf/iso is20:25
lifelessgary_poster: is foundations/ops20:31
gary_posterah!20:31
gary_posterok20:31
lifelessgary_poster: I cc'd you on mail instead20:33
gary_posteroh20:33
lifelesswe'll get a machine for staging scripts20:33
gary_postercool, that will be great20:33
gary_postersaw email20:33
lifelessso, I'm trying to qa20:39
lifelessbut mail from bugs on staging doesn't seem to be going to the staging mailbox20:39
lifelessmbarnett: we're not seeing the last few comments from https://bugs.staging.launchpad.net/bzr/+bug/644855 in the staging imap mbox20:44
_mup_Bug #644855: TestVersion.test_main_version fails run from installed package <easy> <selftest> <Bazaar:Fix Released by vila> <Bazaar 2.2:Fix Released by vila> <Bazaar 2.3:Fix Released by vila> <https://launchpad.net/bugs/644855>20:44
mbarnettlifeless: sorry, got a couple pings at the same time there.  give me a minute and i will take a look at that.20:47
lifelessthanks20:48
=== matsubara is now known as matsubara-afk
mbarnettlifeless: so, the issue is, new comments should be generating individual emails that are sent to the staging imap mbox, and this step isn't happening?21:12
lifelessmbarnett: yeah21:14
lifelessI think that that happens through a script21:14
mbarnettlifeless: is this unique to that bug?21:15
* mbarnett goes to try and find the cronjob for generating bug-comment-emails21:15
lifelesslast mail I see there was 22 hours ago (for staging bug mail)21:16
lifelessmbarnett: ^21:19
mbarnetti ran the process-mail script by hand.  i saw some errors in the log file from the failed staging restore from a couple days ago21:20
mbarnettbut it seemed to return cleanly21:20
lifelessI'll give it a minute and try again21:21
StevenKlosa ping21:22
mbarnettheya StevenK21:22
lifelessStevenK: <- -ops :P21:23
lifelessStevenK: for the 'ping' itself.21:23
StevenKlifeless: Yes, brain fail :-(21:24
lifelesswhat does 'More than one process found' mean from cronscripts?21:25
lifelessmbarnett: not seeing anything21:42
lifelessmbarnett: what were the scripts errors ?21:42
mbarnettlifeless: i saw some reference to shipit, which is what caused me to suspect it was from the failed staging update21:43
mbarnettthat and the fact that they were from 2 days ago21:43
lifelessright; it might not be starting up properly then21:43
lifeless?21:43
mbarnettlifeless: when you say "it" here, what exactly are you referring to?  /me is trying to figure out what *should* be happening with regard to bug-generated emails.21:47
lifeless'the bug mail sender' might not ...21:48
lifelessmbarnett: I'd expect them to end up on m.c.c in the account 'staging'21:48
mbarnettlifeless: right, but your question that "it" might not be starting up properly.. i am not sure what the "it" was.21:51
lifelessmbarnett: the bug mail sending script - the one that gave you shipit errors21:52
lifelessmbarnett: deleting lib/canonical/shipit should fix those errors21:52
mbarnettlifeless: it is very possible i was looking at the wrong script... i am not sure if "process-mail" is what gets emails from bug comments to the staging ,mailbox21:52
lifelessmbarnett: well the mail is sent to local smtp as usual21:53
lifelessmbarnett: so you could look at that config21:53
mbarnettlifeless: those errors were from a couple days ago, i haven't seen them since and the process-mail cronjob runs much more frequently, so i don't think we havea  problem there21:53
lifelessmbarnett: ok; so its going somewhere else ;)21:56
lifelessmbarnett: mail is being sent to localhost:2521:56
poolie_droidDoes anyone do their lp development on a cloud instance?22:17
lifelessI use a vm, not a cloud instance though22:18
poolie_droidAs opposed to just running tests there22:18
lifelessyes22:18
poolie_droidYes, I use a vm on my desktop22:19
poolie_droidAm going to try using ec2 for a bit22:19
mtaylorlifeless: that launchpad extension thing in the lunch session ... do you know if there's a project for that?22:26
lifelesslunch session? I missed the lightning talks - was grabbed by two! people for 'must have before eow discussions'22:27
poolie_droidNice talk btw mtaylor22:27
mtaylorlifeless: ah.22:27
mtaylorpoolie_droid: thanks!22:27
lifelessmtaylor: what thing are you talking about22:27
mtaylorpoolie_droid: at this point, I have more-than-normal amount of experience talking to people who are switching to bzr :)22:27
mtaylorlifeless: it was a thing someone was showing where he'd made a test-results web app thing, but used some amount of lpapi/something to make a) the app look launchpad-y and b) register with real launchpad the existence of his thing22:28
StevenKmtaylor: That was cr322:28
poolie_droidMtaylor the speaker was Marc Tardif, if you're talking about the thing with grease monkey22:28
lifelessmtaylor: look at /launchpad-project22:29
mtaylorpoolie_droid: StevenK: sweet. thanks22:29
lifelessmtaylor: its there22:29
mtaylorlifeless: when you say "it's there" ... I am obviously unintelligent, cause I don't see nothing...22:33
mtaylorlifeless: thanks22:33
poolie_droidGot it now?22:48
marsOOPS-1763CMP423:07
StevenKmars: You should be able to land your branch now23:21
marsStevenK, thanks, I completely forgot about that :/23:22
StevenKmars: Heh, I hadn't. I've been fighting to get us out of testfix for most of the day23:22
marsStevenK, and most of your weekend, it appears.  That sucks.23:23
marsSent.  I'll know in (2*13)+(13/2) minutes23:26
mars(approximately)23:26

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!