[01:00] wgrant, there's still a BRANCH.TODO in that patch [01:00] jml: I was about to fix that. [01:00] I must have used the wrong prereq. [01:00] :) [01:00] r something. [01:00] I'll review the branch then. [01:01] Thanks. [01:01] Ah, yeah, I based it on the integration branch, but forgot ther was still that one change remaining. [01:02] * wgrant pushes. [01:06] jml: Diff is fixed now. [01:06] wgrant, cool. [01:07] Hm, odd import diff. [01:07] wgrant, I've reviewed it. Thanks for the patch :) [01:09] jml: Why not 'queueBuild'? [01:09] wgrant, that could work. Took me a moment to see that 'queue' was a verb though... [01:10] wgrant, but it is a better name. :) [01:10] _estimateDuration was private before, so it wasn't on the interface. [01:10] ahh ok. [01:11] * mwhudson stabs buildmailman in the lungs [01:14] * mwhudson widens his stabbing to the build process in general [01:21] * elmo joins in the stabbing from the sidelines [01:21] * wgrant stabs both the Launchpad and Soyuz build processes. [01:24] gargling stabby lungs === jamalta-afk is now known as jamalta [01:31] jml: Want to review the second bit? It's 500ish lines [01:32] wgrant, sure. It'll be a couple of minutes before I start though. [01:41] wgrant, ok. ready [01:41] woot. [01:43] This is landable, as thefinal in a series of three unmerged branches. [01:43] The first is noodles', and was reviewed last week. [01:43] (that's the remaining unmerged bit of the integration branch) [01:45] wgrant, why the new tests in lib/lp/soyuz/tests/test_sourcepackagerecipebuild.py ? [01:45] wgrant, also, is there a bug filed for the bad names? [01:45] jml: There is a bug filed. Shall I add it there with an XXX? [01:46] wgrant, that'd be nice, thanks. [01:46] The new tests are because there are new bits on the interface that have been implemented. [01:47] wgrant, ah, I see now. [01:48] wgrant, r=jml [01:49] jml: Thanks. I'll add the XXX, then convince you to ec2 land it. [01:49] wgrant, ok. [02:04] jml: OK, pushed (also with the year corrected in all of my XXXs. oops) [02:04] Can you please ec2 land it? [02:04] wgrant, sure. got a commit message on the MP? [02:04] jml: Yep. [02:05] wgrant, just to be clear, I'm landing lp:~wgrant/launchpad/ibuildbase-compliance right? [02:06] jml: That's the one. [02:06] cool. [02:09] jml: How's your process-upload branch? [02:09] * jml does some local make build crap [02:10] I had forgotten about it. [02:14] That's all that's unlanded, apart from my Friday afternoon hacks which I'm isolating now. [02:17] ok. [02:41] wgrant, ec2 land is broken :( [02:41] wgrant, or maybe I am. [02:46] jml: What went wrong? [02:46] I gave it the url of the branch, not the mp [02:46] it raised a stupid error message [02:46] Ah. [02:47] process-upload-checks had some conflicts [02:47] I've resolved them fairly brainlessly, but I think correctly [02:47] So, bug #507783, bug #507784 and bug #507363 remain as blockers for a full run-through. [02:47] Bug #507783: RecipeBuildBehaviour has no security declarations [02:47] Bug #507784: SourcePackageRecipeBuild.getLogFilename() is not implemented [02:47] Bug #507363: Generalise rescueBuilderIfLost [02:47] Yeah, it was trivial to merge that. [02:48] jml: Since jelmer's branch has landed, somebody should probably sneak that first one in. [02:48] wgrant, the process-upload-checks branch is waiting for a review, but no one has [02:48] * wgrant fixes the middle one. [02:48] jml: Ah. I guess that's probably a bigjools thing. [02:51] yeah [02:51] wgrant, I think my branch fixes bug 507783 [02:51] Bug #507783: RecipeBuildBehaviour has no security declarations [02:51] 12 conflicts encountered. [02:52] :( [02:52] jml: Your p-u-c? [02:52] yeah, after merging db-stable in [02:53] jml: Merge ibuildbase-compliance into it. It is reasonably up-to-date. [02:53] (and will be landed soon... maybe) [02:53] the instance is up & running, fwiw. [02:53] Great, thanks. [02:54] merging your branch in doesn't really help [02:55] Hmmm. [02:55] I'll do db-stable & get that going [02:57] I have nfi why I get code import conflicts [02:58] criss-cross ftl [02:58] Yay criss-cross? [02:58] Yeah. [02:59] jml: I need a common base class for BuildFarmJobs that have an associated BuildBase. Any hints for names that don't suck? [02:59] wgrant, start by picking a non-crappy name for BuildBase, I guess. [03:00] Julian's against renaming that for the foreseeable future. [03:00] wgrant, such BFJs are building package stuff, right? [03:00] jml: Yes. [03:00] SourcePackageRecipeBuildJob and BuildPackageJob, but not TranslationsRecipeBuildJob or whatever they call it. [03:00] wgrant, PackageBuildFarmJobs? [03:01] oh wait [03:01] They're not necessarily building packages, but all the current candidates do. [03:01] BuildPackageJob is _also_ terribly named [03:01] It is. [03:01] We intend to rename it. [03:01] to BinaryPackageBuildJob. [03:01] wgrant, what's the thing they have in common? [03:01] other than building packages? [03:01] jml: {SourcePackageRecipeBuildJob,BuildPackageJob}.build is an IBuildBase [03:02] _handleStatus_OK should be on Build, right? [03:02] No, it should be on BuildBase. [03:02] Well, until somebody else needs a different implementation. [03:02] wgrant, yeah, but conceptually -- you say they aren't necessarily for building packages? [03:02] Right. [03:02] I don't want to make the inheritance hierarchy more horrible than is necessary. [03:03] If somebody wants to add a BuildBase derivative that doesn't do package stuff, they can create another layer. [03:03] what could they possibly be for other than building packages? [03:04] jml: Is there anything package-specific on IBuildBase? [03:04] Just about any other job running in an archive context could use it. [03:04] wgrant, I guess not. [03:04] wgrant, there's nothing about archives there either. [03:05] jml: Not in trunk. Check my branch. [03:05] wgrant, I'll take your word for it :) I want to resolve these conflicts before digging into even more code. [03:05] Ah, yeah, good idea. [03:06] wgrant, perhaps the name should have something to do with archives. [03:06] It also has distroseries, pocket, etc. [03:09] yeah. that sounds pretty package-y to me. [03:09] or at least, very focused on stuff to do with debian-derivatives. [03:09] Mm, possibly. [03:09] Yeah. [03:10] Hmm. [03:11] We actually have some build-specific stuff in BuildFarmJobBehaviorBase. [03:11] Julian suggested that when we asked him about a name for the build-specific version of that. [03:11] I wonder if we should do the same here. [03:11] another thing to consider is that maybe our current object/class model is forcing us to choose bad names. [03:18] on db-stable, which is correct: [03:18] specific_class = self.specific_job_classes[self.job_type] [03:19] specific_class = specific_job_classes()[self.job_type] [03:19] * jml picks one [03:20] OK. After that bloody merge, I'll run the tests. [03:20] hmm. I should have done that merge in the 'wellington' branch. [03:21] Possibly. [03:21] or I should abandon the branch. [03:21] Once my branch lands, the branch is merged. [03:23] fair enough. [03:23] I'll abandon it then. [03:23] So probably best to abandon it. [03:23] Yep. [03:25] * jml goes back to gtg hacking [03:25] jml: Before you vanish, do you have anything more to say on the naming thingy? [03:26] wgrant, I think I'd give it a name that emphasises the archive-y or package-y nature of it. [03:26] jml: OK. Thanks. [03:26] wgrant, I also think that once the translation stuff lands, it would be worth writing a document that explains the current system, and how to add a new type of job [03:27] Probably, yes. [03:27] wgrant, by seeing all of the cruft described to other humans, we'll all suddenly get good ideas on how to make it better. [03:27] (also, subclassing for code sharing sucks) [03:27] What's a better solution? [03:28] wgrant, often composition is a better solution. [03:28] wgrant, but also sometimes just having different kinds of objects :) [03:28] True. [03:29] C++ folks have some sort of proverb for this, IIRC. thumper might know. [03:42] jml: for what? === jamalta is now known as jamalta-afk [07:09] Hi. I have installed launchpad as described on launchpad.net and it seems to be running correctly. I do however start to wonder if I got the right branch build since everything seems hardcoded to launchpad.dev, has dummy data in it, mail configured to only go to local root, etc. Should I use a different branch for a production server? [07:17] freim: no you have the right code - same as what we use on the prod servers; you should (I believe) have a file configs/README.txt that should take you thru some of the config stuff and vaguely how it all works. The defaults are all wired for .dev as you've noticed. [07:20] spm: ok, thanks [07:21] guess I need to learn zope then :) === Ursinha is now known as Ursinha-afk [07:48] Anybody around who can check if PQM knows about my branch? [07:48] An ec2test started 5 hours ago, but I haven't been emailed either way yet. [07:48] jml: ^^? [07:51] Yay, landed. [07:51] Yep! [07:52] This leaves jml's branch, my other branch, and two more diff hunks until trunk can do an end-to-end recipe build. [07:52] hmm.. [07:53] wgrant: maybe it would be worthwhile sending a bigjools an email outlining what you just said i.e. what branches are still outstanding and mee [07:54] .. and need to land [07:54] I might, yeah. i'm just proposing my latest branch now. [07:54] * al-maisan goes back to packing [07:55] Oh, yeah, you're leaving :( [07:55] yup, tomorrow, bright and early :) [07:56] 6am? [07:56] from the hotel, yes. [07:59] wgrant, hi [07:59] henninge: Hi, regarding bug 507498 , any idea why the bug was not catched by xx-potemplate-index.txt test ? [07:59] Bug #507498: AttributeError on potemplate page [07:59] wgrant, my branch has broken zcml, so doesn't get past the build step [07:59] wgrant, I'll look at it tomorrow or maybe later tonight, off to dinner now. [08:00] jml: OK, thanks. [08:19] Hi adiroiban! [08:28] henninge: hi. I'm investigating why the bug 507498 was not prevented by the current tests (xx-potemplate-index.txt) [08:28] Bug #507498: AttributeError on potemplate page [08:29] adiroiban: yes, I am looking at that [08:30] adiroiban: it's because that permission got only checked on a corner case that the page test does not cover. [08:31] adiroiban: it is only checked if the project has rosetta *not* enabled and the template is *not* active (current). [08:31] henninge: but why. I can see the potemplate-index, is accessing a POTemplateSubset (+pots) using anon_browser [08:32] adiroiban: then, in the check itself the owner check was only done if the potemplate was not for a productseries. [08:33] adiroiban: consider these two lines: [08:33] if ((official_rosetta and potemplate.iscurrent) or [08:33] check_permission('launchpad.Edit', potemplate)): [08:34] adiroiban: check_permission will only be called if on of official_rosetta iscurrent is false. [08:34] s/on/one/ [08:35] (there was a term for that but I forget) [08:35] henninge: thanks. got it now :) [08:36] so normal user are not linked to that page... wondering how Diogo spoted this bug [08:36] adiroiban: also, for anon_browser, checkAuthenticated will not be called at all. [08:37] adiroiban: Diogo is just looking at oopses that occur on the production, edge and staging servers. [08:37] adiroiban: so this did not happen to Diogo but a user on edge. [08:37] :) [08:37] yes, but since that page is not linked from any other page visible to normal users [08:38] then is should have been a webcrawler or such :) [08:38] thanks for the explanations :) [08:38] adiroiban: or a book mark or a user hacking the url ... [09:08] bigjools: Morning. [09:08] morning [09:08] Did that buildd-manager warning actually cause any problems/ [09:09] not that I can tell [09:09] hmm. [09:09] but I wasn't paying much attention [09:09] Might just be the generally broken logging. [09:09] yeah the logging is pitiful [09:09] I mean, we broke it somehow last week. [09:09] It works in the tests, but not in real life. [09:13] * wgrant hunts for a reviewer for https://code.edge.launchpad.net/~wgrant/launchpad/bug-507784/+merge/17722 [09:27] Hi! [09:27] eyup mrevell [09:28] bigjools, Back in GMT yet? [09:28] mrevell: yeah since sunday [09:28] He abandoned us. [09:28] well - my body is in GMT [09:28] bigjools, Yeah, I meant your mind, rather than your body :) [09:28] I've been waking up at 5am every day since sunday [09:29] nice [09:29] wgrant: how's lca? [09:29] bigjools: Pretty good. Some very interesting talks. [09:29] and do you have any unlanded branches from last week? [09:29] And the wireless even works now. [09:29] gosh [09:30] bigjools: Three branches landed a couple of hours ago. [09:30] One is outstanding -- the one I linked 15 minutes ago. [09:30] ok [09:30] Then jml's needs to land (he's requested a review from you, but the diff looks utterly broken), and somebody needs to fix rescueBuilderFromSlave. [09:30] E_too_many_new_classes [09:31] Then everything is merged. [09:31] YES. [09:31] I'll review his todau [09:31] today even [09:31] bigjools, thanks. [09:31] was busy fixing that private build cockup yesterday [09:31] jml: Any idea what's wrong with the diff? [09:31] bigjools: What was the actual problem? Private->public PPA copies worked fine here... [09:31] jml: no problem Stephen [09:31] wgrant, no, I'm working on other more interesting failures right now [09:32] wgrant: the bug you reported about the missing _sendFileToSlave [09:32] bigjools, :) [09:32] bigjools: Oh, that one. [09:32] yes that one :) [09:32] bigjools, I was saying to wgrant (re the too many classes thing) that it'd be good to write a doc on how to add a new build farm job after this & the translations one are done [09:32] bigjools, such a doc would show us quite clearly the bits where it's All Too Hard [09:33] +1 [09:33] I want to document all the new classes separately [09:33] and then we can rename them if needed [09:33] it's too bloody confusing [09:33] Yep. [09:34] And we can shuffle stuff out of lp.soyuz. Once everything is merged. [09:34] jml: where do we normally put mixin classes in our hierarchy? [09:34] yep [09:34] At least the Translations jobs seem to be keeping to lp.translations [09:34] bigjools, well, a "how to" guide might show you why some of them don't need to be separate (or exist!) at all. Or maybe not. [09:35] bigjools, probably lp.services normally. lp.buildmaster seems a good place for a lot of these though. [09:35] well wgrant has added one in the model dir. I question if that taints the purity of everything actually being a model class [09:35] I suspect that lp.buildmaster actually wants to go to lp.services.buildfarm eventually. [09:36] or just rename buildmaster -> buildfarm [09:36] oh right [09:37] bigjools, on the 'model' or not, opinion is divided [09:37] bigjools, I personally think that the word 'model' means more than just "db wrappers" [09:37] well I don;t mind either way, as long as it's clear :) [09:38] and that we all know where to put them and look for them [09:38] bigjools, probably 'model' [09:38] hardly anyone actually uses the 'adapters' subpackage [09:38] apart from Soyuz :/ [09:38] which wasn't my doing [09:39] also, lp.services.buildfarm would better fit the intent of the new tree than lp.buildfarm. But I'll save that argument for when someone gets around to moving it. :) [09:42] I don't like lp.services [09:42] it seems ill-defined [09:43] If the build farm isn't a service, what is? [09:44] what's a service? [09:44] Good question. [09:45] wgrant: ok I'll approve your branch - is jml landing it? [09:45] bigjools, lp.services is supposed to be stuff that the rest of Launchpad uses that isn't really worthy of an external library [09:46] it's a terrible name [09:46] yeah [09:46] but I haven't heard anyone come up with a better one, or a better place to put generally useful code. [09:46] lp.stuff would even be better :) [09:46] bigjools: I've not organised a landing. [09:48] I wonder if I should sneak the fix for bug #507783 in with it, given that it wasn't included in jelmer's branch. [09:48] Bug #507783: RecipeBuildBehaviour has no security declarations [09:48] feel free [09:50] wgrant, it's in my branch. [09:52] (I think) [09:52] I remember fixing it at the sprint anyway [09:54] jml: You attached a patch to the bug. [09:54] oh. [09:54] * wgrant checks your branch, though. [09:54] I didn't see it when I merged it earlier. [09:55] no, that makes sense. [10:00] bigjools, wgrant: ok. I'm running my branch through ec2 test, now that its zcml is fixed [10:01] bigjools: OK, security stuff there. Can you ec2 land it? [10:01] jml: Great. [10:01] wgrant: I can't ec2 land it :) [10:01] * wgrant will look at rescueBuilderIfLost tomorrow. [10:01] bigjools: Oh, true. [10:01] * bigjools runs into the house and turns on the beast [10:02] wgrant: so the branch I just reviewed, you added zcml stuff? [10:02] bigjools: Right. http://bazaar.launchpad.net/~wgrant/launchpad/bug-507784/revision/10203 [10:02] ok [10:02] Stolen from jml's diff. [10:02] I guess I should sort my ec2 access out [10:03] It's pretty handy. [10:03] jml: Is it expected that I didn't receive an email about the earlier test completion? [10:04] wgrant, umm. no. [10:06] It looks like I normally do, but this time I did not. [10:10] wgrant, I didn't get one either. [10:10] Odd. [10:10] yeah. [10:10] I'm not going to debug ec2 test / land now though [10:11] Good policy. [10:21] I suppose we should fix the data model this week. [10:44] * wgrant considers the whole sleeping thing. [10:50] wgrant: you can sleep when you're dead [10:58] hi. any idea why factory.makeProduct() is getting an error for wikiurl, when running from make harness ? http://paste.ubuntu.com/359492/ === matsubara-afk is now known as matsubara [12:03] jml: still around? [13:26] BjornT, what format was the js-play.prof file that you took? Firebug Profiler? === jamalta-afk is now known as jamalta [14:27] hi henninge_ === henninge_ is now known as henninge [14:32] Hi bac! === mrevell-lunch is now known as mrevell [14:32] hi henninge -- i'm re-reviewing the branch adi worked on yesterday. he had a problem with date_last_updated [14:33] yes [14:33] henninge: i recall you advised him to use removeSecurityProxy instead of updating the permission [14:33] henninge: problem is you can't set the new value using rSP [14:34] i was wondering why not just move date_last_updated to use lp.Edit [14:35] bac: The reason I opted for rSP is that date_last_updated should only be changed in that context. [14:35] henninge: right, but it just doesn't work. :) [14:35] a = removeSecurityProxy(b) [14:35] a = new_value [14:35] does not change b [14:36] bac: but if that 's not possible, allowing lp.Edit is ok. [14:36] bac: hm, something about flushing or comitting? [14:36] henninge: ok, i just wanted to run it by you to ensure i wasn't missing something [14:37] henninge: on the phone be right [14:42] adiroiban: what's the login on that virtual machine? [14:43] henninge: good question :) [14:43] something like d3v3l0p3r [14:43] user: developer [14:43] henninge: nm, i found out what he was doing wrong [14:44] bac: oh, what was it? [14:44] henninge: he was calling rSP(context.date_last_updated) ... getting an unwrapped attribute not the unwrapped object [14:45] bac, adiroiban: oh, I thought we had talked about that. === Ursinha-afk is now known as Ursinha [14:46] adiroiban: the login was correct [14:46] bac: thanks === salgado is now known as salgado-afk === salgado-afk is now known as salgado-lunch [14:48] adiroiban, henninge: http://pastebin.ubuntu.com/359563/ [14:49] bac: yes, that's what I would have expected. [14:50] ok, I'm a bit confused by our setup docs here. maxb, around? [14:50] hello [14:51] hi maxb. Do you have a moment to help untangle the docs for a system reinstall? [14:51] maxb, I'm trying to figure out why the 'launchpad-developer-dependencies' package isn't mentioned anywhere in the setup docs [14:51] and it is no longer in the ~launchpad PPA? [14:52] ! [14:52] 'launchpad-developer-dependencies' is a binary package built by the 'launchpad-dependencies' source package. the PPA webpages display source packages [14:52] It is in the PPA [14:52] ah [14:53] that makes sense [14:53] I know I have to install 'launchpad-dependencies' as a dep of lp-dev-deps, but I didn't know they came from the same source [14:53] bac: I've pushed the change [14:54] adiroiban: ok, i'm including a few other bits in my review. [14:54] maxb, cool, thanks. You wouldn't happen to know if installing the ~launchpad PPA, and then installing launchpad-developer-dependencies must be done *before* running rocketfuel-setup? [14:54] maxb, because the docs don't even mention the ~launchpad PPA [14:55] hmm [14:55] Unless you're missing something really fundamental, like bzr, it should be fine to let rocketfuel-setup add the PPA [14:56] ah, it does? [14:56] * mars checks the source again [14:56] adiroiban: MP updated [14:57] maxb, got it, ~line 177 in rf-setup. Cool, thanks for the help! [14:59] "2 packages upgraded, 153 newly installed, 0 to remove and 11 not upgraded. [14:59] Need to get 310MB of archives. After unpacking 737MB will be used." [14:59] ! [15:00] ^ that is the launchpad dev system footprint. [15:19] tell me about it, my nice lean VM image ballooned after installed the deps :( [15:22] well, that nixes the idea of downloading a full VM. You'll have to grow the VM from a seed image. [15:22] yep [15:22] I have a script to make one [15:22] bigjools, how big is a 'lean' VM? [15:23] I can't really remember [15:23] at a guess it was about 30MB [15:23] maybe less [15:24] wow [15:24] big size difference there === matsubara is now known as matsubara-lunch [15:25] gary_poster, ^ so that makes the story around "downloading a seed VM for LP developers" sound a little more appealing, eh? [15:27] argh. rocketfuel-setup went without a hitch, but 'make schema' barfed on a CSS error: make: *** [css_combine] Error 1 [15:28] mars, yes. bigjools, is that lean vm something we could offer to open source devs? Or does it at least show us a way we could do it? [15:29] yeah we could [15:29] bigjools, and what does your "script to make one" do? Build the VM, or the VM+lp-dev ? [15:29] I was using the vmbuilder script to make mine [15:29] just the VM, running rf-setup obviously bloats it [15:29] just the VM [15:30] however we could work out a minimal set of scripts that sets up basic stuff [15:30] and then some sort of easy way to run rf-setup inside of it [15:30] then let the dev run rf-setup [15:30] or a subset of it [15:30] it's very easy to set up with vmbuilder [15:30] bigjools, how do you access the vm from your local system? Fuse? [15:30] bigjools: I hadn't heard of vmbuilder. That's cool. What does the vm run in? [15:31] mars: I run it as a VM and ssh into it [15:31] oh, I guess, many of them... [15:31] gary_poster: any vm manager :) [15:31] bigjools, how do you hack on the source tree then? [15:31] I used qemu [15:31] yeah, nice little script! [15:31] mars: it's COW [15:31] surely you don't run the editor in the VM [15:32] what editor? [15:32] bigjools, "I need to hack on this feature, then run the branch". How do I hack the branch with my local editor, but run the branch using the VM? [15:33] fuse is one way to do it [15:33] seamless integration [15:33] I think I was pulling off my host, or pushing to the VM [15:33] I use fuse for my vm stuff. It is nice. [15:33] I guess you can use fuse [15:34] but if the VM is running... [15:34] right, if the branch resides on the VM, then it needs to be running [15:34] bigjools, I don't understand how the vm is only 30M. Does it rely on the Ubuntu source hanging around? [15:34] but if the branch resides locally, and fuse pulls it into the VM... [15:34] gary_poster: it's only that size until you install the lp deps [15:35] and yes it pulls in a load of packages to build it in the first place [15:35] it helps if you have apt-proxy [15:35] for repeated runs! [15:36] bigjools, trying to work on your xvfb problem. Does 'make css_combine' work in your copy of trunk? [15:37] mars: let me check [15:37] mars: yep it's fine [15:37] crap [15:38] mars: my big problem now is that I can't even run my tests using bin/test :( [15:38] it won't start the browser over an ssh-proxied X session [15:38] bigjools, yeah. Did you see my reply? [15:38] oh not yet [15:38] mars: I replied to your reply, I have a different problem [15:39] unless you replied to my reply to your reply === leonardr is now known as leonardr-market [15:41] bigjools, maybe an xset command is called for? [15:42] gmb: when you get a chance, take a look at our fix for that "XXX" in https://code.edge.launchpad.net/~kfogel/launchpad/505845-affects-person-from-dups/+merge/17721 (which I've resubmitted, so you should get a new diff) [15:42] mars: to do what? [15:42] I mean, other X stuff works fine over ssh [15:42] it's very odd [15:42] hmm === salgado-lunch is now known as salgado [15:43] I think we should remove js tests from blocking landings until this is all resolved [15:48] bigjools: +1. [15:49] gmb: do you find it flaky as well? [15:50] bigjools: Not on this system, but I've had it do weird things to me last week (which I got around nicely by just killing the Windmill process) [15:54] bigjools, is that the correct display number in your error message? 10:0 ? [15:54] bigjools: hello :) [15:54] bigjools: is this a known error? https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1480EC819 [15:55] mars: yes, it's the ssh proxy [15:55] Ursinha! [15:56] Ursinha: hmmm that's odd [15:57] Ursinha: someone is copying between private/public yet again [15:57] it's not really tested [15:57] I need to disable it :( [15:57] bigjools: :( [15:57] bigjools: may I file a bug about it? [15:58] I already have one [15:58] Ursinha: bug 509333 [15:58] Bug #509333: LP should not allow a user to copy from a private to a public PPA [15:59] you can add the oops there if you like [16:00] bigjools: just did that :) [16:00] bigjools: thank you very much [16:00] thank you === bigjools is now known as bigjools-otp === bigjools-otp is now known as bigjools === matsubara-lunch is now known as matsubara [16:34] bigjools, I'm wondering if some debugging info in test_on_merge.py, around line 140, may be in order [16:34] mars: happy to help [16:35] bigjools, perhaps a call to subprocess.call(['/usr/bin/bash'], shell=True) ? [16:35] to open a shell on the terminal [16:36] bigjools, either that, or a print statement [16:38] mars: which? :) [16:38] bigjools, still reading. does the xvfb-run script use xauth? [16:40] mars: looks like it [16:41] bigjools, can you call something like "xvfb-run -s '-screen 0 1024x768x24' /usr/bin/xclock" on the local/remote sysytem? [16:41] bigjools, run xclock in the same way that windmill would run [16:42] mars: it just exits with no error [16:42] bigjools, I guess it would have to run on the remote system, because that is where test_on_merge.py is run [16:42] I tried local and remote [16:44] bigjools, how about: xvfb-run -s '-screen 0 1024x768x24' /home/ed/canonical/lp-branches/missing-slave-method-bug-509383/bin/test -vv [16:45] mars: same thing, it just exits [16:45] bigjools, no processes left over? [16:45] and leaves an xvfb running in the background [16:46] no test process, eh? [16:49] bigjools, ok. So you get a "cannot connect to display" error when running bin/test on the remote system [16:50] and 'make check' fails on the remote system when you use the xvfb-run step [16:50] mars: yes, after about 3 hours when it starts the windmill layer tests [16:50] :) [16:50] so I landed the fucker anyway : [16:50] bigjools, 'make jscheck' on the remote system does... ? [16:50] heh [16:50] one sec [16:52] mars: working fine over the ssh tunnel [16:52] my screen is full of FF [16:52] hmmm [16:55] bigjools, reading man xvfb-run: The following command should execute successfully: "$ xvfb-run --auto-servernum --server-num=1 xlogo" [16:55] bigjools, if it does not, grab the exit code [16:56] echo $? [16:57] one sec [16:58] mars: exit code is 1 === Ursinha is now known as Ursinha-nom [16:59] ok, perhaps something with the way that xvfb-run is using server numbers [16:59] bigjools, I had to ^C that call on my local system, and it gave an exit code of 130 [17:00] both my remote and local boxes have the problem here [17:00] I suspect you have a package installed I don't [17:01] bigjools, does it say anything in the terminal? ""Xvfb failed to start" >&2 [17:02] bigjools, you do have the xlogo program on your system, right? [17:02] the remote system [17:02] yes :) [17:03] mars: ok this is weird, now it works locally [17:04] but nothing in the terminal for the remote system that fails [17:05] bigjools, ok, "$ cp /usr/bin/xvfb-run $home/xvfb-run", edit the script, around line 182 add 'echo "Return value: $RETVAL"' [17:05] bigjools, then chmod +x $home/xvfb-run && bash $home/xvfb-run [17:05] er [17:06] and finally, run it with: $ xvfb-run --auto-servernum --server-num=1 xlogo [17:06] bigjools, that should give you /something/ in the terminal [17:07] there is a slight confounding of the script return variables at work here [17:07] I can't tell if xvfb-run is failing, or if the command you are passing to it is failing [17:08] mars: on a call now, I'll be intermittent, one sec [17:08] ok [17:11] mars: line 182 is "exit 1", is that the right place? [17:11] bigjools, uhm, no. "exit 1" is line 175 on my system [17:12] $ apt-cache policy xvfb [17:12] xvfb: [17:12] Installed: 2:1.6.4-2ubuntu4.1 [17:12] bigjools, ^ ? [17:13] 2:1.6.4-2ubuntu4 [17:13] running lucid? [17:13] hell no :) [17:14] ah, wait [17:14] ah but wait! [17:14] 2:1.6.4-2ubuntu4.1 is greater than 2:1.6.4-2ubuntu4 [17:16] bigjools, so it looks like there is at least some teeny, tiny ten line difference between our xvfb-run scripts. I wonder what the .1 package version bump did? [17:17] mars: I have that version in an update [17:17] let me try again [17:17] I lack the apt-fu to pull the change from the command line [17:18] mars: ok line 182 is "set -e" [17:19] bigjools, ok, then please add: echo "Proxied command return value: $RETVAL" [17:19] bigjools, and then you should be able to see if command failed, or if xvfb-run failed, or if Xvfb failed [17:20] well it doesn't fail any more [17:20] lol [17:22] mars: https://edge.launchpad.net/ubuntu/+source/xorg-server [17:22] see the changelog for karmix [17:23] it was published 14 mins ago and fixed xvfb [17:23] 'Universal Troubleshooting Process, Step 1: "Is your system up to date?"' [17:23] bigjools, what?! [17:23] quite :) [17:32] ok, next up: converting Bjorn's .prof file to KCacheGrind === leonardr-market is now known as leonardr [17:57] flacoste, gary: we have declarations @operation_returns_entry and @operation_returns_collection_of [17:58] we do not have @operation_returns_nothing_in_particular [17:58] which means that in a multiversion scenario you can go from returning nothing in particular (ie. nothing the wadl needs to know about) to returning an entry, and then to returning a collection, but you can't go back to returning nothing in particular [17:58] should i define @operation_returns_nothing_in_particular as part of this work, or just mention it in case we need it later? [18:02] leonardr: I don't really understand. flacoste is away. What does the wadl not need to know about? Is this for the case of a function that returns None? Or... [18:03] gary: if a named operation returns a data model object, we put that information into the wadl [18:03] otherwise it's assumed that the operation returns arbitrary json [18:03] leonardr: but if it returns a scalar we do not? [18:03] ah [18:03] and launchpadlib does not make any attempt to wrap the json in a launchpad object [18:04] leonardr, so, @operation_returns_json [18:04] so we're talking about the unlikely case where a named operation returns a data model object in one version and arbitrary json in the next [18:04] yeah [18:04] good name [18:04] except it doesn't even have to be json [18:04] example? [18:05] it could return html (assuming the client requested html) === Ursinha-nom is now known as Ursinha [18:09] OK, I'm assuming we have these already. It sounds like these methods are specifically for returning to the webservice? @webservice_operation? @direct_webservice_operation? If it is easy to do this, it seems reasonable to do this now. If it takes more than an hour, and we don't need it, move on. [18:09] with a note [18:09] leonardr: ^^^ [18:10] gary: we do have such methods already [18:10] ack [18:10] it's somewhat likely that they will trend towards returning data model objects [18:10] it's less likely that anything will go in the opposite direction [18:10] but it should be easy to add [18:11] leonardr: are the methods typically specifically for the webservice? [18:12] gary: yes, these declarations only apply to methods _as published in the webservice_ [18:14] now that i think about it, if a method changes that heavily, it's more likely that we'll define two different methods and expose them as the same name in different versions [18:16] we've got a similar problem with @mutator_for. what if the method stops being a mutator? [18:16] leonardr: I don't think that's what I mean. Yes, operations_* describe the webservice. However, typically, they are annotating methods that are often used in other ways, yes? They are often just internal API methods for which we say "expose this". My question was whether these methods that return JSON or HTML are methods that are typically written for the webservice, rather than merely exposed by the webservice. ...If i [18:16] important, then whatever. [18:16] gary: in a multi-versioned environment you will not longer be able to just 'expose this' [18:17] depending in how serious you are about backward compatibility you will have to keep old code around [18:20] gary: i'm leaning towards just implementing a general @not_exported or @reset declaration, which i believe i was going to implement anyway [18:20] yes, it's @no_longer_exported [18:21] leonardr: ok sounds good [18:21] gary: so you can use @no_longer_exported to stop it, and then if you want to be really crazy you can use @export_*_operation again to bring it back [18:22] +1 [18:29] Is anyone around who can tell me how bzr-builder is supposed to be knit into the db-devel tree? [18:40] * maxb knows nothing, but really hopes it's the same way as the other bzr plugins [18:44] gary_poster: Run update-sourcecode. [18:44] Before yesterday you would have needed to run it in db-devel, but the changes seem to have been pushed into devel yesterday as well. [18:46] wgrant: yeah, I was the one who pushed them into devel to work around lameness in some of our test scripts. what I actually need to know is how bzr-builder is supposed to find its way into optionalbzrplugins, because db-devel is failing, I've duped locally, and it is because bzr-plugins is not importable, and I can't figure out how it should have gotten into optionalbzrplugins, or the python path. do you know? [18:47] eh, should have been a period after "is failing." Blame it, and other run-on constructions, on writing too fast :-) [18:48] I thought it was in bzrplugins, not optionalbzrplugins? [18:49] (to be clear, my two concrete observations are that I don't see it in optionalbzrplugins, though I assume it should be there; and it is not importable by lib/lp/soyuz/model/sourcepackagerecipedata.py during wadl generation) [18:50] maxb: ah, yes, builder is in bzrplugins, and hg, git, and the like are in optionalbzrplugins [18:51] builder should be in bzrplugins [18:51] oh [18:51] maybe you have to import lp.codehosting before you import it? [18:51] goddamn import order dependencies [18:51] mwhudson, ok will try :-/ [18:53] Is buildbot happy now? [18:53] wgrant, no it is sad [18:54] mwhudson: no, did not solve [18:55] * mwhudson actually looks at buildbot [18:55] mwhudson: will try looking at python path before import... [18:55] gary_poster: i think bzrlib.plugins.__path__ is also worth looking at [18:57] mwhudson: ack, that would be more pertinent thanks [18:59] disabling SHHH would help... [18:59] ...sigh, or maybe not... [18:59] gary_poster: 'make' in db-devel works for me, of course [18:59] :-) of course [19:00] mwhudson: here is the recipe that worked for me fwiw [19:00] get db-devel [19:00] though that's perhaps because i have bzr-builder installed in ~/.bazaar... [19:00] oh, maybe [19:00] nope [19:01] ok, so to continue recipe, link-external-dependencies [19:01] rm the symlinks to the new packages (bzr-hg and bzr-builder) in sourcecode [19:01] run update-sourcecode-dependencies [19:01] and, if you are me or buildbot, fail when you try to run make [19:02] * mwhudson tries [19:05] mwhudson (and any others): http://paste.ubuntu.com/359690/ shows sys.path followed by bzrlib.plugins.__path__ [19:06] bzrlib.errors.BzrError: xmlrpc protocol error connecting to https://xmlrpc.edge.launchpad.net/bazaar/: 302 Found [19:06] yay hotel internet! [19:06] mwhudson: so, bzrplugins/builder/ is empty for me [19:06] !? [19:06] it is also a real, not symlink [19:06] hard [19:06] I am guessing it should be a symlink? [19:07] yes [19:07] mwhudson, who was supposed to put it there? [19:07] !? [19:07] i _did_ put it there [19:07] heh [19:07] but it seems db-devel 8894 unsymlinked it [19:08] oh! [19:08] kind changed: [19:08] bzrplugins/builder@ (symlink => directory) [19:11] mwhudson: I assume that should be a symlink to sourccode/bzr-builder? Would you like me to do the honors? [19:11] Or I can go have lunch :-) [19:11] gary_poster: i would like to go and have breakfast, so if you could... [19:11] mwhudson: sure. Thanks so much for your help [19:12] fwiw it was gmb in db-devel r8889.1.1 that done it [19:12] yeah, I saw :-) [19:12] i guess related to the general sourcecode confusion [19:12] oh well [19:12] gary_poster, mwhudson: sry. [19:12] gmb: not to worry, at least it's easy to fix :) [19:12] :) [19:12] absolutely :-) [19:12] * mwhudson goes to see if loggerhead explodes over the kind change [19:14] hm, doesn't display it usefully, but at least it doesn't go bang [19:14] * mwhudson breaks fast [19:15] ok, not out of woods yet, fwiw [19:15] Changing the symlink reveals the following [19:16] http://paste.ubuntu.com/359700/ [19:16] of which the important bit is ImportError: No module named debian_bundle [19:16] oh [19:16] duh [19:16] I bet I need to update my dependencies [19:17] yes [19:17] that's in python-debian which is depended on by launchpad-dependences 0.62 [19:17] yes, should have done that first, sorry [19:17] np [19:17] so the failure was because of a bad merge conflict resolution i guess [19:17] yeah [19:17] * mwhudson really goes away [19:17] :-) [19:18] flacoste: actually, probably because gmb was trying to get things to work before devel had the sourcecode branches, and did so by mutating the tree [19:19] Yep. [19:47] rockstar: hi, you're the only one from the asiapac reviewer meeting who's around, right? what say we cancel this week? [19:48] gary_poster: do we have a build engineer this month? [19:49] bac: no. Considering canceling the program. Maybe will ask for volunteers for next cycle, give it one more whirl, then discuss. [19:50] gary_poster: so your team would just pick it up? [19:51] bac: yes. [19:52] gary_poster: ok. i may hunt you down for a pre-imp call for a fix i want to do to ec2 in my spare time. [19:54] bac: cool [20:04] so is login_anonymously gone from launchpadlib? [20:04] i can't find it in help() and it tells me the method doesn't exist [20:04] or is it a new feature that isn't in the karmic version of launchpadlib? [20:05] jamalta, it's brand new [20:06] salgado: ah ok, thanks [20:06] how do i get a bug_target for a project, with launchpadlib? i don't see how in the +apidoc on edge [20:11] dobey: A project *is* a bug_target. === salgado is now known as salgado-afk [20:13] ok, well i didn't know that, and it's in no way clear from the documentation that it is the case [20:14] "Examples include an IDistribution, an IDistroSeries and an IProduct. [20:14] " [20:14] yes [20:16] wgrant: perhaps it should say "examples include distributions, series, and projects" [20:16] there are only vague insinuations that IProduct == "project" in other places in the doc. nothing concrete, or that makes me say "oh, a project, ok" [20:17] thumper: indeed. i'm seeing lots of places where the docs could be clearer in that respect :) [20:17] Probably. A lot of Launchpad docstrings are awful. [20:17] :) [20:17] Even moreso when exposed over the API. [20:17] guess i'll file bugs about them [20:17] dobey: DO IT! [20:18] thumper: Why does make run_all sometimes clobber my push branches? [20:18] wgrant: I dunno [20:18] look at the Makefile [20:18] i will. have to file all these bugs to track my own work first, since i barely have enough time to get it all done by feature freeze :) [20:19] regarding, https://help.launchpad.net/API/launchpadlib [20:19] thanks [20:19] you can't bzr branch lp:oauth [20:19] because it doesn't have a main branch === mwhudson_ is now known as mwhudson === matsubara is now known as matsubara-afk [20:44] jamalta: should it have? [20:45] thumper: well, the instructions in the wiki say to branch lp:oauth [20:45] but you can't [20:45] I'm looking at it [20:45] although I'm tempted to change the trunk branch to use bzr-svn [20:46] thumper: to pull from code.google.com? [20:46] jamalta: yeah, currently the import is using cscvs [20:46] but we'd have to change our launchpad branch if I did that [20:46] I'll take it to the dev list [20:47] thumper: cool :) [20:47] also, it seems that lazr.restfulclient is broken (or my pull is) [20:47] it fails to import from lazr.restfulclient.authorize [20:48] http://paste.ubuntu.com/359738/ [20:48] Can somebody please ec2 land https://code.edge.launchpad.net/~wgrant/launchpad/bug-507784/+merge/17722, since it looks like bigjools ran into issues last night? [20:49] jamalta: email sent [20:50] thumper: thanks :) [20:50] jamalta: are you on the launchpad dev list? [20:50] thumper: yeah [20:50] ok [20:52] should i just report a bug for the lazr.restfulclient issue? [21:03] jamalta: yep [21:07] thumper: thanks [21:27] thumper: i think leah might have moved the "canonical" trunk for python-oauth to github now [21:50] eoasuheoasuheoauseoathisuaheosnideoasuhaei [21:50] !!!##!$$#@!#!$!$#@#! [21:50] I'm unhapppy. [21:50] gary: i think the next step is to start building multiversioned adapter classes for named operations [21:51] leonardr: cool, sounds good [21:52] jml, why unhappiness? [21:52] because merging db-devel into my branch has 16 conflicts [21:52] even though I merged db-stable in yesterday and resolved about the same number of conflicts. [21:53] Morning jml. [21:53] it makes me very upset. [21:53] More criss-crosses? [21:53] wgrant, good morning [21:53] yes. [21:53] ok, down to ten with some smarter merging. [21:54] * wgrant violates the mandatory community pre-imp call rule and puzzles over how to do rescueBuilderIfLost. [21:58] heh [22:03] Can someone please ec2 land https://code.launchpad.net/~wgrant/launchpad/bug-507784/+merge/17722? [22:05] channel = logging.StreamHandler(log.StdioOnnaStick()) [22:05] Huh? [22:06] almost done [22:06] wgrant, what's the huh about? [22:06] jml: StdioOnnaStick [22:06] * wgrant finds it. [22:07] it's a Twisted thing [22:07] I see. [22:07] on the whole, I think it's a better name than SourcePackageRecipeJobBuild [22:07] s/JobBuild/BuildJob/ [22:07] But yes. [22:08] How bad were the conflicts? [22:10] wgrant, some of them were the same as the ones I fixed the other day [22:10] Fun. [22:10] wgrant, lots of them were because of your renames to stuff in my branch. [22:10] Ah :( === mwhudson_ is now known as mwhudson [22:11] darn it, --headless should just be the default for ec2 test [22:18] pain pain pain. [22:19] jml: good morning [22:19] mwhudson, pain [22:19] zcml is such a terrible, terrible idea [22:19] Martian, Martian, Martian. [22:19] jml: i see [22:22] someone added zcml declarations for the classes added in my branch in the same file but a different location [22:23] jml: is zcml causing you a world of pain? [22:23] mwhudson: you know a lot about pdb and python. if i have a multithreaded app that is using 100% CPU, is there an easy way of seeing which thread is busiest, and what it is doing atm? [22:24] BjornT: you can attach to it with gdb and wangle your way to a (python) stack trace [22:24] mwhudson: do you have time to show me how? [22:24] if one thread is using 100% cpu, it's pretty likely to be the one that you get when you attach, i guess [22:24] BjornT: even better, it's documented on wiki.c.c i think [22:25] BjornT: https://wiki.canonical.com/InformationInfrastructure/OSA/LPHowTo/BacktraceFromCoredump [22:26] BjornT: going offline for a bit now, biab [22:26] ok, let me try that [22:30] mwhudson: hmm, didn't work. when doing apply pystack, it complains with: No symbol "t_bootstrap" in current context === Chex_ is now known as Chex [22:38] Arrrrgh massive doctests kill kill kill. [22:42] jelmer_, how do you feed testr failing stuff into ./bin/test [22:42] wgrant: good morning to you too :-) [22:43] jml: ./bin/test --subunit | testr load [22:43] the other way around [22:43] run the tests that just failed [22:43] jml: Oh, I haven't done that [22:43] ok. me neither. [22:43] I'm not aware of a way to do that yet [22:44] Morning jelmer_ [22:46] mwhudson_: hmm, didn't work. when doing apply pystack, it complains with: No symbol "t_bootstrap" in current context [22:47] hm [22:47] that means threading isn't loaded === mwhudson_ is now known as mwhudson [22:47] BjornT: are you connecting to the right process? [22:47] there's a bit of a forest in make check [22:47] alternatively,,, [22:48] BjornT: try this .gdbinit instead: http://pastebin.ubuntu.com/359793/ [22:49] mwhudson: i think so. i'm running bin/test manually. i'm attaching to it with 'gdb /usr/bin/python2.5 $procid' [22:50] BjornT: just gdb -p $pid should be enoough [22:50] BjornT: i guess you can check which process is hogging the cpu in top... [22:53] mwhudson: right. i'm attaching to the process with 100% CPU. with the new .gdbinit i get this output, which i guess isn't expected: http://pastebin.ubuntu.com/359796/ [22:54] BjornT: which gdbinit is that with? [22:54] mwhudson: http://pastebin.ubuntu.com/359793/ [22:54] BjornT: try the one from the wiki page === flacoste is now known as flacoste_afk [22:55] what's the right way to make a distroarchseries? [22:56] jml: In a test? [22:56] wgrant, yeah. [22:56] jml: I think there's IDistroSeries.newArch [22:56] wgrant, thanks. [22:56] But normally we just use sample data. [22:57] mwhudson: with the one from the wiki page i get: http://pastebin.ubuntu.com/359798/ [22:57] (yes, evil, but so is the Soyuz data model) [22:57] BjornT: :( [22:58] maybe it's a 2.4/2.5 difference or something [22:59] BjornT: where are you? [22:59] i can come and try to help in person after the talk [22:59] wgrant, the problem is that the test_recipebuilder tests no longer work now that processor info is used :) [23:00] BjornT: oh [23:00] BjornT: do you have python2.5-dbg installed? [23:00] * jml pounds away [23:00] jml: Ah :( [23:01] mwhudson: i'm in the main auditorium now. although, i don't have that package installed... let me try installing that [23:01] BjornT: i'm in renouf1 so it should be easy enough to meet up after the talks if needed [23:03] although i'm running out of battery [23:05] mwhudson: ok. i'll try to grab you after the talks. installing python2.5-dbg mad things better, but still no information from pystack :( [23:05] bah [23:08] is it too late to say "don't use threads"? [23:12] jml: yes [23:12] sinzui, ping [23:12] BjornT: catch you in a bit [23:12] enobatter [23:13] :( :( [23:14] mwhudson, str(self.build.recipe.builder_recipe) doesn't do what I thought it should do === EdwinGrubbs is now known as Edwin-afk [23:15] hi deryck [23:15] sinzui, so I have a failing registry test in a new branch for me, that I think we should remove... [23:15] sinzui, see http://pastebin.ubuntu.com/359803/ [23:16] all of these tests passed last week [23:16] sinzui, the work flow is no longer supported because of my changes. if a project doesn't use LP for bug tracking, there is only a message on the bugs page saying "you don't use LP for bug tracking, enable bug tracking here." type link [23:16] sinzui, and this is well tested in the bugs tests. so I think we should kill the bits I show you in the paste. you okay with this? [23:17] deryck: great: I was writing that I think that test is a bogus exercise of a form [23:17] sinzui, excellent. thanks, sir! [23:19] deryck: the registry team will re-invent the set bug tracker forms in March as a part of our effort to improve drive-thru-registration [23:19] sinzui, sounds good [23:30] lifeless, do you have any thoughts on making test selection better? [23:45] does anyone have any idea at all about this error? http://pastebin.ubuntu.com/359816/