[00:00] ajmitch, those are bzr-ish errors, unlikely to be caused by a proxy [00:01] jml: well [00:01] What are the programming languages used in Launchpad? [00:01] lifeless, NoSuchRevision caused by a proxy? [00:01] jml: if pack-names gets cached in violation of our request it would cause that symptom [00:02] right, and I'd not really paid attention to the bzr+ssh:// part of that [00:02] neither had I:P [00:02] bzr+ssh definitely isn't a proxy [00:02] firefly2442, Python. Python. Python. :) [00:02] ajmitch: where are you seeing those errors? [00:02] i get this http://paste.ubuntu.com/223935/ when running make schema [00:02] thanks [00:03] lifeless: on checking various branches in lp-sourcedeps, when running rocketfuel-get [00:03] firefly2442, but you can get the code & look for yourself. :) [00:03] so [00:03] how can we get the ohloh guys to upgrade their version of Bazaar? [00:03] I'm just rerunning it at the moment after killing off the dulwich branch [00:04] etank: there's an instruction in that error message [00:04] Ah, you got /p/launchpad. Good. [00:04] jml: don't you have friends at sourceforge now? [00:04] wgrant, but we didn't get the name 'Launchpad'! [00:05] mwhudson, hmm. there's a thought. [00:06] jml: send in the hordes of rabid lawyers? [00:07] ajmitch: its an error, or something logged in .bzr.log? [00:07] * jml looks again at his beautiful diagram [00:08] lifeless: an error with a traceback, just waiting on it to reproduce [00:08] hey, it would be really nice if an error halfway through make didn't totally screw your working tree [00:09] I've found it in .bzr.log if you want it on pastebin [00:09] sure [00:09] mwhudson: i did that and got 'link-external-sourcecode: error: Parent branch not specified, and could not be discovered.' [00:10] http://paste.ubuntu.com/223939/ [00:10] etank: did you run rocketfuel-setup to start with? [00:10] mwhudson: yeah. [00:10] at least dulwich branched without errors after a careful rm -rf :) [00:10] it took quite a few hours to finish [00:10] though i have to admit, i can't get make to work either right now.... [00:11] etank: what's in sourcecode in your branch? [00:11] jml: call? [00:11] ajmitch: file a bug please [00:11] thumper, sure. fire away. [00:11] ajmitch: it looks like that branch hasn't been upgraded and the converter is running into trouble [00:11] ok [00:11] lifeless: So it was trying to convert to 2a? [00:12] on the fly yes [00:12] _fetch_batch [00:12] is part of IDS [00:13] That would be because rocketfuel-get was broken earlier, and was creating 2a repos before pulling sourcedeps. [00:13] Now it just checks them out, so no conversion is required. [00:13] thumper, try again please. [00:13] ooh [00:13] mwhudson: just whatever rocketfuel-setup put there [00:14] wgrant: regardless, it should have succeeded [00:14] etank: can you run python2.4 bootstrap.py --ez_setup-source=ez_setup.py --download-base=download-cache/dist --eggs=eggs [00:14] etank: and see what that says? [00:17] * gmb calls it a night. T'morrow, folks. [00:17] lifeless: what else do you need on https://bugs.edge.launchpad.net/bzr/+bug/402778 ? [00:17] Malone bug 402778 in bzr "NoSuchRevision error when branching with rocketfuel-get" [Undecided,New] [00:18] mwhudson: it said nothing [00:19] etank: and does plain 'make' work now? [00:20] will it ever become possible for community contributors to earn commit rights? [00:20] gmb, g'night. [00:21] nellery: good question! probably [00:21] nellery: though with a DVCS it's not that much of an issue [00:22] nellery: given that you can commit & push branches already & most likely propose them for review & merging, I'd say yes [00:23] nellery: in the sense of committing directly to trunk? no - noone has that right even @ canonical - commits are done by a daemon that runs the test suite [00:24] nellery: in the sense of being able to submit something to land; as mwhudson says, probably :) [00:24] there's info on the wiki about the steps to take for that [00:32] * jml grumbles, the point of commit messages is to communicate [00:34] Is there some kind of Launchpad Roadmap available? I was looking for the wiki integration, but all I found is this blueprint (https://blueprints.edge.launchpad.net/launchpad-registry/+spec/launchpad-wiki). It seems everything it links to has been removed from launchpad. I was just curious if there already is a decision on this topic. [00:35] jml: rather than defeating obscure regular expressions? [00:35] MarkusT1: there's https://dev.launchpad.net/VersionThreeDotO [00:35] mwhudson, wgrant: what exactly was the rocketfuel problem? [00:35] kfogel: i don't know exactly [00:35] kfogel: Which one? The 2a upgrade one that I referred to? [00:36] wgrant: "which one"... not reassuring words :-). Yes, I meant the 2a one I saw in backscroll. [00:36] mwhudson: It seems it's quite empty. So I guess: no decision made on that issue. [00:36] mwhudson: obscure regular expressions are cause & effect by an obscure joke by obscure losas [00:36] kfogel: the sourccode branches aren't in 2a [00:36] kfogel: and for at least one of them converting on the fly errors [00:36] MarkusT1: which issue, sorry? [00:37] kfogel: bug 402778 [00:37] Malone bug 402778 in bzr "NoSuchRevision error when branching with rocketfuel-get" [Undecided,New] https://launchpad.net/bugs/402778 [00:37] jml: is this in reference to knowing what pqm is apparantly listening to? [00:37] mwhudsono: The question whether launchpad.net get's a wiki or not. :-) [00:37] kfogel: rocketfuel-get had a brand new bug which treated all of the source dependencies as if they were SSO and ShipIt. So, to save time, it first branched devel into the target directory, then pulled the dep. This caused the deps to get on-the-fly conversions to 2a. [00:37] Which is slow and crashy. [00:37] lifeless, wgrant: thank you, got it. [00:38] ajmitch, in particular, it's in reference to the heinous practice of saying rs=me or release-critical=me [00:38] * thumper is trying to avoid the firehose that is #launchpad-dev :) [00:38] MarkusT1: launchpad.net will get a wiki [00:38] thumper: it's only a few people here causing the trouble :) [00:39] at least we're past the first hump === Ursinha is now known as Ursinha-bbl [00:39] yes, less spraying around now than before [00:39] I meant downloads actually ;P [00:40] kfogel: should standup minutes go to the launchpad-dev mailing list now? [00:40] I keep getting intermittent connection resets when talking to launchpad.dev, and the local XML-RPC server seems to do it consistently when I attempt to resolve lp://dev/ URLs. [00:40] thumper: Great news! Is there any announcement on that? (Besides you telling me now :->) [00:40] MarkusT1: there is much work to do for it [00:40] MarkusT1: it is in the planning phase post 3.0 [00:41] thumper: "XXX on leave for next week" probably shouldn't go to a public list [00:41] MarkusT1: we know what we want to offer, and no-one has done it yet [00:41] mwhudson: good point [00:41] thumper: I think so. If there's any company confidential stuff, it can go internal of course. [00:41] MarkusT1, https://bugs.edge.launchpad.net/launchpad-project?orderby=-users_affected_count [00:41] * thumper looks at his notes again [00:41] MarkusT1, it's the single most popular bug on the entire Launchpad project :) [00:42] thumper: that is, the confidential stuff can be separated out and go internal. But I think our standup notes should be like bzr's, which are sent publicly AFAIR. [00:42] jml: no, that's "cheddar" [00:42] kfogel: ok, will do [00:42] kfogel, *blink* [00:43] pkern: Have you succeeded in running publish-distro yet? [00:44] As long as it's on the agenda I'm allright. You guys proved very well how you're able to handle this project. I found the bug report before, I just could not find any official comment on it. Thanks for sharing. This is getting better and better :-) [00:45] I presume it's just a matter of populating distroseries.lucilleconfig and the librarian properly, then running it in full careful mode. [00:46] * thumper updates his trunks [00:47] hmm, what's the chance I actually write any code before lunch... [00:47] https://www.ohloh.net/topics/3685?page=1#post_11061 [00:47] depends how strong your "ignore stuff" field is [00:47] * mwhudson is coding [00:47] (and gabbing while acceptance tests run...) [00:48] I wonder how uploadpolicy is wired into the system, because that might screw with my tries to add a distroseries for Debian. [00:49] I might just manually process a PPA upload a publish PPAs for now. [00:49] jml: yayness [00:49] Since the librarian is decidedly file-less, and I can't be bothered working out how to get gina to work. [00:54] wgrant, spiv has commented more than once in my hearing that the librarian is an ideal candidate for spinning off into a standalone app, fwiw [00:58] thumper: barry points out that standup notes can contain vacation times and other personal stuff, and that therefore they shouldn't be public [00:58] thumper: I think we're going to need to think about this more carefully; I will ponder and post a proposal, but for now do it internally I guess. I think really we're going to have to have two versions: one with internal stuff and another with public dev stuff. [00:59] kfogel: I checked my standup notes for personal details [00:59] kfogel: I agree we should be careful with what we put in public notes [00:59] mwhudson: no make does not run [00:59] i get the same error [01:00] etank: i can only suggest running the commands make is running one by one (without the ssh.py bit) and seeing what is breaking [01:00] thumper: but we will need a system that is documented and can be routinized. We don't want team leads having to improvise this every time. [01:02] kfogel: right === matsubara is now known as matsubara-dinner [01:13] What happens with mail in devmode? I expected it to go to /var/tmp/launchpad_mailqueue, but it instead seems to be sent to root. [01:15] well yes, it gets sent to root [01:15] i once found the code that did that, i can't remember where it is though [01:26] ping [01:26] oh wow [01:26] from lp.registry.model.person import *\nAttributeError: \'module\' object has no attribute \'generate_nick\'\n' [01:26] not managed that one before [01:26] (it's a circular import, of course) [01:27] Did anyone try/manage to install launchpad on Debian (lenny)? [01:29] hmm. I seem to be getting conflicts every time I pull. :\ [01:31] I guess that's because a directory change is moving through the trunk branches. [01:35] bz_g, I don't think anyone's tried yet, that I know of. [01:37] it would be nice if different pyflakes warnings came out as different colours in flymake [01:37] that sounds kind of hard to achieve though [01:38] mwhudson, interesting notion. [01:38] mwhudson, have you got pep8.py hooked up to flymake as well? [01:38] jml: no [01:39] mwhudson, I do, and I'm quite liking it, but I do wish the warnings were differently coloured. [01:40] jml: time to read flymake.el a bit i guess! [01:40] mwhudson, good luck. [01:40] Here is your elisp trowel. Use it wisely. [01:41] it has different faces for errors and warnings at leas [01:41] t [01:42] mwhudson, pyflakes doesn't really distinguish between the two though [01:42] right [01:42] * jml sometimes wonders if it should have some more reporting options. [01:42] i guess it's a regexp somewhere in flymake to try to tell the difference [01:43] \o/ [01:43] heh [01:43] it's a warning if the string "warning" appears in the output i think [01:44] and an error otherwise? [01:44] ah, mildly more complex than that [01:44] jml: yeah === matsubara-dinner is now known as matsubara [01:52] Hmmmmm. The Soyuz karmaactions are in sampledata/current.sql, but not sampledata/current-dev.sql, so they were missing from my DB. Why would that be? [01:52] mwhudson: you mean flymake is two-faced? :) [01:52] spiv: zing! [01:53] jml: thanks. Maybe I'll give a go... [01:53] wgrant: the sampledata used for tests is not the sampledata that you get when you run make run and poke around [01:53] wgrant: i don't know which is which any more :) [01:53] we want to reduce the sampledata used for tests [01:54] The missing karmaaction was crashing things :( [01:54] Yay, a successfully populated and published PPA. [01:55] * mwhudson goes for lunch [01:59] I tried really hard to find the right documentation, but I still have a question left :-) : How do I actually delete projects and users in lp as the foo.bar admin user? I'm able to set projects inactive, but I can't find the "delete" button? :-/ [01:59] MarkusT1: Projects are only ever deactivated. [02:00] They can't be deleted. [02:00] Same with people. [02:00] wgrant: Ah thanks. So at least I can stop searching :-) [02:01] congratz to launchpad-dev team \o/ . [02:02] lajjr, thanks :) [02:05] your welcome great source release. I can't wait to look at the code. [02:06] * Snova_ would, but 280 MB is huge for this time of day [02:08] I download the tar.gz file and it is done, but the ./rocketfuel-setup started 10 mins ago. [02:09] I think that might be awhile yet :P [02:09] lajjr: Did you prepopulate the repository with the tar.gz's contents? [02:09] yep.. [02:09] (also, rocketfuel-setup calls rocketfuel-get, which downloads lots more) [02:09] it will work right?? [02:10] What is rocketfuel-setup saying it's doing? [02:10] downloading the deps apache etc. [02:12] fresh install on a new laptop Jaunty 9.04. [02:14] You can use the following commands to manage your Launchpad [02:14] development environment: [02:14] rocketfuel-get [02:14] Update your copy of devel and the necessary source [02:14] dependencies, and make sure all source dependencies are properly [02:14] linked in to all the branches you are working on. [02:14] rocketfuel-branch foo [02:14] Create a new branch of LP called "foo" in [02:14] /home/lajjr/launchpad/lp-branches/foo, [02:14] with all the source dependencies properly linked in. [02:14] rocketfuel-status [02:14] wow I guess it's done. [02:15] ooi, is there a summary of what couples Launchpad to a specific python version so much more so than other python code? [02:15] yep it just ran a list with that at the top.. [02:16] rocketfuel etc etc rocketfuel status etc. === Ursinha-bbl is now known as Ursinha [02:16] lajjr: That doesn't tell you much. What does ~/launchpad/lp-branches/devel/sourcecode have in it? [02:21] thumper, mwhudson, rockstar: there are still a few untested test plan items [02:21] * thumper looks [02:22] ok hold on. [02:22] maxb: zope [02:24] lp-branches lp-sourcedeps [02:24] nd the script rocketfuel-setup [02:25] s/nd/and [02:25] maxb, we're very close to being able to switch to a more modern python. [02:26] and we can't wait [02:26] which will be great for those of us who use karmic. [02:26] thumper, indeed :) [02:28] jml: given the sort of people who are probably likely to grab a copy of the launchpad source, running on karmic may be a good thing :) [02:29] ajmitch, yeah [02:29] ajmitch, I'm running in a hardy chroot atm, which is working out ok [02:29] it'd save me trying to dig around in makefiles to get simple things like bin/py [02:29] ajmitch, but I have a screwed up postgres config which is causing difficulties. [02:30] I should probably setup something in kvm anyway [02:32] one consideration is that we deploy on LTS [02:32] spm: is there going to be a staging update before rollout? [02:32] so we need to keep working there regardless of the current ubuntu development status [02:33] maxb: i bet most blobs of python code as large as launchpad end up fairly tied to a specific python version [02:34] jml: looking [02:34] mwhudson, thanks. [02:34] it takes more work than one might think to support more than one python version reliably. [02:35] guh. [02:35] it's like 0.0001 units of aggravation per line of code or something [02:35] so distracted that I have a half written item in my todo list :\ [02:35] mwhudson, what is the SI unit for aggravation anyway? [02:36] jml: i don't know, i'm sure we can come up with something suitably offensive [02:36] jml: the BSOD ? [02:36] jml: "the openoffice" ? [02:36] hahaha [02:36] jml: I dunno, we do 2.4/2.5/2.6 quite easily in bzr [02:37] jml: the clippy [02:37] lifeless, I think that's the imperial unit. [02:37] * mwhudson plays the "is my code on staging yet" game [02:37] lifeless: have you seen http://www.ntk.net/doh/options.html ? [02:37] lifeless, I bet you had to change code to support 2.5 and 2.6. [02:38] jml: yes, but it was pretty painless, and we don't routinely have trouble with new code [02:38] mwhudson: classic, and no, I hadn't [02:39] lifeless: one of the funniest things on the internet i think :) [02:39] Annoy me with that sodding paperclib: [02:39] ( ) all the time [02:39] (*) when i least expect it [02:43] thumper: staging restore: Wed Jul 22 02:17:56 BST 2009 Lock file deleted. Script finished [02:44] spm: when was that? [02:45] like half an hour ago? [02:45] yup [02:45] spm: but staging is revno 8298, and I need 8301 :( [02:46] spm: why did staging come up with old code? [02:46] erm [02:46] thumper: mainly as the actual code side happened about 12 hoursish ago [02:46] is stable still being merged into db-devel [02:46] ? [02:47] :( [02:47] mwhudson: it should be [02:47] 1 failure on db_lp builder [02:47] :( [02:47] thumper: I lie. code was updated ~ Tue Jul 21 21:27:44 BST 2009 [02:48] WTF? [02:48] why is the doc test printing out javascript code??!?! [02:49] lol [02:49] i need to test the revision _after_ what is running on both staging and edge [02:49] damn sprite! [02:50] beuno: was that you? [02:50] mwhudson, my script says there's 1 revision in devel not in stable, and 4 in db-devel that aren't in db-stable [02:50] mwhudson, but that stable & db-devel are up to dae [02:50] jml: cool, i was confused for a few minutes, but i've got it figured out now, i think [02:51] kernel update caused a reboot. lol [02:55] * jml has a buildout moment [02:56] jml: i made a branch earlier, buildout broke and the easiest thing to do seemed to be to throw away the branch and start again === matsubara is now known as matsubara-afk [02:59] :\ [02:59] mwhudson, sometime after the release, we need to make sure that sourcecode/bzr never ever gets created an automated process [03:00] mwhudson, there's a great well of hidden errors just waiting to bite us there. [03:00] jml: maybe there should be an engineer devoted to working on these things for an entire cycle! [03:01] jml: we need to be careful we never import the system bzr somehow too [03:01] (god knows how) [03:01] mwhudson, hmm. [03:02] mwhudson, we could make all of launchpad a bzr plugin & use bzr's api thing [03:02] jml: i admit that wasn't a suggestion i was expecting! [03:02] mwhudson, :) [03:04] I likes it [03:10] * mwhudson finds canonical.launchpad.scripts.logger.BufferLogger, finds it to be a piece of crap [03:11] :) [03:14] beuno: so what happened with your laptop yesterday? Did you ever get it working again? [03:20] sinzui: I changed bug #386797 to invalid; hope that was okay. [03:20] Malone bug 386797 in launchpad-foundations "Enable distributed content development" [Undecided,Invalid] https://launchpad.net/bugs/386797 [03:21] kfogel: not at all [03:23] sinzui: not okay? [03:23] :-) [03:23] sinzui: "not at all" is ambiguous in this context, but I assume you meant "no problem at all" [03:24] kfogel: it is okay. Francis would ignore it for a few years. I even suggested that he spend a day Triaging bugs because he could close 50 of them [03:24] * jml instruments [03:24] closing 50 bugs would be nice [03:25] Since foundations was the old Launchpad, Francis could easily transfer 50 bugs to each our our porjects [03:25] that would be less nice [03:25] sinzui: I've been a bit hands off about triaging bugs, not knowing if I should be making decisions like that. Should I be a bit more aggressive and assume that mistakes can be corrected? [03:26] We should be honest [03:26] If we really don't intend to do it, close it [03:26] jml: how about: BranchCollection.getTeamsWithBranches(person): [03:26] """Return the Teams that person is a member of that have branches.""" [03:26] sinzui: agreed. It's not like the record of the conversation is lost if we close it anyway. [03:27] Every bug in blueprint, launchpad-answers, and launchpad-registry really should be fixed or implemented. I wish that was true of foundations [03:27] kfogel: right. The cost of a mistake there is pretty low. The worst is probably offending the reporter, which is a pretty bad thing to do, but ignoring their report is probably just as bad... [03:27] thumper, what's the question exactly? [03:27] jml: comments on a BranchCollection method to return a result set of People [03:27] thumper, ahh ok. [03:28] jml: good or not? [03:28] jml: it'd use the _getBranchIdQuery [03:28] thumper, my spider sense is tingling [03:28] thumper, why do you want it? [03:28] jml: mostly, but tweak for owner [03:28] jml: we need to be able to get the teams that have branches in a given collection for a person quickly [03:28] jml: one query rather than one query per team [03:29] jml: beuno is in 86 teams, and the query is taking 150ms ish [03:29] thumper, is this to generate links from the Person branch listing? [03:29] jml: yes [03:30] thumper, I feel that it's something of a violation of the spirit of the interface, but I don't have any better ideas right now. [03:30] jml: we already have branch collection returning branches and merge proposals [03:30] jml: we could add a new utility somewhere [03:30] jml: not sure what to call it though [03:31] thumper, returning branches is its raison d'etre, and merge proposals are a pretty natural follow on. [03:31] jml: yeah, I know [03:32] jml: but not sure how to get at the collection internals without it being a method on the collection itself [03:32] thumper, yeah. me neither. [03:32] thumper, I think just put it in there for now, making a comment about how it doesn't quite fit. [03:32] jml: ok [03:33] * jml idly wonders why 'reason for being' lacks punch in English. [03:34] jml: "to be or not to be"? [03:37] spiv: that isn't punchy either [03:43] instrumenting code :( [03:46] mwhudson, I wonder. [03:47] mwhudson, how would monkey patching and lazr imports interact, do you think? [03:47] jml: lazy imports? [03:47] mwhudson, yes. [03:47] sorry. [03:47] jml: i guess it could get exciting [03:47] jml: does ScopeReplacer implement __setattr__ ? [03:48] jml: i think i guess where you're coming from [03:48] lazr imports? [03:48] thumper, lazy. [03:48] jml: lp-serve not logging oops? [03:48] jml: sorry, read that just after hitting enter [03:48] mwhudson, I can't hide anything from you, can I? :) [03:49] jml: lazy imports --- day before release --- monkey patching --- talking about test plans earlier [03:49] jml: it wasn't _that_ hard :) [03:50] oh and this brain wave sensor [03:50] * jml throws away his aluminium foil hat [03:50] I knew it. It *has* to be tin. This one's no good. [03:50] jml: go get your cowboy hat :) [03:55] mwhudson, I now have solid evidence that the monkeypatched version is not being called. [03:55] mwhudson, what is this ScopeReplacer of which you speak? [03:55] jml: it's an implementation detail of lazy imports [03:55] bzrlib.lazy_import [03:56] oh. bzr-grep usage fail [03:57] mwhudson, it looks like it implements __setattr__ beautifully. [03:58] jml: new theory required then [03:58] dammit. going to have to do this the Right Way. [03:58] damn storm compilation problems [03:58] * thumper smacks head on thetable [03:59] mwhudson, I think I have a new theory. [03:59] jml: does something somewhere do "from bzrlib.trace import log_exception_quietly" ? [03:59] mwhudson, bzrlib.smart.protocol imports 'log_exception_quietly' directly from bzrlib.trace before it gets patched [03:59] jml: arghlbargl [03:59] mwhudson, ... [04:00] mwhudson, so I can shuffle around some code, probably. [04:01] statement: SELECT Branch.id, Branch.unique_name FROM Branch WHERE false AND Branch.private = false [04:01] mwhudson, or I can abandon this approach and do it the right way by giving bzr the appropriate hooks. [04:01] that's not a very useful query [04:01] no, 'tisn't. [04:01] i wonder why storm is generating it [04:01] jml: i think the time may have come for the right way [04:02] oh ffs [04:02] mwhudson, ok. I'll file bugs appropriately and prepare a patch for bzr [04:03] jml: cool [04:03] mwhudson, the code I've already written in Launchpad was deliberately designed to be easy to switch to hooks [04:03] so I should only have to change one or two functions & probably none of the tests. [04:04] jml: yay [04:04] * jml -> lunch etc. [04:32] http://pastebin.ubuntu.com/224061/ :( [04:38] mwhudson: eh? [04:38] thumper: circular import [04:38] mwhudson: I think I know why [04:38] yeah [04:38] mwhudson: you need to import canonical.launchpad.database first [04:38] import * is evil [04:38] it blows [04:39] that it is [04:39] bug 402845 [04:39] Malone bug 402845 in launchpad-registry "./bin/py -c 'from lp.registry.model import person' fails due to circular import" [Undecided,Triaged] https://launchpad.net/bugs/402845 [04:39] thumper: removing import *s from canonical.launchpad.database will help i think [04:39] mwhudson: yeah, but likely to be a world of hurt [04:39] mwhudson: it was a PITA when I did the code ones [04:39] mwhudson: all the page tests :( [04:40] thumper: maybe only a continent of hurt [04:40] mwhudson: an Australia of hurt [04:44] thumper: want to review https://code.edge.launchpad.net/~mwhudson/launchpad/much-faster-rewrite-map/+merge/9121 ? [04:44] lifeless: you might be interested too [04:44] * thumper looks [04:45] awaiting diff [04:45] mwhudson: not really, unless its different than we discussed [04:45] mwhudson: does it nuke the cache? [04:45] fair enough [04:45] lifeless: what do you mean? [04:45] it still caches [04:46] how fast is a miss now? [04:46] but cache misses are done via 1 direct query [04:46] lifeless: < 1 ms i hope [04:46] thats pretty good [04:46] I'd really like to nuke the cache [04:46] or get a stream of updates from the db [04:47] thats 300K RPS we can serve @ 1ms per query [04:47] sorry, 300K Requests/5minutes [04:47] only 7 times our peak yesterday :) [04:48] lifeless: i imagine stub would like the database to be able to do something else as well as serve these requests [04:48] i guess we'd only peg a core at worst [04:48] at 1ms each we won't even come close to pegging a core [04:49] even at yesterdays peak [04:49] lifeless: i think there's a good case for a very short cache, because of ".bzr/smart, .bzr/branch-format, .bzr/branch/format" [04:49] If it is a problem, we can get a dedicated db for this. I'd also consider if memcache is a good solution - we know we need it in other areas, we just need to integrate it all into the test suite so it is easy to use. [04:49] mwhudson: I think theres a strong argument for truncating the mapping at .bzr [04:50] mwhudson: because everything to the right is bzr internals [04:50] lifeless: what? [04:50] the rewriter doesn't need to map foo/.bzr/baz [04:50] only foo/ [04:50] right [04:50] lifeless: maybe you should look at the code? [04:50] hmm, also backup.bzr [04:50] and .backup.bzr [04:50] mwhudson: perhaps [04:51] mwhudson: right now, I am trying to finish fixing iter_changes [04:51] lifeless: also codebrowse! [04:51] I'm still unsure why we need to do substring matching (WHERE foo IN ('a', 'aa', 'aa/a', 'aa/aa') rather than splitting the path on '/' and looking for WHERE foo in ('aa', 'aa/aa') [04:51] lifeless: fair enough [04:51] mwhudson: doesn't codebrowse map itself? [04:51] lifeless: only when the request gets to codebrowse... [04:51] stub: we don't [04:52] stub: my code splits on '/' [04:52] ok [04:52] stub: splitting on characters is actually wrong as well as just inefficient [04:52] mwhudson: if my looking at the patch will help you, I will [04:52] otherwise I trust in review :) [04:53] lifeless: ok [04:54] lifeless: i only suggested you looked (the second time) because you kept asking questions :-p [04:54] :) [04:55] mwhudson: -> #launchpad-reviews [04:57] Getting rid of the cache or using a shared cache like memcache is needed to avoid weirdness when we scale horizontally - you don't want two different requests accessing different branches because they where served by different Apache's. [04:58] I guess we have that problem already though if someone renames a branch. [04:59] thumper: i'm there [05:10] * wgrant juat managed to convince his local Launchpad to accept a PPA upload, publish it, build it, accept the binaries, and publish them. [05:10] wgrant: woo! [05:10] wgrant: great, how much did that take to setup? [05:10] & have you documented whatever's missing for the rest of us? [05:11] ajmitch: I've got notes here. [05:11] It took a while, as there are almost no docs around... [05:11] And there are some nice obscure bits. [05:13] One particularly time-consuming bit was working out why my builds weren't being dispatched. Apparently they will only be dispatched if there is a source published in the archive. [05:13] Which doesn't make too much sense. [05:13] well [05:13] it does, when you consider NEW [05:15] But we build from ACCEPTED now. [05:15] I have a suspicion as to why it's like that. [05:15] But I need to find the bug report... [05:15] ok, you're the expert :P [05:17] OK, no, it wasn't what I thought. [05:27] just realized today it's exactly one year I joined lp team [05:27] Ursinha: congrats [05:28] hello again [05:28] thumper, thanks :) [05:28] Ursinha, grats. [05:28] Ursinha, time flies when you're having fun :) [05:28] jml, thanks [05:28] jml, well said [05:28] I'll quote you in my blog post :P [05:29] haha [05:29] oh, that reminds me. [05:29] what's so funny about ultimo.fm? [05:29] jml, lol [05:29] jml, that was a bad translation, because last == ultimo in portuguese [05:30] but last.fm isn't translatable... :) [05:30] Ursinha, I thought it might be something like that :) [05:30] jml, :) [05:44] * thumper goes to make veggie curry [05:57] ajmitch: http://williamgrant.id.au/f/1/2009/soyuzness.html [05:57] Some of that was done some time afterwards, so there might be issues. [05:57] nice, thanks [06:02] wgrant: wow, very determined of you [06:03] mwhudson: It looks harder than it is. [06:03] some of that should probably be turned into patches. [06:03] I suspect so. [06:04] A fair bit of stupidity is needed because the sample data is prehistoric, but I guess that's not easily fixable due to the tests. [06:04] But a lot of that can go into rocketfuel-setup. [06:04] wgrant, the sampledata used by the development config is separate from that used by the testrunner config [06:04] jml: Oh. [06:04] Useful. [06:05] wgrant, I think if you just get your dev environment set up with the right sampledata & run 'make newsampledata', you should be close to done [06:05] I think [06:05] it's been a while since I've touched the sampledata, as you can tell. [06:06] current-dev.sql? [06:06] yeah [06:06] I only took a brief look in there, so wasn't sure which to use [06:07] It seems I should have read database/sampledata/README. It explains all. [06:08] I'll gladly review & merge patches that make our docs better / more discoverable. [06:10] I might run make check tonight to see how long it takes on my laptop... [06:10] wgrant: I take it you're doing all this on jaunty? [06:10] ajmitch: In a Jaunty chroot, yes. [06:11] Since that was easier than convincing LP to work on Karmic, I suspect. [06:11] yes, I've tried a little with it on karmic, didn't get far & didn't really expect to anyway [06:12] have you tried it on Jaunty? [06:12] I think rocketfuel-setup should Just Work now. [06:12] not yet, I'd rather set it up on a fresh apache & postgres [06:13] That's what schroot and KVM are for. [06:14] yep, I just didn't have time last night after waiting for it all to download [06:14] I couldn't get Launchpad running on karmic either, fwiw. [06:15] jml: various packages have had their python 2.4 support removed [06:15] yeah. [06:15] I didn't try very hard. Once I saw rocketfuel-setup fail to install launchpad-developer-dependencies from ~launchpad's PPA, I dropped into a chroot. [06:15] ajmitch: I'm not sure many more have in karmic than in jaunty. [06:15] probably not many [06:15] well, I tweaked python-support to build for 2.4 [06:15] but I got to the point of it failing to do anything with bin/py [06:15] but not all of our deps use python-support [06:16] Doing it in a chroot is probably a good idea anyway, as it does like to put stuff everywhere. [06:17] so I noticed [06:17] I'll have to take care not to destroy the current postgres data I have [06:18] another thing we'd like to do is make it so we can run more than one instance of the test suite on the same machine [06:19] partly because it's a laudable goal in itself, partly so we can use more than one core [06:23] * al-maisan has installed the LP development environment in a (hardy) chroot as well; works like a charm :) [06:23] al-maisan, my postgres config is a little dodgy still [06:23] probably my fault. [06:23] jml: aha [06:23] * wgrant now tries to work out how to use gina. [06:23] I think it's because my karmic postgres & hardy postgres want the same resources. [06:24] jml: like ports..? [06:24] al-maisan, yeah, and pid files maybe [06:24] * jml hasn't investigated. [06:24] * mwhudson is EODing soon, shout if you want me to do anything today... [06:25] * al-maisan installed the chroot according to https://wiki.ubuntu.com/DebootstrapChroot and has no issues with postgres [06:25] * ajmitch would suggest supplying beer, but it's probably a little far [06:28] jml: the PID files are kept here: [06:28] CHROOT db-devel $ l /var/run/postgresql/ [06:28] 8.3-main.pid .s.PGSQL.5433= .s.PGSQL.5433.lock [06:28] .. and the chroot has it's own /var partition [06:29] the config files are here: [06:29] CHROOT db-devel $ l /etc/postgresql/8.3/main/ [06:29] environment pg_hba.conf pg_ident.conf postgresql.conf start.conf [06:32] al-maisan, thanks. [06:33] jml: hope it helps :) [07:19] * jml moves closer to a power point [07:52] Anyone in this time zone who can give me a release-critical? [07:54] stub, no. [07:54] stub, kiko will be probably be awake soonish. [07:56] * jml makes a note to change getAnyPocket to return something other than release [07:57] Is any particular HTML documentation generator favoured? [07:58] wgrant, for API docs? [07:59] wgrant, pydoctor for API docs, sphinx for other docs [07:59] jml: Right. [07:59] I don't see a make target, so I guess just run it manually? [07:59] wgrant, mwhudson wrote pydoctor, and might well have a recipe somewhere. [07:59] wgrant, probably run it manually -- I've never tried on Launchpad. [08:00] wgrant, I'd be very excited to see a make target though. I just added one to GTG. [08:00] * jml pokes around a bit [08:07] there are up-to-date api docs online, just not public (yet) [08:07] i guess i should move that onto people.canonical.com [08:08] mwhudson, is that the same thing as people.ubuntu.com? [08:08] jml: yes [08:15] jml, mwhudson: Ah, I see. [08:15] They might be useful. [08:15] There's a lot of code. [08:15] you noticed :) [08:16] oh that reminds me, I should put bzr-tools.el on the wiki. [08:17] wgrant, 'make tags' can also help a lot for navigating the code [08:17] wgrant: have you built Launchpad yet? [08:18] (I might be missing backscroll, just got back from afk.) [08:18] kfogel: Oh yes, I had the webapp working after a bit over 3 hours. [08:19] I've even had Soyuz bits working today. [08:19] wgrant: nice! [08:19] And I'm currently trying to work out how to run a local keyserver. [08:19] wgrant: er, well, you took less time than I did to do that, and I work for Canonical. Hats off! [08:20] hey adeuring [08:20] kfogel: but wgrant had already deduced most of the launchpad innards a long time ago ;) [08:20] noodles775: I ended up getting a full upload, build, publish working. [08:20] hi kfogel [08:20] wgrant: cool! [08:21] * wgrant [08:22] Oops. [08:26] noodles775: Any idea how I'm meant to run zeca/buildd-master? I've been running them manually with twistd for now - some other daemons are registered in canonical.launchpad.scripts.runlaunchpad, so are runnable with bin/run, but not those. [08:26] noodles775, hi :) [08:27] I just realized that by cunningly getting distracted in the middle of the day I'm in prime-time to get help from soyuz folks for this patch :) [08:28] wgrant: we don't (at least, I haven't) run the build master et al locally... for local development we usually just depend on the testing infrastructure (see SoyuzTestPublisher), and then test on dogfood... [08:28] wgrant: but cprov will undoubtedly know more. [08:28] jml: hi! Which patch? [08:29] noodles775: Hm, OK. [08:29] noodles775, bug 345737 [08:29] Malone bug 345737 in launchpad-code "lp:ubuntu/package should resolve" [High,In progress] https://launchpad.net/bugs/345737 [08:29] noodles775, sorry, bug 347768 [08:29] Malone bug 347768 in launchpad-code "Allow anyone with upload rights to write to a package branch" [High,Triaged] https://launchpad.net/bugs/347768 [08:30] wgrant might want to look too... [08:30] oh, you're already subscribed by default, so have probably already seen it ;) [08:31] Good morning ladies, gentlemen and variations thereupon. [08:31] I'm not stuck yet. just poking around trying to find how to allow someone to upload to a package. [08:31] jml: archivepermission is the magic thing. [08:32] And they're manipulated on IArchive, at least through the webservice... [08:32] * wgrant needs to poke around inside the code. [08:33] jml: why do you want to allow someone to upload a package? don't you just need to check whether someone has permission to upload a package? [08:34] wgrant: Ah, thanks for poking there. [08:34] jml: there are 3 types of archive permissions: based on components, source package names and (new!) package sets. [08:34] pkern: Where? [08:34] ... and I was about to say, al-maisan is the person to speak to there (having just implemented the new package set permissions) [08:34] excellent [08:35] al-maisan, so, my mission is to make it such that if you can upload to a package, then you can write to any branch officially linked to that package. [08:35] al-maisan: is it possible for us to abstract away the fact that there are currently 3 different ways? Or perhaps we already do? [08:35] al-maisan, to do this, I need an API for checking to see whether a person can write to a package [08:35] and a way of granting such permissions. [08:35] jml: that API already exists [08:35] (the latter being for unit tests) [08:35] let me find it for you. [08:35] al-maisan, thanks. [08:36] wgrant: Into the upload rights code. ;-) [08:36] pkern: Ah. [08:36] pkern: What did you end up doing with Soyuz? [08:36] thumper, why is bug 243135 invalid? [08:36] jml: Bug 243135 on http://launchpad.net/bugs/243135 is private [08:38] jml: IArchive.getPermissions() is the method you'd want to use. [08:38] al-maisan: Why not IArchive.canUpload? [08:39] or check_permissions(sourcepackage, 'launchpad.Edit') for that matter [08:39] al-maisan, thanks, looking now. [08:40] wgrant: IIRC Archive.canUpload() only operates on components .. but let me look again. [08:41] al-maisan: component_or_package, it takes. [08:46] wgrant: canUpload() eventually invokes getPermissions() === j^_ is now known as j^ [08:47] al-maisan, next question, why not check_permissions(sourcepackage, 'launchpad.Edit')? [08:48] jml: let me have a look. [08:48] thanks. [08:48] There's no ArchiveSourcePackage, is there? [08:51] * gmb achieves inbox 4, is satisfied [08:51] Has anyone else struggled to make LP work on jaunty because of apt installing a broken python2.4 installation? It doesn't seem to have installed any of the python-support/central stuff for the new runtime, and the sys.path doesn't include any directories in /usr/lib ! [08:52] maxb: I haven't seen that - I installed it in a fresh Jaunty chroot last night, and it worked fine (except for the other issues) [08:53] hrm :-/ [08:53] maxb: How far have you got with trying to run LP? The LP buildout process creates a bin/py executable with the right sys.path. It also builds all the eggs that you need inside the Launchpad tree rather than polluting your site-packages. [08:53] maxb: Try apt-get reinstall launchpad-developer-dependencies, see if that helps any. [08:53] No, I think it's actually my system install of python that's broken [08:54] python2.4 -c 'import sys; print sys.path' is missing lots of things which should be there [08:54] Hmm. [08:54] even after purging and reinstalling the package [08:55] maxb: You even purged python2.4-minimal? [08:55] yup [08:55] Huh. [08:55] my thought [08:55] meh [08:55] * my thoughts exactly :-) [08:56] jml: check_permission() uses checkPermission() zope.security.management .. how does one configure or hook into the latter? [08:56] al-maisan, canonical.launchpad.security is scanned automagically [08:56] hmm. and maybe there's some zcml [08:57] * al-maisan looks at ./lib/canonical/launchpad/security.py [08:57] there's IPackageUpload and IPackageUploadQueue in there [08:58] and launchpad.Append on IArchive [09:02] jml: hmm .. it looks like the piece you'd like to have still needs to be added to lib/canonical/launchpad/security.py .. sorry [09:02] al-maisan, no worries. [09:04] al-maisan, I'd be happy to add it, but I'm not sure exactly what to make it do. [09:04] bigjools, hello [09:04] /away [09:04] morning! [09:04] bigjools, we're just talking about fixing bug 347768 [09:04] Malone bug 347768 in launchpad-code "Allow anyone with upload rights to write to a package branch" [High,In progress] https://launchpad.net/bugs/347768 [09:04] ok [09:05] morning bigjools [09:05] trying to figure out the best way of asking whether a person has upload rights to a package, and how to grant them said rights (for testing) [09:06] there's a few checks done in the upload processor [09:07] unfortunately there's no single call that will give you a yes or a no [09:07] bigjools, lp.soyuz.scripts.soyuz_process_upload being the starting point, right? [09:07] * bigjools stabs Firefox and the xorg intel driver [09:07] bigjools, karmic upgraded the intel driver today. :) [09:08] jml: no, IArchive.canUpload() [09:08] let me refresh my memory and then I can talk more sense [09:08] bigjools, how do I get to that from an ISourcePackage? [09:08] and possible reboot [09:08] bigjools, cool, thanksn. [09:09] jml: well you need to know which archive you're uploading to [09:09] presumably it's based on a distro, do you can use IDistribution.main_archive [09:09] but that obviously only covers the case where you want to upload to, well, the main archive :) [09:10] argh, fscking FF and xorg both using over 1Gb resident [09:10] bigjools: Karmic? [09:10] jaunty [09:11] Ah. That would be your problem. [09:11] bigjools, that's probably what we want here. [09:11] bigjools, since these are for official package branches for a distroseries, pocket. [09:11] I tried the karmic kernel and xorg driver a month aho and it was no better [09:12] jml: because the tests aren't there any more :) [09:12] * thumper thinks... [09:12] jml: great, so the next thing to work out is whether there are package-specific permisssions, component-specific permissions then packageset permissions [09:12] thumper, yeah. I checked. [09:12] thumper, and at their new location, the test modules have been correctly factored. [09:12] thumper, so it's a little more fix released than invalid. [09:13] thumper, but no big deal. [09:13] bigjools: I understood jml merely wants a yes/no answer.. [09:13] yes. [09:13] what al-maisan said :) [09:13] that's not possible [09:13] like I already said [09:13] ok. [09:13] jml: changed to make you feel better :) [09:14] thumper, you're a champ. :) [09:14] bigjools: assuming jml knows the destination archive, IArchive.canUpload() should provide the yes/no answer .. [09:14] al-maisan: no, it can't [09:14] please explain. [09:14] you also need to know the package name, a component name or a packageset [09:15] you only don't need those if you have a PPA [09:15] ah, right. [09:15] bigjools, we have the package name, since we have an ISourcePackage. [09:15] jml: that's a good start :) but not enough yet [09:15] you also need to know which component it's headed for [09:15] and you have to check both [09:15] * jml buckles up and sits tight. [09:16] so start with canUpload(user, package_name) [09:16] if it works, great [09:16] if it doesn't, you need to use canUpload(user, component) [09:16] bigjools, if I know the distroseries & sourcepackagename, can I can derive the component? [09:16] yes [09:16] you need to work out where it's published [09:16] that was where I was going next :) [09:17] jml: I'll point you at example code [09:17] how bout I just sit quiet for a bit then? :) [09:17] lib/lp/archiveuploader/nascentupload.py [09:17] verify_acl() does the upload checks [09:18] bigjools: that's a great pointer! [09:18] jml: you need to know which pocket it's being uploaded to as well, you have a suite somewhere IIRC? [09:18] * jml looks [09:18] bigjools, yep. [09:19] jml: you can also look at BugNomination.canApprove(), which does similar check (except that it doesn't check for packagesets yet) [09:19] http://paste.ubuntu.com/224163/ [09:19] jml: ok so you need to look up the SPPH for that package/pocket [09:19] BjornT_: you need to fix that for karmic :) [09:19] that's the test I'm halfway through writing. [09:20] jml: distroseries.getPublishedReleases() does that lookup [09:20] bigjools: how about finally adding a method that gives you a yes/no answer? ;) this is at least the second time we implement these checks. [09:20] BjornT_: it's not possible [09:20] bigjools: that is, second time outside of soyus [09:21] bigjools, and once I get the SPPH [09:21] bigjools: why not. how can i and jml get a a yes/no answer if it's not possible? [09:21] there are three different things to check depending on what data you have [09:21] and which distroseries it is [09:21] (after karmic) [09:22] jml: once you get the spph, you can get spph.component, and pass it to canUpload() [09:22] bigjools, how will I know which element from getPublishedReleases to use? [09:22] bigjools: both jml (i think at least) and i have an ISourcePackage. i.e., we have a source package in a distro series. all information can be derived from that, can't it? [09:23] bigjools: if not, then i'm doing something wrong [09:23] BjornT_, I do have an ISourcePackage. [09:23] BjornT_: you need the pocket as well, but after that yes, we could factor it somewhere [09:23] bigjools: how do i know the pocket? [09:24] BjornT_: it depends on where the package is being uploaded to [09:24] and is data that you need to supply [09:24] bigjools: can the same ISourcePackage be uploaded to multiple pockets? [09:25] it can exist in multiple pockets [09:25] it can start in say, security, and be copied to updates [09:25] wgrant, can you think of an example where something would have a different component in a different pocket? [09:25] bigjools: so in what way should i fix BugNomination.canApprove()? it doesn't use pockets at all [09:25] BjornT_: let me check your code [09:26] bigjools: It might have been done once, but I don't remember. It was certainly discussed with the archive admins, who talked to one of you guys, who confirmed it was possible with SQL, IIRC. I don't remember if it was actually done. [09:26] I see you use latest_published_component [09:26] NascentUpload.verify_acl() does not seem to use pockets either .. [09:26] BjornT_, ^ [09:27] But that's such a strange case it's not worth caring about for this, I don't think. [09:27] source_package.latest_published_component is perfect [09:27] ok [09:27] al-maisan: not in that specific place, because it already looked them up [09:27] al-maisan: see getSourceAncestry() [09:27] jml: yes. that's why i'd like a method that accepts an ISourcePackage that does the check for me! [09:28] * al-maisan looks [09:28] s/check/checks/ [09:28] BjornT_, I'm inclined to agree. [09:28] BjornT_, jml: yes, I can add something to do that [09:28] But I'd like to get to the end of bigjools's explanation :) [09:28] aaaaanyway [09:28] bigjools, well, I'm happy to do so, since I'm working on this problem now. [09:28] jml: awesome [09:29] check_permission(ISourcePackage, 'launchpad.Edit'), I assume. [09:29] jml: no, IArchive. [09:29] let me think a but [09:29] bit [09:29] because we are trying to fix the security adapter, it won't work for lp.Append on IArchive right now [09:32] jml: you could change canUpload() so it takes an optional ISourcePackage [09:33] bigjools, AIUI, BjornT_ & I are just going to derive the IArchive instance from the ISourcePackage anyway [09:33] jml: I think that's a bad idea [09:34] it's tying everything into a single archive [09:35] bigjools, I don't see how we can avoid that. [09:35] bigjools: i don't see how we could get the right archive, though. all we have is a distribution/distroseries and a source package name [09:35] BjornT_, in my case, I also have a pocket. [09:35] and a pocketful of broken dreams [09:35] but I don't plan on using them. [09:35] jml, BjornT_: you have to decide which archive you're uploading to, simple fact. In most cases it's IDistribution.main_archive [09:36] but there's no way that should go in the security adapter [09:36] hard-coded I mean [09:36] Something like latest_published_archive seems to make sense. [09:36] Which will be either primary or partner. [09:37] I don't think it does [09:37] bigjools, ok. so how about this: [09:37] How is it significantly different from latest_published_component? [09:37] bigjools, I add a method / function / whatever, [09:37] bigjools, it takes an ISourcePackage, an IPerson and an optional IArchive [09:38] if IArchive is None, it gets it from source_package.distribution.main_archive or whatever is a sane default. [09:38] then it does the black handwavey magic that I'm slowly beginning to understand [09:39] bigjools, because, in the design of Bugs and Code, there's absolutely know way of knowing the archive beyond that. [09:39] no way. [09:39] * jml was correcting spelling, rather than adding emphasis [09:39] :) [09:39] so [09:40] basically all I've got to work with is the stuff in this string: 'lp:ubuntu/karmic-backports/openssh' [09:40] at some point, you're going to have source package branches and bugs linked to PPAs [09:40] you don't right now, so assuming main_archive is fine [09:41] I'd say the per team package branch would map to that team/persons PPA [09:41] but don't hack that into soyuz code *please* [09:41] e.g. my subunit branches [09:41] yes, either way there's an archive involved [09:42] bigjools, I was thinking a method on ISourcePackage, actually. that leaves the assumption at quite a high level, and in exactly one place. [09:42] wgrant: latest_published_component works because packages are not generally in more than one distro archive at once [09:42] bigjools: it feels like there should be some object representing a package in a PPA (or rather, a package in a specific archive), no? [09:42] bigjools: More than one distro component, you mean? [09:42] no, archive [09:43] BjornT_, that sounds right to me. [09:43] (or at least a good question) [09:43] for anything that starts with 'lp:ubuntu/..' you'd take the corresponding main_archive; for anything that begins with 'lp:~user/..' you'd fall back to the respective PPA (how about users with multiple PPAs though?) [09:43] BjornT_: that's called a publication [09:43] bigjools: How's the archive presence relevant to latest_published_component? [09:43] bigjools: isn't that tied to a specific version of the package? [09:44] wgrant: because when you're looking for the publications, it needs an archive a well [09:44] BjornT_: right [09:44] bigjools: Oh, true. [09:45] bigjools: what i'm looking for is something like ISourcePackage, or maybe even IDistributionSourcePackage. maybe they should be extended to know which archive they belong to. [09:45] I should say for 'lp:/..' one should take the main_archive .. [09:46] ISourcePackage should really be named IDistroSeriesSourcePackage ! [09:47] let me think about it for a moment [09:53] How do you properly clean a launchpad source tree, including linked sourcedeps? [09:54] jml: ok I have a plan [09:54] maxb: make clean does all of that apart from removing the links [09:54] which I don't think anything does [09:55] bigjools, I'm all ears. [09:55] jml: we need ISourcePackage.lastest_published which will return a publication [09:55] then you can do spph.component and spph.archive [09:55] without duplicating queries [09:56] what kind of object is a publication, an IPublication? [09:56] jml: ISourcePackagePublishingHistory [09:56] golly. [09:56] I can see why you said 'publication' the first time :) [09:57] lol [09:57] At least there isn't still a SecureSourcePackagePublishingHistory still in wide use, although it does seem to still exist :( [09:57] jml: and reviewers always say to us "why are you using spph as a variable name?" [09:57] wgrant: yes, it needs ripping out [09:57] I tried once, and ended up in a world of pain [09:58] jml: does it make sense to you? [09:59] bigjools, ummm. let's go through this again from the top [09:59] okay [09:59] bigjools, I get the latest_published [10:00] bigjools, then I ...? [10:00] can I assume that you have an ISourcePackage already? [10:00] (I'm glad DistroArchSeriesBinaryPackageRelease isn't spelt out in full) [10:00] bigjools, yes! [10:00] bigjools, branch.sourcepackage :) [10:00] poifekt [10:00] so [10:01] add a new property to it, latest_published (trivial, just return self._getFirstPublishingHistory [10:01] then you have in your hands a component and an archive [10:02] this could be encapsulated inside IArchive.canUpload() [10:02] if you pass it an ISourcePackage [10:02] the only thing canUpload doesn't check is packageset permissions, I think I need to ask al-maisan why he didn't change it to do that ... [10:03] bigjools: it does .. actually. [10:03] * al-maisan checked the sources. [10:03] it does? great! [10:04] al-maisan: but I can't see where [10:04] bigjools: what eventually gets called is IArchive.getPermissions() and that does the right thing. [10:05] yes, I see it now [10:05] fab [10:05] jml: so that's it, are you comfortable with it? [10:05] bigjools, comfortable enough to start, I think. [10:06] jml: oh actually you can't put it in canUpload [10:06] d'oh [10:06] but it's still easy [10:06] I was thinking maybe having a canUploadTo on ISourcePackage or something [10:06] something will fall out anyway [10:07] jml: canUploadToArchive would be good [10:07] *nod* [10:07] anyway I have a call now [10:07] catcha later [10:07] and maybe I can do something to stop the duplication between bugs & code here [10:07] yes [10:07] bigjools, np. thanks for the help. [10:07] jml: np - ping me again if you need more help [10:08] bigjools, will do [10:08] although I think I'm going to just jot down some notes from this conversation and then switch to working on my talk for tomorrow evening. [10:10] mrevell, hello! [10:10] Quick visit. [10:12] He's an efficient man. [10:13] anyway, I'm off home. [10:13] jml: I can write you a summary [10:13] bigjools, you can if you'd like, but I think I'll be right from the logs. [10:14] bigjools, putting on the mailing list might help more people than just me though :) [10:15] I do have to leave though [10:15] bye! [10:15] al-maisan, bigjools, BjornT_: thanks for the help! [10:15] jml: my pleasure :) [10:23] bigjools: So, I managed to get lots of Soyuz bits to cooperate today, but it all seems a bit manual and I'm not sure if I've done anything terribly wrong. http://williamgrant.id.au/f/1/2009/soyuzness.html is my current setup. [10:24] will check it out in a bit, on a call right now [10:24] Sure. [10:26] jtv: So I've realized that for us, a Storm cache where the size is bounded by the number of objects is not optimal. What we care about is the amount of RAM being used. I was thinking of making a generational cache subclass that bumps a generation whenever num_objects > n and process_ram_usage > r. [10:26] stub: very true. [10:26] wgrant: Hm cool. I should've taken Ubuntu as an example rather than hacking it to name it Debian. Anyway I had something like "Unable to find distroseries: lenny" albeit I created that below /debian/. I thought that UploadPolicies are not properly set up, did you find that wired somewhere? [10:27] pkern: I used a PPA rather than try to convince primary to publish. [10:27] jtv: Unless there is someway of keeping count of the size of individual objects, but process size may still be better for our needs. [10:27] wgrant: I also tried PPA. [10:27] Although I was able to get Ubuntu primary to publish without --careful, I don't trust that. [10:28] pkern: I should try a Debian PPA at some point. [10:28] stub: object size is horrendous in any case, except where __slots__ are used. [10:28] stub: did you see the cache change results I posted to that bug? [10:29] bigjools: https://code.edge.launchpad.net/~stub/launchpad/update-storm/+merge/9130 [10:29] wgrant: we only use --careful when we want to re-publish everything. it's quite devastating [10:29] "Must omit the trailing 'ubuntu', this time. " I love hardcoded stuff. ;-) [10:30] bigjools: Right, but I did want to republish everything, as the on-disk archive was empty. [10:30] stub: (apologies if you replied I've not read my email yet) [10:30] bigjools: But the librarian files aren't there, so it crashes. [10:30] wgrant: yes, in the first instance it's what you need [10:30] bigjools: Even once I supersede/delete all of the pulibcations. [10:30] oh fucking firefox you piece of shit [10:30] pkern: I think it probably just uses the distro name, rather than hardcoding it. [10:30] bigjools: Firefox killed my laptop a couple of minutes after you complained about it earlier. [10:31] Moin + Firefox locked up X completely the other day. [10:31] * gmb joins in the two-minute hate [10:31] That hasn't happened to me in a month or so (this is Karmic). [10:31] wgrant: yes and mine just restarted without my 10 tabs I wanted saved >:( [10:31] bigjools: Ahaha. [10:31] wgrant: It's at least hardcoded in activate-ppa by retrieving only ubuntu through ILaunchpadCelebrities. And I was delighted that debian is available there, too. :-P [10:32] are you going to work on debianb ppas? [10:32] pkern: Right, but you should be able to easily change an Ubuntu PPA into a Debian PPA. [10:32] I'll try that after dinner. [10:32] That's true. [10:33] (just IArchive.distribution needs touching, AFAICT) [10:34] wgrant: if it's easier for you, you can also do a lot of that setup on your link using `make harness` [10:34] pkern: Oh, probably archivearch and archivedependency will need touching too. [10:35] noodles775: True. [10:35] But it wouldn't make it much shorter, AFAICT. [10:36] no, not shorter, but easier to reproduce after the database is reset. [10:37] bigjools: I use the sessionsaver plugin which, so far, has never lost my previous session on a crash. [10:38] Firefox 3.5 seems to be better about recovering. [10:40] I like that you need to quit Banshee to do make run :-P [10:41] ! === henninge_ is now known as henninge [10:46] hi henninge! [10:46] pkern: If you turn off the local music sharing options in banshee it stops hogging the port that Launchpad wants. [10:46] Hey jtv! [10:47] pkern: Took a while to figure that one out... [10:49] what port is that? [10:51] mgdm: I can't remember offhand... It's whichever port you get an "already in use" message about when you try to make run with Banshee running. [10:56] 80 something [10:56] 8085 [10:59] wgrant: "Builds will only be dispatched for archives with published sources" - not quite right, that only happens if the PPA is private. [10:59] wgrant: did you get a local buildd working then? [11:00] bigjools: Ahh. Why is that? It won't have a .htaccess otherwise? [11:00] bigjools: I did. [11:00] It was pretty easy. [11:00] very cool, I've never tried [11:00] because the buildd gets sources from the librarian normally, but we don't do that for private builds [11:01] Ah. [11:01] I see. [11:01] they need to stay sekrit [11:01] Right. [11:01] private builds ): [11:02] pkern: Why ):? [11:02] bigjools: Why weren't you able to just tell the librarian that it should give out that files local-only? [11:02] And where are oopses stored btw... [11:03] pkern: there are two librarians [11:03] /var/tmp/lp-err [11:03] because they don't have any access control [11:03] so one is restricted in the DC [11:03] the buildds can't see it, otherwise other builds could steal data [11:04] Hm, point. [11:04] Morning, all. [11:04] oopses are logged, check the config to find out where [11:04] Well, you could sort out access for the outside fetching things only and limit connectivity for the build itself. [11:04] I don't remember offhand [11:04] Hi deryck ! [11:04] bigjools: wgrant is right (: [11:05] Apart from s/lp-err/lperr/ but well. [11:05] Ehem. [11:05] I think I found a hole. [11:05] gadzooks [11:05] * wgrant pokes around a bit more. [11:05] * pkern giggles. [11:06] I'd wondered about how this stuff worked for some time, as it could easily be vulnerable. But looking at it now seems to confirm it. [11:06] * wgrant tries, then files a bug. [11:08] hmm .. such "discoveries" were to be expected .. [11:08] Yes. [11:08] I meant to look for this particular one earlier. [11:09] wgrant: PM me the bug # when you're done please [11:13] jtv: Hmm.... the problem is that for Launchpad I would need to bump a generation when ram usage *for the thread* got too high, and for a generic storm cache when the ram usage by the cache got too high. Otherwise we risk a large object sitting in an idle cache causing other caches to thrash. [11:14] jtv: Unless we share the storage for all of these cache instances, so they have one big cache rather than individual ones. [11:15] jtv: Or perhaps maintain a list of all of the caches, and bump all of them with num_objects > threshold when the ram limit is exceeded. [11:17] I think that would work [11:17] stub: (sorry, on call) [11:38] stub: you could have a shared policy on what would make a nice cache size under current memory pressure. [11:39] jtv: But we don't know how many objects would be nice because the memory footprint of each object can be very different. [11:40] jtv: Or do you mean bumping the desired object counts up and down until RAM usage is within bounds? [11:40] stub: will that matter so much if we tune it dynamically anyway? Too much memory pressure -> fewer objects please. [11:40] It'll victimise stores with lots of small objects, true, but how much would that hurt performance? [11:41] stub: the issue with the cache that you're waiting for an RC on is mentioned on the CRB page, it would be great if you could manage that :) [11:41] I'm don't see how that is better than just bumping the caches when the memory limit is reached. [11:41] CRB? [11:42] https://wiki.canonical.com/Launchpad/CurrentRolloutBlockers [11:42] bigjools: I probably won't be here, so someone will need to land it for me once it is rc'd. [11:42] stub: ok, I can do that [11:43] bigjools: kiko has an email in addition to the mp request. [11:43] yeah I saw [11:43] flacoste can give RCs too [11:44] flacoste is on leave I believe [11:44] ah yes [11:44] kiko it is [11:47] Argh. [11:47] * gmb just punched himself in the face with a mug full of tea. [11:50] gmb: Edwin's bug: https://bugs.edge.launchpad.net/launchpad-registry/+bug/401748 [11:50] Malone bug 401748 in launchpad-registry "Cannot create new project in IE8" [High,In progress] [11:51] allenap: Ta# [11:56] is that bug on the CRB page? [11:56] I seem to be the only person updating it [11:57] bigjools: There's a CRB on dev.launchpad.net now too. [11:57] only just added [11:57] without migrating the old page :/ [11:57] ffs === noodles775 is now known as noodles-afk === matsubara-afk is now known as matsubara === salgado-afk is now known as salgado === barry is now known as barry-away === barry-away is now known as barry === barry is now known as barry-away [13:52] jtv: ping [13:52] henninge: ? [13:53] jtv: Looking at the pofiles in the queue I see that most of the files are probably still in there because the lang code cannot be determined. [13:54] henninge: hang on, I'm coming. Just the po files for projects? [13:54] jtv: yes [13:54] jtv: almost 400 [13:54] jtv: There is a lot like domain-ll.po [13:54] :( [13:54] ah yes [13:55] jtv: I think that they should be deleted from the queue and the uploaders informed about how to name the files. === noodles-afk is now known as noodles [13:56] henninge: instead of deleting, we could just let them sit there for now and email the uploaders to say there's a faster way. [13:58] jtv: but even then the po files need to be named properly to be automatically approved. [13:58] henninge: yes, they'd upload new files and discover that it was much faster. [13:59] henninge: once they've done that, we can delete the old uploads. This is not a part of the queue we should watch daily anyway, so that gives them time to play. [14:00] jtv: oh, I thought "faster way" was bzr uploads ... [14:00] ;-) [14:00] jtv: yeah, we should do that [14:00] henninge: in this case, it's fixing the PO names. They'll have to do that either way. [14:02] sinzui: have you started a page about updating the new 3.0 templates? If not I can take a look at your branch to get some ideas. [14:02] I am writing it today [14:03] * mars gives up on reading the channel backlog [14:03] noodles: The work is easy, but there are heading conflicts that may require us to edit every page twice...making the progress report bogus [14:03] jtv: what I meant. [14:03] henninge: we're in violent agreement. Would you like me to write a canned response and put it up on the wiki? [14:04] sinzui: OK. Let me know if I can take a sneak preview ;) [14:04] Maybe I'll start a new subpage, "approval issues." [14:04] jtv: please do, I'll send them out, then. [14:04] henninge: I mean, auto-approval issues. [14:04] OK. [14:04] jtv: or how busy are you? [14:05] henninge: not very. Need help? [14:05] jtv: no, no, just wanted to put something else on you. [14:05] henninge: go ahead. [14:05] jtv: I'll move to my office soon, so this is cool [14:06] jtv: oh, sorry. [14:06] ;-D [14:06] henninge: I don't think I follow [14:06] jtv: no, no, just *did* *not* want to put something else on you. [14:06] ahhhh :) [14:06] jtv: ^ what I meant to write [14:07] No worries, CHR is *incredibly* quiet. I think everyone decided to look up their questions in the source first. Or maybe our entire user base is just stuck downloading/browsing the code for the heck of it. [14:07] jtv: ok, I'll relocate now. [14:08] ok [14:24] sinzui: I'm just fiddling with a main-only layout, and noticed that style-3-0 is quite specific when applying styles to elements that have been reset (via the yui reset). For example [14:25] sinzui: rather than setting any th element as bold, only those within form table tbody are set to bold... [14:25] noodles: I think there is a comment that we wanted to restore some of the settings from style.css [14:26] noodles: reset is complete, there is no style. So strong way was never bold, [14:27] noodles: I expect the style sheet will get a lot of changes as we get more pages using them [14:27] sinzui: yes, but I'm just confused why style-3-0 would specifically set 'form table tbody th' to font-weight:bold rather than just th. [14:27] Ah, ok. [14:27] I'll do some modifications and than perhaps later chat with you on the diff (after reading your doc of course :) ). [14:28] noodles: Some ths are not bold on launchpad, so I set a rule that matches how we currently use th bold [14:28] I see. [14:28] pqm still failing? :-( [14:28] noodles: we have only two page designs, only one in html, There is a tremendous about of css we will discover [14:29] jtv. yes, I cannot restart buildbot. I am hoping for gary to come by [14:36] barry, bac, Edwin, salgado: standup in 2 minutes [14:43] Ursinha: ping. in the registry test plan you mentioned you filed bug 401887, but that doesn't seem to be the right bug number [14:44] Malone bug 401887 in launchpad "offer "make announcement" on +announcements" [Undecided,New] https://launchpad.net/bugs/401887 [14:48] barry, argh, paste fail [14:48] sinzui: can you call again, skype wouldn't ring, but I know the rest of the audio works. [14:49] barry, bug 402736 [14:49] Malone bug 402736 in lazr-js "Buttons seem not hooked up to js in IE8" [Undecided,New] https://launchpad.net/bugs/402736 [14:49] I'll fix in the testplan [14:50] barry, done [14:51] Does anyone else find themselves routinely running make SHHH= .... [14:51] ? [14:52] Ursinha: thanks! [14:52] maxb, not personally. When there are startup errors the extra noise is a welcome debugging aide. :) [14:52] barry, sorry for the mess [14:53] maxb, say, for example, when you accidentally run two instances side-by-side [14:53] mars: that's the point - SHHH=(empty string here) turns off the output suppression [14:53] Ursinha: no worries [14:53] maxb, ah, my mistake [14:54] np, i could have been a lot less terse :-) [14:54] Ursinha: though i do not think we need to release critical this bug. sinzui says that we don't support ie8 officially yet [14:55] Well that was comparatively painless [14:55] allenap, ping re: the pages you moved to the dev wiki [14:55] * maxb has a launchpad webapp running...... on karmic [14:55] cool [14:55] mars: Yeah [14:55] maxb, using which Python? [14:55] 2.5 [14:55] barry, ^ [14:55] it *is* possible :) [14:56] heh, but I bet he hasn't run the test suite :) [14:56] barry, no problem then, if we don't support officially [14:56] well, no, baby steps... [14:56] barry: Ursinha: AN RC is needed if there is broken JS that prevents a user from completing a task. We do not care if the task can be completed via AJAX or HTML. [14:58] folks. every week we have two meetings for launchpad code reviewers. the meetings have always been public. reviewers are required to attend, but anybody else is also welcome to lurk. the america/euro version starts in 2 minutes in #launchpad-meeting [15:00] sinzui: A quick question - on the following url, there is a table used to layout "Repository disk usage, Build dependencies" etc. [15:00] reviewers -> #launchpad-meeting [15:00] https://edge.launchpad.net/~cprov/+archive/ppa [15:00] sinzui: is that the kind of thing that we want to use a dl for instead, or will we stick with a table for the moment? [15:01] noodles: yes, that is a good example [15:01] hello together, i have a question/problem concerning the local installation of launchpad. After going through the step-by-step-solution (every seemed to go correct) and when i then run "make schema && make run" in ~/launchpad/lp-branches/devel/ and when i enter "launchpad.dev" in firefox i get a 503. is there a quick solution for this? [15:03] Knut-HB, well, first lets look for a quick diagnosis :) [15:03] noodles: That layout may change. The onecolumn layout used that style, but you can see the project information has a new layout in https://devpad.canonical.com/~curtis/LP_projectdetail.png [15:03] * noodles looks [15:03] mars: re-pong :) [15:04] sinzui: yes, that looks lovely :), it would be great to get something similar for the archive index. [15:04] allenap, ah, just wondering if you also moved the wiki pages over? and if so, was it easy to find a place to link them from? [15:04] allenap, is it just me or are the edit icons for inline editing of bug status/importance misbehaving (i.e. only showing up when I hover the mouse over them)? [15:05] salgado: That happens to me sometimes too. [15:05] And they sometimes take several seconds to disappear. [15:05] Knut-HB, could you kill the server and paste the output of 'make run'? I want to be sure that the server is in fact up [15:05] wgrant, is there a bug about that? [15:05] mars: Yeah, I moved them over to Bugs/ExternalBugTrackers/Mantis and the other to Bugs/Spec/FormattingBugNotifications [15:06] salgado: There are a few bugs about that sort of thing, but nothing about that particular issue. [15:06] mars: I also added most of the intermediate pages. They're looking a bit sparse, but they're there. [15:06] Things were changing, so I didn't file one. [15:06] salgado: Not just you. I think that's a feature. intellectronica? [15:06] Knut-HB: when you run make run, watch the output and verify you see "[-] daemon ready!" [15:08] salgado: that's a feature [15:08] wgrant, if I leave the mouse pointer over the place where the link should be, it keeps showing up and disappearing in an infinite loop. does that happen to you too? [15:08] intellectronica, but not that (^), I hope? [15:09] intellectronica, that happens after the first time the icon shows up and I move the mouse pointer away from it [15:09] sinzui: if gary is at oscon, that doesn't bode well for your pqm restart. :/ [15:09] salgado: no, that sounds pretty bad. let me see if i can reproduce [15:09] salgado: That doesn't, but for the first load on each page it takes one Launchpad-long-time to appear, and another to disappear. [15:09] It seems to make a request each time. [15:10] intellectronica, when I move the mouse pointer back to it and leave it there for around two secs, it goes into that loop [15:10] jtv: I am prepared to issue a release-critical empty branch to make buildbot work. I will ask for forgiveness after I see staging updated [15:10] salgado: is that locally or on edge? [15:10] intellectronica, edge [15:11] sinzui: non-empty branches sure aren't working... [15:12] intellectronica, it happens only when the pointer is above the place where the icon should be. if the pointer is above the text, it doesn't happen [15:12] salgado: there's a fix that didn't make it to the nightly because of an unrelated failure. could you please try to reproduce locally? [15:12] jtv: right, I will make a white space change to one of our ugly page templates [15:12] intellectronica, sure [15:12] salgado: thanks [15:12] sinzui: so what's breaking it that a branch like that would succeed whereas mine fails? [15:13] jtv. I do not know. I will find out now [15:13] sinzui: good luck! [15:14] intellectronica, it happens on lp.dev too [15:14] (and I just did a rocketfuel-get) [15:16] salgado: :( can you please file a bug and assign to me? [15:17] salgado: what browser are you using, b.t.w? [15:20] intellectronica, it happens on lp.dev too [15:20] (and I just did a rocketfuel-get) === salgado_ is now known as salgado [15:29] hi everyone, need some help debugging a sourcecode dependencies build problem [15:29] in a new setup [15:29] Here's the 'make schema' output showing the error: http://paste.ubuntu.com/224383/ [15:29] and the sourcecode/ directory has links in it [15:30] BTW, this is in devel/ [15:31] wgrant, around? [15:32] pkern: I just successfully uploaded things to both Debian primary and PPA here, and can even access the PPA in the web UI along with Ubuntu ones with a few lines of changes. It just took a bit of lucilleconfigging. [15:32] mars: Yes. [15:33] An odd error. [15:33] wgrant, just wondering if you saw anyone with problems running link-external-sourcecode in devel/ [15:33] Is that from your machine? [15:33] wgrant, this is Knut-HB's new setup [15:33] I saw somebody complaining of the same thing earlier, IIRC. [15:34] Knut-HB, do you have any contents in devel/bin/ ? Could you paste them please? [15:34] that way I know what has and has not been generated by the buildout scripts [15:34] download-cache should live in ~/launchpad/lp-sourcedeps, shouldn't it? [15:36] mars: http://paste.ubuntu.com/224397/ [15:37] wgrant, yes [15:37] Knut-HB, and devel/download-cache is a valid link? [15:39] when i open "devel/download-cache" i see another folder named "dist". is that correct? [15:39] Knut-HB, btw, you may want to restart apache. Launchpad will not do that for you [15:39] Knut-HB, it is. does dist/ contain a number of .tar.gz files? [15:40] salgado: sorry, you may have missed my reply when you disconnected. i asked if you could file a bug with instructions on how to reproduce and assign to me [15:40] i still can't seem to reproduce this locally [15:40] intellectronica, will do [15:40] salgado: cool, thanks [15:40] mars, after doing a "sudo /etc/init.d/apache2 start" the apache restarted and inside the "dist"-folder are 178 files, a lot are tar.gz [15:40] (I missed your reply indeed) [15:41] Knut-HB, good! [15:41] sinzui, barry, question: why in item r8865 needstesting in your testplan it doesn't have the Konqueror items to test? [15:41] Knut-HB, please try "cd devel/", 'make', then 'make schema' [15:41] ok [15:41] Ursinha: I do not know the answer to that one. I did not it. I removed the Konqueror 3 since it is not supported. [15:42] wgrant: wow [15:42] after "make" i get several errors, pastebin? [15:42] Ursinha: I did note that Konqueror 4 was missing, but did not consider to ask why [15:42] sinzui, I'm adding by default konqueror 3 browser as C graded, because of people using LTS version of Kubuntu (mars can correct me if I'm wrong) [15:43] sinzui, that was removed by hand, since the script is adding all of them automagically when detecting the js tag [15:43] Ursinha: The test will always fail, We are not fixing them [15:43] pkern: Have you had luck, or do you want some pointing in the right direction, or do you have significantly better things to do with your time? [15:44] Ursinha: Do not make k3 take an AJAX test it has no chance of passing. It should only use html [15:44] mars: this is what i get after "make": http://paste.ubuntu.com/224401/ [15:44] sinzui, do we have to guarantee that it will work as disabled? I assumed so [15:46] Knut-HB, ok, hmm [15:47] that is frustrating [15:47] the directory is there, and it is valid [15:47] Ursinha: The HTML must work, and that is what need to be tested. AJAX is for A grade browsers only. The K3 tests should verify that the operation still works in HTML (bug subscribe via HTML was lost for a while, so that is a good example of a FAIL that had to be fixed) [15:47] Knut-HB, does the directory `/home/test/launchpad/lp-sourcedeps/sourcecode/cscvs' exist? [15:47] mars, checking [15:48] Knut-HB, perhaps the sourcecode download broke during transfer [15:48] that has happened to other people [15:48] sinzui, right, they're being added to the testplans to test not just the ajax, but if the feature is still functional even without js [15:48] Knut-HB: is your devel branch up to date? [15:48] i was at the laptop all the time watching the progress and the download didn't break or something like that [15:48] "bzr pull" it [15:48] bigjools: downloaded just yesterday [15:49] pull again please [15:49] What about running rocketfuel-get? [15:49] there was a fix that went in late [15:49] ok, first the checking [15:49] wgrant, yep, that's next :) [15:49] That will update everything and make sure they're checked out properly. [15:49] don't run fg-get yet [15:49] Ursinha: then I was mistaken in the intent of the inline edit test [15:49] rf-get even [15:49] Although it won't fix the 2a issue. [15:50] sinzui, at least I thought that the js testing was about making ajax work and not breaking if it doesn't [15:50] Knut-HB: when bzr pull finishes, run utilities/rocketfuel-get [15:50] mars: check, folder is there with contents [15:50] mars, am I understanding that wrong? [15:50] Ursinha, reading back [15:50] bigjools: where do i have to pull? inside the folder "launchpad"? [15:51] Knut-HB: insde the devel dir [15:51] that is the trunk branch [15:51] ok, pulling [15:51] there was an important fix to rocketfuel-get done late yesterday [15:51] ah ok [15:51] sinzui, Ursinha, what are the K3 tests written in? [15:52] mars: this is the test plan, not automated testing === matsubara is now known as matsubara-lunch [15:52] intellectronica, bug 403066 [15:52] Malone bug 403066 in malone "Icons to edit a bug's status/importance come and go in an infinite loop" [Undecided,New] https://launchpad.net/bugs/403066 [15:52] bigjools: ok, pulled, what next? rocketfuel-get? [15:52] sinzui, ah, see, that is why I asked :) [15:52] Knut-HB: yep [15:52] salgado: thanks [15:53] Knut-HB: utilities/rocketfuel-get [15:53] ok, working [15:53] it will take a while [15:53] sinzui, Ursinha, the K3 tests in the test plan should ensure that the functionality is still accessible as HTML in the K3 browser. [15:53] salgado: whoa, finally realised how to reproduce [15:53] herb: buildbot appears to be dead I cannot make it restart. I know this is unlikely. but do you know how to kick buildbot? [15:53] this can be very bad for epileptic users [15:53] bigjools: ok, i'll tell you when it's finished [15:54] intellectronica, lol [15:54] ok thanks [15:54] sinzui, Ursinha, that is what defines "C" Grade: we explicitly test that the site still works on a known problematic platform. [15:54] sinzui: I can certainly try [15:54] mars, so I got that right :) [15:54] sinzui, Ursinha, versus "X" Grade, where we don't test, we just assume it's ok. [15:55] Ursinha, yep. The K3 test should check that the AJAX is disabled, and that users can still use the site. [15:59] mthaddon: herb: buildbot appears to be dead I cannot make it restart. I know this is unlikely. but do you know how to kick buildbot? [15:59] sinzui, herb said he would try [15:59] * sinzui is still frazzled from yesterday [16:00] sinzui, it was buried in the last flurry of messages addressed to you :) [16:00] sinzui, frazzled, but fun, no? :) [16:00] sorry, should make that more Canadian... [16:01] sinzui, frazzled, but fun, eh? :) [16:02] No. My day sucked because I have a ton of work to complete and too many interruptions to work on it. I really do not want to release code today since I cannot see that any of our landing fixed bugs [16:03] bigjools, ok, finished [16:03] bigjools, what now? [16:04] Knut-HB: any errors? [16:05] sinzui, is there any way I could help? QA perhaps? [16:05] bigjools, can't find any [16:05] Knut-HB: ok that's good - try "make schema" now [16:05] mars: you cannot QA because the code never arrived in staging because buildbot had a heart attack [16:06] bigjools, same errors again =/ [16:07] gah [16:07] ok [16:07] sinzui: The buildmaster appears to have (re)started correctly. [16:07] can you run rocketfuel-setup again [16:07] ok [16:07] sinzui, ah, sorry to hear that. You enjoy lean: this is something that should go in the "unnecessary waste" category. [16:08] herb: \o/ [16:08] I can deliver beer to your house later this evening [16:09] mars: I suppose my frustration is really these moment I feel powerless to fix something [16:09] sinzui, I've been building a list of problem areas in the dev process, and the building and landing processes are definitely in the running for "biggest problem right now" [16:10] sinzui, if the system was perfect, you wouldn't have to fix anything :) [16:12] mars: but where would I get my karma from then? [16:12] sinzui, you'll never catch flacoste, give up :) [16:13] mars: I can catch flacoste in 1 week. I choose not to use blueprints until they rock [16:13] well, if you fix blueprints, you will close so many bugs that yes, you will be in first place :) [16:16] bac: should we have our call? [16:17] bigjools, do you think a series of environment checks before lp startup would help with diagnosis? make start-check [16:18] mars: not a bad idea, but I'd make it a separate target, "make diagnose" or something like that so we can ask for it to be run [16:18] bigjools, ah, that is a good name :) [16:18] bigjools, ok, rocketfuel-setup has finished, what next? make schema? [16:18] sinzui: yes [16:19] Knut-HB: if there were no errors, yes [16:19] bigjools, I got an error of "Package `launchpad-developer-dependencies' is not installed and no info is available." is it only available in jaunty? (I am running karmic) [16:19] while doing "rocketfuel-setup" i couldn't find any errors but when doing "make schema" i get the usual errors =/ [16:20] okay, I think rf-setup is confused [16:20] let me check something [16:20] ok [16:20] ara: Yeah, us karmic users need to be trailblazers right now :-/ [16:20] maxb, ok, thanks [16:20] ara: yes, jaunty only, LP doesn't yet work in karmic [16:21] or you can use hardy [16:21] :-P [16:21] only *.04 releases? :P [16:21] that's the last LTS release, and what we deploy on [16:21] supported platforms :) [16:22] bac: https://edge.launchpad.net/launchpad-registry/+milestone/2.2.7 [16:22] Knut-HB: what is in lp-sourcedeps/download-cache/dist/ ? [16:24] Knut-HB, what happens if you run 'make download-cache' in devel/ ? === salgado is now known as salgado-lunch [16:24] mars, i'll do it next [16:26] bigjools, http://paste.ubuntu.com/224424/ this is inside the folder [16:26] mars, "make: `download-cache' is up to date. [16:26] Knut-HB: in devel, do you have a symlink "download-cache" ? [16:27] wgrant: I'm currently at Debconf and people want me to move Debian autobuilding to a new host and discussing stuff with people. That's the main reason I get distracted at the moment, so I appreciate the pointers and will look at it later today. \-: [16:27] bigjools, yes [16:27] Knut-HB: at it points to the ../../lp-sourcedeps/download-cache ? [16:27] s/at/and/ [16:28] bigjools, yes it does [16:29] Knut-HB: does devel have a sourcecode dir? [16:29] full of symlinks? [16:29] bigjools, i'll check that, just have to check something in [16:31] bigjools, yes, 27 symlinks and one makefile [16:31] Knut-HB: ok, if you type "make build" now, in devel, what happens? [16:32] bigjools, drilling down the Makefile target chain? :) [16:33] bigjools, http://paste.ubuntu.com/224430/ [16:33] mars: trying different things :) [16:33] Knut-HB, how about 'make compile' ? [16:34] Knut-HB: this is bizarre [16:34] I suspect it will throw the same error [16:34] bigjools, you won't believe me: the same errors :P [16:34] mars, you just won 1000 points! [16:35] ok, lets keep drilling then [16:35] Knut-HB: rm download-cache and rm sourcecode/* then run "utilities/link-external-sourcecode ../../lp-sourcedeps" [16:35] ok wait [16:36] there should really be a GNU Make option that gets it to spit out the targets.... [16:36] bigjools, you want to see the output? [16:36] Knut-HB: no [16:36] if it's done, try make build [16:37] wow Oo one part of three errors less :D [16:37] "No rule to make target `build'. Stop." [16:37] lol [16:37] ok just "make" [16:38] "No rule to make target `build'. Stop." [16:38] bigjools, we need a 'make distclean' target :/ [16:38] Knut-HB: ok try "python2.4 bootstrap.py" [16:38] mars: what would that do over make clean? [16:39] bigjools, 'make clean' cleans up the test env. 'make distclean' would kill eggs/, download-cache, apidoc, etc. [16:39] apidoc is removed by make clean, but ISWYM [16:39] bigjools, http://paste.ubuntu.com/224434/ [16:40] bigjools, 'make clean' means 'clean up everything from running'. 'make distclean' means 'remove everything that isn't in the source tree, so I can tarball it' [16:40] Knut-HB: huh, I think we see your problem [16:40] bigjools, really? :D [16:41] buildout can't get its dependencies [16:41] bigjools, what Knut-HB said: really? [16:41] "Link to http://pypi.python.org/simple/zc.buildout/ ***BLOCKED*** by --allow-hosts [16:41] I've not seen that before [16:41] bigjools, that is expected - it is supposed to grab them from eggs/ [16:41] afk, biab [16:42] kiko: so are you release manager for today? [16:42] bigjools, or from download-cache, I don't remember which exactly [16:42] :) [16:42] mthaddon, indeed I am, how are you? [16:42] kiko: depends on how things are looking for the release :) [16:43] bigjools, Knut-HB, I think it is the 'bin/buildout' target that is failing [16:43] losa ping [16:43] barry: hi [16:43] or was failing, before download-cache got killed [16:44] Knut-HB: what is in your devel/bin dir? [16:44] Knut-HB, you can always try 'make -d foo' if you want more info about what make is deciding to do [16:44] mthaddon: hi. kfogel asked me to coordinate with you about regenerating the mailing list archives with his new style. he's at oscon [16:45] barry: ok [16:45] mthaddon: cool. let me make sure the wiki page with the instructions is updated [16:45] bigjools, http://paste.ubuntu.com/224437/ [16:46] mthaddon: actually. have we rolled out yet? if not, i think we need to wait until that happens [16:46] barry: rolling out 22:00 UTC [16:47] Knut-HB: that looks ok [16:47] mthaddon: cool. then let's chat again in a few hours, or tomorrow morning. in the meantime, i'll make sure the wiki has the right instructions [16:47] Knut-HB: when you ran link-external-sourcecode, did it print a load of symlink info? [16:48] yes [16:48] kiko: so are there any more expected items after what's currently in buildbot? [16:48] I am totally baffled [16:49] bigjools, me too :p [16:50] Knut-HB: I only have one more suggestion. Blow away your lp-sourcedeps, and run rocketfuel-get again [16:50] bigjools, hm ok, i do as you say ;9 [16:50] sorry, it will download lots of stuff again :/ [16:50] ah, 16 mbit/s connection ;) [16:50] woo :) [16:51] and it's not my system i'm working on anyway, it's a virtual system on a remote system accessed via ssh so... don't worry :D [16:53] ok, downloading [17:01] mthaddon, so the rollout is at 2200 UTC? [17:01] kiko: yep [17:04] bigjools, "Couldn't find lp:~launchpad-pqm/shipit/trunk/, skipping it." is a message i get after rocketfuel-get finished. what now? [17:04] Knut-HB: do you get that for any others? === deryck is now known as deryck[lunch] [17:04] if not, it's ok [17:05] now i don't think so [17:05] ok [17:05] no other errors from rf-get? [17:05] no, couldn't see any [17:05] rf-get does a "make" when it finishes [17:05] so that's good [17:05] let's see if make build works now! [17:06] now make build made some more stuff but quits with errors [17:06] /o\ [17:06] "no rule to make target `build''" [17:06] ok [17:06] make schema [17:07] "no rule to make target `build''" [17:07] geez [17:07] "make" gives the same error I guess [17:07] mthaddon, could you rename: https://edge.launchpad.net/research38917 to archive-behavior-research? [17:07] wow, how did you know that? ;) [17:07] I am psychic [17:07] O.O [17:07] so [17:08] let's try make clean [17:08] did a lot of "rm -rf" stuff [17:08] and make [17:08] beuno: done [17:08] mthaddon, you rock, Thanks. [17:09] ok, it's working longer now and so far no errors [17:09] shhh.py is doing something [17:09] \o/ [17:09] kiko: so are you expecting any more submissions before the rollout? [17:10] bigjools, is that good? [17:10] Knut-HB: are you back at the prompt? [17:10] not yet [17:10] is that good too? [17:10] yeah it takes a while [17:10] it makes the api docs [17:10] so chances are high it works when this step is finished? [17:11] let's not go that far yet :) [17:11] hmpf -.- ok :p [17:11] mthaddon, would you be a love and give me a URL to buildbot as my bookmarks died? [17:11] if it finishes ok, then you need "make schema" [17:11] ok [17:11] kiko: buildbot.devpad.info [17:11] what he said :) [17:15] bigjools, ok, after doing a long time some stuff in the background make finished with "*** No rule to make target `build'. Stop." [17:15] make schema? [17:15] that's not good [17:15] your makefile sounds screwed [17:16] sounds not good [17:16] can you find a build target in it? [17:16] about line 114 [17:16] where can i find the file? [17:16] top of devel [17:16] your're in that directory already, right? [17:17] yep [17:17] line 114 says the following [17:18] "build: $(BZR_VERSION_INFO) compile apidoc" [17:18] ok try make build, in the devel dir [17:19] bigjools, "*** No rule to make target `build'. Stop." [17:19] ! [17:20] bigjools, but i have to go now =/ [17:20] make compile [17:20] make apidoc [17:20] ? [17:20] ah ok [17:20] same errors [17:20] both compile and apidoc [17:20] weird, you just showed me the makefile [17:20] make -F Makefile build [17:21] -f sorry [17:21] lower case [17:21] error [17:21] same one? [17:21] would it be the best to just delete the whole launchpad-folder and download it again? [17:21] yes [17:22] ok, delete lp-branches and re-run the rocketfuel-setup script [17:22] i will asap [17:22] save it first [17:22] it's in lp-branches :) [17:22] it's all in the log so i won'T forget ;) [17:22] thanks for the help dude [17:22] ok good luck [17:22] thanks [17:23] mthaddon, there doesn't seem to be anything critical I've found yet [17:23] so I think it's on-track [17:23] kiko: that's what I like to hear :) === matsubara-lunch is now known as matsubara === kiko is now known as kiko-fud === ursula_ is now known as Ursinha [17:36] ping rockstar [17:42] Hi all [17:43] hi tfmoraes [17:43] I have just installed the launchpad [17:43] hi [17:43] Is there a default user? [17:44] tfmoraes, foo.bar@canonical.com:test [17:44] afair :) [17:44] thank you [17:45] it works! [17:45] tfmoraes, you can find the full sample data user list in lib/canonical/launchpad/pagetests/README.txt [17:46] Thanks [17:47] tfmoraes, cool :) [17:57] Added the default user and password to the /Getting page [17:57] should make it easier for everyone else [17:58] how do i cause a 404 from python view code? do i raise NotFoundError? [17:59] intellectronica, try that first, it might bubble up to the right spot in the publisher [17:59] tfmoraes, foo.bar@canonical is deprecated. use admin@canonical.com instead for an admin user or test@canonical.com for a regular user [17:59] mars, add it to the FAQ as well [17:59] intellectronica, if it doesn't work, look at raising it from one of the traversal-associated methods of the view [18:00] bigjools, ah, matsubara was to /says too late :) [18:00] at least the wiki is editable [18:00] fancy that [18:01] matsubara, passwords are still 'test'? [18:02] mars, yes [18:05] thanks [18:05] * gmb EODs [18:13] Other question [18:14] If someone try to access my self-hosted launchpad [18:15] It doesn't locate the launchpad.dev [18:16] It is not accessible other than from the machine it's running on [18:17] Is there a way? [18:19] You'd have to dig into the guts and work out how to reconfigure it [18:20] any tip? === deryck[lunch] is now known as deryck [18:21] no, I've only just convinced it to run in the default configuration myself [18:22] thanks [18:23] tfmoraes, there's a way to make it accessible in your LAN. does it help? [18:23] yes [18:24] * matsubara looks for docs [18:24] Hi! Why utilities/rocketfuel-branch does not create stacked branches? [18:24] tfmoraes: When I want to QA my .dev instance from another machine on my how network. I edit Allow from 127.0.0.0/255.0.0.0 in /etc/apache2/sites-enabled/local-launchpad [18:25] tfmoraes: you need to add an allow block for you lan [18:28] to all VirtualHost ? [18:32] tfmoraes, http://pastebin.ubuntu.com/224529/ [18:32] I'll move the corresponding doc from our internal wiki to the public wiki [18:32] it just needs some cleanup first [18:36] thanks again [18:39] jtv: is that you are a bot? :-) [18:39] s/are/or/ [18:39] jtv: a bot [18:39] joey: why does everyone want to do Turing tests today? [18:39] joey: a bot [18:39] ;-) [18:39] lol [18:39] it's just really late for you to be online jtv [18:40] here you go henninge, here's your 20 marks [18:40] * joey laughs. [18:40] joey: yes, I've been trying to land an RC branch for... a day and something. [18:40] * henninge looks for a bank that will still trade them into Euros. [18:40] jtv: haven't seen you in ages it seems like. Doing well I hope. [18:40] joey: great, thanks. [18:40] joey: still getting used to not typing "Rinchen" === joey is now known as launchpad [18:41] this better jtv ? [18:41] :-) [18:41] lol! [18:41] launchpad: no :) === launchpad is now known as Rinchen [18:41] ok then [18:41] ah, that's better [18:41] * Rinchen laughs. [18:41] Yup, just like old times [18:41] nameserv just loves me [18:42] I grabbed launchpad for the day we add IRC two-way comms into LP === Rinchen is now known as joey [18:42] I usually get messages from the other two brothers, Nick & Chan Serv. [18:42] Yeah. Mine are all linked of course so they leave me alone, generally. [18:44] Is it notmal to get Python MemoryError exceptions if your devenv is not beefy enough, or have I stumbled across one of the reasons why LP isn't supported on Python 2.5 yet? [18:44] *normal [18:49] jtv: EOD for me. You can see my work output in rosetta@ ;-) [18:49] henninge: just spotted it. Impressive! [18:49] Gute Nacht [18:50] jtv: but there is more in the queu for tomorrow. Some were over a month old, I just hope the delay is not annoying people more than it helps. [18:50] jtv: Tschüß! [18:50] * henninge needs to learn some Dutch phrases .... [18:58] gah, still no PQM? [19:09] sinzui, still no luck with pqm/buildbot? [19:09] jtv: I did land to PQM, and herb whipped buildbot to work [19:10] sinzui: my branch is still failing with /bin/false [19:10] any idea why that might be? [19:10] I thought it was the same problem you had. [19:12] jtv: I did a direct submit to PQM using the --submit-branch option for db-devel [19:13] sinzui: oh, I've been trying to land on devel—also using pqm-submit. [19:13] jtv: devel will fail, only db-devel can be landed [19:13] why is that? [19:13] * sinzui thinks this is a bug in the process [19:14] because we do not have a sanity check in our build/deploy process to no not to deploy changes to edge if only db-devel is being used [19:15] sinzui: so all this time, "/bin/false" meant "please submit to db-devel instead"? [19:17] Does anyone know why versions.cfg for stable and db-stable requires bzr 1.17 when bzr+ssh://bazaar.launchpad.net/~launchpad/lp-source-dependencies/trunk/ only has bzr1.17rc2? === noodles is now known as noodles775 === kiko-fud is now known as kiko [19:33] Other question [19:34] And the "bzr launchpad-login" ? [19:35] If I try that, it tries to log in the launchap.net === salgado-lunch is now known as salgado [19:39] tfmoraes: it doesn't log in, but it does check that the user exists and has ssh keys [19:41] hi all [19:42] should i care about a NoSuchRevision error branching pygettextpo? [19:42] using rocketfuel-setup [19:42] abentley, bzr blame said jml last updated the line, and I see 1.17rc1 here [19:43] Hi, I'm trying to do a perfectly standard setup on LP on Jaunty, and am getting: ImportError: /home/maxb/launchpad/lp-sourcedeps/eggs/storm-0.14stub_storm_launchpad_288-py2.4-linux-i686.egg/storm/cextensions.so: undefined symbol: PyUnicodeUCS2_Format [19:44] I have logged in the launchpad with foo.bar@canonical.com [19:44] and the username is name16 [19:44] marc0s, you can always try rocketfuel-get after rf-setup finishes. If there is a problem, it will re-fetch it. [19:45] tfmoraes, yep, long time holdover [19:45] marc0s: IIRC someone said that is triggered by a bug in rocketfuel-get, now fixed. The first thing to try would be to ensure your LP devel branch is up to date, delete the pygettextpo local branch, and try again. [19:45] then I tried "bzr launchpad-login name16" [19:45] And it shows bzr: ERROR: The user name name16 is not registered on Launchpad. [19:46] Just curious, does LP do administration in its UI, or is that all external to the Web app? [19:46] There is some in the UI. But not administration of LP itself, AFAICS. [19:47] But I've registered her ssh keys [19:47] thanks mars and maxb i'll try now with rocketfuel-get [19:47] and the user exists [19:47] mars: I think you're out of date. This was done in revno 8970 [19:47] Yeah, I was thinking a "superuser" type of user in LP that could go around and do things like delete projects, etc., though having a way to install a DB with zero data would probably serve a similar purpose. [19:48] abentley, yep 8969 here [19:48] mbt, some of that stuff has to be done in the DB directly [19:49] tfmoraes, are you trying to point bzr launchpad-login at your local LP instance? [19:50] yes [19:50] mars: And I assume there are no scripts that do this? I haven't had a chance to browse the entire source tree yet, but it seems that good 'ol psql is your friend there. [19:50] mthaddon, did we unjam PQM? [19:50] kiko: was it jammed? [19:50] mbt, you would have to ask the Launchpad Operational System Administrators (a.k.a LOSAs) [19:51] I thought jtv suggested it was, but maybe he was confused [19:51] tfmoraes, I'm not sure you can do that with the basic plugin. Might mean a change to the bzr source? One of the bzr devs in here might know. [19:51] kiko: it kept failing with "/bin/false", I thought sinzui had the same [19:52] mthaddon, at any rate I think what's in buildbot is what will go live unless we find anything critical from then until now [19:52] mars, there is other way to checkout the source code? [19:52] mthaddon, I've asked other leads to review the OOPS listings [19:52] kiko: ok, cool [19:53] mars: There's no need to do that. bzr will use the default user from the ssh config, sabdfl [19:53] kiko: 'Commit message [[release-critical=flacoste][ui=none][r=mwhudson][bug=401835] Fix\n\tcommit-translations-to-branch: repeated path error.] does not match commit_re [(?is)^\\s*(?:\\[(?:release-critical=[^\\]]+)\\]\\s*\\[(?:rs?=[^\\]]+)\\]|\\[rs=buildbot-poller\\])]' [19:53] tfmoraes, from a local LP instance? not sure [19:53] mars, yes from local LP [19:53] tfmoraes, abentley might know, as he is on the code hosting team :) [19:54] mars: ^ [19:54] tfmoraes, mars: There's no need to do that. bzr will use the default mars: There's no need to do that. bzr will use the default user from the ssh config, sabdfluser from the ssh config, sabdfl [19:54] yay, thanks xchat [19:54] mthaddon, that should work, no? [19:55] no, the regex no longer expects the [ui=none] [19:55] mthaddon: herb: buildbot completed a build with RC fixes in it. Can staging be updated so that we can verify them? [19:56] sinzui: does it include DB updates since the last staging update? [19:56] mthaddon: I do not think so. /me looks [19:58] mthaddon: no db changes. templates and browser code and images. [19:59] sinzui: revno 8312? [20:00] yes [20:01] mars, I added the name16 in ssh config [20:02] maxb, do you have /usr/include/python2.4/Python.h on your system? [20:02] Hmm. I'm confused. How can anyone have a working LP devenv on Jaunty when Jaunty's Python is built using UCS4, but one of the LP eggs is built for a Python using UCS2 ? [20:02] Then I do a bzr branch, but it shows this error "You have not informed bzr of your Launchpad ID, and you must do this to ... " [20:02] mars: yes [20:04] tfmoraes: I think you should only be using bzr lp: urls for interacting with the real launchpad. You probably need to use http:// or bzr+ssh:// to talk to your dev instance [20:04] I will try [20:04] I wonder how many knobs I need to push to get an uploader listed for a distroseries. o_O [20:05] maxb, how did you find that the egg uses UCS2? Perhaps I could check my local setup in comparison [20:06] I assumed that based on the text of the error message: "undefined symbol: PyUnicodeUCS2_Format". I could unzip the egg and run nm on the .so - /me does that now [20:06] sinzui: staging updated [20:06] thanks mthaddon [20:07] yah [20:07] oh gosh, it's not a prebuilt egg, is it. Hrm [20:07] Gah [20:08] ok, I know what has happened, I didn't find all the places I needed to clean after accidentally building with the wrong python [20:08] ah, that could do it [20:09] maxb, yep, mine is built with PyUnicodeUCS4 [20:09] Hmm, rm -r lp-sourcedeps/eggs/* seems to have borked things quite a bit [20:09] just kill the eggs/ directory [20:10] it is a make target, 'make' will recreate it [20:10] I seem to have confused the build, now I get an ImportError for pytz [20:13] do you have eggs/pytz-2009j-py2.4.egg? [20:14] EdwinGrubbs: ping [20:14] well no, because I just deleted everything in eggs/ :-) [20:14] sinzui: hi [20:14] I've run "make clean; make" - it's doing stuff [20:14] Edwin, can you verify that IE 8 can create a project on staging? [20:15] sinzui: yes, I already ran that test and marked it on the wiki. [20:15] rock [20:16] EdwinGrubbs: do you agree the sprite is fixed: https://staging.launchpad.net/launchpad-registry/2.2/+addrelease [20:17] sinzui: yes, I hadn't seen that staging was updated with the last few revisions, but it looks good. [20:18] EdwinGrubbs: it just happened. That is why I am checking. [20:39] matsubara: ping [20:40] sinzui, hi curtis [20:41] matsubara: There are two registry bugs that are still bad, blocked by anther bug we are fixing. I don't think they are an issue because the feature is only used by admins, and the problem will be fix either in a reroll, or Monday when the fix lands on edge [20:42] matsubara: So I can move the bugs to the rc fixed area, or move them to a 2.2.8 test plan [20:42] sinzui, you mean the adminteammerge bugs? [20:43] yes, both of those [20:44] sinzui, remember that timeouts on staging have a lower threshold. are those timeouts under 25s? [20:45] and what is the other bug you're fixing that will fix both of those? [20:45] sinzui, they are not rcfixed; they are BAD, I think [20:45] sinzui, and then the decision is to roll out with those items as BAD [20:46] I have not tested them since they are blocked by the other bug. We believe the other bug is a performance issue for many timeout bugs [20:46] kiko: understood [20:46] sinzui, as kiko suggested leave them as BAD and make a note in the test plan pointing to the other bug that will solve both BADs [20:47] that way we'll know what we're still waiting for the re-roll [20:49] matsubara: kiko: registry is ready for the rollout [20:49] thanks sinzui [20:49] Ursinha, ^ [20:49] thanks [20:49] me [20:49] thanks matsubara [20:52] Is there an open bug for making LP work on Python 2.5? Or any preexisting discussion I can read on the topic? [20:52] maxb, gary will be working on that as soon as he has zope running from buildout [20:53] So I should just keep an eye on this channel then? [20:53] maxb: look in launchpad-foundations. The issue is a really a story, not a bug, but it is probably in there [20:54] Doesn't seem to be - oh well [20:59] maxb, nothing yet, but as kiko said, it's coming: https://dev.launchpad.net/VersionThreeDotO/Foundations [20:59] sure, I'm just curious to follow it as it evolves [20:59] Why is rocketfuel-setup installing what appears to be an entire texlive setup? [21:00] texlive? [21:00] Well, lots of texlive-* packages, which are probably the reason apt-get is going to download 277 MB when I press y. [21:01] I had a go at coaxing it to run under Python 2.5 on karmic myself, but am stuck on MemoryErrors being thrown from the depths of Zope/TAL [21:01] Snova_, somewhere in the launchpad-developer-dependencies chain I would guess [21:02] try installing firefox on a server, and you'll be astounded by what it pulls in :) [21:11] bac: did your fix for the team merge timeout land? [21:11] EdwinGrubbs: no. i'm not going to submit for this release [21:12] Ahah! I think it's python-epydoc; texlive stuff is in the Recommends. [21:13] Snova_, or it could be a build-depends - apt-rdepends shows some stuff there, too [21:15] EdwinGrubbs: delaying until PQM opens doesn't affect you does it? [21:16] bac: well, it just means that I can't QA my fix for deactivating the members of a team, so it's really not a big deal. [21:16] mars: Well, installing it without the recommended packages seems to have gotten around it, though something else might want it later. It looks like it's only used for documentation, though. [21:16] EdwinGrubbs: yeah, i'm in the same boat for +adminteammerge === mthaddon changed the topic of #launchpad-dev to: Launchpad will be down/in read-only from 22:00 UTC until 23:00 UTC for a code update | Launchpad Development Channel | https://dev.launchpad.net/ | Please use #launchpad for support. | https://launchpad.net/~launchpad-dev | Get it: https://dev.launchpad.net/Getting | http://people.canonical.com/~herb/ | http://paste.ubuntu.com/ [21:27] hello. I'm trying to run the rocketfuel-setup and I'm getting errors like this: [21:27] make: *** No rule to make target `install'. Stop. [21:27] ERROR: Unable to install apache config appropriately [21:28] anyone know whats up? [21:28] shriven, could you please put the output of the 'make' error into a pastebin? That will help us diagnose it [21:29] sure [21:30] mars: when you say the "make" error, what command are you envisioning me running to get said error? [21:30] all I've done so far is ./rocketfuel-setup [21:30] shriven, just the output from rocketfuel-setup so far will do [21:30] ok [21:31] I'd like to see the last lines, to get an idea about what it was doing [21:31] http://pastebin.ca/1503603 [21:31] thats the last 10 lines or so [21:32] I had previously finished the package installation and was just pking around [21:32] so thats all there is [21:32] currently the bzr login just sits... I let it try for a few minutes then hit cntrl-c to it [21:32] and it moved on [21:33] it moved on, then dies with this error later? [21:33] yea, just a few seconds later [21:34] lets start by checking what rocketfuel-setup is doing at this point [21:34] sure [21:35] just ran it again... this time bzr login seemed to suceed, same apache error though [21:36] good morning [21:36] shriven: are you a sudoer on this system? [21:36] yup [21:36] though it looks like the checkout must have failed [21:36] its a VM [21:37] well I don't see it doing any bzr work at all [21:37] holas wonderful lp hackers [21:37] oh [21:38] i was wondering... is there any special reason that branch_merge_proposal.createComment() in the API a) requires the subject argument, and b) doesn't seem to behave the same as if i carete a comment via the lp web ui? [21:38] shriven, "sudo make install" in devel/ fails, I'm guessing [21:38] shriven: it looks like getting a copy of the branch may have partially succeeded or something [21:39] shriven, check the root Makefile, you'll see what the 'install' target is doing [21:39] there is no devel/ [21:39] maybe I missed a step? [21:39] I thought I combed over it a few times.... [21:39] shriven: what files have been created? [21:39] let me go re-read [21:39] just rocketfuel [21:39] shriven: ~/launchpad, ~/launchpad/lp-branches, ~/launchpad/lp-branches/devel ?? [21:40] nothing exists below launchpad except rocketfuel [21:41] this is where I'm starting at, am I mistaken in doing this? https://dev.launchpad.net/Getting#Getting%20It [21:42] I saw the alternate source code download... I am assuming it really is alternative and rocketfuel will download the source itself? [21:42] shriven, it will [21:43] yeah, that must be the part that is failing for some reason [21:43] there really isn't a target for make install [21:44] shriven, yes, odd, rf-setup should have failed on line 368 [21:44] cd $LP_TRUNK_NAME [21:44] yes, I'm just browsing that myself [21:45] or earlier at 354? [21:46] yep [21:46] hmmm is it hardcoded somewhere that we must have our launchpad directory at ~/launchpad? [21:46] I put mine in ~/Applications/launchpad [21:46] preferring to do this sort of thing there [21:46] shriven: you can create a file ~/.rocketfuel-env.sh that sets some shell variables [21:46] ah! [21:47] yes, ~/launchpad/lp-branches has been created [21:47] i think LP_PROJECT_ROOT=~/Applications/launchpad will do what you want [21:47] shriven, line 47+ in rf-setup [21:47] ok [21:47] I'll just use the default way [21:47] thanks guys [21:52] mwhudson, do you remember what the 'bucket' argument is when creating an image? [21:53] mars: is that an argument to ec2-bundle-vol? [21:53] yes [21:54] no, it doesn't look like i passed it [21:55] mars: are you sure you don't mean ec2-upload-bundle ? [21:55] mwhudson, ah, sorry, yes [21:55] then it's the name of the ami, basically [21:55] you want launchpad-ec2test10 or whatever [21:56] right, ok, thanks [21:56] * mwhudson is extremely glad he kept his notes from when he did all the image diddling [21:56] I just did it from the AWS docs [21:57] mwhudson, here, I'll bundle the script I have, so you can take a peek [21:57] it automates image creation [21:57] same here, but it took a while and some hopeful guessing [21:57] ah, awesome [21:57] and instance configuration [21:58] * dobey wonders about this createComment() method [22:00] mwhudson, lp:~mars/lp-dev-utils/add-windmill-image-generator/ [22:26] hrmm [22:30] i started over with rocketfuel-setup and i got an ssh key error after apache setup [22:30] Host key verification failed. [22:30] bzr: ERROR: Connection closed: Unexpected end of message. Please check connectivity and permissions, and report a bug if problems persist. [22:30] any clues on that? [22:31] i told my real launchpad username to rocketfuel-setup when it asked me for a launchpad username [22:32] marc0s, what was the last line of successful rf-setup output before the failure? [22:32] so I know how far rf-setup go [22:32] got along [22:33] mars: http://dpaste.com/70131/ [22:33] so you have more lines to check [22:34] before that, some apache modules were enabled and apache reloaded [22:35] looks like it dies around line 373 maybe? [22:35] no, that can't be right [22:36] line 425+ somewhere [22:36] or maybe 361 ? [22:36] let me check 425 ... [22:37] marc0s, I would suspect line 485 then - rf-get itself may have died on you [22:37] yes, the supermirror one [22:38] if i launch rf-get it dies with the same error [22:38] if so, then no worries, you can just run it manually. The rest of the configuration suceeded [22:38] good! :) [22:38] good? :) [22:38] how should i continue now? [22:39] that means we have narrowed the error down to a single script, probably ssh authentication [22:39] with the make schema && make run stuff ? [22:39] ok [22:39] well, not having rocketfuel-get may be a problem, it implies you can't fetch stuff over bzr+ssh. [22:40] marc0s, did you supply an SSH key for your launchpad user account? [22:40] not an ssh key from this machine, so i was asking if i should before :) [22:41] I think it will work to run an instance of LP, but you won't be able to check in code, or use rf-get [22:41] does deve/sourcecode have symlinks in it? [22:41] devel/sourcecode [22:42] not at all [22:42] just a makefile [22:43] hmm [22:43] rocketfuel-get runs 'utilities/link-external-dependencies' [22:44] which populates devel/sourcecode/ [22:44] so you won't be able to proceed to 'make schema' without running that, or getting rf-get going. [22:45] hmm no good news :P [22:45] do you think uploading the ssh key will let me continue the bzr fetching process? [22:46] I'm not sure if it is the key that is the problem, or that it doesn't like bazaar.launchpad.net itself. You may be able to add that manually to your known_hosts file [22:47] marc0s, on a whim, what happens if you try 'ssh bazaar.launchpad.net'? [22:47] i've uploaded the key and it seems to be fetching more stuff [22:47] i try [22:47] No shells on this server. [22:47] and connectoin closed [22:47] ah, nm then :) [22:48] you added the key? and rf-get is running now? [22:48] it seems to, it's downlading :) [22:49] hope it finishes before the maintenance downtime scheduled to be in 10 minutes :D [22:49] I don't think that will affect it. It should be a read-only switchover. [22:49] not full downtime? [22:50] ah ok [22:50] sinzui, is distributionsourcepackagecache.py really meant to be in lp/registry? [22:50] i don't know just seen that on the web after uploading the key [22:50] how long will the maintenance be? [22:50] oh, 1 hour [22:51] hello everybody [22:51] good morning jml [22:51] hello jml [22:52] I was wondering about apturl in launchpad. I was thinking of writing support for it because I would think it would be quite useful for answers. Would anyone be able to offer some guidance? [22:53] Shane_Fagan, sure! [22:54] Ok so im downloading the source at the moment [22:54] So give me about 15 minutes and then ill start asking a few questions and hopefully get hacking after that [22:57] It would be cool if bzrlib could handle reconciliation between CLI options and CFG file options supplied to a script :/ [22:58] mars: lp:~mars/lp-dev-utils/add-windmill-image-generator/ looks fairly nice, if still a bit shell script ish [22:58] You have to manually merge optparse and ConfigParser into a new class to get that to happen with the stdlib [22:59] mwhudson, shell-ish? :) [22:59] mars: now write a version that updates the ec2test-ish [22:59] mars: well, maybe that's not quite right [22:59] mars: copy-and-paste ish from ec2test [22:59] yeah, there is a good reason for that [22:59] i can believe it [22:59] that reminds me [23:00] that reason being that I did not want to risk breaking ec2test at all, and I needed some features to be factored out into smaller bits [23:00] is ec2test ok to be a bzr plugin? [23:00] jml, no one has objected, but gary is away at OSCON - did he have anything to say on the matter? [23:00] he did have plans for the script [23:01] i think the downtime was total :) connection closed to bazaar.launchpad.net [23:01] mars, no definitive answer. [23:01] but then, he is also quite pragmatic - if a plugin is better and cleaner, I'm sure he would enjoy doing so [23:01] jml, mwhudson, thumper are you guys up for meeting in 29m? [23:02] jml, how were you going to land the plugin? [23:02] barry, yes [23:02] land/distribute [23:02] jml: fantastic [23:03] mars, simply change ec2test.py to a plugin, ask people to symlink it into ~/.bazaar/plugins [23:03] jml, why not land it beside ec2test.py as ec2test_plugin.py? [23:03] that way we can transition from one to the other [23:03] jml, set-based development :D [23:04] mars, "why not" is because it's accompanied by other refactorings to ec2test [23:04] to make it more module-like [23:04] sinzui: hai [23:04] Damn does bzr stop in read only mode too? [23:04] (and because I want to delete the current option parsing) [23:04] jml, ok, that still doesn't prevent you from landing one beside the other, does it? [23:04] Shane_Fagan: yes [23:04] Ah crap [23:04] mars, no, it just means more work. [23:04] lifeless, I take it read-only mode interrupts the SSH connections? [23:05] mars: we write to the db when the client disconnects, to trigger scanning, public mirroring, etc [23:05] barry: yes [23:05] lifeless, not anymore, we write to db on Branch.unlock)( [23:05] lifeless, ok, so "yes"? :) [23:05] i think codehosting is down during r/o mode at the moment? [23:05] jml: sftp :P [23:06] not strictly necessary [23:06] lifeless: the same [23:06] lifeless, same. [23:06] ok cool. I don't want to know how you determine unlock for sftp ;P [23:06] lifeless, I won't tell you [23:06] mars: I don't see the correspondence to SSH connections in what I said :) [23:06] magic? [23:07] thumper: http://www.w3schools.com/CSS/pr_text_white-space.asp [23:07] * ajmitch would like bugs to still be visible when in r/o mode [23:08] * jml too! [23:08] time to get the family supper [23:08] good night! [23:08] bye mars [23:08] thanks! :) [23:11] Is it ok that the install stopped like that or will it cause problems? [23:12] It was in the middle of getting the branch [23:17] rocketfuel-setup has failed while branching... I hope this hasn't been asked half a dozen times today already, but http://paste.ubuntu.com/225073/ [23:17] It maybe because launchpad is in read only mode [23:18] Im getting this error http://paste.ubuntu.com/225080/ [23:19] barry: i need to pop out for a few minutes, maybe 10? [23:21] * jml looks at the pastes [23:21] Snova_, yeah, sorry about that. Launchpad going down interrupted your pull. [23:21] jml: Just my luck. :P I'll try again tomorrow, I guess. [23:21] Shane_Fagan, you'll need to add an SSH key to your Launchpad account to get rid of that error, I think. [23:22] Snova_, it'll be up again in less than an hour. [23:22] I have one [23:22] jml: Yes, but this connection is rather slow, and it's getting late. [23:22] Shane_Fagan, is your Launchpad account called 'shane'? [23:22] Snova_, ahh, ok. no worries then. [23:22] shanepatrickfagan [23:22] Snova_, better luck tomorrow [23:22] Its worked every other time ive tried it [23:22] Shane_Fagan, Launchpad is trying to use 'shane' to SSH in. [23:23] "bzr: ERROR: The user shane has not registered any SSH keys with Launchpad." [23:23] Ah ill switch and see what happens [23:23] Shane_Fagan, type: 'bzr launchpad-login shanepatrickfagan' and you should be right. === matsubara is now known as matsubara-afk [23:24] Nope still the same error [23:24] Ill try it after it comes out of read only mode and see [23:25] sinzui: ping [23:26] Hi thumper [23:26] sinzui: I've got a question about layers and requests [23:26] sinzui: I'm trying to write a test for my oops on demand branch [23:26] sinzui: which needs a current browser request [23:26] sinzui: how can I easily set one up in a unittest? === salgado is now known as salgado-afk [23:27] hmm. I think I had to subclass a TestRequest to do that [23:28] thumper, jml, mwhudson -> #launchpad-meeting in 2m [23:28] sinzui: have you done it somewhere? [23:29] sinzui: the thing is I'm using the from lazr.restful.utils import get_current_browser_request [23:29] sinzui: in the code I'm testing [23:29] thumper: I am looking for an example [23:29] sinzui: cool, ta [23:32] Aargh. [23:32] I just lost a huge bug comment because Launchpad is (presumably) in read-only mode and still allows AJAX "in-page" actions to run. [23:33] jkakar, argh [23:33] I'll file a bug about it, if find any [23:34] thumper: look at [23:34] from canonical.launchpad.layers import setFirstLayer [23:34] setFirstLayer(request, 'CodeLayer') [23:34] Ursinha: Hmm, I wonder if I'm wrong. [23:34] thumper: it is just a wrapper for: [23:34] directlyProvides(request, layer, directlyProvidedBy(request)) [23:34] jkakar: you mean you opened the collapsing form under the bug tasks table and tried to submit? [23:34] Ursinha: I was on a bug page, clicking "Add comment", entered my comment and then, after clicking "Submit", I got the "Launchpad Offline" page... but I'd loaded the page before LP went down. [23:35] intellectronica: Nope, I used the collapsing form for adding a comment. [23:35] jkakar, we need to slap a launchpad.Edit on that link [23:35] when LP comes back, we need a bug :) [23:35] Ursinha: If I try and load it now I just get the "Launchpad Offline" page. [23:35] beuno: Ah, okay. [23:35] jkakar: ah ok, so nothing to do with ajax [23:35] intellectronica: Maybe, I'm not sure. [23:35] beuno, I'll file one [23:35] ideally we should disable forms like that in read-only mode [23:35] intellectronica: Yes, exactly. [23:36] but in this case, if you loaded the page before LP entered read-only mode that wouldn't have helped [23:36] intellectronica: The only thing is I loaded the page before LP went read-only, so how would it know in that case? [23:36] intellectronica: I guess it could ping every now and then to see if LP is alive, but that kind of thing is fraught with terribleness. [23:36] with ajax, otoh, we could try, tell you that we couldn't save and ask you to try again later, so there's an opportunity for a better experience [23:37] intellectronica: Ah, duh, of course. Use AJAX for the form submit. [23:37] intellectronica: That'd be nice, yeah. [23:38] jkakar: yes. that's coming soon anyway [23:39] sinzui: how does that help? [23:40] intellectronica: Awesome, thanks. [23:50] hey kiko, remember that matrix you put together recently of all the weekly meetings? If you didn't already think of this, that would be good info to have on the dev wiki for the community devs don't you think?