[12:05] BACK! [12:06] sabdfl: here's the problem: i'm lazy. i want one screen on which to see everything. [12:07] sabdfl: forcing a user to visit two different screens "the bugs" is too much. [12:07] my report put it all on one screen [12:07] just in four sections [12:07] upstream, directly assigned [12:07] package, directly assigned [12:07] upstream, maintainer [12:07] package, maintainer [12:08] but you made it go away :-/ [12:08] sabdfl: that's a heck of a lot to think about. i just want one thing to look at. [12:08] BradB: it works well actually [12:08] sabdfl: and i can't say that four different things to batch is much easier to solve than the problem at hand :) [12:08] you don't see sections that don't apply [12:09] i spent a lot of time beating up on myself to try to consolidate these assignments into a single report [12:09] and failed [12:09] the reality is, we wear different hats in the FLOSS world [12:09] i succeeded, but it's just too slow [12:09] and malone is modeling different hats [12:10] so, let's just get it up and running, perhaps somewhat fragmented [12:10] there are four different groups? show four separately [12:10] then when we have real users we can revisit that problem [12:11] sabdfl: to be honest, i think it'll be (much) easier for me to solve the problem at hand, it would have just taken 15 minutes instead of 2 hours, had their been one thing in the DB i can iterate over to deal with one conceptual entity. [12:12] maybe [12:12] we split it up because having one conceptual entity was breaking other things [12:12] and i didn't want to use postgres inheritance [12:13] time for me to crash a little, be fresh for the arch guys tomorrow [12:13] sabdfl: i haven't heard anyone complain about the bug listing in malone. i think it's great (which isn't to say it's perfect, but rather to say that it's got the right ideas) [12:13] BradB: there's room for different approaches [12:14] we are definitely going to need a complex search page for people to make up fun queries and email them around [12:14] or save as personal queries [12:14] BUT there is also room to have short, simple, focused context-aware listings [12:14] sabdfl: sure...i think having an ultra-super-mega search page is worth creating a separate page for [12:14] "the bugs on this package" [12:14] bradb: yes, it is [12:14] but you keep taking away my simpler things in favour of the mega search page [12:14] sabdfl: but, really, the simple searches of which you speak are just links into what is the current bug listing [12:15] erm... no they are not [12:15] sabdfl: and they can all be really, really easily done with code that's already written [12:15] they are context-aware bug listings [12:15] sabdfl: which are context-aware? [12:15] the simple ones [12:15] they know which distro, and package you are interested in [12:15] so they just show you that stuff [12:15] without knobs and dials to tweak them [12:15] it's gnome vs kde [12:16] i understand you want the kde approach, i want the gnome approach, and there's room for them both [12:16] what i'd rather focus on is workflow stuff [12:16] mark a bug upstream [12:16] we're debating something here that nobody has complained about. [12:16] remove a bug assignment [12:16] nobody is USING it [12:16] the dogfooders [12:16] and right now we have a lot of little bits to do [12:17] i'd rather we worked on the selectors, and the little workflow elements [12:17] yes [12:17] some of the things require you to know the datamodel [12:17] they should have direct answers - how do you reassign a bug? [12:17] "little workflow elements" are a huge, as-yet-unimplemented part of malone :) [12:17] in practice, you edit the assignment [12:18] but there should be a "reassign this" sort of link [12:18] at the moment, it's just auto-generated widgets on the underlying tables [12:18] we need to get it more process oriented [12:18] so please dont bang hours on a report [12:18] not just yet [12:19] my next merge will show # bugs, give next and previous links on the nav, and, hopefully be relatively fast for 10,000 bugs [12:19] cool [12:19] it's the last one that's got me tripped up [12:19] but anyway, i'll get it working [12:19] are you starting to add indexes for that performance, or is that without indexes? [12:19] sabdfl: no indexes yet. i've got some kinks to iron out. [12:20] the slowness that remains may be at the db level, i'm not sure [12:21] i'm really happy with the work you are doing [12:21] thanks [12:22] during es-conf we'll bring on-stream the debbugs sync engine [12:22] should really rock [12:22] you'll be able to surf debbugs in malone [12:22] updated hourly [12:22] sweet [12:23] night all [12:23] see ya tomorrow [12:43] what's the trick to running *just* the page tests? [12:43] python test.py -f canonical.launchpad [12:43] i'm still trying to go to bed [12:43] that runs the page tests + a couple other functional testes [12:43] um, tests [12:43] thanks SteveA [12:43] I hope we all have functional testes [12:43] and that's faster is it? [12:43] than running make check? yes [12:47] python test.py -vvf is a good way of seeing what's going on [12:47] and, unfortunately, python test.py -vvf --test "20-some-pt" doesn't reset the db properly currently [12:50] Merge to rocketfuel@canonical.com/launchpad--devel--0: added bug # count info and next/prev URLs to batching (patch-845) [12:51] SteveA: here's a wild idea: i want to be able to profile how long some tal statements are taking to run. can i do that? [12:52] i'm thinking the bottleneck in the 10,000-bugs handling code may be in the TAL itself. hitting the db is murder. [12:54] kiko: yes? [12:57] Kinnison, you rock? :) [12:57] I need to run, though! [12:57] SteveA: ah, i mentioned to stub yesterday that the new bug may indeed have been to do with the internals of publishing having changed + our custom publisher [12:57] yes, I saw [12:57] I saw from the traceback that it was something to do with layers and view [12:58] but it has taken a while to track down exactly what it is [12:58] indeed, that was a tough one :) [12:58] glad to hear you've found it [01:00] Merge to rocketfuel@canonical.com/launchpad--devel--0: prepare for doap status fields (patch-846) [01:06] BradB: might have a problem though -- I need to think about how to upgrade launchpad so that it will work with either current zope or new zope [01:07] think I can do it with an import trick [01:11] hm, i'd like to know more about that, but i have to leave right now unfortunately. i'll catch up with you on the upgrade/backwards compatibility tomorrow(ish...i know you're off to london.) [01:11] later all === BradB is now known as BradB|away [01:11] BradB|away: I'll be checking in changes soon that will allow lp to work with old and new zope [01:11] yay! it works [01:13] wow, nice work SteveA [01:13] I'm about to commit it === BradB|away heads off to catch the metro [01:25] Merge to rocketfuel@canonical.com/launchpad--devel--0: Made launchpad forward-compatible with latest zope3 code (patch-847) [01:26] thanks dilys === SteveA goes to sleep [01:35] Night all === stub [~stub@dsl-246.248.240.220.dsl.comindico.com.au] has joined #launchpad [03:34] lifeless: ping === stub [~stub@dsl-246.248.240.220.dsl.comindico.com.au] has joined #launchpad [05:58] Merge to rocketfuel@canonical.com/launchpad--devel--0: Sampledata documentation additions and clarifications (patch-848) [07:53] New Malone bug #74: "Remove do-not-use-info-imports project", submitted by Stuart Bishop [07:53] https://launchpad.ubuntu.com/malone/bugs/74 [07:55] New Malone bug #75: "Adding bug takes you to the wrong screen", submitted by Stuart Bishop [07:55] https://launchpad.ubuntu.com/malone/bugs/75 [09:13] stub: pong [09:15] lifeless: I wanted to confirm an arch process regarding branches. If a developer working on launchpad--devel--0 creates a branch using 'baz branch launchpad--mybranch--0', hacks away and commits, can PQM be told to merge in changed directly from launchpad--mybranch--0 into rocketfuel@canonical.com/launchpad--devel--0 ? [09:16] This is regarding database changes that need to be committed at the same time as code and test updates, so ideally I could checkout someones branch, verify and issue the PQM request. [09:16] fully qualify those branches, and I'll be able to answer [09:17] lifeless: I wanted to confirm an arch process regarding branches. If a developer working on me@canonical.com/launchpad--devel--0 creates a branch using 'baz branch me@canonical.com/launchpad--mybranch--0', hacks away and commits, can PQM be told to merge in changed directly from me@canonical.com/launchpad--mybranch--0 into rocketfuel@canonical.com/launchpad--devel--0 [09:17] no. [09:17] it may work, some of the time, but its not a star. [09:17] so, it will generate spurious conflicts if the timing is wrong. [09:18] the developer can go baz switch rocketfuel..devel--0; baz branch me...devel--0; baz commit; submit-arch-merge [09:18] ok. I'll need to come up with a better process. [09:19] so whats the use case ? [09:20] A launchpad developer is happily hacking away and realize they need a database schema update done. Unfortunately if that schema update cannot be made immediately by me because it would cause breakage and tests to fail. So instead the patch needs to be prepared and committed at the same time as their code changes. === stub wants baz triangle-merge [09:21] so, what they need to do is not commit those changes to their main branch. [09:22] hmm [09:22] ok, this will work. [09:22] 1) branch me..devel to me..d-feature [09:23] 2) hack and commit there unti the db stuff is done. [09:23] 3) merge that back to me..devel [09:23] 4) future work there. MUST NOT merge to rf at this point. [09:23] 5) you verify and then merge me..d-feature to rf. [09:23] 5) they merge the lsat stuff from d-feature to me..devel [09:24] oops, missed a step. [09:24] nope, won't. garh. [09:24] yes, you need what we're talking about here with baz and graph merges. sory. [09:25] We are coping so far. I just look at the patch and say 'ok - commit it as patch-foo.sql' [09:25] yeah. [09:30] This actually points out a flaw in the multiple trees vs. single tree project arrangement. If a project is made out of 'web--devel--0' and 'backend--devel--0', and there is an interface change in 'backend-devel--0', then a commit would need to be made simultaneously to both trees. [09:31] the spec for that is designed in tla already, and pqm can be easily taught that too. [09:34] morning all [09:46] yo [09:55] stub: did you ask lifeless about getting Zope3 into the supermirror? [09:55] Nope [09:55] stub: pending/mark-bugtracker-naming.sql is ready from my side [09:55] lifeless: put Zope3 into the supermirror! [09:55] :) [09:55] that's *my* kind of asking ;-) [09:56] our source will now work with the latest zope3 code [09:56] stub: regarding pending/mark-doap-status.sql i'm not sure that "status" is the right column name [09:56] i really want to use that to describe whether or not it's been reviewed, and if so whether its active or not [09:57] this will allow me to generate reports of new ones, and have an admin team go through them and clean out the ones that are pure nonsense [09:57] also, edit and neaten the descriptions of the projects / products [09:58] "status" is one of those "last resort" names for variables and columns [09:58] agreed [09:58] "reviewed"? [09:58] there is almost always a better name, but often it is cumbersome, or hard to think og [09:58] reviewstate? [09:59] speak now or forever hold... [09:59] I havn't looked at the patch yet - just finalizing a commit [10:00] bugtracker-name isn't urgent, it's behind the scenes and can go whenever you like [10:01] this is the doap-status pending patch that i need for work this morning [10:01] I think status is fine, because you are using it to describe a linear workflow (new, reviewed, active). [10:02] (Unless it can be active without having been reviewed) [10:02] it will be active without review... [10:02] NEW and ACTIVE we should treat the same, otherwise people will fel they have to wait for us all the time [10:02] it's just our way of knowing which one wes we have looked at and which we haven't [10:03] So we should have a 'reviewed' boolean field (?), because it is indicating an independant binary state [10:04] And an 'active' one [10:05] Unless we are planning on having more values than just yes/no [10:05] you;re right [10:05] i was hoping to keep it to a single field but you're right [10:06] let me restructure the patch on that basis === lulu [~lu@host217-37-231-28.in-addr.btopenworld.com] has joined #launchpad [10:16] stub: dilys will announce the merge shortly [10:17] could you have a look at that and, if it's good, move it to a patch- during the day? [10:17] night ;) [10:18] sure [10:18] I think your patch is fighting with my patch for pqm time, so I can't merge just yet ;) [10:19] right [10:19] your timezone adjustment to spain should be easy... you're there already! [10:20] Morning [10:20] hey Kinnison [10:20] lifeless: pqm dead I think [10:20] hi sabdfl === carlos [~carlos@69.Red-80-33-181.pooles.rima-tde.net] has joined #launchpad [11:21] stub: doh, small mistake in that patch, will send in a new merge === cprov [~cprov@200.158.100.251] has joined #launchpad [11:29] Morning cprov [11:38] Kinnison: morning, how was yesterday ? I had an unexpected travel to So Paulo. let me know what you've done and what I can do to help you . [11:42] cprov: I've been concentrating on gina as you may have seen from the activity list :-) [11:45] Kinnison: I've just read you comments/activities, I'll be working on Librarian Wrapper Unittest for today, is it ok for you ? [11:46] Merge to rocketfuel@canonical.com/launchpad--devel--0: corrected doap status patch (patch-849) [11:52] stub: thar she blows [11:58] cprov: perfect [11:58] does stub ever sleep? === stub snores loudly [12:10] SteveA: i have moments of exhiliration with z3 [12:10] no idea how to spell that [12:12] +++ Whispered to GoogleBot: 'spell exhiliration' [12:12] GoogleBot >Perhaps you meant 'exhilaration'? [12:12] there you go ;-) [12:13] jim has started working on a "dead simple" version of zope3. well, not really a version. a very minimal pythonic thing, with no zcml, not necessarily page templates. the kind of thing you'd use for ship-it or supermirror. [12:14] a sort of no lerning curve thing [12:17] when we get a browser:form directive would you point me at the docs for it? [12:17] I'll be able to point you at the docs for it before we get the directive. [12:24] Merge to rocketfuel@canonical.com/launchpad--devel--0: More popups - Person and BinaryPackageName (patch-850) === stub hands pqm a banana === SteveA [~steve@adsl-213-190-44-43.takas.lt] has joined #launchpad [01:03] x crashed === debonzi [~debonzi@200.158.100.251] has joined #launchpad === salgado [~salgado@200-206-134-238.async.com.br] has joined #launchpad === SteveA -> plane [01:53] hi salgado [01:53] how's the karma chameleon coming along [01:55] sabdfl, hello. I'm finishing the move of the people bits to foaf, and I'll start on the karma tonight. [01:56] cool enough [01:56] sabdfl, I was thinking about the karma yesterday, and I discussed with kiko if there would be any kind of depreciation of the cached value? [01:56] depreciation? you mean, it declines over time? [01:56] yes [01:56] or deprecation - we prefer not to use the field? [01:57] the former [01:57] ok [01:57] kiko and i discussed a karmaactivity table, where you would store a list of the karma-earning actions a person had taken [01:57] so each time the person does something karma-worthy, we throw a row in the table to reflect it [01:57] it would include a datecreated [01:58] and the Person.karma value would be calculated from that table [01:58] and yes, i think it makes sense to calculate it over the past month only [01:58] or, if you want to be fancy, give actions in the last month full weight, the month before that half weight, and before that one third weight [01:59] for the moment, let's just get the hooks in place to put rows in the table and have a very simple aggregation formula [01:59] we can tweak it once we have richer data to work with [02:00] ok, but then we'll have to calculate Person.karma periodicaly (apart from updating it everytime someone calls Person.assing_karma()), right? [02:02] I was thinking about a daily (or weekly or montlhy) depreciation, to avoid having to recalculate the Person.karma. === Kinnison asks gina nicely if she'd mind importing d-i too now [02:25] sabdfl, ? [02:25] yes? [02:26] salgado: let's get the core framework working first [02:27] sabdfl, sure. the depreciation is something that can be discussed later [02:38] \o/ /\o/\ /o_ /o\ [02:38] gina has imported with d-i now === Kinnison just has a little more to go before unleashing her on hoary [02:48] we love gina! [02:48] She's a babe [02:53] cprov: where can i find the sourceforge / freshmeat access functions? [03:20] Is this channel registered? [03:42] 00:42:32 kent | bob2, do ubuntu keep track of strings they have changed, and if they are accepted upstreams? if accepted upstream, i guess they will be [03:43] translated in time.. [03:43] that's a good idea! [03:46] Merge to rocketfuel@canonical.com/launchpad--devel--0: Database schema patches for Carlos and Mark (patch-851) [03:46] thanks === salgado -> lunch and then classes. come back at night [03:49] elmo: around? [03:49] (elmo/#launchpad) sabdfl: yes [03:49] hiya [03:50] sabdfl: yesterday, I detected an intrusion in one of my servers. Today seems like another one (the new) has the same problem. Is ok for you If I move my today work to Saturday? [03:50] can we shuffle the current launchpad.ubuntu.com to dogfood.canonical.com, and make launchpad.ubuntu.com point at macquarie's production launchpad server? [03:50] elmo: ^ [03:50] carlos: yes [03:50] sabdfl: thanks [03:50] (elmo/#launchpad) sabdfl: when? [03:50] elmo: this week [03:51] daf: I will be online, if you need anything from me, just ping me [03:51] carlos: is there any chance that your compsomise could affect chinstrap? [03:51] (elmo/#launchpad) sabdfl: sure - is it ready on your end? [03:51] sabdfl: no way [03:51] elmo: yes, I think the production code gets updated regularly by lifeless and stub [03:51] (elmo/#launchpad) carlos: you were compromised? [03:52] carlos: so you haven't ever ssh'd to a canonical box from those machines? [03:52] elmo: not my personal server directly but a gforge server I admin [03:52] (elmo/#launchpad) sabdfl: should anyone be around when I do it, or can I Just Do It? [03:52] sabdfl: no, I only ssh to canonical machines from my local machines [03:52] elmo: we cover enough timezones to be able to fix any issues, so Just Do It [03:52] daf: if you are around, this might affect the rosetta testers [03:53] but i don't think so since rosetta.shuttleworthfoundation.org will still point at the same ip address on mawson [03:53] I have different passwords and the ssh private certificate is not there, so don't think it's a problem [03:53] carlos: ok, good luck cleaning up [03:53] sabdfl: thanks [03:54] sabdfl: so rosetta.shuttleworthfoundation.org will be the production server now? [03:55] carlos: no, it will still point at the dogfood server for a while [03:55] ok [03:56] carlos: later on, we can point it at the production server for most users [03:56] then the advanced rosetta users can use dogfood.canonical.com for testing pre-released features in rosetta, before they move to production [03:59] ok [04:00] (elmo/#launchpad) sabdfl: are we still client cert protecting both sites? [04:01] elmo: yes please === BradB|away is now known as BradB [05:03] sabdfl: they are under lib/canonical/launchpad/scripts/nicole/, to be precise in sourceforge.py [05:20] minor nit: you can enter random shit in the arch "version" field for a new rcs and it won't complain [05:22] er, for a source === debonzi [~debonzi@200.158.100.251] has joined #launchpad [05:46] bob2: yeah, because we don't trust that form. === BradB wishes Zope 3 worked with profiling tools [06:16] Is there any easy way to turn on debugging in SQLOS? I want to have SQL statements printed out somewhere, to perhaps get an idea of what's making the bug listing take 1m 30s for 7,000 bugs. [06:17] initialise it with debug=1 ? [06:18] Where 'it' is something I'm not certain of yet [06:18] The sqlobject documentation refers to initialising the 'connection' with debug=1 [06:18] yeah, i know about that :) i wasn't sure where this is done though. === BradB hunts around for something looking like our db connection [06:19] BradB: log_statement = true [06:19] in /etc/posgresql/postgresql.conf [06:19] then restart postgres [06:19] and tail the log [06:21] ROCK [06:22] that in combination with log_duration rocks my world [06:36] 45 seconds of it is our vocabs, eesh [06:37] all the more reason that we really want to upgrade Z3 [07:01] (elmo/#launchpad) postgres has stats stuff to tell you about index usage etc. too [07:13] Merge to rocketfuel@canonical.com/launchpad--devel--0: Soyuz sourcepackage translation portlet fixed. (patch-852) [07:16] lulu: I added the RSS feeds for freshmeat and lwn, and shortened all feeds to five each. I think Simon'll be the right one to respond re: the question specific to ZWiki. [07:19] I put anymore optimization work on hold, since the work on the selection widgets will make at least half the problem magically disappear (since the hack of using normal vocabs will be no more.) [07:22] lifeless: ping [07:22] Malone bug #19 fixed for package malone: Bug listing needs paging [07:22] https://launchpad.ubuntu.com/malone/bugs/19 [07:24] sabdfl: ping [07:29] Malone bug #18 fixed for package malone: Bug workflow needs to make it easy to resolve bugs [07:29] https://launchpad.ubuntu.com/malone/bugs/18 === salgado [~salgado@200-206-134-238.async.com.br] has joined #launchpad [07:33] Malone bug #68 fixed for product Malone: Bug assignments search needs Next and Prev nav options [07:33] https://launchpad.ubuntu.com/malone/bugs/68 === BradB is now known as BradB|lunch [07:55] I've got a sqlobject, which is not being commited [07:55] commit is called [07:55] no exceptions thrown [07:55] but nada in the db [07:57] BradB|lunch: pong [07:58] BradB|lunch: pong === Kinnison kicks gina in the unmentionables [07:59] Kinnison: with the beeeatches you got to do the slappin', not the kickin' [07:59] sabdfl: the way gina is behaving I'm beginning to wonder if she's "All Woman" [08:00] I have to fix these FMO things or else decide how to cleanly work around them for publishing purposes [08:01] FMO things? [08:01] (elmo/#launchpad) fuck me over [08:02] (elmo/#launchpad) err, that's what it means [08:02] (elmo/#launchpad) it's a kiko-ism [08:03] if not srcpkg: [08:03] print "\t** FMO courtesy of TROUP & TROUT inc. on %s (%s)" \ [08:03] % (bin.source, bin.source_version) [08:03] elmo: kiko really loves and admires you, doesn't he? [08:03] night all :o) [08:04] night lu === Kinnison hugs lu === lulu hug back! === lulu [~lu@host217-37-231-28.in-addr.btopenworld.com] has left #launchpad [] [08:13] Merge to rocketfuel@canonical.com/launchpad--devel--0: Fixing on Librarian Wrapper and soyuz/people moved to FOAF from salgado (patch-853) [08:15] cprov: thanks for your efforts on the librarian wrapper today === BradB|lunch is now known as BradB [08:20] lifeless: stub mentioned something he wanted to get you to do so that it would be easy for us LPers to upgrade Z3 without requiring anything from you...is there something you can think of doing that would make it easy for easy to upgrade Z3 relatively painlessly whenever we decide we need to? [08:22] sabdfl: do you have an idea in mind for the shortest distance to assigning a bug? i wanted to fix #47, which refers to that. [08:23] Merge to rocketfuel@canonical.com/launchpad--devel--0: doap workflow, manifest work, product portlet cleanup (patch-854) [08:32] BradB: shortest distance to assigning a bug? [08:33] sabdfl: in the collector issue you said: [08:33] The idea is that bugs are New until the assignee "accepts" them, at which time they become Open. We really need a fast way to accept bug work, rather than changing the initial state. [08:33] Do you know what the fast way to accept bug work is? [08:34] ok... "changing state" is just an HTTP call, right? so imagine we had a report that had two images - "accept" and "reject" [08:34] I can imagine a UI down the road that allows one-click bug acceptance, but i think that's pushing it a bit right now [08:34] clicking on them gets JS to send that HTTP call [08:35] and changes the state in the report [08:35] click click click down the list and you've done it [08:35] got to go.. back later [08:35] ok === dafydd [daf@muse.19inch.net] has joined #launchpad [09:43] daf! [09:50] Merge to rocketfuel@canonical.com/launchpad--devel--0: Zope 3 compatibility fix, Carlos' upload database code (patch-855) [10:22] hey daf [11:02] I expect there to be an easy way to fetch a URL in javascript. It appears that I expected wrong. === Kinnison decides that working from 9am to 10pm has got to be enough === Kinnison goes to have some dinner and to read his library book === BradB tries something [11:19] kickass [11:20] iframe's rock