/srv/irclogs.ubuntu.com/2010/02/18/#launchpad-dev.txt

=== maxb_ is now known as maxb
thumperjml: could you enlighten me to how it's hocked up?00:13
jmlthumper, IBranchSet is exported as a collection, getByUniqueName is a read operation on that collection00:14
thumpergotcha00:14
thumperjml: thanks00:14
jmlthumper, np00:14
thumpermwhudson: when is good for you?00:18
mwhudsonthumper: argh00:19
mwhudsonthumper: about an hour?00:19
thumpermwhudson: ok00:19
mwhudsoni haven't had lunch yet00:19
thumpermwhudson: at least it'll timebox our discussion00:19
thumpermwhudson: I have to go get the girls at 300:19
mwhudsonthumper: ok00:19
=== jamalta is now known as jamalta-afk
* mwhudson lunches00:27
thumpersinzui: ping00:50
mwhudsonthumper: hello01:06
thumpermwhudson: hi01:06
mwhudsonthumper: ready for a call now, but if you can wait a few minutes more you won't have to listen to me eating my lunch :-)01:07
thumpermwhudson: I can wait a few minutes :)01:07
thumpermwhudson: now?01:20
mwhudsonthumper: yep01:20
mwhudsonthumper: https://code.edge.launchpad.net/~vcs-imports/pydoctor/trunk01:31
thumperhttps://edge.launchpad.net/ubuntu/+source/gwibber/2.29.90-0ubuntu101:33
thumperhttps://edge.launchpad.net/~gwibber-daily/+archive/ppa01:35
thumperhttps://edge.launchpad.net/~gwibber-daily/+archive/ppa/+build/151463101:38
mwhudsonthumper: https://edge.launchpad.net/builders/01:40
mwhudsonthumper: https://edge.launchpad.net/~launchpad/+archive/ppa/+build/105675101:43
pooliedid abentley or anyone write a script that will automatically feed approved reviews to pqm?02:18
poolieor semiautomatically?02:18
abentleypoolie, not that I know of.02:18
pooliemaybe i will then02:19
abentleypoolie, however, Tarmac behaves that way.02:19
poolieit automatically pulls?02:19
pooliedo you think we should switch?02:19
abentleyIt automatically merges approved merge proposals and commits.02:19
poolieright02:19
abentleyI think we should switch.02:20
poolieso presumably one should only use status:Approved if you really mean 'approved with no further changes'02:20
poolienot conditionally approved02:20
abentleypoolie, true.02:20
abentleypoolie, when we get a chance to work on merge queues again, that will be less of a concern.02:21
pooliei think it's ok, as long as people use it that way02:22
poolieit's probably a good idea anyhow02:22
pooliein piloting i find myself wanting a state that's not "in progress" but not "needs review"02:22
poolielike, it needs a pp to fix it02:22
pooliesomewhere in between02:22
abentleypoolie, if we can generalize it sufficiently, cool.02:24
abentleypoolie, another option was to assign merge proposals to people.02:24
pooliei don't think adding another state is precisely right02:24
pooliemaybe that's it02:24
pooliebecause actually i want to distinguish 'the author is going to go away and fix this' from 'i will'02:24
poolieso maybe assignment is right02:40
lifelesssounds like a bug02:47
abentleylifeless, what sounds like a bug?02:57
lifelesssomething that gets assigned to someone to do, and wanting to track that02:57
poolieyeah, but it's one of those vague difficult bugs02:58
abentleylifeless, ah.  I thought you meant the discussion suggested a bug was present.02:58
poolieit's questionable to file it until you can make it concrete imo02:58
lifelesspoolie: I guess I'm saying that maybe merge proposals lie on the same spectrum as specs and bugs02:59
poolieoh i see02:59
poolieIAssignable02:59
lifelesswhile I'd like to see be less crisp about what they are, and more malleable about what we want them to do02:59
lifelesss/while/which/03:00
=== bjf is now known as _bjf
mwhudsongrr what's locking bugbranch03:49
mwhudsonoh probably the scanner03:49
poolielifeless: i was interested by the idea of using rpc signing rather than https04:01
pooliehttp://developer.amazonwebservices.com/connect/entry.jspa?externalID=192804:01
poolie"use ssl if at all possible though it is slower"04:01
lifelesspoolie: yes04:01
poolieso i think we should fix lplib (or lazr or whatever) to hold the connection04:02
lifelesspoolie: you still get to avoid round trips though - and note that more and more corporates are deploying SSLBump and equivalents04:02
lifelesspoolie: ofh for sure.04:02
poolie'still get to' how?04:03
lifelesspoolie: using message signing04:04
poolieusing message signing and http?04:04
poolieyes04:04
poolieit's kind of a shame it's not enough04:04
mwhudsoncan you upload files to the librarian without a database connection?04:12
mwhudsonhm04:13
* mwhudson eods04:30
thumpergah07:36
thumpercan't get balsamiq to start07:36
thumper:(07:36
adeuringgood morning08:08
mrevellMorning09:07
* wgrant is surprised to see the product/project rename actually happening!10:29
deryckMorning, all.11:01
bigjoolsmorgen11:04
adeuringmorning deryck11:06
didrockshey guys, I've at last a LP checkout working in a karmic VM. I'm tried to export and import GPG key from the launchpad API (cf bug #389872). Following jml's explanation, I have added the export_read… export_write… decorator to function but I don't have any idea of other stuff to add. For the attribute, appart from adding exported() to them, same thing, quite lost12:13
mupBug #389872: GPG keys not exposed in API <api> <Launchpad Registry:In Progress by didrocks> <https://launchpad.net/bugs/389872>12:13
didrocksis there any doc or help I can get? :)12:13
thekorndidrocks, there is https://dev.launchpad.net/API/ImplementingAPIs which explains how doing such things,12:21
didrocksthekorn: sweet, it seems to be what I need, let get it a try :)12:22
didrocksthanks12:22
thekorndidrocks, did you push your code somewhere?12:22
didrocksthekorn: not yet, I'll try to get it working first and check locally before pushing12:23
thekornaha, ok12:23
wgrantIt's not the easiest export.12:23
wgrantBecause there's no URL yet.12:24
thekornright, this part is missing on the wiki page I mentioned above12:25
wgrantSo you'll need to add a new method to PersonNavigation, and you'll need a browser:url directive in lib/lp/registry/browser/configure.zcml12:25
didrockswgrant: hem, I'm already fighting to do the right thing, seems more difficult then :)12:53
didrocks(and I need to do the same for ssh)12:54
=== bigjools is now known as bigjools-lunch
=== lionel_ is now known as lionel
didrockswell, I pushed my branch into ~didrocks/launchpad/devel but it still needs work and I'm unsure to know understand enough the documentation for the decorators handling13:32
=== mrevell is now known as mrevell-lunch
deryckadeuring, gmb, kfogel -- just a reminder to update the kanban board before the standup, to make walking the board quicker.13:36
adeuringOK, I'll try it...13:36
deryckmatsubara -- the qa burndown seems not to be updating any longer for 10.02.13:37
deryckAssuming I'm still looking at the right page.13:37
matsubaraderyck, I'll take a look13:37
deryckmatsubara, thanks!13:38
deryckadeuring or gmb -- could I get one of you to review a branch for me?13:56
adeuringderyck: sure13:56
deryckI need a bugs dev to make sure I haven't missed something that exists somewhere else.13:56
deryckadeuring, thanks!  https://code.edge.launchpad.net/~deryck/launchpad/enable-tracking-link-perms-512378/+merge/1960013:56
deryckadeuring, feel free to ping me in #launchpad-review to follow up.13:57
adeuringderyck: r=me14:10
deryckadeuring, excellent, thanks!14:10
BjornTderyck: why don't you check whether the user has edit permission for the project?14:11
deryckBjornT, because I'm dumb. :-)14:12
deryckBjornT, this is why I wanted someone from bugs.  I felt I was missing something obvious.14:12
deryckbut I guess that's obvious beyond bugs even.14:12
BjornTderyck: you can do a tal:condition on something like context/required:launchpad.Edit14:13
deryckBjornT, ah, cool.  I never knew that actually.14:14
deryckmuch simpler, too.14:15
=== mrevell-lunch is now known as mrevell
directhexi just came across bug #139855. is there any drive from canonical to resolve the bug, or in the short term is the easiest way to track usage by mirroring a PPA off-site where you have your own access.log to parse?14:23
mup_Bug #139855: Display stats about PPA usage <feature> <Soyuz:Triaged> <https://launchpad.net/bugs/139855>14:23
=== mup_ is now known as mup
deryckadeuring, BjornT -- updated:  https://code.edge.launchpad.net/~deryck/launchpad/enable-tracking-link-perms-512378/+merge/1960014:26
deryckadeuring, BjornT -- look good?14:26
=== bigjools-lunch is now known as bigjools
adeuringderyck: yes14:27
bigjoolsdirecthex: it's not a priority at the moment, although we'd love to do it at some point14:27
deryckadeuring, gmb, kfogel -- call, in two?14:28
gmbyep14:28
kfogelderyck: yup14:29
directhexbigjools, the post by jml presents an action list. how much of that list can be worked on by normal plebs without secret canonical web server access?14:30
BjornTderyck: looks good14:30
deryckBjornT, thanks!14:30
bigjoolsdirecthex: most if not all of it14:30
bigjoolsdirecthex: some work was done already to scan logs14:31
directhexbigjools, i'll take a look then. my cpu/ram seem to be on fire, courtesy of "bzr branch lp:launchpad".14:31
bigjoolsyeah it's a big branch14:32
directhex243Mlaunchpad/14:33
directhexright, there we go14:33
=== Chex_ is now known as ChEx
=== ChEx is now known as Chex
=== salgado is now known as salgado-lunch
directhexbigjools, as i read this source, a thought occurs. how exactly do i *test* my changes?14:47
bigjoolsdirecthex: depends on what you want to implement, there's a lot of work to do14:47
bigjoolsUI, backend, database schema etc14:47
directhexbigjools, the UI is the kind of easy bit i could probably do, but unfortunately the backend stuff is a prerequisite14:48
bigjoolsmost of the existing testing is done in the test suite, unit tests or doc tests14:48
bigjoolswell you could start by proposing some schema changes, we'll get those done, and then you can poke values in locally when doing the UI14:49
bigjoolsthe scanning part is a separate task14:49
directhexbigjools, is the bug report the best place to discuss my thoughts?14:54
bigjoolsdirecthex: yes, absolutely14:59
fran6cohi15:01
fran6coi need some help setting up launchpad in my machine, anybody that want to give a hand with it?15:02
fran6cowell, I managed to install it and make it work, but the thing that i don't get is the cronscripts15:03
fran6coi couldn't find info about how to i should run them15:04
fran6cothanks in advance15:04
=== matsubara is now known as matsubara-lunch
matsubara-lunchderyck, burndown is up to date15:15
deryckmatsubara-lunch, thanks!15:16
deryckmrevell, call time?15:16
sinzuijelmer: ping15:16
jelmersinzui, hi15:16
sinzuibug 523844 does not look like a bug, it looks like a question, and I think it is one should should be able to answer yourself.15:17
mupBug #523844: experimental Debian distroseries <Launchpad Registry:New> <https://launchpad.net/bugs/523844>15:17
sinzuijelmer: do you see the Add series link: https://edge.launchpad.net/debian15:17
jelmersinzui: Ah, yep15:18
sinzuijelmer: I think you have a better understanding about creating a debian series than myself.15:18
jelmersinzui: I hadn't realized I could do that sort of thing myself now. :-)15:19
jelmersinzui: I'd like to double-check that experimental isn't missing by intention though, who should I talk to about that?15:19
sinzuijelmer: No idea. I can fix the code, but distroseries were designed for Ubuntu. Launchpad really ignores all other distros15:20
* sinzui tries to edit lenny to see if experimental exists15:21
sinzuiExperimental does not appear to be supported15:22
sinzuibut I think that is because series cannot go backwards15:22
sinzuijelmer: try creating the series on staging, the editing it to fix the status15:23
sinzuijelmer: you may need to hack the URL because only losas are really offered the link15:23
mrevellmsg deryck I'll get Skype up and running15:23
mrevellheh15:24
sinzuijelmer: I just confirmed that you can hack the url for +edit ti set a active series to experimental15:24
jelmersinzui: ah, thanks15:25
jelmersinzui: I'll see if I can confirm that it's ok to create an experimental distroseries and then I'll give it a try. I'll close the bug.15:26
sinzuijelmer: the missing series status sounds familiar, I think this is a bug that also affects projects15:26
jelmersinzui: In particular I'd like a distroseries named experimental, I'm not too worried about having its status set to Experimental15:27
james_werm, https://edge.launchpad.net/debian/experimental15:39
james_wis that not what you are looking for15:39
james_w?15:39
=== Ursinha-1fk is now known as Ursinha
=== Ursinha is now known as Guest50427
deryckgmb, ping15:49
gmbderyck: Hi15:49
=== Ursinha_ is now known as Ursinha
=== beuno is now known as beuno-lunch
=== matsubara-lunch is now known as matsubara
=== salgado-lunch is now known as salgado
=== sinzui1 is now known as sinzui
deryckrockstar, you around?16:03
kfogelderyck: terminology question: do we have a name for a not-yet-filled-in-by-separate-javascript-request portlet?  Do we call the raw, unfilled portlet a "base" or a "template" or a "raw" portlet or anything like that?16:35
deryckkfogel, you mean the name of the template file itself?16:36
kfogelderyck: well, no, I have that.  I mean a word for the unfilled portlet (except I don't know if "unfilled" is what we'd use).16:36
kfogellike if you were writing a test, and one phase of your test examined the unfilled portlet, and another phase pulled the real contents and examined those, what would be the words to describe each phase?16:37
adiroibangmb: did you had time to put this branch for ec2 test https://code.edge.launchpad.net/~adiroiban/launchpad/bug-522188/+merge/19395 ?16:38
deryckkfogel, in just the test comment or doc portion?  In plain English not code, is that what you mean?16:38
kfogelderyck: well, in a doc comment, but also in the names of two methods I'm abstracting out of xx-bugs-statistics-portlet.txt (I'm moving them to pages.py, because they're needed in multiple tests now).16:39
kfogelderyck: right now, they're called, respectively, print_portlet() and print_portlet_contents().16:39
=== beuno-lunch is now known as beuno
deryckkfogel, ah, ok. yeah, I'm not aware of any convention for that.  Those names seem fine to me.  Or print_empty_portlet for the first?16:39
kfogelderyck: the first of those names is unclear on its own; then if you see the second name it makes more sense, but I'd like to avoid that window of confusion.  I'll probably go with "unfilled" and "filled" (as "empty" implies no content at all, which isn't the case).16:40
kfogelderyck: I just wanted to check that there wasn't already a term in use within Launchpad for these two states.16:40
deryckkfogel, not that I'm aware of, no.16:41
kfogelderyck: ok, thx16:41
derycknp16:42
gmbadiroiban: Strange, I thought that branch had landed; let me check16:46
adiroibangmb: I have not received any email from buildbot. Same for this branch https://code.edge.launchpad.net/~adiroiban/launchpad/bug-340664/+merge/1845216:50
gmbadiroiban: Hmm. I'll look into that.16:51
adiroibanI am not sure how buildbot is sending notification... as some of my branch did land without a notification from buildbot16:51
gmbadiroiban: How did only some of it land? That doesn't make sense.16:52
adiroibanI mean that for some of my branch that landed16:52
adiroibani received an email from buildbot16:52
adiroibanothers were landed without a notification from buildbot16:52
kfogeljtv: saw the characters displayed correctly in my email from your review response.  yes, they're right :-)16:53
jtvkfogel: different chars this time.  Got the full text from google translate.  Is that last character the same one I hear in the polite version of "hello"?16:54
kfogeljtv: yup -- it means "you'16:55
kfogel"you"16:55
jtvIn the polite form, right?  I always thought it sounded more like níŋ16:55
gmbadiroiban: Ah, looks like your branches were submitted close to the same time but we were in testfix mode so they didn't land and I subsequently forgot to resubmit. Apologies; I'll do so now.16:56
adiroibangmb: no problem. thanks16:57
=== deryck is now known as deryck[lunch]
=== henninge is now known as henninge-afk
=== gary_poster is now known as gary-lunch
=== deryck[lunch] is now known as deryck
sinzuiadiroiban: See my answer to your question. I want to know if you see what I see18:37
adiroibansinzui: http://bayimg.com/eaKPPAAcJ18:39
adiroibanthis is whay I see18:39
adiroibanonly „Reactivate ML”18:39
sinzui:(18:40
sinzuiadiroiban: I will purge and report a bug18:40
adiroibanthanks!18:40
kfogelderyck: just fyi, jcastro and I are having this conversation over in the community channel (and are about to turn it into a phone call): http://paste.ubuntu.com/379256/18:41
sinzuiadiroiban: It is purged18:41
kfogelderyck: it's a dicey UI question w.r.t. the bugs-with-patches stats.  your opinion welcome.18:41
* deryck looks18:41
adiroibansinzui: yep. Many thanks!18:41
kfogelsinzui: (you might be interested in above two comments addressed to deryck too)18:43
sinzuiadiroiban: this may not be time to celebrate: bug 47127418:43
mupBug #471274: No option to purge list archives when purging a mailing list <feature> <mailing-lists> <oem-services> <Launchpad Registry:Triaged> <https://launchpad.net/bugs/471274>18:43
deryckkfogel, simple fix -- just have the X bugs with patches be inclusive of closed bugs  OR have +patches exclude closed by default and add filter by status.18:43
kfogelderyck: I think I like the former, actually.  Since people can sort by state once they get to the +patches page anyway.18:44
adiroibansinzui: that's ok. we didn't have top secret stuff there :)18:45
kfogelderyck: thanks.18:45
deryckkfogel, sure18:45
mwhudsonjelmer: i'd like to upgrade dulwich & bzr-git so i can get my changes to do partial imports landed, will lp:dulwich and lp:bzr-git be ok?18:49
mwhudsoni guess lp:bzr-git is required :-)18:49
mwhudsonjelmer: thanks for merging my branch btw18:49
sinzuibac: ping18:54
sinzuiEdwinGrubbs: ping18:55
bachi19:00
bacsinzui19:01
sinzuibac: look at https://edge.launchpad.net/ubuntu/lucid/+source/alacarte The "Unspecified" is a db hit, and when you list a lot of projects on a page, it is a costly repeat19:03
sinzuibac: I have never liked this this ambiguous, possibly pathetic attempt to say the license is unknown. Do you want to argue for this feature's continued existence?19:04
bacsinzui: not i19:04
jelmermwhudson, yeah, both trunks should be fine19:04
bacsinzui: but that lookup is no more costly than anything else, is it?  getting rid of it b/c it is ugly is one thing but i can't see how it is hammering us more than any other attributte19:05
kfogelsinzui: advice -- I've abstracted out two functions that were formerly in a .txt test file.  Now they live in pages.py -- see http://paste.ubuntu.com/379268/ .  But, the code refers directly to "http://bugs.launchpad.dev/", because the functions are specific to the bugfilters portlet.  I think that's okay, but I also notice this is the only .py code in that directory that hardcodes a service URL.  Is this ok?19:06
sinzuibac: true, but if +packaging shows 20 of these packages, we are doing repeat queries for the license, plus the bug supervisor, tracker, branch, and translations. I care about the last four items, but the license is a formatter quirk, and the only person who can change the license if the project owner19:07
sinzuikfogel: I see. I think both helpers are kind of bogus because they are making assumptions about the markup or host. They break every year19:09
sinzuikfogel: as long as the bug team is willing to do the maintenance, there is no problem19:10
kfogelsinzui: well, I think we are (will check with the team).  my question is really about the host aspect -- whether that's likely to break ever.  But if you think it's no worse than any of the other assumptions in that test, then I'll leave it.19:12
kfogels/test/test function/19:12
sinzuiThe host is less brittle then the markup. I would question why the test helper is going into 1) a deprecated module, and 2) a module used by by non-bugs apps. I think the tests should be in lp.bugs.tests.bug19:15
sinzuikfogel: ^19:16
sinzuikfogel: actually, lp.bugs.tests.bug is exactly where the helpers belong. doctests. stories, and unittests can import them as needed19:17
kfogelsinzui: thx, will move19:17
* sinzui wonders why lp.bugs.pagetests exists19:17
* kfogel wonders how one is supposed to know it's deprecated19:17
sinzuikfogel: it is canonical.launchpad. we build in lp.<app>19:18
=== gary-lunch is now known as gary_poster
sinzuikfogel: everything in canonical.launchpad was left behind during the open source apocalypse19:19
kfogelsinzui: ahhh.  Yes, I remember that, but as I wasn't developing at the time, I didn't have a reflexive understanding of it.  got it19:20
sinzuioh dear, as I feared lp.pagetests do not work because that is not a legitimate directory19:21
sinzuideryck: ping19:27
deryckhi sinzui19:29
sinzuilp.bugs.pagetests should not exist. The tests in those directories are not played by the test runner. They should be moved to lp.bugs.stories19:30
sinzuiI was about to report a bug19:30
sinzuideryck: just doing a move to the stories directory should make the command work19:32
sinzui./bin/test -vvc -t cve-pages -t xx-bug-text-pages19:32
derycksinzui, oh, wow.  Didn't realize we had anything in pagetests still.19:33
kfogelderyck: since this came up as I was adding some test infrastructure, if there's a simple rearrangement/move to do, I can just do it on my branch here...19:34
kfogelsinzui: ^^19:34
derycksinzui, I'll move them this evening or tomorrow am.19:34
deryckah19:34
kfogelderyck: lib/canonical/launchpad/testing/pages.py is the file I was adding to, when sinzui noticed19:34
deryckkfogel, ok, you could move the tests under lp.bugs.pagetests to lp.bugs.stories if you don't mind.19:35
deryckkfogel, see the command above sinzui gave.  it should run after the move.19:35
deryckkfogel, but I don't mind doing this tomorrow AM first thing if you don't want to mess with it.19:35
sinzuideryck: I think this is an issue where someone found some tests in the old location, and tried to move them to the now location, but created a bad directory in the process.19:36
kfogelderyck: I don't -- nearly complete non-understanding of the totality of this issue, now that I look carefully at the commands and paths above, coupled with a desire to close out my WIP, makes me defer to you :-).19:36
derycksinzui, ah, right.  that would make sense.19:36
deryckkfogel, sure.  it's trivial for me.  So happy to do it.19:37
sinzuideryck: kfogel: The tests are pre-3.0. they might not pass19:37
deryckgah!19:37
deryckright19:37
kfogel?19:37
deryckthey haven't been running this long  rm -rf anyone? :-)19:37
* deryck ducks19:37
derycksinzui, kfogel -- I'll sort it out proper tomorrow.  I have another test to fix, so no worries.19:38
kfogelderyck: thx19:38
sinzuideryck: you have my rs to delete any test that duplicates the authority of another test.19:39
derycksinzui, will do.  thanks.19:39
mwhudsonhmm19:53
mwhudsonjelmer: do you have any clever ideas about managing ~/.bazaar/svn-cache on the import slaves19:53
mwhudsonjelmer: these directories are about 7 gigs on the slaves already19:54
jelmermwhudson: do we need clever ideas?19:54
jelmermwhudson: ah19:54
jelmermwhudson: are those sizes really a problem?19:54
mwhudsonand as we add more slaves, each slave is going to have to do the work to rebuild the cache19:54
mwhudsonwhich seems pretty wasteful19:55
mwhudsonjelmer: well, it depends how much more it grows, i guess19:55
mwhudson10 gigs isn't really a problem, i guess19:55
mwhudson100 gigs we'd need to know about19:55
mwhudson1000 would be a definite problem19:55
jelmermwhudson: it'll be a while before you'd hit 100 gigs I think19:55
jelmerwe should have a better mechanism in place in bzr to store this sort of cache data before that I hope19:56
jelmermwhudson, alternatively, we could see if we could turn off the cache for bzr-svn and see how much extra bandwidth that requires19:56
jelmermwhudson: since lp only does pulls we might be able to get away with that19:56
mwhudsonjelmer: hmm19:58
mwhudsonjelmer: the "determining revisions to fetch" step takes a considerable amount of time for large repos19:59
mwhudsonjelmer: isn't that the step that the cache helps with?19:59
jelmermwhudson, I wonder why that is, it is much quicker locally19:59
mwhudsonjelmer: f'ex https://code.edge.launchpad.net/~timmie/grass6/grass_trunk20:00
mwhudsonlooks like "determining revisions to fetch" too 7 hours here (!)20:00
mwhudson*took20:00
jelmerwhoa20:00
* jelmer tries locally20:01
jelmermwhudson, does a lot of terminal out cause the slave process to hang perhaps?20:01
jelmerterminal outPUT20:01
mwhudsonand copying revisions took 520:01
mwhudsonjelmer: i don't think so, it's only outputting one line a minute20:01
mwhudsonit's possible the machine was slammed while this was happening20:02
jelmermwhudson: I've seen it with more importants so I don't think this was a glitch20:02
jelmer*imports20:02
jelmerman, my brain is sleeping20:02
jelmermwhudson, I'll see if I can reproduce it here locally doing a pull. If not, I wonder how we can profile the problems on the lp slaves..20:03
mwhudsonother things we can do are preserve the svn-cache between runs like we do the git.db20:06
mwhudsonor maybe just gzip the caches, they seem to compress pretty well20:06
=== salgado is now known as salgado-afk
mwhudsonjelmer: the reason i'm asking is because i've been asked about how much disk space to give new code import slaves20:06
jelmermwhudson: the svn-cache is not preserved between runs, the home directory of the slave is cleared?20:07
mwhudsonjelmer: uh no20:07
mwhudsonthat's not what i meant20:08
mwhudsonwe currently preserve git.db files by copying them from the imported branch onto escudero, and fetching them before updating the import20:08
mwhudsonwe *could* copy the ~/.bazaar/svn-cache/$foo directory to and from escudero after and before an import in the same way20:09
mwhudsonwith some trickery to know which file to get, i guess20:09
jelmerI don't think that's worth the effort to be honest20:14
jelmerunless the "fetching revision info" step is taking too much time20:14
mwhudsonoh right20:15
mwhudsonthat step seem to hardly be taking any time20:15
mwhudsonhm, but maybe the cache already existed for that branch20:16
mwhudsonseems like it took 10 minutes for that repo in fact20:17
mwhudsonthat's more than you'd want to spend on every import, for sure20:17
mwhudsonbut i guess once per slave isn't that bad20:17
jelmermwhudson: it'll only happen once per slave per repo20:17
jelmerafter that it should be seconds20:17
mwhudsonjelmer: but it's not really about time, it's about disk space20:17
mwhudsonright now anyway20:18
mwhudsonif we preserve them somewhere else, we can only have the ones on the slave that are running at a given time20:18
jelmerif it's about disk space we can look at whether we actually need the cache20:18
jelmermwhudson, there's definitely something wrong on launchpad20:19
jelmer"determing revisions to fetch" for the branch you just linked to took less than a minute here20:19
mwhudson!!20:19
maxbooi, why isn't "determining revisions to fetch" the equivalent of a single "svn log" operation?20:20
mwhudsonjelmer: is this a clue?20:20
mwhudson2010-02-16 21:43:44 WARNING Upgrade to svn 1.5 or higher for faster retrieving of revision properties.20:20
jelmermaxb: if you're not using the cache, it is20:20
maxbShouldn't 'svn log' be fast enough to make a cache pointless?20:20
jelmermaxb: there's more you can do on a svn repo than svn log20:20
jelmermaxb: more than bzr pull I mean20:20
mwhudsonjelmer: the slaves seem to be on subversion 1.4.6dfsg1-2ubuntu1.120:21
jelmermwhudson: Hmm, I don't get that here20:21
jelmermwhudson: Ah, it might be useful to upgrade the version of subversion on the slaves20:22
jelmermwhudson: but it also looks like we're hitting a very slow code path when we're using svn 1.4, so we should probably fix that anyway20:22
mwhudsonjelmer: last time i talked about upgrading svn apart from as part of a distro upgrade i was told it was impossible20:24
jelmermwhudson: I'll see if I can reproduce the issue in a dapper vm20:24
mwhudsonjelmer: hardy should be fine...20:25
maxbmwhudson: interesting, was a reason given?20:25
mwhudsonmaxb: cscvs uses both python-subversion and pysvn20:25
maxbThat sounds merely slightly complex, not impossible20:26
mwhudsonand at least one of those is really hard to build20:26
mwhudsonwell20:26
mwhudsonmaybe we didn't ask you :-)20:26
mwhudsonanyway, it might be better now20:26
maxbI've built pysvn on Slackware 10.0, I'm sure I can build it on hardy20:26
maxb:-)20:27
mwhudsonbackporting from say feisty to dapper might have been more awkward than karmic -> hardy20:27
kfogelsinzui: several days in a row now, my machine has gradually slowed down to a crawl, becoming more and more unusable; running lp tests seems to be the cause, though I'm not 100% sure yet.  'top' indicates that python2.5 consumes most of the CPU.  Have you experienced anything similar?20:28
sinzuikfogel: the testrunner does take most of one cpu, but all is better when the test completes20:30
kfogelsinzui: the "all is better" part doesn't always seem to happen for me20:30
sinzuikfogel: I never run into swap, so I think memory may be important. I have 2 gigs @ 32 bit usually allocated to development20:31
kfogelsinzui: well, up to several seconds just to switch virtual desktops, maybe 1/2 second keystroke delay now.  I'm rebooting.  back in a bit20:34
=== EdwinGrubbs is now known as Edwin-lunch
=== matsubara is now known as matsubara-afk
kfogelderyck: in a searchTasks() query, is there a recommended way to get the search to include all statuses?  If you do status=None, it reverts to default statuses, which don't include (e.g.) BugTaskStatus.FIXRELEASED.21:11
kfogelderyck: should I just do status=any(*UNRESOLVED_BUGTASK_STATUSES, *RESOLVED_BUGTASK_STATUS) or something?21:11
sinzuiIs anyone with postgress guruness awake?21:12
kfogelderyck: (well, that syntax may be wrong but you get the idea)21:12
kfogelsinzui: sorry, no guruness, but if you ask I'll look and see if I know the answer off the top of my head.21:12
deryckkfogel, yes, the idea is right, but not the syntax.  Pass in a single combined list.21:13
kfogelderyck: will do21:13
deryckI'm out.  Later all.21:14
sinzuikfogel: we have bad data in production that I though we fixed in November. patch-2207-09-0.sql drops packaging_uniqueness and adds packaging__distroseries__sourcepackagename__key  which is a more restrictive UNIQUE rule. But I do not see this patch applied when I look at the db21:16
* sinzui thinks he needs to email stub and jtv to understand the screwup21:16
kfogelsinzui: I think so -- this is probably more about lp db patching process than about postgresql per se21:16
sinzuiI also need to find the query that identified the insane data too21:17
mwhudsonsinzui: do you need to "drop index" not "drop constraint" ?21:36
mwhudsonjust a guess21:36
sinzuimaybe21:36
mwhudsonstrange for it not to error though21:37
sinzuithe new constraint was not added, so there is either a big failure or two small failures21:37
=== Edwin-lunch is now known as EdwinGrubbs
kfogelsinzui: I tried to request a code review (non-ui this time) from you for https://code.edge.launchpad.net/~kfogel/launchpad/255868-patches-view-from-bugs-page/+merge/19438  -- it wouldn't let me, I guess because you had already approved it for ui.  Can you do a code review?22:18
sinzuikfogel: I saw it and am reading right now22:19
kfogelsinzui: thanks (hunh -- you got the email, and yet the page doesn't show you as a pending reviewer)22:19
sinzuikfogel: r=me22:19
kfogelsinzui: thanks22:19
bacsinzui: Q: in the new portlet under "Needs linking" is that really "needs linking or more info", i.e. using getPrioritizedUnlinkedSourcePackages?22:24
bacsinzui: b/c some of those can be *linked* but still lacking signficant information22:25
bacif that's the case i need to change the heading22:25
kfogelsinzui: is it normal for EC2 to try to merge devel into a db-devel-based branch before testing?  http://paste.ubuntu.com/379375/22:31
sinzuibac: yes getPrioritizedUnlinkedSourcePackages22:31
bacsinzui: so "Needs linking or more information"?  very wordy22:32
sinzuibac: the ones that are missing information need to be fixes by upstream contributors most of the time22:32
kfogelsinzui: 'utilities/ec2 test --headless -b launchpad=db-devel' is probably the answer22:33
sinzuibac: Maybe we needed to be clear that the packages need to be associated with an upstream project...I do not like the use of "link"22:33
backfogel: yes, if you're not using devel you need to specify db-devel.  there is a wiki page devoted to how to work with db-devel22:34
sinzuikfogel: if you branched from db-devel, then yes you need to merge to that, but I have read your changes and they could be extracted and applied to a devel branch so that edge users can see it22:34
kfogelsinzui: my changes depend on stuff that's only in db-devel, though (the entire +patches view is not present in devel yet, IIRC)22:35
kfogelsinzui: so these particular changes would work, but the link they add would be a broken link22:35
sinzuifair enough, send it to staging22:36
bacsinzui: http://people.canonical.com/~bac/link-portlet.png22:41
bacthat's a lot of use of "link"22:41
sinzuibac: yes, which is why I wonder is linked is right. We can let the users decide22:42
bacsinzui: so you want to go with linked now?22:42
bacor do you want to try to come up with a new term now?22:43
jelmermwhudson, hmm, looks like subvertpy doesn't actually compile with svn 1.4 at the moment..22:44
sinzuibac: if you can, that would be grand. I wont make it a condition for landing since I think we need users to help find the words that explains the connections between packages an project releases, and communities and kinds of contributions22:44
mwhudsonjelmer: i guess we'd better be careful when upgrading that then!22:45
jelmermwhudson: fixing it atm22:45
bacsinzui: i'm having a hard time coming up with an alternative right now.  "associate"/"association" is the only thing i can think of and it would look silly in that many places i think22:46
mwhudsonjelmer: ok22:46
sinzuibac: yes, it is hard22:46
sinzuibac: I now see that the bug I am working on is in fact a duplicate of the one I asked for help with on the list: look at this: https://edge.launchpad.net/gtk/+packages22:47
baci think i'll do a first pass as is knowing that inertia is a terrible thing22:47
bacsinzui: so any clue why that db patch is not applied?22:50
sinzuino, and I wish I could find my dup finder query. I could clean up the dup data in an evening if I could get a list22:50
mwhudsonoh23:04
mwhudsoni know why the patch isn't applying23:04
mwhudsonthe filename is wrong23:05
mwhudsonsinzui: ^23:05
sinzuirock. I am incompetent23:05
sinzuimwhudson: I do not see the file name wrong, but maybe the revision is wrong?23:07
sinzui    INSERT INTO LaunchpadDatabaseRevision VALUES (2207, 9, 0);23:07
sinzui9 should be 09?23:07
mwhudsonsinzui: no23:07
mwhudsonot23:07
mwhudsonit's called .0.sql23:08
mwhudsonall the others are -0.sql23:08
* sinzui bangs head23:08
sinzuithanks mwhudson I will update the bug. We cannot land a name fix until the data is cleaned up again23:09
mwhudsonsinzui: np23:09
mwhudsoni guess it's "unusual rollout requirement" time23:09
sinzuimwhudson: thanks a lot. there are only two bad condition in the data, I got lucky when I saw one in the list of 10,000 packagings23:20
jelmermwhudson, 1.4 compatibility has been restored23:21
mwhudsonjelmer: cool23:25
sinzuispm: ping23:32
sinzuihmm, losas are sprinting aren't they23:33
mwhudsonnot yet, but spm isn't around23:34
mwhudsonmbarnett might still be?23:34
* mwhudson lunches23:34
* thumper is back but grabbing lunch23:36

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!