=== cprov [~cprov@] has joined #launchpad
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: continue malone code reorganisation (patch-624)12:59
=== stub [~stub@dsl-] has joined #launchpad
=== BradB [~bradb@modemcable165.196-131-66.mc.videotron.ca] has joined #launchpad
!lilo:*! Of possible interest: #accounting, a channel for accounting support for small not-for-profit entities. If you have accounting experience, please stop by. Thanks!05:26
=== BradB_ [~bradb@modemcable165.196-131-66.mc.videotron.ca] has joined #launchpad
(dilys/#launchpad) New bug 2119 for Launchpad/Database: Use of __del__ in sqlobject07:53
(dilys/#launchpad) https://bugzilla.warthogs.hbd.com/bugzilla/show_bug.cgi?id=211907:53
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: Improved PostgreSQL/Launchpad sample data test harness (now an order of magnitude faster) (patch-625)08:52
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: Tabnanny putting on her jackboots for the whitespace impared (patch-626)09:06
=== jblack [~jblack@static-209-158-45-74.scr.east.verizon.net] has joined #launchpad
lifelessspiv: around?09:12
=== lulu [~lu@host217-37-231-28.in-addr.btopenworld.com] has joined #launchpad
=== Kinnison [~dsilvers@haddenham.pepperfish.net] has joined #launchpad
=== carlos [~carlos@69.Red-80-33-181.pooles.rima-tde.net] has joined #launchpad
jblackwho here has really slow star-merges? 11:11
jblackas in longer than 2 minutes? 11:11
stubjblack: I'm fairly certain that is only the Mac OSX users, so that would be BradB_and Limi (I'm on Ubuntu now)11:38
jblackstub: I've been hearing of slow star-merges on x86 boxes too.11:38
=== stub throws that theory out the window
jblackstub: Well, that may play part too, if os x boxes tend to come with less memory.11:39
jblackI know that bradb only has 256 megs11:39
stubI had problems on a box with 1GB11:40
jblackwith libraries and local mirrors ?11:40
=== Kinnison has never had a slow star-merge. I use Ubuntu on x86 with 512 megs of ram and have a revlib but not a local mirror of rocketfuel
stubYes - I think you commented on it at the conference. I don't have the box any more though so I can't do proper comparisons or confirm that with 100% certainty.11:41
Kinnisonbut then again; I've only been doing simple stuff in my archive11:41
jblackstub: Ok.11:41
stubI suspect Limi will have a reasonable amount of memory, so he might be your best bet at the moment. 11:43
jblackOk. I'll hunt him down11:44
lifelessstub: we know hfs+ sucks :[. we're trying to identify the x86 problems, to reduce the scope of the problem.11:44
lifelesswhat we are gonna do about the hfs+ users,I'm not sure right now.11:44
jblackyeah. according to my filesystem timings, os x is *1/6* the speed of reiserfs 11:45
lifelessrunning bonnie++ 11:46
jblacknothing so extravagant. various dd timings.11:47
lifelessthat would be a good basis for comparison actually, a bonnie ++ script to get disk comparisons, then a tla-script of some sort.11:47
jblack5 meg file 50 meg file 1 gig file, consistantly about 1/611:47
lifelessdd is 1/6th - sheesh. thats /sad/11:47
lifelessit might be the disk though...11:47
stubI was about to ask - same hardware?11:47
jblackhe claims its a reasonably modern machine.11:47
jblackNo, not the same hardware.11:47
jblacka rather new, high end x86 laptop against a new-a-year-ago mac11:48
jblackthe thing that struck me about bradb's machine was that it acted as if it didn't have buffer cache11:48
stubIt might not for all I know - it would be quite valid to limit free ram usage for disk cache in exchange for other caches11:51
=== SteveA [~steve@adsl-213-190-44-43.takas.lt] has joined #launchpad
KinnisonSteveA: do you publish summaries of the launchpad meetings anywhere?11:55
SteveAno, not usually11:55
SteveAvery ocassionally11:55
SteveApoints may come out as part of warthogs traffic11:56
SteveAwould you find summaries very useful?11:56
KinnisonI think they would be useful; yes.11:57
KinnisonI find it quite hard to remember what everyone else has done11:57
SteveABradB_: ping12:14
SteveA(a bit early, I think)12:14
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: malone reorganisation (patch-627)12:14
SteveAstub: hello12:14
stubSteveA: Was there any luck with Plone and secure auth?12:16
SteveALast week, I was going to request a "malone deployment" meeting for today12:16
SteveAbut, the email languished in my outbox12:16
SteveAit would be good if you, brad, elmo (perhaps) and sabdfl talked together today about getting malone running on mawson 12:17
SteveAover the next few days12:17
SteveAI have no reply from roche, so I need to chase that up12:17
SteveAthen again, brad could install the patch for us, which might be easier12:17
SteveAI can test what the cookies look like after that patch is applied12:18
=== sabdfl [~mark@host217-37-231-28.in-addr.btopenworld.com] has joined #launchpad
sabdflmorning all lunchpadders12:19
KinnisonMorning sabdfl 12:22
=== Kinnison writes huuuuge views for lucille :-)
Kinnisonwell, they're not that big, but they're useful12:23
sabdflstub: landed a series of big malone reorganisations over the weekend and this morning12:49
sabdflBradB_: ^^12:49
stubYup - done a merge. Haven't looked closely at the latest iteration yet though.12:50
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: Lucille-related DB stuff (again) (patch-628)01:01
=== spiv has internet again!
sabdflwelcome back, king of doap!01:07
sabdflhmm... need to send mail to the list in that regard01:07
KinnisonIf I have an SQLObject result from a selectBy which included a transaction; will any foreign key provided object also have that transaction embeded in it (for update purposes)?01:08
(spiv/#launchpad) Kinnison: You're explicitly passing connection= to selectBy?01:09
KinnisonErm, well, that's the way the librarian does it01:10
carlosstub: I need to coordinate with you to merge my pomsgset/potmsgset split branch into rocketfuel01:13
stubYup. Is it ready for me to look at now?01:14
carlosstub: I'm still removing small bugs, but the DB patch is ready01:14
carlosstub: we cannot merge it yet into rocketfuel01:14
carlosuntil I finish the review, but I suppose you will be sleeping...01:15
(spiv/#launchpad) Kinnison: Oh, right. I expect that SQLObject probably does the right thing, but I'd double-check by reading the source...01:15
stubyup. Got a revision available on chinstrap for me to look at?01:15
carlosarchzoom or tla?01:16
carloswhat do you prefer?01:16
(spiv/#launchpad) Kinnison: Although if I get this bug of lifeless's sorted out, then we can use that work and not pass transactions around epxplicitly anymore.01:16
carlosI need to commit a fix to the current.sql file01:17
carlosstub: it's ready01:18
stubCool. I'm not too fussed about current.sql, as it may need to be rebuilt by the time commit actually happens.01:19
carlosstub: I'm merging all changes from rocketfuel, so it should be updated with latest changes01:20
stubcarlos: current.sql won't merge well01:21
carlosstub: It should I fixed the conflicts by hand and recreate it from that01:22
stubHmm... scary. You confident no data has been lost?01:22
carlosstub: yes, I'm sure, the changes I'm doing don't affect the modified sample data01:23
carlosso the conflicts were minor01:24
stubcarlos: I don't have any problems with the patch and it all seems to load cleanly. I'll want to add a 'set client_min_messages to error' at the top to remove noise and name the unnamed constraints.01:46
carlosstub: sure, will you do it? or do you want I do it?01:47
stubcarlos: I'm happy to do it, so I might as well unless you particularly want to or need to get this committed when I'm in bed.01:48
stubI'm personally getting to dislike having a simple 'create table' followed by a raft of alter tables for the constraints, but that is just taste and has no effect on the database :-)01:49
carlosstub: that depends on Daf, if we need to merge it to continue our work, is it ok If I add it myself?01:49
carlosstub: I can fix it, I just did the same we have at this moment :-)01:50
=== Kinnison whoops excitedly as canoncal.lucille.publishing.SourcePackagePublisher publishes an archive's pool
Kinnisonwell, it's publishing the sourcepackages anyway01:51
stubYes. In this case I'm happy to have you commit it as there are no outstanding patches in the queue to conflict and it only affects the rosetta work (hopefully for the good ;) )01:51
stubIt will involve 'tla mv patch-3-99-0.sql patch-3-11-0.sql' of course.01:51
sabdflKinnison: good work01:51
sabdflwas it correct?01:52
Kinnisonsabdfl: It's still publishing :-)01:52
stubcarlos: The launchpad-3-00-0.sql is a database dump - it is not to be used as an example of good style ;)01:52
Kinnisonsabdfl: 20,000 files don't come out of the librarian onto disk that fast :-)01:52
carlosstub: ok, should I change the the way I'm creating the restrictions so it's all inside the create table?01:52
Kinnisonsabdfl: but so far it looks to be building the pool structure correctly :-)01:52
stubcarlos: Don't bother - like I said, it makes no difference to the database.01:52
carlosstub: thanks01:52
Kinnisonsabdfl: it was all kicked off with pub.publish(SourcePackageFilesToPublish.selectBy(drd=1)) to publish all sources pending publication for distribution 1 (ubuntu)01:53
stubcarlos: The names of the foreign keys should be changed though so I don't have to do it in future tidies - the current (rather arbitrary) standard I'm using is like - ALTER TABLE potmsgset ADD CONSTRAINT potmsgset_primemsgid_fk FOREIGN KEY (primemsgid) REFERENCES pomsgid(id);01:55
stubcarlos: Oh - and there had better be comments added in comments.sql which will save pain later (easier now while it is all fresh in your mind).01:56
=== cprov [~cprov@] has joined #launchpad
sabdflstub: i haven't had much chance to look at roundup for ticketing02:08
sabdflis it zodb based?02:09
sabdflor rdbms based?02:09
stubNope. A chunk of Roundup is what is called Hyperdb, which is yet another database. It has backends to postgresql, mysql, sqllite etc. It seems a bit like a poor mans object database (which is not necessarily a bad thing).02:11
=== kiko [~kiko@] has joined #launchpad
KinnisonWould sqlobject get really upset if the id field wasn't an integer?02:11
=== debonzi [~debonzi@] has joined #launchpad
kikoSteveA, cprov: #launchpad-meeting?02:12
sabdflstub: does it use fixed table names when it maps to the rdbms?02:12
stubKinnison: It supports string ids as well - they just can't be compound primary keys. But I suspect it is better to stick with our internal standards unless there is a damn good reason otherwise.02:13
sabdflor does it create tables on the fly?02:13
Kinnisonstub: I'm trying to make a view, only the only way to guarantee a unique ID will be to stringify and concatenate various columns02:13
stubsabdfl: It creates tables on the fly. You define classes and it builds or modifies the backend tables for you.02:13
stubKinnison: Sounds valid. Don't ask me for the syntax to do it though - I just know it supports it :-)02:14
kikoKinnison, an sql view?02:14
Kinnisonstub: okay; I'll play with the SQL02:14
Kinnisonkiko: yes02:14
kikoKinnison, I have one living in a patch somewhere which provides a unified sourcepackage 02:14
kikoit provides all the major columns02:14
kikoand is a *major* performance improvement02:15
Kinnisonkiko: I have a view which shows all the columns I need for publishing a sourcepackagerelease to a given distrorelease in a distribution02:15
Kinnisonkiko: it goes delving off into the libraryfilealias table etc to retrieve filenames02:15
sabdflstub: ok, don't want that anywhere near emperor then02:15
kikocprov, #launchpad-meeting02:16
=== cprov [~cprov@] has joined #launchpad
=== cprov [~cprov@] has joined #launchpad
SteveAspiv: /join #launchpad-meeting please02:39
SteveAelmo: where do I use userdir-ldap ?02:54
Kinnisonstub: It seems that I'm not allowed to make id a string column :-(02:59
Kinnisonstub: I'm going to have to prod about more now :-(03:00
sabdflelmo: can we bring an archive mirror up on mawson for gina and friends?03:10
(elmo/#launchpad) yeah03:10
stubKinnison: http://sqlobject.org/docs/SQLObject.html#non-integer-keys seems to suggest 'it just works', but I remember something flying past on sqlobject-discuss that mentioned some magic setting in the class definition.03:10
Kinnisonstub: I'll take a look03:11
=== Kinnison has a specious id field for now anyway
(elmo/#launchpad) good god, I just created a new user on mawson and it has some crackful color prompt by default03:11
=== BradB_ is now known as BradB
SteveAthe "gentoo effect"03:12
=== BradB [~bradb@modemcable165.196-131-66.mc.videotron.ca] has joined #launchpad
Kinnisonsabdfl: I'm about 50% of the way through a re-publish to see if the new id column works better03:13
kikoelmo, can I have an account with color prompts too03:13
cprovelmo: heh, can you kick this rainbow colourful prompt, please :)03:15
sabdflelmo: please defer artwork discussions to #ubuntu, 1400 UTC :-)03:17
(elmo/#launchpad) yeah, that's what we need, an ascii-art version of the artwork in /etc/motd !!103:19
(elmo/#launchpad) ahem, anyway, mirror's running - it'll be a while..03:19
sabdflelmo: only on april 1st, 'k?03:22
sabdflcow porn03:22
=== limi [~limi@host217-37-231-28.in-addr.btopenworld.com] has joined #launchpad
=== limi is now known as limi|london
SteveAelmo: do you have a few minutes to talk about running a soyuz dogfood server on mawson?  #launchpad-meeting03:24
BradBsabdfl: What's the difference between watching a bug and being CC'd on a bug? The terminology makes it seem like the former means you subscribed yourself, the latter means someone else subscribed you.04:00
kikoin Bugzilla you watch *users*, and when you do so you get all their bugmail 04:01
limi|londonBig Brothzilla04:01
BradBkiko: Hm, then Malone's interface is confusing, if its intent is to imitate that behaviour.04:01
BradBBecause, on a bug, I've got a "subscribers" portlet, listing CC'd, and right below, watching.04:02
kikoI"m not sure it does, though, just adding a datapoint04:02
=== limi|london thinks it may have something to do with whether people are CCed email-wise or just have the bug in their web "favorites"
BradBthat's possible too04:05
limi|londonis mawson down?04:09
(elmo/#launchpad) limi|london: no?04:14
(elmo/#launchpad) at least the machine itself is fine04:14
limi|londonhttp://mawson.ubuntu.com/ doesn't work for me04:15
=== cprov [~cprov@] has joined #launchpad
=== stub [~stub@dsl-] has joined #launchpad
!dmwaters:*! Hi all! It looks as though level3 is having some routing problems. I've pulled the affected rotation server for now04:23
SteveAlimi|london: it should be https04:30
limi|londonsame result04:30
SteveAbut, I think daf needs to be prodded to get it running04:30
=== limi|london prods daf
(daf/#launchpad) ow04:30
SteveAhi daf.  having a rosetta meeting today?04:32
(daf/#launchpad) yes, as soon as Carlos is back from his meeting04:32
SteveAwhat meeting is carlos at?  university thing?04:33
(daf/#launchpad) yes04:33
(daf/#launchpad) I think I CC'd you about it04:33
(daf/#launchpad) I don't know what's up with Mawson04:34
(daf/#launchpad) Launchpad is running -- perhaps a problem with Apache?04:34
SteveAlulu: I'll open a bug about having a + in email addresses.  Does the user in question need his password to be reset?04:35
limi|londonelmo: is apache forwarding to launchpad?04:37
=== cprov_ [~cprov@] has joined #launchpad
luluSteveA: Thanks - I assume so - do you want me to check first?04:37
(elmo/#launchpad) hmm, what apache? :/04:37
(dilys/#launchpad) New bug 2120 for Launchpad/Launchpad: forgotten password app doesn't work if + in email address04:37
(dilys/#launchpad) https://bugzilla.warthogs.hbd.com/bugzilla/show_bug.cgi?id=212004:37
(daf/#launchpad) elmo: Mawson is refusing connections on HTTPS04:38
SteveAlulu: yes, please check.  From the email, he might have just been trying things out and kindly reporting a bug.  If he does want his password reset, then andrew can do that for him.04:38
luluSteveA: sure - will do.04:39
SteveAI've filed a bug on it.  I expect this will be fixed in the next update of the app server on macquarie, but that won't be for a while.04:39
SteveAspiv: any idea how many email addresses with "+" in them are in the database on emperor?04:40
(elmo/#launchpad) daf: see "what apache"04:40
=== cprov_ is now known as cprov
(daf/#launchpad) elmo: doesn't https://mawson.ubuntu.com/ go through an Apache proxy?04:41
=== elmo throws a bus at daf
(elmo/#launchpad) apache died. I'm working on it04:43
(daf/#launchpad) ow04:43
(daf/#launchpad) thanks04:43
(spiv/#launchpad) SteveA: I'll take a look04:48
(spiv/#launchpad) SteveA: Zero.04:50
SteveAthat's odd04:51
SteveAwhat email addresses have "ennis" in them?04:51
(spiv/#launchpad) Also zero.04:52
stubBradB: The way I interpreted the Watch/CC thing was that if you watch a bug you see it in your reports ('My bugs', dashboard etc), and if you are CC you also get email updates.04:52
SteveAspiv: I don't understand the email lu forwarded.04:53
(spiv/#launchpad) SteveA: I'm just grabbing my email now.04:53
SteveAany addresses ending in "ubuntu@gmail.com" ?04:54
(spiv/#launchpad) Also zero.04:54
(spiv/#launchpad) There's only one gmail address at all..04:54
(spiv/#launchpad) Hmm.04:55
SteveAso, I must assume that geoff ennis has never actually signed up04:55
BradBstub: ok04:56
(spiv/#launchpad) I suppose so. I assume they tried, and that plone somehow thwarted them before the database became involved.04:56
(elmo/#launchpad) okay, apache's back up but it's now using the client cert - which has been emailed to the launchpad list04:56
(elmo/#launchpad) (for mawson.ubuntu.com - the alpha site is unchanged for now)04:57
SteveAwhat is https://mawson.ubuntu.com/ supposed to present?05:02
=== ddaa [~ddaa@nemesis.xlii.org] has joined #launchpad
SteveAspiv: I don't know what in plone could account for this.05:02
(elmo/#launchpad) SteveA: the devel server?05:02
SteveAlulu: you'll need to import some certificates into your browser in order to use the launchpad servers05:02
SteveAlulu: also, andrew can't find any record of geoff ennis in the database at all.  very odd.05:03
luluSteveA: ok. Could you pop me an email on this - import some certificates into your browser in order to use the launchpad servers....05:04
luluSteveA: very odd - ok - I'll get back to Geoff and ask him to re register. I saw a gmail was found...what was that?05:04
SteveAlulu: what browsers do you use?05:05
luluFirefox, netscape, Safari, IE to test stuff. Firefox default.05:06
SteveAI'll mail you how to import a certificate for firefox.  I don't know what to do about the rest05:06
(spiv/#launchpad) SteveA: Neither do I, but the fact that "+" is being mistreated smells an awful lot like a web issue, not a DB issue...05:06
luluok - thanks :o)05:06
luluspiv: is it a Plone prob? perhaps Roche can have a look05:08
(spiv/#launchpad) lulu: I'm purely speculating :)05:08
(spiv/#launchpad) lulu: But my guess would be it's somewhere on the web end, before the authserver or the DB gets involved.05:09
SteveAwe need someone on our end who has a valid email address containing a "+" to test this properly.05:10
SteveAdaf: what's the correct address for the rosetta alpha now?05:10
(elmo/#launchpad) rosetta.shuttleworthfoundation.org I think05:11
=== Riddell [jr@muse.19inch.net] has joined #launchpad
SteveAlulu: mailed you information on how to import certificates05:12
luluSteveA: Thanks hon :o)05:12
SteveAif you need to use them with other browsers, we'll have to find out how to import certificates for them05:13
(daf/#launchpad) SteveA: it hasn't changed...05:13
SteveAshould I be getting a launchpad devel server on  https://mawson.ubuntu.com/ ?05:14
=== BradB tries that again
BradBwow, we've really been chopping down trees in the page tests05:14
SteveAqueue canadian lumberjack joke05:14
BradBthe malone bug index test now looks like this:05:15
BradB  ...05:15
BradB  <h1>...</h1>05:15
BradB  ...05:15
luluSteveA: for the + in validation - it must be stripping characters from the email on submit. Let's set up a test user.05:16
limi|londondaf / stub: "A system error occured" on all the Malone pages - is that because I'm not logged in?05:16
=== BradB goes ahead and checks in bug external ref support anyway...ignorance, bliss, etc.
SteveAlimi|london: try port 8086 for debugging tracebacks05:17
limi|londonwhat was the passwd for the foo.bar user again? not "test"?05:18
SteveAI'm getting a 403 forbidden on  https://mawson.ubuntu.com/05:18
(daf/#launchpad) SteveA: did you install the certificate?05:19
SteveAI did05:21
SteveAboth of them05:21
(daf/#launchpad) both?05:23
(daf/#launchpad) there's two?05:23
SteveAcanonical development, testers05:26
(daf/#launchpad) I only have one, which elmo posted to the launchpad mailing list05:27
(daf/#launchpad) where did you get testers.p12 from?05:28
SteveAstub: you do realize that pagetests can be run in a particular order -- that is, the system has a dependency mechanism05:28
SteveAdaf: elmo mailed it to you, carlos and me05:29
(daf/#launchpad) oh, so he did05:29
stubSteveA: Yes, which also means if the early tests cause new side effects it could break all following tests05:30
(daf/#launchpad) https://mawson.ubuntu.com/05:30
SteveAstub: that's the idea, surely, so you can see that happen, if it is important05:30
(daf/#launchpad) ^^ works for me05:30
SteveAif it is not important, the later tests should have sections elided as appropriate05:30
SteveAdaf: which certificates have you imported?05:31
(daf/#launchpad) only the Launchpad one so far05:31
(daf/#launchpad) importing certificates into Epiphany is tricky05:31
stubSteveA: That isn't very scalable if we end up with hundreds of tests05:31
(elmo/#launchpad) if you import both, it breaks. meh.05:31
SteveAaha -- if I tell firefox to let me choose which certificate to use, i can manually choose the launchpad one05:32
SteveAand it works05:32
(elmo/#launchpad) galeon doesn't even have that option :/05:32
(daf/#launchpad) elmo: I ran my Epiphany profile under Mozilla and did it that way05:33
(daf/#launchpad) elmo: the same trick should work for Galeon05:34
=== Riddell [jr@muse.19inch.net] has left #launchpad []
SteveAspiv: you have access to the database.  Can you test the issue with email addresses and logging in / registering with the website?05:37
SteveAspiv: I can supply you with some email addresses to test with.05:37
luluSteveA: Just sent you another email on an underscore character being a problem too - do you think it's on our validation?05:44
(spiv/#launchpad) SteOk.05:44
(spiv/#launchpad) SteveA: Actually, don't we have + addresses at canonical.com?05:45
=== spiv checkes
SteveAlulu: I have no idea.  We'll need to look into it and try to reproduce the problem.05:48
ddaadid someone already asked elmo to add a rsync service to chinstrap to speed up archive mirroring?05:49
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: bug ext ref fixes (patch-629)05:50
luluSteveA: thanks guys05:50
(daf/#launchpad) elmo: did somebody already ask you to add an rsync service to chinstrap to speed up archive mirroring?05:50
ddaadaf: well, I expected that my message would have the same effect, that wasu just a slightly more oblique way of asking "elmo, could you add a rsync service" :-)05:52
(daf/#launchpad) ddaa: I think perhaps you're being a little more subtle than necessary here :)05:52
(spiv/#launchpad) SteveA: Yes, andrew+test@canonical.com works, so I'll test with that...05:57
(spiv/#launchpad) SteveA: Um, where do I sign up? :)06:00
(elmo/#launchpad) daf: no06:00
(elmo/#launchpad) and rsync using what? without ssh, rsync is a wide-open protocol06:01
ddaaelmo: I'm not on top of it, but if it's possible to conveniently tunnel rsync through ssh that will cut it as well.06:01
ddaaThe basic idea is that "tla archive-mirror" is stupidly slow even if safe, and that rsync just works better if you understand how it can break.06:02
(elmo/#launchpad) eh, just do 'rsync -e ssh' it works fine, doesn't need any changes by admin06:02
ddaaelmo: thanks, I'll check that.06:03
(spiv/#launchpad) lulu: Do you know where the sign up page these users are using is?06:04
luluit's not readily available as yet http://www.ubuntulinux.org/join_form. This should be on https://06:07
=== BradB is now known as BradB|lunch
(spiv/#launchpad) lulu: Ah, thanks.06:07
luluspiv: Brad is keen to install the new new cookiecrumbler - will this interfere with your testing?06:10
(spiv/#launchpad) lulu: Hmm, that form hasn't been used for almost a week... is there another place, maybe in launchpad?06:11
(spiv/#launchpad) lulu: Or are these user problems older than that?06:12
luluThat's weird. perhaps they are talking about the shipit database of Mako's06:17
BradB|lunchspiv: can i go ahead and install the new CC?06:18
luluspiv: last week while I was away. Let me clarify with the users and get back to you ok!?06:18
=== cprov is now known as cprov-food
(spiv/#launchpad) BradB|lunch: Sure.06:20
(spiv/#launchpad) lulu: Heh, ok :)06:20
(spiv/#launchpad) SteveA: Around?06:20
=== Kinnison is now known as KinniLunch
SteveAspiv: yep06:26
(spiv/#launchpad) SteveA: Is there a sign-up page in a launchpad somewhere, or are all sign-ups happening through the plone site?06:27
SteveAthrough plone06:28
(spiv/#launchpad) SteveA: Because the authserver's createUser doesn't work atm (because it hasn't been udpated for nicknames), so looking at the lack of errors in the logs I can see that no-one has tried the plone site's join_form page for about a week.06:28
(spiv/#launchpad) Ok.06:29
SteveAcan you update the authserver now?06:29
(spiv/#launchpad) So before I can test this, I need to add nickname generation to the authserver.06:29
(spiv/#launchpad) Yeah, I can do that.06:29
(spiv/#launchpad) But I'll have to workrave first ;)06:29
(spiv/#launchpad) (and I'll have to actually code it, although assuming BradB's module is snae that won't take long)06:30
(spiv/#launchpad) sane, rather.06:30
=== spiv -> workrave
=== carlos [~carlos@69.Red-80-33-181.pooles.rima-tde.net] has joined #launchpad
KinniLunch35726 entries in the librarian, 35726 files published to the pool by lucille06:37
=== justdave [~dave@] has joined #launchpad
=== cprov-food is now known as cprov
sabdflKinniLunch: good job06:56
sabdflspiv: noticed an interesting thing yesterday while editing the site06:56
sabdfl(you have to log in to https://site-edit.ubuntulinux.org/ to avoid cacheing by the way)06:57
sabdflany pages i created were created by "1" which is my id in the db06:57
sabdflwould have thought either nickname or email would show up06:57
=== sabdfl [~mark@host217-37-231-28.in-addr.btopenworld.com] has left #launchpad []
=== sabdfl [~mark@host217-37-231-28.in-addr.btopenworld.com] has joined #launchpad
SteveAsabdfl: sounds like a plone thing.  may be legitimate snagging for roche. 06:59
sabdflSteveA: are we passing the email / username to plone in the first place?06:59
SteveAplone can find out the email and username of users07:00
SteveAI have no idea how to actually tell plone that, though07:01
=== KinniLunch is now known as Kinnison
=== ddaa [~ddaa@nemesis.xlii.org] has left #launchpad []
=== ddaa [~ddaa@nemesis.xlii.org] has joined #launchpad
(daf/#launchpad) what's the deal with arrowBlank.gif?07:19
carlosdaf: hey, when you want we could have the meeting07:20
(daf/#launchpad) hi Carlos07:20
(daf/#launchpad) did the meeting at the University go ok?07:20
=== BradB|lunch really goes for lunch now
carlosSteveA: do you know any release date for Zope3? I'm thinking on doing some development in my free time and I want to give it a try07:21
carlosdaf: yes, I'm starting today with my "final project" (a kind of project that all students should do last year)07:22
(daf/#launchpad) carlos: http://dev.zope.org/Wikis/DevSite/Projects/ComponentArchitecture/RoadMap07:23
(daf/#launchpad) Zope X3 final is due today07:23
carlostrue :-)07:24
carlosgood news...07:24
(daf/#launchpad) ok, shall we have a meeting?07:25
(daf/#launchpad) spiv, sabdfl: both lib/canonical/foaf/browser.py and lib/canonical/launchpad/database/project.py have a ProjectContainer class07:29
(daf/#launchpad) is this intentional?07:30
(daf/#launchpad) (and yes, I know ProjectContainer is deprecated)07:30
sabdfldaf: good catch, no, the database/project.py one is the correct location, not sure which one is active in the code07:31
(daf/#launchpad) the foaf one doesn't seem to be used anywhere07:31
sabdflif there's anything useful in the foaf one please merge it into the database/ one and eliminate the foaf one07:31
(daf/#launchpad) either in the Python or the ZCML07:31
carlosdaf: yes, when you want07:31
sabdflok, then we can just remove it07:31
(daf/#launchpad) but I'm not 100% sure07:31
(spiv/#launchpad) daf: If you rename it, do the tests still pass? ;)07:32
(daf/#launchpad) spiv: :D07:32
(spiv/#launchpad) (We're not too far from being able to rely on that, thanks to the page tests...)07:32
(daf/#launchpad) "you broke it!" / "no I didn't -- the tests were still working!"07:33
carlosthere are some tests that are still failing07:34
(spiv/#launchpad) daf: The annoying cases are "no I didn't -- the tests are still working!" / "not on my machine, they aren't"07:34
carlosbut they are only detected by daf's script in rosetta07:34
(daf/#launchpad) carlos: eh?07:35
(spiv/#launchpad) daf: But hopefully we can avoid having fragile tests :)07:35
(daf/#launchpad) carlos: the interface checker07:35
(daf/#launchpad) spiv: true07:35
carlosdaf: yes07:35
carloswe should move it outside Rosetta :-)07:35
(daf/#launchpad) spiv: I'm fully in support of "if the tests still work and the code is broken, how was I supposed to know I broke it?"07:36
(daf/#launchpad) carlos: yes07:36
(spiv/#launchpad) daf: Absolutely. If the tests pass only under some conditions (or worse, only sometimes, randomly), then that's a bug (possibly in the tests) that needs fixing fairly urgently, due to the developer confusion it causes.07:37
(daf/#launchpad) Kinnison: you need to add an __init__.py to lib/canonical/lucille/tests for it to be picked up by the test machinery07:37
(daf/#launchpad) spiv: absolutely07:37
(daf/#launchpad) Kinnison: will you or shall I?07:38
(spiv/#launchpad) daf: Twisted has had some nasty issues in this area in the past (and to some extent, today as well :( )07:38
Kinnisondaf: If you do; it'll exploderificate07:38
(daf/#launchpad) spiv: I have one sqlbase test failing here07:38
Kinnisondaf: It's not ready to be integrated07:38
Kinnisondaf: I have a hive somewhere which needs some work before I commit it07:38
(daf/#launchpad) Kinnison: you COMMITTED BROKEN TESTS?!07:38
(spiv/#launchpad) daf: Which one?07:38
Kinnisondaf: the tests run07:38
Kinnisondaf: But not as part of the integrated suite07:39
Kinnisondaf: special paths needed for the data/ dir07:39
(daf/#launchpad) Kinnison: grumble ;)07:39
(daf/#launchpad) spiv: 07:39
(daf/#launchpad) Failure in example: sqlrepr(time(13, 45, 50), 'postgres')07:39
(daf/#launchpad) from line #30 of canonical.database.sqlbase.quote07:39
(daf/#launchpad) Expected: "'13:45:-1'"07:39
(daf/#launchpad) Got: "'13:45:50'"07:39
(spiv/#launchpad) Hmm.07:39
(spiv/#launchpad) I thought I merged the fix for that one.07:39
(daf/#launchpad) oh, I also have a failing authserver test07:40
=== spiv adds that to his todo list
(daf/#launchpad) IntegrityError: ERROR: new row for relation "person" violates check constraint "valid_name"07:40
(spiv/#launchpad) daf: I'm fixing the authserver right now :)07:40
(daf/#launchpad) groovy :)07:40
Kinnisondaf: If you cd into the test dir and run 'make check' it works fine :-)07:41
=== carlos phone
(daf/#launchpad) Kinnison: my, what verbose test harnesses you have07:42
SteveAKinnison: if you need special paths, can you get them relative to a test_foo.py module's __file__ ?07:42
(spiv/#launchpad) SteveA: Incidentally, Twisted has a convenience method for that. It's very handy.07:43
(spiv/#launchpad) (twisted.python.util.sibpath, iirc)07:43
(daf/#launchpad) spiv: "sibpath"?07:44
(spiv/#launchpad) SteveA: It's probably worth writing one of our own to encourage the right organisation of test files.07:44
(spiv/#launchpad) daf: short for "sibling path"07:44
KinnisonSteveA: probably07:44
(spiv/#launchpad) (by analogy with "parent path" and "child path")07:44
(daf/#launchpad) aha07:46
(spiv/#launchpad) In fact, I think I've already used sibpath in the authserver functional tests (seeing as it depends on Twisted anyway...)07:46
(daf/#launchpad) well, Launchpad has a Twisted dependency already, I think07:46
=== debonzi [~debonzi@] has joined #launchpad
(daf/#launchpad) so I don't see a problem with using that07:46
(spiv/#launchpad) daf: Only sort of. The launchpad web app itself runs fine without it, it's just ancilliary stsuff like the librarian and the authserver that needs it.07:47
(daf/#launchpad) spiv: I thought there was something else07:47
(spiv/#launchpad) So I'm hesitant to make that dependency any stronger, as much as it would suit me...07:47
(spiv/#launchpad) Oh, and buildbot/importd.07:47
(daf/#launchpad) I have no objections to a twisted dependency07:47
(daf/#launchpad) better that than rewriting code07:48
(spiv/#launchpad) (And I think lamont has an XML-RPC server for his builders that uses that, but that's not in the laucnhpad source tree)07:48
(spiv/#launchpad) daf: Me either, but I'm biased :)07:49
(daf/#launchpad) :)07:50
=== Kinnison doesn't see why it'd be bad to add a twisted dependency to the testsuite
(daf/#launchpad) Kinnison: an aversion to dependencies07:51
(daf/#launchpad) (which I personally don't have)07:51
Kinnisondaf: it's getting to the point where it's a given dependency anyway; hardly seems avoiding it07:51
(daf/#launchpad) Kinnison: you're preaching to the converted, man :)07:52
Kinnisondaf: good good :-)07:55
=== Kinnison gets down from the pulpit
Kinnisonthe air was thin up there07:55
carlosdaf: do you remember the bug I show you on Friday?07:57
carlosdaf: It was because there was a potmsgset without any pomsgidsighting, I'm not sure if it's a real bug, it was there because I had the sample data broken07:59
(daf/#launchpad) I don't remember07:59
=== lulu [~lu@host217-37-231-28.in-addr.btopenworld.com] has left #launchpad []
=== daf workraves
carlosdaf: the out of index error when editing a translation08:00
carlosI don't remember it completely, let me look for the trace I sent you...08:01
carlos * Module canonical.rosetta.browser, line 785, in messageSets yield self._messageSet(set) * Module canonical.rosetta.browser, line 756, in _messageSet messageID = self._messageID(messageIDs[0] , set.flags()) * Module sqlobject.main, line 1238, in __getitem__ return list(self.clone(start=start, end=start+1))[0]  IndexError: list index out of range08:03
(daf/#launchpad) oh, *that* one08:08
(daf/#launchpad) it was broken data?08:09
carlosnot sure if we should add extra checks08:09
(daf/#launchpad) humph08:09
(daf/#launchpad) I think extra checks are usually good08:09
(daf/#launchpad) do we know which check to add in this case?08:09
carlosmessageIDs[0] 08:10
carlosmessageIDs is an empty list08:10
(daf/#launchpad) aha08:10
(daf/#launchpad) do we know where we would add the check?08:10
carlosyes, I think we should add it just in that line08:10
(daf/#launchpad) in canonical.rosetta.browser?08:11
carlosor perhaps, move it into the method that returns messageIDs so we raise an exception if the list of msgids is empty08:11
carloshmm, the later solution is better, it's inside database/pofile.py08:11
(daf/#launchpad) spiv: at any rate, renaming the class didn't seem to make any tests fail that weren't failing before, so shall I delete it?08:12
(daf/#launchpad) carlos: yes, that sounds good to me08:12
carlosalso, we are returning a sqlrecordset (or whatever its named) instead of a plain list08:12
(spiv/#launchpad) daf: Given that grep found no references, I'd say yes...08:12
carlosso the browser.py code is converting it into a list before use it08:12
(daf/#launchpad) that's not usually a problem as long as it behaves like a list08:12
(spiv/#launchpad) daf: Thanks for noticing :)08:13
carlosdaf: no, it does not behaves like a list, you need to cast it as a list08:13
(daf/#launchpad) spiv: de nada :)08:13
(daf/#launchpad) perhaps the cast should be made in pofile.py then08:13
(daf/#launchpad) carlos: is it OK to make changes to pofile.py?08:13
(daf/#launchpad) will they case conflicts on your branch?08:13
carlosdaf: please wait, I have my changes almost ready08:14
carlosdaf: I would prefer if you could check the changes today as soon as I fix a small bugs that are remaining08:14
carlosI got stub's permission to commit the database changes this morning08:15
(daf/#launchpad) no problem08:15
carlosdaf: or are you stopped by it?08:15
(daf/#launchpad) I'm not blocked on it08:15
(daf/#launchpad) I just have a changeset from "tla undo" that I won't commit until your branch is merged08:16
carlosok, thanks08:16
carlosspiv: any way to be able to omit unneeded fields when creating sqlobjects? they are not null in the database and notNull=False08:20
carlosbut I get an exception asking for them08:20
carlos    *  Module sqlobject.main, line 856, in _create08:20
carlos      raise TypeError, "%s() did not get expected keyword argument %s" % (self.__class__.__name__, column.name)08:20
carlosTypeError: POFile() did not get expected keyword argument filename08:20
(daf/#launchpad) carlos: does the field have a default?08:21
carlosdaf: no08:21
carlosis it the only solution available?08:21
(daf/#launchpad) so you'd like there to be an implicit default of None?08:21
(daf/#launchpad) a default default? :)08:21
carloswell, when you create a row08:22
carlosand you omit a field08:22
carlosit's set to NULL08:22
carlosthat's what I want08:22
(daf/#launchpad) isn't that the same thing?08:22
carlosif you put default=None, yes08:22
(spiv/#launchpad) carlos: To use the database's default value, use database.constants.DEFAULT.08:22
carlosbut I don't have it at this moment08:22
(spiv/#launchpad) I agree that SQLObject should be smarter about this...08:23
(daf/#launchpad) right, so you're saying that if you don't put a default, the default should default to none?08:23
carlosspiv: the database does not have a default set for those fields (or a field that could be empty is a default value?08:23
carlosdaf: I think so08:23
(spiv/#launchpad) carlos: Then explicitly set None, whether in the column declaration or your invocation.08:23
carlosI mean, I thought that sqlobject was smart enough to do it alone, but seems like it's not as clever as I thought :-P08:24
carlosspiv: ok08:24
(spiv/#launchpad) carlos: No, sqlobject is stupid here, unfortunately08:24
(daf/#launchpad) carlos: file a bug, work around it :)08:24
(spiv/#launchpad) But seeing as the solution is to be explicit, it's not too terrible a problem.08:24
carlosspiv: thanks for the confirmation :-)08:24
(spiv/#launchpad) I posted to the mailing list about this some time ago...08:25
(daf/#launchpad) (if you think it is a bug)08:25
(daf/#launchpad) spiv: and...?08:25
carlosspiv: sorry, I don't remember it :-(08:25
(spiv/#launchpad) carlos: Sorry, I meant the sqlobject-disucss list :)08:25
carlosohh, then is normal I don't remember it :-D08:26
cprovdaf: ping08:38
(daf/#launchpad) cprov: pong!08:41
cprovdaf: how to use launchpad pg_user on mawson (psql -U xx fails on IDENT) ?08:44
(daf/#launchpad) cprov: "sudo -u launchpad psql"08:45
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: Add nickname support to the authserver (fixing the failing test (patch-630)08:46
cprovdaf: I can't use sudo cause I don't have password :)08:50
(daf/#launchpad) cprov: you don't?08:51
(daf/#launchpad) cprov: it's your normal login password it wants08:51
cprovdaf: ssh id_dsa.pub08:51
(daf/#launchpad) sure, I use certificate authentication also08:51
(daf/#launchpad) but I need to use my password for sudo08:51
(daf/#launchpad) if you don't have a password or don't remember it, you'll have to set one08:52
=== cprov testing
=== BradB|lunch is now known as BradB
cprovdaf: I just can figure out that I don't have a password, none that I remember ...08:54
(daf/#launchpad) cprov: you probably first got it in a gpg-encrypted email from elmo08:56
(daf/#launchpad) cprov: but it's easy enough to set a new one, I think08:56
cprovdaf: i'm looking for elmo email08:56
cprovdaf: nop, I have no email from james with a pass, anyway, I ask him for a new pass08:59
cprovdaf: tks, daf08:59
(daf/#launchpad) cprov: use db.warthogs.hbd.com to do a password change09:00
=== debonzi goes for a little university exam
cprovdaf: yep !09:05
(daf/#launchpad) cprov: ok, cool :)09:06
=== BradB is now known as BradB|ank
=== jblack waves at the launchpad team
jblackHow are you guys? 09:09
cprovdaf: ehe, not that cool, dude, if chpasswd@db.warthogs.hbd.com can't understant my signature ..09:09
cprovjblack: Leaving in a Dream <wink> 09:10
(daf/#launchpad) cprov: hmm :(09:10
cprovdaf: exactly what I thought ...09:11
jblackdaf: Sorry. Everybody showed up at once. 09:57
(daf/#launchpad) jblack: no worries :)09:59
=== cprov [~cprov@] has joined #launchpad
=== BradB|ank is now known as BradB
jblackdaf: Ok. Where were we, boss ? 10:25
(daf/#launchpad) the East Coast, IIRC10:25
jblackAhh. Yeah.10:25
jblackYou're welcome out here any time. 10:25
jblackJust let me know a couple days ahead of time so that I get the guest room ready for you10:26
(daf/#launchpad) well, looks like there are buses10:26
(daf/#launchpad) if I get on the right one, it takes 3 hours10:26
jblackAnything I should know? Allergies of any sort? 10:28
(daf/#launchpad) I'm slightly allergic to cats and I don't eat mammals10:29
jblackOk. So I should have lettuce, carrots and what on hand? \10:30
jblack(no cats, but I do smoke) 10:30
(daf/#launchpad) :)10:30
(daf/#launchpad) fish are good, though10:31
jblackHow about this. When you get here, we'll go grocery shopping, and we'll fill the fridge up with stuff you like.10:31
(daf/#launchpad) sounds good :)10:33
jblackOk. That just leaves when10:33
(daf/#launchpad) probably not this week10:33
(daf/#launchpad) I have a vague intention to go travelling further out at some point10:34
jblackOk. some indefinite point in the future it is. =) 10:34
jblackI have some questions for you now.10:34
(daf/#launchpad) shoot10:34
jblackHow long does star-merge take you on rocketfuel? 10:35
(daf/#launchpad) a minute or two, I think10:35
jblackarch/os ? 10:35
jblackarchitecture/os, that is10:35
(daf/#launchpad) i386/Linux10:36
jblackubuntu, I take it? 10:36
(daf/#launchpad) cough10:36
jblackIts ok if its not ubuntu.10:36
(daf/#launchpad) it's Debian sid10:36
jblackram ? 10:37
(daf/#launchpad) 768MiBs10:37
(daf/#launchpad) (I recently upgraded)10:37
(daf/#launchpad) from 256MiBs10:37
jblackyou using libraries? if so, greedy/nongreedy sparse/nonsparse ? 10:37
(daf/#launchpad) I haven't really noticed much change in arch10:37
(daf/#launchpad) greedy sparse10:37
jblackand last question. are you locally mirroring rocketfuel? 10:38
(daf/#launchpad) I'm not10:38
(daf/#launchpad) I suspect my disk is slowing arch down, acutally10:38
jblack2 minutes is about right.10:38
jblackIf you're machine is top of the line, its about a minute. If you're machine is like mine, and merely rather nice, its about 2 minutes.10:39
carlosspiv: ping10:39
jblackcarlos: you're on launchpad, right ?10:39
carlosjblack: yes10:40
jblackmind answering the same questions for me that I just asked daf ? 10:40
(daf/#launchpad) jblack: is it CPU-bound or memory-bound or network-bound or disk-bound?10:40
jblackdaf: thats what I'm trying to figure out.10:40
carloslet me read them :-)10:40
(daf/#launchpad) jblack: aha :)10:40
jblackwhen I went to bed last night, I was certain that it was disk bound. 10:40
jblackubuntu has a footprint of about 200 megs. And 90 megs of trees wouldn't get in the cache with a system w/ 256 megs (which would explain 1 hour star-merges for brad) 10:41
jblackthough in fairness, brad isn't runinng ubuntu at all, but presumably os x has a similiar footprint.10:41
(daf/#launchpad) hmm10:41
(daf/#launchpad) 90 megs?10:41
jblackdaf: Yeah. RF is about 30 megs, the bulk of which is patchlogs.10:41
(daf/#launchpad) gosh10:42
jblackdepending on how you count, and how libraries play in, you're looking at 2 or 3 trees.10:42
(daf/#launchpad) does that mean it's going to get worse in proportion with the number of revisions?10:42
jblackanyways, that went out the window when I talked to limi, who has os x and a gig of ram. He's taking 7 minutes, but I don't know yet whether he's using libraries.10:42
ddaatroll of the day: use bdb to store patchlogs10:42
=== jblack throws ddaa a nasty look
jblackdaf: Not for a long while. If there's a buffer cache line, its somewhere between 256 and 512.10:43
jblackyou're very safe up there at 76810:43
ddaaMore seriously, there are two sides to it:10:43
(daf/#launchpad) right10:43
ddaa1. patch application: just check that the name 10:44
ddaaand the id stored in the patchlog match what is in the tree instead of making a full tree inventory.10:44
carlosjblack: How long does star-merge take you on rocketfuel?  -> about 2 minutes 40 seconds (3 patchsets)10:44
carlosjblack: PPC/Ubuntu10:44
carlosRAM: 77418810:44
jblack(/me strike out ppc as a possible cause) 10:45
ddaa2. commit: we can make up something simple which uses commit limit with a cli of the form "tla touch file" which add the file to the limit of the next commit,10:45
ddaaor something to that effect.10:45
jblackddaa: How will that help with 1 hour star-merges ? 10:46
carlosyou using libraries? Yes but I don't remember the kind of .. the log says greedy, not idea about sparse, I did what the default was from the documentation...10:46
jblackcarlos: tla library-config /the/path-to-your/library10:46
ddaajblack: does that figure include the revlib population or just the apply-delta with both revisions available in the library?10:47
carlosjblack: my laptop is two years old (three years since was launched to the market)10:47
(daf/#launchpad) carlos: tla library-config `tla my-revision-library`10:47
jblackddaa: mostly its the merge.10:47
carlosgreedy and sparse10:47
jblackddaa: I can't even build a library on bradb's machine. I fell asleep.10:47
jblackcarlos: last question: local mirror? 10:47
BradBjblack: Note: it doesn't take me an hour to star-merge per se, but rather to go through the whole process (tla tree-lint, tla changes, star-merge, etc.) tla changes and tla star-merge take mind-boggling amounts of time.10:47
ddaajblack: you are not answering...10:48
BradBAnd, of course, the more there is to merge, the worse it gets.10:48
carlosjblack: and a link of 512Kbps download 128Kbps upload10:48
jblackddaa: I already answered. Its mostly the star-merge. 10:48
ddaa(22:47:03) ddaa: jblack: does that figure include the revlib population or just the apply-delta with both revisions available in the library?10:48
jblackddaa: Like I said, bradb can't use libraries at all. so thats apply delta.10:49
jblackddaa: I haven't dived deeply yet into bradb's machine, because its so impossibly slow.10:49
carlosBradB: which powerbook do you have? a pismo?10:49
=== mako [mako@micha.hampshire.edu] has joined #launchpad
ddaaIf it's without library, that involves building the parent and the target revision, isn't it? Which takes essentially the same time with a greedy non-sparse...10:50
jblackOk. Does anybody but limi and bradb use os x with rocketfuel? 10:50
BradBcarlos: The second most recent 15". 867 MHz10:51
ddaaThe "no full inventory on patch application" makes patch application time roughly proportional to the size of the patch instead of size(patch)+size(tree)10:51
carlosthen mine is older10:51
jblackbradb: Would it be easy for you to temporarily bump up your ram to 512 or greator? 10:51
BradBjblack: I've thought of it. I10:51
ddaaWhich I expect would already yield a very noticeable performance increase.10:51
BradBI'd have to buy some, but it'd be a good investment (not just for tla/arch)10:51
carlosjblack: I have osx, I could test it if it's easy to setup it or give you a shell account if you want10:51
jblackcarlos: I'd love that. what are the specs on the machine? 10:52
carlosimac G4 800MHz10:52
carlosit's faster than my laptop10:52
carlosand same RAM10:52
jblackWhat's the memory and the throuput on the io bus? 10:52
jblackAhh, 768. 10:52
ddaaThe last piece, would be making the patchlog collection more opaque so we have additional invariants to rely on and need not stat it all.10:52
carlosRAM: 77418810:53
ddaaWhich is a big chunk of work.10:53
jblackcarlos: yeah, that would help a *lot* 10:53
carlosok, let me redirect the port and create the account10:53
jblackcarlos: I'm down to three dependant variables, and that would knock one out. 10:54
carlosI'm not working on it at this moment, so it's 100% yours (well, I'm listen internet radio from it :-P)10:54
jblackshould I mail you a ssh key, and if so, to where? 10:54
carlosjblack: no, don't worry10:57
(daf/#launchpad) I don't really mind the speed of star-merge, because I don't do it very often10:59
(daf/#launchpad) I can take a break or have a cup of tea10:59
ddaajblack: what do you think of what I said?10:59
(daf/#launchpad) but I use "tla changes" very often, and its speed (or lack thereof) is rather frustrating10:59
jblackddaa: I think that collecting the data and figuring out what is wrong is called for before we fix the problem. :) 11:00
ddaadaf: are you using revlib-linked trees? It is reported to dramatically improve the speed of "tla changes".11:00
(daf/#launchpad) I don't think I am, no11:01
ddaajblack: You are right in doing so. Just wanted to know what you think of my informed speculations.11:01
(daf/#launchpad) is that documented anywhere?11:01
jblackddaa: I'm not really thinking about it atm.11:02
ddaatla get -H, tla changes -H11:02
ddaadaf: ^11:02
(spiv/#launchpad) daf: Use the --link option on tla get/build-config.11:02
(daf/#launchpad) aha11:02
(spiv/#launchpad) daf: And tla changes --link will convert a tree to be hard-linked in-place.11:02
(daf/#launchpad) interesting11:02
(daf/#launchpad) and the downside is that any tools which don't unlink-on-write will get your revlib in a twist?11:03
(spiv/#launchpad) daf: exactly.11:03
(spiv/#launchpad) daf: There's a vim option you should turn on... se the gnuarch wiki somewhere.11:03
jblackddaa: How about we set asside time tomorrow, would that work for you? 11:03
(spiv/#launchpad) daf: Oh, I have the setting: set backupcopy=breakhardlink,auto11:04
(daf/#launchpad) spiv: vim does that by default doesn't it?11:04
ddaaEventually, the way to improve the speed of tla changes would be a command to say "consider changes only to those files", or something that makes it possible to dispense with traversing the whole patchlog collection (for the "consider changes everywhere" case).11:04
(daf/#launchpad) oh, backups11:04
(daf/#launchpad) I don't use backups11:04
(spiv/#launchpad) With hardlinks, I can do tla get in under 3 seconds (when it's in cache), ditto tla changes.11:04
ddaajblack: I'm supposedly hellbound to imports...11:04
(daf/#launchpad) ddaa: that only works as long as "tla commit" only considers the same files11:05
(daf/#launchpad) ddaa: I often use "tla changes" to check for inadvertent changes11:05
jblackddaa: Yeah, Thats right.11:05
(spiv/#launchpad) daf: something like tla commit --only-this-subdir?11:05
ddaa[tla changes]  and of course make sure that "tla changes" and "tla commit" do not do any more inventories than strictly necessary...11:05
jblackddaa: willing to distill out your ideas and mail them to me, so I can read them in a less distracting medium? 11:06
(spiv/#launchpad) daf: But given that I can do a full tla changes in under 3 seconds, I'm not concerned...11:06
ddaajblack: later this week11:06
ddaajblack: I really need to get some imports going...11:06
jblackddaa: sounds like a plan11:06
(daf/#launchpad) spiv: well, ddaa was proposing having "tla changes" only look at files you've explicitly said you might have changed11:07
(dilys/#launchpad) Merge to rocketfuel@canonical.com/launchpad--devel--0: Fix the failing sqlbase doctest (patch-631)11:07
(daf/#launchpad) spiv: ta11:07
ddaastupid buildbot is hung again...11:08
(spiv/#launchpad) daf: Sure, but typing a list of files would probably take me more than three seconds... :)11:08
(spiv/#launchpad) daf: So, in my case, I don't mind :)11:08
carlosValueError: Unknown SQL builtin type: <class 'canonical.launchpad.database.person.Person'> for <Person at 0x307f37d0>11:08
(spiv/#launchpad) If I were on OS X, my opinion would be rather different...11:08
jblackddaa: That may be a necessary fallback position, but before we go there, lets see if we can just tell limi "use libraries" and bradb "get more ram, you cheap bastard"  :) 11:09
(daf/#launchpad) spiv: right, and it wouldn't catch inadvertent changes11:09
(daf/#launchpad) spiv: I'd like it to be transparently faster -- maybe hardlinking will be enough for me11:09
ddaajblack: yeah, but the sad truth is that there _are_ performance problems which need adressing.11:09
jblackddaa: Yeah. I think it may be the 28 megs of patchlogs or so that's getting carried around.11:10
jblackso the problem could possibly be solved with a patchlog autopruner.11:10
ddaajblack: It's probably the problem. In any case performance should not deteriorate with the number of patchlogs.11:11
ddaajblack: I do not think that pruning is the right answer.11:11
carlostalking about the performance....11:11
jblackof course performance should deteriorite with the number of patchlogs.11:11
carlosdoing a new branch from rocketfuel today is really sloooooooooww....11:11
jblackcarlos: how slow is slooooooooowwww ? 11:12
carlosjblack: about 5 minutes or more11:12
carlosnot sure, I could do a check later if you want11:13
carlosI did a new branch last week11:13
=== daf -> workrave
ddaajblack: instead I think the patchlog collection should be made smarter and be able to tell what was changed (tla changes) and which set of logs it contains (for the general changeset generation for apply-delta). Maybe with some extra smarts because there are probably changesets in the wild which modify the content of patchlogs (to fix typos and stuff in auto-generated changelogs).11:13
jblackHow would you know which patchlogs apply, if you don't look at them and see what they are? 11:14
ddaaThe important facts here are: 1. user generally do not need direct access to patchlogs and 2. patchlog mutation is a very rare event.11:15
jblackcarlos: would it be possible to get a newer diff and diff3 on the box? 11:16
carlosjblack: if you point me to them...11:16
ddaajblack: for "changes" and "commit", we know what are the new or removed patchlogs because tla is the only one to do such changes (on changeset application).11:16
carlosjblack: I never did any development on MacOSX, I have it to play games and edit home videos11:16
jblackddaa, you do understand that I'm not dealing with changes and commit right now, just star-merge? 11:17
jblackcarlos: Nor have I. This is the second time in my life I've been on os x. ;) 11:17
carlosBradB: could you help here?11:17
jblackI'll have to bug either limi or brad to see how they pull it off11:17
ddaajblack: for generic changeset calculation (which applies to star-merge), there are more efficient ways to determine the set of patchlogs than traversing a overcrowded file hierarchy, but that requires giving up the "patchlog are stored as individual files" implementation choice.11:18
jblackddaa: And what would you do with the merge mess of having one patchlogs file? 11:19
carlosjblack: https://wiki.canonical.com/OSX11:19
jblackgah. I don't remember the username and password.11:20
ddaajblack: the changet generation and application should special case patchlogs.11:20
jblackohh. good guess jblack11:20
jblackcarlos: that page doesn't seem related. 11:20
carlosjblack: that page tells you how to setup arch on MacOSX11:21
carlosfrom http://darwinports.opendarwin.org/11:21
jblackOh, there it is on the top.11:21
jblackcan I run those, or do you have to? 11:21
carlosI think you should be able to install it11:21
carlosin your home11:21
jblackI don't seem to have port in my path, and there's no locate database11:22
carlosif you have any problem, tell me it and I will run it11:22
carlosjblack: you need to install it first11:22
carlosIt's all in that page11:22
=== cprov [~cprov@200-206-134-238.async.com.br] has joined #launchpad
ddaajblack: essentially, each patchlog can be identified by "fqrev N" where N is the extra bit for when the patchlog is patched.11:23
BradBcarlos: What do you need to know about OS X?11:24
carlosBradB: ask jblack he has an account in my iMac11:24
jblackbradb: I'm trying to build tla on the machine, but it doesn't like diff and diff3 on his machine11:24
BradB(note: I don't really have time to look at this atm, as I'm spending the next few hours trying to keep in line with the wednesday dog food date for Malone. :)11:24
BradBjblack: fink install tla11:24
carlosBradB: latest MacOSX release with development tools11:24
ddaaIn the common case, the the patchset-delta is just additions and removals, and the expensive bit is getting the patchlog listing. On slow filesystems it will probably faster to read one big file than stating several directories with hundred of entries.11:26
carlosBradB: does it works?11:26
carlosjblack: I will install fink now (it's apt-get for MacOSX)11:26
jblackbradb: as root, I take it? 11:26
carlosjblack: it will take about 15 minutes I need to download about 20MB of data11:28
BradBit'll ask for the sudo p/w11:28
BradBcarlos: Well, apt-get for OS X is apt-get for OS X. :)11:28
carlosjblack: I will tell you when it's ready11:28
BradBfink compiles everything from source.11:29
carlosI know11:29
carlosI was using it some time ago11:29
carlosuntil I decided to forget about MacOSX development :-)11:29
jblackdinner. bbs11:30
BradBPanther may be a heck of a lot better than Jaguar, I just don't yet have a machine to fall back on if I'm inconvenienced any downtime by attempting an upgrade.11:31
BradBAnd, of course, I need more memory.11:31
carlosdaf: I'm fixing now the functional tests and my branch will be ready to be merged into rocketfuel11:33
(daf/#launchpad) carlos: cool!11:33
BradBIf s is an instance of an SQLObject, s.foo is an instance of an IntCol whose schema def uses a dbschema vocab, how do I access the "term" from the vocab in a python expr in TALES?11:40
BradBi.e. I don't want to do if s.subscription == 1; I want to do if s.subscription == 'CC'11:40
BradBI tried if path('s/subscription/lp:BugSubscription'), but got a KeyError on s.11:41
=== BradB decides to defer doing it The One True Way until after Malone has users
carlosBradB: apt-get install tla says that it does not exists11:45
BradBcarlos: I suggested fink.11:46
BradBfink install tla should work.11:46
carlosno package found11:46
BradBcarlos: https://wiki.canonical.com/Arch11:52
carlosBradB: ok, thanks11:53
BradBI'm running 1.2.1, yeesh.11:54
BradBpretty old...i think!?11:54
BradBoh, maybe not old11:55
carlosthe mirror seems to be down11:57

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!