/srv/irclogs.ubuntu.com/2005/08/01/#launchpad.txt

dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial]  PackageVersionVerification (patch-2174)12:16
dilysNew Malone bug 1591 filed on Bazaar by Matthieu Moy: baz rm non-existant-file should give a clean error message.12:36
dilyshttps://launchpad.ubuntu.com/malone/bugs/159112:36
=== Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: Add Soyuz legalese. r=sabdfl (patch-2175: daniel.silverstone@canonical.com)12:42
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial]  fixes to various page titles (patch-2176: mpt@canonical.com)01:09
=== sabdfl [~mark@sabdfl.silver.supporter.pdpc] has left #launchpad []
=== Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad
=== sabdf1 [~mark@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== sabdf1 [~mark@200-171-140-32.dsl.telesp.net.br] has left #launchpad []
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: Fix checkwatches.py, take 2: s/logger/log and other randomness, r=stub (patch-2177: christian.reis@canonical.com)02:22
=== Virtuall [~virtuall@who.is.virtuall.info] has joined #launchpad
=== otep [~otep@AP-203.167.31.177.sysads.com] has joined #launchpad
=== _otep [~otep@AP-203.167.31.177.sysads.com] has joined #launchpad
=== carlos [~carlos@243.Red-83-47-24.pooles.rima-tde.net] has joined #launchpad
carlosmorning10:40
elmook, wiki migrated - until DNS propogates (30 mins or so), an editable copy is reachable via https://wiki2.launchpad.canonical.com/ (NB: https till DNS propogates)10:49
elmothe old one is uneditable, so don't worry about editing the wrong one10:49
carloselmo, what changes with that migration?10:50
elmooh, y'all have to use your launchpad login now10:50
elmocarlos: I've no idea, I just got "MOIN 1.3 NOW. SCHNELLE, SCHNELLE, BITTE" orders from brazil10:50
carlosok, so it's a version update10:51
carlos+ launchpad integration10:51
jordihello10:51
carlosjordi, !10:52
carlosjordi, tonight acs, Kal, xavi de blast and Ismael will be in my house having dinner, do you want to come?10:52
jordicarlos: I can't, I have another one :(10:59
carlosok10:59
=== carlos out
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial]  Improve descriptions in registry interfaces (patch-2178: morgan.collett@canonical.com)11:36
=== Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad
=== Virtuall [~virtuall@who.is.virtuall.info] has joined #launchpad
=== JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad
=== morgs [~morgan@wblv-146-245-52.telkomadsl.co.za] has left #launchpad []
=== jamesh [~james@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== Keybuk [~scott@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== SteveA [~steve@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== mpt [~mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== salgado [~salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
kikoahoy01:55
Kinnisonahoyhoy kiko01:56
kikothe pillowman01:56
=== debonzi [~debonzi@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad
=== carlos [~carlos@243.Red-83-47-24.pooles.rima-tde.net] has joined #launchpad
=== stub [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== camilotelles [~Camilo@201.32.192.121] has joined #launchpad
carlosSteveA, hi, around?02:17
SteveAhi carlos 02:54
SteveAi'm around02:54
carlosSteveA, launchpad.Append does not exists 02:55
carlosalso, https://launchpad.ubuntu.com/malone/bugs/1564 -> a bug I think it's related with the sqlobject garbage collector, that bug is a bit critical for Rosetta02:56
dafcarlos: have you tried using row.expire()?02:57
carlosdaf, no, I didn't 02:58
carlosthe problem is that I need to change it, commit and ask stub to run it02:58
SteveAcarlos: I said:02:58
SteveA  Add a launchpad.Append permission to permissions.zcml.  Make this02:58
SteveApermission be used for the +addpotemplate form.02:58
carlosdaf, anyway, it's still a bug02:58
SteveA02:58
carlosoh, ok, I missed that part02:58
carlosSteveA, thank you02:58
=== SteveA looks at 1564
=== Kinnison cringes. Mark said "Multiple inheritance of seeds"
Kinnisonfortunately he then ran off03:02
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl]  Tighten comment spacing in bug report pages (patch-2179: mpt@canonical.com)03:16
SteveAcarlos: hello03:19
SteveAcarlos: stub and i have been looking at the memory issues when running that script03:19
SteveAcarlos: stu will try another run of it in an hour or so03:20
carlosok03:23
carlosSteveA, is it related to the way I implemented it?03:23
carlosor it's a problem with sqlobject?03:23
SteveAyou're doing a commit every so often03:23
SteveAthe caches should be cleared out on a commit03:23
carlosonce per row03:23
SteveAalthough, you may need to explicitly del and run gc some things.  we'll see how the next run goes.03:23
SteveArunning one commit per row may end up being very slow, but it's a good enough start.03:24
SteveAholding onto objects across a commit is a bit dodgy03:24
SteveAso, you should probably get a list of ids03:24
SteveAand then for each id, get the object of that id, do the work, commit03:24
SteveAthat avoids the problem of hanging onto objects across a commit03:25
carlosSteveA, ok, will take into account it for the next script of that kind I develop03:32
SteveAplease rewrite this one03:32
carlosin case next run works....03:32
SteveAto use a list of ids03:32
SteveAeven if it works, it will be a source of bugs03:32
SteveAbecause we shouldn't be holding onto objects across a commit03:32
carlosSteveA, once it's executed the script will not be needed anymore03:32
SteveAalso, stub says that the latest sqlobject fixes don't fix it03:32
carlosit's a migration script03:32
SteveA1. if it will remain in RF, it needs to be right.  2. it still doesn't work.03:33
carlosok03:33
SteveAfor point 1, other people will be using it as an example of how to write this kind of code.03:33
carlosSteveA, If it will stay in RF after the migration is done, we should find a better place to store those kind of scripts than the pending db directory03:34
SteveAok03:34
dafsee also database/schema/pending/daf-migrate-pre-po-template-rawfile-2.py03:35
carlosok03:38
daf(it's been there for months and months)03:40
carlosdaf, anyway the amount of potemplates and pofiles is lower than the amount of potranslations03:43
carlosdaf, so perhaps you don't have the memory problem because that03:43
dafsure03:43
dafI was just pointing it out as another example of a Python data migration script03:44
dafwe were having problems with the query to get PO files pending import running out of memory03:44
dafyou remember?03:44
carlosdaf, but that was because the attachments being huge, right?03:47
dafyes03:47
dafthat script had that problem03:48
dafbecause it needed to get all the attachments03:48
dafand put them in the Librarian03:48
=== stu1 [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad
=== carlos -> lunch
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl]  Tighten comment spacing in bug report pages (take 2) (patch-2180)04:10
=== lamont__ [~lamont@15.238.5.126] has joined #launchpad
mdkewhat infrastructure does launchpad use for authentication? is there any information about it anywhere that I can have a look at?04:46
dafinfrastructure?04:46
mdkei've found a page on the wiki... it refers to ZODB04:47
mdkethat is where the account information is stored i guess?04:48
dafno04:48
dafaccount information is stored in Postgres04:48
dafthe ZODB is used for session information04:48
mdkeok...04:49
mdkei don't know what either of them are anyhow :)04:50
=== ddaa [~ddaa@ordo.xlii.org] has joined #launchpad
bob2ZODB = Z Object database04:50
bob2which i a python object persistence deal04:50
dafyep04:51
dafwhereas Postgres is a relational database04:51
mdkeso the authentication server is the latter?04:51
dafit's a bit more complicated than that04:52
mdkedamn04:52
dafthere is a daemon called the authserver04:52
=== jamesh [~james@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== kiko [~kiko@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== debonzi [~debonzi@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
dafwhen somebody logs in to Launchpad, it asks the authserver if the account is valid04:53
=== salgado [~salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
dafthe authserver looks in Postgres04:53
=== mpt [~mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
dafLaunchpad uses the ZODB to keep track of which users are logged in04:53
mdkeok04:53
mdkeso on something like www.ubuntu.com, ZODB isn't used at all, only the authserver04:53
dafother things like wikis use the authserver for authentication04:53
bob2why doesn't LP hit the db itself?04:54
dafbob2: so that authentication code for all our services is in one place, I'd imagine04:54
mdkedaf, is the authserver like an ldap server?04:54
=== stub [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
dafmdke: I'm not sure how one does authenticatoin with LDAP, so I can't say04:54
mdkeah ok04:55
dafI don't think www.ubuntu.com uses the ZODB, no04:55
mdkeso in theory, anything can use the auth server?04:55
mdkeif for example ubuntuforums wanted to unify their login, they could do it?04:55
dafhmm04:57
dafgood question04:57
dafin principle, yes04:57
ddaagraaaagrl... recent update broken my firefox :(04:57
dafthere may be some problems with the authserver being firewalled off04:57
bob2ddaa: I need to ask you about pybaz and debian at some point04:58
bob2ie is the public version api-stable enough04:58
mdkedaf, sure, but in principle yes.04:58
ddaabob2: hehe04:58
mdkedaf, is there anything I can read on how the authserver works?04:58
ddaaFYI. the public version == the canonical version, I merge into rocketfuel from the ddaa.net devo branch04:58
bob2I'd hope that wouldn't expose any account data to whoever ran ubuntuforums04:59
bob2ddaa: ah, cool04:59
ddaaStability wise...04:59
dafmdke: dunno04:59
ddaawell... it's not really clear... There are some big changes right now because archive registration is being phased out of baz04:59
dafmdke: it's spiv who wrote it04:59
mdkedaf, i'll search around on the wiki04:59
ddaaI mean, "registered names" are being phased out05:00
bob2ah, right05:00
dafit's a fairly simple thing that uses Twisted, as far as I know05:00
=== Keybuk [~scott@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
ddaaBut generally, lack of time to work on it, and generally lack of future for all this code base means I just do not have the time to fix the broken API, so it's likely as stable as it will ever be.05:01
ddaa(though I hope to remove all the deprecated stuff soon)05:01
ddaaWhen I'm reasonably satisfied of pybaz, I release it on ddaa.net05:01
bob2is deprecated stuff marked with warnings?05:01
mdkedaf, thanks for your help :D05:02
ddaabob2: yes it is05:02
dafmdke: no worries05:02
bob2rock05:02
carloshmm05:02
carloslifeless, did you changed "baz diff" recently?05:02
carloslifeless, https://chinstrap.ubuntu.com/~dsilvers/paste/fileiZSVkG.html05:03
jameshcarlos: s/launchpa--devel--0/launchpad--devel--0/ ?05:05
carlosyeah, I just saw it05:05
carlosjamesh, thanks anyway05:05
ddaabob2: I have learn a thing with pybaz...05:05
carlosbtw, bazaar error messages are a bit cryptic, aren't they?05:05
ddaaWhen you have an API that is broken in a way that cannot be fixed with a deprecation path (e.g. WorkingTree deriving from str), just fix it NOW.05:06
ddaabecause you'd rather have such a fix behind you than in front of you...05:07
bob2haha05:10
bob2yeah05:10
jblackMorning guys05:29
carlosjblack, morning05:29
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl]  Tighten comment spacing in bug report pages (take 3) (patch-2181)05:38
jblackddaa: I took a look at your docs yesterday. What about % of the api did you deprecate? 05:38
ddaamh... I guess about 20%... certainly more if you weight by use...05:40
jblackHeh. Yeah. Looks to me like I'm about 80% affected. =) 05:40
jblackYou're getting rid of the lists. What should I be using instead? (The deprecations don't say what they're deprecated by) 05:40
ddaaYeah, the bits that were deprecated tend to be frequently used in client code.05:41
ddaasorry, but providing lists of that can be _long_, take a long time to produce due to network delays, and that are mutable by changes outside of the system, was very much a bad idea.05:42
jblackI know you think very carefully about how your choices affect people, so I know that you had good reasons. 05:43
jblackSo I'm looking at it from the perspective of how to get this code back in line with the direction you're moving. 05:44
ddaaI think the ChangeLog should give you the patterns you need to grep for.05:44
jblackFor categories, branches and versions, there's NameIterables. What's the archive equivilant? 05:45
ddaaHu?05:45
ddaaNameIterables?05:45
jblackCategoryIterable, BranchIterable, VersionIterable05:45
ddaaExposing this stuff was sooo crackful... it's all about reducing duplication of code and making pychecker happy...05:46
ddaaArchive equivalent: "arch.archives()" -> "pybaz.iter_archives()"05:46
ddaathat's one of those ones where the renaming does not really make sense by itself, only for consistence with other changes.05:47
jblackAha. Here it is. (Finally found the archive summary) 05:47
jblackpardon, the function summary05:47
jblack I should be fine now. 05:49
=== andandare [~joju@DWM-87-139.go.retevision.es] has joined #launchpad
ddaalifeless: looks like that old bug with missing branch name06:03
=== BjornT [~bjorn@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
ddaa  File "/home/importd/dists/launchpad/lib/CVS/CacheGenerator.py", line 92, in cleanUpDefaultFillers06:04
ddaa     endFileRev = self.findLastFileRevision(rev.branch, rev.filename)06:04
ddaa   File "/home/importd/dists/launchpad/lib/CVS/CacheGenerator.py", line 124, in findLastFileRevision06:04
ddaa     return self.fileInChangeset(self._catalog.getBranch(branchName).getChangesetList()[-1] , fileName)06:04
ddaa IndexError: list index out of range06:04
ddaaWould take me _days_ to figure out how to fix it.06:04
=== ddaa goes out to confirm the hunch with a debug run
=== SteveA [~steve@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
lifelessddaa: try nuking all state and resetting it back to enabled, nbot syncing. I bet it will come good.06:06
lifelessddaa: I won't be able to look at it for 3-4 weeks :[06:06
ddaamh... has not been published... should be legal to do that...06:06
jblackbleh.06:12
carloslifeless, jblack, ddaa:  https://chinstrap.ubuntu.com/~dsilvers/paste/filesWFX6W.html06:19
kiko-fudsalgado, BjornT: http://www.squarefree.com/bugkarma/bugkarma.html06:20
ddaamh... IIRC, that one looks like a different failure06:28
carloslifeless, ddaa jblack any suggestion to be able to commit? I'm blocked on that problem with bazaar06:30
ddaacarlos: try using 1.4.N06:31
ddaa(where N is the latest release, whatever it is ATM)06:31
ddaalooks like the kind of resource-handling issues that are bound to pop up with the changes lifeless is doing in 1.5. Extra point for making it reproducible.06:32
carlosddaa, I can give you my current tree06:34
carlosddaa, ok, I will revert to hoary's bazaar06:35
lifelesscarlos: what is the error ? 06:35
ddaahttps://chinstrap.ubuntu.com/~dsilvers/paste/filesWFX6W.html06:35
lifelesscarlos: I'm at the end of a long thin pipe, web pages DoNotHelp06:35
ddaacarlos: current tree would certainly help06:35
carloslifeless, /pqm/build_dir/thelove@canonical.com/thelove@canonical.com---hackerlab--devo--1.5/src/hackerlab/vu/vfdbuf.c:1681:botched invariant06:37
carlos    avail >= count06:37
carlosbaz: uncaught exception: -1:(exiting on botched invariant)06:37
carlos  please report this as a bug to bazaar@lists.canonical.com06:37
carloslifeless, I get that with a commit06:37
ddaajust after the changeset generation06:37
carlosddaa, ok, I suppose a tar.gz would be enough, right?06:37
lifelesscarlos: thanks. That is new and interesting :[06:37
ddaacarlos: bz2 preferred, considered the size of a launchpad tree nowadays06:38
lifelesscarlos: I'm fixing now, rollback a few baz's to get it fixed in the interim06:38
lifelesscarlos: no need to send the tree around06:38
carlosok06:39
lifelessfixed, testing06:41
carlosis it too bad if I go back to 1.2?06:42
carlosit's the version available with hoary06:42
=== Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad
dilysMerge to rocketfuel@canonical.com/launchpad--devel--0: [trivial]  Fixed the permissions for the addpotemplate form + test r=Steve (it's not really a review but implemented the way he asked) (patch-2182: carlos.perello@canonical.com)06:43
carlosstub, lifeless could you cherrypick that patch? ^^^06:44
lifelesscarlos: fixed, uploading06:47
=== Seveas [~seveas@seveas.demon.nl] has joined #launchpad
=== cprov [~cprov@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
carloslifeless, cool, thanks06:57
=== sabdfl [~mark@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
lifelesssprint guys : kiko, me, stevea and mark are in a meeting for the next 60 minutes odd - please take care of yourselves/next break etc.07:04
lifelessKinnison: ^^07:04
SteveAwell, i was going to announce it in 5 mins07:05
dilysNew Malone bug 1597 filed on Bazaar by David Allouche: baz switch to fail with unrelated revision07:08
dilyshttps://launchpad.ubuntu.com/malone/bugs/159707:08
kiko-fudddaa!07:10
ddaakiko-fud: ?07:10
kiko-fudI didn't get a chance to say bye, how was your trip home?07:11
ddaaunexpectedly lengthy (as I lost my password on the bus to Sao Paulo) but otherwise reasonably pleasant (as Varig changed my ticket for free for the day after, and I got a business class seat).07:12
kiko-fudddaa, password?07:13
ddaahu... passport07:13
ddaasame difference :)07:13
kiko-fudyou're joking?07:13
ddaano, I'm not07:13
ddaaIt was reasonably easy to get a right-of-the-way at the french consulate, and a helpful .br policeman at the airport put me on the track.07:14
kiko-fudwhere did you sleep?07:17
ddaaNH hotel near the consulate, they had a week-end price (about R$150)07:18
lifelessthats like 2francs right ?07:18
ddaaI'll try to expense it though07:18
ddaalifeless: no, that's more like 300FF07:19
ddaaor 60 eurs07:19
ddaaI could have found cheaper, but I decided it was too much to ask at midnight, with my luggage, in a foreign country whose language I do not speak :)07:21
lifelessyah07:22
lifelessshould be expensable I think07:22
jblacklifeless: porting to pybaz looks easy enough. Got reminded in a bad way that elmo hasn't fixed pydavlib.07:26
dilysMerge to thelove@canonical.com/dists--bazaar--1.5: new build (patch-57)07:29
dilysMerge to thelove@canonical.com/hackerlab--devo--1.5: unbreak vfd buffers where a write is smaller than the current buffer size increase (patch-12: robert.collins@canonical.com)07:29
lifelesscarlos: ^^ the fix.07:33
carloslifeless, thanks!07:33
ddaalifeless: cannot run importd locally... looks like your "reconnection" hack broke something.07:46
ddaahaha...07:46
lifelessddaa - /my/ reconnection hack ?07:47
ddaaMust be the removal of implicit begin...07:47
lifelessoh, db reconnection.07:47
lifelesscommand line runner you mean ?07:47
ddaanah buildbot... but actually it's not your hack07:47
ddaawell, it's the "spiv who is reviewing this suggested this XXX abstraction violation. RBC 20050608"07:48
=== ddaa sets implicitBegin=True
ddaayeah, working now07:50
lifelessdo not be doing that in production07:50
lifelessI'd like to know why its not working locally for you07:50
ddaathat's because it's doing txn.abort() before the first txn.begin() in jobsFromDB when the service was not setup (i.e. pristine tap).07:51
ddaamh... probably the sqlos reconnection broke the assuption that SQLBase._connection was not None when no transaction was begun.07:54
dilysMerge to rocketfuel@canonical.com/launchpad--production--1.26: Cherry pick patch-2177 into production (patch-4: rocketfuel@canonical.com, christian.reis@canonical.com)07:54
lifelessjobsFromDB should do what hte test I did does and check for a transaction then08:00
ddaalifeless: the issue is almost certainly the fact that production launchpad is based on 1.22, then08:01
ddaaI'm being called08:02
ddaaI'll look into upgrading importd's launchpad soon.08:03
=== ddaa -> dinner
KinnisonCan the launchpad webapp launch a long-running process to run in the background?08:05
SteveAum08:06
SteveAsounds yucky08:06
KinnisonI want to trigger a germinate run on a web request, but not hold the request until the germinate completes08:06
KinnisonIt could be a thread, I don't mind that08:06
SteveAwe need to talk about this08:06
SteveAthere are many complexities here08:07
Kinnisonokay08:07
lifelessrosettas export process is a good example of a resasonable approach08:07
SteveAfor example, we'll have many server machines with many launchpad webapp servers on them08:07
SteveAideally, you'd use the database to signal to the germinate box08:07
SteveAthe database is our central point of coordination08:08
lifelessi think there is a clear line to these things - either they are near-instant or they get queued and processed asynchronsouly08:08
KinnisonOkay, so I have to queue them? Hmm08:08
KinnisonThat's fine08:08
SteveAokay08:08
SteveAif you need it more responsive, we can do something about that.  but i'd rather not.08:08
Kinnisonnaah, a cronscript will be fine08:09
SteveAgood08:09
dilysMerge to rocketfuel@canonical.com/launchpad--production--1.26: Cherry pick patch-2182 into production (patch-5: carlos.perello@canonical.com, rocketfuel@canonical.com)08:22
carlosstub, lifeless thanks08:23
=== elmo_ [~james@83-216-156-21.jamest747.adsl.metronet.co.uk] has joined #launchpad
carlosmpt, ping08:58
=== camilotelles [~Camilo@201.32.192.121] has joined #launchpad
=== Burgundavia [~corey@S0106000000cc07fc.gv.shawcable.net] has joined #launchpad
=== SnakeBite [~SnakeBite@84.242.143.64] has joined #launchpad
carlosKinnison, hi, around?10:00
=== Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!