[12:16] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial] PackageVersionVerification (patch-2174) [12:36] New Malone bug 1591 filed on Bazaar by Matthieu Moy: baz rm non-existant-file should give a clean error message. [12:36] https://launchpad.ubuntu.com/malone/bugs/1591 === Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad [12:42] Merge to rocketfuel@canonical.com/launchpad--devel--0: Add Soyuz legalese. r=sabdfl (patch-2175: daniel.silverstone@canonical.com) [01:09] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial] fixes to various page titles (patch-2176: mpt@canonical.com) === sabdfl [~mark@sabdfl.silver.supporter.pdpc] has left #launchpad [] === Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad === sabdf1 [~mark@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === sabdf1 [~mark@200-171-140-32.dsl.telesp.net.br] has left #launchpad [] [02:22] Merge to rocketfuel@canonical.com/launchpad--devel--0: Fix checkwatches.py, take 2: s/logger/log and other randomness, r=stub (patch-2177: christian.reis@canonical.com) === Virtuall [~virtuall@who.is.virtuall.info] has joined #launchpad === otep [~otep@AP-203.167.31.177.sysads.com] has joined #launchpad === _otep [~otep@AP-203.167.31.177.sysads.com] has joined #launchpad === carlos [~carlos@243.Red-83-47-24.pooles.rima-tde.net] has joined #launchpad [10:40] morning [10:49] ok, wiki migrated - until DNS propogates (30 mins or so), an editable copy is reachable via https://wiki2.launchpad.canonical.com/ (NB: https till DNS propogates) [10:49] the old one is uneditable, so don't worry about editing the wrong one [10:50] elmo, what changes with that migration? [10:50] oh, y'all have to use your launchpad login now [10:50] carlos: I've no idea, I just got "MOIN 1.3 NOW. SCHNELLE, SCHNELLE, BITTE" orders from brazil [10:51] ok, so it's a version update [10:51] + launchpad integration [10:51] hello [10:52] jordi, ! [10:52] jordi, tonight acs, Kal, xavi de blast and Ismael will be in my house having dinner, do you want to come? [10:59] carlos: I can't, I have another one :( [10:59] ok === carlos out [11:36] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial] Improve descriptions in registry interfaces (patch-2178: morgan.collett@canonical.com) === Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad === Virtuall [~virtuall@who.is.virtuall.info] has joined #launchpad === JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad === morgs [~morgan@wblv-146-245-52.telkomadsl.co.za] has left #launchpad [] === jamesh [~james@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === Keybuk [~scott@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === SteveA [~steve@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === mpt [~mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === salgado [~salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [01:55] ahoy [01:56] ahoyhoy kiko [01:56] the pillowman === debonzi [~debonzi@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad === carlos [~carlos@243.Red-83-47-24.pooles.rima-tde.net] has joined #launchpad === stub [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === camilotelles [~Camilo@201.32.192.121] has joined #launchpad [02:17] SteveA, hi, around? [02:54] hi carlos [02:54] i'm around [02:55] SteveA, launchpad.Append does not exists [02:56] also, https://launchpad.ubuntu.com/malone/bugs/1564 -> a bug I think it's related with the sqlobject garbage collector, that bug is a bit critical for Rosetta [02:57] carlos: have you tried using row.expire()? [02:58] daf, no, I didn't [02:58] the problem is that I need to change it, commit and ask stub to run it [02:58] carlos: I said: [02:58] Add a launchpad.Append permission to permissions.zcml. Make this [02:58] permission be used for the +addpotemplate form. [02:58] daf, anyway, it's still a bug [02:58] [02:58] oh, ok, I missed that part [02:58] SteveA, thank you === SteveA looks at 1564 === Kinnison cringes. Mark said "Multiple inheritance of seeds" [03:02] fortunately he then ran off [03:16] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl] Tighten comment spacing in bug report pages (patch-2179: mpt@canonical.com) [03:19] carlos: hello [03:19] carlos: stub and i have been looking at the memory issues when running that script [03:20] carlos: stu will try another run of it in an hour or so [03:23] ok [03:23] SteveA, is it related to the way I implemented it? [03:23] or it's a problem with sqlobject? [03:23] you're doing a commit every so often [03:23] the caches should be cleared out on a commit [03:23] once per row [03:23] although, you may need to explicitly del and run gc some things. we'll see how the next run goes. [03:24] running one commit per row may end up being very slow, but it's a good enough start. [03:24] holding onto objects across a commit is a bit dodgy [03:24] so, you should probably get a list of ids [03:24] and then for each id, get the object of that id, do the work, commit [03:25] that avoids the problem of hanging onto objects across a commit [03:32] SteveA, ok, will take into account it for the next script of that kind I develop [03:32] please rewrite this one [03:32] in case next run works.... [03:32] to use a list of ids [03:32] even if it works, it will be a source of bugs [03:32] because we shouldn't be holding onto objects across a commit [03:32] SteveA, once it's executed the script will not be needed anymore [03:32] also, stub says that the latest sqlobject fixes don't fix it [03:32] it's a migration script [03:33] 1. if it will remain in RF, it needs to be right. 2. it still doesn't work. [03:33] ok [03:33] for point 1, other people will be using it as an example of how to write this kind of code. [03:34] SteveA, If it will stay in RF after the migration is done, we should find a better place to store those kind of scripts than the pending db directory [03:34] ok [03:35] see also database/schema/pending/daf-migrate-pre-po-template-rawfile-2.py [03:38] ok [03:40] (it's been there for months and months) [03:43] daf, anyway the amount of potemplates and pofiles is lower than the amount of potranslations [03:43] daf, so perhaps you don't have the memory problem because that [03:43] sure [03:44] I was just pointing it out as another example of a Python data migration script [03:44] we were having problems with the query to get PO files pending import running out of memory [03:44] you remember? [03:47] daf, but that was because the attachments being huge, right? [03:47] yes [03:48] that script had that problem [03:48] because it needed to get all the attachments [03:48] and put them in the Librarian === stu1 [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === JanC [~janc@dD5764BEC.access.telenet.be] has joined #launchpad === carlos -> lunch [04:10] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl] Tighten comment spacing in bug report pages (take 2) (patch-2180) === lamont__ [~lamont@15.238.5.126] has joined #launchpad [04:46] what infrastructure does launchpad use for authentication? is there any information about it anywhere that I can have a look at? [04:46] infrastructure? [04:47] i've found a page on the wiki... it refers to ZODB [04:48] that is where the account information is stored i guess? [04:48] no [04:48] account information is stored in Postgres [04:48] the ZODB is used for session information [04:49] ok... [04:50] i don't know what either of them are anyhow :) === ddaa [~ddaa@ordo.xlii.org] has joined #launchpad [04:50] ZODB = Z Object database [04:50] which i a python object persistence deal [04:51] yep [04:51] whereas Postgres is a relational database [04:51] so the authentication server is the latter? [04:52] it's a bit more complicated than that [04:52] damn [04:52] there is a daemon called the authserver === jamesh [~james@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === kiko [~kiko@200-171-140-32.dsl.telesp.net.br] has joined #launchpad === debonzi [~debonzi@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [04:53] when somebody logs in to Launchpad, it asks the authserver if the account is valid === salgado [~salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [04:53] the authserver looks in Postgres === mpt [~mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [04:53] Launchpad uses the ZODB to keep track of which users are logged in [04:53] ok [04:53] so on something like www.ubuntu.com, ZODB isn't used at all, only the authserver [04:53] other things like wikis use the authserver for authentication [04:54] why doesn't LP hit the db itself? [04:54] bob2: so that authentication code for all our services is in one place, I'd imagine [04:54] daf, is the authserver like an ldap server? === stub [~stub@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [04:54] mdke: I'm not sure how one does authenticatoin with LDAP, so I can't say [04:55] ah ok [04:55] I don't think www.ubuntu.com uses the ZODB, no [04:55] so in theory, anything can use the auth server? [04:55] if for example ubuntuforums wanted to unify their login, they could do it? [04:57] hmm [04:57] good question [04:57] in principle, yes [04:57] graaaagrl... recent update broken my firefox :( [04:57] there may be some problems with the authserver being firewalled off [04:58] ddaa: I need to ask you about pybaz and debian at some point [04:58] ie is the public version api-stable enough [04:58] daf, sure, but in principle yes. [04:58] bob2: hehe [04:58] daf, is there anything I can read on how the authserver works? [04:58] FYI. the public version == the canonical version, I merge into rocketfuel from the ddaa.net devo branch [04:59] I'd hope that wouldn't expose any account data to whoever ran ubuntuforums [04:59] ddaa: ah, cool [04:59] Stability wise... [04:59] mdke: dunno [04:59] well... it's not really clear... There are some big changes right now because archive registration is being phased out of baz [04:59] mdke: it's spiv who wrote it [04:59] daf, i'll search around on the wiki [05:00] I mean, "registered names" are being phased out [05:00] ah, right [05:00] it's a fairly simple thing that uses Twisted, as far as I know === Keybuk [~scott@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [05:01] But generally, lack of time to work on it, and generally lack of future for all this code base means I just do not have the time to fix the broken API, so it's likely as stable as it will ever be. [05:01] (though I hope to remove all the deprecated stuff soon) [05:01] When I'm reasonably satisfied of pybaz, I release it on ddaa.net [05:01] is deprecated stuff marked with warnings? [05:02] daf, thanks for your help :D [05:02] bob2: yes it is [05:02] mdke: no worries [05:02] rock [05:02] hmm [05:02] lifeless, did you changed "baz diff" recently? [05:03] lifeless, https://chinstrap.ubuntu.com/~dsilvers/paste/fileiZSVkG.html [05:05] carlos: s/launchpa--devel--0/launchpad--devel--0/ ? [05:05] yeah, I just saw it [05:05] jamesh, thanks anyway [05:05] bob2: I have learn a thing with pybaz... [05:05] btw, bazaar error messages are a bit cryptic, aren't they? [05:06] When you have an API that is broken in a way that cannot be fixed with a deprecation path (e.g. WorkingTree deriving from str), just fix it NOW. [05:07] because you'd rather have such a fix behind you than in front of you... [05:10] haha [05:10] yeah [05:29] Morning guys [05:29] jblack, morning [05:38] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial, rs=sabdfl] Tighten comment spacing in bug report pages (take 3) (patch-2181) [05:38] ddaa: I took a look at your docs yesterday. What about % of the api did you deprecate? [05:40] mh... I guess about 20%... certainly more if you weight by use... [05:40] Heh. Yeah. Looks to me like I'm about 80% affected. =) [05:40] You're getting rid of the lists. What should I be using instead? (The deprecations don't say what they're deprecated by) [05:41] Yeah, the bits that were deprecated tend to be frequently used in client code. [05:42] sorry, but providing lists of that can be _long_, take a long time to produce due to network delays, and that are mutable by changes outside of the system, was very much a bad idea. [05:43] I know you think very carefully about how your choices affect people, so I know that you had good reasons. [05:44] So I'm looking at it from the perspective of how to get this code back in line with the direction you're moving. [05:44] I think the ChangeLog should give you the patterns you need to grep for. [05:45] For categories, branches and versions, there's NameIterables. What's the archive equivilant? [05:45] Hu? [05:45] NameIterables? [05:45] CategoryIterable, BranchIterable, VersionIterable [05:46] Exposing this stuff was sooo crackful... it's all about reducing duplication of code and making pychecker happy... [05:46] Archive equivalent: "arch.archives()" -> "pybaz.iter_archives()" [05:47] that's one of those ones where the renaming does not really make sense by itself, only for consistence with other changes. [05:47] Aha. Here it is. (Finally found the archive summary) [05:47] pardon, the function summary [05:49] I should be fine now. === andandare [~joju@DWM-87-139.go.retevision.es] has joined #launchpad [06:03] lifeless: looks like that old bug with missing branch name === BjornT [~bjorn@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [06:04] File "/home/importd/dists/launchpad/lib/CVS/CacheGenerator.py", line 92, in cleanUpDefaultFillers [06:04] endFileRev = self.findLastFileRevision(rev.branch, rev.filename) [06:04] File "/home/importd/dists/launchpad/lib/CVS/CacheGenerator.py", line 124, in findLastFileRevision [06:04] return self.fileInChangeset(self._catalog.getBranch(branchName).getChangesetList()[-1] , fileName) [06:04] IndexError: list index out of range [06:04] Would take me _days_ to figure out how to fix it. === ddaa goes out to confirm the hunch with a debug run === SteveA [~steve@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [06:06] ddaa: try nuking all state and resetting it back to enabled, nbot syncing. I bet it will come good. [06:06] ddaa: I won't be able to look at it for 3-4 weeks :[ [06:06] mh... has not been published... should be legal to do that... [06:12] bleh. [06:19] lifeless, jblack, ddaa: https://chinstrap.ubuntu.com/~dsilvers/paste/filesWFX6W.html [06:20] salgado, BjornT: http://www.squarefree.com/bugkarma/bugkarma.html [06:28] mh... IIRC, that one looks like a different failure [06:30] lifeless, ddaa jblack any suggestion to be able to commit? I'm blocked on that problem with bazaar [06:31] carlos: try using 1.4.N [06:31] (where N is the latest release, whatever it is ATM) [06:32] looks like the kind of resource-handling issues that are bound to pop up with the changes lifeless is doing in 1.5. Extra point for making it reproducible. [06:34] ddaa, I can give you my current tree [06:35] ddaa, ok, I will revert to hoary's bazaar [06:35] carlos: what is the error ? [06:35] https://chinstrap.ubuntu.com/~dsilvers/paste/filesWFX6W.html [06:35] carlos: I'm at the end of a long thin pipe, web pages DoNotHelp [06:35] carlos: current tree would certainly help [06:37] lifeless, /pqm/build_dir/thelove@canonical.com/thelove@canonical.com---hackerlab--devo--1.5/src/hackerlab/vu/vfdbuf.c:1681:botched invariant [06:37] avail >= count [06:37] baz: uncaught exception: -1:(exiting on botched invariant) [06:37] please report this as a bug to bazaar@lists.canonical.com [06:37] lifeless, I get that with a commit [06:37] just after the changeset generation [06:37] ddaa, ok, I suppose a tar.gz would be enough, right? [06:37] carlos: thanks. That is new and interesting :[ [06:38] carlos: bz2 preferred, considered the size of a launchpad tree nowadays [06:38] carlos: I'm fixing now, rollback a few baz's to get it fixed in the interim [06:38] carlos: no need to send the tree around [06:39] ok [06:41] fixed, testing [06:42] is it too bad if I go back to 1.2? [06:42] it's the version available with hoary === Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad [06:43] Merge to rocketfuel@canonical.com/launchpad--devel--0: [trivial] Fixed the permissions for the addpotemplate form + test r=Steve (it's not really a review but implemented the way he asked) (patch-2182: carlos.perello@canonical.com) [06:44] stub, lifeless could you cherrypick that patch? ^^^ [06:47] carlos: fixed, uploading === Seveas [~seveas@seveas.demon.nl] has joined #launchpad === cprov [~cprov@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [06:57] lifeless, cool, thanks === sabdfl [~mark@200-171-140-32.dsl.telesp.net.br] has joined #launchpad [07:04] sprint guys : kiko, me, stevea and mark are in a meeting for the next 60 minutes odd - please take care of yourselves/next break etc. [07:04] Kinnison: ^^ [07:05] well, i was going to announce it in 5 mins [07:08] New Malone bug 1597 filed on Bazaar by David Allouche: baz switch to fail with unrelated revision [07:08] https://launchpad.ubuntu.com/malone/bugs/1597 [07:10] ddaa! [07:10] kiko-fud: ? [07:11] I didn't get a chance to say bye, how was your trip home? [07:12] unexpectedly lengthy (as I lost my password on the bus to Sao Paulo) but otherwise reasonably pleasant (as Varig changed my ticket for free for the day after, and I got a business class seat). [07:13] ddaa, password? [07:13] hu... passport [07:13] same difference :) [07:13] you're joking? [07:13] no, I'm not [07:14] It was reasonably easy to get a right-of-the-way at the french consulate, and a helpful .br policeman at the airport put me on the track. [07:17] where did you sleep? [07:18] NH hotel near the consulate, they had a week-end price (about R$150) [07:18] thats like 2francs right ? [07:18] I'll try to expense it though [07:19] lifeless: no, that's more like 300FF [07:19] or 60 eurs [07:21] I could have found cheaper, but I decided it was too much to ask at midnight, with my luggage, in a foreign country whose language I do not speak :) [07:22] yah [07:22] should be expensable I think [07:26] lifeless: porting to pybaz looks easy enough. Got reminded in a bad way that elmo hasn't fixed pydavlib. [07:29] Merge to thelove@canonical.com/dists--bazaar--1.5: new build (patch-57) [07:29] Merge to thelove@canonical.com/hackerlab--devo--1.5: unbreak vfd buffers where a write is smaller than the current buffer size increase (patch-12: robert.collins@canonical.com) [07:33] carlos: ^^ the fix. [07:33] lifeless, thanks! [07:46] lifeless: cannot run importd locally... looks like your "reconnection" hack broke something. [07:46] haha... [07:47] ddaa - /my/ reconnection hack ? [07:47] Must be the removal of implicit begin... [07:47] oh, db reconnection. [07:47] command line runner you mean ? [07:47] nah buildbot... but actually it's not your hack [07:48] well, it's the "spiv who is reviewing this suggested this XXX abstraction violation. RBC 20050608" === ddaa sets implicitBegin=True [07:50] yeah, working now [07:50] do not be doing that in production [07:50] I'd like to know why its not working locally for you [07:51] that's because it's doing txn.abort() before the first txn.begin() in jobsFromDB when the service was not setup (i.e. pristine tap). [07:54] mh... probably the sqlos reconnection broke the assuption that SQLBase._connection was not None when no transaction was begun. [07:54] Merge to rocketfuel@canonical.com/launchpad--production--1.26: Cherry pick patch-2177 into production (patch-4: rocketfuel@canonical.com, christian.reis@canonical.com) [08:00] jobsFromDB should do what hte test I did does and check for a transaction then [08:01] lifeless: the issue is almost certainly the fact that production launchpad is based on 1.22, then [08:02] I'm being called [08:03] I'll look into upgrading importd's launchpad soon. === ddaa -> dinner [08:05] Can the launchpad webapp launch a long-running process to run in the background? [08:06] um [08:06] sounds yucky [08:06] I want to trigger a germinate run on a web request, but not hold the request until the germinate completes [08:06] It could be a thread, I don't mind that [08:06] we need to talk about this [08:07] there are many complexities here [08:07] okay [08:07] rosettas export process is a good example of a resasonable approach [08:07] for example, we'll have many server machines with many launchpad webapp servers on them [08:07] ideally, you'd use the database to signal to the germinate box [08:08] the database is our central point of coordination [08:08] i think there is a clear line to these things - either they are near-instant or they get queued and processed asynchronsouly [08:08] Okay, so I have to queue them? Hmm [08:08] That's fine [08:08] okay [08:08] if you need it more responsive, we can do something about that. but i'd rather not. [08:09] naah, a cronscript will be fine [08:09] good [08:22] Merge to rocketfuel@canonical.com/launchpad--production--1.26: Cherry pick patch-2182 into production (patch-5: carlos.perello@canonical.com, rocketfuel@canonical.com) [08:23] stub, lifeless thanks === elmo_ [~james@83-216-156-21.jamest747.adsl.metronet.co.uk] has joined #launchpad [08:58] mpt, ping === camilotelles [~Camilo@201.32.192.121] has joined #launchpad === Burgundavia [~corey@S0106000000cc07fc.gv.shawcable.net] has joined #launchpad === SnakeBite [~SnakeBite@84.242.143.64] has joined #launchpad [10:00] Kinnison, hi, around? === Mez [~Mez@cpc2-lich4-3-0-cust115.brhm.cable.ntl.com] has joined #launchpad