/srv/irclogs.ubuntu.com/2005/11/02/#launchpad.txt

=== camilotelles [n=Camilo@20132194128.user.veloxzone.com.br] has joined #launchpad
segfaultjordi: pong12:06
lifelessLarstiQ: dunno12:07
LarstiQlifeless: ok, I'll see if I can find some documentation12:09
=== interalia [n=interali@adsl-60-232.swiftdsl.com.au] has joined #launchpad
LarstiQhttps://wiki.launchpad.canonical.com/BranchActivityVisualization is the closest I get to having activity explained12:14
lifelessLarstiQ: yah, but thats not per product :)12:26
=== Virtuall[BZA] [n=virtuall@alpha.bounzza.net] has joined #launchpad
LarstiQlifeless: right, and I also found activity reports on https://wiki.launchpad.canonical.com/LaunchpadTeamFAQ. Completely different, although interesting.12:27
lifeless:)12:27
lifelessyou can see one of those in the bzr list archives12:27
=== Virtuall[BZA] [i=virtuall@alpha.bounzza.net] has joined #launchpad
LarstiQlifeless: yes, I remember that one12:28
LarstiQand Martin's reaction to it ;)12:28
=== LarstiQ is going to give gtimelog a try
=== segfault [i=carlos@prognus.com.br] has joined #launchpad
jordisegfault: we need to talk. There are way too many split files. Maybe we can do something.12:42
=== netjoined: irc.freenode.net -> brown.freenode.net
=== interalia [n=interali@adsl-60-232.swiftdsl.com.au] has joined #launchpad
=== jamesh [n=james@66.103.220.207] has joined #launchpad
segfaultjordi: sure! can you tell me how? :)12:51
carlosjordi, yes, one potemplate can be moved from the +admin page but only by you or any Rosetta admin12:59
=== carlos -> bed
carlosnight!01:01
Kinnisonnight carlos01:01
KinnisonWhat's the right way to flush the sqlobject cache?01:07
Kinnisonand subsequently what's the right way to get python to GC the objects?01:07
KinnisonThis is actually kinda important I think01:08
spivKinnison: flush_database_caches from canonical.database.sqlbase01:10
spivKinnison: Although, can you explain a little more about why you need this?01:11
spivAnd why do you care about when objects are GCed?01:11
Kinnisonspiv: because the domination in the publisher uses ca. 900M *per distrorelease*01:11
Kinnison900M of sodding sqlobjects01:11
Kinnisonhmm, perhaps 600M01:12
KinnisonNo, 90001:12
spivOk.  To get Python to GC objects, just make sure you don't have any references to objects you don't need.01:12
spivAnd don't define __del__ :)01:12
Kinnisonso flushing the db cache should do the trick?01:12
Kinnisonand python will gc merrily from there?01:12
spivPerhaps.01:12
spivDepends on if you have any other references to them :)01:12
Kinnisonwell, I'm not keeping 'em around01:13
Kinnisonif there are cycles what will python do?01:13
spivIt will merrily collect them.01:13
Kinnisongood, I know perl won't01:13
Kinnisonbecause it's shit01:13
spiv*Unless* you have __del__, in which case they'll probably end up in gc.garbage instead.01:13
Kinnisondo sqlobjects have __del__ ?01:13
spivNope.01:14
=== spiv just double-checked.
spivSQLObject does define it on connections iirc, but that shouldn't matter.01:15
spivBtw, how do you know that that 900MB is sqlobjects?01:15
KinnisonWell, I'm assuming it is01:16
spivAh :)01:16
spivYou're probably right.01:16
Kinnisonbecause if it's not, I don't see what it can be01:16
Kinnisonsince the code is essentially01:16
=== LarstiQ [n=larstiq@cust.7.157.adsl.cistron.nl] has joined #launchpad
spivBut just to make sure, take a look at http://twistedmatrix.com/users/spiv/countrefs.py01:16
Kinnisonfor some_sql_object in gigantic_select_result:01:16
Kinnison   do_stuff(some_sql_object)01:16
SteveAspiv: we'd need to totally stop the sqlobject cache from running i think01:17
=== Kinnison kills this 3.4G process
Kinnisonit's too scary01:17
spivSteveA: That may be possible.01:17
spivKinnison: Also, if flushing the cache is inadequate, gc.get_referrers(some_object_I_thought_should_be_gced) may be helpful.01:18
Kinnisonspiv: doesn't that kinda imply keeping a reference to it to check?01:18
spivKinnison: Well, that's the trick ;)01:18
spivKinnison: Either find the object the same way countrefs.py does (by crawling over gc.get_objects()), or keep a weakref to an object you suspect isn't gc'd.01:19
=== Kinnison watches ram usage with these flushes in place
spivYou can force a gc run with gc.collect(), btw, but that's almost certain to make no difference -- by default it runs pretty frequently already.01:20
KinnisonOkay, a distrorelease is actually taking closer to 1.2G01:22
=== Kinnison is gonna have to flush per distroarchrelease
=== Kinnison opens publishing.py
=== Kinnison tries again
Kinnisonb01:27
=== Kinnison tries that in a window where it'll work
NafalloKinnison: tired? :-)01:28
Kinnisonannoyed with sqlobject mostly01:29
Nafallooki01:29
Kinnisontakes it ages to flush its cache and that in itself doesn't appear to have helped a great deal01:29
KinnisonIn fact, regardless of how much sqlobjects there are, it really seems to hammer the cache01:30
KinnisonI.E. taking upwards of 30 CPU seconds to empty a cache of the security pocket's sources01:30
Kinnisonthis is bad01:30
spivKinnison: in theory adding cache=False to the connectionURI for the database should help.01:31
Nafallothat does not sound healthy indeed01:31
Kinnisonspiv: how do I do that?01:31
spivBut that code appears to be buggy.  Hmm.01:31
Kinnisontxn = initZopeless( dbuser='lucille' ) 01:31
spivKinnison: by abusing dbname ;)01:31
spivBut let's not do that.01:31
KinnisonWhy would flushing the cache take so long?01:32
Kinnisonunless it's not really flushing the cache and is just calling .sync() on all the objects in it01:32
Kinnisonargh01:33
Kinnisonthat's exactly what it's doing01:33
Kinnisonuseless01:33
spivKinnison: try "Person._connection.cache.kw['cache']  = False" at the very start of your transaction.01:34
spiv(s/Person/any convenient sqlobject/ if you like)01:35
=== Kinnison tries
KinnisonAttributeError: 'NullCache' object has no attribute 'kw'01:35
spivHah.01:36
Kinnisonvery odd01:38
=== Kinnison tries with _clearCache() being called instead
=== sfeehan [n=sfeehan@pool-64-222-103-115.burl.east.verizon.net] has joined #launchpad
spivKinnison: Hmm.01:43
spivKinnison: If you're seeing a NullCache, you must be doing that too soon.01:43
spivKinnison: Are you using zopeless? with or without implicitBegin?01:44
=== user__ [n=user@66.103.220.208] has joined #launchpad
user__Ahoy01:46
Kinnisonzopeless with01:46
spivKinnison: Odd.   And yet Person._connection is a NullConnection?01:48
Kinnisonspiv: not entirely sure01:50
KinnisonI think .cache was a NullCache01:50
Kinnisoncalling SQLBase.flush_database_updates()01:50
Kinnisonthen SQLBase._clearCache()01:50
Kinnisonthen gc.collect()01:50
Kinnisonkeeps the RAM usage at a steady half-gig01:50
spivWhich is still huge.01:50
Kinnisoninstead of climbing into the 3.5g range01:50
Kinnisoneach gc.collect() is collecting ca 200,000 objects01:51
spivAlso, _clearCache is always called when you start a new transaction.01:51
Kinnisonthis is mid-transaction01:51
spivAh.01:51
KinnisonI already had some txn.commit()s in there01:51
Kinnisonwhich reduced it from >4G==explode to 3.5G==goslow01:51
KinnisonDEBUG:Dominator:Performing domination across hoary/Release (i386)01:52
KinnisonDEBUG:Dominator:Sorting binaries...01:52
KinnisonDEBUG:Dominator:Dominating binaries...01:52
KinnisonDEBUG:Dominator:Flushing SQLObject cache.01:52
KinnisonDEBUG:Dominator:GC.Collect()01:52
KinnisonDEBUG:Dominator:Returned: 24400501:52
Kinnisonyay for sqlobject01:52
spivThe right answer is to set the cache=False on the Cache.01:52
Kinnisonbut that'll make each domination much slower01:52
Kinnisonwon't it?01:52
spivWell, maybe.01:52
spivMaybe not.01:52
spivIt still keeps weakrefs.01:52
spivSo depending on other code, it may still be able to return the objects.01:53
spivAnd how often are your queries returning the same object, anyway?01:53
Kinnisonfoo.bar01:53
spivBut it's very weird that you're getting a NullCache, but that _clearCache works.01:54
spivBecause they're accessing the same attribute.01:54
spivI guess try s/Person/SQLBase/ to narrow it down.01:54
spivHmm, or do an explicit txn.begin(), perhaps...01:55
=== Kinnison is happy to periodically flush the cache
Kinnisonfor now01:56
Kinnisonwe can look at it together in montreal01:56
spivOk.01:58
spivI would like to understand what's going on here.01:58
spivSo I'll corner you in Montreal.01:59
Kinnisoncool02:00
Kinnisonin the meantime, for the first time in days, a publisher run on staging will complete02:00
=== Kinnison bounces
spiv500MB is still huge, though.02:00
=== Kinnison shrugs
spivWe'll figure it out in Montreal... there are a couple too many mysteries here :)02:01
Kinnisonaye02:01
Kinnisonalmost certainly all my fault02:01
=== bradb [n=bradb@modemcable033.209-70-69.mc.videotron.ca] has joined #launchpad
=== asw [n=asw@karuna.med.harvard.edu] has joined #launchpad
=== carlos [n=carlos@gandalf.pemas.net] has joined #launchpad
KinnisonHmm, 11 minutes to do a full publishing run now02:31
Kinnisonmuch better than before02:31
=== Kinnison tries a --careful run
=== stub [i=stub@sweep.bur.st] has joined #launchpad
Kinnisonhey stubbaroony02:57
=== ChanServ [ChanServ@services.] has joined #launchpad
=== beyond [n=beyond@200-161-81-29.dsl.telesp.net.br] has joined #launchpad
=== stub [i=stub@sweep.bur.st] has joined #launchpad
Kinnisonciao all03:46
=== poningru [n=poningru@n128-227-50-19.xlate.ufl.edu] has joined #launchpad
=== sfeehan [n=sfeehan@pool-64-222-103-115.burl.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== Nafallo is now known as Nafallo_away
=== EggMan2 [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== robitaille [n=robitail@ubuntu/member/robitaille] has joined #launchpad
=== EggMan2 [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== EggMan2 [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== sankar [n=sankar@202.144.95.245] has joined #launchpad
=== feehan [n=sfeehan@pool-64-222-103-115.burl.east.verizon.net] has joined #launchpad
=== Burgundavia [n=corey@S0106000000cc07fc.gv.shawcable.net] has joined #launchpad
=== poningru [n=poningru@n128-227-50-19.xlate.ufl.edu] has joined #launchpad
=== auth00 [i=auth@fiji.grd.sgsnet.se] has joined #launchpad
=== lbm [n=lbm@cpe.atm4-0-1301006.0x50a0824e.vgnxx6.customer.tele.dk] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== zyga [n=zyga@2-mi2-1.acn.waw.pl] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== sazwerx [n=sazwerx@202.152.172.1] has joined #launchpad
BjornTstub: is production running a baz branch? that is, if i want you to cherry pick something, should i branch off the production branch?10:14
=== sazwerx [n=sazwerx@202.152.172.1] has left #launchpad ["Leaving"]
stubBjornT: production is currently running a baz branch10:14
=== sankar [n=sankar@202.144.95.245] has joined #launchpad
BjornTstub: which branch?10:15
stublaunchpad--production--1.3810:15
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
BjornTstub: when adding some sample data and running make newsampledata, i get >1Mb diff... any ideas of what could be wrong?10:41
stubI've seen that happen before. No idea why it does that. IIRC newsampledata is supposed to be doing some sorting to minimize that sort of stuff.10:42
carlosBjornT, usually it implies new fields additions 10:43
carlosBjornT, someone added new fields but no new sampledata was added so with your export you update those tables10:43
BjornTcarlos: no, that's not it10:45
carlosBjornT, then there are two more options10:46
BjornTit seems like make newsampledata decided that all tables should be in alphabetical order, which wasn't the case before10:46
carlos1.- If the diff has case changes, someone did a manual addition to the sampledata (IMHO is a bad way to add it)10:46
carlosoh10:46
carlosthat's new10:46
=== koke [n=koke@ubuntu/member/koke] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
zygacarlos: hi11:30
zygacarlos: I've created #ubuntu-hardware, who should I contact to put this into topic line at #ubuntu11:30
carloszyga, don't know, perhaps jdub11:30
zygacarlos: thanks, I'll try11:31
=== sankar [n=sankar@202.144.95.245] has joined #launchpad
=== looksaus [n=looksaus@ip-83-134-126-9.dsl.scarlet.be] has joined #launchpad
=== WaterSevenUb [n=WaterSev@azevedo.astro.up.pt] has joined #launchpad
=== [DFC] EggMan [n=[DFC] Egg@pool-71-241-189-196.buff.east.verizon.net] has joined #launchpad
=== cprov [n=cprov@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
cprovmorning guys12:04
=== looksaus [n=looksaus@ip-83-134-126-9.dsl.scarlet.be] has left #launchpad ["Looksaus]
KinnisonWho here is going to UBZ flying tomorrow on BA95 from LHR->YUL 17:25 -> 19:25 ?12:35
=== Kinnison thinks kamion is
BjornTstub: sent you a cherry pick request01:00
=== matsubara [n=matsubar@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
matsubaragood morning!01:06
=== koke_ [n=koke@169.Red-217-127-113.staticIP.rima-tde.net] has joined #launchpad
KinnisonOkay, so I have a bzr branch of launchpad01:09
KinnisonI've done some work in it01:09
Kinnisonand I want to push those changes to chinstrap01:09
Kinnisonhow do I do that?01:09
siretarthi01:12
siretartI've sent a feature request for being able to close malone bugs via debian/changelog, but havn't heard any response yet :( - did you overlook me or is this way to hard to implement or way to low priority?01:13
KinnisonIt's currently low priority I imagine01:14
KinnisonWe'll certainly be looking into that though01:14
siretartokay. thanks for considering01:14
=== gneuman [n=gneuman@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
LarstiQKinnison: does something like 'bzr push chinstrap:/home/warthogs/archives/$yourusername/launchpad/branch-name' work?01:38
LarstiQKinnison: (shamelessly stolen from https://wiki.launchpad.canonical.com/MoveToBazNG)01:38
=== Kinnison thinks I missed out a mkdir
LarstiQssh chinstrap mkdir -p /home/warthogs/archives/$yourusername/launchpad 01:39
LarstiQ;)01:39
Kinnisonaye01:41
LarstiQKinnison: did you get it to work now?01:41
Kinnisonaye01:42
LarstiQsweet01:42
=== koke [n=koke@ubuntu/member/koke] has joined #launchpad
=== stub [i=stub@sweep.bur.st] has joined #launchpad
=== carlos -> lunch
=== beyond [n=beyond@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
lifelessstub: ping02:42
=== mpt [n=mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
stublifeless: pong02:47
lifelessstub: why did you need to use trunk? I used the rollouts stuff with jamesh successfully yesterday02:48
=== Nafallo_away is now known as Nafallo
=== heyko [n=heyko@p54842FD7.dip.t-dialin.net] has joined #launchpad
stublifeless: Mirroring branches with rsync to make branches locally02:50
=== JanC [n=janc@lugwv/member/JanC] has joined #launchpad
stublifeless: I was about to commit a modern refuel script that creates local mirrors of branches using rsync, allowing you to update and build trees much quicker.02:53
lifelessstub: well, three thoughts02:54
lifelessstub: firstly, make sure .bzr/parent is set correctly.02:54
lifelessstub: secondly, tree *building* should be a once per developer and install activity. After that it should be pull/merge/pull --overwrite.02:55
stublifeless: I have several trees open at a time in general and find I'm building trees quite often02:56
=== Virtuall[BZA] [n=virtuall@alpha.bounzza.net] has joined #launchpad
lifelessstub: so, cp -a between them - thats fully supported02:57
stublifeless: Yup. But update is painful02:57
lifelessstub: but there should be no need for full builds, in general.02:57
lifelessstub: update of the nested trees ?02:57
stubrsynced trees seem quite servicable to me. What is the issue?02:58
lifelessits doable, no particular issue. But you need to run revert in every tree, as I explained. in email.02:58
lifelessalso it seems ugly that rsync is needed, martin and I hope to make non rsync performance as good or better for 0.702:59
stublifeless: Sure. This is just a temporary measure.03:01
stublifeless: But until then building a tree remotely is just impractical03:02
lifelessstub: note that I have not said 'dont do it'03:02
lifelessjust raised some thoughts03:02
=== cprov [n=cprov@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
stubAny hints on how to use bzrlib to do a revert?03:03
lifelessyah, look in bzrlib/builtins.py and cargo cult from cmd_revert03:03
=== SteveA [n=steve@66.103.220.202] has joined #launchpad
lifelessSteveA: comign down ?03:04
SteveAsure.  have you had breakfast yet?03:05
lifelessyes03:05
lifelesswe're starting work :)03:05
SteveAsuccessfully?03:05
stubAhh.... bzrlib.branch.Branch.revert might be a start03:05
lifelessno03:05
kikoSteveA, coming down too03:17
=== jamesh [n=james@66.103.220.207] has joined #launchpad
=== mdz [n=mdz@66.103.220.211] has joined #launchpad
=== lamont [n=lamont@mib.fc.hp.com] has joined #launchpad
SteveAhi stub.03:42
stubSteveA: hi03:42
SteveAlifeless / stub: the 'trivial, steve's spec hacks in production' email from pqm seemed to include a LOT of stuff03:42
SteveAstub: do you know what the problem with your address and shipit is?03:43
stubToo many lines, lines too long. I got it in my abusing the organization field. But the issues outlined remain.03:44
SteveAi don't think "we're losing orders because of this" is a convincing enough argument on its own03:45
SteveAis there a way we can ask people "are you having problems entering your address into our system?"03:45
SteveAsalgado /  mpt: what do you think?03:46
mptSomething like "If you think ShipIt should accept addresses like this, __report this as a bug__"?03:47
mptwhere the link automagically squirts the address into the Description field of the bug report? :-)03:48
stubOh. My main issue would be why the hell are we bending over backwards to meet the demands of a company we are pumping millions of euros through when they should be the ones meeting our requirements and asking if we would like a blow job with that?03:48
stubASCII only, no commas, very restrictive fields. I recall the encoding issues gave mako a lot of headaches, and the ascii names have already given us grief.03:50
mptso the company's using CSV, huh03:51
SteveAusing *shitty* csv03:51
mptWe could convert commas to semicolons behind the scenes, I don't think anyone would mind03:52
salgadompt, I already do that03:52
SteveAi thought we already did that03:52
mptso did I03:52
SteveAso stub is saying, why can't the shippiing company03:52
mptok03:52
lifelessSteveA: yes, and to add insult, pqm died after sending the email, before completing the push03:52
SteveAwhither transactions?03:53
lifelessthe failure was during sending the mail03:53
lifeless'mail' considered the pipe closing to be 'please send.'03:54
SteveAah03:54
lifelessascii codec, failure to encode, ordinal not in range.03:54
=== heyko_ [n=heyko@p54843F30.dip.t-dialin.net] has joined #launchpad
=== jdub [n=jdub@home.waugh.id.au] has joined #launchpad
SteveAstub: jdub wants to hassle you03:57
jdubHEY STUB!03:57
=== stub hides under the sofa
=== SteveA kicks jdub from #launchpad
jdubSteveA said i should bug you about me being JeffWaugh2 on the wiki03:58
SteveAscrew you hippy03:58
SteveAi'm channeling stub here03:58
=== Virtuall[BZA] [n=virtuall@alpha.bounzza.net] has joined #launchpad
SteveAspiv: hello03:59
SteveAspiv: can we talk about some minor moin integration stuff?03:59
stubjdub: What do you log in as? The DB says username jdub's wikiname is JeffWaugh04:00
SteveAlifeless: the load on chinstrap goes up to 1104:01
lifelessactually, it goes up to 20004:01
lifelessbut we're being nice to it right now04:01
SteveAbut 11 is louder04:01
stubAnd JeffWaugh2 is owned by an atavism from an account merge04:01
=== ruda_porto [n=Ruda@fwcpd.ufba.br] has joined #launchpad
elmokiko, you slack jawed hippy, what's your launchpad ID?04:06
lifelesskiko04:07
jdubstub: but on the wiki, i'm logged in as JeffWaugh204:07
elmono, numerically04:07
uwsheya jdub sign my gpg key! :P04:07
stub(21:00:24) stub: jdub: What do you log in as? The DB says username jdub's wikiname is JeffWaugh04:07
=== Virtuall[BZA] [n=virtuall@80.233.208.92] has joined #launchpad
=== Keybuk [n=scott@66.103.220.198] has joined #launchpad
lifelesselmo: numerically, he wont know, its in person.id04:08
lifelesselmo: you have db access ?04:09
elmoI have root, that doesn't mean I go around running SQL queries on the production DB for giggles04:09
stub1387, although I'd love to know what that is being used for apart from an internal database key?04:10
jdubstub: yes, in launchpad, it just says JeffWaugh. when i log in to the wiki as jeff.waugh@ubuntu.com, the wiki user is JeffWaugh204:10
lifelesselmo: well, you could ask 'staging' the query, which is where stub does most of his adhoc stuff, IRRC>04:11
stubjdub: That is very wierd. That email address is linked to JeffWaugh04:11
elmostub: moin04:11
stubelmo: oh... the perferences cache? I see.04:12
elmowell not so much a cache as a data store, but yeah04:13
=== Virtuall[BZA] [i=virtuall@80.233.208.92] has joined #launchpad
stubjdub: The database is correct. I think you need to hassle spiv, or maybe those files elmo is poking in right now have the answer.04:13
stub(Jeff is 6727)04:14
LarstiQuws: tsk04:16
elmoI think you want spiv first, as it's not obvious how id maps to name, and the code to do it is square in the middle of stuff he patched04:23
elmokiko: as for yours, your account doesn't say disabled...04:23
=== kiko [n=kiko@66.103.220.203] has joined #launchpad
elmokiko: as for yours, your account doesn't say disabled...04:25
kikoelmo, that's odd, but it is disabled. I can't log in at least.04:26
=== GoRoDeK [n=gorodek@p5083D4D9.dip.t-dialin.net] has joined #launchpad
spivelmo: The file name in moin for a user should be the launchpad ID, I think.04:38
elmospiv: yes, it is04:39
elmospiv: I more meant the mapping of launchpad ID -> wiki User Name04:39
spivOh, right.04:40
spivThat's from the database -- the query stub would have done earlier would be right.04:40
spivi.e. select wikiname from wikiname where person = X and wiki = 'http://whatever';04:41
stubWhich gives JeffWaugh, not JeffWaugh204:42
spivMoin asks the authserver for that info, and it does (essentially) that query.04:42
=== spiv tries querying the authserver directly.
=== lbm [n=lbm@x1-6-00-13-10-7a-d1-e4.k233.webspeed.dk] has joined #launchpad
spivThe authserver says jeff.waugh@ubuntu.com has a wikiname of JeffWaugh.04:43
kikospiv, mine is ChristianReis, right?04:44
spivkiko: right04:45
mptWho's lalo@canonical.com?04:46
kikompt, someone who used to work with us04:46
spivjdub: https://wiki.ubuntu.com/JeffWaugh?action=info shows "JeffWaugh" in the edit history.04:46
spivjdub: Where are you seeing the string JeffWaugh2?04:47
mptThey're the ancestor of all my branches04:47
jdubspiv: moin04:47
jduboh, hold on04:47
spivjdub: Be more specific, please :P04:47
kikompt, have you asked lifeless?04:47
mptkiko, it seems to be working fine, I was just wondering04:47
jdubspiv: yeah, sec :)04:48
jdubspiv: hrm, i'll bug you when i see it04:48
=== jdub [n=jdub@home.waugh.id.au] has left #launchpad []
spivHeh.04:49
kikompt, sounds like a bug to me but..04:49
spivI'll just assume that means jdub can't reproduce his problem ;)04:50
mptok, lifeless: ping04:50
kikoI can however, spiv :)04:51
spivkiko: Does that mean you have a URL for me? :)04:51
LarstiQmpt: Lalo Martins?04:53
jameshspiv: pending-reviews/ doesn't currently URL-decode the %2F in your branch name05:00
spivjamesh: I wondered about that... I couldn't remember if the @ confused it or not.05:01
spivjamesh: Although, %2f is slightly more correct, isn't it?05:02
jameshspiv: the '@' did confuse it at one point, but doesn't now05:04
kikospiv, well, I can' t log in to the wiki, period.05:07
jameshspiv: if you're done with your baz branches, you can move the contents of the andrew.bennetts@canonical.com/ directory up one level too05:07
LarstiQkiko: do you get an error?05:07
spivkiko: Using your launchpad login?05:08
kikospiv, yep05:08
spiv(i.e. logging in as "kiko" not "ChristianReis")05:08
spiv(or with your email address)05:08
kikospiv, as kiko@async.com.br05:08
spivThat should work.05:09
spivDo you have access to macquarie?05:09
kikospiv, I /think/ I once clicked on "disable my account forever"  because a user had done it and I wanted to reproduce05:09
kikospiv, no, I don't05:09
spivOh.05:09
kikoand in fact I lost it forever05:09
spivHeh.05:09
jameshkiko: create a new launchpad account, merge your existing one into it, and use that ...05:10
spivThat option probably needs to die.05:10
jameshthat'll get a new user ID05:10
kikono05:10
jameshno?05:10
kikothat option should be nuked AND all disabled accounts should be reenabled05:11
spivkiko: re-enabling that needs elmo or someone else with direct access to wiki files.05:11
=== spiv looks at disabling disabling.
kikospiv, elmo is a step away from me05:11
elmoit's not disabled05:12
kikobut he apparently said that my account isn' t disabled05:12
kikoright05:12
jameshkiko: he might have been looking at your pre-launchpad user ID05:12
spivelmo: you checked file 1387?05:13
elmoroot@palmer:/srv/wiki.launchpad.canonical.com/www/data/user # grep disabled 138705:14
elmodisabled=005:14
spivHmm.05:14
kikohmmm05:14
kikohey stub, did you get my email?05:15
spivkiko: Hmm.05:15
stubeh?05:15
kikostub, the one I sent yesterday, on gina?05:17
spivkiko: On chinstrap, could you fire up a python prompt, and do: >>> import xmlrpclib; s = xmlrpclib.Server('http://macquarie:8999/v2'); print s.authUser('kiko@async.com.br', 'xxx')05:17
stubi rolled out a patch of yours on staging and fired off a gina run05:17
spivkiko: Only, with your actual password ;)05:17
spivAnd tell me if it returns an empty dictionary or not.05:17
kikostub, you /rock/05:18
kikowhee05:18
kikospiv, let me try.05:18
kikospiv, it returns my data correctly.05:19
kiko{'wikiname': 'ChristianReis', 'emailaddresses': ['kiko@async.com.br', 'kiko@canonical.com'] , 'displayname': 'Christian Reis', 'id': 1387, 'teams': [{'displayname': 'Ubuntu Drivers', 'id': 322877, 'name': 'ubuntu-drivers'}, {'displayname': 'Christian Reis', 'id': 1387, 'name': 'kiko'}, {'displayname': 'Launchpad Developers', 'id': 15158, 'name': 'launchpad'}, {'displayname': 'Launchpad Administrators', 'id': 2794, 'name': 'admins'}, {'displayname': 'ShipIt 05:19
kikoAdministrators', 'id': 243601, 'name': 'shipit-admins'}] }05:19
spivOk, so the authserver end is working just fine.05:19
spivSo the problem must be in moin somewhere.05:19
kikoyeah, I knew it was because I can log in to any other wiki05:20
kikoI think the issue is related to what I suggested before 05:21
kikobut.. I don't know for sure.05:21
spivWeird.05:21
=== mfuentes [n=mario@200.54.6.230] has joined #launchpad
spivI didn't realise it was just the one moin.  That's doubly weird.05:21
spivelmo: maybe diff kiko's moin user file from a working wiki?05:21
spivkiko: You're seeing "Sorry, wrong password", or something else?05:21
kikoSorry, wrong password.05:22
spivelmo: is there a "valid=0" in kiko's user file?  (there should be no valid=foo line at all, but who knows...)05:23
=== matsubara is now known as matsubara-lunch
elmospiv: no, valid=0, and diff to a random other ID looks sane05:29
elmohttp://people.ubuntu.com/~james/tmp/138705:29
spivelmo: thanks05:30
spivYeah, certainly looks sane.05:31
spivkiko: I've got *no* idea.  Must be a browser bug ;)05:31
spivThe user code in moin is pretty horrible, but I can't see how it's horrible enough to muck that up.05:31
kikospiv, you are very funny05:32
spivWell, it is considerably past my bedtime :)05:32
jameshkiko: maybe you shouldn't have logged out forever05:32
kikojamesh, maybe not. I was trying to help verify a problem a user reported.05:36
spivAnyway, the patch to remove that option should be a simple one-liner (delete the obvious line from MoinMoin/user.py:User._checkbox_fields), but I'm not going to trust my testing of that at this time of night.05:37
=== yi [i=yi@rollright.bmsc.washington.edu] has left #launchpad []
lifelessSteveA: ping05:43
lifelessSteveA: can we get the lp test runner to not buffer everything until the end ?05:43
lifelessSteveA: for pqm.05:44
=== Kinnison nods
Kinnisonmy merge was "Terminated"05:47
KinnisonI assume by pqm05:47
lifelessI dont know what that means05:47
KinnisonWell, I sent off a merge05:48
Kinnisonit failed05:48
SteveAlifeless: the point of that originally was to give no output on success, and only output on failure, because the test suite was too darn noisy.05:48
SteveAnow it is much less noisy05:48
KinnisonThe end of the log was :05:48
Kinnisonmake: *** [check_merge]  Terminated05:48
=== Kinnison assumed that was pqm
lifelessoh, I stomped on a merge05:48
lifelessthere was a bug I needed to correct that would have cuased a later failure.05:49
KinnisonOh05:49
=== Kinnison resubmits then
=== Kinnison discovered that sshing into chinstrap and cp'ing the rocketfuel tree is a good way to start a branch
kikostub, where are the logs going?05:50
stubkiko: Same place as always05:50
Kinnisoncertainly speeds up the subsequent push05:50
lifelessKinnison: read the MoveToBazNG page05:50
Keybuk...hmm, my Karma has been stuck on 69 for ages05:50
Keybukwhy do I think someone's hardcoded that05:50
kikostub, /srv... right?05:50
Kinnisonlifeless: erm, perdon?05:50
lifelessKinnison: its documented 05:51
Kinnisonoh right05:51
LarstiQKinnison: no reason, no reason at all05:51
stub /srv/launchpad.ubuntu.com/gina-logs05:51
KinnisonLarstiQ: whowhat?!05:51
LarstiQargh05:52
LarstiQs/Kinnison/Keybuk/05:52
LarstiQKinnison: sorry!05:52
SteveAlifeless: https://wiki.launchpad.canonical.com/AssertionsInLaunchpad  btw05:57
lifelessyah05:59
lifelessI had read that06:00
lifelessand it doth not say 'in tests, do /donot'06:00
SteveAyes06:00
SteveAyou should update it, or get someone else to do so, when this is all agreed06:01
=== bradb goes for lunch while his merge request inches up pqm's queue
=== lamont-away is now known as lamont
stublifeless: Will brads merge fail? The pqm message is different to the others (no sftp)06:17
stubI just documented 'setting the parent' in the rsync recipe06:17
salgadohow big is a launchpad tree with all dependencies in bzr?06:29
lifelessstub: yes, it will fail06:31
lifelessbradb: ^^^06:31
stubbzr: ERROR: 'ascii' codec can't encode characters in position 25-26: ordinal not in range(128)06:37
stub  command: '/usr/bin/bzr' 're-sign' '-r' '1681..'06:37
stub      pwd: u'/home/stub/tmp/da'06:37
stub    error: exceptions.UnicodeEncodeError06:37
stub  at /usr/lib/python2.4/site-packages/bzrlib/testament.py line 168, in as_short_text()06:37
stub  see ~/.bzr.log for debug information06:37
stublifeless: Trying to resign one of my branches06:37
lifelessstub: grah06:39
lifelessstub: what bzr are you running ?06:39
stub23:39:21~/lp/da $ bzr --version06:39
stubbzr (bazaar-ng) 0.6pre06:39
=== matsubara-lunch is now known as matsubara
stubjbaileys06:39
stubI can reinstall integration from source easily enough06:40
lifelessstub: can you file a bug, with the backtrace from bzr.log06:40
stubWhere are bugs filed? Launchpad?06:40
lifelessbzr - malone06:40
=== jinty [n=jinty@G9ce5.g.pppool.de] has joined #launchpad
=== LarstiQ [n=larstiq@cust.7.157.adsl.cistron.nl] has joined #launchpad
=== eruin [n=eruin@unaffiliated/eruin] has joined #launchpad
lifelessstub: so, please try with integration07:02
lifelessstub: also, what was the problem with rollouts ?07:05
stubrollouts?07:05
lifelessyou emailed saying you could not use the rollouts bzr 07:05
SteveAmpt: ping07:05
stubOh. Erm. I forget :-(07:06
stubcm.py was hanging trying to get the first bzr branch (hct I think). Using the head of the integration branch fixed it.07:06
=== bradb resubmits his merge request
=== bradb clicks the "cancel this merge request" link to cancel his earlier merge request</dreamer>
=== salgado [n=salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
stublifeless: dies at the same place07:18
=== salgado [n=salgado@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
salgadolifeless, ping07:40
salgadoso, I was running "cm.py build configs/configs/canonical.com/launchpad/development07:41
salgado" for more than 20 hours when we had a power outage. how can I resume that?07:41
bradbsalgado: dude, run that on chinstrap07:42
bradbit'll be done in under an hour, IIRC (like, a lot under an hour IIRC)07:42
salgadobradb, thanks dude. I thought I've seen someone saying some requirement for that wasn't installed on chinstrap07:44
salgadolooks like I got it wrong. :-(07:45
bradbyeah, that was me :) lifeless installed bzr07:45
bradbso, the instructions for doing it remotely should work fine now07:45
salgadobradb, not really. :-(07:46
salgadocm.py build configs/configs/canonical.com/launchpad/development07:46
salgadoTraceback (most recent call last):07:46
salgado  File "/usr/local/bin/cm.py", line 21, in ?07:46
salgado    from config_manager import main07:46
salgadoImportError: No module named config_manager07:46
salgadodid you run it there?07:46
bradbi ran the instructions verbatim07:46
salgadooh, okay. the instructions on MoveToBazNG are different07:47
bradbsalgado: just follow the instructions word-for-word in "Using bzr remotelly and rsyncing locally" on that page07:47
bradbs/lly/ly/07:47
=== salgado follows bradb's advice. thanks again, dude
bradbno prob07:50
salgadobradb, do you know why the hell we need to configure a greedy revision library?07:54
bradbnot really, no. I've already removed baz from my machine though, and I'd rather not think too much more about the way it "works". :)07:55
=== auth00 [i=auth@fiji.grd.sgsnet.se] has joined #launchpad
lifelesssalgado: see 'MoveToBazNG'08:14
lifelessstub: I'll try getting hct with integration08:15
=== SteveA [n=steve@66.103.220.202] has joined #launchpad
=== sabdfl [n=mark@pdpc/supporter/silver/sabdfl] has joined #launchpad
=== mdz [n=mdz@66.103.220.211] has joined #launchpad
kikobradb?08:43
bradbyo08:43
kikohow goes it duderino08:43
bradbpretty good, you?08:43
kikobradb, not entirely ungood08:44
kikobradb, privmsg alert ;)08:44
bradbgood thing you told me! colloquy is teh suck for privmsg's08:44
kikoI've since learned08:47
kikohey sabdfl, how's the other hemisphere? 08:47
SteveAsalgado: seen mpt?08:50
matsubaraSteveA: I think he's on portuguese class08:53
=== mpt [n=mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== mpt [n=mpt@200-171-140-32.dsl.telesp.net.br] has left #launchpad []
=== mpt [n=mpt@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== Nafallo is now known as Nafallo_away
=== mgalvin [n=mgalvin@host-66-202-95-170.spr.choiceone.net] has joined #launchpad
lifelessSteveA: ping09:22
SteveAyes09:22
lifeless19:02:56 INFO    Applying comments.sql09:22
lifelesscreatedb: database creation failed: ERROR:  source database "launchpad_ftest_template" is being accessed by other users09:22
lifelessTraceback (most recent call last):09:22
lifeless...09:22
lifeless  File "/home/pqm/arch/queue/workdir/home/---devel/launchpad/database/schema/../../lib/canonical/database/sqlbase.py", line 577, in connect09:22
lifeless    return psycopg.connect(con_str)09:22
lifelesspsycopg.OperationalError: FATAL:  database "launchpad_empty" does not exist09:22
SteveAany processes sitting around?09:22
lifelessno, its not the normal.09:22
lifelessrather than 'in use', its 'missing'09:23
SteveAfull disks?09:23
SteveAlet's ask elmo to look into it, from a sysadmin level09:23
lifelessFilesystem            Size  Used Avail Use% Mounted on09:23
lifeless/dev/sda3             537G  263G  247G  52% /09:23
lifelesselmo: ping09:23
SteveAhmm09:23
sabdflstub around at all?09:25
lifelesshes asleep I think09:26
sabdfllifeless: in montreal? or in thailand still?09:26
lifelessAFAIK, thailand.09:27
bradblifeless: did you try running the command more than once?09:27
bradbsometimes it works the second time09:27
SteveASteveA: 09:27
lifelessbradb: thats pqm09:27
SteveAsabdfl: according to the wiki, stub arrives on 1 nov09:27
SteveAso, still in thailand09:27
bradblifeless: oh09:27
sabdflSteveA: i have a baz branch that contains last nights work. should i merge latest baz rocketfuel?09:28
sabdflit has a db patch that is good but needs a numberfrom stub.09:28
sabdflif you could merge it, morving the db patch to the official place, it will give you the Not for us bits and quite a bit of general cleanup09:28
sabdflit specifically needs a review from you, though09:29
sabdflbecause i was inspired finally to sort out the generalform infrastructure i created09:29
sabdflit now supports zcml directives09:29
SteveAdoes that make it clearer?09:29
sabdflits really a much simpler form infrastructure for the non-trivial add/edit cases09:29
sabdflSteveA: yes, besides, it just feels proper09:30
sabdflbut, there's some cargo culting of zope magic09:30
SteveAi'm very keen to move as much as possible out of the zcml09:30
sabdflso a review would be welcomed09:30
SteveAok09:30
sabdfli'll mirror up the current branch, which passes tests09:30
SteveAplease add the details to the PendingReviews page so james' script can pick it up09:30
sabdflthen i'll merge rocketfuel, and if that passes tests, will mirror it up too so a landing will be conflict-free09:31
sabdfli haven't done the bzr switcheroo09:31
SteveAit takes a while09:31
SteveAto convert your branches09:31
SteveAa long while09:31
=== bradb retired his baz branches and just applied the diffs to new bzr branches
bradbthe baz -> bzr branch conversions will be running all next week, at this pace09:32
SteveAyes09:32
SteveAbut, they also make pqm really slow09:32
bradbyep :/09:32
SteveAbecause it is all running on chinstrap09:32
SteveAthe load was about 12 earlier09:32
sabdflmark.shuttleworth@canonical.com/launchpad--pre-ubz-specs--009:33
sabdflelmo: is that integration box ready for lifeless love?09:33
sabdflsounds a bit like dating an english chick09:33
sabdflSteveA: plan is to move pqm to a dedicated fast box09:34
SteveAyep09:34
SteveAbut i don't know what the ETA for that is09:34
mptlifeless: ping09:42
lifelesspong09:42
mptlifeless: For every branch that's baz-imported, it gets to nearly finished, then says "ancestor of lalo@canonical.com--canonical-work-2004/pytranslations--devel--0.1--version-0 is lalo@canonical.com--canonical-work-2004/pytranslations--devel--0.1--patch-17", then begins the next one09:43
mptIs that any cause for concern?09:43
lifelessnope09:43
mptgood good09:44
lifelessits just that the emission of the debug statement there means you do not see the end of the scroll bar09:44
mptok09:44
mptI reported that as a bug, I just wanted to know whether the import was still being useful09:44
lifelessvery much so09:46
lifelessthank you09:46
sabdflSteveA: mail from jamesh sais baz branches are being ignored by his script09:56
kikothat is true09:57
jameshsabdfl: yeah.  since they can't be landed.10:01
sabdfljamesh: np10:02
sabdflSteveA: you could tag from mine, fix db patch number, review, and land10:02
sabdflhowever10:02
sabdfli'm worried that it would make my work tonight behave weirdly w.t.o. conflicts etc10:02
SteveAsabdfl: okay.  i can review etc. without using james' script10:04
SteveAdo you have any idea what you will work on during the flight back?10:06
sabdflSteveA: privmsg todo list10:07
=== sfeehan [n=sfeehan@132.198.90.91] has joined #launchpad
=== sabdfl [n=mark@pdpc/supporter/silver/sabdfl] has left #launchpad []
SteveAmpt: how do you specify a minimum table cell height?10:31
mptSteveA: min-height: whatever;10:32
SteveAthanks10:33
elmocan you safely modify a list you're iterating over?10:33
SteveAno10:33
SteveAwell10:33
elmobother10:33
lifelesselmo: new_list = list(old); for member in old:10:36
elmois that more idiomatic than copy.copy() ?10:36
SteveAyes10:36
lifelessits easier :)10:37
SteveAcopy.copy() attempts a deep copy10:37
SteveAor does it10:37
lifelesserr no10:37
SteveAwhatever10:37
SteveAit's all CRACK anywya10:37
elmocopy.deepcopy() does a deep copy, copy.copy() is shallow10:37
lifelessHelp on function copy in copy:10:37
lifelesscopy.copy = copy(x)10:37
lifeless    Shallow copy operation on arbitrary Python objects.10:37
lifeless10:37
SteveAelmo: if you're iterating over the list, you can modify its members.10:37
lifelesselmo: list(foo) is nice in that it ensure you have a list10:37
lifelesscopy.copy is nice in that it preserves the type10:37
SteveAbut you can't add to or remove elements from the list10:38
elmoSteveA: sorry, by "modify", I mean use .remove()10:38
SteveAyeah, don't10:38
SteveAuse a copy10:38
LarstiQfor item in old[:] : is also iodmatic, but list(old) is nicer10:38
elmoyeah, I'd done that by 'bother' :)10:38
=== SteveA msgs mpt
bradbelmo: you might want to use something like "newlist = [foo for foo in bar if foo == something] " to filter items out of a list.10:39
=== gneuman [n=gneuman@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== salgado [n=salgado@201-26-78-69.dsl.telesp.net.br] has joined #launchpad
=== TylerM [n=TylerM@66.244.194.174] has joined #launchpad
TylerManyone here got a geographic data or mapping project on the go via launchpad?10:55
kikonot yet, TylerM!10:56
=== salgado [n=salgado@201-26-78-69.dsl.telesp.net.br] has joined #launchpad
bradbhm, by the time one writes an interface, a content class, a dbschema vocab, a *Set utility (and a doctest for that), and hooks it all up in ZCML, it seems to take about 150-200 lines of code/doctest/config to expose a new domain object in LP (of course, that's not counting any extra logic beyond the minimum CRUD APIs)11:06
SteveAwhy do you need a *Set ?11:09
SteveAshuldn't need that11:09
lifelessbecause he is writing stars!11:09
bradbSteveA: to create the object11:09
SteveAwe generally create objects in the context of something11:09
SteveAyou're probably not creating a new context object11:10
SteveAdon't create unnecessary content sets11:10
bradbSteveA: that's interesting that you say we "generally" do that, because we have already 79 *Set interfaces11:12
bradband it often seems like 1-to-1 domain object to *Set11:13
SteveAwe should get rid of most of them11:14
bradbindeed :)11:14
bradbi hope we can trim down to under 10,000 lines of XML config too :)11:15
SteveAi'm going to be getting rid of much of the zcml in time11:15
bradbit sounds like you want less of that. simplicity is the new black.11:15
bradbso, in this case, I'll do the create in IDistributionSourcePackage.subscribe11:16
=== sfeehan [n=sfeehan@132.198.90.91] has left #launchpad []
TylerMkiko: thanks :)11:19
kikosounds interesting though11:19
TylerMit's what I really care about :)  http://oreillynet.com/pub/au/189811:26
TylerMthe commercial realm is quite monopolised and the open source geospatial realm is exhilirating...11:26
=== jdub [n=jdub@home.waugh.id.au] has joined #launchpad
jdubspiv: ping11:33
=== mpt [n=mpt@200-171-140-32.dsl.telesp.net.br] has left #launchpad []
jdubspiv: that 'JeffWaugh2' user is now 'MrPantless'11:35
jdubhttps://wiki.ubuntu.com/UbuntuBelowZero/LoveDay?action=info11:35

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!