/srv/irclogs.ubuntu.com/2006/05/23/#launchpad.txt

ddaalifeless: does svn_oo support the svn equivalent of module configs?12:04
KeybukkikoX: obviously the biggest problem for us is that it means bugs are getting assigned to packages that should not exist, so there's nobody who's bug contact for them, or even looking for them12:06
lifelessexternals ? dont know12:06
Keybukso I've been going down the list of packages and trying to look for "bugs on binaries" too12:06
Keybukso will see if I find any more examples that prove or disprove that syncs aren't doing it12:06
ddaacarlos: can you file a bug about that, provided I can stay focused on importd long enough, I will come around to in the medium term12:07
ddaa(a few months) unless somebody contributes code after we release cscvs12:07
kikoXKeybuk yeah. this needs to be fixed ASAP12:07
kikoXcprov is on it12:07
carlosddaa: ok, will do12:08
carlosddaa: thanks for looking into it12:08
=== ddaa -> bed
=== SnkBite [n=SnkBite@212.25.63.35] has joined #launchpad
kikosalgado, what's the RT number?12:15
salgadokiko, 914312:16
kikothanks salgado 12:16
kikohey Znarl 12:16
ZnarlHello12:16
kikosorry to bump you this late12:17
salgadoyeah, sorry for the short notice12:17
kikoZnarl, salgado filed RT 914312:17
salgadoit's all my fault12:17
ZnarlIt's fine.  How can I help?12:17
lifelesshi znarl. thanks12:17
kikobut basically we need to ensure lifeless and you synchronize on flicking the switch for the shipit apache redirect setup 12:17
kikoit's only really a problem for shipit.ubuntu12:18
ZnarlRT#9143.  12:18
Znarlok.12:18
kikolifeless, Znarl: perhaps #canonical-meeting?12:18
kikoZnarl, it's important that it be done more or less in sync with lifeless or else the redirect will break until the rollout happens.12:18
ZnarlSure.12:18
kikosalgado, I'll let you handle things on #canonical-meeting :)12:20
YannigHum, problem with the server :(12:21
YannigOperationalError12:21
YannigA server error occurred.12:21
kikoYannig, oops id?12:21
KeybukOperationalError12:22
KeybukA server error occurred.12:22
Keybukheh12:22
Keybukok, somebody beat me12:22
Keybukkiko: no oops, just "*BOOM*"12:22
kikoKeybuk, Yannig: the system is being upgraded, hold on for some turbulence12:23
Keybukkiko: it told me 14 minutes not more than 3 minutes ago :p12:23
kikoapparently lifeless is not wasting a minute12:23
lifelessKeybuk: sorry, it lied to you12:27
kikowe normally have a launchpad is down page12:27
kikofor some reason it's down too12:27
carloskiko, lifeless: are you doing the rollout?12:28
kikoyep12:28
carlosI didn't finished with mark's branch merge...12:30
kikocarlos, too late now :)12:30
carlosI guess..12:31
carlosanyway, I'm going to merge it tonight as I told SteveA...12:31
carloskiko: about https://launchpad.net/bugs/4516412:31
carloskiko: mpt told me that we should not add the navigation links to the bottom of the translation form, because people would click on 'Next' instead of submit translations and that would make them lose their translations12:32
carlosthere is already a rejected bug about it12:32
kikoI see. then dupe it.12:32
carlosok12:33
YannigThe "launchpad is down" page is up :)12:34
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
YannigAny idea when it should be back? Nothing hurrying but I was about to download po file and I'll have to go to bed reasonably early :)12:48
lifeless10 minutes 12:49
YannigThanks :)12:49
=== ploum [n=ploum@ubuntu/member/ploum] has left #launchpad ["Ex-Chat"]
lifelessweb ui is back01:07
carloslifeless: hi, why does my pqm request say: "Request for non-PQM managed branch" at http://pqm.launchpad.net/ ?01:17
salgadocarlos, are you using a bzr repo and the pqm-submit plugin?01:18
carlosno, I'm using a wave bzr repository and the old bzr-submit-merge script01:19
carlosit worked this morning01:19
carlosafter the knit migration01:20
salgadoodd01:21
lifelessI encourage you to switch to pqm-submit01:22
salgadolifeless, is there a workaround for bug 45306?01:23
UbugtuMalone bug 45306 in bzr "LocationConfig should look for options on parent locations when they're not found" [Normal,Unconfirmed]  http://launchpad.net/bugs/4530601:23
salgadoI think that's going to be a problem for people using pqm-submit and not manually rsyncing their branches up01:24
lifelesssalgado: yeah, we should change that01:25
=== kbrooks [n=kbrooks@unaffiliated/kbrooks] has joined #launchpad
lifelessI think the workaround is 'write the code'01:25
kbrooksis the shipit code proprietary?01:25
=== cprov [n=cprov@201-68-2-63.dsl.telesp.net.br] has joined #launchpad
carloslifeless: is it included with bzrtools?01:26
lifelessSteveA: around ?01:26
lifelesscarlos: no, I think that james's repository use page documents how to get it01:27
salgadogotta go now. be back in a few minutes01:27
carlosok01:27
kbrooksis the shipit code proprietary?01:27
kbrooksis the shipit code proprietary?01:28
=== kbrooks waits
=== kbrooks prepares for the stuff.
carloskbrooks: yes, it is01:29
kbrookscarlos: why?01:29
mptGooooooooooooooooooooooooood morning Launchpadders!01:29
kbrookshmm, i have a bug?01:30
carloskbrooks: https://launchpad.net/faq <- Please, look at "Is Launchpad open source? Will it be?"01:30
carlosmpt: morning01:30
=== Yannig [n=LokaUsr@AToulouse-254-1-24-55.w81-250.abo.wanadoo.fr] has joined #launchpad
carloslifeless: pqm-submit seems like fixed the issue, but the old request is stalled or at least, looks stalled01:39
carlosanyway... it's too late already here... and I missed the production update..01:40
kbrooksum, i have a bug, carlos 01:40
carlosI will continue tomorrow01:40
carloskbrooks: where?01:40
kbrooks"3 CDs requested in 2006-01-01. 3 CDs approved and sent to the shipping company in 2006-01-03."01:41
kbrooksbut I DID NOT request there cds on january 1, 200601:41
kbrooksthree*01:41
carloskbrooks: please, file a but about it at https://launchpad.net/products/shipit/+bugs01:42
kbrooksOK.01:42
carloskbrooks: thanks01:42
=== carlos -> bed
carlosgood night!01:42
=== alexandros_se [i=ctrl@2-1-1-18a.spa.sth.bostream.se] has joined #launchpad
=== salgado [n=salgado@201-1-130-8.dsl.telesp.net.br] has joined #launchpad
=== mpt_ [n=mpt@203.109.220.214] has joined #launchpad
=== stub [n=stub@ppp-58.8.2.77.revip2.asianet.co.th] has joined #launchpad
=== stub [n=stub@ppp-58.8.2.77.revip2.asianet.co.th] has joined #launchpad
stublifeless: was jubany acting up?03:12
stubahhh - would have been the shipit rollout03:13
lifelessstub: I found the rollout instructions a little ... sparse.03:14
lifelessi.e. no db backup in there03:14
lifelessnor info on bouncing librarian/authserver etc.03:14
lifelessI've added some info and some nicer ways of doing things03:15
stubyup. db backup takes over an hour, so we need to rely on dailys now (and pitr when set up)03:15
stubwell... cloneing the db would be faster, but still too slow03:15
lifelesswell, we downed it and just copied the pg dir, took about 15 minutes03:15
elmorsync it before and after should be faster tan 15 minutes03:16
lifelesselmo: sure. we were adhocing it - I woke up to a 'please rollout and stub is sick' email03:17
stubahh good - you found push.py (work in progress but useful)03:17
lifelessstub: :)03:17
lifelessstub: the notes I have on the rollout page may be useful for commands push could run03:17
stubyup03:17
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
Keybukkiko: those dups are still definitely getting created by the uploader03:27
Keybuks/dups/strange sources/03:27
Keybuka package that just added new binaries created them03:27
KeybukI had a thought though03:27
Keybukcould this be a result of overrides?03:27
=== mpt_ [n=mpt@203.109.220.214] has joined #launchpad
lifelesspopping out for a bit03:53
salgadolifeless: is pqm still disabled?03:54
mpt_"-537 revision(s) pulled."03:56
mpt_heh03:56
=== stub wanders off to hospital
mpt_!04:03
=== bradb [n=bradb@modemcable092.66-130-66.mc.videotron.ca] has joined #launchpad
jameshmpt_: your branch history was canonicalised04:23
jameshmpt_: leading to a shorter revision history04:23
mpt_uh oh04:23
mpt_I just finished all the steps on RocketfuelToKnits04:24
mpt_And now I've merged rocketfuel into MaloneSimplifications04:24
mpt_and got a conflict04:24
mpt_and the conflict's MERGE-SOURCE is something that's from neither rocketfuel *nor* MaloneSimplifications04:25
mpt_it's from a separate branch04:25
mpt_spiv?04:26
mpt_Yes, now MaloneSimplifications branch is full of code from the other branch04:27
mpt_Is there a missing step 6 in those instructions?04:27
mpt_jamesh: any ideas?04:48
jameshmpt_: what commands did you run exactly?04:49
mpt_Exactly the commands given on RocketfuelToKnits04:50
mpt_and then04:50
jameshso what command produced the "-537 revision(s) pulled." message?04:50
mpt_2006-03-MaloneSimplifications> bzr merge ../rocketfuel/04:50
mpt_The -537 was a long time beforehand04:51
jameshif it was from the "bzr pull --overwrite" command, then that might be expected04:51
mpt_sure, you explained that04:51
mpt_I don't think it's related to my problem at all.04:52
jameshit basically reports (# of revisions now - # revisions before)04:52
jameshso bzr picked a weird merge base04:52
mpt_My problem is that my copy of rocketfuel now contains stuff from one of my branches.04:52
jameshokay.04:53
mpt_Which doesn't really surprise me, since I used "bzr pull --overwrite" from the branches into rocketfuel04:53
jameshwhen you were upgrading your branches, did you do the "bzr pull --overwrite" stuff onto a copy of rocketfuel-built, or the main copy you use?04:54
mpt_but when I asked about that yesterday, spiv and lifeless said it was fine04:54
dilysMerge to devel/launchpad/: [r=bjornt]  Fix bug #36420 (archive-cruft-check redesigned, old script kept for tests), fix bug #41600 (buildd-sequencer crashes, add socket_timeout config option), fix SPR.getBuildByArch() (using selectFirst properly), merge elmo's sync-source fixes. (r3568: Celso Providelo)04:54
UbugtuMalone bug 36420 in qprocd "archive-cruft-check broken" [Critical,In progress]  http://launchpad.net/bugs/3642004:54
mpt_jamesh: I don't understand that distinction04:54
mpt_I keep one copy of rocketfuel-built to merge from. I don't change it directly.04:54
jameshmpt_: when you do "bzr pull --overwrite foo", you are overwriting the branch history of the current branch with the history of "foo"04:55
jameshso you'd be modifying rocketfuel-built04:55
mpt_I know04:55
mpt_that's why step 2 seems so strange04:55
jameshif you've done all the upgrades, just rsync down rocketfuel-built again to get it back to normal04:56
jameshstep 2 says "Pull your branch into your rocketfuel-built (or a copy of it),"04:56
mpt_yep04:57
mpt_and when I went through this yesterday, I pointed out that this would mean that the second branch I did would end up with the history of the first and second branches04:57
mpt_and that the third branch I did would end up with the history of the first, second, and third branches, and so on04:58
mpt_and that that seemed strange04:58
jameshthere are two concepts of "history" here04:58
mpt_so was it wrong after all?04:58
jameshsee this picture: http://blogs.gnome.org/attachment/jamesh/2006/04/23/0/bzr-repo.png04:58
jameshthink of each of the nodes in the graph as a particular state of your source tree04:58
jameshthe blue line indicates the line of development you've taken in your branch04:59
jameshand the collection of all the nodes includes stuff you've merged05:00
jameshso with the instructions on the RocketfuelToKnits page, the last branch will contain the history of the other branches in the sense that those nodes will be in the branch's internal repository05:00
jameshbut it won't contain the history of those branches in the sense of the blue line indicating the line of development for the branch05:01
mpt_ok05:01
jameshdoes that make things clearer or less clear?05:01
jamesh:)05:01
mpt_so the other branches now have records of the changes, but not the changes themselves05:01
jameshthe changes of your other branches wouldn't be in the linear branch history, no.05:02
jameshthe reason for the complicated steps on the RocketfuelToKnits page is that converting weave data to knits is expensive05:02
jameshthe already converted version of rocketfuel contains most of the tree states as your local branches in knit format05:03
mpt_So, RocketfuelToKnits is missing a final instruction: "When you've converted all your branches, rsync your copy of rocketfuel-built again so that it doesn't contain code from any of your other branches."05:03
mpt_Is that accurate?05:03
mpt_"rsync down", even05:03
jameshso the "pull --overwrite" command just adds the missing nodes as knit data so it can trace the blue line for that branch05:04
jameshwhich is cheaper05:04
jameshthat sounds accurate.05:04
=== doko [n=doko@201.160.17.131.cableonline.com.mx] has joined #launchpad
mpt_thanks jamesh05:12
mpt_ok, next question:05:12
mpt_"To push a standalone knit branch to chinstrap the first time..."05:12
mpt_Is that necessary for existing branches, or just newly-created ones?05:12
spivmpt_: sorry, was afk for a bit.  You and jamesh are right, I'll update the instructions.05:14
spivOh, someone beat me to it :)05:14
jameshmpt_: after having upgraded your branch to knit format, basically all the revision control files have changed05:14
mpt_:-)05:14
jameshmpt_: if you don't mind pushing 200MB+ for each branch, you can ignore it :)05:15
mpt_oh, so I should do it anyway05:15
jameshthe idea is to put something similar to the branch in place on chinstrap, so that when you rsync your branch you are only sending the differences05:15
mpt_assuming that the changes in each of my branches are less than 200 MB :-)05:16
mpt_right05:16
spivmpt_: "bzr push" will preserve the format of an existing branch, so it would push your local knit branch to a remote weave branch if it already existed, which would be massively slow.  So you should do it for every converted branch you want to push.05:16
mpt_ok05:16
mpt_so maybe it should be step 6?05:16
jameshspiv: good point. Hadn't thought of that ..05:16
spivProbably, I only added that note quickly last night before I went to bed.05:17
mpt_spiv, and it has an error05:18
spivIdeally, we'd use repositories...05:18
mpt_bash: /home/warthogs/archives/rocketfuel.knits/launchpad/devel/: is a directory05:18
mpt_stray slash?05:18
mpt_two stray slashes?05:18
jameshmpt_: did you do "cp" or "cp -a"?05:18
mpt_ahaha05:19
mpt_I did "-a"05:19
spivThe trailing slash shouldn't matter.05:19
mpt_Yes, the problem wasn't the missing "-a", it was the missing "cp"05:19
spivOh, right :)05:19
jameshmpt_: thanks for cleaning up some of the text on the WokringWithSharedRepositories page05:20
mpt_Well, lifeless asked me to read it, so I was just practising05:22
mpt_"bzr: WARNING: This transport does not update the working tree of: sftp://chinstrap.ubuntu.com/home/warthogs/archives/mpt/launchpad/trivial/"05:30
mpt_Then what *does* it update?05:30
jameshthe repository data and the branch data05:32
jameshi.e. the stuff that pqm cares about05:32
mpt_ok05:32
=== elmo [n=james@83-216-156-21.jamest747.adsl.metronet.co.uk] has joined #launchpad
=== jsgotangco [n=jsg@210.4.38.43] has joined #launchpad
=== tambaqui [n=tambaqui@201.160.20.136.cableonline.com.mx] has joined #launchpad
=== stub [n=stub@ppp-58.8.2.77.revip2.asianet.co.th] has joined #launchpad
=== stub [n=stub@ppp-58.8.2.77.revip2.asianet.co.th] has joined #launchpad
=== olive [n=olive@pigeon.moostik.net] has joined #launchpad
=== Keybuk [n=scott@quest.netsplit.com] has joined #launchpad
=== mpt__ [n=mpt@203.109.220.214] has joined #launchpad
=== dsas [n=dean@host81-129-228-205.range81-129.btcentralplus.com] has joined #launchpad
=== Burgundavia [n=corey@ubuntu/member/burgundavia] has joined #launchpad
mpt__lifeless: When will PQM be available again?07:01
=== fabbione [i=fabbione@gordian.fabbione.net] has joined #launchpad
=== BjornT [n=bjorn@clt-84-32-240-183.dtiltas.lt] has joined #launchpad
=== ..[topic/#launchpad:lifeless] : https://launchpad.net/ | developer meeting: Thu 18 May, 1200UTC (wiki:MeetingAgenda) | launchpad-users@lists.canonical.com (wiki:MailingLists) | Channel logs: http://tinyurl.com/72w39
=== BjornT [n=bjorn@clt-84-32-240-183.dtiltas.lt] has joined #launchpad
=== BjornT [n=bjorn@clt-84-32-240-183.dtiltas.lt] has joined #launchpad
=== BjornT [n=bjorn@213.226.190.253] has joined #launchpad
=== mpt [n=mpt@203-173-174-236.bliink.ihug.co.nz] has joined #launchpad
mpt"bzr: ERROR: Parent directory of sftp://chinstrap.ubuntu.com/warthogs/archives/mpt/launchpad/2006-03-MaloneSimplifications/ does not exist."08:09
spivmpt: That's right.08:10
spivmpt: You're missing a /home08:11
mpta-ha08:11
spivIt would be nice if it said which part of the path specifically was causing the problem...08:12
spivAlthough I think that's hard to do 100% correctly, because it optimistically tries the full thing, and the error the SFTP server sends doesn't contain that information.08:12
mptspiv: If you're using --overwrite, what's the point of the ssh chinstrap cp... before it?08:15
spivmpt: overwrite won't make it push what's already there.08:16
mptSo how does --overwrite differ from not overwriting?08:16
mpt"Ignore differences between branches and overwrite unconditionally"08:17
spivIt just tells it to continue even if the branch you are pushing to has a different history to yours.08:17
mptah08:17
mptand knits vs. weaves = different history08:17
spivSpecifically, if the rocketfuel you cp from is more recent than when your branch branched off rocketfuel, the push would refuse to work without --overwrite.08:18
spivBecause you would be overwriting revisions that aren't in the branch you're pushing.08:18
spivIt's not about knits vs. weavs.08:18
spivweaves, rather.08:19
mptok08:19
spivIt's about bzr refusing to overwrite revision 1234 with a different revision 1234 by default.08:19
spivThe help for --overwrite probably ought to be clearer that it's talking about overwriting revision history, rather than talking about just blinding sending everything.08:20
spivs/blinding/blindly/08:21
=== spiv sets up some repositories
spivOr a repository, I should say...08:22
=== mpt_ [n=mpt@203-173-174-236.bliink.ihug.co.nz] has joined #launchpad
=== mpt__ [n=mpt@203.109.220.214] has joined #launchpad
mpt__spiv: I lost my Internet connection while pushing, and now I get "bzr: ERROR: Lock error: File 'branch-lock' already locked"08:29
mpt__Should I just delete that file?08:29
spivmpt__: try the "bzr break-lock" command.08:29
spivI've never bumped into this myself, though, so I'm just making educated guesses :)08:30
jameshspiv: one thing to note: doing an sftp push of a branch inside a shared repository can cause some sections of the ~/.bazaar/branches.conf file to be shadowed (if you use the pqm-submit config I gave on the WorkingWithSharedRepositories page)08:38
BjornTSteveA: ping08:39
jameshit creates an entry for $repository/$branchname giving the push location, and bzr doesn't look at sections for parent directories08:39
SteveABjornT: hi08:41
Keybukhi guys,08:41
SteveAhello scott08:42
Keybukjust to give you an idea of the problem caused by that "sourcepackagenames exist for things that aren't source packages" bug08:42
Keybukhttp://people.ubuntu.com/~scott/reports/unpublished.html08:42
Keybukwe've got 182 bugs assigned to them at the moment :-/08:42
=== sfllaw [i=sfllaw@debian/developer/coleSLAW] has joined #launchpad
BjornThi SteveA. just wanted to make sure you were awake. i'm leaving my place now, so i'll be at your place in 20 minutes or so depending on traffic.08:42
SteveAokay, fine08:44
mpt__hmm, that didn't work09:03
=== rpedro [n=rpedro@87-196-70-18.net.novis.pt] has joined #launchpad
Keybukdo people in here know about schooltool ?09:04
lifelessfsvo about09:05
mpt__bah09:05
Keybuklifeless: it's sitting in main, but begging to be moved to universe09:06
lifelessits python right ;)09:06
lifelessSteveA is probably the most aware of the circumstances/policy about it09:07
Keybukit doesn't appear to be seeded anymore09:07
SteveAhello scott09:07
Keybukdon't know if it ever has been09:07
SteveAi know a little about schooltool09:07
lifelessits a tool09:07
lifelessfor schools.09:07
lifeless^ a little ^09:07
sivangmorning all09:07
Keybukhmm, that's odd actually09:08
Keybukedubuntu-server depends on it09:08
SteveAi haven't followed recent development09:08
Keybukoh,09:08
Keybukschool*bell*09:08
Keybukwhat's that one? :p09:08
SteveAschoolbell is a product based on schooltool, a cut-down version that just does calendaring09:08
jsgotangcohmm that's odd if ubuntu-server depends on them09:09
SteveArather than calendaring + attendance for schools + other schools stuff09:09
Keybukok, it's that that's fallen out09:09
KeybukI should probably just seed it somewhere, yes?09:09
Keybukit should be in main and not universe?09:10
=== raphink [n=raphink@ubuntu/member/raphink] has joined #launchpad
SteveAi guess so.09:10
SteveAubuntu is the primary distribution channel for schooltool09:10
Keybukit looks like schooltool used to depend on schoolbell09:11
SteveAjinty would know more09:11
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
SteveAmpt: hello09:14
stubBah - 14kb/s from chinstrap via ssh :-(09:15
Keybukyeah chinstrap is poorly today09:15
SteveAjamesh: we're due to have a call sometime soon, to talk about review processes09:15
Keybuk 08:15:55 up 89 days, 15:27,  5 users,  load average: 5.58, 4.91, 4.4909:16
SteveAKeybuk: what's up?09:16
jameshSteveA: yeah.09:16
jameshKeybuk: we did the knit upgrade yesterday, so I guess everyone's branches are churning09:16
Keybukthat's what I figured09:16
SteveAyou mean, lots and lots of rsync and disk IO?09:17
SteveAwhat does user archvsyn do?09:17
SteveAjamesh: so, skype call?09:21
jameshseems to be rsyncing launchpad logs from gangotri09:22
jameshSteveA: okay09:22
lifelesstop shouls 87 % in IO wait09:24
lifeless*shows*09:24
lifelessbzr conversions are memory hungry, but there is no python in top-sortyed-by-memory09:25
=== freeflying [n=freeflyi@ubuntu/member/freeflying] has joined #launchpad
lifelesslots of rsyncs though ;)09:25
lifelesshowever, I think aide is the culrpit09:25
freeflyingneed help. can not sign COC  error:str: The signed text does not match the Code of Conduct. Make sure that you signed the correct text (white space differences are acceptable).09:27
=== carlos [n=carlos@175.Red-88-9-38.dynamicIP.rima-tde.net] has joined #launchpad
carlosmorning09:28
freeflyingcarlos: hi, why can't Isign coc now? thx09:29
carlosfreeflying: I guess your problem could be https://launchpad.net/products/launchpad/+bug/3954709:30
UbugtuMalone bug 39547 in launchpad "Code of Conduct 1.0.1 signatures not accepted" [Critical,Confirmed]  09:30
carlosSteveA: hi, around?09:30
freeflyingcarlos: thx, just the same09:31
mpthi SteveA 09:40
=== `6og [n=kgoetz@ppp202-110.lns1.adl4.internode.on.net] has joined #launchpad
=== malcc [n=malcolm@host81-154-31-97.range81-154.btcentralplus.com] has joined #launchpad
=== mpt_ [n=mpt@203.109.220.214] has joined #launchpad
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
SteveAspiv: hello10:09
spivSteveA: hi10:09
SteveAspiv: shall we have a skype call?10:09
spivSure.10:09
carlosSteveA: mark's branch was rejected (and anyway, I was late for the rollout)10:13
carlosSteveA: I'm doing the knit migration to merge rocketfuel into that branch and solve any conflict I find10:13
=== freeflying [n=freeflyi@ubuntu/member/freeflying] has left #launchpad ["Konversation]
stubUsing sftp, will the 95Mb inventory.knit need to be pushed in entirety?10:23
lifelessstub: no10:24
lifelessstub: the 2M index is downloaded, the new data calculated, and then appended to the inventory.knit and new index entries appended to the index.10:24
stubBut can you do that on push with sftp?10:25
lifelessI'm describing what sftp push with knits does.10:25
lifelessWhat are you asking?10:25
=== mpt__ [n=mpt@203.109.220.214] has joined #launchpad
=== jinty [n=jinty@212.Red-83-54-75.dynamicIP.rima-tde.net] has joined #launchpad
stubI didn't think you could append with sftp. I'm wondering if I bzr push an updated branch to update a previous push, using sftp, if the entire inventory.knit will need to be shoved up ?10:27
lifelesssftp supports append10:28
stubok10:28
lifelesswhat will happen is that the 2M index is downloaded, the new data calculated, and then appended to the inventory.knit and new index entries appended to the index.10:28
carlosstub: hmmm, I see my branch with the needs-reply status... but I didn't get any email with the review10:29
stubI'll resend10:30
carloscould you resend it, please?10:30
carlosthanks10:30
carlosstub: are you working today, or still sick?10:30
stubworking10:30
carlosok, could you take a look to my email about the DELETE SQL commands?10:31
carlosstub: we should run all those SQL commands as soon as possible to close that issue with Kurdish10:31
=== Yannig [n=yannick@AToulouse-254-1-24-55.w81-250.abo.wanadoo.fr] has joined #launchpad
stubresent10:31
carlosstub: got it, thanks10:34
YannigHello everybody :)10:35
=== mpt_ [n=mpt@203.109.220.214] has joined #launchpad
carlosstub: btw, I sent you an email to have a meeting to talk about the RSS feature that will use that new API10:36
carlosstub: when would you have time to have such meeting?10:36
stubcarlos: I have two patches from you, one with a number of updates and a single delete. And another with just deletes. Both need to run?10:36
carlosthat will answer some of your questions raised on that review email10:37
stubcarlos: Now if you like.10:37
carlosstub: the second on with deletes is a modification of the single DELETE in the first patch10:37
=== Seveas [n=seveas@ubuntu/member/seveas] has joined #launchpad
carloss/on/one/10:37
stubok. So only run the updates from the first patch, and all the deletes from the second10:37
carlosstub: well, you can just execute the first one10:38
carlosstub: but the delete is really, really slow10:38
carlosI rewrote it with 25 differente deletes to reduce the amount of time we would have the table locked10:38
carlosbut it's still too slow10:38
carlosif you could give me a hint to reduce its execution time...10:39
carlosSteveA: do you have time now to talk about the RSS feature with stub?10:39
stubIt will be slow - it is a big table.10:39
carlosYannig: hi10:39
carlosstub: will that lock Rosetta?10:39
stubMaybe10:39
SteveAeven if you run it with no isolation?10:40
SteveAoh, you're not talking about the RSS output being slow10:40
stubSteveA: The individual queries will each take a few minutes.10:40
SteveAyou're talking about the update sql patch thing being slow10:41
carlosSteveA: no, sorry, talking about data migration too10:41
SteveAi can talk about RSS now10:42
carlosok10:42
stubSo I said we need a mockup of the RSS feed we are after, and then I could review the appropriateness of the API.10:42
carlosstub: the idea is to prepare an RSS feed with latest updated POTemplate10:43
stubI'm not sure what sort of an RSS feed people wanted by reverse engineering the API changes10:43
carlosthat way, translators would subscribe to it to know when new strings appear10:43
stubThat is vague. We need a mockup. Just .txt will do10:44
SteveAcarlos: so, can you prepare a short amount of text, in a chinstrap pastebin10:44
SteveAthat explains what you want to see in an RSS reader?10:44
SteveAlike 10:44
carlosso the RSS feed would use IPOTemplate.title as its title and the URL canonical_URL(potemplate)10:44
SteveA--------10:44
carlossure10:44
SteveA11 July 2006: Foo uploaded whatever <--- link to http:///.....10:44
SteveABy John Smith10:44
SteveAWhatever10:44
SteveA--------10:44
SteveAetc.10:44
=== ddaa [n=ddaa@nor75-18-82-241-238-155.fbx.proxad.net] has joined #launchpad
carlosSteveA, stub: https://chinstrap.ubuntu.com/~dsilvers/paste/fileA8eN9F.html10:47
carlosI guess it would be more or less that way10:48
carlosall that information is stored inside the POTemplate object10:48
carlosand the API I added is returning a list of all POTemplates we have10:48
stubSo we will have an RSS feed per (distribition, sourcepackage), or is it just coincidence that your mockup only contains one sourcepackage?10:49
carlosleaving to the RSS feed code the decision of the amount of potemplates to show10:49
ddaahello10:50
carlosstub: well, I wrote it so we could have an RSS feed for the whole system and others specific to a distrorelease, a productseries or a distrorelease and sourcepackagename10:50
carlosstub: it depends on the context object we use, IPOTemplateSet or IPOTempalteSubset10:50
carlosddaa: hi10:51
stubI'll need to go over your code and estimate how expensive it is doing these queries on request. I suspect we will need to refactor it to use events and a message store similar to what was specced for RSS feeds in Brazil.10:52
carlosstub: I added the new field to the POTemplate object so we only need to use one table to get the information and reduce the query time10:54
carlosthe new field is a cached value with the last date when it was updated10:54
carlosso I guess it depends on the amount of potemplates we have in our database10:54
SteveAstub: this is meant to be a quick fix for a communication problem we have right now10:58
SteveAso, if it will work, i'd like to get something out without refactoring, then refactor later10:58
stubWhat does 'updated template' actually mean might have happened?10:59
SteveA(that is, assuming that refactoring is time consuming)10:59
carlosstub: we got a .pot upload into the system11:00
carlosstub: that is newer than the previous upload11:01
carlosso we accepted it to be imported into the system11:01
stubA pot upload will not delete the previous pot? The old one is still there?11:01
carloswell, not delete but update11:02
carloswill add/remove strings from the previous one11:02
stubI'm more interested in what a user sees if their RSS reader is polling every 60 minutes, and several uploads of the same potemplate were made during that period.11:03
carlosonly the latest one will appear11:04
carlosso yes, it's a removal from that point of view11:04
stubWill the new POTemplate get a new id?11:07
carlosno11:07
stubThis is making the RSS feed generator much more complex, and only applicable to this particular feed - it will need rewriting for future feeds.11:08
stubEach article will need a unique, unchanging id. We can't use the id's we have in the database, as they are mutating. And we also have to store publication dates and such too.11:09
SteveAstub: so, you think using an events-table would be simpler?11:09
stubAn events table will mean the feed generator will work on anything that can fill in a similar structure, and the table will also be usable for emailing noifications, or pushing notifications out via other means such as IRC or Jabber.11:10
carlosstub: I don't understand this... you say that we need a unique ID11:10
stubWe need an events table anyway to store the information the RSS feed needs to be stable (article ids etc)11:10
carlosand we have such unique IDs11:10
carlosbut you also say that they will be mutating... why?11:11
carlospotemplate.id will not change at all11:11
stubEach article in an rss feed has a publication date, an id, title, and content. The id can't change. The publication date can't change (there is a different field for last changed).11:11
stubSo if you upload a potemplate 3 times, each article generated needs a stable and unique id and publication date.11:12
carloswe have that11:12
carlospotemplate.datecreated could be used as publication date11:12
carlosand then potemplate.date_last_updated as the last changed11:13
carloswould that be enough?11:13
carlosony date_last_updated will be changed with every update11:13
stubThat might work. It depends on if the readers support last changed well.11:14
stubI'll go over the RSS2.0 spec again quickly...11:14
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
carlosok11:15
stubWhat you are suggesting is we only ever publish a single feed item per potemplate, but update the information on each upload.11:15
carlosif that's possible, yes11:16
carlosI know nothing about RSS details11:16
carlosso I'm not sure if that's possible or not11:16
=== `6og is now known as kgoetz
stubHmm... no date changed in RSS. That must be Atom I was thinking of.11:22
stubIt might be possible to generate a guid using the POTemplate.id and last_changed - that should cover things.11:23
carlosstub: could I do anything to help there?11:25
stubNah.11:27
carlosok11:29
carlosI will apply your review changes11:30
stubJust need to figure out caching of the feed, so it only gets regenerated evey 30 mins or so.11:30
stubSo we don't want to generate the feed on the fly, or we reward people who set their refresh time to tiny amounts.11:34
stubWe can't pregenerate the feeds and serve them of the filesystem via Apache as there are too many of them.11:34
stubWe could use Squid to serve and cache the RSS feeds, but that adds another moving part to the Launchpad production environment.11:34
stubProbably the best option is to cache in the main PostgreSQL database.11:35
stubI'm still leaning towards maintaining an events table as described in https://wiki.launchpad.net/RssFeeds personally11:37
SteveAwe can cache rss in apache11:37
SteveAbut...11:38
=== WaterSevenUb [n=WaterSev@azevedo.astro.up.pt] has joined #launchpad
SteveAstub: if you want to implement RssFeeds, it looked mostly fine to me.  it needs a little updating though.11:38
uwsrss feeds are pretty straightforward to implement most of the time (i've done in several webapps)11:40
SteveAANNOUNCEMENT: launchpad development meeting in 2 hours.11:53
SteveAnow is a good time to ensure your activity reports are up to date.11:53
stubcarlos: The code is setting potemplate.last_update_date instead of potemplate.date_last_updated11:53
carlosstub: really? hmmm, I wonder if I forgot to run tests after that change...11:54
stubcarlos: I'm curious as to why we are setting it in the getLastTranslator method (a hidden side effect), and setting it to whatever was specified in the templates headers instead of the current time.11:54
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
carlosstub: it's not done inside getLastTranslator...11:55
carlosstub: it's done inside import_po11:55
stubYer - misreading diffs.11:55
carlosstub: about the value... that date is the actual date when the pot file was generated11:56
carlosthere could be a newer version with a newer date11:56
stubBut we can't rely on it because it is user input. Or at least we can't rely on it to be the actual time it was last modified.11:56
carloswell, it's supposed to be updated on .pot generation time11:57
carlosnot manually handled by the user11:57
carlosbut gettext11:57
stubWe are still trusting the remote environment and people to work the way you expect them to (rather than the way they want to, which might be different)11:58
carlosthe user handled field is for .po files not .pot files11:58
carlosstub: right11:58
carlosstub: so you think we should use current time instead?11:58
carlosok, I see your point and is a good concern11:59
carloswill do it that way11:59
stubIt all depends on what you want date_last_updated to store. If you want it to store the value from that header, it probably should be renamed and I can't rely on it for RSS feed generation (so we will still need a date_last_updated set to CURRENT_TIMESTAMP anyway)11:59
stubWe definitely want a limit argument passed into the new methods, which is propagated through to the select() calls.12:00
stubWhich I guess means the methods should also be renamed, removing the 'All'12:01
ddaacarlos: re users-don't-read12:02
ddaacarlos: maybe the default for that selector should be "I don't know", then12:02
stubOr If I do foo.select(blah)[:200] , does that issue the SQL with a LIMIT command? 12:04
stubc/command/clause/12:05
stubGeez... my rocketfuel-built rsync is still syncing. 3 hours!12:06
ddaayowzer, it would probably have been faster for you to download it as a tarball12:07
ddaainteresting12:08
ddaajust compared rsync and nested-pull (a trivial script that does pull on every nested tree) for rocketfuel built12:08
ddaarsync ran in 1 min 30s12:08
ddaapull ran in 1 min 20s12:08
ddaa(wallclock time)12:09
carlosstub: it should, yes12:10
carlosstub: I'm returning a selectresult12:11
stubcarlos: No need for the limit argument - slicing the select results issues the SQL with the LIMIT12:11
stubok12:11
carlosstub: about the date field, I will do what you suggest, that field is specific for the RSS feature12:11
carlosno need to have the header value parsed12:11
stubok. Will it get updated if someone uploads an identical potemplate?12:12
carlosddaa: it's already the default12:12
ddaahehe hehe hehe12:12
stubThe TranslationSubscriptions spec was using a checksum to detect rather than a timestamp.12:12
ddaacarlos: okay, that why this quote is funny12:12
carlosstub: yes, it will be updated12:12
ddaait's not obvious from just the quote12:12
carlosddaa: ;-)12:12
carlosddaa: ok, I will update it to show that fact12:13
carlos;-)12:13
stubcarlos: Do we care if we tell users that the template was updated when it actually hasn't been modified at all in this particular case? I suspect it wouldn't happen often?12:13
stubWill we ever be doing bulk potemplate uploads that could cause this case?12:14
carlosstub: I think is ok to do it that way until we implement the checksum thing you noted12:14
stubok12:14
stubcarlos: I think we can run with what we have after you have fixed the naming of the column and the typo I mentioned earlier. If we want to make the feed richer though (eg. '44 new message id's added, 12 removed' etc.) we will need to refactor.12:15
carlosyeah, I know12:16
carlosbut the idea is to provide a basic functionality, so it's ok to go with what we have atm12:16
stubSteveA: Are you sure our Apache is capable of caching?12:17
SteveAi'm sure it can be made so by the admins12:18
SteveAthey've done it for the wiki sites12:18
stubCool. If they are doing the wikis, a few thousand RSS feeds shouldn't be a burden.12:18
lifelessif apache can't, we can always stuff squid in front12:18
lifeless:)12:19
SteveAthey're doing the ubuntu website, which is a moin wiki12:19
stublifeless: This is a quick hack. I've got other plans for doing this properly ;)12:19
lifeless2.6 is coming out very soon, with all the rproxy stuff in it. going to rock.12:19
carlosstub: Could you give me a patch number for my db patch?12:20
carlosstub: also, I assume that with the two changes you noted, I can request a merge into rocketfuel, right?12:20
stubThe db patch also needs an index added -- CREATE INDEX potemplate__date_last_updated__idx ON POTemplate(date_last_updated);12:21
stubcarlos: patch-40-56-0.sql12:23
carlosok12:23
carlosthanks12:23
stubr=stub12:23
jameshmpt: have you seen this? http://code.google.com/webtoolkit/12:23
stubcarlos: And file a bug for the RSS feeds so it doesn't get dropped12:23
carlosstub: ok12:24
carlosthanks12:24
SteveAjamesh: hah -- they implemented menus12:25
jameshSteveA: among other things, it lets you write code in Java and it translates it to javascript12:25
stubSounds similar to mochikit, but in Java.12:25
jameshSteveA: letting you use Java development tools to debug/test the code12:25
SteveAi see12:27
SteveABjornT: lunch?  ili pica across the road is quick and kinda edible12:35
BjornTSteveA: sure, sounds good.12:36
=== LeeJunFan [n=junfan@adsl-69-210-207-5.dsl.klmzmi.ameritech.net] has joined #launchpad
ddaastub: is there a config for the recently rolled out code?12:41
lifelessddaa: I did not update any configs.12:42
ddaathe branch-scanner config has been broken since the last rollout, but the last time I fixed it in place because there was not a production config and because merging anything was way too much pain anyway12:42
lifelessddaa: was not in the RolloutProcedure12:42
ddaaI'll add it then.12:43
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
ddaalifeless: updating the config should happen when creating the production branch12:49
ddaabut the "create the new production branch" step is not in LaunchpadRollout12:50
ddaaso I cannot add the "update the config" step12:50
lifelessddaa: so add both!12:51
ddaamh, thought that "create the production branch" bit was somewhere else12:51
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
=== ploum [n=ploum@ubuntu/member/ploum] has joined #launchpad
cprovgood morning, guys01:15
carloscprov: hey!01:18
cprovcarlos: yo, how is it going ?01:19
carlosburning my hard drive and my DSL line with the knits migration ;-)01:19
cprovcarlos: it's worth, I would not think twice, it's much faster 01:22
carlosyeah01:22
ddaaI'm sure we'll find something to bitch about, in time01:22
carlosI'm converting branches as soon as I need to merge from rocketfuel01:22
ddaabut right now, it feels great01:22
carlosddaa: but not now ;-)01:22
=== matsubara [n=matsubar@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
=== cprov looks for coffee, back in a minute
YannigI don't if you saw it when I told it last night but the Untranslated strings number does not change anymore since the server update (example: https://launchpad.net/distros/ubuntu/dapper/+lang/oc/)01:35
Yannig(only the general one: the counter for each template works fine)01:36
carlosYannig: those values are cached ones and I think they are updated once per day01:36
carlosso don't expect to get real time updates for it01:37
YannigFair enough :)01:38
YannigSo I'll stick to 99,62 % untranslated today :D01:39
SteveAlaunchpad meeting in 18 mins01:40
carlosYannig: I guess... not sure if it's executed more often01:41
carlosstub: ?01:41
carlosstub: talking about the cron job that update the cached statistics01:41
stubeh?01:41
carlosI don't remember how often is it executed01:41
Yannigcarlos> I thought it was done at once befoce yesterday, that's why (but I don't really mind, it's just stats :))01:41
stubdaily01:41
carlosYannig: perhaps yesterday's update was not executed due the production update01:42
YannigI should be able to survive :)01:43
carlosYannig: no, the update was executed today "They were last generated on 2006-05-18 at 07:20:57 CEST."01:43
carlosYannig: you can see it at https://launchpad.net/rosetta on the left portlet01:44
YannigOK01:44
YannigThanks a lot :)01:44
cprovstub: ping01:50
stubpong01:50
cprovstub: could you, please, copy a new production backup to mawson ?  don't override the current launchpad_dogfood DB right now01:51
SteveAmeeting in 7 mins01:51
stubok01:51
SteveAi'm going to take a workrave01:51
cprovstub: thank you 01:51
cprovstub: btw, could you double check the indexes are correcly installed, I suspect the last copy hasn't proper index, because the performance on publisher was much lower than production. I didn't have time to investigate it properly, though.01:54
=== raphink [n=raphink@ubuntu/member/raphink] has joined #launchpad
stubYou would have seen errors when restoring from the backup. Most likely, it is because production is running on 4 fast dual core AMD 64's with 32GB of RAM, and mawson isn't.01:55
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
cprovstub: yes, propably (with sarcasm :)01:57
carlosstub: hmm what are you going to do with the SQL commands to migrate data that I gave you?01:57
carlosare you going to execute it on production?01:57
stubcarlos: run them ;) I'll kick it off in a tick and we can see if rosetta is affected.01:58
carloslifeless: I cannot believe it... did you added the Hackergotchi images to pqm.launchpad.net? dude!! that's sooo sweet (well, the links are broken, but I love the idea :-P)01:59
carlosstub: ok, thanks01:59
lifelesslooks like a quoting bug01:59
lifelessits just test output01:59
SteveAhello01:59
lifelessprobably failing tests01:59
SteveALAUNCHPAD DEVELOPERS MEETING02:00
carloslifeless: ooh... well, it's a good idea anyway ;-)02:00
SteveAwelcome to this week's launchpad development meeting02:00
SteveAstarting at 3.01pm sharp, vilnius time02:00
SteveAwho is here today?02:00
mptme02:00
malccme02:00
bradbme02:00
ddaame02:00
carlosme02:00
BjornTme02:00
lifelessoi oi oi02:00
cprovme02:01
spivme02:01
stubme02:01
jameshme02:01
salgadome02:01
YannigI'm here too, but I may not be necessary :p02:01
kikome02:01
matsubarame02:02
SteveAjordi: ?02:02
kikohow is everyone?02:02
malccI tried to switch on my brain this morning, it said: No swap space02:02
stubsore02:02
malccOther than that, fine :)02:02
mptI made the mistake of having a nap, and I started dreaming about Launchpad02:02
SteveAnever the second clown, don't you?02:03
SteveA== Agenda ==02:03
SteveA * Roll call02:03
SteveA * Agenda02:03
SteveA * Next meeting02:03
SteveA * Activity reports02:03
SteveA * Actions from last meeting02:03
SteveA * Launchpad oops milestone report02:03
SteveA * Outstanding sysadmin requests02:03
SteveA * Production and staging (stub)02:03
SteveA----02:03
SteveA * Are we all using bzr and bzrtools from dapper (kiko)02:03
SteveA * Status of bugwatches work (bjorn)02:03
SteveA * Result of converting to knits (steve)02:03
SteveA----02:03
SteveA * Keep, Bag, Change02:03
SteveA * Three sentences02:03
SteveA02:03
SteveAnext meeting, same time next week02:03
=== SteveA allows 10s to object while he removes a teabag from a teacup
kikolet's have it at midnight UTC!!11!02:04
=== mpt scowls at kiko
=== ..[topic/#launchpad:SteveA] : https://launchpad.net/ | developer meeting: Thu 25 May, 1200UTC (wiki:MeetingAgenda) | launchpad-users@lists.canonical.com (wiki:MailingLists) | Channel logs: http://tinyurl.com/72w39
kikook let's have it at the same time as usual then02:04
SteveAit is done02:04
jameshmpt: that's like midday for you02:04
SteveA * activity reports02:05
mptup to date02:05
ddaauptodate02:05
kikoas usual02:05
BjornTup to date02:05
salgadoup to date02:05
bradbup to date02:05
cprovup to date02:05
jameshsent a summary for this week02:05
matsubaraup to date02:05
spivup to date02:05
lifelessup to date02:05
SteveAi sent a summary of my activity this week, so if i send today's i'll be back on the straight and narrow02:05
malccup to date02:05
stubup to date02:05
carlosup to date02:05
malccYay woo, go us, we rock, etc.02:06
SteveAis that a full house (allowing for summaries?)02:06
SteveAcool02:06
SteveAwell done everyone02:06
carlosjordi: up to date02:06
SteveAjamesh: be sure to send in today's activity report02:06
SteveAthanks carlos 02:06
SteveA * Actions from last meeting02:07
SteveA * '''kiko''' to talk to bzrtools and bzr packagers to sort out this nonsense02:07
kikoit's been done as you saw via email02:07
SteveAdo we have consistent compatible bzr and bzrtools in dapper now?02:07
SteveAyay02:07
kikohas everyone upgraded to bzr-in-dapper?02:07
SteveA * Launchpad oops milestone report02:07
SteveAmatsubara: take the floor!02:07
kikooops jumped the gun02:07
matsubaraWe're seeing bugs like 1887 and 44834 (Out of order SQL queries). stub, spiv?02:07
SteveAbug 188702:08
SteveAbug 4483402:08
matsubarawhere's ubugtu when we need it?02:08
spivI wish I had even half a clue about how that happens.02:08
matsubaraboth a private02:08
matsubaras/a/are02:08
SteveAI'd like Ubugtu to give the bug URL nonetheless, in these cases 02:08
stubHaven't looked further into this. As far as we can tell, it is impossible. It has not been reproduced in a controlled environment.02:08
matsubaraso, I should just ignore it when it hits the oops report?02:09
SteveAwould having the value of locals up the stack be any help diagnosing this from oopses?02:09
SteveAor any other particular diagnostic data?02:09
=== zorglub [n=zorglub@wahe.diwi.org] has left #launchpad []
kikocould it be server overload?02:09
matsubarawhat can I do that might help?02:09
salgadocan't this be the same issue with the merge people test that is failing randomly?02:09
stubI'm at a bit of a loss on what we can do to debug this further.02:09
stubsalgado: Yes - quite likely.02:09
SteveAkiko: i don't think so.  it seems like a correctness issue.02:10
SteveAcorrectness shouldn't suffer when the server gets loaded02:10
spivkiko: I'd say only if postgres has extremely wierd and subtle bugs.02:10
SteveAalthough, perhaps it could be that python does more gc when memory is tight02:10
kikommmm. yeah, but maybe it happens only when there is pressure on the server. random guess, anyway02:10
SteveAnot sure about that though02:10
SteveAor if there's more blocking on IO02:10
SteveAso more time to do gc02:10
kikohaving the loadavg would be ideal in the OOPS report02:11
kikoit's clear that out02:11
spivIt's interesting that it only tends to affect certain pages, rather than randomly victimising everything.02:11
jameshIIRC, the Python GC is only triggered by creating/deleting objects02:11
kikoof course, having  the loadavg of the /database box/ may be even more useful02:11
kikospiv, well, the pages which are used the most, it appears, no? standard statistical spread?02:11
spivjamesh: And calling gc.collect(), but otherwise that's my understanding too :)02:11
SteveAi don't think it is a database box issue -- i think it is more likely that sqlobject makes things less correct02:11
SteveAthan we have a correctness problem in postgres02:11
stubkiko: loadavg will not be interesting. cpu utilization maybe, but my gut feeling is that this isn't a client issue.02:12
jameshGiven the way the SQL statement log is recorded, it can't be a multithreading issue02:12
SteveAstub: isn't a client issue?02:12
jameshit only records statements from one thread02:12
spivkiko: Hmm, I don't think so, there isn't enough randomness to the victims.02:12
kikospiv, +translate is the usual victim, no?02:12
stubSteveA: Unless our logging is screwed - IIRC when I checked, the queries were being sent correctly to the server.02:12
kikowhich is by far the most hit page02:12
kikowhich does writes anyway02:12
SteveAstub: i'd like to have a voice call with you about this after the meeting02:12
matsubarakiko: yes, but it happened too in +editstatus02:13
stubok02:13
SteveAok02:13
SteveAtime to move on02:13
matsubaramoving on02:13
kikomatsubara, second page most hit I suspect02:13
kikoyes let's02:13
SteveAmatsubara: anything else on the oops report?02:13
matsubaraRetry Exceptions still happening and bug 31479 would help diagnose the real problem. spiv?02:13
UbugtuMalone bug 31479 in launchpad "Retry exceptions should include information about the original query" [Normal,Confirmed]  http://launchpad.net/bugs/3147902:13
matsubarayes lots of things02:13
jordihi02:13
SteveAhi jordi.02:13
matsubaraSteve's patch to tickcount. Steve asked me to test it, but I don't know C enough to understand what the patch does, so I'm not sure if I'm the right person to do it.02:13
SteveAordi: carlos said you're up to date with activity reports02:13
matsubaraOutstanding Timeouts (bugs 2497, 3991, 6459) all assigned to kiko.02:13
jordisorry I'm late, I was in some other nmeeting02:13
UbugtuMalone bug 3991 in rosetta "Timeout error on translation page (+translate)" [Normal,Confirmed]  http://launchpad.net/bugs/399102:13
UbugtuMalone bug 6459 in rosetta "SoftTimeout error on distribution release language page" [Normal,Confirmed]  http://launchpad.net/bugs/645902:13
jordiSteveA: I'm up to date.02:14
kikomatsubara, this week I'll have some coding time, fingers crossed02:14
SteveAmatsubara: i spoke with kiko, and you have other things to do.  i'll get someone else to do it.02:14
matsubaraFrom the QA side, while triaging I noticed bug 43263. Rosetta can't handle Dapper Universe packages, so is it difficult to add some page that tell people to not report bugs asking to add the templates? Currently users end up in a page that tells them to ask the inclusion of the template via Rosetta list or reporting a bug.02:14
matsubaraI'd like to suggest that malcc be assigned to bug 44914, since he's working on soyuz and he could do that while getting confortable with the code.02:14
UbugtuMalone bug 43263 in rosetta "No translatable templates for Dapper Universe packages" [Normal,Rejected]  http://launchpad.net/bugs/4326302:14
spivmatsubara: 31479 is on my todo list, but I'm unlikely to get to it until late next week.02:14
UbugtuMalone bug 44914 in soyuz "Updade soyuz tests to use Zope 3.2 style " [Normal,Confirmed]  http://launchpad.net/bugs/4491402:14
malccI'm happy to take 4491402:14
kikomatsubara, great suggestion!02:15
kikocarlos, what do you say about dapper/universe?02:15
kikomalcc, thanks!02:15
carlosmatsubara: well, the thing is that edgy will have universe imported02:15
carlosmatsubara: we are going to add a feature to solve the problem that prevented us to import universe02:16
SteveAbug 3147902:16
UbugtuMalone bug 31479 in launchpad "Retry exceptions should include information about the original query" [Normal,Confirmed]  http://launchpad.net/bugs/3147902:16
carlosI'm preparing an announcement about dapper translations, I will add there an explanation about it anyway and jordi should add an entry to our FAQ explaining it02:16
carlosjordi: ^^^ 02:17
jordiexplaining wghat?02:17
jordioh I see02:17
jordithat dapper has no universe in rosetta02:17
jordiokie dokie02:17
carlosright02:17
matsubaracarlos: great. shouldn't be a problem then. and edgy will open soon, right?02:17
carlosjordi: thanks02:17
carlosmatsubara: as soon as dapper is released02:17
jordiyeah, we hope the edgy process will be smooth from the beginning02:18
kikookay then.02:18
SteveAmatsubara: anything else?02:18
matsubaraI'm done SteveA , thanks02:18
SteveAthank you matsubara 02:18
cprovmalcc: glad you assume 44914, i can help, since there is a lot and I need to learn more about new test style02:18
SteveA * Outstanding sysadmin requests02:18
SteveA602:19
SteveA502:19
SteveA402:19
SteveA302:19
stubshipit urls02:19
SteveA202:19
SteveAstub: what's that?02:19
stubWhich is new, but I suspect urgent02:19
SteveAgot an RT number?02:19
stubNo - lifeless CC'd it. 02:19
spivpushsftp log file access (rt #8372)02:19
stubAnd I can't mention details in public02:19
SteveAstub: i saw that karl fixed some vhost thing recently.  is that it?02:20
kikostub, hasn't it been handled yet?02:20
spivIt's progressed slightly since last week, but it's still outstanding.02:20
SteveAspiv: when do you want rt 8372 to be done by?02:20
stubOh... seems to be working now.02:20
spivSteveA: sooner rather than later ;)02:20
SteveAspiv: when will you start work on that stuff?02:21
SteveAlike, monday, tuesday?02:21
spivSteveA: early next week would be great.02:21
stubshipit seems to be ready to announce then.02:21
SteveAokay02:21
SteveAMeetingAction: stevea to ask admins about rt 8372 to see if they can finish it before tuesday02:21
SteveA * Production and staging (stub)02:21
stubProduction was updated to HEAD about 10 hours ago by lifeless. This was primarily to get shipit-for-dapper landed. I believe we are still waiting for new DNS changes and Apache rewrites done before we can announce it is open and the new surprises.02:22
stubStaging is currently not being updated daily for shipit testing. Please let me know if I can switch the updates back on.02:22
stubErm... ignore the 'still waiting' but02:22
stubbit02:22
salgadostub, yes, you can swith the updates back02:22
stubta02:22
kikoyeah, shipit's already live02:22
SteveAon all hosts?02:22
SteveAall domains rather02:22
salgadoall02:22
kikoyes02:22
salgadowe even have requests from different domains02:22
SteveAcool02:23
kikoamazing02:23
kikolifeless, Znarl, salgado: outstanding work02:23
SteveAcarlos: you have the translation priority stuff that needs landing still02:23
carlosSteveA: it's on PQM again02:23
kikoSteveA, I think that could wait till next tuesday?02:23
SteveAokay.  so, we'll want that cherrypicked when it lands02:24
kikoI mean, we will have updates to go in by then02:24
carlosSteveA: lifeless offered to cherry pick it02:24
SteveAgreat02:24
SteveAkiko: please talk with me about that after the meeting02:24
SteveA * Are we all using bzr and bzrtools from dapper (kiko)02:24
kikoso, Are We?02:24
kikoI am02:24
bradbyar02:24
carlosI am02:25
BjornTme too02:25
mptme02:25
stubyer02:25
malccYup02:25
spivyep02:25
jameshyeah02:25
SteveAii  bzr            0.8-0ubuntu1   bazaar-ng, the next-generation distributed v02:25
SteveAii  bzrtools       0.8.1-0ubuntu1 Collection of tools for bzr02:25
ddaayup02:25
ddaawell02:25
kikoI know salgado and matsubara aren't but we will move them to dapper this week.02:25
ddaanot bzrtools02:25
salgadonot the most recent one, but I'll upgrade right away02:25
SteveA(I ran:  dpkg -l bzr bzrtools  )02:25
salgadowe're using a two weeks old version, or something like that02:25
SteveAkiko: done?02:26
kikoSteveA, yeah.02:26
SteveAthanks kiko02:26
SteveA * Status of bugwatches work (bjorn)02:26
=== ddaa rm's his bzrtools symlink
BjornTok02:27
BjornTOne branch (bugwatches-rework) I haven't been able to merge due to test failures in 30-mergepeople.txt. With that branch, a branch which is up for review, the bug watches work as according to the discussion in "Re: Immutable upstream task".02:27
BjornTWhen everything is merged i'm going to ask mpt to take a look at the UI, i'm sure it can be improved.02:27
BjornTkiko: btw, you were going to fix bug 42573, how's that going?02:27
UbugtuMalone bug 42573 in malone "Look in the debbugs archive when syncing bug watches" [Critical,Confirmed]  http://launchpad.net/bugs/4257302:27
kikoBjornT, I'll have time for coding this week, previous weeks have been very busy02:27
BjornTcool02:27
kikoBjornT, one question is: did you unconflict and attempt to remerge again?02:27
BjornTkiko: i'm resolving conflicts now, i'll try to merge again soon.02:28
SteveABjornT: if 30-mergepeople.txt fails again, please discuss it right away with me/stub02:28
BjornTwill do02:28
kikoBjornT, okay. I'd like to know if 30-mergie fails again02:28
SteveAi may need to put some tasks aside and do some sqlobject spelunking02:28
=== SteveA moves on
SteveA * Result of converting to knits (steve)02:29
SteveAany feedback on using bzr now that we've converted to knits?02:29
kikoknits are the future!02:29
bradbthe speed improvements have so far been very encouraging02:29
cprovbradb: +102:29
ddaagot a rsync-like performance on a test I ran this morning02:30
kikoddaa, for push you mean?02:30
ddaa(daily update of rocketfuel-built)02:30
ddaakiko: for pull02:30
kikorspush worked for me -- push did not02:30
salgadopush did work for me02:30
bradbm etoo02:30
spivkiko: interesting, someone should talk with you after the meeting and figure out why.02:30
mptCan someone help me push after the meeting? (I'm not strong enough)02:30
jameshworking fine for me02:30
carlosI guess we could do a bzr merge against rocketfuel instead of getting a local branch first, right?02:31
cprovyes, me too. progress bar still a bit obscure02:31
ddaacarlos: ?02:31
mptthere's a progress bar??02:31
carlosddaa: instead of fetching rocketfuel-build02:31
carloss/build/built/02:31
SteveAwho will help mpt after the meeting?02:32
carlosddaa: we could do a merge using sftp now, right?02:32
ddaacarlos: ha, yes02:32
ddaacarlos: looks like it would perform reasonably02:32
kikoI think it's very fast02:32
ddaathough I still find rocketfuel-built useful for keeping in touch with config changes02:32
lifelessddaa: for those of you in europe. latency will still make the brazilians and australians cry02:32
ddaacarlos: looks like it would perform reasonably for us who live on the right continent02:33
carlosok02:33
kikoha ha02:33
=== SteveA will find someone to help mpt, after the meeting
SteveAmoving on...02:33
SteveA * Keep, Bag, Change02:33
ddaagot one02:33
ddaaCHANGE: remove the redundant cruft from the launchpad configs. Only keep config entries for the machines where a system is deployed.02:34
mptCHANGE: stop mailing me translation import statistics every day02:34
mptIt's interesting information, but it should be on Launchpad (/distros/ubuntu/+translations), so non-Launchpadders can read it and Launchpadders don't have to02:34
kikoKEEP: translation import statistics! I definitely want to have that logged daily02:34
kikoit is vital information for keeping track of how the Dapper import/export process is working02:35
SteveAchange: use topics for the launchpad list02:35
mptSo, why not on Launchpad?02:35
=== slux [n=antti@82-203-196-131.dsl.gohome.fi] has joined #launchpad
carlosmpt: it will not make sense when all things are done02:35
kikompt, it's a little more complicated than that. if you are curious /msg carlos after the meeting.02:35
mptok02:35
ddaaKEEP: fast review02:35
=== SteveA does a countdown
sluxhow am I supposed to add comments to bugs on launchpad? clicking the link at the end of the page just jumps to the beginning...02:35
SteveA802:35
SteveA702:36
ddaaposted a cscvs review request yesterday, got a replay today. Still one outstanding though :)02:36
SteveA602:36
kikoslux, what browser? javascript on or off?02:36
SteveA502:36
SteveA402:36
SteveA302:36
ddaaBAG: sourcecode/ breakage AGAN02:36
SteveA202:36
lifelessddaa: bjornt just woke up ;)02:36
SteveA102:36
sluxkiko, Firefox 1.0.802:36
SteveAdone.02:36
sluxbreezy's latest02:36
=== niemeyer [n=niemeyer@200.138.41.159] has joined #launchpad
kikoslux, JS off by any chance?02:36
SteveAkiko, slux: the channel is about to become *very* noisy02:36
SteveAyou may want to continue elsewhere02:36
SteveA * Three sentences02:37
SteveAgo ahead, state your sentences02:37
mptDONE: MaloneSimplifications fixes, PageHeadings spec, bugfixes, knits02:37
mptTODO: land MaloneSimplifications(!!!), portlet trimming, menus, specs02:37
mptBLOCKED: no02:37
stubTODO: text searching, unless preempted by basic Rosetta RSS or impossible-sql-query-problem02:37
ddaaDONE: switched to importd/cscvs coding02:37
ddaaTODO: bugfixes to seamlessly handle CVS repo migrations, a ton of cscvs cleanups, bzr-native imports02:37
ddaaBLOCKED: bzr test failures blocks sourcecode/ merges _AGAIN_02:37
stubDONE: Mainly production stuff and did something nasty to my wrist02:37
stubBLOCKED: Nope02:37
salgadoDONE: ShipItForDapper, some small changes on the mirror prober02:37
sluxkiko, it's on02:37
salgadoTODO: Finish the new custom-request page for shipit and get it on production02:37
salgadoBLOCKED: No02:37
jameshDONE: supermirror pull list stuff, sprint scheduler work, convert to knits, WorkingWithSharedRepositories documentation, code reviews02:37
jameshTODO: finish sprint scheduler work, code reviews02:37
jameshBLOCKED: no02:37
BjornTDONE: improved the bug watch widgets. bug fixes. reviews.02:37
BjornTTODO: Work on my assigned bugs list, fixing the most important ones.02:37
BjornTBLOCKED: can't merge bugwatches-rework branch due to 30-mergepeople.txt failure.02:37
matsubaraDONE: oops report analysis, bug triage, oops bugs02:37
matsubaraTODO: more of the same02:37
matsubaraBLOCKED: no02:37
carlosDONE: PoMsgSetPage, API to add potemplate RSS, import queue review, bugs #35631, #38472, #44529, #37078, #41071, debugged and fixed a bug with the batching code while using it with POMsgSetPage02:37
carlosTODO: Fix tests after the migration of POMsgSetPage to the standard batching code, finish #35631 and a set of easy to fix bugs noted at https://wiki.launchpad.canonical.com/CarlosPerelloMarin, migrate translations from breezy to dapper02:37
carlosBLOCKED: No02:37
UbugtuMalone bug 35631 in rosetta "Karma handling on Rosetta is broken" [Major,In progress]  http://launchpad.net/bugs/3563102:37
UbugtuMalone bug 38472 in amarok "Korean instead of Kurdish imported into Rosetta" [Normal,Unconfirmed]  http://launchpad.net/bugs/3847202:37
UbugtuMalone bug 44529 in rosetta "Translation import queue query needs validation." [Normal,Rejected]  http://launchpad.net/bugs/4452902:37
malccDONE: Learnt more, fixed some bugs, finished startup admin02:37
UbugtuMalone bug 37078 in rosetta "+admin page for IPOTemplate is not working for Rosetta experts" [Major,Fix committed]  http://launchpad.net/bugs/3707802:37
UbugtuMalone bug 41071 in openoffice.org "All ooo-translations are overridden by the English originals" [Normal,Fix released]  http://launchpad.net/bugs/4107102:37
lifelessDONE: knit rf upgrade, various bzr tweaks and improvements.02:37
lifelessTODO: travel finalisating, europython talk abstract02:37
lifelessBLOCKED: No02:37
jameshkiko: with JS turned off, the form would never get hidden02:37
bradbDONE: Laptop died. Various bug fixes. Spent some time on implicit subscriptions.02:37
bradbTODO: Land implicit subs. Fix OOPS bugs as they appear.02:37
bradbBLOCKED: No.02:37
malccTODO: Learn more, fix more bugs, sprint with cprov next week02:37
kikoDONE: finished perf reviews, helped ShipIt definitions and rollout, upgrade trees, production report, architecting. 02:37
malccBLOCKED: No.02:38
jordiDONE: list Email, imports of new templates02:38
spivDONE: bug 44182, bug 44183, worked on bug 41414, reviews, knit upgrade, started ubuntu wiki stuff.02:38
spivTODO: ubuntu wiki stuff, make importd tests (and thus check_merge) pass with bzr 0.8, sftp server bugs.02:38
spivBLOCKED: No.02:38
UbugtuMalone bug 44182 in launchpad-bazaar "supermirror branch puller leaves empty branch when initial mirroring fails" [Major,Fix committed]  http://launchpad.net/bugs/4418202:38
kikoTODO: coding! some minor reviews and assist shipit post-rollout, catch up with team activity02:38
UbugtuMalone bug 44183 in launchpad-bazaar "supermirror branch puller does not preserve source branch format" [Major,Confirmed]  http://launchpad.net/bugs/4418302:38
UbugtuMalone bug 41414 in launchpad-bazaar "supermirror-branch-puller ignores format changes" [Major,Confirmed]  http://launchpad.net/bugs/4141402:38
SteveADONE: management, menus, review02:38
SteveATODO: menus, management, various02:38
SteveABLOCKED: no02:38
jordiTODO: clear Needs_Review in the queue, pending teams creations02:38
kikoBLOCKED: various email responses by stub, SteveA, cprov and others02:38
jordiBLOCKED: no02:38
kikoBLOCKED: on jamesh updating the error reports cron-runner too02:38
cprovDONE:archive-cruft-check redesign, queue-ui, various pending fixes in buildd-UI02:39
cprovTODO: sprint with malcolm, PPA design consolidation02:39
cprovBLOCKED: none02:39
SteveAkiko: please state your blocked issues in more detail02:40
stubI haven't got any kikograms flagged for response02:40
jameshkiko: I'll look at getting the weekly report thingee done tonight02:40
kikoSteveA, I can't remember all of them, but off the top of my head: experimental server, database removal analysis for source package names, some database optimization queries I sent in...02:41
stubOh - bogus sourcepackage stuff02:41
kikothere are other things, I need to look at my sent-mail02:41
kikoyeah02:41
kikostub, that's sore because the distro guys are very inconvenienced by this02:41
stubI responded to experimental server02:41
kikoonly you02:41
kiko- write access to staging02:42
kiko- milestones and upstreams02:42
salgadompt, can you have a quick look at bug 5812? (I'm sure you'll know what I can use to avoid the issue I mentioned in the last comment)02:42
salgadohttps://launchpad.net/bugs/581202:42
stubI never wanted the sourcepackagename table in the first place ;)02:43
kikoheh02:43
kiko- ppa-ng tables02:43
SteveAit's almost meeting ending time02:43
kiko(please please help with that)02:43
kiko(it is my coffin)02:43
SteveAokay, that's it02:44
SteveAnot even time for a countdown-of-dooom02:44
kikookidokie02:44
SteveAMEETING ENDS02:44
SteveAthanks everyone02:44
SteveAmpt: will you do the meeting summary again this week?02:44
mptnaturally02:44
ddaalifeless: you might have noticed that the bzr test suite fails in pqm02:44
SteveAthanks mpt02:44
ddaathat is blocking the cscvs merges, AGAIN02:44
lifelessddaa: well, as bzr.dev is managed by pqm, I haven't noticed that.02:45
SteveAspiv, jamesh, ddaa, lifeless: would one of you please help mpt with bzr push02:45
jameshSteveA: okay02:45
cprovstub: would be nice if you can comment the sql view solution proposed by kiko for ppa-ng, is it feasible ?02:45
SteveAthanks jamesh 02:45
lifelessddaa: spiv and I are working on this. I have some branches to publish for him.02:45
ddaalifeless: I'll forward you the failure02:45
kikocprov, I'm trying to avoid our funeral earlier!02:45
stubkiko: I only have the sourcepackagename query from you. I don't have a record of ppa-ng (or even know what the abbeviation stands for)02:45
ddaampt: SteveA: I need to have lunch now02:45
kikostub, you got email on it though: Subject: REVIEW: cprov/ppa-ng02:46
SteveAstub: i have a phone call to make, but can we talk on skype after that about the data disordering issue?02:46
jameshstub: personal package archive - next generation02:46
stubSteveA: ok02:46
kikostub, the email starts by saying02:46
SteveAta02:46
kikoDaniel, Stuart, I need some advice from you below on how we can reduce02:46
kikothe impact of this change. Full diff:02:46
sluxhm, the firefox should be pretty much stock, only unusual thing about it is that it's locked down for public access02:46
mptbrb02:46
stubfound ppa-ng message02:47
kikoslux, it's odd because it appears that javascript is broken. can you check the javascript console, clear it, and reload the page?02:47
kikostub, do you filter stuff that is directly To: you?02:47
stubkiko: No - just gives me duplicates and makes my life hard02:47
kikostub, when I add you to the To: it's because I expect you to read it as directed to you02:48
=== ddaa -> lunch
cprovstub: good, looking forward to your comments, maybe we can sort this out easily exploring SQL views02:48
kikootherwise I'd just leave the standard CC:s02:48
kikobecause I know you subscribe to everything02:48
kikostub, is there another technique I should use? forward you emails?02:49
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
stubkiko: No - I read them. I don't always respond - most of the time I'm CC'd other people answer queries or I'm not actually needed.02:49
kikostub, your opinion is one that I highly value, so I usually hang on waiting for an answer from you02:50
mptCan anyone help me with bzr push?02:52
kikompt, what happens?02:52
jameshmpt: what did you try, and what error did you get?02:52
LarstiQonly with non-launchpad specific issues02:52
mptjamesh: I lost my Internet connection part-way through pushing. When I try again I get "bzr: ERROR: Lock error: File 'branch-lock' already locked", even after "bzr break-lock" (which produces no output).02:54
lifelessmpt: do bzr break-lock URLYOUWEREPUSHINGTO02:54
=== jamesh has flashbacks of arch
sluxkiko, if using the chrome url to access the console is acceptable, I didn't get anything in there when reloading the page...02:56
mptthat seems to be working, thanks lifeless02:56
mptIs it a bug that break-lock doesn't return a proper error?02:56
kikoslux, yeah, it's accessible. and you say javascript is running? what happens when you click on a status line in the table at the top of the page?02:56
jameshmpt: if you ran "bzr break-lock" without an argument, it would have operated on your local branch02:57
jameshmpt: it then successfully broke the stale locks on that tree (all zero of them)02:57
mptok, now it's stopped again02:57
mptwith exactly the same error02:57
mptbzr: WARNING: This transport does not update the working tree of: sftp://chinstrap.ubuntu.com/home/warthogs/archives/mpt/launchpad/2006-03-MaloneSimplifications/02:58
mptbzr: ERROR: Lock error: File 'branch-lock' already locked02:58
jameshmpt: try ssh'ing into chinstrap, and change to the branch directory02:58
stubkiko: I don't see why your a) option requires yet another layer of views (securepackagepublishinghistory becomes a view, I think you suggested), when we could just update the existing views on securepackagepublishinghistory02:58
mptjamesh: done02:58
jameshmpt: does "ls .bzr/branch-lock/" show anything?02:59
kikostub, some of the queries are directly on SSPPH and SBPPH.02:59
mptmpt@chinstrap:/home/warthogs/archives/mpt/launchpad/2006-03-MaloneSimplifications/.bzr $ ls branch-lock02:59
mptbranch-lock02:59
mptthat's all02:59
lifelessmpt: 'ls' please02:59
kikostub, and those queries would still need to be band-aided03:00
stubkiko: The fallout from doing it would be a pain anyway, as any updates would need to be refactored to use the underlying table (unless I went sick on table rules, which I'd rather not)03:00
mptmpt@chinstrap:/home/warthogs/archives/mpt/launchpad/2006-03-MaloneSimplifications/.bzr $ ls -l | grep lock03:00
mpt-rw-rw-r--    1 mpt warthogs         0 May 14 09:55 branch-lock03:00
mpt-rw-r--r--    1 mpt warthogs         0 May 18 07:12 branch-lock.write-lock03:00
sluxkiko, if you mean clicking on the link under "Affects", a form for changing the bug details appears on the page03:00
stubCause we don't have updatable views03:00
lifelessmpt: this branch is in 0.7 firmat03:00
lifeless*format*03:00
lifelessmpt: you need to perform the same upgrade procedure you did on your devel machine, on chinstrap03:00
kikostub, no, we'd change all queries to use the view, and leave inserts inserting into the right table03:00
lifelessthen it will all work better03:00
mptoh, foo03:00
kikostub, as it works today for other views.03:00
lifelessright now, you should rm branch-lock.write-lock03:01
kikostub, the main difference being that the SSPPH and SBPPH table queries would be done on the views.03:01
jameshmpt: okay.  try this: change to the /home/warthogs/archives/mpt/launchpad directory and move 2006-03-MaloneSimplifications out of the way03:01
sluxclicking the link at the end of the page makes "Virhe: icon.getAttribute("src") has no properties03:01
sluxLhdetiedosto: https://launchpad.net/@@/launchpad.js03:01
jameshmpt: then "cp -a /home/warthogs/archives/rocketfuel.knit/launchpad/devel 2006-03-MaloneSimplifications"03:01
slux" appear (sorry for the newlines)03:02
jameshmpt: that'll give you a rocketfuel branch at the right location03:02
lifelessjamesh: wrong tree03:02
jameshlifeless: oh?03:02
lifelessjamesh: /home/warthogs/archives/rocketfuel/launchpad/devel03:02
lifelessthat .knit one is going to be deleted RSN03:02
jameshlifeless: well, the "cp" trick won't work for that one because it is in a repo (last I checked)03:02
=== beyond [n=beyond@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
lifelessjamesh: true. So use branch!03:03
mptcancel the cp?03:03
lifelessmpt: no need, it will work ok.03:03
lifelessits just out of date now03:03
jameshmpt: nah.03:04
jameshlifeless: it is close enough though03:04
mptok03:04
kikostub, can you consider that and follow-up via email?03:04
=== mpt -> food, brb
kikoslux, how odd. 03:04
jameshmpt: now on your local machine, run "bzr push --overwrite sftp://chinstrap.ubuntu.com/home/..."03:04
stubkiko: I'm seeing a choice between complicating the data model or complicating the code. I'm leaning towards complicating the code, because the data model in this area is already too complex. The existing views were justified because the queries were just getting too complex and because grabbing wrong rows would be a security hole (with embargod stuff).03:05
slux"https://launchpad.net/@@/launchpad.js" is the source of that error03:05
stubkiko: Splitting the tables might be an option03:05
sluxLine 15503:05
jameshslux: is there any other earlier errors?03:06
kikostub, complicating the code.. seems to be a non-option. did you look at the diff?03:06
kikostub, the risk and potential for us missing or getting a callsite wrong is /very/ large03:08
kikostub, this code is not unit-tested.03:08
kiko(and yes, that is being addressed, but more slowly than ppa-ng is going it appears)03:08
stubWhat is the risk?03:08
cprovkiko: yes, I agree with you on this point, code is already enough complicated & untested.03:08
sluxjamesh, I'm getting some uncaught exceptions, NS_ERROR_XPC_BAD_CONVERT_JS in the console, it's not just that page though03:08
kikostub, did you /read/ the patch?03:09
stubie. What could happen if code thought a personal package archive was not personal? Something that shouldn't getting rolled out into the official release?03:09
stubI'm reading it03:09
jameshslux: try this: open the JS console and clear all the messages.  Then reload the bug page and try to expand the comment box03:09
cprovstub: system break down, data model corruption andso on 03:09
jameshslux: that way you'll only have the messages from the LP bug page03:09
=== Znarl [n=karl@bb-82-108-14-161.ukonline.co.uk] has joined #launchpad
salgadoBjornT, around?03:10
sluxjamesh: what should expand the comment box? the link that jumps to the start of the page and is labeled "add comment to this bug"? :P03:10
kikostub, getting something wrong could range from disaster to bad03:10
=== aa__ [n=ali@host81-153-29-123.range81-153.btcentralplus.com] has joined #launchpad
kikoslux, yes. that link shouldn't behave that way, though.03:10
jameshslux: yeah.03:11
sluxjamesh: doing that results in the first icon.getattribute error and that exception03:11
jameshslux: I'm wondering if the javascript run when the page loads is failing03:11
jameshslux: are there any other messages?03:11
sluxjamesh: nope03:11
cprovstub: a noise in the current publication system has extremelly bad consequences over the distro team, mirrors, etc and it's hard to detect in the model (remember dup librarian filenames took 3 days to debug)03:11
jameshslux: that's weird.  the img element it is looking up is created in the onload handler03:12
stubDo personal package archives need all that embargo and security stuff?03:12
stubcprov, kiko: ^^03:12
kikostub, probably not.03:12
jameshslux: do you see a little arrow next to the "Add comment to this bug" link?03:12
cprovstub: no, it's not strictly necessary 03:12
stubMight it be necessary? I'm thinking about the pros and cons of splitting the personal stuff from the .... erm... impersonal?03:13
sluxjamesh, just the text03:13
kikostub, it might be a nice-to-have feature but is not really necessary03:13
kikogiven the fact that embargo only really makes sense for stuff that is going through a security process03:14
kiko-afkI need to skip out for 30m for an appointment, but email is appreciated03:14
malccIf we stick with one table, can we reduce the risk of old-school queries by implementing PPA with an existing field, eg having a new distrorelease name for my personal version of dapper?03:14
kiko-afkor cprov can keep it03:14
malccWe already know the code doesn't muddle up different distros03:14
jameshslux: there is meant to be an arrow pointing to the right next to the link, that changes to a down arrow when the form gets expanded03:15
kiko-afkmalcc, mmmm. it would mean a new distrorelease entry, which is dangerous.03:15
SteveAstub: call in 15 mins?03:15
stubSteveA: ok03:15
cprovstub: by being personal we can also model it _private_ and it will reach some level of security 03:15
kiko-afkwell, not dangerous per se, but certainly causes the data model to become weaker in semantic03:15
malcckiko-afk: That seems to be the underlying tradeoff here, to choose a different data model than the most semantically clear one, to try to mitigate the risks from the code change03:16
sluxjamesh, right. the only thing between the comment boxes and the footer is the link that reads "Add comment to this bug", there's nothing but whitespace on either side of it or between footer/comment boxes and it03:16
cprovmalcc: kiko is right, since even PPA packages are target to an existent distrorelease03:16
kiko-afkmalcc, yes, you're right. I'm mainly proposing using views to try and mitigate the risk, but...03:16
sluxso I guess I'm not seeing all I should be for some reason..03:17
kiko-afkslux, can we see a screenshot?03:17
kiko-afkanyway, bbiab03:17
malcccprov: Yes, it would effectively mean giving distroreleases parents which are other distroreleases, so my personal dapper becomes semantically a child of the main dapper03:17
malccAnyway I less than half have a clue about this data model so I'm just making stuff up here03:18
malccAlthough the advantage of implementing PPA as a tree in distrorelease would be I could make a personal version of your personal version of dapper...03:18
mptheh03:18
mptjamesh: bzr: ERROR: No repository present: 'sftp://chinstrap.ubuntu.com/home/warthogs/archives/mpt/launchpad/2006-03-MaloneSimplifications/'03:19
cprovmalcc: that's the derivation model, which overkill for PPA, since includes specifics semantics for archive publication, domination and etc, that are not necessary for PPA.03:19
BjornThi salgado 03:20
sluxjamesh, kiko: http://lib2.vaasa.fi/shot.png03:20
malcccprov: Hmm, ok, but if we need that model anyway, we can turn bits of it off for PPA and only have to implement one model03:20
malcccprov: Otherwise we implement two systems, one for distro derivation the big way, and one for distro derivation on a small scale for PPA03:21
cprovmalcc: and also improve things we don't like from the current publication model but we can't experiment in the main publication tables (like apt-ftparchive dependency and filesystem based archive)03:22
mptlifeless: --^03:23
=== carlos -> lunch
carloslater03:23
mptAny idea about fixing that error?03:23
cprovmalcc: yes, having two system for the same issue freaks me out, fixing bugs twice would be utterly distressing03:24
ddaabah, dapper bzrtools does not have my switch plugin03:24
=== ddaa re-enables local bzrtools
malcccprov: I need to read around this issue more, I'm just starting. But all my instincts are telling me PPA is a special case of derivation and we should implement this once only03:24
cprovmalcc: after pondering a lot, I'm really inclined to use the SQL view approach and deal with complex DB arreangement instead of be in risk of break the code or having two models for the same feature03:26
cprovmalcc: I'm glad that you interested and aware of this topic, I think it'll be the main topic of our sprint. Would you like to face this problem with me ?03:27
malcccprov: Yes, I think this is the ideal problem for us to work on together03:27
SteveAstub: i'm running skype03:27
mptlifeless / spiv: By the way, if rocketfuel.knits is going away RSN, the "To push a standalone knit branch to chinstrap the first time" instructions on RocketfuelToKnits should be updated03:28
lifelessjamesh: can you finish helping mpt out ?03:29
lifelessjamesh: its 2330 for me03:29
ddaampt: why use standalone branches at all?03:29
ddaaat least for lauchpad03:29
mptddaa: Because I haven't had repositories fully explained to me yet, and I'm doing one thing at a time03:29
cprovmalcc: great, I'll do some reserch on writable SQL views, but first of all, we needs to reorganize the spread queries on SSPPH/SBPPH, currently it's awkward how we do this.03:30
ddaampt: let's go to #bzr, and I'll give you as full an explanation as you wish03:30
spivmpt: fixed, thanks.03:30
mptddaa: ok, how about tomorrow? It's 1.30am, and I just want to push this branch while people are here03:31
ddaaif you prefer03:31
mptIn my current state, if you explained repositories to me I'd have forgotten by tomorrow anyway :-)03:32
ddaathere's really not much to understand03:32
=== mpt wonders if rm-ing the branch on chinstrap, then following spiv's new instructions, will work
=== mpt tries
=== Who_ [n=jonny@194-247-228-106.dynamic.dsl.as9105.com] has joined #launchpad
Who_kiko-afk: are you around?03:38
ddaaheya, somebody up for a quick review? Got a branch fixing the annoying logging in the importd test suite.03:43
ddaamh, gotta admit sftp push is not terribly fast yet03:44
kiko-afkWho_!03:44
ddaaha, my rocketfuel repo was still weave :)03:45
Who_kiko: did you get my email?03:46
kikoWho_, I did, I need to tackle my inbox shortl03:46
kikoy03:46
Who_yea, that's fine - I had to get the email address off Launchpad and wasn't 100% certain I'd got you :P03:47
kikoyou got me!03:47
Who_well I'll wait my turn for your time then. Thanks very much :)03:48
kikothanks03:48
=== kiko gets the lowercase failure
sluxoh well, ended up adding the comment on a different system that had ffox 1.503:55
kikoslux, that actually worked?03:56
sluxkiko, yeah03:57
=== Znarl [n=karl@bb-82-108-14-161.ukonline.co.uk] has joined #launchpad
sluxwonder if it does on a stock breezy badger with 1.0.8... this one should be rather close to that...03:58
kikoslux, we use breezy here and no problems, so I don't think so03:59
sluxkiko, it's really strange then.. the only customization I've done to this one is a firefox.js that has some of the prefs set as locked03:59
kikoany prefs that are worth mentioning?04:00
sluxkiko, I don't know really... the only javascript related stuff is the firefox javascript popup prevention etc.04:04
spivslux: hmm, maybe it's possible that popup prevention interferes with some onload javascript that page depends on...04:05
dilysMerge to devel/launchpad/: [r=salgado]  make bugtasks editable if they don't have a bugwatch. some other fixes as well. (r3569: Bjorn Tillenius)04:06
kikoyes!04:07
kikoyes!04:07
kikoyes!04:07
kikomy patch is a winner :)04:07
kikoslux, how about trying that firefox.js in the newer version and seeing if it also breaks?04:08
kikoSteveA, so it appears my patch may have helped the 30-mergie04:08
=== mdz [n=mdz@201.160.20.139.cableonline.com.mx] has joined #launchpad
sluxkiko, now that I found the correct lockdown file and removed it for a test I found what disables it04:12
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
sluxkiko, it's simply preventing javascript from changing images (the last checkbox in the js permission ffox preferences)04:13
kikoaha04:13
kikoslux, would you be able to file a bug on that, explaining how to reproduce?04:13
SteveAkiko: so, you added some gc stuff04:15
kikoI did indeed04:16
SteveAkiko: so i reckon it may be an sqlobject/sqlos object's connection issue04:16
kikoeven more than the recommended amount04:16
kikoit went well over the RDA04:16
SteveAODed on OJ04:16
sluxsure, if that's needed... quite straightforward though, 5 clicks or so :P04:17
kikoslux, thanks -- we are ODing on tasks right now04:17
mpteh04:20
mptWhat should .bzr/parent contain for Launchpad branches?04:21
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
kikompt, sftp://chinstrap.ubuntu.com/home/warthogs/archives/rocketfuel/launchpad/devel04:22
ddaawithout trailing newline04:23
ddaaactually04:23
mptthanks04:23
lifelessmpt: .bzr/branch/parent04:23
ddaaon knit branches it's not there anymore04:23
lifelessmpt: .bzr/parent is not used nomore04:23
lifelessgoodnight all04:23
mptSo the error message is out of date?04:23
ddaaas lifeless said, except if your branch is a light checkout is actually removed one more level04:23
mpt"Please identify where you want submitted merges to occur in .bzr/parent (or use bzr pull --remember)"04:23
ddaahu?04:24
ddaaWhere does that come from?04:24
mptoh, never mind04:24
mptthat's from the publish script, not part of bzr04:24
mptok, now I'm cooking04:26
ddaawhat's the dessert?04:26
ddaaboys'n berries ice cream?04:26
mptDessert is PQM04:31
mptIt's berry-colored at the moment04:31
mpthttp://pqm.launchpad.net/04:32
mptIs that bug 42866?04:34
UbugtuMalone bug 42866 in pqm "Web UI dies with NotImplementedError if a "patch" command is in the queue" [Normal,Unconfirmed]  http://launchpad.net/bugs/4286604:34
=== mpt reports a bug anyway
stubcarlos: That first DELETE is being really slow because you are joining with the Person table in the subquery, but the Person table isn't in the WHERE clause (or being used). So the subquery is returning several orders of magnitude more rows than it needs to.04:34
carlosstub: really?04:35
carlos:-(04:35
spivmpt: It looks like the same traceback as 42886, anyway.04:35
carloscould you fix it or should I do it and send you it back?04:35
mptbug 4288604:35
UbugtuMalone bug 42886 in hotkey-setup "ibm-acpi volume control unpredictable" [Normal,Unconfirmed]  http://launchpad.net/bugs/4288604:35
spivmpt: er, 42866 :)04:35
=== mpt will assume spiv means 42866 :-)
stubcarlos: Yup. Nasty bug because there is no warning ;)04:35
mptSo now I can't tell whether MaloneSimplifications is in the queue or not04:36
=== aa_ [n=ali@host81-153-29-123.range81-153.btcentralplus.com] has joined #launchpad
mptanyway, bedtime04:37
=== mpt [n=mpt@203.109.220.214] has left #launchpad ["Ex-Chat"]
spivmpt: damn.04:37
=== ddaa would really like pMock in launchpad
spivWell, for the record, PQM is processing a branch from carlos, and has two more in the queue, then a mystery command that breaks PQM.04:38
kikospiv, it just breaks the HTTP. it's not a big deal04:39
ddaaor mock, or some or other mock-object implementation04:39
spivWhich means mpt's merge isn't in the queue.04:39
ddaakiko: what would you think of that?04:39
spivOr, if his is the mystery command, it may as well not be because the odds of mpt meaning anything other than star-merge are low :)04:39
kikoddaa, you mean, something better than Snapshot?04:40
ddaasnapshot?04:40
ddaakiko: I mean something that provides a mock-object implementation04:41
SteveAddaa: what is this mock-object stuff for?04:41
stubcarlos: Delete took 10 seconds with it removed ;)04:41
ddaaso we would not have to implement our own half-assed mock objects everytime we need it04:41
=== WaterSevenUb [n=WaterSev@azevedo.astro.up.pt] has joined #launchpad
=== fabbione [i=fabbione@gordian.fabbione.net] has joined #launchpad
=== Bluekuja [n=andrea@ubuntu/member/bluekuja] has joined #launchpad
=== havarha [i=havarha@dragon.idi.ntnu.no] has joined #launchpad
=== siretart [i=siretart@ubuntu/member/siretart] has joined #launchpad
=== JanC [n=janc@lugwv/member/JanC] has joined #launchpad
=== LarstiQ [n=larstiq@cust.7.157.adsl.cistron.nl] has joined #launchpad
=== lifeless [n=robertc@dsl-152.1.240.220.rns01-kent-syd.dsl.comindico.com.au] has joined #launchpad
=== zakame [n=zakame@ubuntu/member/zakame] has joined #launchpad
=== jmg [n=jmg@shinobi.thoughtcrime.org.nz] has joined #launchpad
=== lamont [n=lamont@mib.fc.hp.com] has joined #launchpad
SteveAwhat do you mean by "mock object" exactly?04:41
ddaaSteveA: it's for unit testing04:41
SteveAis there a project you can point me at to look at these?04:42
carlosstub: wow....04:42
malccSteveA: Put mock objects into google, a lot has been written about them (mostly in the Java world)04:43
ddaahttp://c2.com/cgi/wiki?MockObject04:43
SteveAddaa: i mean, a specific implementation you think we should consider04:43
ddaaI have experience with no specific implementation so far04:43
SteveAok04:44
ddaaa couple of candidates could be http://pmock.sourceforge.net/ and http://python-mock.sourceforge.net/04:44
SteveAi have discussed with bjorn and (i think) stub in the past about using our interfaces to create mock objects04:44
SteveAthe interfaces describe the boundaries of units04:44
ddaaSteveA: I have a lot of uses for mock objects in non zopy stuff, too04:44
SteveAand so by using interfaces, we can get reasonable mock behaviour, without needing to say a great amount04:45
ddaanow that I'm starting to grok unit testing, I'm finding uses for them in cscvs and importd04:45
SteveAddaa: you may use interfaces to describe any python systems you like04:45
SteveAit is a descriptive idea, not something that a system must conform to in order for you to use this approach04:45
ddaaI'm very far form convinced that interface are sufficient, and that it's worth adding them just for mock object testing purposes04:46
ddaaactually, except for security wrapping purposes, I am not yet convinced of the usefulness of interfaces except in some very spethial applications (zope and twisted have a lot of implementations and adapters, so that make sense there)04:47
ddaaeven in launchpad, I see we use interfaces for two purposes: security wrapping and automatic form generation04:47
LarstiQmock objects aren't only good04:47
ddaaand I'd rather have the automatic form generation stuff in the content or browser classes04:48
malccZope interfaces aren't interfaces in the conventional sense, they provide behaviour as well as describing API04:48
stubcarlos: Does https://chinstrap.ubuntu.com/~dsilvers/paste/fileAXE2I7.html look sane?04:48
ddaamalcc: also, I'm not really convinced of the interface for the sake of defining interfaces in general python programming04:49
ddaalooks to me like an attempt to force some kind of static type checking onto python04:49
carlosstub: hmm, it's a bit difficult to see it, more or less, yes, I don't see any high number that should not be there04:49
=== stub commits
carlosstub: if you are 100% sure that only translations from rosetta-admins were removed... go ahead04:49
carlosremoved == DELETE ...04:49
SteveAmalcc: how do you mean "they provide behaviour" ?04:50
ddaaSteveA: well, the next time the issue pops up, I'd really like a mock object implementation that integrates usefully with unittest04:50
malccSteveA: Just yesterday I made a change to how one of our forms validated. I did so by editing an interface class, but my change made no change to any APIs, it just changed the behaviour of some objects04:50
SteveAddaa: file a spec on launchpad04:51
malccSteveA: As in a certain type of database object changed how it validated its fields04:51
SteveAthat's interesting.  i wouldn't call the constraint in a schema "behaviour"04:52
carlosstub: thank you for your help04:52
SteveAcertainly changing an interface can change the behaviour of parts of the system that look to that interface to inform how they should behave04:52
SteveAthis is the same as in other systems that allow introspection of interfaces04:52
SteveAfor example, removing an attribute from an interface may have the effect in the whole application of removing a field from a form04:53
malccSteveA: Yes, most systems with interfaces allow this kind of thing, eg in Java you can include constants in interfaces if you choose, and then make code elsewhere conditional on them04:53
SteveAyou can make java code conditional on the API of an interface too04:53
malccSteveA: Many coding guidelines call for not doing this, as it's not what interfaces are "supposed to be for"04:53
SteveAalthough, because of compile time type-checking, this is less common except on systems that allow very dynamic assembly of parts04:54
malccSteveA: I think this is another one for over-a-beer04:54
carlosjordi: around?04:54
ddaaSteveA: too much meta-work04:54
SteveAi don't think this is a property of interfaces as such04:54
SteveAbut more a property of the system that makes use of them04:54
=== ddaa goes back to teach importd how to properly deal with repo migrations
malccHmm, interesting statement!04:55
SteveAso i would not say "an interface provides behaviour".  i would say "an interface specifies or constrains the behaviour of other parts of the system"04:55
malccSurely interfaces are given their properties by how they fit into the system around them?04:55
SteveAi don't know what you're saying, so i'll leave this for the beer.04:56
SteveAi'll note that one thing i'll be doing on launchpad very soon is making it so that we don't need to duplicate method signatures and attributes between implementation and interfaces04:57
SteveAyet, we'll still have interfaces04:57
ddaaokay, so that's a very different sort of interface than in java04:57
malccInteresting. How will the implementing class indicate which method in the interface it is providing the implementation for, without duplicating the signature?04:58
carlosSteveA, kiko-fud: Now that I fixed the bug that required me to be a Launchpad admin, I just removed myself from that team04:58
SteveAok04:58
SteveAthanks04:58
carlosnp04:59
SteveAddaa: i agree that there are some differences than in java.  but i think my statement holds true for java too.04:59
carloslifeless: http://pqm.launchpad.net/ is broken atm05:00
SteveAmalcc: this margin is not large enough for the full explanation.05:01
SteveAmalcc: so, it's either when the code lands, or over a beer...05:01
malccSteveA: Cool05:04
spivcarlos: It'll right itself as soon as it processes the request that's breaking the web UI.05:14
carlosspiv: it's already fixed05:15
carlosspiv: so it's a problem with test output?05:15
spivOh, so it is.05:15
spivInteresting.05:15
spivcarlos: Did you get a big colourful traceback?05:16
carlosyes05:16
spivI doubt it's the test output then :)05:16
=== doko [n=doko@201.160.19.41.cableonline.com.mx] has joined #launchpad
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
stubcprov: ~stub/launchpad_prod.20060518.dump on mawson05:27
cprovstub: great, could you paste the restore cmdline if it is special ? (don't remember if simply pg_restore will work appropriately) 05:29
stubcprov: pg_restore --no-acl --no-owner --dbname=whatever ~stub/launchpad_prod.20060518.dump05:30
stubThen upgrade.py, fti.py and security.py as normal05:30
cprovstub: ahh --no-acl --no-owner, remeber now, thanks05:31
=== sabdfl [n=mark@201.160.17.131.cableonline.com.mx] has joined #launchpad
malccI'm using this: python test.py -vvf canonical pagetests/soyuz to run pagetests, and also editing them at the same time, as it takes a while. The test runner is choking on the .#... files emacs leaves lying around. Is there an easy fix? Pls don't say vi.05:47
SteveAthere is code in the test runner that attempts to find stuff while ignoring junk files05:48
SteveAso it would be a reasonable patch in our test runner and upstream in zope to make it ignore those files too05:48
SteveAi think you can also configure emacs to leave the turds in a different place05:49
carlosbradb, BjornT: How could I know why rosetta-admins is subscribed to https://launchpad.net/distros/ubuntu/+source/xfce4-terminal/+bug/41791 ?05:49
UbugtuMalone bug 41791 in xfce "Xubuntu-Dapper Drake (AMD64): Missing Terminal RC File" [Unknown,Unknown]  05:49
malccSteveA: Thanks05:49
carlosthe activity log does not show anything...05:50
bradbcarlos: indeed, hm, that's a bit curious05:51
carlosI'm not completely sure, but I think this is not the first time it happens05:51
bradboh, it's because you are the upstream registrant05:51
SteveAmalcc: although actually... maybe it is just our test runner05:52
bradbcarlos: https://launchpad.net/products/xfce/05:52
carlosbradb: ?05:52
carlosI see05:52
carlosthat's confusing...05:52
SteveAmalcc: because the way we do pagetests is not how they're done in zope05:52
bradbyou, i.e., the rosetta admins05:52
carlosanyway, I will change the ownership to the register team05:52
carlosthanks for checking it05:52
malccSteveA: Thanks, I found the emacs turd-moving recipe and I'm going to go that route05:52
bradbno prob05:52
spivmalcc, SteveA: the file to look at is lib/canonical/launchpad/ftests/test_pages.py05:55
spivIt just filters a listdir with "filename.lower().endswith('.txt')".05:55
=== aa__ [n=ali@host81-153-29-10.range81-153.btcentralplus.com] has joined #launchpad
spivSo if emacs is just prefixing its backup files and not suffixing, then I can see how that would confuse it.05:56
=== sits [n=sits@cpc3-cwma2-0-0-cust739.swan.cable.ntl.com] has joined #launchpad
=== carlos -> out
carlossee you!05:56
dilysMerge to devel/launchpad/: [r=kiko]  Implemented POTemplate priorities to help our users to know what's more important to get translated. This feature has been implemented by Mark (r3570: Carlos Perello Marin, Mark Shuttleworth, Carlos Perell Marn)06:02
=== bradb & # lunch
=== aa_ [n=ali@host81-153-25-44.range81-153.btcentralplus.com] has joined #launchpad
=== glatzor [n=sebi@ppp-82-135-8-223.mnet-online.de] has joined #launchpad
spivGood grief.  "bzr viz" is about 3000 pixels wide for launchpad...06:22
=== BjornT [n=bjorn@195.182.78.95] has joined #launchpad
kikospiv, that's hard work. :)06:24
kikoBjornT, you got lucky :)06:24
BjornTkiko: yeah :) hard to tell if it was your fix that did it, or something else, though.06:26
kikoBjornT, what are you talking about? it is OBVIOUS that my fix is PERFECT!!106:27
=== salgado can bet that kiko's fix is a sleep(5)
kikono it contains advanced gc.collect() calls too06:29
kikoddaa, ping?06:30
=== acko88 [n=alexanda@212.62.51.89] has joined #launchpad
=== ddaa is singing in the shower
kikoddaa, vostok's loadavg is high. check it out06:31
Znarlddaa : CRITICAL - load average: 161.65, 160.64, 159.85 06:32
=== tambaqu1 [n=tambaqui@201.160.17.131.cableonline.com.mx] has joined #launchpad
ddaawow :)06:32
=== acko88 [n=alexanda@212.62.51.89] has left #launchpad []
ddaaZnarl: I can have a look, but your judgement is a good as mine. I do not own the code that runs there (spiv and salgado do) and I do not have any priv to manage it.06:33
jordicarlos: here06:33
=== auth00 [n=auth@evot.olf.sgsnet.se] has joined #launchpad
ddaakiko: I know what it is06:33
ddaaI bet that a new bzrlib was rolled out06:33
ddaa*sigh*06:33
kikorock and rollit06:33
=== tambaqu1 [n=tambaqui@201.160.17.131.cableonline.com.mx] has left #launchpad []
ddaathere's a couple of bugs that cause it to mirror a bunch of knit branches as weave06:34
ddaathus doing knit->weave conversion06:34
ddaawhich is a bad idea06:34
ddaathus meltdown06:34
ddaaI made noises about not rolling out the new bzr before that was fixed06:34
ddaaa think that can be done to help is put down the branch puller now and downgrade bzrlib until the problems are fixed06:35
ddaahttps://launchpad.net/products/launchpad-bazaar/+bug/4418306:36
UbugtuMalone bug 44183 in launchpad-bazaar "supermirror branch puller does not preserve source branch format" [Major,Confirmed]  06:36
kikoddaa, is that something znarl can do?06:36
ddaahttps://launchpad.net/products/launchpad-bazaar/+bug/4418206:37
UbugtuMalone bug 44182 in launchpad-bazaar "supermirror branch puller leaves empty branch when initial mirroring fails" [Major,Fix committed]  06:37
ddaahttps://launchpad.net/products/launchpad-bazaar/+bug/4141406:37
UbugtuMalone bug 41414 in launchpad-bazaar "supermirror-branch-puller ignores format changes" [Major,Confirmed]  06:37
ddaakiko: whatever, it's not going to break it anymore...06:37
ddaakiko: combine these three bugs, and do a careless rollout of the new bzr, and you get the current situation06:38
ddaakiko: though stub or lifeless would be best qualified to do it06:38
ddaalifeless was aware of the problem, but we disagreed on the seriousness of the issue06:40
spivddaa: Are you sure that's the issue?  The new bzr isn't in rocketfuel yet.06:41
kikoddaa, are you sure that's what's up?06:41
ddaanot absolutely sure06:41
kikowalk the mile06:41
ddaaspiv: but the pqm failure I got  when trying to merge cscvs the last time suggest the new bzr is in rocketfuel06:41
spivSo a "careless rollout" is unlikely to have changed the bzr in use.06:41
spivddaa: It isn't.06:41
spivddaa: I suspect the testsuite of the old bzr in rocketfuel is unfortunately senstive to the *system* bzr being upgraded.06:42
ddaamh06:42
ddaakiko: okay, so I'm probably wrong06:43
ddaaand then I've no clue06:43
kikowell, I did say walk the mile :)06:43
ddaawhat does that mean?06:43
kikogo the distance to debug what is wrong06:43
dilysMerge to devel/launchpad/: [rs=kiko]  Improved security adapters for DistroReleaseQueue and view/template code (r3571: Celso Providelo)06:43
ddaaI'm not going to have the time.06:43
kikorock on cprov06:43
kikoddaa, the loadavg is blowing up /now/ though06:43
ddaaI about to leave for a school reunion06:43
kikowell, what should znarl do meanwhile06:44
spivddaa: As soon as bzr in rf is upgraded, I will be merging a bugfix for 44183, the code part of 44182 is already in rf, and I have already half-done the fix for 41414.  You can relax :)06:44
ddaaspiv: if you can land the fix for 41414 before rollout, there should be no need for manual fixup, that would help my peace of mind a lot06:45
spiv(well, assuming reviews don't get in the way, but I don't expect that to be a significant impediment)06:45
=== ddaa goes to have a look on vostok
=== mpt [n=mpt@203.109.220.214] has joined #launchpad
kikocprov-lunch, we will need to make fixing up the source package name creation a priority today06:46
spivIt's my bedtime... g'night.06:46
kikonight spiv 06:46
kikocprov, I am doing some research as we speak06:47
cprovkiko: did you discovered something new ?06:47
ddaaZnarl: there seems to be a crazy moin load there06:48
cprovs/discovered/discover06:48
kikocprov, well, stub cleared out the DB, and I am going to snapshot the list of bogus SPNs now and in 2 hours06:48
kikocprov, are there uploads being processed in the next two hours?06:48
cprovkiko: sure, do you want to stop it ?06:49
ddaaZnarl: any clue what could be causing that?06:49
kikocprov, no, let them run06:49
ddaaspiv: what does the listbranches script do?06:49
kikocprov, we have a log of everything processed, right?06:49
Znarlddaa : Checking.06:49
spivddaa: I don't think I've heard of that one.06:50
cprovkiko: yes, in lp_archive mailbox in drescher06:50
kikocprov, that's perfect. let's wait for now.06:50
ddaaspiv: there's also seem to be a very busy sftp server06:50
ddaaspiv: I have no idea what could be the cause06:50
cprovkiko: understood, i'm going to office soon 06:50
kikocprov, okay, awaiting your arrival, I already have the data I needed.06:51
ddaaspiv: listbranches seems to be old supermirror06:51
spivddaa: That's interesting.  Neither do I at the moment, but I should be getting access to the logfiles soon, which may tell me something.06:51
spivddaa: jblack code then?  I know nothing of it.06:51
ddaaI think we are just being brutaly DOSed06:51
=== spiv -> really sleep
cprovkiko: how do you mean ? did you identify the bogus spn creation ?06:51
=== Who_ [n=jonny@194-247-228-106.dynamic.dsl.as9105.com] has joined #launchpad
ddaaZnarl: if you have a network activity log somewhere, it might tell something interesting06:52
kikocprov, I have at least times and names that were created06:52
kikothat should allow us to debug better06:52
ddaamaybe a spam harvester run amok06:52
cprovkiko: right06:53
Znarlddaa : Restarting apache will kill off all these old moin processes.06:53
ddaaoh, right, the moin thingies have completely crazy cpu times06:53
ddaaup to 99 mins06:54
ZnarlYes, moin is running as part of wiki.gnuarch.org.06:54
ddaaZnarl: is that regular cgi?06:55
ddaabecause 99 mins cpu time for a regular one-off moin.cgi process is a caracterised DOS06:55
=== lbm [n=lbm@0x555298ca.adsl.cybercity.dk] has joined #launchpad
Znarlddaa : Yes, I've never seen moin do this before.  06:57
=== mpt sighs at conflicts
ddaaZnarl: okay, now that we have that one out of the way, it looks like old supermirror is burning06:58
ddaait looks like something is wrong the the cron06:59
ddaathere are two cron.daily runs atm07:00
ddaaand large number of listbranches cronjobs too07:00
ddaashould probably be safe to kill all the listbranches07:00
Znarlddaa : You'd like me to kill off the listbranches?07:01
ddaamh07:01
ddaamaybe not necessary07:01
ddaaI know that jblack stuff is designed to work in massively parallel fashion07:02
ddaaso the "thundering herd of cronscripts" thing is probably normal07:02
ddaaZnarl: though you probably want to disable updatedb from the cron.daily07:02
ddaaespecially because the old supermirror involves an insane filesystem hierarchy07:03
cprovZnarl: RT #9209, let me know when it's done, thank you07:03
ddaaZnarl: I think the load should decrease to something reasonable now07:04
Znarlddaa : OK, lets leave it for a few hours and see if it recovers instead of killing? 07:05
ddaayup07:05
ZnarlLoad seems to be staying around 85 presently.07:05
ddaanow, it's steadily decreasing07:05
=== Kamion [n=cjwatson@83-216-156-196.colinw664.adsl.metronet.co.uk] has joined #launchpad
ddaaZnarl: please disable updatedb too07:07
ddaait's a waste of i/o bandwidth on this system07:07
Znarlddaa : OK, good idea.07:08
Znarlddaa, kiko : Thanks for your help.07:10
KamionI'm getting timeouts on all my attempts to fetch translations at the moment; is this known?07:10
Kamion(OOPS-138C492 e.g.)07:10
Ubugtuhttps://chinstrap.ubuntu.com/~jamesh/oops.cgi/138C49207:10
Kamionit's rather urgent as I need to finalise translations before distro RC freeze07:11
kikolet's see07:11
kikoKamion, the language table is locked, apparently.07:15
kikoKamion, have you retried since and obtained a more recent OOPS?07:15
kikoKamion, what are you trying to do, btw?07:15
kikoview the desktop pots?07:16
KamionI retried a few times ...07:16
Kamionfetch https://launchpad.net/distros/ubuntu/dapper/+source/ubiquity/+pots/desktop and https://launchpad.net/distros/ubuntu/dapper/+source/debian-installer/+pots/debian-installer which aren't subject to language packs, I need to integrate them into the packaging07:16
KamionOOPS-138A57307:16
Ubugtuhttps://chinstrap.ubuntu.com/~jamesh/oops.cgi/138A57307:16
kikoKamion, so basically download those translations?07:16
Kamionyes07:16
kikoyes, language table locked. how strange.07:16
=== BjornT [n=bjorn@clt-84-32-240-183.dtiltas.lt] has joined #launchpad
kikoKamion, so far no luck. I'm a bit confused because a lock could not hold on to this table for so long, I thought07:23
=== cpro1 [n=cprov@200-171-140-32.dsl.telesp.net.br] has joined #launchpad
kikocarlos, stub: ping?07:23
stubyo07:27
kikostub, can you check up on kamion's oops? Language table seems to be locked... 07:28
kikohttps://chinstrap.ubuntu.com/~jamesh/oops.cgi/2006-05-18/C49207:28
kikohttps://chinstrap.ubuntu.com/~jamesh/oops.cgi/2006-05-18/A57307:28
kikobeen locked for at least 20 minutes, stub 07:28
stubTry again - I was dropping a large index07:28
salgadokiko, http://shipit.async.com.br/requests07:29
=== raphink [n=raphink@ubuntu/member/raphink] has joined #launchpad
kikosalgado, connection refused.07:30
salgadohad to restart, sorry. 07:30
kikostub, works now, thanks.07:31
salgadoit's up again07:31
kikoKamion, should be working, sorry07:31
kikos/All/Any07:32
kikooh mmm07:32
Znarlddaa : CRITICAL - load average: 26.02, 41.00, 70.44 07:32
ddaalooks like it's returning to normal07:32
Kamionkiko,stub: works now. thanks!07:33
kikoKamion, sorry bout that07:33
kikoddaa, good work07:33
Kamionno problem07:33
=== tambaqui [n=tambaqui@201.160.20.139.cableonline.com.mx] has joined #launchpad
Kamionhmm, publisher blowing up now08:07
Kamionhttp://librarian.launchpad.net/2735165/u65u22gL5U0AUkGbYhKvKVa4gGS.txt08:07
=== sits [n=sits@cpc3-cwma2-0-0-cust739.swan.cable.ntl.com] has left #launchpad []
KamionI think I might just retry that, looks like it could be transient08:07
kikoKamion, yes, just retry.08:12
kikosomebody's working on the importqueue08:12
Kamionit's running now and apparently working08:15
Kamionsorry to be are-we-there-yet, it's a rather stressful day in distro-land08:15
=== tambaqui [n=tambaqui@201.160.17.131.cableonline.com.mx] has joined #launchpad
=== AlinuxOS [n=AlinuxOS@d83-176-106-124.cust.tele2.it] has joined #launchpad
=== tambaqui [n=tambaqui@201.160.20.139.cableonline.com.mx] has joined #launchpad
=== sabdfl [n=mark@ubuntu/member/pdpc.silver.sabdfl] has left #launchpad []
kikoKamion, no worries, help as I can08:59
=== jmg [n=jmg@shinobi.thoughtcrime.org.nz] has joined #launchpad
=== lbm [n=lbm@0x555298ca.adsl.cybercity.dk] has joined #launchpad
cprovkiko: miscreated spn bug reproduced, do you want do discuss the fix ?09:47
kikoyep09:47
kikoI have the fix I think09:47
kikocome on down09:47
=== Kamion [n=cjwatson@83-216-156-196.colinw664.adsl.metronet.co.uk] has left #launchpad []
cprovkiko: yup09:50
=== LeeJunFan [n=junfan@adsl-69-210-207-5.dsl.klmzmi.ameritech.net] has joined #launchpad
=== doko [n=doko@201.160.20.136.cableonline.com.mx] has joined #launchpad
=== tambaqui [n=tambaqui@201.160.20.139.cableonline.com.mx] has joined #launchpad
mdkespiv: around?10:40
bradbkiko: do you have time for a drive-by for bug 33882? it's a bug mark pointed out the other day.10:41
UbugtuMalone bug 33882 in malone "Critical bugs are listed as 8 in the side bar, but there actually aren't any" [Normal,In progress]  http://launchpad.net/bugs/3388210:41
=== jinty [n=jinty@212.Red-83-54-75.dynamicIP.rima-tde.net] has joined #launchpad
kikobradb, yes I do.10:49
bradbkiko: cool, https://chinstrap.ubuntu.com/~dsilvers/paste/filec9m2wg.html10:51
kikobradb, can we convert getSearchFilterUrl to have explicit params instead of the **?10:53
kikothe ** is what let the bug appear.10:53
kikothat's my main reservation.10:53
bradbHm? The bug appeared because some URLs and some search count queries were just wrong.10:53
=== sistpoty [n=sistpoty@ubuntu/member/sistpoty] has joined #launchpad
kiko-            unassigned='on')10:54
kikobradb, is unassigned='on' still valid? see what I mean?10:54
sistpotyhi folks10:54
bradbkiko: Ok. Is it sufficient to define enough of the API to work for what it's currently being used for? (i.e. just status, assignee, etc.)10:56
kikobradb, just do it all!10:56
kikowhat difference should it may?10:56
kikomake10:56
bradbjust seems to be adding unneeded code10:57
kikohmm10:57
kikodo you understand what I'm suggesting?10:57
kikoremoving **extra_params10:58
bradbyep10:58
bradbreplacing it with explicit kw args10:58
kikoright10:58
bradbI'm just wondering if we need to define all the possible filter args, even though this few only uses like three or four of them10:58
bradbs/this few/this view/10:59
kikolet's see10:59
kikooh11:00
kikoISWYM11:00
kikois there a place where we can read the standard form schema from?11:00
bradbthis portlet doesn't have a form. can you elaborate on what you have in mind?11:02
kikowell11:02
kikoI would like us to be able to determine which options are valid11:02
kikoinstead of supplying anything via **extra_params11:02
kikoif you have a set of fixed options11:02
kikoyou could validate11:02
kikoto see if an extra_param had been supplied which you did not expect11:03
bradbi'm suggesting something like def getSearchFilterURL(self, assignee, status, ...):11:03
kikobradb, okay. so what are you asking, then? :)11:03
bradbif doing the above for *just the params we use* is ok, or if you want it to be def getSearchFilterURL(self, assignee, status, every, other, possible, param, that, exists, even, though, we, dont, use, them, here):11:04
kikooh!11:04
kikono, just the params we use of course11:04
bradbok :)11:04
kikoif you wanted to do the complete solution11:04
kikoyou could try and obtain a list of such params11:05
kikoand then, well, use kwargs and validate the kwargs with them. but that's fluff.11:05
kikogood work11:05
kikobbiab11:05
bradbcheers11:05
=== aa__ [n=ali@host81-153-24-22.range81-153.btcentralplus.com] has joined #launchpad
=== ChanServ [ChanServ@services.] has joined #launchpad
=== tambaqui [n=tambaqui@201.160.20.136.cableonline.com.mx] has joined #launchpad
dilysMerge to devel/launchpad/: [r=kiko]  Fix bug 33882 (Critical bugs are listed as 8 in the side bar, but there actually aren't any) (r3572: Brad Bollenbach)11:51
UbugtuMalone bug 33882 in malone "Critical bugs are listed as 8 in the side bar, but there actually aren't any" [Normal,In progress]  http://launchpad.net/bugs/3388211:51
=== marienz [i=marienz@gentoo/developer/marienz] has joined #launchpad
marienzI'm probably just being daft, but why does launchpad.net/people/marienz/ tell me "Ubuntero:  Not yet"? What's an ubuntero?11:54
LarstiQmarienz: someone who has agreed to and signed the code of conduct11:54
marienzahhh11:55
LarstiQmarienz: btw, you're not at SANE, are you?11:55
=== raphink [n=raphink@ubuntu/member/raphink] has joined #launchpad
marienzerr11:55
marienzwhat's a SANE? :)11:55
LarstiQmarienz: sane.nl11:56
LarstiQsane2006 is taking place this week in Delft11:56
marienzahh, nope11:56
=== raphink [n=raphink@ubuntu/member/raphink] has joined #launchpad
=== aa_ [n=ali@host81-153-27-115.range81-153.btcentralplus.com] has joined #launchpad
=== LarstiQ_ [n=larstiq@cust.7.157.adsl.cistron.nl] has joined #launchpad
=== havarha_ [i=havarha@dragon.idi.ntnu.no] has joined #launchpad

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!