/srv/irclogs.ubuntu.com/2013/03/28/#launchpad-dev.txt

StevenKwgrant: http://bazaar.qastaging.launchpad.net/~launchpad-pqm/launchpad/devel/files looks okay to my testing, but I'm not sure how to stress it00:05
wgrantStevenK: Have you tried some non-ASCII paths?00:09
StevenKThat means finding a branch that happens to have some, or making my own...00:11
wgrantdanilos: Are bug #869264 and bug #730610 duplicates?00:20
_mup_Bug #869264: Old upstream translations overwrite newer upstream translations in Ubuntu <lp-translations> <message-sharing> <regression> <Launchpad itself:Triaged> < https://launchpad.net/bugs/869264 >00:20
_mup_Bug #730610: translation uploads from old series replace the current series translations <message-sharing> <Launchpad itself:Triaged> < https://launchpad.net/bugs/730610 >00:20
StevenKwgrant: http://bazaar.qastaging.launchpad.net/~stevenk/+junk/foo/files00:23
wgrantStevenK: Does that crash on prod?00:24
StevenKNope00:24
wgrantThen it's not a dreadfully good testcas00:25
wgrante00:25
wgrantIt's in a dirname function00:26
wgrantSo it will probably need to be a directory name00:26
StevenKYes, I'm pushing r2 now00:27
StevenKhttp://bazaar.launchpad.net/~stevenk/+junk/foo/files/head:/foo%C7%80%C6%B6/foo%C6%86/ => OOPS00:28
* StevenK reaches for qas00:28
StevenKwgrant: OOPS-3b6ba4d894000fb4d96e6e6e947ef2cd on prod, a lack of oops on qas00:28
wgrantStevenK: Marvellous00:28
wgrantDoes it look sane on qas?00:29
StevenKYes00:29
wgrantSo it does00:29
StevenKwgrant: http://bazaar.qastaging.launchpad.net/~stevenk/+junk/foo/files00:29
wgrantqa-ok!00:29
StevenKwgrant: Does sir wish for a NDT?00:29
wgrantIndeedily.00:29
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
wgrantAhhh03:45
wgrantTracked down the translation consistency bug finally03:45
wgrantThe export bug03:45
wgrantczajkowski: ^^03:45
StevenKwgrant: Oh?03:57
wgrantStevenK: Filtering a left join in the wrong place04:00
wgrantSimilar to a mailing list bug we had a couple of years ago04:00
StevenKHandy04:00
StevenKAnd sort of subtle without tests04:00
wgrantYeah04:01
wgrantIt excludes messages when the potmsgset is shared, and the only translation is a diverged one for the other side.04:02
wgrantjtv: Around?04:35
jtvHi wgrant04:35
jtvI mean: yes.04:35
wgrantjtv: Hi04:35
wgrantjtv: http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/view/head:/lib/lp/translations/doc/vpoexport.txt#L10104:36
wgrantThe last section04:36
wgrantI think the test is insane04:36
wgrantDo you remember enough about this to sanity check it?04:36
wgrantThe test asserts that the untranslated messages aren't returned by getTranslationRows04:36
wgrantBut normal untranslated messages *are* returned04:37
jtvIm looking.04:37
wgrantThe ones in this test are not returned due to a probably SQL bug which excludes messages if the only translation is a diverged one on the other side04:37
jtvOh, by the way: it's a doctest, so safe assumption that it's insane.04:37
wgrantIf I were to create a new template item, it would show up there04:37
wgrantHhe04:37
wgrantYes04:37
jtvExcludes messages from what?  From the list of suggestions?  Or from the translation?04:38
jtvBecause if the only translation is a diverged one on the other side, that means there's no translation where you're looking.04:38
wgrantgetTranslationRows is used for PO exports, so it's meant to return all of the template's messages04:38
wgrantEven if they're untranslated04:38
wgrantIt achieves this, except that the left join condition is in the wrong place, so if the only translation for a potmsgset is a diverged translation for another template, the message doesn't show up at all, even with a null translation.04:39
jtvOh, the potmsgset is being left out?04:39
jtvGotcha.04:39
wgrantThe test asserts that behaviour; both of those examples at the end should also return a None row AFAICT04:39
jtvLet me just look closer into what getTranslationRows was meant to do...04:41
wgrantSure04:41
wgranthttps://pastebin.canonical.com/87982/04:42
wgrantIf I add a third message with no translations at all, it shows up, as I assume the correct behaviour is04:42
jtv#@$ 2fa04:42
wgrantBut the messages that have only diverged translations don't show up at all.04:43
wgranthttp://paste.ubuntu.com/5654235/04:43
jtvTrying to load that first pastebin first.04:43
wgrantThe second one is the same04:43
wgrantBut no 2FA :)04:43
jtvAh04:43
jtvI'll have a look.04:43
jtvWhy, why, why did nobody accept my proposal of using null instead of 0 as a sequence number for obsolete messages?04:46
wgrantI have been wondering that for a good portion of the last week04:46
wgrantI hoped you'd have an excuse :P04:46
jtvWell okay, I think I remember the reason: it was left for later.04:47
wgrantHeh04:48
jtvI guess the condition on TranslationMessage.potemplate is in the wrong place, yeah.04:48
wgrantYeah04:48
wgrantIf I move it into the left join where it should be, the bug goes away and that test fails04:48
jtvWatch out for performance changes.04:49
jtv(Even if it gets faster, I'd like to hear about it :)04:49
wgrantThere's also the slightly confusing aspect that in its current position it's actually a three-way disjunction: no TM, undiverged TM, or diverged TM for this template04:49
wgrantYeah04:49
wgrantThe existing query is absolutely dreadful, so I'm not too concerned04:49
wgrantBut I will check04:49
wgrantOh04:50
wgrantThe query itself is only a couple of seconds04:50
wgrantI guess the data transfer and object loading may be big04:50
wgrant'cause it appears to take about a minute04:50
wgrantWhen run in a harness04:50
jtvFWIW VPOExport used to be a view in the database.  Meant as an optimization, had turned into maintenance *and* performance drag.04:50
jtvA minute in harness?  What kind of dataset are you  running against!?04:51
wgrantddtp-ubuntu-universe04:51
jtvAh OK then :)04:51
wgrantaka. the biggest template04:51
wgrantIt's what the bug was reported against04:51
wgrantAnd I had no idea what was wrong04:51
wgrantSo couldn't really minimise it04:51
jtvAny major speed changes for that query though?04:51
wgrantChecking04:51
jtvCongratulations on spotting this.  Good sleuthing.04:51
StevenKAnd wgrant has spent 1.5 weeks with his head in rosetta :-(04:52
wgrant(the export of just the French raring translation takes upwards of 5 minutes, so testing without a harness is a bit painful...)04:52
jtvGah04:52
wgrantStevenK: This bug is only today, though04:52
jtvSo many things I would still have loved to have time to clean up...04:52
jtvImport approvals in particular!04:52
StevenKjtv: Like lp.translations.model.* ? :-)04:52
jtvPretty much.04:52
jtvThe trick with these things is that you have to hate complexity, ambiguity, and tech debt.  Seek it out & destroy it.04:53
jtvOh, and you want my guess as to why data transfer & object loading seem to take so long?04:54
wgrantOh04:54
wgrantIt's grabbing context etc.04:54
jtvIf the query includes POTemplate or POFile, those have text fields containing the headers.04:55
wgrantSo lots of reasonably sized strings, I suppose04:55
jtvUnreasonably sized header strings.04:55
wgrantAnd pomsgids04:55
jtvUnicode conversion, awkward data sizes.04:55
wgrantNo POTemplates or POFiles here04:55
jtvOh that's a relief.04:55
wgrantJust POTMsgSets and POMsgIDs04:55
wgrantBut still not small, especially for that template04:55
jtvpomsgids are short and de-duped.04:55
wgrantDescriptions are fat04:55
jtvAh true04:55
jtvBut they should only come in at the end, basically.04:56
wgrantThis template is about the worst possible case for everything, except that it has no plurals.04:56
jtvQuite.04:56
wgrantAnyway, thanks for your help04:56
wgrant:)04:56
jtvNo worries.04:56
wgrantStevenK: https://code.launchpad.net/~wgrant/launchpad/bug-1158854/+merge/15589205:25
StevenKwgrant: r=me05:33
wgrantThanks05:33
StevenKI'd like Stormification, but not now05:33
wgrantTranslations is difficult to Stormify due to the dynamic column names05:34
nigelbOh hey, jtv is still around! ;)06:45
jtvYup.  Hi nigelb!06:46
jtvHow's life?06:46
nigelbPretty good! Surving. How about you?06:46
nigelb*Surviving06:46
nigelbAre you still out East?06:47
jtvYup.06:48
jtvHot  here.06:48
nigelbHere too. 35C is *not* pleasant.06:48
StevenKIt hit 32 in Sydney today06:59
nigelbI'm on the top floor of this building. Sometimes I end up sitting on the floor because it's slightly less warmer.07:00
jtvI've got a fan blowing at me right now.07:05
daniloswgrant, yeah, they seem to be describing the same thing, though 869264 is a bit more specific07:06
wgrantdanilos: Yeah, I was going to dupe them in that direction07:07
wgrantSince 869264 is clearer07:07
wgrantThanks07:08
czajkowskiwgrant: StevenK translation bug all fixed ?08:31
wgrantczajkowski: Not on production yet, but the missing string thing is fixed in trunk08:32
wgrantWill be deployed Tue or Wed08:32
wgrantThat's the two bugs from the 23rd08:33
czajkowskiexcellent08:34
czajkowskithanks folks08:34
=== Nigel_ is now known as G
=== benji___ is now known as benji
=== teknico is now known as teknico_away
=== wedgwood_away is now known as wedgwood
=== jamestunnicliff_ is now known as jamestunnicliffe
=== vednis_ is now known as mars
=== matsubara_ is now known as matsubara
=== Ursinha-afk is now known as Ursula
=== wedgwood is now known as wedgwood_away

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!