/srv/irclogs.ubuntu.com/2011/10/21/#launchpad-dev.txt

lifelesswgrant: got a url to a test failure ?00:20
wgranthttps://lpbuildbot.canonical.com/builders/lucid_lp/builds/1484/steps/shell_6/logs/summary https://lpbuildbot.canonical.com/builders/lucid_db_lp/builds/1446/steps/shell_6/logs/summary00:21
wgrantI first saw it in an ec2 run against devel r1417400:22
lifelessit looks like a regression00:22
wgrantIn an untested JS-only branch of mine00:22
lifelessthe (158, 160, 'SQL-main-slave', 'SELECT Product.answers_usage, Product.blueprints_usage, Product.owner, Product.active, Product.autoupdate, Product.bug_reported_acknowledgement, Product.bug_reporting_guidelines, Product.bug_supervisor, Product.bugtracker, Product.date_next_suggest_packaging, Product.datecreated, Product.description, Product.development_focus, Product.displayname, Product.downloadurl, Product.driver, Product.enable_bug_expiration, 00:22
wgrantBut it is not reproducible locally, and a second ec2 run worked.00:22
wgrantYes.00:22
lifelessbah00:22
lifeless(244, 244, 'SQL-main-slave', 'SELECT Product.answers_usage, Product.blueprints_usage, Product.owner, Product.active, Product.autoupdate, Product.bug_reported_acknowledgement, Product.bug_reporting_guidelines, Product.bug_supervisor, Product.bugtracker, Product.date_next_suggest_packaging, Product.datecreated, Product.description, Product.development_focus, Product.displayname, Product.downloadurl, Product.driver, Product.enable_bug_expiration, Prod00:22
wgrantThat's clearly the regression.00:23
wgrantI don't see how, though.00:23
lifelesscould be storm cache exhaustion ?00:23
lifelesshave you seen it happen locally?00:23
wgrantNo.00:23
wgrantNever locally.00:23
wgrantLocally it's way below the threshold.00:23
wgrantBy like 2000:24
wgrantI had to reduce the limit to 20 or 30 or so to get it to fail locally.00:24
lifelessthat where X LIMIT 1 is odd00:24
lifelessI have to pop out for a bit; doing a test run that generates backtraces on every query into the timeline would probably let this get diagnosed00:25
wgrantWould it?00:26
wgrantThe revision that added the test speaks of testing for preloading of Product and Distribution.00:26
wgrantWhich suggests that there is preloading broken, not that there are extra product lookups.00:27
lifelessthat trace clearly shows the product being loaded twice00:29
lifelesssee the query starting at 15900:29
lifeless'product.id IN (...., 49, ....)'00:30
lifelessand then the qyery at 24400:30
lifeless'product.id = 49 LIMIT 1'00:30
lifelesssame product00:30
lifelesssame store00:30
lifelesswgrant: ^ I'm out for a bit sorry, but that smells like a storm cache issue to me; I think we should disable the silly size limits00:32
wgrantOh, so it does.00:33
wgrantlifeless: You mean the custom dev limit of 100?00:34
wgrantWhereas on prod it's 10000?00:34
* wgrant fixes qa-tagger to not use edge.00:51
lifelesswgrant: yes01:11
lifelesswgrant: dev should match prod, because devs want to reproduce behaviour on prod01:11
lifelessseparately, given we toss the entire cache away per request, we should stop using a fancy cache and just use a dict01:11
wgrantlifeless: I imagine the motivation is similar to the batch size of 8.01:11
lifelessbatch size of 8 makes more sense01:12
lifeless(but still is an issue for e.g. screen layout testing01:12
wgrantRight.01:12
lifelessanyhow, focus - the cache size is I think the issue here01:12
wgrantSo, fixing the 100 to 10000 is a matter of deleting a line from the dev config.01:12
wgrantBut do we want to identify the regression?01:13
lifelesswow, wiredoo, wow01:13
lifelesswgrant: well, if it is the cache, its not a regression01:13
lifelesswgrant: prod won't be late-evaluating01:14
wgrantIndeed, but something extra is getting into the cache.01:14
lifelesstest threads don't dump the cache01:14
lifelesspublication.py like 75901:16
lifelessis the loop01:16
lifelessand this is the kicker:01:16
lifeless            if thread_name != 'MainThread' or name.endswith('-slave'):01:16
lifeless                store.reset()01:16
lifelessnot thread 0 or any slave, reset01:16
wgrantHeh01:17
lifelessand yes, thats production code01:17
lifelessso, interestingly, this shold be getting dumped IFF the test runs through publication01:17
lifelessah, happens on endRequest, not begin01:17
mwhudsonthat code did my head in the other week01:17
lifelessmwhudson: of course, it exists to blow your mind01:18
lifelessin fact, it should reset test stores01:18
lifelessit only doesn't because the test fallout would be ginormous01:19
lifelessaieee01:33
lifelesshttp://wiki.postgresql.org/wiki/Loose_indexscan01:33
wgrantHah01:34
jtvStevenK: did you come up with the term “blamer” in the soyuz notification module?  I'm trying to make sense of it but not doing very well.06:07
wgrantjtv: I believe it's more of the blamee.06:11
wgrantThe uploader or the copier, in general.06:11
jtvYes, I've been thinking it must be the blamee.  The code seems to assume pretty strongly that it's the signer.06:14
jtvMy clever scheme is to figure out whether a native English speaker came up with it.  If yes, I'm more willing to assume that there's a reason that I'm not seeing.06:16
wgrantStevenK implemented it, but I don't recall who came up with it.06:16
wgrant'twasn'06:16
jtvI'm separating the "figure out whom to email" code from the "compose and send" code.  There's only a few call sites, but one of them is in the package copier which I think is a very different use case.06:16
wgrantt me.06:16
wgrantThe package copier is meant to use the person who requested the copy as the blamer.06:17
wgrantI believe they receive notifications of the copy, and are used as the sender for the announcement message.06:17
jtvIronically, the maintainer and the person credited with the latest change are emailed _if_ the caller passes a "blamer."06:18
wgrantThat may be related to autosyncs.06:18
jtvI'd sort of expect that to happen if you _don't_ pass one, as a fallback.06:18
wgrantWhich are unsigned, and should email nobody.06:18
jtvNow, who should be notified in the case of a copy?06:21
wgrantThe person who requested it and an undefined set of other people.06:21
jtvJust the person requesting it?06:21
wgrantExcept in the case of autosyncs, in which case an undefined set of people.06:21
jtvI am asking you to help define that set.06:21
wgrantThat's one of the great mysteries of the universe, which we've never had a good answer to :/ But probably nobody, in the general case.06:22
wgrantBuild notifications are even less well defined :/06:22
spm<wgrant> That's one of the great mysteries of the universe, <== the answer is 42. just sayin.06:23
jtvThen how about we notify only the requester, then sit back and see who else wants to be in the loop?06:25
wgrantWell, for one thing we don't know the requester for build notifications.06:26
wgrantWhich I believe are the problem here.06:26
jtvDamn.  I have to go take of stuff.06:31
jtvEspecially drinking water.06:31
jtvAnd seeing how my family is — their area got hit hard overnight and I think they lost telephone06:33
=== wallyworld_ changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | Welcome danhg | On call reviewer: - | Critical bugtasks: 266
nigelbspm: heh07:20
adeuringgood morning07:57
rvbaMorning adeuring.07:57
adeuringhi rvba!07:57
bigjoolsmorning08:01
mrevellGood morning!08:02
=== panta_ is now known as panta
=== almaisan-away is now known as al-maisan
* nigelb hugs wgrant 09:23
=== al-maisan is now known as almaisan-away
jtvdanilos: have fun in your new team!11:06
danilosjtv, thanks :)11:06
jtvAlso, don't try sneaking out without finishing your Q/A because I would be able to get to it until Tuesday!11:07
=== jtv is now known as jtv-afk
=== almaisan-away is now known as al-maisan
StevenKjml: Hai. I'd like to do a cherry pick release of Twisted so I can fix a Critical, but I can't figure out how you did it. The fix is already upstream, so perhaps they're close to a release?12:59
jmlStevenK: bigjools did one recently, iirc.13:00
jmlStevenK: and I could have sworn I wrote up the process a couple of years ago into a mailing list message.13:00
jmlStevenK: I have to be afk now, otherwise I'd help more.13:00
jmlStevenK: Twisted's looking for volunteers for an 11.1 release.13:00
bigjoolsStevenK: I can  help13:23
StevenKbigjools: I've been distracted, but I want to head to bed soon, so would you mind sending me a mail with follow-the-bouncing-ball?13:26
danhgHey gmb, thanks for the email14:05
danhggmb:14:05
danhghmmm...14:05
gmbHi danhg :)14:06
danhgah, it works!14:06
danhgIt didn't 'look' like it had14:06
flacostebigjools: so the fix for bug 34086 is live?14:15
_mup_Bug #34086: removal of arch-all packages while there are arch-specific packages dependent on it results in uninstallable binaries <bad-commit-14159> <escalated> <feature> <lp-soyuz> <qa-ok> <rls-mgr-p-tracking> <soyuz-publish> <Launchpad itself:Fix Committed by julian-edwards> <Ubuntu:Invalid> < https://launchpad.net/bugs/34086 >14:15
bigjoolsflacoste: no, it's still fix-committed14:15
flacostebigjools: 14171 was deployed earlier today14:16
bigjoolsI didn't want to push a release out to cocoplum on a Friday14:16
bigjoolshmmm14:16
bigjoolsflacoste: cocoplum is not in the FDT set14:17
flacosteyou mean the NDT set14:17
flacostebut ok14:17
flacostethanks14:17
bigjoolsI do!14:17
bigjoolsflacoste: I told infinity it would most likely be on Monday anyway14:18
flacostegreat14:18
SpamapSassuming this was a temporary problem: https://launchpadlibrarian.net/83224566/buildlog.txt.gz14:20
SpamapSbzr: ERROR: xmlrpc protocol error connecting to https://xmlrpc.edge.launchpad.net/bazaar/: 502 Bad Gateway14:20
abentleyallenap: Where are we at with this storm bug you've fixed?14:25
rvbaabentley: allenap is off today.14:26
abentleyderyck: ^^14:26
deryckah bummer bummer14:26
deryckbigjools, do you know where allenap was at with the Storm bug?14:27
deryckhmmm, nearly call time for me. nm.14:28
bigjoolsderyck: trying to get it reviewed - there was some back and forth.  I told him to just throw it at download-cache for now to unblock us but I dunno if he finished that14:28
bigjoolsyou could grab his branchj14:28
deryckbigjools, ah great.  That's what I was going to suggest.14:28
deryckabentley, can you grab his branch and roll up a tar ball for download-cache?14:28
abentleybigjools: This is lp:~allenap/storm/oneiric-admin-shutdown-bug-871596 right?14:30
bigjoolsyes14:30
abentleyderyck: It's tricky, because allenap's branch is against a newer version of storm than our current, so merging it brings in those changes.15:01
deryckabentley, ah, right.  And we need to maintain our fork as well, for the with stuff.15:05
abentleyderyck: Right.  So I guess I can merge current storm into our fork, then merge allenap's stuff.15:06
deryckabentley, yeah, that sounds right to me.15:10
deryckmrevell, so I see the problem now in the image you sent me.  Was hard to spot at first.  The number and title part are further to the right from the status and importance than what I see.15:16
deryckmrevell, sound right?15:16
mrevellderyck, Yeah, that's it15:16
deryckmrevell, gotcha.  that's easy.  I just gave each section a % width.  Easy enough not to do that.  The middle one needs to expand but not the first or last.15:17
deryckmrevell, there are actually sections there, even though it's not a table.15:17
mrevellYeah, I like them, they solve the scannability problem.15:17
deryckmrevell, yeah, I think so, too.15:18
sinzuigary_poster, benji, bac: help! launchpadlib does not know who I am. I switched computers, and uses deja-dup to restore my user data to the new machine. I have deauthorised all my scripts in lp, deleted .launchpadlib cache, and deleted all the launchpad.net password in my keyring15:34
benjisinzui: what error are you getting?  are you getting the authorize-this-script web page?15:35
sinzuibenji, I an never prompted to re-authorise. The script runs then when I need lp.edit or lp.moderate, I get permission denied15:37
benjisinzui: did you delete all of .launchpadlib or just the cache directory?15:38
=== al-maisan is now known as almaisan-away
sinzuithere is nothing in the directory now15:38
benjik15:38
sinzuiI logged and and back in thinking the keyring in the session had cached15:39
benjisinzui: is your script using login_with or login?15:40
sinzuiwell good question15:40
sinzuibenji, lpscript uses Launchpad.login_with(app_name, system_name, version='devel')15:41
* sinzui tries his test script15:41
sinzuibenji, my test script fails in the same way with Launchpad.login_with(15:42
sinzui        'test', service_root='https://api.launchpad.net', version='devel'15:42
sinzuibenji, I did deauthorise all scripts since they were all tied to my previous computer15:43
sinzuiI really expect a prompt to reauthorise15:43
benjisinzui: I suspect there's a deauthorized credential lurking in your keyring, that's the only scenario I can see at the moment that would cause these symptoms15:44
sinzuiyeah, that is why I got brutal and removed all Lp passwords.15:44
sinzuibenji, since these were system-wide for my computer, is Lp the real authorisor? could ubuntu/login.ubuntu.com be the actual authorising party?15:46
benjisinzui: I don't understand the question, but regardless, I think the answer is "yes".15:47
sinzuioh, I could rename the script which might cause an authorisation prompt15:47
benjiI don't think that'll work.  At least, I'd be dissapointed if it did.  The intent was that once a machine is authorized, all scripts are authorized.15:49
sinzuidoes lp-lib piggy back on firefox? I think I same an authorisation request a new days ago that opened firefox, but that is not my preferred browser15:51
benjisinzui: it uses python's webbrowser module (which is awful)15:55
sinzuiI renamed my moz dir, but that did not help15:55
flacostedanilos: since it's your last LP day, thanks for everything and good luck with Linaro!16:08
bigjoolsdanilos: ditto from me16:08
flacostesinzui: did you cleaned-up seahorse?16:08
sinzuiI have been, but I believe I have a lot more to purge16:09
danilosflacoste, bigjools: thanks both, it was a joyful ride! :)16:09
flacostesinzui: lplib tokens are very descriptively called 'network password' :-(16:09
sinzuioh!16:09
sinzui!!16:09
sinzuithere are a hell pf a lot of those16:09
flacosteif you click on them, you should see that it relates to one of the LP hosts16:09
flacostedanilos: and i'll have my illuminati cards in Orlando to kick your butt for leaving ;-)16:10
sinzuiinteresting16:10
danilosflacoste, hehe, you know that whoever is a rookie at the game will win (ok, or Martin :)16:11
flacostedanilos: and of course buy you a beer afterwards to thank you for all of the good things you did16:11
danilosflacoste, thanks, I owe you plenty of beers myself!16:11
sinzuiflacoste, deleting them did indeed prompt to reauthorise. But I still got the lp.moderate auth error in my script16:11
sinzuiI was also shown firefox, which is not my browser16:11
flacostei blame ubuntu for the later part :-)16:12
flacostesinzui: what's the lp.moderate error?16:12
sinzui401 (<Product at 0x145c8950>, 'project_reviewed', 'launchpad.Moderate')16:13
sinzuiflacoste, I do not think the script knows I am sinzui in ~registry16:13
sinzui!16:14
sinzuiflacoste, I see the problem16:14
sinzuiflacoste, it is firefox16:14
sinzuiflacoste, It is not my browser. It is my daughter. She is only authorised to to choose television programs in my house16:15
flacoste!16:15
flacostesinzui: you are on your daughter computer?16:15
sinzuiNo, She does qa for me when I need a normal user16:16
sinzuihence my remark that it is not my browser.16:16
=== deryck is now known as deryck[lunch]
sinzuiThis is an easy fix in the browser, but I want launchpadlib to use the browser my computer is configured to use16:16
flacostesinzui: how did you configure the browser?16:22
flacostesinzui: iirc, we are using the python browser which should use either x-www-browser or www-browser depening on the DISPLAY env16:23
flacostedoes x-www-browser invokes your correct browser?16:23
sinzuiFrom Ubuntu's menu, System Settings > System Info, Default Applications16:23
sinzuiThat controls the web browser shown in the dash16:23
sinzuiand it sets the xdg data16:24
flacosteright16:24
flacostebut that doesn't integrate with the Debian alternatives system16:24
flacosteupdate-alternatives --display x-www-browser16:24
flacostewhat does that show?16:24
flacosteuse that to set your browser and you'll be fine16:25
flacostei'd advocate that changing default applications that doesn't update the alternatives is not a launchpadlib bug16:25
sinzuiflacoste, thank you very much. I reconfigured x-www-browser and chose the auto option and the system default browser now always the chosen browser16:28
flacostegreat!16:28
flacostenow food16:28
sinzuiThis looks like a bug in  x-www-browser where it chooses a specific16:28
jmlStevenK: http://people.canonical.com/~therve/Twisted/11.1.0pre1/ ; http://twistedmatrix.com/pipermail/twisted-python/2011-October/024686.html16:30
* bigjools gets the buildd-manager to cancel a build mid-build <evil cackle>16:37
=== deryck[lunch] is now known as deryck
=== jam2 is now known as jam
abentleyderyck: how's it going?18:46
deryckabentley, not too bad.  a little slower than I'd like.  But making progress.18:47
abentleyderyck: just a heads-up, I've reached the point where I see that what I have is better represented as an object with several methods, rather than a collection of functions.  So update_listing will become ListingNavigator.change_ordering.18:50
deryckabentley, ah, interesting.18:50
deryckabentley, presumably this still just needs the order by string from the order by widget to update the page?18:51
abentleyderyck: right.  It will allow me to write unit tests that don't have to mutate window.*18:52
deryckabentley, ok, nice.18:52
abentleyderyck: Because that connection will be made by a factory method.18:52
=== danhg_ is now known as danhg
sinzuijcsackett, do you have time to mumble?19:45
jcsackettsinzui: sure.19:45
sinzuijcsackett, part1 https://help.ubuntu.com/community/MacBookAir4-219:55
sinzuijcsackett, part2 http://sourceforge.net/projects/gptfdisk/19:56
sinzuijcsackett, part3 http://ubuntuforums.org/showpost.php?p=11215214&postcount=18519:57
flacostecritical analysis draft finally completed!22:04
flacostesent to the list!22:04
flacosteand i'm done for the day22:04
flacosteenjoy your week-end22:04
wallyworldsinzui: you still around?22:11
cjwatsonflacoste: illuminati> subscribe!  haven't played that in years23:37

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!