/srv/irclogs.ubuntu.com/2010/06/03/#launchpad-dev.txt

=== Ursinha is now known as Ursinha-afk
=== bjf is now known as bjf[afk]
pooliespm, when you have a spare few minutes could you look over https://dev.launchpad.net/LEP/DKIMAuthenticatedMail from a LOSA's point of view?00:29
spmpoolie: tbh, I don't know a lot about dkim. but the reasonings for, sound fine to me. it's not perfect (what is...), but afaict from the cases there, will assist a large chunk of users. +½, given my ignorance on the full topic.00:33
pooliethanks00:36
Ursinha-afkis it just me or it isn't possible to login to staging right now?01:02
lifelesswgrant: do you mean 'beta is breaking'?01:03
spmUrsinha-afk: it's not just you. I have the same problem. I believe it's known.01:03
Ursinha-afkoh...01:04
Ursinha-afkspm, you're not sure it's known? I'm considering filing a bug for that01:05
Ursinha-afkwhat do you think?01:05
spmUrsinha-afk: :-) file it anyway. worst case LP QA will mark it as a dupe. :-P01:05
spmtbh, I thought it was just me. but if you're having issues too, perhaps not.01:05
Ursinha-afkspm, just found out trying to validate a token to use lpapi01:06
spmnod01:06
Ursinha-afkand it explodes as a django error, not an oops01:07
ScottKpoolie: In answer to yesterday's question: A dkim signature covers a lot more of the message than a gpg signature.  The one case I've managed to see real success data of a large enterprise trying to do dkim verification on a second tier MTA and not on the border it had a significantly lower verification reliability than cases where I've seen it done on the border MTA.01:47
ScottKSo yes, I think there's an unintended transformation in there, but experience tells me they are hard to avoid entirely.01:48
poolieok02:01
pooliethat's useful data02:01
pooliei saw a post the other day about exchange breaking signatures02:01
poolieand my first attempt at a test broke because when the message is parsed and unparsed the headers come back re-flowed02:02
poolieScottK, i'm kind of hoping we have less of the 'enterprise' software that mangles messages02:04
poolieimbw02:04
ScottKpoolie: I think it's more to do with verify at the border or internally.  The other issue with internal verification is that not only do you not have to break the signatures now, you have to make sure future changes don't either.  Not an issue if you verify at the border.02:36
ScottKpoolie: Did you add the test messages to the python-dkim bug?  I don't recall seeing the bugmail?02:36
poolieScottK, sorry not yet02:38
pooliehaven't worked on it again yet02:38
poolieit's just itch-scratching/curiousity, not actually my job02:38
ScottKOK.  As long as it's not forgotten, not a big deal, you just won't get progress on the bug until I get it.02:38
ScottKOK.02:38
* ScottK looks around to see what's his job.02:39
pooliek02:45
lifeless\o/ timeouts04:41
lifelessspm: can you sync edge oops please?04:41
lifelessOOPS-1615EC39504:41
spmdone04:42
spmand not found. wonderful.04:42
lifeless\o/04:42
lifelessis it me?04:42
* spm is tempted to say yes, but that'd be the evil talking04:43
lifelesshttps://bugs.edge.launchpad.net/oops-tools/+bug/58900704:50
mupBug #589007: oops OOPS-1615EC395 not found by lp-oops web ui <OOPS Tools:New> <https://launchpad.net/bugs/589007>04:51
mwhudsonit's there now04:53
lifelessgrr04:53
lifelessspm rsunc it04:54
lifelessand it didna work04:54
lifelessanyhow04:55
lifeless10410360ms04:55
lifelessthats 104  10360ms04:55
lifelessSELECT COUNT (CASE WHEN BugTask.status = 10 THEN BugTask.id ELSE NULL END), COUNT (CASE WHEN BugTask.status = 15 THEN BugTask.id ELSE NULL END), COUNT (CASE WHEN BugTask.status = 20 THEN BugTask.id ELSE NULL END), COUNT (CASE WHEN BugTask.status = 21 THEN BugTask.id ELSE NULL END), COUNT (CASE WHEN BugTask.status = 22 THEN BugTask.id ELSE NULL END), COUNT (CASE WHEN BugTask.status = 25 THEN BugTask.id ELSE NULL END) FROM BugTask04:55
mwhudsonlotsa ubuntu bugs to count up04:56
thumperstub: hi04:58
stubyo04:58
thumperstub: review poke for abentley's branch05:01
lifelessanother timeout05:02
lifelessstub: hows the db looking; getting timeouts on edge on fairly routine things05:10
lifelesslike filing a bug on the launchpad project, in the 'related bugs' search05:11
mwhudsonoh05:12
stubNothing traumatic. Load of under 10, log lag. Fair bit or replication going on.05:12
mwhudsonwell05:12
stubc/log lag/low lag05:12
=== almaisan-away is now known as al-maisan
stubNow, on the other hand, we are having load issues...07:53
stubfiera, karma calculater, garbo-daily, lucille all running at the same time.07:54
lifelessoops07:54
stubSo OOPS-1615EA901 (trying to view a merge proposal) caused by load I think07:59
lifelessSELECT %s FROM (SELECT BranchRevision.branch, BranchRevision.id, BranchRevision.revision, BranchRevision.sequence FROM BranchRevision WHERE BranchRevision.branch = 352323 AND BranchRevision.sequence IS NOT NULL AND BranchRevision.revision NOT IN ( SELECT revision FROM BranchRevision WHERE branch = 34755) ORDER BY BranchRevision.sequence DESC LIMIT 1) AS "_tmp" LIMIT 108:00
lifelessthats what took 17 seconds08:00
lifelessI'd guess lock contention rather than sheer load08:00
* lifeless handwaves08:00
adeuringgood morning08:11
krkhancan anyone point me to the method for manually calculating the ssha hashes used for accounts?10:18
jelmer_when is PQM going to be opened again?10:25
krkhanopenldap's slappasswd generates ssha hash but it still doesn't login10:29
thumperjelmer_: did you see the chicken git import failure log?10:31
jelmer_thumper: hi10:32
lifelesskrkhan: sha hashes? where10:33
jelmer_thumper: looking10:34
thumperjelmer_: thanks10:34
krkhanlifeless: i'm running a local launchpad. i can't login for the default admin@canonical.com account for some reason (invalid email/password). so i thought maybe i changed the passwd and forgot10:34
krkhani guess manually editing the accountpassword table would make things work. but i don't know how to correctly calculate the ssha hash used10:35
lifelessAFAIK launchpad no longer stores any passwords10:36
thumperkrkhan: the local password should be 'test'10:36
thumperjelmer_: pqm opens when the release manager is happy :)10:36
krkhanthumper: i used to login with 'test' before. it's not logging in with that any longer10:37
thumperkrkhan: what did you change?10:37
jelmer_thumper: I can reproduce it locally, but no idea what it's caused by10:39
krkhanthumper: not the password at least. let me recheck using a previous snapshot of the vm10:39
thumperjelmer_: some fun debugging then :)10:39
jelmer_thumper: can you file a bug against bzr-git ?10:39
thumpersure, but probably tomorrow :)10:40
krkhanthumper: it refuses to login with admin@canonical.com and test. and i haven't changed anything10:50
thumperkrkhan: I'd run 'make clean schema' and try again10:50
noodles775krkhan: ^^^ assuming you don't care about any data in the launchpad database.10:52
krkhanthumper, noodles775: i don't. anything that works will be fine. trying make clean schema10:53
lifelessthumper: how does local auth work; didn't SSO split it all out ?10:57
* thumper shrugs10:58
thumperI don't know how it wors10:58
thumperworks10:58
bigjoolso/10:58
thumperyes bigjools?11:05
bigjoolsjust saying hi11:05
thumperoh hi11:06
krkhanthumper: worked perfectly. thanks :-)11:06
thumperkrkhan: I have no idea why though11:06
thumperkrkhan: make clean schema is my reset button11:06
maxbooi, when does the db-devel>devel mergeback happen?11:11
bigjoolsmaxb: when the release manager decides it can happen, usually when we open PQM after a re-roll, if that happens at all.11:18
wgrantlifeless: The data is still in the DB -- and LP still has a test OpenID provider which uses that data.12:52
wgrantEventually Account will probably die, and testopenid will just have to ask for an email address and no password.12:53
=== jelmer_ is now known as jelmer-lunch
=== al-maisan is now known as almaisan-away
deryckgmb or adeuring , can one of you help me interpret bad test documentation please?13:19
adeuringderyck: I can try ;)13:19
deryckadeuring, see http://pastebin.ubuntu.com/443974/13:19
deryckadeuring, what "marker" does this test refer to?13:19
adeuringderyck: I think this means the text "This bug is a duplicate of..." (just concludning from the test output)13:20
deryckadeuring, ah, ok.13:21
deryckadeuring, I was thinking so special email foo something or other.  That makes sense.13:21
deryckprinting a ga-jillion emails out in doctest, however, does not. :-)13:22
adeuring;)13:22
deryckadeuring, thanks13:22
=== jtv1 is now known as jtv
svakshanigelb: hi14:07
svakshabryceh: i was told thatat you have developed a crawler which allows data from LP to be pushed upstream in to a bug tracker. I was looking for a webcrawler which allows data to be entered into forms (ala the kind of crawlers blog spammers use to leave comments)14:09
svakshadid i miss a reply to my query, /me was disconnected14:28
jmlmaxb, thanks for the great bug report14:31
derycksvaksha, bryceh doesn't really have a crawler.  He has a cgi script that gets bug data from LP and creates an upstream bug report from the data.14:58
svakshaderyck: thanks. that is probably not what i am looking for15:02
derycksvaksha, np.  cheers.15:04
=== bjf[afk] is now known as bjf
svakshaderyck: i'm trying to test MM lists for errors thatcrop up after some new featureswere implemented. see, http://abiwt.org/mailman/listinfo/dlist-58337915:09
derycksvaksha, ok, interesting.  How does this relate to Launchpad data?15:11
svakshasorry, that is why i didnt mention it earlier15:11
svakshaumm...i didnt know what bryceh's crawler does. i was told about it so asked to see if it would be useful15:12
deryckDoes any still find make lint output useful?15:22
bigjoolsderyck: only if I intend to fix it :)15:24
bigjoolsI use a pyflakes vim plugin now, so I tend to pick most lint up immediately.15:25
deryckbigjools, I used to find make lint useful when I started on lp, but it has become increasingly noisy and always pointing at stuff unrelated to what I'm working on...15:26
deryckwhich makes me wonder if anyone actually uses it.15:26
bigjoolsderyck: it used to be rigorously enforced15:26
bigjoolsdoesn't seem like it is any more15:27
deryckbigjools, by buildbot?  Or just in review?15:27
bigjoolsderyck: reviews15:27
bigjoolsI'd mention it in the next reviewers' meeting15:27
deryckyeah, I think I will.15:27
deryckbac, I can update the wiki, but I'd like to bring up the above ^^ about make lint in the next reviewers meeting.15:28
bacderyck: i find make lint useful, if noisy15:29
deryckbac, are you ok with me bringing this up in the reviewers meeting, i.e. to ask if we're enforcing lint checks at review and asking if the output of make lint could be made better?15:30
bacderyck: for the people that use our supported tools to create MPs, the lint report is always included and is handy for the reviewer.  increasingly i see developers not using 'bzr send' and writing subpar MPs that don't include lint output nor many of the needed sections.15:30
bacderyck: definitely15:30
deryckbac, yeah, I'm using bzr lp-propose-merge now, which doesn't include lint output like the bzr send plugin.15:31
deryckmake lint gone bad:  http://pastebin.ubuntu.com/444066/  :-)15:34
marsderyck, IIRC there was a discussion on the dev list recently where sinzui talked about his improved lint scripts.  They would be nice to land, but his release duties are blocking that.15:49
deryckmars, yeah, that would be cool to land.15:50
sinzuiMy scripts are now gedit plugins. Some work is needed to make them scripts again15:50
deryckmaybe I should just get bigjools pyflakes plugin for vim.15:51
deryckI tend to watch carefully myself and just like the post-work lint check.15:52
bigjoolsthe plugin is fabulous15:52
bigjoolsit's on vim.org15:52
marsderyck, yes, you should use that plugin.  I don't use vim anymore, but I still give it a huge +1 :)15:52
marsI would love to recreate it for Komodo15:52
deryckok, I'll grab it here shortly then.15:52
deryckI still think it's worth having a sane make lint, though.  Just for easy run against a branch we're reviewing.15:53
jelmeremphasis on "sane" :-)15:53
=== jelmer-lunch is now known as jelmer_
=== gary_poster is now known as gary_lunch
=== gary_lunch is now known as gary_poster
=== deryck is now known as deryck[lunch]
gary_posterderyck[lunch]: Are hwdb questions like this appropriate for the bugs team:  https://answers.edge.launchpad.net/launchpad/+question/113350 ?  If not, any ideas on where I should send it?18:39
=== salgado is now known as salgado-afk
=== deryck[lunch] is now known as deryck
deryckgary_poster, yup, completely fine for malone.19:24
gary_posterthanks deryck19:26
brycehwhenever I try to load https://dev.launchpad.net in my browser, it redirects me to the last page on that site I viewed, instead of taking me to the homepage.  Anyone else seeing this behavior?20:11
jmlbryceh, no20:42
lifelesssinzui: ping21:30
sinzuihi lifeless21:30
lifelesssinzui: bugs are too low bandwidth, I could feel myself getting into itty-bitty mode21:30
lifelessthe oops thing21:30
lifelessI'd like to know why you feel/think that its not a coding issue21:30
lifelessI mean, I can see that we have data to fix *too*, but surely the code should have behaved better given the data we gave it.21:31
sinzuiabout Lp identifying reserved names from the db and reserved names in the code and verifying that the object can have the name and that the user can access the object with the name21:31
sinzuiThat is a hard problem21:32
lifelessyeah, and filtering from searches appropriately; blacklisting isn't any harder than privacy, is it ?21:32
lifeless(he says knowing that privacy isn't all that easy :P)21:32
sinzuifrom the db perspective, no, because it is acl/privacy and we do handle it.21:33
sinzuifrom the code, we need some way to register the names in traversal and their type to verify they can be used.21:33
sinzuiI think the policy was to ensure the names in the code are added to the db21:33
sinzuiI am pretty sure that did not happen with 'oops' statik had no problems using his project last year. I do not know when we changed the code the break his project21:35
lifelessso there is a bit of code that lists <names>21:37
lifelessand a db table that also lists <names> ?21:37
sinzuiyes.21:38
lifelessI guess what I'm saying is this: how do we fix this so that it doesn't happen again; deleting the project only fixes this instance, not the cause of the confusion behaviour and spurious oops21:38
sinzuiYes21:38
lifelessI was assuming we'd need to enforce a blacklist somewhere we weren't, but if I understand you correctly, there's actually 2 lists that are meant to be identical, and aren't.21:39
sinzuiI do not know when or what in the app claims 'oops'21:39
lifelessthere is a ++oops++ handler21:39
lifelesswhich triggers an explicit soft oops21:39
lifelesscould that be it ?21:39
lifelessIf so, perhaps the oops project *isn't meant* to be blacklisted21:40
lifelessits just a victim of thumper's work to let devs trigger oops on demand, to see where db time is going.21:40
sinzuipossibly21:40
lifelesshow do we check the db list of blacklisted names ?21:41
lifelessif oops isn't in there, and isn't in the app list of blacklisted names, then its not really a blacklist issue21:41
lifelessits a webapp-overusing-a-name issue21:41
sinzuithat is an open bug. we do a sql query. We want a page to view and edit them.21:41
lifelessok21:42
lifelesslosa ping21:42
mbarnetthello lifeless21:42
lifelesswe're like to get the current list of blacklisted projects from the db please21:42
lifelesss/we're/we'd/21:42
sinzuiOur fields block admins from renaming a project to a blacklisted name when we know we must do it. They do a sql update to make it happen21:42
lifelessmbarnett: I don't know the right query to run, if its not in the LOSA pages, sinzui can supply it21:45
sinzuilifeless, I see the data on staging21:46
lifelessok cool21:46
lifelessmbarnett: sorry, you're not needed :)21:47
lifelesssinzui: so, is oops in the list of blacklisted projects?21:47
* sinzui still looking for the table21:47
lifeless:) ok21:47
rockstarsinzui, do you know how I create a browser for a person that isn't logged in.21:49
sinzuianon_browser?21:49
lifelessis that different to logged in anonymously?21:49
sinzuiyou can just import it from testing.pages I think21:50
* sinzui reads code to find the table21:50
* sinzui is an idiot21:52
sinzuilifeless, oops is not in the table21:53
lifelessok21:53
lifelessand its not defined as a blacklist in the app either, its just the ++oops++ trigger?21:54
rockstarsinzui, I'm not using a pagetest, but a unit test, so it's not available in some evil globals thing.21:55
thumperrockstar: just call setupBrowser()21:57
thumperrockstar: with no auth, it is anon21:57
* mbarnett is both glad and sad he is not needed.21:58
sinzuilifeless,  I lost power just as I was typing that oops is not in the table.22:01
sinzuirockstar, import setupBrowser() from canonical.launchpad.testing.pages. calling it without arguments return anon_browser22:01
lifeless08:53 < lifeless> ok22:02
lifeless08:54 < lifeless> and its not defined as a blacklist in the app either, its just the ++oops++ trigger?22:02
rockstarsinzui, got it, thanks.22:02
sinzuilifeless, I think so22:02
lifelessin which case22:03
lifelessI think a better phrasing of the bug is22:03
lifeless'non blacklisted webapp hooks subtly break search'22:04
lifelessand then we have two related questions22:04
lifeless - can we enumerate these hooks (to make an automated cross-check that the db blacklists things that users cant use anyway)22:04
sinzuiBut I cannot access "oops" from statik's pages, or from the list commercial project either22:05
lifeless - could we change the oops one so that it only triggers as ++oops++ and doesn't cause this broken traversal22:05
lifelesssinzui: right, somethings clearly going wrong here, but I think is unintentional fallout from the ++oops++ support22:05
sinzuiyes, and we can certainly make the same mistake again22:06
lifelessright22:06
lifelessso I'd like to keep one of the bugs open saying 'we should have some code that helps prevent this sort of mistake'22:07
sinzuiyes, I agree that is the bug22:07
lifelessand if possible, another saying '++oops++ does not need to break the /oops/ project - but perhaps that is hard :- I don't know as I haven't looked into it.22:07
sinzuiIt may be knowable if Navigation always uses @stepto and @step, but I am certain there are exceptions22:08
thumpersinzui: is it really conflicting?22:09
thumperI'd be surprised22:09
lifelessthumper: visit launchpad.net22:09
lifelessthumper: search for oops22:09
lifelessclick on statik's project name there22:09
lifelessyou get a 404 with an oops generated22:10
lifelessthumper: oops isn't blacklisted in the db, nor in the code from what sinzui could see22:10
thumperthat's the whole reason the namespaces have ++ on each end22:11
thumperI'm not sure why this is happening22:11
lifelessindeed22:11
lifelessI'm going to redraft the bugs to be clearer22:11
mwhudsonlifeless: the oops generation is not mysterious22:11
lifelessabout the generic and specific issues, assuming they are separate22:11
thumperI'd ask gary_poster, him being a zope master and all :)22:11
mwhudsonlifeless: it's because the referrer is a launchpad url22:11
lifelessmwhudson: oh right22:12
mwhudsonso we can stop talking about that22:12
lifelessmwhudson: thanks22:12
lifelessmwhudson: FWIW I only mentioned it here to address thumpers 'is it really conflicting' question22:12
sinzuibut we are getting about zope person right? there are always two, but which is the master22:12
mwhudsoni thought i said this last night, but maybe my wifi falling over22:12
lifelessmwhudson: which a simple 404 isn't very convincing about22:12
mwhudsonok22:12
lifelessmwhudson: yes, you did, and I know.22:12
mwhudsonsorry for the noise then :)22:13
* gary_poster sees name but nothing to which to respond22:13
lifelessmwhudson: but I was tired last night :)22:13
lifelessgary_poster: there is a oops hook in the webapp22:13
gary_posterfor generating oopses you mean?22:13
lifelesswhich handles ++oops++ - e.g. lp.net/launchpad/++oops++22:13
lifelessgenerates a soft oops22:13
lifelessyes22:13
lifelesshowever22:13
lifelessit seems that lp.net/oops which is a real project, not blacklisted, is denied access and we think its due to the oops handler existing.22:14
gary_posteroh!  I suppose "it shouldn't be" is a bit of an obvious reply :-)22:15
gary_posterperhaps, "why do you think so?" would be better22:15
lifelesswell22:15
gary_posterthat would imply to me that we should be able to dupe on a dev system22:15
gary_posterlemme try that22:15
lifelesswe know of the following mechanisms to make 404s22:15
lifelessblacklists22:15
lifelessdeleting things22:15
lifelessand bugs22:15
lifelessits not blacklisted22:15
lifelessits not deleted22:15
lifelessso must be a bug :)22:16
gary_poster:-)22:16
lifelessI haven't setup my dev VM to let me connect to it from the outside host yet, I've just been doing in-place unit testing :( I really should get around to that.22:20
lifelessgary_poster: does it happen for you locally?22:23
lifelesswe're getting way to many Searching for your bug in Launchpad took too long. Try reducing the number of words in the summary field and click "Check again" to retry your search. Alternatively, you can enter the details of your bug below.22:23
gary_posterlifeless: I decided to update post-PQM so...things are just ready to start up now post make schema.  Will report back.22:24
gary_posterpost PQM opening I mean22:24
lifelessI gotcha22:25
gary_posterlifeless: it is reproducible locally22:26
lifelessI've updated the bug report22:26
lifelesssinzui: thanks for teasing this apart with me22:26
sinzuiyour welcome22:26
lifelessgary_poster: so, do you think its the ++oops++ thing, or something different?22:30
gary_posterlifeless, not sure.  Should be a different code path, of course, but obviously something is wrong, and it's the same string, so....  since we've talked about it, I'm doing a pdb to look around.22:31
lifelesscool! thanks22:31
gary_posteryes, most definitely this has something to do with the namespace (Zope considers ++*++ to be a URI namespace mechanism).  The failure is specifically that it can't fine an "index.html" for the OopsNamespace object.22:33
gary_posterfind22:33
lifelessgary_poster: but lp.dev/oops shouldn't be going into the ++oops++ code, should it ?22:37
gary_posternope22:37
gary_posterpossibly a registration error.22:37
gary_posteroddly, editing one branch and running a branch doesn't accomplish much.22:56
gary_posterrunning a different22:56
gary_posterlifeless: so, the ++oops++ url is registered in an odd way.  It's the problem.  I'll fix it up tomorrow.22:59
gary_posternight all22:59
bdmurrayIs there some way to run 2 specific tests with bin/test?  something like bin/test -cvvt bugtask-search.txt patches-view.txt ?23:33
lifelessyes23:35
lifelessif you've got a failure back from ec2, you can just unzip the subunit log to .testrepository/failing and do testr run --failing23:36
bdmurrayI'm working on this branch and I've modified two tests and just want to run those 2 tests ...23:37
bdmurrayI haven't done anything with ec2 yet23:38
lifelesstry bugtask-search without the .txt23:43
lifelessif you know the testid you can use --load-list and a file listing ids, one-per line23:43
bdmurraylifeless: the testid?23:45
lifelessyes, all tests have a unique test id23:45
lifelessI don't know what it is for doctests23:45
wgrantbdmurray: bin/test -cvvt bugtask-search.txt -t patches-view.txt23:49
wgrantYou need the second -t.23:49
lifelesswgrant: thanks, I'll try to remember that :)23:50
wgrant(-t's argument is actually a regex, but one normally just uses test names or fragments)23:50
bdmurraywgrant: great, I couldn't think of a regex that would hit both of those tests.23:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!