[00:32] * poolie thinks, again, there ought to be an incipient mp for every branch [00:32] whether it's been actually proposed or not [00:33] spiv, the thing is writing the extension is easy, deploying it is the hard part [00:34] poolie: but how would you know what the destination branch is? [00:34] maxb: all of them :P [00:34] poolie: why is deploying the extension hard? [00:34] wallyworld: not really [00:34] wallyworld: file one [00:36] i'm just once-bitten by attempting to change the oauth deployment [00:36] how does one document a flag? [00:36] thumper, read dev.launchpad.net/FeatureFlags and if that's not enough, ask me [00:36] ok [00:36] if it's not enough i'd really like to make it better [00:38] poolie: https://launchpad.net/+feature-info lists undocumented features [00:39] poolie: how do they become "documented"? The docs don't cover that [00:40] hm [00:40] ah, see "adding a new flag" [00:40] i'll expand that a bit [00:41] or are you just documenting an existing one? [00:41] I'm wanting to add a new flag, but I should also document the missing ones [00:41] The missing ones are documented in a branch of mine. [00:42] poolie: yeah, that section is very easy to miss [00:42] wgrant: thanks [00:42] poolie: who is able to edit the feature flags on prod? [00:42] losas [00:42] only [00:42] well, ~admin [00:43] i think that's correct [00:43] is that better now? [00:46] thumper, please try to match the naming guide in that page too [00:46] or object to it and we can change it [00:47] But if you invent another non-standard scheme I will cry :) [00:47] exactly, so please don't [00:47] the naked juggling is distracting enough without people criying too [00:52] StevenK: when do you want to chat? [00:52] thumper, all good? [00:53] poolie: the only thing making me cry right now is how we are currently hiding recipes [00:57] thumper: can you remember where that code is where you check for None in the formatter? [00:57] wallyworld: yes [00:58] thumper: and please tell me where it is mr smarty [00:58] wallyworld: lib/lp/code/browser/sourcepackagerecipe.py [00:58] thanks [00:59] archive_picker [00:59] * wallyworld sad - there's actually no existing tests for NoneFormatter [01:26] StevenK: btw [01:26] StevenK: there is a jenkins openid plugin now [02:01] whoa [02:01] where did the loggerhead exceptions go [02:03] StevenK: how's the recipe popup build request review going? [02:04] wallyworld: You mean, the one I wasn't actually doing? :-) [02:04] StevenK: you asked me questions about it so i assumed you had claimed it :-) [02:05] wallyworld: Nope :-) [02:06] StevenK: np. i'll find another sucker^H^H^H^H^H esteemed developer to do it [02:06] wallyworld: I'm a little confused [02:06] wallyworld: I thought you were working on manually requested builds [02:06] lifeless: i always confused [02:07] wallyworld: but I saw you file a but about manually requested daily builds that aren't stale [02:07] lifeless: yes, but the request build popup work was done before that [02:07] which is a /totally/ different use case [02:07] so i have 2 recipe related branches up for review [02:07] the 2nd depends on the first [02:07] due to shared javascript [02:07] lifeless: make sense now? [02:08] wgrant: want a small review? https://code.launchpad.net/~wallyworld/launchpad/add-link-to-noneformatter/+merge/50088 [02:09] * wallyworld has 3 active reviews to try and get off his list [02:20] Yippie, build fixed! [02:20] Project devel build (448): FIXED in 5 hr 59 min: https://hudson.wedontsleep.org/job/devel/448/ [02:20] * Launchpad Patch Queue Manager: [r=leonardr][bug=649252] add an unsubscribe link to non-verbose bug [02:20] notifications [02:20] * Launchpad Patch Queue Manager: [r=leonardr][no-qa] isolate bin/lint.sh's use of grep from the [02:20] environment [02:20] * Launchpad Patch Queue Manager: [r=danilo][ui=none][no-qa] Fix rST and Sphinx errors in our top-level [02:20] docs, and make the main page more interesting. [02:22] whats the glue to say 'does this class implement ISomething or other' - when querying, not declaring [02:36] hi huwshimi [02:36] sinzui: Hey therwe [02:36] *there [02:37] huwshimi: I recall writing about the loss of colour from the involvement portlet. but I cannot find it in my email :( [02:38] huwshimi: So pretending I have dot written about this. do you want to mumble to discuss the issues that users have raised? [02:38] sinzui: Sure, that'd be great [02:40] lifeless: what do you think about converting feature flag values of "off" and "false" to False ? [02:47] thumper: i'm pretty unkeen [02:47] thumper: what issue are you trying to solve? [02:47] lifeless: I'm adding a feature flag "code.recipe.beta" to control the message and the beta icon [02:48] lifeless: so we'll add a rule that says code.recipe.beta -> "on" [02:48] lifeless: but if we set a rule to say code.recipe.beta -> 'off' [02:48] thumper: theres a rule for this already isn't there ? [02:48] lifeless: I want it to work [02:48] no [02:48] we have code.recipe_enabled [02:48] which is different [02:48] I'd like to rename that to "code.recipe.enabled" [02:49] enabled controls whether we barf on recipe actions [02:49] thumper: so this is to let you go to non-beta without tying it to a deploy ? [02:49] beta is just to show the messages [02:49] yes [02:49] exactly [02:49] and then you'll delete both rules entirely. [02:49] aye [02:49] thumper: can you tell me where our existing web service api tests are? i've had a boy look but can't see them [02:49] I would just do the current thing - 'if : ... ' [02:50] yeah, I know I _can) [02:50] thumper: the default is None/'', and you can add rules of '' [02:50] I just think it would make it more clear [02:50] I have think it makes it more awkward [02:51] getFeatureFlag('some.feature') should be False if some.feature == "off" or "false" [02:51] Not at that layer [02:51] and I really don't see the argument for a higher layer at the moment [02:51] it seems like cruft [02:51] find [02:51] fine [02:51] we can agree to disagree and I'll not change it [02:51] I agree that there is some confusion [02:52] lifeless: what do you have against implementing expected semantics for 'off'/'false' meaning Bool(False) ? [02:52] one of the reasons I have the opinion I have is that 'no rule implies no value' is kind of predictable. 'no rule implies a specific value' needs some sort of schema [02:53] wallyworld: the current /layer/ is simple strings. Its schemaless and typeless. [02:53] wallyworld: this makes it extremely robust in some ways, and frustrating in others. [02:53] ok. [02:54] wallyworld: given that we version the interpreter for this data (the appserver processes) multiple times a day, a failure in this area would be extremely messy. [02:54] yep :-) [02:54] I've no strong objection to a higher layer being built : but I see no benefit to building it either for simple booleans because the current implementation meets our functional needs [02:55] but that's what tests are for :-) [02:55] wallyworld: tests cannot catch this [02:55] we had one failure from features already, took the site down [02:56] -the whole site- [02:56] i'll take your word for it. not familiar enough with it to have an opinion either way. but on the surfaces, everything should be testable in an ideal world [02:56] wallyworld: the rules are in the production DB [02:56] why not also in stable or staging? [02:57] stable is a branch, not a DB, and the rules can have commercial-in-confidence values in them. [02:57] as for staging, it /may/ have the same rules, or it may have different ones [02:57] lifeless: sorry ETERMINOLOGY. i just meant the test databases [02:58] I'd rather see small helpers when folk solve tricky problems here built up than the core of the layer become typed. [02:58] i'd say there's an argument that our test environment should replicate the prod one, in this case having the same core database values. but i take the point about the privacy issue [02:59] and booleans have a comprehensive solution now: there's nothing you can add to make our handling of booleans more pithy, correct or powerful [03:00] wallyworld: folk need to be able to change rules on [qa]staging to be able to check their patches work etc [03:00] wallyworld: it would be disruptive to forcibly sync those on a high frequency basis [03:01] agreed. but people also should do some testing with data reflective of what's in production if possible (akin to progression vs regression testing in a way) [03:02] lifeless: so since i have your attention, do you know where out web service api tests are? [03:04] what sort of such tests [03:04] like [03:04] tests for a given api [03:04] or tests that the api is wired up [03:04] or ... ? [03:05] i want to use a web api client to invoke something annotated with export_write_operation() for example to see that it works [03:05] so i guess tests that the api is wired up [03:05] given that the underlying functionality is unit tested separately [03:06] thats generally done by a smoke test of that api [03:06] AIUI [03:06] but testing that what comes over the wire is as expected [03:06] test.*webservice, spread throughout the tree [03:07] oh. thanks, i'll take a look. i just wanted a starting point to current practices before diving down the wrong rabbit hole :-) [03:08] lifeless: ah i see my problem now. there's web services already on the domain model i'm working with but no tests written, so i couldn't find any examples to start from [03:09] for the new web services i'm adding [03:09] Argh. Where is the representation of an archive as a link hiding? [03:09] StevenK: PPAFormatterAPI ? [03:09] are [03:09] canonical.librarian.ftests.test_web.LibrarianWebTestCase.test_404 [03:09] canonical.librarian.ftests.test_web.LibrarianWebTestCase.test_oldurl [03:09] still known as intermittent failures? [03:09] lifeless: Yes, they failed yesterday [03:09] StevenK: or something like that? [03:14] huwshimi: http://pxtoem.com/ [03:19] wallyworld: Thanks, but that isn't in the trace back [03:19] StevenK: pastebin? [03:19] AH! [03:20] The information is spat out before the traceback [03:21] wallyworld: You could give me a clue tracing back from the page template to the code, though. [03:22] StevenK: ok. wanna throw the tb in pb? [03:22] wallyworld: [03:22] wallyworld: I think that's the line. If not, it's sourcepackagerecipe-index.pt, unchanged from devel [03:23] StevenK: should we mumble? [03:23] wallyworld: Sure [03:29] simple review lifeless? https://code.launchpad.net/~thumper/launchpad/recipe-feature-flag/+merge/50092 [03:30] just pushing some lint cleanup [03:31] thumper: get in line :-P [03:31] take a number [03:31] wallyworld: ok, you do it :) [03:31] thumper: i'll do yours if you do mine :-) [03:31] ok [03:31] which one? [03:32] thumper: Check your indenting line 43 of the diff [03:32] thanks. i've got 3 and our wip limit is exceeded on the board [03:32] StevenK: that was in the lint cleanup [03:32] StevenK: the diff is updating as we speak [03:34] thumper: which one? there's the simple link formatter which could be done first [03:34] wallyworld: hit me [03:34] thumper: https://code.launchpad.net/~wallyworld/launchpad/add-link-to-noneformatter/+merge/50088 [03:34] the recipe ones will take a lot more effort [03:34] but still need to be done [03:37] wallyworld: TestXHTMLRepresentations? [03:37] wallyworld: shouldn't that be TestNoneFormatter or something? [03:37] ? [03:37] * wallyworld looks [03:37] wallyworld: have you looked at test_tales? [03:40] wallyworld: 'cause I don't understand you test_shorten_traversal [03:40] thumper: didn't see test_tales. since tales.py was in lib/app/browser i looked for existing tests in lib/app/browser/tests [03:40] * thumper nods [03:40] from lp.testing import test_tales [03:40] or more accurately [03:41] from lazr.restful.testing.tales import test_tales [03:41] thumper: the test_shorten_traversal was my attempt to unit test that method based on my reading of it's intended behaviour [03:41] wallyworld: since there is no docstring, I can't tell what it should do [03:41] :) [03:42] thumper: yeah, but there's no docstring on the traverse() method that is being tested either, so it's catch 22 [03:43] thumper: i'll look at the existing test_tales stuff and fix the tests accordingly [03:45] \o/ tests pass [03:51] wallyworld: ok [03:52] thumper: the TestXHTMLRepresentations was a cut'n'paste gone wrong :-( [03:52] wallyworld: good :) [03:52] wallyworld: I was wondering if I was understanding it :) [04:02] thumper: mp diff updating as i type this [04:06] * wallyworld dislikes how long it takes for the diff to be updated [04:07] wallyworld: Patches welcome? [04:07] StevenK: isn't it controlled by a cron script? [04:07] Two, in fact [04:08] hey, remember when Launchpad devs didn't use merge proposals at all? those where the days [04:08] hi beuno [04:08] ah, when i was a wee lad, i had to walk to school through 10 feet of snow with no shoes [04:08] beuno: notice we just went over the 50k mark? [04:08] and speaking of merge proposals! [04:08] thumper, I did, and I \o/ed [04:09] :) [04:09] it kinda blew my mind, I didn't realize the numbers where growing so quick;y [04:10] beuno: still mostly canonical people using them [04:10] I guess the biggest consumer of MPs is LP? [04:11] I bet U1 can give LP a run for its money [04:11] thumper: just to double check - you don't know of any existing web service tests for recipes that i can't find? [04:11] LP only has like 7000 branches. [04:11] beuno: I wonder how to test that theory [04:11] So it can't be many of the MPs. [04:12] https://lpstats.canonical.com/graphs/BranchMergeProposalsNewPerDay/20100218/20110218/ [04:12] I'm pondering crafting some SQL to get the answer [04:12] NotFound: Object: , name: u'lp.js' [04:12] ? [04:12] * beuno tries to manually add up all the branches for u1 [04:12] thumper: That's a really encouraging graph. [04:13] https://lpstats.canonical.com/graphs/BMPNewRegistrants/20100218/20110218/ [04:13] wgrant, how do I find out how many branches a project has? [04:13] hi all [04:14] it only seems to tell me about active branches [04:14] https://lpstats.canonical.com/graphs/BranchMergeProposalsProjectsNewMergeProposals/20100218/20110218/ [04:14] hi beuno [04:14] heya poolie! [04:14] beuno: select show all branches [04:15] I did, "Any status" [04:15] Ubuntu One Servers has 345 active branches owned by 31 people and 3 teams. There were 716 commits by 19 people in the last month. [04:15] but that's not useful [04:15] flacoste: hhhaa - XXX flacoste 2008/04/24 This should be moved to a [04:15] flacoste: I've half-implemented said setTarget [04:15] In SQL: "PackageBuild.archive = Archive.id AND False" ... D'OH [04:15] 10294 | launchpad | f | 5103 [04:15] 9514 | ubuntuone-servers | f | 3462 [04:15] 1186 | bzr | f | 1473 [04:15] 8920 | drizzle | f | 1279 [04:15] 23444 | examiner | f | 1109 [04:15] 13681 | openlp | f | 939 [04:16] 12784 | ubuntuone-client | f | 754 [04:16] From October. [04:16] Right column is the count [04:16] So U1 probably wins by now. [04:16] :( [04:16] wallyworld: U1 client already does? [04:16] BAH [04:16] wgrant: ^ [04:16] right, we have desktopcouch, bindwood, android clients, iphone [04:17] beuno: Are they in a project group? [04:17] wgrant, yes, all under ubuuntuone I think [04:19] name | count [04:19] ------------------------------+------- [04:19] launchpad-project | 5385 [04:19] ubuntuone | 5042 [04:19] bazaar | 2339 [04:19] But that is outdated :( [04:19] well, still surprising to see more activity in LP [04:19] October is not that far away [04:20] wgrant: Tempted to get that run on prod :-) [04:20] wgrant: With "LIMIT 3" or so [04:20] wgrant: go on, ask spm [04:21] thumper: staging's only a week out of date; you can do it :P [04:21] wgrant: ok [04:21] From the start of 2010: [04:21] launchpad-project | 2375 [04:21] ubuntuone | 2271 [04:21] bazaar | 1079 [04:21] ayatana | 959 [04:21] So we still win!? [04:22] thumper: SELECT project.name, COUNT(*) FROM branchmergeproposal JOIN branch ON branch.id=branchmergeproposal.target_branch JOIN product ON product.id = branch.product JOIN project ON project.id = product.project GROUP BY project.name ORDER BY COUNT(*) DESC; [04:22] thumper: watch out with your recipe FF-only branch. [04:22] thumper: request-daily-builds uses the config option. [04:23] And we can't make an FF apply only to a script, AFAIK. [04:23] launchpad-project | 8912 [04:23] ubuntuone | 6695 [04:23] bazaar | 4294 [04:23] I wrote it from scratch [04:23] [15:20:50] wgrant: go on, ask spm <== have I finally got you lot scared of me. *FINALLY*!?!? [04:23] spm: Ask wgrant? [04:23] * StevenK cackles [04:23] heh [04:24] * StevenK notes that Storm doesn't like 'is' [04:24] But it returns a BOOLEAN! [04:26] its interesting - bazaar has 1/5th the devs, and 1/2 the mps [04:26] lifeless: But Bazaar also doesn't suck. [04:28] I guess bazaar probably has the most community as well [04:29] True. [04:29] spm: r12395 to nodowntime, pls. [04:30] and, launchpad was the first of all those to start using mps, if we look at totals [04:30] bazaar slowly moves away from bundlebuggy after a while [04:30] True. [04:30] That's why I took the numbers from 2010 onwards. [04:30] When everyone should have been using MPs. [04:31] * beuno nods [04:31] \o/ [04:32] one query for the milestone targeted bugs portlet. [04:33] lifeless: But how slow? [04:34] wgrant: https://bugs.launchpad.net/launchpad/+bug/717394/comments/2 [04:34] wgrant: I expect to be close to that, am assessing the generated sql now [04:35] argh, search builder fail [04:35] constraining on distro series using any -> noop, no constraino. [04:35] beuno: ... [04:36] launchpad-project | 3879 [04:36] ubuntuone | 3525 [04:36] bazaar | 1548 [04:36] ( [04:36] SELECT BugTask.distroseries, COUNT(BugTask.bug) FROM BugTask, Bug WHERE Bug.id = BugTask.bug AND ((BugTask.status = 10) OR (BugTask.status = 15) OR (BugTask.status = 20) OR (BugTask.status = 21) OR (BugTask.status = 22) OR (BugTask.status = 25)) AND Bug.duplicateof is NULL GROUP BY BugTask.distroseries [04:36] for branches created after the start of 2010 [04:36] ah, laz U1 devs! [04:36] *lazy [04:37] * thumper is getting the munchies [04:37] still, i need to go; I'll finish it off later [04:38] Mmmmmm, smells like rain here [04:39] wgrant: pushing to lp:~lifeless/launchpad/bug-717394 if you are interested. Its a little ugly, but EMENOCARE [04:40] pushed [04:41] wgrant: I thought you requested a deploy? [04:41] lifeless: It's on LPS [04:42] lifeless: henninge added one to the deployed section of LPS, but didn't poke anyone about it. I extended it to the latest rev and moved it to the right place. [04:42] Just now. [04:42] wgrant: cool; probably want to poke someone [04:42] I did. [04:42] lifeless: He did? [04:43] spm: Are you sufficiently poked? [04:43] Haha [04:44] "Are you not entertained!?" [05:04] thumper, so lifeless's point was to just keep using non-empty strings as boolean true? [05:05] poolie: yes... although I agree with you [05:05] * thumper EODs [05:05] good night [05:05] poolie: we can talk about this more tomorrow if you like [05:07] Can haz review from someone? [05:09] lifeless: You know, I think identi.ca doesn't know your new suburb [05:22] wow [05:23] wgrant, the lag seemed to be suddenly going up to several seconds [05:23] Yeah. [05:23] I guess Mumble isn't so good when you're on the same side of the world. [05:23] adequate consultation is good [05:23] routing via london's not optimal [05:23] Not quite. [05:24] i guess we possibly could have an australasian server [05:24] i wonder how hard it is [05:24] Huh. [05:25] What happened to the loggerhead OOPSes/ [05:25] ? [05:25] There were <1000 yesterday. [05:26] lib/lp/contrib/ [05:26] Oxymoron! [05:26] wgrant: Naming is hard [05:27] StevenK: We already have lib/contrib :( [05:27] Yes, and it needs to die too [05:27] Now I have two directories to destroy :( [05:28] Awesome, lib/contrib/oauth.py has no license [05:29] wgrant: Seems like spm is not sufficently poked. [05:30] Insufficiently present, would be my guess. [05:30] poolie: Is there something wrong with the oauth 1.0.1 egg? [05:30] Or did you just try to use a package because it is less evil? [05:30] wallyworld, hi [05:30] poolie: yellow [05:31] the thing with tim's patch is when he says 'on/off' he doesn't actually mean the strings 'on' or 'off' [05:31] how silly of you :) [05:31] we can either fix it so you can actually use those values [05:31] which is the bug i mentioned [05:31] i thought that's what gerFeatureFlag() returns? [05:31] or we can update his docs [05:31] you're right [05:31] it just returns the string at the moment [05:32] so unless it's handled at a lower level he needs to check == 'on' [05:32] so his condiitonal will fail [05:32] as written [05:32] well, it won't work in the way you'd expect [05:32] how do you say that in TAL? [05:32] i think it's a bit longwinded [05:32] wgrant, i believe the egg still has the bug in it [05:32] ubuntu's package is 1.0+a bit [05:33] poolie: We have the 1.0 egg. [05:33] poolie: so, won't "if not getFeatureFlag(RECIPE_ENABLED_FLAG)" give a crap result if the ff is set to "off" ???? [05:33] There is a 1.0.1 egg aka 1.0a, which is probably what Ubuntu has. [05:34] wgrant: Can you see the point of lib/canonical/lazr/security.py at all? [05:36] StevenK: Probably to support callsites that were added before stuff was moved to lazr.restful. [05:36] I can only see one left, though, in a test. [05:36] Right [05:36] I'm tempted to just fix it [05:36] Delete delete delete. [05:36] You have my full support. [05:36] For once. :-P [05:36] You have my full support to delete anything in lib/canonical, as long as it doesn't break tests :P [05:37] I'll delete lib/canonical/database, then. [05:37] That won't break tests, that will break EVERYTHING. [05:37] Indeed. [05:38] * wallyworld goes to take kid to soccer [05:40] wgrant: So, fix the test to import from lazr.restful or just bin it completly? [05:42] StevenK: LP doesn't use protect_schema directly. [05:42] Check that it's tested in lazr.restful and bin it. [05:44] wgrant: Looks to be used extensively in doc/webservice.txt [05:44] wallyworld, yes it will give a crap result [05:44] back in a sec [05:46] StevenK: But is it tested directly? [05:47] wallyworld, anyhow, that's my point [05:47] there are various approaches [05:47] wgrant: I can't see a unit test directly [05:48] [XXX leonardr 2009-04-02 bug=354441 This test should be moved into the same lazr module as the code it tests, security.py (in lazr.restful as of this writing.)] [05:48] I'd follow that advice. [05:48] wgrant, my first attempt at removing the code from contrib fell in a heap because the same bug is in the code in the egg [05:48] hooray for tests [05:49] poolie: Yeah, but I think our egg is outdated. [05:49] There is a newer one. [05:50] ok, in that case upgrading the egg and re-landing my first branch should fix it [05:50] Where is that branch? [05:51] I will throw it at ec2 now. [05:51] bug 715000? [05:51] Not that one. [05:51] Because we gained a new contrib module this morning, I must remove this one swiftly. [05:54] Ah, the branch is gone. [05:55] > Because we gained a new contrib module this morning, I must remove this one swiftly. [05:55] why? [05:55] ah i might have pulled into that branch [05:55] * poolie look [05:56] Yeah, you repurposed the branch to use the package instead. [05:57] cherrypicking r12325 of lp:launchpad should do it [05:57] it was merged and then it failed in buildbot [05:57] Oh, true. [05:57] I forgot that bit. [05:57] Or just s/contrib.oauth/oauth.oauth/, I guess. [06:07] wgrant, basically just that plus deleting the contrib thing [06:07] yep [06:07] for going to use the packaged version there was just a bit mor estuff [06:08] are you just trying to remove cruft, or was there some other motivation too? [06:08] poolie: Removing cruft. [06:09] thanks [06:09] So the new SSH server is falling over under load, or because it is leaking? [06:11] stub: It uses more handles per connection than before, but as far as jam and I can see it does not leak until it has already exhausted its handles. [06:11] And jam has a fix for those post-exhaustion leaks, which should allow recovery. [06:11] We do not know why production reached exhaustion. [06:11] it seems like previously it would stall or block connections when load spiked [06:11] wgrant: Can we put it behind HAProxy to keep the load under control? [06:11] and with jam's change it would get bogged down [06:11] there's separate work underway towards that [06:12] stub: I suppose we could. [06:12] We want haproxy soon anyway for other reasons. [06:12] The numbers of observed connections in production don't match the analysis of how many connections it would take to reach exhaustion, so we're still missing something. [06:13] (Fixing the known robustness bugs is still a good idea, of course) [06:13] There were 117 forking services at the probable time of exhaustion. [06:13] Which is only 600 FDs. [06:13] Unless it was being slow and hadn't noticed that lots of children were dead. [06:13] So it still held their handles. [06:13] But howmany 'recently' that might not have been cleaned up? [06:13] Mmm... [06:13] It's hard to say, because the logs are gone. [06:15] I think we should fix the leak, bump the limit (which means moving to a new reactor), and then deploy while watching very carefully and lsofing regularly. [06:15] Last time we knew something was up 40 minutes before service really degraded. [06:15] So it is not *too* dangerous. [06:16] Right. Since there will always be a hard limits though, so we will want limiting from HAProxy anyway (just might be much higher once the leak is fixed). And it will help diagnose if it is a leak or slow gc. [06:16] I don't know any reason not to add --reactor=epoll to the twistd invocation (in the init script, I guess?) [06:16] Sure. [06:17] spiv: Let me try that locally and throw 600 connections at it. [06:17] (And we may as well do that for all twistd invocations everywhere) [06:18] spiv, what _is_ the state of the haproxy stuff in production [06:18] per robert's comments in bug 717345 [06:18] it's not yet live but ready to go live? [06:18] spm^^ ? [06:21] poolie: see bug 702024 (or RT 40480); I'm stuck waiting for more information from spm about how it was tested on staging, because that failed but AFACIS it's working perfectly in a dev vm. [06:22] poolie: the support code in the production code base, and the web status port is deployed [06:22] 2000 FDs,s till going fine... [06:23] wgrant: you had to raise the per-process fd limit, I assume? [06:23] spiv: Yes. [06:24] Hah. [06:24] hammer_ssh.py hit the FD limit at a little over 500 connections. [06:24] But the server is fine. [06:25] :) [06:25] Running with an FD limit of 10000 and --reactor=epoll [06:25] Although it does like its RAM... [06:39] i'd like to see some Launchpad Enchantment Proposals [07:21] what is the rule for who can triage while filing? [07:21] i'm in ~kanban and yet i cannot do it for kanban/+filebug [07:25] The bug supervisor. [07:26] If the bug supervisor is not set, then nobody can. [07:26] It does not revert to the owner. [07:26] i see; thanks [07:26] (probably a bug, but so are lots of things!) [07:27] > Awesome feature. I'm happy to volunteer gcalctool to use this. [07:27] excellent [07:27] what a good start [07:29] poolie: Is that a BFBIP volunteer? [07:29] yes, robert ancell [07:29] k, got to go [07:29] Ah, yes, found it. [07:29] have a good night [07:29] You too. [07:38] StevenK: I've told it to not show location, but it didnae listen [07:40] poolie: hi [07:40] poolie: am back if you wantt to talk [07:45] Is the PPA publishing cycle still at 5 minute interval? [07:45] cody-somerville: Yes. [07:46] Deletions get processed during that cycle, right? [07:47] and is there a graph showing delay? (ie. # of minutes late starting new cycle vs. time or something) [07:48] Files are removed from the indices as part of each publisher run. [07:48] But they are removed from disk less frequently. [07:48] */30, IIRC. [07:48] Yes, */20 [07:48] Er/ [07:48] */30, I cannot type. [07:51] stub: ping [07:52] cody-somerville: https://lpstats.canonical.com/graphs/PPALatencies/20110217/20110218/ [07:54] lifeless: pong [07:55] now a good time for the weekly call ? [07:55] lifeless: time is fine. my sleep patterns the problem. [07:55] lifeless: sure [07:55] no worries; went and saw a movie ;) [08:16] stub: https://lpstats.canonical.com/graphs/WildcherryDiskUsage/ [08:23] Project devel build (449): FAILURE in 6 hr 3 min: https://hudson.wedontsleep.org/job/devel/449/ [08:23] * Launchpad Patch Queue Manager: [r=stub][bug=607935] Reduce overhead when showing only some bug [08:23] comments. [08:23] * Launchpad Patch Queue Manager: [r=leonardr][no-qa] Add YUI3 gallery-accordion widget to tree. [08:32] explain select count(distinct branchrevision.branch) from branchrevision, branch where branch.id=branchrevision.branch and branch.last_scanned is NULL; [08:34] https://pastebin.canonical.com/43510/ [08:43] Bug 711071 [08:43] <_mup_> Bug #711071: Distribution:+bugtarget-portlet-bugfilters-stats timeouts < https://launchpad.net/bugs/711071 > [08:43] stub: https://bugs.launchpad.net/launchpad/+bug/717394 [08:43] <_mup_> Bug #717394: Distribution:+bugs timeouts < https://launchpad.net/bugs/717394 > === jtv-afk is now known as jtv [08:47] morning folks [08:58] good morning [09:05] hi adeuring [09:05] hi jtv! [09:09] allenap: Hello, Mr OCR! Would you have time to review my branch today? === almaisan-away is now known as al-maisan [09:10] StevenK: if not, I could take it. [09:13] \o/ 1.4 seconds off of bug search in ubuntu coming right up [09:13] and, I'm off to sleep [09:17] Morning [09:22] StevenK: Sure. I'm only doing a half day today, but you're first in line :) === allenap changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: allenap | https://code.launchpad.net/launchpad-project/+activereviews [09:22] * allenap assumed abentley is no longer reviewing. [09:23] allenap: I already claimed it :) [09:23] jtv: Woah, swifty. [09:23] a timezone ahead :) === al-maisan is now known as almaisan-away [09:26] StevenK: "an" private archive..? [09:26] lib/lp/code/model/tests/test_sourcepackagerecipe.py [09:27] jtv: I can't see that in my diff, but looking [09:27] Near the bottom. [09:28] Very close to it. [09:28] Oh, it's "an" disabled, not private [09:28] Sorry! [09:28] Force of habit I suppose [09:29] jtv: Fixed and pushed [09:30] StevenK: also in that same method by the way: it may be clearer to change the name slightly to say what should happen, not just what scenario you test. For instance, test_getBuilds_ignores_disabled_archive instead of test_getBuilds_disabled_archive === almaisan-away is now known as al-maisan [09:31] jtv: Agreed, fixed locally. [09:45] jtv: Anything else you can see, or shall I commit and push? [09:45] StevenK: I've got more, hang on [09:48] StevenK: two questions about test_view_with_disabled_archive. [09:48] jtv: Shoot [09:49] First, are all cases covered? Owner can see builds for private archive, other users can't? [09:49] jtv: In this case, even the owner won't, which I think is fine. They disabled the archive, anyway. [09:50] Then I think I misunderstood something in the MP [09:50] They will of course be able to change the daily build archive if they wish. [09:50] So the owner sees private _archives_, not _builds for_ private archives. [09:50] *disabled* [09:50] Stop doing that :-) [09:50] Argh [09:51] Yes, sorry. [09:51] So: the owner sees their disabled archives, but not builds for their disabled archives? [09:52] jtv: We are only talking about the page for the recipe here -- if the daily build archive is disabled, anyone will see the name of the archive, but no one will see builds into it. And of course will be able to change it, as I said. [09:53] And of course, the owner will be able to change it, I mean. [09:53] OK. [09:53] Then what I hope is my final stupid question: it looks like you're adding Archive to your join. How will that affect performance? [09:54] Damn, penultimate. My other one was "why does test_view_with_disabled_archive create a browser with a specific person, rather than either the default or self.factory.makePerson()" [09:55] jtv: I suppose I could make another person rather than using no-priv. Would you prefer that? [09:55] StevenK: I think so, yes. makePerson() really says "some arbitrary regular person." [09:55] jtv: Archive isn't terrible large, so I can't see it adds much to the query. [09:55] But if there's a default you can use, that's even better. [09:56] Well, I can use no-priv, but sampledata makes me sob. [09:57] jtv: Also fixed locally. [09:57] What I mean is, doesn't getUserBrowser give you some arbitrary, unprivileged person by default? [09:57] Oh. Not that I noticed when I read it. [09:57] * StevenK re-checks [10:01] jtv: You're right, fixing. [10:02] StevenK: also, please keep an eye on its performance! Archive isn't _that_ small, and I think I caught it slowing down a join quite a lot recently. [10:05] jtv: I will compare before and after on qastaging for page loads when I QA. If it's a large jump, I will file a bug. [10:05] StevenK: great, thanks. [10:06] Final note: in lp/code/model/sourcepackagerecipe.py, the And() you add has its arguments list formatted weirdly. Could you add a line break right after the opening parenthesis? [10:07] jtv: It matches other uses in the file ... [10:07] StevenK: no time like the present… [10:08] jtv: [10:08] http://pastebin.ubuntu.com/568101/ [10:08] Rah [10:08] jtv: I prefer it before, TBH. [10:09] Hmm okay, let's be pragmatic then. :) [10:09] Approved. [10:09] jtv: With the And() change, or you don't mind now? [10:10] StevenK: I don't mind now [10:11] Anyway, I already voted. [10:12] henninge: I think this was you, but I'm not used to hearing such foul language from you! [10:12] self.assertEqual('my-domain', make_name('my - do@ #*$&main')) [10:13] jtv: That's what reading comic books does to one's language! [10:13] tsk tsk === allenap changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews === matsubara-afk is now known as matsubara [11:12] I've added a dependency, and that dependency makes deprecation warnings when it loads === al-maisan is now known as almaisan-away [11:12] we shouldn't do anything about the deprecation warnings [11:12] how can I silence them? [11:13] jml: lib/lp_sitecustomise.py [11:13] s/mise/mize/ [11:13] We filter Crypto DeprecationWarnings there already. [11:13] wgrant: thanks. [11:15] next question, what's the correct way of running a script from an egg dependency within a test? [11:17] Is it importable? [11:19] not really. it's the sphinx-build script from Sphinx. I could sort of re-implement sphinx-build by importing sphinx and calling main() directly, if pressed. [11:19] but am not in a rush to do so. [11:20] I'd be doing that, unless the script itself is non-trivial... [11:21] hmm. [11:22] more robust against path snafus, less against changes to the sphinx-build interface. you're probably right. [11:22] Plus it feels less like evil. [11:23] I'm not sure [11:23] my evilometer can't really distinguish the two. [11:23] Calling Python from Python via a subprocess is somewhat evil. [11:24] well, the evil is that sphinx doesn't provide a decent API [11:24] Ah :( [11:24] My programmatic invocations of it are limited to Makefiles. [11:26] I had thought about calling the Make target. [11:26] Project db-devel build (374): FAILURE in 5 hr 56 min: https://hudson.wedontsleep.org/job/db-devel/374/ [11:26] * Launchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 12396, [11:26] 12397 included. [11:26] * Launchpad Patch Queue Manager: [r=stub][no-qa] Make the BugMessage.index non-null now that its fully [11:26] populated and maintained by code. [11:26] * Launchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 12394, [11:26] 12395 included. [11:26] sphinx-build also doesn't return a non-zero return code when it fails [11:26] Yeah, I noticed that. [11:26] Fortunately docs aren't terribly critical, I guess. [11:27] Still, Sphinx is really likable in lots of ways. [11:27] I can forgive it a bit. [11:27] No, but that's not an excuse for not building a good command line tool [11:27] Although I cannot forgive docutils for being what it is. [11:27] grar caching [11:29] wait, huh. Why does TestCase.makeTemporaryDirectory not delete the directory in tearDown? [11:29] you mean - our code has bugs?! [11:30] never mind. I'm a muppet. [11:31] waldorf? [11:34] Hmm, that's pretty nice. [11:34] nightly.sh takes 5 hours now. [11:34] Not >24 [11:34] wgrant: that's good. 5 is much less than 24. [11:35] Although update-bugtask-targetnamecaches takes 50% longer on prod than mawson :( [11:35] *sigh*. running directly from Python means mangling stdout & stderr. I guess I'll try it and see if it's faster. [11:36] Sounds like it may be similar to docutils in its general levels of sensibility. Which I guess isn't surprising. [11:36] wgrant: mawson is for soyuz testing.... [12:02] Morning, all. [12:38] boring branch: https://code.launchpad.net/~jml/launchpad/prevent-new-sphinx-errors/+merge/50136 [12:50] where is zeca used these days? [12:50] specifically, is zeca.tac invoked anywhere? [12:52] tests that need to talk to a keyserver? [12:52] It is still used by tests. [12:53] eg soyuz-upload.txt [12:54] any ideas about prod though? [12:55] jml: It was never used in prod. [12:55] It would possibly be even less reliable than SKS. [12:55] It was never intended for anything more than tests. [12:56] ok. I'll move the tac/ out of the root daemons/ directory then. [12:57] Renaming it wouldn't go astray either... [12:58] wgrant: yeah. I'm moving canonical.zeca to lp.services.keyserver. [12:59] jml: Could you put it in lp.testing.keyserver, maybe? [12:59] wgrant: yeah, I think so. [12:59] lp.services.keyserver sounds like GPGHandler. [13:13] hmm. [13:13] does zeca even *need* config? [13:13] * jml doesn't think so [13:14] It needs a root. [13:14] Indeed, that is its only key. [13:15] If you think you can make it static, you are sadly mistaken -- we need to override all those for parallel testing :( [13:16] is config the easiest way to do that? [13:16] does start-soyuz-dev.sh get used much? [13:17] The existing facilities to do that are based on the config infrastructure. [13:18] I use it often, but more often for buildd-manager than zeca. [13:18] allenap: Are you OCRing today? [13:19] gmb: Not really, I'm only doing a half-day and I've got a lot on my plate. If it's short I might take a look though :) [13:20] allenap: 57 lines of JS refactoring? Pweeese? [13:20] gmb: Okay. [13:20] wgrant: ok. I'll fix it rather than delete it then. [13:20] As it's you :) [13:20] allenap: I shall send you a Woodfordes voucher by way of thanks. https://code.launchpad.net/~gmb/launchpad/speed-up-subscription-overlay-bug-719249/+merge/50148 [13:20] jml: It will probably be used more often when we have another 20 people trying to work out what Soyuz does. [13:20] Rather than just using mawson. [13:20] * gmb notes that he needs to find out whether Woodfordes does vouchers. [13:21] yeah. [13:21] I just wish we had some consistency with the means by which we fire up dev services [13:21] You mean like a Makefile? [13:21] and indeed some rationale for scripts/, bin/ *and* utilities/ [13:25] wgrant: if such were used universally [13:26] jml: They pretty much are, except for Soyuz because I was lazy. [13:27] I love that 'zeca' is also a package and a password. [13:29] I do not know its etymology. [13:34] A Brazillian singer. [13:35] Ah. [14:09] I have to say I don't like the newer standard_test_template [14:37] Anybody in for a 103 line review? [14:37] https://code.edge.launchpad.net/~henninge/launchpad/bug-720673-import-origin/+merge/50157 [14:40] deryck, abentley, adeuring: ^ ? [14:41] henninge, sure. [14:41] abentley: thank you! [14:53] henninge, you're still using edge? :-P [14:54] abentley: ups, that's my browser history playing tricks on me ;) [14:54] henninge, r=me [14:54] abentley: thanks! === matsubara is now known as matsubara-lunch [14:54] henninge, also, could we mumble about bug #702477? [14:54] <_mup_> Bug #702477: Translation credits on new POFiles show the dummy string for the other side < https://launchpad.net/bugs/702477 > [14:57] abentley: sure, give me 5 minutes [14:57] henninge, cool. [15:04] abentley: now [15:04] ;) === jcsackett changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: jcsackett | https://code.launchpad.net/launchpad-project/+activereviews [15:07] henninge: do you know what's going on here? https://answers.edge.launchpad.net/launchpad/+question/125218 [15:12] * jml pushes up a branch that renames 'zeca' [15:12] https://code.launchpad.net/~jml/launchpad/zeca-is-keyserver/+merge/50166 [15:13] want that reviewed? :) [15:13] bigjools: yes please. [15:15] sinzui: could you follow up on my review of https://code.launchpad.net/~jml/launchpad/prevent-new-sphinx-errors/+merge/50136, pls? [15:15] I will [15:19] thanks. [15:20] Revenge for the Fake Librarian! [15:21] I just got a test case down from 29s to 3s. [15:21] bigjools: ^^^ [15:21] nice! [15:21] The main trick is that you don't have to commit as much. [15:21] very nice [15:21] Also of course, when run individually, you can save on setup by using a lighter layer. [15:24] That's another 8s or so. [15:32] jtv: know what's going on here? https://answers.edge.launchpad.net/launchpad/+question/125218 [15:33] Gar, the incorrect use of technical terms is dizzying [15:42] bigjools: working on it. === deryck is now known as deryck[lunch] [15:45] jtv: also: https://answers.edge.launchpad.net/launchpad/+question/140873 and https://answers.edge.launchpad.net/launchpad/+question/140873 [15:45] bigjools: aren't those the same? [15:45] grar paste fail [15:45] They very much look the same. [15:46] https://answers.edge.launchpad.net/launchpad/+question/137882 [15:46] bigjools: OK, that's me busy for the rest of the day :) [15:46] sinzui: did you hear back from the guy here? : https://answers.edge.launchpad.net/launchpad/+question/145187 [15:46] jtv: I aim to please [15:46] your aim is OW! [15:48] bigjools: thanks for asking. No. he has not. I think we should suspend [15:48] large but interesting branch needs review: https://code.launchpad.net/~leonardr/lazr.restful/include-html-field-representations/+merge/50174 === salgado is now known as salgado-lunch [15:48] sinzui: ok, I'll get on it === matsubara-lunch is now known as matsubara [16:04] bigjools: Chex I have a question from a user I cannot answer. It concerns a user investigating spam that claims to be from him: https://pastebin.canonical.com/43532/ [16:04] Yippie, build fixed! [16:05] Project devel build (450): FIXED in 5 hr 49 min: https://hudson.wedontsleep.org/job/devel/450/ === beuno is now known as beuno-lunch [16:18] what benefit do we get from chunkydiff? [16:21] a better question, are the errors from pagetests more readable than the errors from standard doctests? [16:21] * jml experiments [16:23] jml, I dunno, but I would *love* to have bzr's assertEqualDiff. [16:24] jml: I've never noticed any difference between doc and page test error output === deryck[lunch] is now known as deryck [16:34] yeah, identical. [16:38] abentley: I am stuck on a stupid timeout on qastaging for approving a template to be uploaded to cheese ... [16:39] henninge, ah. [16:39] before that it was waiting for an admin to make me maintainer of the project [16:39] ... [16:42] abentley: I am about EOD now. I cannot continue on this today, I am sorry. [16:43] henninge, understood. === salgado-lunch is now known as salgado === beuno-lunch is now known as beuno [17:11] How anti-climactic. Some preparation, a whole day of revising and adding tests, and then everything just passes with just a tiny tweak of two functions. [17:12] TDD will never sell until they learn to threaten us with eternal damnation. [17:12] huh [17:12] TDD isn't spending a day writing tests before you change code [17:13] There were a lot of tests to be revised. [17:13] Small change, large consequences. [17:16] guh, DNS down [17:17] anyway, https://code.launchpad.net/~jml/launchpad/flush-out-canonical/+merge/50192 up for review [17:20] jml: it's massive! [17:20] jtv: not really. [17:20] jtv: I mean, it's bigger than usual, but it's not like it's 1500 lines of actual programming. [17:21] jml: anyway, fell for it—I spoke up so I volunteered. Looking now. [17:21] jtv: thanks. [17:22] And may I say thank you for doing this. [17:22] jtv: my pleasure. [17:26] jml: doesn't pydoc have a dedicated tag for things that are deprecated? [17:31] back. [17:31] jtv: don't know. will look it up. [17:31] also, we use rst-based epytext [17:32] ah [17:32] that gives me something I can search for, thanks [17:32] (I'd been wondering) [17:33] answer is "yes", http://epydoc.sourceforge.net/manual-fields.html [17:33] Cool! [17:34] mmm "make compile" is taking forever.... [17:35] bigjools: -j∞ [17:36] that'd be nice [17:36] -j2 for now though. still takes ages [17:36] 5 minutes so far! [17:37] 2 spare cores = sad Phenom [17:38] jcsackett, can you look at https://code.launchpad.net/~leonardr/lazr.restful/include-html-field-representations/+merge/50174? it's a big branch but it should be fun [17:38] jml: I am trying to bolt ftp into poppy-sftp [17:39] moin [17:39] bigjools: oh yes. [17:39] the maze of twisted objects is making my head hurt [17:39] lifeless: hello [17:39] jml: hello [17:39] morning lifeless [17:39] bigjools: am happy to help navigate. [17:39] jml: I will take you up on that tomorrow, thank you [17:39] jml: you might want to deop yourself; joey fixed us to have permissions, but its nominally bad form to have ops all the time [17:39] just trying to get something basic working first [17:39] lifeless: thanks. I didn't notice. [17:40] flacoste: you too [17:40] jml: I'm surprised we're not using some off-the-shelf base64. [17:40] jtv: me too. [17:41] I'll admit I'm not sure it's all url-safe. And I believe there are different choices for the 64th digit. [17:42] jtv: I'm also not sure why we sometimes use md5 and sometimes use sha1 [17:42] flacoste: ping [17:42] jml: if we keep the algorithm secret, it's harder to crack. [17:43] (yes, I AM joking) [17:43] jtv: at least now the intent of the calling code is more clear. [17:43] jml: yes, it's a pleasure to read. [17:44] jtv: stub is the original author, it seems (r1268!) [17:45] long live stub [17:46] A factory of metaclasses, oh dear—my meta stack just overflowed. [17:50] twistd has finally beaten me for the day, I quit [17:50] jml: half-overhearing your conversation makes me wonder if base64.urlsafe_b64encode in the stdlib is of interest to you [17:52] leonardr: looking now. [17:52] jml: ISTM base does go horribly wrong on 2's-complement minimal numbers. [17:52] benji: If I'm reading the code correctly, I think it's too late. [17:53] benji: since we've already stored stuff keyed with the old algorithm. [17:53] Oh, there are otherwise encoded URLs in the wild? That would be too late. (Unless we were highly motivated to change for some reason.) [17:53] right. [17:54] not 100% sure though. [17:54] I'm just moving the bit that does the encoding from one place to another :) [17:54] (yay abstraction!) [17:54] having a wierd way and a standard way is worse than just a wierd way :) [17:54] leonardr: this will probably take me a bit. :-P [17:54] exactly. [17:55] jtv: I don't know. I'm not sure it really matters, tbh. [17:55] matsubara: hi [17:55] matsubara: I think this is another bug in wallyworlds bind variables patch [17:55] lifeless, hi [17:55] matsubara: note the values has (u"...." [17:55] jml: yeah… though given the recent hullabaloo with basically all java and php breaking… [17:55] thats python syntax, not sql [17:55] lifeless, i don't know what patch is that [17:56] jtv: I can add a check to reject negative numbers. It's not used for positive ones right now. [17:56] s/not/only/ [17:56] matsubara: he changed the oops sql layer to record the values of things getting [17:56] jml: sure, that'd do it for me! [17:56] %s substituted etc [17:56] jml: also, simpler. [17:56] good night [17:56] bigjools: night [17:56] good night bigjools [17:56] matsubara: so that we get better diagnostics [17:57] however, its backfired spectacularly;) [17:57] jcsackett, feel free to ask questions [17:58] lifeless, hmm [17:58] jml: in lib/lp_sitecustomize.py, s/eminate/emanate/ [17:59] jml: Also, any idea whether that comment pertains to all deprecation warnings (which emanate from zope), or to all deprecation warnings that emanate from zope? [17:59] lifeless, it doesn't seem to happen often though. I could identify only one oops triggering the regex problem [17:59] jtv: no idea. I just moved it. [18:00] jml: fair enough, I'm ready to vote [18:00] matsubara: indeed - much of our code just embeds literal sql today; this will change [18:03] matsubara: I've just commented via mail with a suggested addition regex, and a proposed bugfix for the existing one so it doesn't timeout [18:05] jml: done. [18:11] jcsackett, fyi, one thing that i shouldn't have put into the branch (and that i remove in the follow-up): [18:11] if not invalid_field.endswith('_html'): [18:11] that's the wrong way to do that [18:13] leonardr: dig. [18:15] jtv: thanks! [18:16] np [18:18] \o/ [18:18] bug 1 rendering reliably on staging. [18:18] <_mup_> Bug #1: Microsoft has a majority market share who would have thought it. [18:22] lifeless: nice [18:24] jcsackett: I see you have a fix for diff and it was the viewport [18:24] sinzui: alignment to the viewport, yes. [18:25] once it was isolated it was trivial. [18:25] jcsackett: r=me for code and ui [18:25] jcsackett, when you're done: https://code.launchpad.net/~leonardr/lazr.restful/more-tests-for-combined-representations/+merge/50202 [18:25] leonardr: that's the followup? [18:25] yeah [18:27] sinzui: thanks [18:27] I wonder if someone would like to qa https://bugs.launchpad.net/launchpad/+bug/718809 [18:27] <_mup_> Bug #718809: New users should default to not receiving email for their own actions < https://launchpad.net/bugs/718809 > [18:27] if they do, we can deploy 4 more revs [18:33] hi lifeless [18:41] jcsackett, are you very busy? [18:41] If not, → https://code.launchpad.net/~jtv/launchpad/bug-719247/+merge/50204 [18:45] hi flacoste [18:46] lifeless, you pinged me earlier? [18:46] also , where do you see that I have ops? [18:46] flacoste: you had ops here and in #launchpad [18:46] now removed? [18:46] jml deoped you here, but that will happen on every join until you tell chanserv not to do it by default [18:47] flacoste: you can get it back with /msg chanserv op #launchpad-dev [18:47] lifeless: ahhh, that's what's going on. [18:47] jml: same story for jtv, bigjools etc having voice [18:48] lifeless: do you know what the setting is? [18:48] lifeless: because afaict, you have the same flags as I do. [18:48] we had someone being hostile/silly on #launchpad the other day and I pinged joey cause the ops list was -staaaale- [18:48] I do [18:52] figured it out [18:52] it should have been [18:53] flags #launchpad-dev lifeless -O [18:53] but chanserv whinged, so I've asked joey to action it [18:53] yeah, that's what I've got. [18:55] jtv: i can get to it, it's just got two in the queue before it. [18:55] jcsackett: then I will have to leave before you get to it… the documentation's fairly extensive though. [18:55] jtv: no worries. [18:55] thanks [18:56] flacoste: I did, about the chat with #is; how did it go? [18:56] using launchpadlib, is there a way to get the url for a person's mugshot? [18:57] lifeless: went well, our tickets are blocked waiting on resources, but are next in line [18:57] thanks [18:57] lp.people['mhall119'].mugshot gives me a lazr.restfulclient.resource.HostedFile [18:57] lp.people['mhall119'].mugshot.open() gives me a lazr.restfulclient.resource.HostedFileBuffer [18:58] for displaying in LD, I just need a URL that the browser can use to load the image [18:58] we currently use "https://edge.launchpad.net/api/beta/~%s/mugshot" % (identity) [18:58] the mugshot_link, but note the caveats: [18:58] if lp.people[request.user.username].mugshot.open() doesn't throw an exception [18:59] - privacy means that we may hand out a link to our appservers which will cause a request to use, a 302 and then a request to the librarian [19:00] mhall119: didn't we go over this in excruciating detail a couple of weeks ago? IIRC you want the external url added to the object where possible, or something? [19:00] lifeless: i don't think there is a web_link for a hosted file [19:01] lifeless: yes, but it was Ronnie asking then, I'm playing catchup [19:01] leonardr: indeed - they've been using the api link directly [19:01] leonardr: which doesn't do what they need quite, AIUI [19:01] mhall119: the channel is logged I think; you might like to read that discussion first [19:02] lifeless: mugshot_link seems to be exactly what I want, not sure why we didn't use it in the first place [19:03] if no mugshot is given, will mugshot_link be None, or raise an exception? [19:03] mhall119: whats the value you see at the moment ? [19:04] mhall119: mugshot_link will always have a value, but sending a GET to that url may give you a 404 [19:04] >>> l.people['david'].mugshot_link [19:04] u'https://api.launchpad.net/1.0/~david/mugshot' [19:04] ok.. [19:04] yeah, its *exactly* the same thing you are using at the moment [19:04] leonardr: that's the problem I'm trying to fix too [19:04] getting text instead of an image [19:05] any ideas on that front? [19:05] 347 packages in canonical and lp, 788 directories [19:06] mhall119: what kind of program are you writing? [19:06] jcsackett: https://code.launchpad.net/~lifeless/launchpad/bug-717394/+merge/50110 [19:06] leonardr: http://loco.ubuntu.com [19:06] lifeless: on the queue. :-P [19:08] mhall119: is it javascript or server-side html generation? [19:08] leonardr: server-side [19:08] we store the URL in our database so we don't have to call LP every time [19:09] mhall119: i suggest issuing a request for the mugshot link. you'll either get a 404 or a redirect to the librarian, and you can store the redirected url [19:09] just be sure to re-check every once in a while in case they change their mugshot [19:09] will that work? [19:10] leonardr: yours doesn't give either a 404 or 302 [19:11] mhall119: it's a 303 [19:14] ah, ok [19:15] leonardr: so given that 303, is there a way to get the correct url? [19:15] mhall119: it should be in the Location header [19:16] oh, nevermind, https://api.launchpad.net/1.0/~david/mugshot gives a 404 [19:17] leonardr: r=me on the first one. [19:17] * jcsackett prays for no more ~800 line diffs. [19:17] * jcsackett glances at lifeless's with sneaking suspicion... [19:17] jcsackett: sorry, i should have done the Accept header parser as a separate branch [19:17] leonardr: all good. :-) [19:18] i just enjoy kvetching. [19:18] in that case you should pray for more 800 line diff [19:18] s [19:19] jcsackett: +360 - 145 [19:19] jcsackett: is small [19:20] of course, because it hits lots of contexts, thats 730 lines flattened [19:20] lifeless: yeah, it's not actually that bad. [19:21] i'm on a bit of cold meds, so my sense of humor is distorted. [19:21] jcsackett: btw I thought about making setUpTarget2 a template function, but the trade off was pretty average, and the code harder to follow so I left it as first crafted [19:21] jcsackett: nasal hijinks? [19:21] lifeless: thus far. there's been a round of flu/bronchitis among some friends. i'm hoping mine is just a cold. [19:21] grah [19:21] be well [19:23] the any/all helpers are a bit awkward to work with [19:30] flacoste: so, optional reviews [19:30] flacoste: I raised the thread as we discussed [19:31] lifeless: yep, looks like we are good to make this the standard process [19:31] lifeless: simply update the wiki pages [19:32] flacoste: I'd like to roll it into the main process docs. What do you think? [19:32] lifeless: sure [19:33] jcsackett: so my branch has only 4 code changes: expose open_bugtasks_search, add BugTaskSearchParams.setTarget, add BugTaskSet.countBugs, use it from BugTargetView [19:38] matsubara: hi [19:38] matsubara: did my suggesetion in the bug make sense? [19:39] lifeless, I'm adding some tests cases so we can see if the regex change will work for us [19:39] lifeless, from what I tested manually the first regex worked, the second one didn't work so well [19:41] matsubara: I think we need test cases yes :) [19:41] matsubara: but broadly you need two changes: [19:41] 1) make the single quote string regex not take so long [19:41] 2) add a regex for u"" strings [19:41] lifeless: dig. having made coffee i'm properly looking at yours now. [19:45] lifeless, cool. thanks for the feedback. once I have the mp ready, I'll ask you to take a look [19:45] :-) [19:45] sweet [20:06] * thumper afk to take car in to get serviced, back asap [20:16] that reminds me, I need to take cdr in for service too; I wonder if the local Lisp shop is still open [20:17] jcsackett, can i get you to take a look at one more small revision to https://code.launchpad.net/~leonardr/lazr.restful/more-tests-for-combined-representations/+merge/50202 ? [20:18] specifically, revision 185 [20:22] leonardr: still r=me. [20:22] great [20:31] jcsackett: hi [20:31] lifeless: hello. [20:32] would a voice call to go through the patch help? I'm only asking because I wasn't expecting it to chew up hours of your time . [20:32] lifeless, https://code.launchpad.net/~matsubara/oops-tools/720358-regex-fix/+merge/50225 [20:33] jcsackett: (and I feel guilty about taking up that much time) [20:33] lifeless: it hasn't chewed up hours. you pinged while i was in the midst of other reviews. [20:34] and i've had some distractions. i'm finishing making notes now. [20:35] jcsackett: oh, phew :) [20:35] lifeless: yeah, no worries. :-) [20:35] now, OCR? that has chewed up hours. :-P [20:41] Yippie, build fixed! [20:41] Project db-devel build (375): FIXED in 5 hr 57 min: https://hudson.wedontsleep.org/job/db-devel/375/ [20:44] lifeless: r=me. [20:44] sinzui, there's a stack of reviews i've thrown in that i need follow up on. not sure if you've seen them or not already. [20:45] * jcsackett moves on to last branch he was pinged for. [20:49] leonardr: want to approve https://code.launchpad.net/~thumper/launchpad/recipe-inline-edit-recipe-text/+merge/49585 ? [20:50] oh, rightm you're being mentored [20:50] sinzui: -yo- [20:51] lifeless: yes, i'm the diet coke of reviewers right now. :-) [20:52] that reminds me of cola/coke/pepsi [20:52] http://piumarta.com/software/cola/ [20:53] jcsackett: ^ [20:53] lifeless, thanks! === matsubara is now known as matsubara-afk [20:53] de nada [20:54] lifeless: that sounds rather ambitious. [20:54] it is [20:55] some interesting shit [20:56] heh, that is not what i think of when i hear pepsi/jolt in reference to a piece of code [20:56] http://piumarta.com/software/peg/ is also interesting to compiler geeks [20:57] peg i have heard of. [20:57] never looked at, but heard of. [20:59] lifeless: jcsackett: I am back. I can review again [21:00] sinzui: \o/ [21:00] * StevenK grumbles at buildbot [21:00] sinzui: I want to have a ui discussion about bugtask:+index with someone [21:00] sinzui: would you be suitable, and if so, when would be good for you? [21:00] In mumble, if I use "push to talk" what do I push? [21:01] there is a config option to choose a key [21:02] lifeless: in a few minutes. I need to get a drink and hope that me second computer prefers an older kernel [21:03] sinzui: kk [21:03] StevenK: can you hear me? [21:04] thumper: Didn't have headphones on, try again? [21:05] leonardr: you around? [21:05] yup [21:05] mumble? === salgado is now known as salgado-afk [21:06] thumper: Configure -> Settings -> Shortcuts [21:15] sinzui: shout when you are ready [21:16] sinzui: can you look at jcsackett's reviews of leonardr's branches? [21:16] sinzui: I want them landed asap :-) [21:18] leonardr: lib/canonical/lazr/security.py and lib/canonical/lazr/doc/checker-utilities.txt is the test [21:21] sinzui: if you can't, I'll be happy to mentor the reviews [21:21] thumper: I am reading it now [21:21] sinzui: awesome, thanks [21:27] I'm so freaking excited about this lazr.restful change [21:28] sinzui: got a minute? [21:28] sinzui: for mumble? [21:28] thumper: I'm queued already for sinzui :) [21:28] lifeless: :( [21:28] thumper: ^^ [21:29] lifeless: my minute with sinzui is talking through the background of the changes that he is currently reviewing [21:29] lifeless: so it is more timely :) [21:29] hi thumper [21:30] hi poolie [21:30] hi lifeless, your statement about pithiness was to pithy to be understandable :) [21:30] poolie: we should have a chat sometime [21:30] how about 60m from now? [21:31] Project devel build (451): FAILURE in 5 hr 26 min: https://hudson.wedontsleep.org/job/devel/451/ [21:31] Launchpad Patch Queue Manager: [r=jtv][bug=715325] Don't return builds for disabled archives using [21:31] get{Pending, }Builds() on recipes. [21:32] poolie: yeah, that should work [21:32] poolie: :) [21:33] thumper, i don't think test_recipe_text tests anything? to test that you can edit the recipe text, you would have to call lp_save() [21:33] do we have to call lp_save for mutators? [21:34] thumper: you don't have to call lp_save() when you invoke a named operation [21:34] but the purpose of a mutator is to hide a named operation so that it looks like normal field access [21:34] leonardr: but you do for mutators? [21:34] and in that case you do need to call lp_save() [21:35] leonardr: if you have several mutators that are being saved, which order are they called? [21:35] ie. on the client, side, there is no 'mutator' [21:35] * thumper adds a lp_save() [21:35] it's just that recipe_text is editable [21:35] r=me apart from that [21:35] ok [21:36] thumper: if you have several mutators, i believe they're called in the order in which the fields were defined in the annotated interface [21:36] ok [21:36] as in the order the fields that are being mutated were defined? [21:36] yeah [21:37] ok [21:37] that makes sense [21:37] that gives you the most control [21:37] * thumper nods [21:37] leonardr: As a stupid question, how do I run the lazr.restful tests? There's no makefile that I can see. [21:38] StevenK: python bootstrap.py; bin/buildout; bin/test [21:38] StevenK: it can take a while the first time [21:38] StevenK: it is worthwhile setting a cache for buildout [21:39] yeah, put this in ~/.buildout/default.cfg [21:39] [buildout] [21:39] eggs-directory=/home/[username]/.buildout/eggs [21:39] download-cache=/home/[username]/.buildout/download-cache [21:39] and create those directories [21:40] first buildout will take a few minutes, subsequent will be instantaneous [21:40] leonardr: I've just privmsg'ed that to StevenK too :) [21:40] k [21:41] I didn't even have setuptools installed, so I'm still on the first step :-) [21:44] * leonardr leaving but will be back to do a lazr.restful release [21:45] jcsackett: could I get you to look at https://code.launchpad.net/~jameinel/launchpad/lp-forking-serve-cleaner-childre/+merge/50031 [21:45] hmm... looks like I put the comment in the wrong spot, just a sec === almaisan-away is now known as al-maisan === al-maisan is now known as almaisan-away [21:47] pushed an update [21:48] sinzui: ping [21:48] hi lifeless [21:48] sinzui: is now good ? [21:48] May I have 10 more minutes to finish a review? [21:49] of course [22:00] jam: everything where it should be on that MP? I can look at it now. [22:04] matsubara-afk: lp-oops is timing out for me now [22:04] matsubara-afk: on OOPS-1716ED446 [22:05] lifeless: I am available now. irc, mumble, or skype [22:05] skype works best I think [22:06] leonardr: https://code.launchpad.net/~stevenk/lazr.restful/move-test/+merge/50239 If you're still around [22:07] turns out my branch to rename zeca fails with an obscure error in an at-first-glance unrelated test [22:07] who'd have thunk it! [22:07] * jml fixes [22:08] jml: I'd a thunk it [22:11] sinzui: https://bugs.launchpad.net/ubuntu/+bug/1 [22:11] <_mup_> Bug #1: Microsoft has a majority market share jcsackett: everything should be ready [22:13] jam: i will look at it soon. [22:13] wgrant: Did you want to close all of the bugs referenced by the rollout? [22:14] sinzui: fire alarm just went off in my apartment building. hopefully we'll be back in before standup. [22:14] jcsackett: this is another one which should be ready for review https://code.launchpad.net/~jameinel/launchpad/twisted-close-on-failure/+merge/50067 [22:19] StevenK: Done. [22:21] getPublisher meaningfully changes state. How interesting. [22:23] StevenK, wgrant: does a distro "always" have a current distroseries? [22:23] No. [22:23] or, I guess, does "ubuntu" always have one? [22:23] Wait. [22:24] With status CURRENT? [22:24] Or do you mean a development focus? [22:24] wgrant: whatever I need for "maverick" now [22:24] wgrant: I'm wanting to provide a reasonable default for daily builds [22:24] so the default initially will be the current distroseries [22:24] development focus right now is natty [22:25] There will almost always be one, but it will be missing occasionally. [22:25] And for new distros. [22:25] Which are coming soon. [22:26] wgrant: if a distro has at least one distro series, is the distro guaranteed to have a development focus? [22:26] also... why don't we force distros to have at least one series like projects? [22:27] Because distroseries are special and do magical Soyuz things. [22:27] Although it's less bad now. [22:27] did anyone debug that error with ec2 things not having any output in 600s? [22:27] You should use Distribution.currentseries. [22:27] sinzui: i'm back. false alarm, evidently. [22:27] thumper: .currentseries implements the development focus logic, and will always return something if there are any series. [22:28] * thumper looks at the distro model code [22:29] wgrant: that would give recipes a default of making for natty now not maverick [22:29] ... [22:29] I know. [22:29] lifeless: See new comment on RT#43352 [22:29] <_mup_> Bug #43352: ipp jobs not purged; purging causes 100% cpu usage < https://launchpad.net/bugs/43352 > [22:29] I wonder if that is good enough [22:29] StevenK: otp [22:29] thumper: ping me when you are free? do you want to discuss the "Build now" ui review points? [22:30] wallyworld: I was just going to have a quick chat with poolie [22:30] wallyworld: after that? [22:30] thumper: no hurry. that's why i mentioned when you are free :-) [22:30] jam: what confidence do we have that this try/finally all works, given there's no test coverage? [22:30] poolie: skype or mumble? [22:31] wgrant: when is a distroseries FROZEN ? [22:31] thumper: Just before release. === jcsackett changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews [22:31] Around release time, or when it has just been created and is not yet initialised. [22:31] * thumper nods [22:31] ok [22:32] Embedding all this in a single status is a little insane, but that's how it is :( [22:34] wgrant: is https://bugs.launchpad.net/launchpad/+bug/661931 still an issue? [22:34] <_mup_> Bug #661931: make check sometimes fails on EC2 without test failures < https://launchpad.net/bugs/661931 > [22:34] jml: I don't think so. [22:34] All that remains is the Windmill hang, AIUI. [22:35] For which I just filed bug 720998 [22:35] <_mup_> Bug #720998: ec2 test times out < https://launchpad.net/bugs/720998 > [22:36] wallyworld: join mumble and lets talk about your reviews [22:36] wallyworld: poolie has now been bumped to after lunch [22:39] jml: Does getPublisher do much beyond creating directories? [22:39] wgrant: well, presumably it gets a publisher [22:39] s/do much/do much evil/ [22:39] wgrant: oh right, nothing obvious. [22:40] wgrant: I deleted a line in a test that was "unused_variable = getPublisher(...)" [22:40] Hah. [22:40] That all sort of sucks. I rewrote the underlying config stuff last year, but didn't end up making it all the way to the top. [22:40] because I guess functions that start with 'get' are effectively read-only [22:41] wgrant: it's all about incremental improvement [22:41] thumper: was otp, ok to go now [22:42] I got this error while running sphinx.main() in the Launchpad test suite on EC2: [22:42] actual = "Making output directory...\nException IndexError: IndexError('list index out of range',) in > ignored\n" [22:42] uhh, the error is the exception [22:42] hmm... [22:42] that gives me a though [22:42] .t [22:52] wgrant: hi [22:53] wgrant: I was considering another deploy, but danilos patch asn't qa'd; wondering if thats something you might like to do? [22:57] StevenK: I see, cool. [23:00] lifeless: ie6=0.5%, ie7=1% [23:02] nice [23:02] so we should ask our stakeholders / commercial customers only [23:05] lifeless: Sure. [23:10] lifeless: Looks good. I shall request the deploy. [23:10] wgrant: -woot- [23:11] This means we have deployed every day this week, I think. [23:11] 16% of our visitors are using mobile devices [23:11] Ah, no, missed Tuesday. [23:11] But I think timezones meant they were close anyway. [23:11] I bet they hate bug 1 [23:11] <_mup_> Bug #1: Microsoft has a majority market share lifeless: Can we remove the security deployment section from LPS? [23:13] production-stable seems to be pretty dead. [23:13] wgrant: raise it for discussion with losas [23:14] I wanted to initially but there was lots of concern about when it would be needed, so it stayed as a compromise [23:14] k [23:14] I am at least tempted to move it below the stable section. [23:14] if it goes, a bunch of processes can be cleaned up too [23:20] sinzui: Wow, the number of mobile users is way higher than I expected it [23:22] jcsackett: sorry about the delay, was picking up my son. I have run the specific code quite thoroughly, and there are some tests that already cover it. [23:22] It is a little bit hard to inject specific failures into that exact point. If you feel it is critical, we can try to figure something out [23:22] but I did do a lot of manual testing. [23:22] jam: ah, in your MP you said there were no tests; i took that to mean no testing. :-) [23:22] no new tests covering what changed [23:23] dig. [23:29] jam: r=me, but i'm mentored, so sinzui will have to follow up, and it is EOD in our tz. he may still follow up today, or tomorrow morning. [23:30] k, thanks jcsackett [23:30] jam: np. :-) [23:32] lifeless: So, are you OK with https://code.launchpad.net/~wgrant/launchpad/bug-708999-ff-docs/+merge/49758? [23:32] It seems rather controversial. [23:32] But it looks like improvements on it are even more controversial. [23:51] otp [23:58] Some people's interpretation of HTTP is pretty creative.