[00:32] Do we use the main loggerhead branch in launchpad? Do we make any modifications to the template or is it just a vanilla deploy? [00:33] huwshimi: no, yes [00:33] huwshimi: I want yours and sinzuis opinion on this actually [00:33] I'd love it if we used releases without modifications, and did our tweaks outside the loggerhead tree [00:35] huwshimi: theres a merge proposal / bug that shows the upstream loggerhead theme, and ours. [00:36] huwshimi: do we need a custom theme, or perhaps we should just run the original - thats even simpler than doing some custom css for it in our tree and glueing them together. [00:37] lifeless: Do you know which bug that is? [00:37] not offhand [00:37] start with launchpad-project/+activereviews [00:37] follow the loggerhead mps, you'll find it pretty quickly [00:38] lifeless: I don't really know the history of loggerhead. Is it mostly just a launchpad project and therefore we can do what we like with the main branch? [00:38] no [00:38] its a bzr community project we earnt commit rights too [00:38] and was then abandoned upstream, so was adopted by mwhudson/lp-code for a while [00:38] then he left and they lost cycles [00:39] most recently, flacoste, poolie and I agreed that the LP team will maintain it, as we maintain lazr-js etc [00:39] which means: [00:39] - do the right thing for it [00:39] - fix bugs affecting us in sensible ways [00:39] - do code review and bug triage for contributions by other users, whatever the their purpose [00:42] lifeless: OK, so I've been tasked with making it look like Launchpad. Somehow I need to do that in a way that is maintainable. [00:44] huwshimi: interesting, cool. [00:44] huwshimi: so, we *could* change trunk to look like LP [00:44] huwshimi: but if we do that, we should still keep it looking and feeling nice for standalone users. [00:44] hi lifeless [00:45] re removing the oauth.py copy and using the system one instead: [00:45] huwshimi: And we'd not want to have assests that prevent it being easily deployed. [00:45] huwshimi: we can definitely add dependencies on this that LP also uses if that helps [00:46] huwshimi: we can also make it more modular/pluggable and change out integration glue [00:46] do you know how i persuade buildout to import oauth from the system pythonpath, rather than trying to get it from an egg? [00:47] poolie: it should just do it; make sure to remove the existing egg and tarball [00:47] lifeless: If it is a separate entity it probably shouldn't change design every time LP does. But having said that if it is our devs doing all the work then they would have to maintain two sets of templates/css. [00:47] huwshimi: it is our devs [00:48] hm apparently not http://pastebin.ubuntu.com/566810/ [00:48] maybe there's still something cached somewhere that makes it think so? [00:49] lifeless: So doing it in trunk means less work, but means we can't have any LP specific stuff right? [00:49] did you delete the eggs/oauth* dirs ? [00:49] poolie: Ah, give up now. [00:50] You have to use the egg. [00:50] Since our other eggs require it. [00:50] wgrant: EWHAT [00:50] Ah, lazr.restfulclient doesn't actually require a particular version. [00:51] So you may be able to make it happy with the system version. [00:51] huwshimi: so, the constraint is 'trunk must still be a viable standalone code browser' [00:51] huwshimi: that doesn't mean 'no lp stuff' but its likely easiest to frame it that way [00:52] huwshimi: *however* we can quite straightforwardly make hook points that our glue in lib/launchpad_loggerhead uses to combine with the generic stuff in trunk [00:52] poolie: Perhaps try lifeless' suggestion of removing the built eggs. But I don't like your chances; I've given up trying to fix things like this before. [00:53] huwshimi: that is a little more engineering, but certainly not twice. [00:54] lifeless: How does this decision get made? [00:54] wgrant, thanks for the advice [00:54] huwshimi: engineers doing the work [00:54] seeing as it's only removal of cruft my perseverence is not going to be very high [00:54] it's just a principle thing [00:55] Heh. [00:55] buildout gets a bit messy sometimes :/ [00:57] wgrant: hey [00:57] wgrant: I'm going through your review comments [00:57] wgrant: it isn't very easy to use the same text in the initial form [00:57] wgrant: I have changed to "Built daily" rather than "Build daily" though [00:59] thumper: Hmm. [00:59] I still do not like the two completely different UIs. [00:59] wgrant: the original form had "Built daily" with a checkbox [00:59] wgrant: it was changed to make it more descriptive [01:00] wgrant: I suppose we could change it back and add the help link [01:00] wgrant: what do you think? [01:00] thumper: I think that would be best. [01:00] * thumper goes to poke the code [01:01] Except in that case it could possibly be better as "Build daily" [01:01] We have no definition that I can see for the style of checkbox labels. [01:03] wgrant: what do you mean? [01:05] :( [01:05] not a fan of the boring grey titles [01:06] thumper: Some of our checkbox labels are imperative, others indicative. [01:06] It makes me sad. [01:06] turning into mpt? [01:06] wbn to have a style guide for that [01:06] someone needs to make sure we're consistent [01:06] I think we did have a style for it [01:06] * thumper goes to look [01:07] Uhoh. [01:07] Debian is considering source-only uploads again. [01:08] wgrant: what is the impact of that? [01:08] thumper: Flamewars, probably. [01:08] Ubuntu has mandated source-only uploads from day 1. [01:08] Someone in Debian proposes it every so often. [01:09] But it inevitably gets nowhere. [01:09] Besides massive threads. [01:09] wgrant: https://dev.launchpad.net/UserInterfaceWording is the page, feel free to edit [01:10] thumper: It's not very thorough, unfortunately. [01:10] We need UI review :( [01:10] eg. http://blog.launchpad.net/ [01:10] i get the same problem even with my entire egg directory deleted [01:10] Look at that first image. [01:10] poolie: What if you remove the egg from download-cache? [01:11] for oauth? [01:11] Yeah. [01:11] i think i already did that [01:11] So buildout cannot find it. [01:11] hm, maybe not [01:12] wgrant, the full stop at the end of the line? [01:12] poolie: Yes. [01:13] They are little things. [01:13] with the ironic red arrow? [01:13] But they make the UI look far more awful than it actually is. [01:14] i think we need ui review in the sense that everybody checks for it [01:14] Indeed. [01:14] also, how ironic to get so many mp reviews about missing full stops in comments, and for this to get through in the ui [01:14] Heh. [01:15] this may be an instance of a kind of thing that is easier to spot in review in a screenshot [01:15] or maybe not [01:16] but the punctuation perhaps stands out more from the code punctuation there [01:16] Apparently not. [01:16] Because there is a screenshot. [01:16] on the mp? [01:16] ah :) [01:16] I'm not sure if there was one there. [01:17] thumper: What's the easiest way to force failed scans to be retried? [01:17] wgrant: lock and unlock the branch [01:17] thumper: There are a few hundred. [01:17] Is that still the easiest way? [01:17] wgrant: I have a simple plugin that allows me to do that [01:17] um... [01:17] why did they fail? [01:17] This is from the package-import incident last week. [01:17] Which exposed the bzr stacking bug. [01:18] ok, even with the download cache and all the eggs deleted, it still fails with "We have no distributions for oauth that satisfies 'oauth'" [01:18] there is an API to force a scan isn't there ? [01:18] i looked for buildout documentation about this but i couldn't find any [01:18] lifeless: Does requestMirror still work? [01:18] I don't really recall. [01:18] poolie: is this in a clean tree ? [01:19] wgrant: if you want to use launchpadlib, I think there is a method [01:19] no, requestMirror doesn't work [01:19] :( [01:20] lifeless, as in ' make clean'd tree? [01:20] no, as in freshly branched [01:20] or bzr remove-tree and then checkout again, kindof thing [01:20] wgrant: it is the branchChanged method, which is triggered by the unlock code [01:20] wgrant: and nothing is exposed over the api [01:20] poolie: I think you're well past diminishing returns [01:21] wgrant: what I did was to get a list of the failed branches, and wrote a bash loop to process them with 'bzr rescan' [01:21] wgrant: which takes advantage of my bzr-expert privileges [01:21] Yeah. [01:21] Can I give you a list of branches? [01:22] wgrant: sure [01:22] wgrant: pastebin? [01:22] poolie: Could you requeue the top p-i failure? 92 packages failed due to some unidentified librarian breakage for ~20 minutes yesterday. [01:22] thumper: Gimme a sec. [01:22] Hopefully I can grep it out. [01:24] lifeless, you mean well past this being sufficiently easy to clean up that it's worth doing? [01:24] i agree [01:24] yes [01:24] regretfully [01:24] ok [01:24] i shall abandon it and explain where i got to [01:26] pisses me off to have it be so hard to remove copy and paste though [01:26] agreed [01:26] but, i shall be po'd about something more important [01:27] this is the problem with having 4 different dep systems in play [01:27] wgrant, will do [01:27] right [01:27] wgrant, actually for the sake of proceeding towards handoff, let's ask a losa (spm?) to do it instead, and i'll help [01:27] poolie: I would, except spm seems to be even more excessively busy than normal. [01:27] u1 melted down in the weekend [01:28] Again. [01:28] no [01:28] uniquely [01:28] Oh. [01:28] Awesome. [01:28] i came in this morning to have all my tomboy notes conflicted [01:28] I doubt he'll have time for anterior irritation amelioration today [01:29] or posterior :P [01:32] wgrant, hm, so that's kind of a problem if we're not going to be able to do it without them in future [01:32] anyhow [01:33] poolie: Well, we are getting lots of new LOSAs :) [01:33] indeed [01:33] that's 92 packages failed with key bzrlib.errors.InvalidHttpResponse [01:33] is this a bug for it? [01:34] i guess it was just an lp operational glitch? [01:34] The librarian was half-broken for a while. [01:34] maybe udd should retry it [01:34] No idea why. [01:34] RIght. [01:34] I'd requeue_package --auto it [01:38] Sourceforge have fixed their svn ssl cert, happily [01:38] * maxb is restarting imports [01:42] https://bugs.launchpad.net/udd/+bug/718483 [01:42] <_mup_> Bug #718483: should delay and retry on http 503 from librarian < https://launchpad.net/bugs/718483 > [01:43] oh, will --auto be enough maybe? [01:43] I think so. [01:45] ok done [01:45] thumper: http://paste.ubuntu.com/566819/ should be most of them. [01:45] wgrant: http://people.canonical.com/~tim/new-recipe-built-daily.png [01:46] thumper: I'm not sure if the (?) belongs on the title or description. But that looks fine. [01:47] Consistency in terminology is the main thing. [01:48] ok [01:49] hmm... almost time to collect mini-mes [02:10] grah [02:10] these bug search pages are scary messy [02:21] The code behind them? [02:21] the structure & code [02:21] bug 717394 [02:21] <_mup_> Bug #717394: Distribution:+bugs timeouts < https://launchpad.net/bugs/717394 > [02:22] 3.5 seconds overhead on every ubuntu bug search, the results are effectively constant [02:25] thumper: Did you have any luck with rescanning those branches? [02:25] wgrant: yep, over 100 triggered so far [02:25] it is a little slow as there are 14 vfs calls [02:25] Ouch. [02:25] Thanks. [02:44] wgrant: all rescans initiated [02:45] wgrant, re your comment on bug 716175 [02:45] <_mup_> Bug #716175: api calls fail while launchpad is readonly < https://launchpad.net/bugs/716175 > [02:45] (i ask only for my education; i'm happy to leave it low) [02:45] the "consumer check" is to do with the oauth validation? [02:45] poolie: Yes. [02:46] Even for anonymous requests it does a consumer lookup. [02:46] is this the kludge that we create a temporary login for anonymous requests? [02:46] Possibly to allow us to blacklist. [02:46] why does it do that? [02:47] So we can kill off misbehaving applications, I guess. [02:54] Yippie, build fixed! [02:54] Project db-devel build (363): FIXED in 5 hr 41 min: https://hudson.wedontsleep.org/job/db-devel/363/ [03:38] thumper: Still around? [03:39] we have a very spec compliant oauth implementation [03:39] the standard solves problems we don't have [03:39] Oh? [03:40] you can do a much more direct solution to the 'hand out a cookie to login a client' problem [03:41] doing nonces in a layer on top of http is rather gruesome [03:44] Archive:+index is looking reasonably healthy now. [03:44] Might almost deserve to have its timeout override removed. [03:56] huwshimi: Do you have a plan for desaturating the buttons? [03:56] There are still 1.0-style large buttons around in the facet colours. [03:56] They have been deprecated for years, but are still used. [03:56] wgrant: Where abouts are they? [03:58] Hmm. They're in the facet colours, but they don't seem to all correspond to the relevant facet. https://code.staging.launchpad.net/ has a few. [03:58] wgrant: Ah yes; [03:58] They look very odd now that everything else is grayscale. [03:59] wgrant: Well not *everything* is greyscale :) [03:59] Ahhh, they actually are app colours. [03:59] But Code uses them inappropriately. [03:59] wgrant: but yes, they do need some love [03:59] There are 6 left. [04:02] Time for another icing purge, I think. [04:08] wgrant: so where is your target brnach? [04:10] lifeless: https://code.launchpad.net/~wgrant/launchpad/stop-using-targetnamecache [04:10] But alone it is not enough to disable the script, unless we want to take it out temporarily and hope that nobody notices sort drift while my rewrite makes it through the system. [04:21] Wow, Distribution:+search is quite a piece of work. [04:29] whats the name of the feature flag context manager [04:31] I only know of FeatureFixture. [04:33] thumper: When you're back, could you try rescanning one of the branches, to check that our DB purge worked? [04:53] * lifeless does a naughty [04:53] wgrant, that's the only contextmgr i know of too [04:54] wallyworld, it seems to me there's a bit of a split here (in qatagger) between [04:54] trying to get the right accurate model, which probably requires adding features to lp [04:54] https://lpstats.canonical.com/graphs/LaunchpadOpenBugs/20100215/20110215/ says launchpad has like 9600 bugs open. [04:54] https://bugs.launchpad.net/launchpad says 5800. [04:55] vs just something pragmatic that people can use [04:55] wgrant: heh [04:55] wgrant, one difference, though I don't know if it would account for all of them, is that lpstats tends to include private bugs [04:55] wgrant: also, https://bugs.launchpad.net/launchpad-project is what we need to look at. [04:55] even private bugs nobody on the team can see [04:55] lifeless: I know, but that's only 1000 more. [04:55] poolie: sorry to cut you off - i am just going to get Lachie from school - running late. i'll talk to you when i'm back [04:55] np, no rush [04:57] Ah [04:57] Does not exclude dupes. [05:00] poolie: What's happening with the forking debugging? [05:00] Do we know what's happening, or should I land the cowboy to turn it off? [05:09] Who moderates blog comments? There are a couple waiting, and I'm wondering if I should approve them as I see them. [05:09] Yippie, build fixed! [05:09] Project devel build (438): FIXED in 5 hr 40 min: https://hudson.wedontsleep.org/job/devel/438/ [05:18] wgrant, i can moderate them [05:18] you should be able to too? [05:19] wgrant, i presume jam is going to look at the data on the bug, if any [05:19] poolie: I can, but I wonder if I should. [05:19] too late! [05:20] but, generally [05:20] they were obviously not spam [05:20] i don't see any benefit in sitting on them [05:20] if in doubt about the policy, talk to someone else [05:20] i think the more we post the better [05:20] wgrant: which one [05:20] thumper: Any of them. [05:20] thumper: They all failed again. [05:20] :( [05:21] thumper: Bug #718511 [05:21] <_mup_> Bug #718511: Failed initial scans require manual cleanup < https://launchpad.net/bugs/718511 > [05:21] what cleanup? [05:21] poolie: I agree. [05:21] thumper: Deleting the branchrevisions. [05:21] Which we have done. [05:21] wgrant: lp:debian/wheezy/php-xml-htmlsax3 [05:22] Thanks. [05:22] * thumper has to make dinner for hungry munchkins [05:22] wgrant: if you want the rest poked, let me know and I'll kick it again [05:22] thumper: You will hopefully be poked in a couple of minutes. Thanks. [05:23] thumper: Consider yourself poked. [05:24] It worked, thanks. [05:24] And p-i only has 72 jobs remaining. [05:24] Excellent. [05:41] poolie: wrt qa tagging, the two goals you mentioned - accurate model and easy to use - don't have to be mutually exclusive :-) [05:44] * thumper pokes the script again [05:44] script is running [05:44] Thanks. [05:47] It's working. [05:57] lifeless: Really like the queries time indicator. I have a question though. Every document load (before images, javascript, css etc.) takes about 2.5 seconds longer than the query time. Is that just the time it takes to execute the files, render the templates etc? [05:58] huwshimi: we are currently 100% overcommitted in the datacentre [05:58] huwshimi: so things are queueing a page in advance, and thats within 3 seconds, 99% of the time [05:59] huwshimi: its our top rt [05:59] huwshimi: or approx; I'm going to pounce on mthaddon today to try and get it moving; we should have traction on it this weke [06:00] huwshimi: bug 716760, which needs someone to grab it and run with it, is about measuring this gap [06:00] <_mup_> Bug #716760: no measurement of in-datacentre queue timings < https://launchpad.net/bugs/716760 > [06:00] huwshimi: (sort of actual transfer times) [06:01] lifeless: It's interesting, once you have one bit of information (the query times) readily available, you notice things. [06:01] huwshimi: I mentioned that bug to stub, but I don't know if he's going to poke at it [06:01] huwshimi: yes, continual partial attention [06:02] huwshimi: I think it would be really excellent to also show the time after the initial document - time to get other assets, fire js etc etc [06:02] huwshimi: I expect a similar psychological effect [06:03] lifeless: For example on the lp.net homepage about 75% of our load time is that load overhead (the queries, js, images etc. load in the other 25%) [06:17] wgrant: bug 31820 [06:17] <_mup_> Bug #31820: mysterious exception during accept on ltsp 0.75 < https://launchpad.net/bugs/31820 > [06:17] wgrant: wtf [06:19] lifeless: Probably librarian down. [06:20] wgrant: any reason not to invalid it and wait for a reoccurence with diagnostics ? [06:21] lifeless: I doubt it. [06:35] thumper: lp:debian/wheezy/libjconv lp:debian/wheezy/atom4 lp:debian/wheezy/netrek-client-cow [06:35] lp:debian/wheezy/biosquid lp:debian/wheezy/quilt [06:35] thumper: I missed those five. All the rest are scanned, though. [06:38] wgrant: doing those now [06:38] thumper: Thanks. [06:38] p-i should finish in a couple of minutes. [06:41] thumper: Thanks, all scanned successfully. [06:51] poolie: Apart from nexuiz-data, we appear to be done. [06:51] Everything is scanned, p-i processing new Ubuntu uploads. [06:52] hooray [06:53] poolie: Except https://code.launchpad.net/~ubuntu-branches/debian/wheezy/xserver-xorg-video-voodoo/wheezy [06:53] Created, but unlinked and unpushed. [06:54] Ah, the squeeze branch is pack-0.92!? [06:55] Yeah, we have some rich-root-pack branches. [06:55] How very odd. === almaisan-away is now known as al-maisan [07:36] Ursinha: hi [07:36] bug 718566 should be on loggerhead not launchpad [07:36] <_mup_> Bug #718566: DatabaseError on loggerhead trying to view a revision on staging < https://launchpad.net/bugs/718566 > [07:37] lifeless, hello [07:38] yes, I know [07:38] am changing right now [07:38] coolio :) [07:38] oh, I like the query count on the top [07:38] Ursinha: excellent === mthaddon` is now known as mthaddon [09:02] Hey [09:03] <_starbuck> morning mrevell [09:03] _starbuck, Nice nick [09:04] <_starbuck> :) [09:04] <_starbuck> thanks [09:05] good morning [09:11] moin adeuring [09:11] salü al-maisan! [09:28] Ursula has gone all BG on us [09:32] Would some kind lp committer please shove https://code.launchpad.net/~spiv/launchpad/haproxy-for-twisted-services/+merge/48427 at ec2test or whatever the next step is? [09:36] ERROR:qa-tagger:Something went wrong when marking bugs: 'LPQAStagingDeployment' object has no attribute 'deployed_source_revno' [09:52] wgrant: just bug 717363 needs qa and we can has deploy. [09:52] <_mup_> Bug #717363: prf WalkerBase.walk can fail if self.open raises an exception < https://launchpad.net/bugs/717363 > [09:52] night all [09:56] Cheerio lifeless . [10:27] Project devel build (439): FAILURE in 5 hr 18 min: https://hudson.wedontsleep.org/job/devel/439/ [10:27] * Launchpad Patch Queue Manager: [r=thumper][no-qa] Use the new, correct lazr.restful-0.16 egg. [10:27] * Launchpad Patch Queue Manager: [rs=wgrant][rollback=12363] Revert r12363. The extra subquery makes [10:27] bug searches perilously slow for non-registry-admins. [10:27] * Launchpad Patch Queue Manager: [r=benji, bac][bug=717363] Recover from an open() failure when the [10:27] product-release-finder calls walk(). [10:27] * Launchpad Patch Queue Manager: [r=lifeless][bug=68203] Do not accept whitespace comments when [10:27] reporting a bug. [10:36] dpm: hi, around? [10:37] hi bigjools [10:37] dpm: hi - do you admin the ubuntu-translators list? [10:37] yes [10:38] dpm: great - can you please unsubscribe help (at) launchpad.net, or it might be launchpad-help at canonical .com [10:39] Could also possibly be feedback@ [10:39] lifeless: What got patch-2208-41-0.sql ? [10:39] not according to the mail headers [10:42] bigjools, done [10:42] dpm: awesome, thanks [10:42] np [10:42] yay for less email [10:46] bigjools: Any fallout from switching to debversion? There are other places in our schema we could switch too (eg. ProductSeries.name and other places with version_sort_key indexes) [10:46] stub: no, swimmingly well actually [10:47] seems a lot faster [10:47] Ta [10:48] Archive:+index has fallen out of the top 10 timed-out pages \o/ [10:48] 99% @ 9.67 [10:49] details details :) [10:49] Which is >3s better than before [10:49] the debversion thing plus some other improvements I made have helped a lot [10:49] Yup. [10:49] We have lost a few thousand soft timeouts a day :) [10:50] well the latest report is for the weekend which is not as busy, let's see tomorrow's [10:50] True. [10:52] wgrant: so, the last soyuz-report cleanup we can do is to turn the routine errors into non-oops [10:53] bigjools: Right. [10:53] The key errors. [10:53] FatalUploadError etc [10:53] Although I'm not sure about that NoneType has no email thing. [10:53] Is that the account/person mess again? === henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews === henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: henninge | https://code.launchpad.net/launchpad-project/+activereviews [10:53] don't see that [10:54] 2 occurrences on the 11th. [10:54] OOPS-1868PPA545, OOPS-1868PPA546 [10:54] could be [10:55] wgrant: your config changes seem ok then, I think [10:55] bigjools: Thanks. [10:55] It makes the inheriting configs much simpler. [10:56] FSVO [10:56] jtv: Any news on my MP? [10:56] The diff is bad. But the configs are nice. [10:56] who can I assign loggerhead questions to? [10:56] It's LP-maintained now. [10:56] So your squad :) [11:03] henninge: no, was trying to figure out the XPI bug. But I can get back to your MP if it's urgent. [11:03] There was some mention of it not being critical any more. [11:03] Does that still apply? [11:04] jtv: it's not release-critical anymore because we had the release [11:04] jtv: the bug still is and re-enabling Ubuntu imports depend on it. [11:05] Yes, it is urgent. ;-) [11:05] Ah! [11:05] henninge: in that case, [11:06] —why do you skip unreadable/nonexistent files instead of requiring the user to get their act in order? [11:06] — why do you require a distroseries to be specified among the options but assume a distroseries to be specified? [11:07] — where does the circular import on IDistributionSet come from, since this is a script? [11:08] jtv: as mentioned, this is adapted from reupload-imports [11:09] I had meant the script for my personal benefit initially but thought it might be useful for others, too. [11:09] So, the answer to the first question is "to keep it simple" but I guess a warning would be appropriate. [11:10] henninge: there is a warning, but it doesn't say what the problem is. I say just dump the check. [11:10] The answers to the other two are: "Because I copied that from the originial script. [11:10] I like robust scripts, though. [11:11] henninge: I don't recall off the top of my head but there may be a way to specify to optparse that a particular option is required. [11:11] Typo in the test: is_trackging === matsubara-afk is now known as matsubara [11:14] henninge: also, a copyright notice of 2009 on a new script in scripts/rosetta/ may be taking "adapting the existing script" a bit far. :) [11:14] I agree ... [11:19] henninge: doesn't is_upstream_import_on_sourcepackage duplicate logic you had somewhere else? [11:19] I thought you already implemented that part. [11:19] no, I don't think so. [11:20] Then sorry—wasn't sure so I thought I'd ask. [11:20] Oh, there's a misplaced import in there. [11:20] Does anyone know if the bug expiry stuff is meant to be running now? [11:20] henninge: lines 777—778 of the diff [11:20] jtv: you already reviewed this code, so maybe you are remembering that. [11:20] * henninge looks [11:20] ohhh could be [11:20] bouncy bouncy [11:22] jtv: hm, I think I had circular problems on that one but I can check that again. [11:23] henninge: even then, please move it to the top of the method and comment it. [11:24] henninge: I'm having trouble figuring out what exactly _makeMessages in the test is supposed to do. It crams a lot of scenarios into one method and it's not clear to me how the parameters are meant to interact. [11:27] hm, does the docstring not help? [11:27] That's after reading the docstring! [11:27] Maybe I should add that is_tracking only makes sense if the other two are False? [11:28] I had tried to think of other interfaces for the method but this was the best I could come up with. [11:28] Why not have multiple methods? [11:29] I mean, it helps to know that is_trackging doesn't combine, but it'd help more to have smaller and more self-evident chunks. [11:29] Also, what's "this message" in the docstring? [11:36] sorry, got called to the door [11:37] jtv: there is a finite permutation of possible combinations that the method I am testing has to deal with. [11:37] I had a table on paper and tried to have something else in code. [11:38] Maybe I should change it to not use the tri-state bools. [11:40] Well more parameters probably aren't the answer either. The method already spends a fair portion of its space just trying to figure out what it was that the caller requested. [11:40] Can't you do something along the lines of "makeIdenticalUpstreamMessage"? [11:42] The tests themselves look good, by the way—nice and thorough, well-documented. [11:43] (repeated typo in the tests: identcal) [11:44] They're also nice and concise. [11:47] Hahaha [11:47] real 1m4.066s [11:47] Down from 18 hours. [11:47] wgrant: what is? [11:47] jtv: update-bugtask-targetnamecaches.py [11:47] wgrant: add some sleep()s to avoid surprises. [11:48] Also, nice cache of future "optimizations" for those lazy days. [11:48] Indeed. [11:51] jtv: expanded docstring [11:51] http://paste.ubuntu.com/566935/ [11:51] * jtv looks [11:52] jtv: I guess I could use _makeUpstream, _makeUbuntu and _makeSuggestion methods and pass other messages as is_identical into it. [11:53] s/method/message/ on line 21 of that paste [11:53] henninge: I think it'd be better to split it up, yes. [11:54] I will have to carry pofile and potmsgset around which I was trying to avoid ... [11:55] henninge: yes, that is a bit of pain. But I suppose potmsgset would be implicit in the TM in most places. [11:55] yes, I was just thinking about that. [12:00] Morning, all. [12:00] Hey deryck! [12:00] hi deryck === jtv is now known as jtv-afk [12:06] henninge: Can I throw a review your way? [12:06] wgrant: sure but please don't aim for any tender parts ... [12:07] henninge: https://code.launchpad.net/~wgrant/launchpad/bug-718004-rewrite-targetnamecache/+merge/49612 [12:08] yay 70% packet loss between ISP and the USA. Think I'll go read a book. [12:31] wgrant: That looks very good. Is it ok for you, though, if I finish this after lunch? [12:32] henninge: I'm about to vanish for the night, so I won't be around, but that's fine. [12:32] wgrant: ok, g'night ;) [12:33] henninge: Thanks for reviewing. === henninge is now known as henninge-lunch === mrevell is now known as mrevell-lunch [13:14] deryck, I figure if I exposed my ignorance enough I'd force someone, probably you, to respond :-) thanks, and I look forward to the "now this is what to do" email ;-) [13:14] heh [13:14] gary_poster, actually, I think bac is doing the right thing ;) [13:14] finishing that reply now [13:15] heh, ok cool, deryck, thanks [13:22] henninge-lunch: could you have another look at https://code.launchpad.net/~adeuring/launchpad/bug-702468/+merge/49205 ? [13:22] thanks deryck. i was hoping you'd give your 2 cents. [13:23] gary_poster: are you fixing my blog post? [13:24] mrevell-lunch: does the 'front-page' *category* not put it on launchpad.net? you have to add a tag? === mrevell-lunch is now known as mrevell [13:24] bac, Yeah, it's a tag, rather than a category [13:24] what does the category do? [13:24] bac, I was approving a comment, and was going to ask if you wanted me to meddle. I approved it, and now I'll leave the rest alone for you :-) [13:24] can we get rid of that one as it confuses people like me [13:25] mrevell: ^^ [13:25] gary_poster: thanks === al-maisan is now known as almaisan-away [13:25] np [13:26] mrevell: do all comments have to be moderated? [13:27] bac, I didn't know there was a front-page category. Sure, let's kill it. As for comments ... from new people they do. [13:27] Once you've had one comment approved, it's open season. [13:27] mrevell: thanks [13:31] Project db-devel build (365): FAILURE in 2 hr 51 min: https://hudson.wedontsleep.org/job/db-devel/365/ [13:31] Launchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 12370, [13:31] 12371, 12372 included. === jtv-afk is now known as jtv [13:51] crazy busy day [13:54] henninge-lunch: test_accept_upstream_no_ubuntu says: "If there was already an upstream translation, but no ubuntu one, the suggestion replaces both." There is only one translation to replace, of course; and might it be better to say "accepting the suggestion" rather than "the suggestion"? === henninge-lunch is now known as henninge [13:57] I was wondering, how do you manage to automatically sign the deb packages created from recipes? (ie, without the user entering his passphrase?) [13:57] I'm trying to achieve this myself, but on a local machine [13:58] pindonga: The signing keys of PPAs are stored by Launchpad. Not even the owner of the PPA has access to the private key. [13:59] maxb, so you have a script that does the signing [13:59] I'm using bzr dailydeb [13:59] and I want to automate the signing of the packages I create [13:59] you know any way I could do? [14:00] In the way you mean, packages are not signed. [14:00] Apt archives are what is signed [14:00] this is essentially for a plugin for tarmac I'm building [14:00] What software are you using to build the Release and Packages files? [14:01] maxb, when I run bzr dailydeb and use the dput option it will push the dsc/changes stuff to launchpad [14:01] henninge, abentley, adeuring -- coming, sorry. 2-3 more minutes. [14:01] for that it will sign the package [14:01] sorry, not pacakge [14:01] but changes/dsc files [14:01] I was wondering if there is a way to have the credentials stored in a way that doesn't require the user to put it in [14:02] bzr dailydeb uses debsign internally to sign the files [14:02] !!! [14:02] Whether or not you have a passphrase set on the key is your own decision. [14:03] max, ah, so if I create a key without a passphrase that should work [14:03] Obviously an unprotected key that enables any possessor to impersonate you to Launchpad is a dangerousl thing [14:03] maxb right [14:03] http://paste.ubuntu.com/566971/ [14:03] pindonga: I think we should continue this on #launchpad, as it is not -dev related [14:04] maxb, sure [14:04] thanks anyway [14:11] henninge: you have my vote—sorry for the delays. [14:13] I just got this error when running a clean build of a branch. [14:13] bigjools: Have there been any problems recently when adding new builders? I think I've found a bug where the buildmaster will create a new SlaveScanner for new builders every 5 minutes until it's restarted. [14:13] http://paste.ubuntu.com/566971/ [14:14] abentley, if you'll point me at that mp, I'll review later, after I finish a handful of emails. [14:14] jtv: thanks! [14:14] deryck, first I have to create the MP. [14:15] ah, ok :-) [14:15] henninge: on an unrelated note, I see that POTMsgSet.setSequence has a case for TranslationTemplateItem.sequence < 0. I have _no_ idea what sense that would make. Can you think of anything? [14:16] jtv: I was not aware of that and nothing comes to mind about it. [14:16] sinzui, could you please have a look at https://code.launchpad.net/~abentley/launchpad/merge-translation-script/+merge/49099 ? [14:16] allenap: because NewBuildersScanner doesn't update self.current_builders? [14:16] jml: That's the badger. [14:16] henninge: thanks, just checking my sanity. :) [14:16] * sinzui looks [14:17] allenap: I don't know of any production issues, but I guess I've just confirmed there's a logic bug in the code. [14:18] jtv: I don't see what you mentioned, though ... [14:18] jml: Okay, I'll file a bug. How would you triage it? I'm tempted to mark it critical. [14:18] allenap: urgh [14:18] jtv: can you paste the version of setSequence you are seeing? Or give me the revno? [14:18] henninge: there's a check for sequence >= 0 (which should always be the case), and then there's an else: pass. [14:18] allenap: I guess critical, but that's probably only because I'd just fix the bug :) [14:18] oh, that's what you meant [14:19] jml: Yeah, that was my plan too :) [14:19] allenap: critical [14:19] jtv: that's because our style guide used to require that else [14:19] sinzui, thanks. [14:19] henninge: it's not that—it's that there's an "elif" instead of an "else" in the first place. [14:20] jtv: hm, you mean that condition should be checked in an assert? [14:20] henninge: an "assert sequence >= 0" would have made more sense! Maybe this grew out of an "if sequence > 0" that then also absorbed the "sequence == 0" case. [14:21] has anyone managed to land anything via ec2 lately? [14:21] jtv: I agree [14:21] I'm on attempt #4 and it's still bloody failing in windmill [14:21] Thanks. [14:21] bigjools: I did, yesterday. [14:21] :/ [14:21] bigjools: I did run rocketfuel-setup first, IIRC, after hitting our windmill problem. [14:21] * henninge relocates [14:21] how does that affect ec2? [14:22] bigjools: newer AMI maybe [14:22] I don't know how those propagate. [14:23] it just picks up the latest automatically [14:23] abentley: r=me [14:23] sinzui, thanks. [14:23] actually, now it's showing connection refused errors in librarian tests [14:36] ec2 testing is about as reliable as a chocolate teapot lately. [14:37] and now bzr lp-land is crashing! I am doomed. [14:43] "about as reliable as a chocolate teapot [14:43] " [14:43] -> an analogy I would have never thought of [14:43] and like :-) === salgado is now known as salgado-lunch [14:44] gary_poster: the other one is a chocolate fireguard - fairly standard stuff this side of t'pond :) [14:45] deryck, https://code.launchpad.net/~abentley/launchpad/share-existing-packagings/+merge/49634 [14:46] bac: hey, the no-email-for-own-bug-actions is totally awesome [14:46] abentley, got it, thanks. Will review very shortly. [14:46] bigjools: yes. danilos and gary_poster did a great job. (i just got to announce it) [14:46] bigjools: and it was only six years in the making [14:46] is there a reason it wasn't done for questions? [14:47] bigjools: that is on our plate. look for it in 2017 [14:47] heh [14:48] heh [14:49] yeah, bac, danilos and gary_poster are to be praised for this work. many lp users will rejoice. [14:49] we're not worthy [14:49] * bigjools does the Wayne's World thing [14:50] * deryck joins in since it was time for a stretch break anyway [14:51] henninge: do you have time to review https://code.edge.launchpad.net/~sinzui/launchpad/packagebugs-search-0/+merge/49479 === jelmer_ is now known as jelmer [14:54] lol :-) [14:57] sinzui: r=me [14:58] thank you henninge === _starbuck is now known as _starbuck-lunch [15:10] henninge: Do you have time to review a fix for bug 718761? https://code.launchpad.net/~allenap/launchpad/new-builders-scanner-calm-down/+merge/49645 [15:10] <_mup_> Bug #718761: NewBuildersScanner schedules a new SlaveScanner every 5 minutes for new builders < https://launchpad.net/bugs/718761 > [15:11] allenap: I am currently looking at another review but will pick yours up right after that. [15:12] henninge: Thanks :) [15:12] hey all [15:12] did something break the API this morning? [15:12] i keep seeing this in tarmac: [15:12] NotImplementedError: Can't look up definition in another url (https://api.launchpad.net/1.0/#branch) [15:12] dobey: you're probably using edge, which is gone [15:13] leonardr: ^^ that URL doesn't have edge in it though... hrmm [15:14] dobey: edge redirects you to api.launchpad.net, but launchpadlib thinks it's using edge [15:14] it's telling you that api.edge.launchpad.net served it urls from another server (api.launchpad.net) === matsubara is now known as matsubara-lunch [15:28] is there a step in the nodowntime rollout process for marking "Fix committed" bugs as "Fix released"? [15:28] jml: i believe people have done that manually. [15:28] or did you mean in documentation? [15:29] bigjools, did you ever get past your windmill test failure? [15:29] I meant the latter but I would have tolerated being pleasantly surprised wrt automation :) [15:29] deryck: yes but I didn't change anything [15:29] I get other errors in ec2 now :/ [15:29] none of them to do with my branch of course, and since it was attempt #4 at ec2 I gave up and pqm-submitted it [15:30] bigjools, ah, ok. I've got a call and review and then can look to see if something stands out to me. [15:36] dobey: try this branch and see if it helps you https://code.launchpad.net/~leonardr/launchpadlib/fake-edge [15:39] henninge: would love a review of https://code.launchpad.net/~leonardr/launchpadlib/fake-edge/+merge/49651 [15:42] leonardr: i did this: https://code.launchpad.net/~dobey/tarmac/no-more-edge/+merge/49649 [15:43] dobey: you don't need to import lpnet_service_root, you can just use the string 'production' [15:43] but you have the right idea [15:43] similarly 'staging' [15:45] well i'd rather import the strings than using literals everywhere. [15:46] Project devel build (440): STILL FAILING in 5 hr 14 min: https://hudson.wedontsleep.org/job/devel/440/ [15:46] Launchpad Patch Queue Manager: [r=lifeless][ui=none][bug=607960] Permit turning targetnamecache off [15:46] via malone.disable_targetnamesearch feature flag. [15:46] dobey: those constants aren't relaly meant to be re-imported [15:46] maybe i should change them to be the strings [15:47] henninge, could we mumble about https://bugs.launchpad.net/launchpad/+bug/716586 ? [15:47] <_mup_> Bug #716586: Diverged translation cannot be converged again. < https://launchpad.net/bugs/716586 > [15:48] leonardr, abentley: otp atm [15:48] * jcsackett sighs. [15:48] local codehosting is not the easiest thing to get working. [15:48] henninge, oic [15:49] jcsackett, what problem are you having? [15:49] abentley: a general inability to push or pull branches to try and test mp stuff. [15:50] abentley: when i try to push, i get an error about needing to supply create-prefix. [15:50] when i try to pull, i get a NOT A BRANCH error. [15:50] i'm rebuilding something right now, when that's done i can supply you more specific errors. [15:50] jcsackett, are you running "make run_all"? [15:51] abentley: no, i was not aware of run_all. i take it that gets everything else up and running? [15:51] * jcsackett prepares to edit wiki page on development codehosting. [15:51] jcsackett, yes. "make run" doesn't start codehosting. [15:51] abentley: fantasitc. thanks. :-) [15:53] jcsackett, I've never used "make run_codehosting" like that page says, but I guess that works, too. [15:53] abentley: make run_codehosting wouldn't run for me, thus trying make run. [15:53] oddly, make run_all *is* working. i should find out why codehosting wasn't. [15:54] jcsackett, that would be very good to know. [15:54] * jcsackett nods. [15:54] thanks, again, abentley. this has gotten me past the current hurdle. :-) [15:54] jcsackett, np [15:58] jkakar, did you get anywhere with that ClassAlias issue? [16:00] abentley: Hey, sorry about that, the other day... I looked at it and then got distracted. [16:00] abentley: So yeah, I looked at it, but I don't understand why you want to use ClassAlias in that code... [16:00] abentley: It's usually useful when you self-join a table, which didn't seem to be the case, if I remember correctly. [16:01] abentley: Anyway, it did seem a touch odd that the ClassAlias wasn't being used, because I would expect it to be. [16:01] jkakar, I want to use the POTemplate table two ways: I want to find Products that link to POTemplates, and I want to find packages that link to POTemplates. === _starbuck-lunch is now known as _starbuck [16:02] abentley: Can you paste the query again, please? [16:04] jkakar, looking... [16:05] abentley: Ta. [16:05] jkakar, http://pastebin.ubuntu.com/565962/ [16:06] jkakar, the english version is "Find me packagings where the product and the sourcepackage each have POTemplates" [16:08] abentley: Hmm, are the POTemplates the same for a product and sourcepackage, or do products and sourcepackages each have their own POTemplate? [16:09] If they're not the same, I suspect you'll need to run two queries or use subselects or something. [16:09] jkakar, the products will have different POTemplates from the sourcepackages. === beuno is now known as beuno-lunch [16:10] abentley: In that case, I don't think the join you have here is going to work. [16:10] jkakar, The direct SQL works just fine. [16:10] abentley: The SQL that's generated at the bottom of the paste you mean? [16:10] jkakar, no, I wrote this as SQL first and got a losa to run it against staging. [16:11] jkakar, I'm trying to Stormify that sql. [16:11] abentley: Is that SQL at the bottom your hand-written working SQL or what's generated? If it's generated, can you paste the working SQL, please? [16:11] jkakar, that's the generated SQL. The SQL I want is: https://pastebin.canonical.com/43146/ [16:12] jml: yeah, needs love [16:12] jml: fixed! [16:13] joey: thanks :) [16:13] my pleasure [16:13] and you're very welcome [16:13] I have one action I can't do on -meeting so I had to mail off for a group request for that [16:14] henninge, ping me when you can chat. [16:16] abentley: now [16:16] ;-) [16:17] abentley: so i thought i had this working, but it turns out the pushing wasn't putting anything into launchpad.dev, but just pushing into my home directory on my machine. thoughts? [16:19] abentley: Hmm, my conversion of that SQL looks a bit different than yours: https://pastebin.canonical.com/43286/ [16:19] abentley: Does that work? [16:19] jcsackett, OTP [16:19] abentley: ah, sorry. === matsubara-lunch is now known as matsubara [16:20] abentley: https://translations.qastaging.launchpad.net/mailclipper/trunk/+pots/testcase/fr/+translate [16:20] sinzui: would your squad be able to finish up the two remaining High priority feature-flags bugs? [16:20] maybe [16:21] jkakar, I can try it, but shouldn't my version have generated a FROM statement with "AS" in it? [16:21] jml: I think the answer is yes. Looks like jcsackett and wgrant have booked their next few days. I will be taking a new bug in a few hours [16:21] sinzui: https://bugs.launchpad.net/launchpad/+bug/670019 and https://bugs.launchpad.net/launchpad/+bug/708999. [16:21] abentley: Yes, I'd expect that. I don't understand why that isn't happening. [16:21] <_mup_> Bug #670019: audit facility for feature flags < https://launchpad.net/bugs/670019 > [16:22] <_mup_> Bug #708999: code.branchmergequeue, code.incremental_diffs.enabled feature flags not documented < https://launchpad.net/bugs/708999 > [16:22] sinzui: thanks. [16:22] jkakar, okay, I'll file a bug then. [16:22] abentley: Thanks. [16:36] hi deryck [16:40] bac, hey [16:40] danilos: Hi there. Could you triage bug 714521 if possible? If I do it, it's likely to be a guess. [16:40] <_mup_> Bug #714521: Partial translation export feature gone < https://launchpad.net/bugs/714521 > [16:41] allenap, well, I wanted to leave it for deryck's team to triage, but considering it's a regression, I am sure it should be critical according to our 'regression' policies [16:42] danilos: Ah, yes :) I'm getting used to this slowly :) I'll update it. [16:43] allenap, it would be nice to get Henning's opinion as well, because he marked it as 'invalid' [16:44] Cool, I'm in favour of that. === henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews [16:46] can someone help me understand why bugattachment.data.open() seems to return a buffer with a read() method, as per the api documentation, but the open method in the LibraryFileAlias class doesn't return anything. [16:46] leonardr: I won't be able to look at your mp, I am sorry. [16:47] ok, i'm sure i can get someone to look at it since it's a partial solution to an active emergency [16:47] wgrant: Mind if I ask you about a build issue? I think bug 718790 is something the user can correct himself - i.e. avoid running javadoc on .class files - but I wanted a second opinion as I am not at all familiar with builds. [16:47] <_mup_> Bug #718790: FTBFS with java due to illegal characters < https://launchpad.net/bugs/718790 > [16:54] jkakar, filed as https://bugs.launchpad.net/storm/+bug/718864 [16:54] <_mup_> Bug #718864: ClassAlias does not generate AS in FROM clause < https://launchpad.net/bugs/718864 > === flacoste changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: API scripts talking to edge are broken | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews [16:58] henninge, if a suggestion is not diverged, there's no way of knowing whether it was suggested for upstream or ubuntu, right? [16:58] abentley: right, and suggestions can not be diverged anyway. [16:59] i.e. potemplate should only be not None if one (and only one) of the is_current_* flags is set. [17:00] henninge, thanks. [17:04] nevermind, folks, found answer in HostedFile in lazr.restfulclient [17:05] Off for a bit. Back later. === deryck is now known as deryck[lunch] === salgado-lunch is now known as salgado === flacoste changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews === beuno-lunch is now known as beuno [17:49] is there anyone who can help me understand PATCHPlugin in launchpad/javascript/client/client.js? [17:53] leonardr: I too seek enlightenment. [17:56] I, on the other hand, seek review: https://code.launchpad.net/~jtv/launchpad/bug-715854/+merge/49676 [17:56] Any takers? [17:57] jtv, i'll take it if you'll take https://code.launchpad.net/~leonardr/launchpadlib/fake-edge/+merge/49651 [17:58] leonardr: OK [18:01] leonardr: I wonder whether we ought to use the new LP import format for launchpadlib. [18:02] src/launchpadlib/launchpad.py: from launchpadlib.uris import STAGING_SERVICE_ROOT, EDGE_SERVICE_ROOT [18:05] leonardr: similar for the list constant in src/launchpadlib/tests/test_launchpad.py [18:11] moin [18:11] hi lifeless === deryck[lunch] is now known as deryck [18:12] jtv: i think i need to push a more recent version [18:13] yeah, you didn't have the version that included the deprecation warning. sorry about that [18:13] leonardr: it does have that [18:13] sorry, i meant... [18:13] the version that will give you a deprecation warning if you use EDGE_SERVICE_ROOT [18:13] it's a minor change [18:13] That's not in _dereference_alias? [18:14] i changed EDGE_SERVICE_ROOT to 'edge' [18:14] Ah [18:14] which will trigger the warning when it goes into _dereference_alias [18:14] as opposed to 'production' [18:14] right. it'll get converted to production after the warning [18:14] I see [18:15] leonardr: my one gripe is with the test. It seems to test multiple things at once: [18:15] * Looking up edge on the web service gives you production. [18:16] * A web lookup for edge also gives you production. [18:16] * Exactly one of these gives the warning. [18:16] well, that's easy to fix [18:16] Nobody said it had to be hard. :) [18:20] jtv: problem with catching the warning. the warning only happens once, and i don't know how to guarantee which test it happens in [18:20] surprising… why is that? [18:21] ordinarily a deprecation warning only happens the first time you do the deprecated thing [18:21] I would maybe the first… [18:21] * leonardr rereads the module doc [18:21] I would _have expected_ maybe the first. [18:22] it's not [18:24] Then can you guarantee that this test won't fail arbitrarily, e.g. when run in combination with specific other tests? [18:25] Arrgh, I have to go. [18:26] jtv: pushed a new revision that should please you [18:26] i'll take a look at your branch now [18:26] cool, thanks [18:31] lifeless, stub still needs to sign off on database reviews, right? [18:31] yes [18:31] https://dev.launchpad.net/PolicyAndProcess/DatabaseSchemaChangesProcess [18:31] both of us need a db review requested [18:32] jtv: reading your mp i kind of get what's going on but i don't know what a file reference actually is. is that the file in which a translatable string occurs? [18:33] lifeless, could not find that page on dev.launchpad.net. [18:33] leonardr: yes, the place in the project's source tree where it's found. [18:33] (I had that in the MP at one point but must have taken it out again) [18:33] abentley: I find it from the policy and process list when I need to [18:33] lifeless, I mean it's there if you know the URL, but not linked to in https://dev.launchpad.net/PatchSubmission or anything. [18:34] leonardr: I'm done with yours. Have to run now! [18:34] abentley: ah, it probably needs to be referenced === jtv is now known as jtv-afk === matsubara is now known as matsubara-afk [19:18] statik: hi [19:22] I can has review? https://code.launchpad.net/~lifeless/launchpad/bug-704446/+merge/49580 [19:43] lifeless, have a moment to talk? [19:43] regarding the revision that had to be rolledback? [19:45] sure [19:45] irc/voice? [19:45] uh, voice might well be easier. [19:45] mumble or skype? [19:45] s [19:47] whats yoiur skype id? [19:47] lifeless: j.c.sackett [19:47] i'm online now. [19:47] durham ? === jam1 is now known as jam [20:39] leonardr: http://code.google.com/p/httplib2/issues/detail?id=97 ! cool. [20:40] yay [20:42] nice [20:42] nasty bug there [20:42] morning [20:44] deryck: ping [20:54] lifeless: I just got rejection emails for proposals against loggerhead trunk... [20:55] Is there any context I can give you that will help? [20:55] (emails, merge proposal, etc.?) [20:57] jam: what mail was rejected? [20:57] jam: as in the address that was sent to [20:57] lifeless: one was a new merge proposal, one was a comment follow up to an existing proposal [20:58] lifeless: the rejection message was: From: launchpad-bugs-owner@lists.canonical.com [20:58] So I assume launchpad-bugs@lists.canonical.com [20:58] Project devel build (441): STILL FAILING in 5 hr 12 min: https://hudson.wedontsleep.org/job/devel/441/ [20:58] Launchpad Patch Queue Manager: [r=adeuring][bug=631206] Make Builder:+history load in 2 seconds [20:58] instead of timing out. [20:59] lifeless: digging into the content, it looks like it was actually launchpad-bugs@lists.ubuntu.com that it was getting sent to [20:59] (From an old Received: line) [21:03] ok thats ~launchpad [21:03] you proposed to trunk yea? [21:03] flacoste: hi [21:03] hi lifeless [21:03] we up ? [21:03] i'm ready for our call [21:04] leonardr: mumble? [21:04] thumper, i'm on it [21:10] lifeless: yes, this is to lp:loggerhead [21:11] https://code.launchpad.net/~thumper/launchpad/daily-ajax/+merge/49295 [21:18] flacoste: https://devpad.canonical.com/~lpqateam/ppr/lpnet/latest-daily-categories.html [21:20] lifeless: should I be adding sinzui to my loggerhead request-for-review for the ui stuff? [21:20] or should I be targetting ~loggerhead-team and asking for ui, or how is that done? [21:20] jam: generally ask here [21:20] jam: I suggeset huwshimi, who is tasked with making loggerhead look more like lp, and sinzui [21:21] lets give huwshimi a go first [21:21] huwshimi and sinzui: https://code.launchpad.net/~jameinel/loggerhead/revert-colors/+merge/49705 is the link [21:21] sinzui: fine with me, just making sure I conformed to whatever protocol is applicable [21:26] why is the person picker showing me a non-active user? [21:31] huwshimi: care to join me on mumble? [21:31] jml: Sure [21:33] ... or not. I can't seem to sign on. [21:33] hello jml, huwshimi, leonardr, all [21:33] jml: You look online to me now [21:33] poolie: hello [21:33] poolie: Morning [21:33] can i have a mini-preimpl discussion on https://bugs.launchpad.net/launchpad/+bug/643224 [21:33] <_mup_> Bug #643224: dkim whitelist should be in configuration < https://launchpad.net/bugs/643224 > [21:33] huwshimi: skyping you instead [21:34] specifically as to whether the the approach described is ok [21:37] leonardr: how do I change an exposed method so it doesn't appear in 'devel' api? [21:38] leonardr: I've changed the setRecipeText from being a callable method to being a mutator on recipe_text [21:38] leonardr: also, do I need to annotate the new mutator in any way to make it say devel only? [21:38] lifeless, can you have a quick glance at 643224? [21:38] thumper: put @operation_removed_in_version("devel") at the top of the annotations [21:38] leonardr: I'm not entirely clear on this point [21:39] leonardr: ok [21:39] you don't need to annotate the mutator because there is no preexisting code that will break now that this field can be edited [21:40] ok [21:40] i think you can make that work if you really want to, but i don't remember how--i think you would use operation_for_version [21:41] leonardr: is a mutator a write_operation? [21:42] leonardr: or more specifically, do I need @export_write_operation as well as @mutator_for ? [21:43] thumper: yes, you define a write operation and _then_ make it a mutator [21:43] so if you want it to be a mutator in one version and not another, you would define it in the earlier version, then put @operation_for_version() on top, and put @mutator_for on top of that [21:44] allenap: There are probably better people at 4am, but sure. [21:46] leonardr: I'm just pushing a change, then I'll get you to look at the diff, and how I've done it to see if there is a more sane way [21:46] ok, i'll take a look [21:59] huwshimi: http://www.ubuntu.com/community [22:02] leonardr: line 196(ish) of https://code.launchpad.net/~thumper/launchpad/recipe-inline-edit-recipe-text/+merge/49585 [22:06] thumper: you might not need two different methods. try putting @operation_for_version("devel") right on top of @operation_removed_in_version("devel") [22:06] leonardr: what of the mutator? [22:06] leonardr: it seems a bit weird to stack them like this [22:07] leonardr, re your comment about LPNET_SERVICE_ROOT='production' [22:07] thumper: @operation_removed_in_version basically clears the slate. you can start from scratch on top of it [22:08] leonardr: do the annotations work from the outside in, or the inside out? [22:09] thumper: they work from bottom to top [22:09] the only restriction is you can't put an older version on top of a newer version [22:10] leonardr: do I need two @export_write_operations ? [22:10] thumper: yeah, you have to start all over [22:10] including the parameters, i think [22:11] leonardr: so if I'm starting over, why do I need the @operation_for_version("devel") ? [22:11] isn't that the default? [22:11] as I don't need it for the current one [22:11] thumper: you might not need it. i'd put it in just to make it clear that you're reinstating it for devel [22:11] hmm.... ok, let me try === salgado is now known as salgado-afk === leonardr is now known as leonardr-afk [22:21] well... it works [22:22] ok, if you can do without two methods i think that's better (although you could argue two methods is actually more readable) [22:22] but i think if you do it with one method you should explicitly state @operation_for_version as a way of signalling its return [22:23] sinzui: https://code.launchpad.net/~wgrant/launchpad/icing-purge/+merge/49590 seems like your sort of thing. Could you take a moment to review it? [22:23] leonardr-afk: yep, I've done that [22:23] wgrant: I will [22:23] lifeless: any chance you could teddy bear on ideas for diagnosing the file handle leak issue? https://bugs.launchpad.net/launchpad/+bug/717345 [22:23] <_mup_> Bug #717345: Updates to SFTP server leak file handles in use_forking_server mode < https://launchpad.net/bugs/717345 > [22:23] I just ran hammer-ssh with 200-way concurrency [22:23] sinzui: THanks. [22:24] and got 186 concurrent connections for 60s [22:24] without falling over anywhere [22:24] at least that I can see [22:24] a bit hard to check every one of 2k connections [22:24] jam: You were requesting a smartserver on every connection? [22:25] wgrant: yep [22:25] wgrant: 'echo hello' which is the cheapest request we have [22:25] but still the full stack [22:25] :( [22:27] wgrant: and running locally, and running 'lsof' while connecting and afterwards shows 0 stale handles, etc. [22:28] jam: :(er [22:28] yep [22:28] g'night all [22:28] It sounds like productions children must just not be dying :/ [22:28] so apparently qastaging and dev is immune from whatever was killing production... [22:28] now, I'm not triggering failures, and some other stuff, which I can try to inject [22:28] but something really smells here [22:29] g'night all. [22:29] wgrant: and I just checked again, all of those spawned connections return a valid response [22:30] so not only is it connecting, the requests are getting through and responded to [22:32] I could try changing the test script to actually do something more than just 'hello', but I'm not sure what that would tell me yet [22:34] jam: sure [22:37] jam: did you want voice or irc? [22:40] lifeless: irc is ok. I'm not sure what else to fill in just yet, other than what I mentioned above to wgrant. I'm trying to redo the hammer_ssh script a bit to do more actions per connection [22:40] jam: one possibility is expensive queries and then detach [22:40] jam: you thought error cases might be important too [22:41] jam: also on loggerhead, both sinzui and huwshimi are online know, if you want to mention the theme thing to them. [22:42] lifeless: detach? meaning disconnect, or do you mean run in the background? [22:42] disconnect [22:44] huwshimi: sinzui: bug 718968 [22:44] <_mup_> Bug #718968: trunk should use old trunk color scheme < https://launchpad.net/bugs/718968 > [22:47] jam: I've commented on the bug too, fwiw [22:48] lifeless: I ran 300, and it only got 1900 connections total [22:48] so I think I'm hitting a cpu bottleneck with the ssh handshake [22:48] jcsackett: So, what's youre codehosting issue? [22:50] jam: it has a fd limit of 1024 [22:50] jam: so wouldn't expect it to get passt 255 concurrent [22:50] lifeless: sure [22:51] well, theoretically 341 [22:51] (1024/3) [22:51] jam: Plus the SSH FD. [22:51] wgrant: broadly, it doesn't work. more specifically, when make run_all or make run_codehosting, i can neither push branches too, nor get branches from lp.dev [22:51] jam: network, in, out, err == 4 [22:51] wgrant: right [22:51] jcsackett: Sounds like you need SSH config. Have you run utilities/make-lp-user? [22:51] lifeless: right, and I'm guessing I'm currently bottlenecked on "network" only [22:51] wgrant: i have. [22:51] which is why I'm trying to set the connection to do a bit more before it exits [22:52] though now after a couple secs it hangs waiting for a child to exit. but I'll work on that [22:52] i'm not sure it's ssh; the error i get when pushing is that a path or parent directory doesn't exist. [22:52] jcsackett: http://paste.ubuntu.com/567140/ is what I have in my ~/.ssh/config. [22:52] jcsackett: replace ppa-user with the username you gave to make-lp-user. [22:52] jcsackett: It is probably SSH. It's connecting to your system sshd instead of the LP one. [22:53] wgrant: ah, that makes sense. [22:53] trying that now. [22:55] jam: In regards to the colours in loggerhead and making it themeable, I'm in the process of skinning LH so that it looks like launchpad. Whatever we do we should make it easy to maintain different themes for LH vanilla and LH Launchpad or make them the same. [22:55] wgrant: http://paste.ubuntu.com/567142/ [22:55] huwshimi: atm, I'm just proxying for max kanat-alexander, who was the one that preferred the old default theme (non-lp) [22:56] and beuno who was the one that said they were requested that the themes look different [22:56] wgrant: on the plus side, that is a *different* error, which frequently implies progress. :-P [22:56] jam: In that case making it themeable might be a good way to go, right? [22:57] huwshimi: themeable would be great [22:57] and a good answer for the bug [22:57] but far outside of my scope :) [22:57] jam: ok sure. [23:00] jcsackett: Ah, you need the forking service now. [23:00] jcsackett: Or to disable the forking service. [23:01] wgrant: ? [23:01] jcsackett: Set use_forking_daemon to False in the development config. [23:01] This is the new thing that jam is debugging. [23:02] wgrant: I doubt that is the failure, but hey, eliminate variables all you want :) [23:03] note the IP address is also custom [23:03] specifically 127.0.0.88 or something like that [23:03] jam: Does run_codehosting start the forking service now? [23:03] wgrant: yep [23:03] Oh :( [23:03] otherwise it wouldn't work :) [23:03] It wouldn't be the first time that development codehosting didn't work :) [23:04] jam: huwshimi: I might have a quick chat to poolie about the theme [23:04] lifeless: fine with me, time for me to EOD [23:04] jam: kk [23:06] lifeless: Did your testfix make it through? [23:06] I don't see it. [23:07] wgrant: we may have success. no error msgs on the push, i'm syncing branches and checking the web interface. [23:07] jcsackett: Excellent. [23:07] * wgrant works out why it didn't work. [23:08] wgrant r=me [23:08] wgrant: looks like that was it. [23:08] thanks! [23:08] sinzui: Thanks. [23:08] sinzui: I wanted you to look over it because I thought you might have left them for a reason last time. [23:09] jcsackett: Great, [23:09] wgrant: I remarked that something was using the translate button a few months ago, well maybe 6 months ago [23:15] jcsackett: Odd. It works fine for me locally with the forking service. [23:15] wgrant: huh, let me see [23:16] lifeless: I bet you forgot [testfix] [23:16] But PQM should have mailed you :) [23:17] Ooooh, sub-second local LP pushes with the forking service. [23:17] beuno: hey, on bug 718968 - question for you [23:17] <_mup_> Bug #718968: trunk should use old trunk color scheme < https://launchpad.net/bugs/718968 > [23:17] That is awesome. [23:17] wgrant: I put the testfix at the end [23:17] silly regeex ordering [23:17] jcsackett: Is there a launchpad-forking-service running? [23:17] lifeless: Hah. [23:18] resubbing in a sec [23:18] Thanks. [23:18] Test runs with that breakage are valid, but have 4 errors? [23:18] yes [23:19] Great. [23:22] wgrant: so, staging appears to have restored successfully; how are you estimating its age ? [23:24] lifeless: I normally look for when the stream of new bugs finished. [23:24] As long as bugs.staging.launchpad.net doesn't time out... [23:24] Which it does. [23:25] Ah, there we are. [23:25] Doesn't look very restored. [23:26] Where is staging-restore.sh? [23:26] I can't find it in any of the usual places. [23:26] It restored fine on the 5th. It should have presumably restored again on the 12th, but I wonder if it didn't do it because there was no new rev to update to. [23:28] I got the restore log 2 days back [23:29] You mean the cronspam? [23:29] That it sends every time it updates? [23:32] lifeless: https://pastebin.canonical.com/43311/ [23:32] It always restores on a Saturday. This time it did not. [23:32] Perhaps a backup was missed due to the rollout. [23:32] Or something like that. [23:34] ah yesm wrong ting [23:34] staging_restore.sh does not always restore staging :( [23:35] LOSA ping. [23:41] yo === spm` is now known as spm [23:43] spm: What is in sourcherry:/srv/staging.launchpad.net/dumps_from_prod/? [23:45] lifeless, hey, will look in a bit [23:45] are you trying to determine what's up wit hthe staging restore? [23:45] spm: Yes. [23:45] Last weekend's did not. [23:45] * beuno replies [23:46] there's nothing helpful in the staging restore email? [23:46] Config schemas with production database servers referenced: Australia says argh [23:47] spm: The emails are not useful. [23:47] The logs on carob only report when a new backup is found. [23:47] So all the information I have is that it finds a new backup every Saturday except the last one. [23:49] 2011-02-09 06:38 & 2011-02-14 06:35 <== no restore [23:50] oh I wonder. possibly the rollout on friday night may have messed things up there. [23:50] spm: are you able to trigger a qastaging restore ? [23:50] sure [23:50] spm: That was my suspicion. [23:50] ssh: connect to host bazaar.launchpad.net port 22: Connection refused [23:50] lifeless: as in a DB restore (to confirm) [23:50] spm: yes [23:50] lifeless: Again? :/ [23:50] lifeless: Still works fine from here. [23:50] wgrant: may be intermittent [23:51] Well, it's happening from at least two places, so I guess we have to investigate... [23:52] erm. is tehre a reason we'd have 49 x /usr/bin/python2.6 /srv/bazaar.launchpad.net/production/launchpad-rev-12351/eggs/bzr-2.2.2_lp_2-py2.6-linux-x86_64.egg/EGG-INFO/scripts/bzr launchpad-forking-service --path /srv/bazaar.launchpad.net/var/launchpad_forking_service.socket --pid-file /srv/bazaar.launchpad.net/var/launchpad_forking_service.pid [23:52] all dating from Feb 11. [23:52] Are they all from Friday? [23:52] Yeah. [23:52] Kill them all. [23:52] I said the process count was infalted. [23:52] ta [23:52] But nobody mentioned those :/ [23:52] Actually. [23:52] If you haven't killed them all. [23:53] Maybe keep a couple around. [23:53] jam might like to investigate. [23:53] spm: (yes to db restore of qastaging) [23:53] Although that's not enough to cause much of a problem. [23:56] #44028 [23:56] <_mup_> Bug #44028: cups reports "printer fault" and refuses to print < https://launchpad.net/bugs/44028 > [23:56] Er. ECHAN, but yeah.