/srv/irclogs.ubuntu.com/2011/02/14/#launchpad-dev.txt

huwshimiDo we use the main loggerhead branch in launchpad? Do we make any modifications to the template or is it just a vanilla deploy?00:32
lifelesshuwshimi: no, yes00:33
lifelesshuwshimi: I want yours and sinzuis opinion on this actually00:33
lifelessI'd love it if we used releases without modifications, and did our tweaks outside the loggerhead tree00:33
lifelesshuwshimi: theres a merge proposal / bug that shows the upstream loggerhead theme, and ours.00:35
lifelesshuwshimi: do we need a custom theme, or perhaps we should just run the original - thats even simpler than doing some custom css for it in our tree and glueing them together.00:36
huwshimilifeless: Do you know which bug that is?00:37
lifelessnot offhand00:37
lifelessstart with launchpad-project/+activereviews00:37
lifelessfollow the loggerhead mps, you'll find it pretty quickly00:37
huwshimilifeless: I don't really know the history of loggerhead. Is it mostly just a launchpad project and therefore we can do what we like with the main branch?00:38
lifelessno00:38
lifelessits a bzr community project we earnt commit rights too00:38
lifelessand was then abandoned upstream, so was adopted by mwhudson/lp-code for a while00:38
lifelessthen he left and they lost cycles00:38
lifelessmost recently, flacoste, poolie and I agreed that the LP team will maintain it, as we maintain lazr-js etc00:39
lifelesswhich means:00:39
lifeless - do the right thing for it00:39
lifeless - fix bugs affecting us in sensible ways00:39
lifeless - do code review and bug triage for contributions by other users, whatever the their purpose00:39
huwshimilifeless: OK, so I've been tasked with making it look like Launchpad. Somehow I need to do that in a way that is maintainable.00:42
lifelesshuwshimi: interesting, cool.00:44
lifelesshuwshimi: so, we *could* change trunk to look like LP00:44
lifelesshuwshimi: but if we do that, we should still keep it looking and feeling nice for standalone users.00:44
pooliehi lifeless00:44
pooliere removing the oauth.py copy and using the system one instead:00:45
lifelesshuwshimi: And we'd not want to have assests that prevent it being easily deployed.00:45
lifelesshuwshimi: we can definitely add dependencies on this that LP also uses if that helps00:45
lifelesshuwshimi: we can also make it more modular/pluggable and change out integration glue00:46
pooliedo you know how i persuade buildout to import oauth from the system pythonpath, rather than trying to get it from an egg?00:46
lifelesspoolie: it should just do it; make sure to remove the existing egg and tarball00:47
huwshimilifeless: If it is a separate entity it probably shouldn't change design every time LP does. But having said that if it is our devs doing all the work then they would have to maintain two sets of templates/css.00:47
lifelesshuwshimi: it is our devs00:47
pooliehm apparently not http://pastebin.ubuntu.com/566810/00:48
pooliemaybe there's still something cached somewhere that makes it think so?00:48
huwshimilifeless: So doing it in trunk means less work, but means we can't have any LP specific stuff right?00:49
lifelessdid you delete the eggs/oauth* dirs ?00:49
wgrantpoolie: Ah, give up now.00:49
wgrantYou have to use the egg.00:50
wgrantSince our other eggs require it.00:50
lifelesswgrant: EWHAT00:50
wgrantAh, lazr.restfulclient doesn't actually require a particular version.00:50
wgrantSo you may be able to make it happy with the system version.00:51
lifelesshuwshimi: so, the constraint is 'trunk must still be a viable standalone code browser'00:51
lifelesshuwshimi: that doesn't mean 'no lp stuff' but its likely easiest to frame it that way00:51
lifelesshuwshimi: *however* we can quite straightforwardly make hook points that our glue in lib/launchpad_loggerhead uses to combine with the generic stuff in trunk00:52
wgrantpoolie: Perhaps try lifeless' suggestion of removing the built eggs. But I don't like your chances; I've given up trying to fix things like this before.00:52
lifelesshuwshimi: that is a little more engineering, but certainly not twice.00:53
huwshimilifeless: How does this decision get made?00:54
pooliewgrant, thanks for the advice00:54
lifelesshuwshimi: engineers doing the work00:54
poolieseeing as it's only removal of cruft my perseverence is not going to be very high00:54
poolieit's just a principle thing00:54
wgrantHeh.00:55
wgrantbuildout gets a bit messy sometimes :/00:55
thumperwgrant: hey00:57
thumperwgrant: I'm going through your review comments00:57
thumperwgrant: it isn't very easy to use the same text in the initial form00:57
thumperwgrant: I have changed to "Built daily" rather than "Build daily" though00:57
wgrantthumper: Hmm.00:59
wgrantI still do not like the two completely different UIs.00:59
thumperwgrant: the original form had "Built daily" with a checkbox00:59
thumperwgrant: it was changed to make it more descriptive00:59
thumperwgrant: I suppose we could change it back and add the help link01:00
thumperwgrant: what do you think?01:00
wgrantthumper: I think that would be best.01:00
* thumper goes to poke the code01:00
wgrantExcept in that case it could possibly be better as "Build daily"01:01
wgrantWe have no definition that I can see for the style of checkbox labels.01:01
thumperwgrant: what do you mean?01:03
thumper:(01:05
thumpernot a fan of the boring grey titles01:05
wgrantthumper: Some of our checkbox labels are imperative, others indicative.01:06
wgrantIt makes me sad.01:06
poolieturning into mpt?01:06
pooliewbn to have a style guide for that01:06
thumpersomeone needs to make sure we're consistent01:06
thumperI think we did have a style for it01:06
* thumper goes to look01:06
wgrantUhoh.01:07
wgrantDebian is considering source-only uploads again.01:07
thumperwgrant: what is the impact of that?01:08
wgrantthumper: Flamewars, probably.01:08
wgrantUbuntu has mandated source-only uploads from day 1.01:08
wgrantSomeone in Debian proposes it every so often.01:08
wgrantBut it inevitably gets nowhere.01:09
wgrantBesides massive threads.01:09
thumperwgrant: https://dev.launchpad.net/UserInterfaceWording is the page, feel free to edit01:09
wgrantthumper: It's not very thorough, unfortunately.01:10
wgrantWe need UI review :(01:10
wgranteg. http://blog.launchpad.net/01:10
pooliei get the same problem even with my entire egg directory deleted01:10
wgrantLook at that first image.01:10
wgrantpoolie: What if you remove the egg from download-cache?01:10
pooliefor oauth?01:11
wgrantYeah.01:11
pooliei think i already did that01:11
wgrantSo buildout cannot find it.01:11
pooliehm, maybe not01:11
pooliewgrant, the full stop at the end of the line?01:12
wgrantpoolie: Yes.01:12
wgrantThey are little things.01:13
pooliewith the ironic red arrow?01:13
wgrantBut they make the UI look far more awful than it actually is.01:13
pooliei think we need ui review in the sense that everybody checks for it01:14
wgrantIndeed.01:14
pooliealso, how ironic to get so many mp reviews about missing full stops in comments, and for this to get through in the ui01:14
wgrantHeh.01:14
pooliethis may be an instance of a kind of thing that is easier to spot in review in a screenshot01:15
poolieor maybe not01:15
pooliebut the punctuation perhaps stands out more from the code punctuation there01:16
wgrantApparently not.01:16
wgrantBecause there is a screenshot.01:16
poolieon the mp?01:16
poolieah :)01:16
wgrantI'm not sure if there was one there.01:16
wgrantthumper: What's the easiest way to force failed scans to be retried?01:17
thumperwgrant: lock and unlock the branch01:17
wgrantthumper: There are a few hundred.01:17
wgrantIs that still the easiest way?01:17
thumperwgrant: I have a simple plugin that allows me to do that01:17
thumperum...01:17
thumperwhy did they fail?01:17
wgrantThis is from the package-import incident last week.01:17
wgrantWhich exposed the bzr stacking bug.01:17
poolieok, even with the download cache and all the eggs deleted, it still fails with "We have no distributions for oauth that satisfies 'oauth'"01:18
lifelessthere is an API to force a scan isn't there ?01:18
pooliei looked for buildout documentation about this but i couldn't find any01:18
wgrantlifeless: Does requestMirror still work?01:18
wgrantI don't really recall.01:18
lifelesspoolie: is this in a clean tree ?01:18
thumperwgrant: if you want to use launchpadlib, I think there is a method01:19
thumperno, requestMirror doesn't work01:19
wgrant:(01:19
poolielifeless, as in ' make clean'd tree?01:20
lifelessno, as in freshly branched01:20
lifelessor bzr remove-tree and then checkout again, kindof thing01:20
thumperwgrant: it is the branchChanged method, which is triggered by the unlock code01:20
thumperwgrant: and nothing is exposed over the api01:20
lifelesspoolie: I think you're well past diminishing returns01:20
thumperwgrant: what I did was to get a list of the failed branches, and wrote a bash loop to process them with 'bzr rescan'01:21
thumperwgrant: which takes advantage of my bzr-expert privileges01:21
wgrantYeah.01:21
wgrantCan I give you a list of branches?01:21
thumperwgrant: sure01:22
thumperwgrant: pastebin?01:22
wgrantpoolie: Could you requeue the top p-i failure? 92 packages failed due to some unidentified librarian breakage for ~20 minutes yesterday.01:22
wgrantthumper: Gimme a sec.01:22
wgrantHopefully I can grep it out.01:22
poolielifeless, you mean well past this being sufficiently easy to clean up that it's worth doing?01:24
pooliei agree01:24
lifelessyes01:24
poolieregretfully01:24
poolieok01:24
pooliei shall abandon it and explain where i got to01:24
pooliepisses me off to have it be so hard to remove copy and paste though01:26
lifelessagreed01:26
pooliebut, i shall be po'd about something more important01:26
lifelessthis is the problem with having 4 different dep systems in play01:27
pooliewgrant, will do01:27
poolieright01:27
pooliewgrant, actually for the sake of proceeding towards handoff, let's ask a losa (spm?) to do it instead, and i'll help01:27
wgrantpoolie: I would, except spm seems to be even more excessively busy than normal.01:27
lifelessu1 melted down in the weekend01:27
wgrantAgain.01:28
lifelessno01:28
lifelessuniquely01:28
wgrantOh.01:28
wgrantAwesome.01:28
pooliei came in this morning to have all my tomboy notes conflicted01:28
lifelessI doubt he'll have time for anterior irritation amelioration today01:28
lifelessor posterior :P01:29
pooliewgrant, hm, so that's kind of a problem if we're not going to be able to do it without them in future01:32
poolieanyhow01:32
wgrantpoolie: Well, we are getting lots of new LOSAs :)01:33
poolieindeed01:33
pooliethat's 92 packages failed with key bzrlib.errors.InvalidHttpResponse01:33
poolieis this a bug for it?01:33
pooliei guess it was just an lp operational glitch?01:34
wgrantThe librarian was half-broken for a while.01:34
pooliemaybe udd should retry it01:34
wgrantNo idea why.01:34
wgrantRIght.01:34
wgrantI'd requeue_package --auto it01:34
maxbSourceforge have fixed their svn ssl cert, happily01:38
* maxb is restarting imports01:38
pooliehttps://bugs.launchpad.net/udd/+bug/71848301:42
_mup_Bug #718483: should delay and retry on http 503 from librarian <Ubuntu Distributed Development:Triaged> < https://launchpad.net/bugs/718483 >01:42
poolieoh, will --auto be enough maybe?01:43
wgrantI think so.01:43
poolieok done01:45
wgrantthumper: http://paste.ubuntu.com/566819/ should be most of them.01:45
thumperwgrant: http://people.canonical.com/~tim/new-recipe-built-daily.png01:45
wgrantthumper: I'm not sure if the (?) belongs on the title or description. But that looks fine.01:46
wgrantConsistency in terminology is the main thing.01:47
thumperok01:48
thumperhmm... almost time to collect mini-mes01:49
lifelessgrah02:10
lifelessthese bug search pages are scary messy02:10
wgrantThe code behind them?02:21
lifelessthe structure & code02:21
lifelessbug 71739402:21
_mup_Bug #717394: Distribution:+bugs timeouts <timeout> <Launchpad itself:Triaged> < https://launchpad.net/bugs/717394 >02:21
lifeless3.5 seconds overhead on every ubuntu bug search, the results are effectively constant02:22
wgrantthumper: Did you have any luck with rescanning those branches?02:25
thumperwgrant: yep, over 100 triggered so far02:25
thumperit is a little slow as there are 14 vfs calls02:25
wgrantOuch.02:25
wgrantThanks.02:25
thumperwgrant: all rescans initiated02:44
pooliewgrant, re your comment on bug 71617502:45
_mup_Bug #716175: api calls fail while launchpad is readonly <Launchpad itself:Triaged> < https://launchpad.net/bugs/716175 >02:45
poolie(i ask only for my education; i'm happy to leave it low)02:45
pooliethe "consumer check" is to do with the oauth validation?02:45
wgrantpoolie: Yes.02:45
wgrantEven for anonymous requests it does a consumer lookup.02:46
poolieis this the kludge that we create a temporary login for anonymous requests?02:46
wgrantPossibly to allow us to blacklist.02:46
pooliewhy does it do that?02:46
wgrantSo we can kill off misbehaving applications, I guess.02:47
LPCIBotYippie, build fixed!02:54
LPCIBotProject db-devel build (363): FIXED in 5 hr 41 min: https://hudson.wedontsleep.org/job/db-devel/363/02:54
wgrantthumper: Still around?03:38
lifelesswe have a very spec compliant oauth implementation03:39
lifelessthe standard solves problems we don't have03:39
wgrantOh?03:39
lifelessyou can do a much more direct solution to the 'hand out a cookie to login a client' problem03:40
lifelessdoing nonces in a layer on top of http is rather gruesome03:41
wgrantArchive:+index is looking reasonably healthy now.03:44
wgrantMight almost deserve to have its timeout override removed.03:44
wgranthuwshimi: Do you have a plan for desaturating the buttons?03:56
wgrantThere are still 1.0-style large buttons around in the facet colours.03:56
wgrantThey have been deprecated for years, but are still used.03:56
huwshimiwgrant: Where abouts are they?03:56
wgrantHmm. They're in the facet colours, but they don't seem to all correspond to the relevant facet. https://code.staging.launchpad.net/ has a few.03:58
huwshimiwgrant: Ah yes;03:58
wgrantThey look very odd now that everything else is grayscale.03:58
huwshimiwgrant: Well not *everything* is greyscale :)03:59
wgrantAhhh, they actually are app colours.03:59
wgrantBut Code uses them inappropriately.03:59
huwshimiwgrant: but yes, they do need some love03:59
wgrantThere are 6 left.03:59
wgrantTime for another icing purge, I think.04:02
lifelesswgrant: so where is your target brnach?04:08
wgrantlifeless: https://code.launchpad.net/~wgrant/launchpad/stop-using-targetnamecache04:10
wgrantBut alone it is not enough to disable the script, unless we want to take it out temporarily and hope that nobody notices sort drift while my rewrite makes it through the system.04:10
wgrantWow, Distribution:+search is quite a piece of work.04:21
lifelesswhats the name of the feature flag context manager04:29
wgrantI only know of FeatureFixture.04:31
wgrantthumper: When you're back, could you try rescanning one of the branches, to check that our DB purge worked?04:33
* lifeless does a naughty04:53
pooliewgrant, that's the only contextmgr i know of too04:53
pooliewallyworld, it seems to me there's a bit of a split here (in qatagger) between04:54
poolietrying to get the right accurate model, which probably requires adding features to lp04:54
wgranthttps://lpstats.canonical.com/graphs/LaunchpadOpenBugs/20100215/20110215/ says launchpad has like 9600 bugs open.04:54
wgranthttps://bugs.launchpad.net/launchpad says 5800.04:54
poolievs just something pragmatic that people can use04:55
lifelesswgrant: heh04:55
pooliewgrant, one difference, though I don't know if it would account for all of them, is that lpstats tends to include private bugs04:55
lifelesswgrant: also, https://bugs.launchpad.net/launchpad-project is what we need to look at.04:55
poolieeven private bugs nobody on the team can see04:55
wgrantlifeless: I know, but that's only 1000 more.04:55
wallyworldpoolie: sorry to cut you off - i am just going to get Lachie from school - running late. i'll talk to you when i'm back04:55
poolienp, no rush04:55
wgrantAh04:57
wgrantDoes not exclude dupes.04:57
wgrantpoolie: What's happening with the forking debugging?05:00
wgrantDo we know what's happening, or should I land the cowboy to turn it off?05:00
wgrantWho moderates blog comments? There are a couple waiting, and I'm wondering if I should approve them as I see them.05:09
LPCIBotYippie, build fixed!05:09
LPCIBotProject devel build (438): FIXED in 5 hr 40 min: https://hudson.wedontsleep.org/job/devel/438/05:09
pooliewgrant, i can moderate them05:18
poolieyou should be able to too?05:18
pooliewgrant, i presume jam is going to look at the data on the bug, if any05:19
wgrantpoolie: I can, but I wonder if I should.05:19
poolietoo late!05:19
pooliebut, generally05:20
pooliethey were obviously not spam05:20
pooliei don't see any benefit in sitting on them05:20
poolieif in doubt about the policy, talk to someone else05:20
pooliei think the more we post the better05:20
thumperwgrant: which one05:20
wgrantthumper: Any of them.05:20
wgrantthumper: They all failed again.05:20
thumper:(05:20
wgrantthumper: Bug #71851105:21
_mup_Bug #718511: Failed initial scans require manual cleanup <branch-scanner> <Launchpad itself:Triaged> < https://launchpad.net/bugs/718511 >05:21
thumperwhat cleanup?05:21
wgrantpoolie: I agree.05:21
wgrantthumper: Deleting the branchrevisions.05:21
wgrantWhich we have done.05:21
thumperwgrant: lp:debian/wheezy/php-xml-htmlsax305:21
wgrantThanks.05:22
* thumper has to make dinner for hungry munchkins05:22
thumperwgrant: if you want the rest poked, let me know and I'll kick it again05:22
wgrantthumper: You will hopefully be poked in a couple of minutes. Thanks.05:22
wgrantthumper: Consider yourself poked.05:23
wgrantIt worked, thanks.05:24
wgrantAnd p-i only has 72 jobs remaining.05:24
wgrantExcellent.05:24
wallyworldpoolie: wrt qa tagging, the two goals you mentioned - accurate model and easy to use - don't have to be mutually exclusive :-)05:41
* thumper pokes the script again05:44
thumperscript is running05:44
wgrantThanks.05:44
wgrantIt's working.05:47
huwshimilifeless: Really like the queries time indicator. I have a question though. Every document load (before images, javascript, css etc.) takes about 2.5 seconds longer than the query time. Is that just the time it takes to execute the files, render the templates etc?05:57
lifelesshuwshimi: we are currently 100% overcommitted in the datacentre05:58
lifelesshuwshimi: so things are queueing a page in advance, and thats within 3 seconds, 99% of the time05:58
lifelesshuwshimi: its our top rt05:59
lifelesshuwshimi: or approx; I'm going to pounce on mthaddon today to try and get it moving; we should have traction on it this weke05:59
lifelesshuwshimi: bug 716760, which needs someone to grab it and run with it, is about measuring this gap06:00
_mup_Bug #716760: no measurement of in-datacentre queue timings <Launchpad itself:Triaged> < https://launchpad.net/bugs/716760 >06:00
lifelesshuwshimi: (sort of actual transfer times)06:00
huwshimilifeless: It's interesting, once you have one bit of information (the query times) readily available, you notice things.06:01
lifelesshuwshimi: I mentioned that bug to stub, but I don't know if he's going to poke at it06:01
lifelesshuwshimi: yes, continual partial attention06:01
lifelesshuwshimi: I think it would be really excellent to also show the time after the initial document - time to get other assets, fire js etc etc06:02
lifelesshuwshimi: I expect a similar psychological effect06:02
huwshimilifeless: For example on the lp.net homepage about 75% of our load time is that load overhead (the queries, js, images etc. load in the other 25%)06:03
lifelesswgrant: bug 3182006:17
_mup_Bug #31820: mysterious exception during accept on ltsp 0.75 <lp-soyuz> <soyuz-upload> <tech-debt> <Launchpad itself:Triaged> < https://launchpad.net/bugs/31820 >06:17
lifelesswgrant: wtf06:17
wgrantlifeless: Probably librarian down.06:19
lifelesswgrant: any reason not to invalid it and wait for a reoccurence with diagnostics ?06:20
wgrantlifeless: I doubt it.06:21
wgrantthumper: lp:debian/wheezy/libjconv lp:debian/wheezy/atom4 lp:debian/wheezy/netrek-client-cow06:35
wgrantlp:debian/wheezy/biosquid lp:debian/wheezy/quilt06:35
wgrantthumper: I missed those five. All the rest are scanned, though.06:35
thumperwgrant: doing those now06:38
wgrantthumper: Thanks.06:38
wgrantp-i should finish in a couple of minutes.06:38
wgrantthumper: Thanks, all scanned successfully.06:41
wgrantpoolie: Apart from nexuiz-data, we appear to be done.06:51
wgrantEverything is scanned, p-i processing new Ubuntu uploads.06:51
pooliehooray06:52
wgrantpoolie: Except https://code.launchpad.net/~ubuntu-branches/debian/wheezy/xserver-xorg-video-voodoo/wheezy06:53
wgrantCreated, but unlinked and unpushed.06:53
wgrantAh, the squeeze branch is pack-0.92!?06:54
wgrantYeah, we have some rich-root-pack branches.06:55
wgrantHow very odd.06:55
=== almaisan-away is now known as al-maisan
lifelessUrsinha: hi07:36
lifelessbug 718566 should be on loggerhead not launchpad07:36
_mup_Bug #718566: DatabaseError on loggerhead trying to view a revision on staging <oops> <Launchpad itself:Triaged> < https://launchpad.net/bugs/718566 >07:36
Ursinhalifeless, hello07:37
Ursinhayes, I know07:38
Ursinhaam changing right now07:38
lifelesscoolio :)07:38
Ursinhaoh, I like the query count on the top07:38
lifelessUrsinha: excellent07:38
=== mthaddon` is now known as mthaddon
mrevellHey09:02
_starbuckmorning mrevell09:03
mrevell_starbuck, Nice nick09:03
_starbuck:)09:04
_starbuckthanks09:04
adeuringgood morning09:05
al-maisanmoin adeuring09:11
adeuringsalü al-maisan!09:11
bigjoolsUrsula has gone all BG on us09:28
spivWould some kind lp committer please shove https://code.launchpad.net/~spiv/launchpad/haproxy-for-twisted-services/+merge/48427 at ec2test or whatever the next step is?09:32
lifelessERROR:qa-tagger:Something went wrong when marking bugs: 'LPQAStagingDeployment' object has no attribute 'deployed_source_revno'09:36
lifelesswgrant: just bug 717363 needs qa and we can has deploy.09:52
_mup_Bug #717363: prf WalkerBase.walk can fail if self.open raises an exception <product-release-finder> <qa-needstesting> <Launchpad itself:Fix Committed by sinzui> < https://launchpad.net/bugs/717363 >09:52
lifelessnight all09:52
allenapCheerio lifeless .09:56
LPCIBotProject devel build (439): FAILURE in 5 hr 18 min: https://hudson.wedontsleep.org/job/devel/439/10:27
LPCIBot* Launchpad Patch Queue Manager: [r=thumper][no-qa] Use the new, correct lazr.restful-0.16 egg.10:27
LPCIBot* Launchpad Patch Queue Manager: [rs=wgrant][rollback=12363] Revert r12363. The extra subquery makes10:27
LPCIBotbug searches perilously slow for non-registry-admins.10:27
LPCIBot* Launchpad Patch Queue Manager: [r=benji, bac][bug=717363] Recover from an open() failure when the10:27
LPCIBotproduct-release-finder calls walk().10:27
LPCIBot* Launchpad Patch Queue Manager: [r=lifeless][bug=68203] Do not accept whitespace comments when10:27
LPCIBotreporting a bug.10:27
bigjoolsdpm: hi, around?10:36
dpmhi bigjools10:37
bigjoolsdpm: hi - do you admin the ubuntu-translators list?10:37
dpmyes10:37
bigjoolsdpm: great - can you please unsubscribe help (at) launchpad.net, or it might be launchpad-help at canonical .com10:38
wgrantCould also possibly be feedback@10:39
stublifeless: What got patch-2208-41-0.sql ?10:39
bigjoolsnot according to the mail headers10:39
dpmbigjools, done10:42
bigjoolsdpm: awesome, thanks10:42
dpmnp10:42
bigjoolsyay for less email10:42
stubbigjools: Any fallout from switching to debversion? There are other places in our schema we could switch too (eg. ProductSeries.name and other places with version_sort_key indexes)10:46
bigjoolsstub: no, swimmingly well actually10:46
bigjoolsseems a lot faster10:47
stubTa10:47
bigjoolsArchive:+index has fallen out of the top 10 timed-out pages \o/10:48
wgrant99% @ 9.6710:48
bigjoolsdetails details :)10:49
wgrantWhich is >3s better than before10:49
bigjoolsthe debversion thing plus some other improvements I made have helped a lot10:49
wgrantYup.10:49
wgrantWe have lost a few thousand soft timeouts a day :)10:49
bigjoolswell the latest report is for the weekend which is not as busy, let's see tomorrow's10:50
wgrantTrue.10:50
bigjoolswgrant: so, the last soyuz-report cleanup we can do is to turn the routine errors into non-oops10:52
wgrantbigjools: Right.10:53
wgrantThe key errors.10:53
bigjoolsFatalUploadError etc10:53
wgrantAlthough I'm not sure about that NoneType has no email thing.10:53
wgrantIs that the account/person mess again?10:53
=== henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews
=== henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: henninge | https://code.launchpad.net/launchpad-project/+activereviews
bigjoolsdon't see that10:53
wgrant2 occurrences on the 11th.10:54
wgrant        OOPS-1868PPA545, OOPS-1868PPA54610:54
bigjoolscould be10:54
bigjoolswgrant: your config changes seem ok then, I think10:55
wgrantbigjools: Thanks.10:55
wgrantIt makes the inheriting configs much simpler.10:55
bigjoolsFSVO10:56
henningejtv: Any news on my MP?10:56
wgrantThe diff is bad. But the configs are nice.10:56
bigjoolswho can I assign loggerhead questions to?10:56
wgrantIt's LP-maintained now.10:56
wgrantSo your squad :)10:56
jtvhenninge: no, was trying to figure out the XPI bug.  But I can get back to your MP if it's urgent.11:03
jtvThere was some mention of it not being critical any more.11:03
jtvDoes that still apply?11:03
henningejtv: it's not release-critical anymore because we had the release11:04
henningejtv: the bug still is and re-enabling Ubuntu imports depend on it.11:04
henningeYes, it is urgent. ;-)11:05
jtvAh!11:05
jtvhenninge: in that case,11:05
jtv—why do you skip unreadable/nonexistent files instead of requiring the user to get their act in order?11:06
jtv— why do you require a distroseries to be specified among the options but assume a distroseries to be specified?11:06
jtv— where does the circular import on IDistributionSet come from, since this is a script?11:07
henningejtv: as mentioned, this is adapted from reupload-imports11:08
henningeI had meant the script for my personal benefit initially but thought it might be useful for others, too.11:09
henningeSo, the answer to the first question is "to keep it simple" but I guess a warning would be appropriate.11:09
jtvhenninge: there is a warning, but it doesn't say what the problem is.  I say just dump the check.11:10
henningeThe answers to the other two are: "Because I copied that from the originial script.11:10
henningeI like robust scripts, though.11:10
jtvhenninge: I don't recall off the top of my head but there may be a way to specify to optparse that a particular option is required.11:11
jtvTypo in the test: is_trackging11:11
=== matsubara-afk is now known as matsubara
jtvhenninge: also, a copyright notice of 2009 on a new script in scripts/rosetta/ may be taking "adapting the existing script" a bit far.  :)11:14
henningeI agree ...11:14
jtvhenninge: doesn't is_upstream_import_on_sourcepackage duplicate logic you had somewhere else?11:19
jtvI thought you already implemented that part.11:19
henningeno, I don't think so.11:19
jtvThen sorry—wasn't sure so I thought I'd ask.11:20
jtvOh, there's a misplaced import in there.11:20
allenapDoes anyone know if the bug expiry stuff is meant to be running now?11:20
jtvhenninge: lines 777—778 of the diff11:20
henningejtv: you already reviewed this code, so maybe you are remembering that.11:20
* henninge looks11:20
jtvohhh could be11:20
stubbouncy bouncy11:20
henningejtv: hm, I think I had circular problems on that one but I can check that again.11:22
jtvhenninge: even then, please move it to the top of the method and comment it.11:23
jtvhenninge: I'm having trouble figuring out what exactly _makeMessages in the test is supposed to do.  It crams a lot of scenarios into one method and it's not clear to me how the parameters are meant to interact.11:24
henningehm, does the docstring not help?11:27
jtvThat's after reading the docstring!11:27
henningeMaybe I should add that is_tracking only makes sense if the other two are False?11:27
henningeI had tried to think of other interfaces for the method but this was the best I could come up with.11:28
jtvWhy not have multiple methods?11:28
jtvI mean, it helps to know that is_trackging doesn't combine, but it'd help more to have smaller and more self-evident chunks.11:29
jtvAlso, what's "this message" in the docstring?11:29
henningesorry, got called to the door11:36
henningejtv: there is a finite permutation of possible combinations that the method I am testing has to deal with.11:37
henningeI had a table on paper and tried to have something else in code.11:37
henningeMaybe I should change it to not use the tri-state bools.11:38
jtvWell more parameters probably aren't the answer either.  The method already spends a fair portion of its space just trying to figure out what it was that the caller requested.11:40
jtvCan't you do something along the lines of "makeIdenticalUpstreamMessage"?11:40
jtvThe tests themselves look good, by the way—nice and thorough, well-documented.11:42
jtv(repeated typo in the tests: identcal)11:43
jtvThey're also nice and concise.11:44
wgrantHahaha11:47
wgrantreal1m4.066s11:47
wgrantDown from 18 hours.11:47
jtvwgrant: what is?11:47
wgrantjtv: update-bugtask-targetnamecaches.py11:47
jtvwgrant: add some sleep()s to avoid surprises.11:47
jtvAlso, nice cache of future "optimizations" for those lazy days.11:48
wgrantIndeed.11:48
henningejtv: expanded docstring11:51
henningehttp://paste.ubuntu.com/566935/11:51
* jtv looks11:51
henningejtv: I guess I could use _makeUpstream, _makeUbuntu and _makeSuggestion methods and pass other messages as is_identical into it.11:52
henninges/method/message/ on line 21 of that paste11:53
jtvhenninge: I think it'd be better to split it up, yes.11:53
henningeI will have to carry pofile and potmsgset around which I was trying to avoid ...11:54
jtvhenninge: yes, that is a bit of pain.  But I suppose potmsgset would be implicit in the TM in most places.11:55
henningeyes, I was just thinking about that.11:55
deryckMorning, all.12:00
henningeHey deryck!12:00
jtvhi deryck12:00
=== jtv is now known as jtv-afk
wgranthenninge: Can I throw a review your way?12:06
henningewgrant: sure but please don't aim for any tender parts ...12:06
wgranthenninge: https://code.launchpad.net/~wgrant/launchpad/bug-718004-rewrite-targetnamecache/+merge/4961212:07
stubyay 70% packet loss between ISP and the USA. Think I'll go read a book.12:08
henningewgrant: That looks very good. Is it ok for you, though, if I finish this after lunch?12:31
wgranthenninge: I'm about to vanish for the night, so I won't be around, but that's fine.12:32
henningewgrant: ok, g'night ;)12:32
wgranthenninge: Thanks for reviewing.12:33
=== henninge is now known as henninge-lunch
=== mrevell is now known as mrevell-lunch
gary_posterderyck, I figure if I exposed my ignorance enough I'd force someone, probably you, to respond :-) thanks, and I look forward to the "now this is what to do" email ;-)13:14
deryckheh13:14
deryckgary_poster, actually, I think bac is doing the right thing ;)13:14
deryckfinishing that reply now13:14
gary_posterheh, ok cool, deryck, thanks13:15
adeuringhenninge-lunch: could you have another look at https://code.launchpad.net/~adeuring/launchpad/bug-702468/+merge/49205 ?13:22
bacthanks deryck.  i was hoping you'd give your 2 cents.13:22
bacgary_poster: are you fixing my blog post?13:23
bacmrevell-lunch: does the 'front-page' *category* not put it on launchpad.net?  you have to add a tag?13:24
=== mrevell-lunch is now known as mrevell
mrevellbac, Yeah, it's a tag, rather than a category13:24
bacwhat does the category do?13:24
gary_posterbac, I was approving a comment, and was going to ask if you wanted me to meddle.  I approved it, and now I'll leave the rest alone for you :-)13:24
baccan we get rid of that one as it confuses people like me13:24
bacmrevell: ^^13:25
bacgary_poster: thanks13:25
=== al-maisan is now known as almaisan-away
gary_posternp13:25
bacmrevell: do all comments have to be moderated?13:26
mrevellbac, I didn't know there was a front-page category. Sure, let's kill it. As for comments ... from new people they do.13:27
mrevellOnce you've had one comment approved, it's open season.13:27
bacmrevell: thanks13:27
LPCIBotProject db-devel build (365): FAILURE in 2 hr 51 min: https://hudson.wedontsleep.org/job/db-devel/365/13:31
LPCIBotLaunchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 12370,13:31
LPCIBot12371, 12372 included.13:31
=== jtv-afk is now known as jtv
jtvcrazy busy day13:51
jtvhenninge-lunch: test_accept_upstream_no_ubuntu says: "If there was already an upstream translation, but no ubuntu one, the suggestion replaces both."  There is only one translation to replace, of course; and might it be better to say "accepting the suggestion" rather than "the suggestion"?13:54
=== henninge-lunch is now known as henninge
pindongaI was wondering, how do you manage to automatically sign the deb packages created from recipes? (ie, without the user entering his passphrase?)13:57
pindongaI'm trying to achieve this myself, but on a local machine13:57
maxbpindonga: The signing keys of PPAs are stored by Launchpad. Not even the owner of the PPA has access to the private key.13:58
pindongamaxb, so you have a script that does the signing13:59
pindongaI'm using bzr dailydeb13:59
pindongaand I want to automate the signing of the packages I create13:59
pindongayou know any way I could do?13:59
maxbIn the way you mean, packages are not signed.14:00
maxbApt archives are what is signed14:00
pindongathis is essentially for a plugin for tarmac I'm building14:00
maxbWhat software are you using to build the Release and Packages files?14:00
pindongamaxb, when I run bzr dailydeb and use the dput option it will push the dsc/changes stuff to launchpad14:01
deryckhenninge, abentley, adeuring -- coming, sorry.  2-3 more minutes.14:01
pindongafor that it will sign the package14:01
pindongasorry, not pacakge14:01
pindongabut changes/dsc files14:01
pindongaI was wondering if there is a way to have the credentials stored in a way that doesn't require the user to put it in14:01
pindongabzr dailydeb uses debsign internally to sign the files14:02
jml!!!14:02
maxbWhether or not you have a passphrase set on the key is your own decision.14:02
pindongamax, ah, so if I create a key without a passphrase that should work14:03
maxbObviously an unprotected key that enables any possessor to impersonate you to Launchpad is a dangerousl thing14:03
pindongamaxb right14:03
jmlhttp://paste.ubuntu.com/566971/14:03
maxbpindonga: I think we should continue this on #launchpad, as it is not -dev related14:03
pindongamaxb, sure14:04
pindongathanks anyway14:04
jtvhenninge: you have my vote—sorry for the delays.14:11
jmlI just got this error when running a clean build of a branch.14:13
allenapbigjools: Have there been any problems recently when adding new builders? I think I've found a bug where the buildmaster will create a new SlaveScanner for new builders every 5 minutes until it's restarted.14:13
jmlhttp://paste.ubuntu.com/566971/14:13
deryckabentley, if you'll point me at that mp, I'll review later, after I finish a handful of emails.14:14
henningejtv: thanks!14:14
abentleyderyck, first I have to create the MP.14:14
deryckah, ok :-)14:15
jtvhenninge: on an unrelated note, I see that POTMsgSet.setSequence has a case for TranslationTemplateItem.sequence < 0.  I have _no_ idea what sense that would make.  Can you think of anything?14:15
henningejtv: I was not aware of that and nothing comes to mind about it.14:16
abentleysinzui, could you please have a look at https://code.launchpad.net/~abentley/launchpad/merge-translation-script/+merge/49099 ?14:16
jmlallenap: because NewBuildersScanner doesn't update self.current_builders?14:16
allenapjml: That's the badger.14:16
jtvhenninge: thanks, just checking my sanity.  :)14:16
* sinzui looks14:16
jmlallenap: I don't know of any production issues, but I guess I've just confirmed there's a logic bug in the code.14:17
henningejtv: I don't see what you mentioned, though ...14:18
allenapjml: Okay, I'll file a bug. How would you triage it? I'm tempted to mark it critical.14:18
bigjoolsallenap: urgh14:18
henningejtv: can you paste the version of setSequence you are seeing? Or give me the revno?14:18
jtvhenninge: there's a check for sequence >= 0 (which should always be the case), and then there's an else: pass.14:18
jmlallenap: I guess critical, but that's probably only because I'd just fix the bug :)14:18
henningeoh, that's what you meant14:18
allenapjml: Yeah, that was my plan too :)14:19
bigjoolsallenap: critical14:19
henningejtv: that's because our style guide used to require that else14:19
abentleysinzui, thanks.14:19
jtvhenninge: it's not that—it's that there's an "elif" instead of an "else" in the first place.14:19
henningejtv: hm, you mean that condition should be checked in an assert?14:20
jtvhenninge: an "assert sequence >= 0" would have made more sense!  Maybe this grew out of an "if sequence > 0" that then also absorbed the "sequence == 0" case.14:20
bigjoolshas anyone managed to land anything via ec2 lately?14:21
henningejtv: I agree14:21
bigjoolsI'm on attempt #4 and it's still bloody failing in windmill14:21
jtvThanks.14:21
jtvbigjools: I did, yesterday.14:21
bigjools:/14:21
jtvbigjools: I did run rocketfuel-setup first, IIRC, after hitting our windmill problem.14:21
* henninge relocates14:21
bigjoolshow does that affect ec2?14:21
jtvbigjools: newer AMI maybe14:22
jtvI don't know how those propagate.14:22
bigjoolsit just picks up the latest automatically14:23
sinzuiabentley: r=me14:23
abentleysinzui, thanks.14:23
bigjoolsactually, now it's showing connection refused errors in librarian tests14:23
bigjoolsec2 testing is about as reliable as a chocolate teapot lately.14:36
bigjoolsand now bzr lp-land is crashing!  I am doomed.14:37
gary_poster"about as reliable as a chocolate teapot14:43
gary_poster"14:43
gary_poster-> an analogy I would have never thought of14:43
gary_posterand like :-)14:43
=== salgado is now known as salgado-lunch
bigjoolsgary_poster: the other one is a chocolate fireguard - fairly standard stuff this side of t'pond :)14:44
abentleyderyck, https://code.launchpad.net/~abentley/launchpad/share-existing-packagings/+merge/4963414:45
bigjoolsbac: hey, the no-email-for-own-bug-actions is totally awesome14:46
deryckabentley, got it, thanks.  Will review very shortly.14:46
bacbigjools: yes.  danilos and gary_poster did a great job.  (i just got to announce it)14:46
bacbigjools: and it was only six years in the making14:46
bigjoolsis there a reason it wasn't done for questions?14:46
bacbigjools: that is on our plate.  look for it in 201714:47
bigjoolsheh14:47
deryckheh14:48
deryckyeah, bac, danilos and gary_poster are to be praised for this work.  many lp users will rejoice.14:49
bigjoolswe're not worthy14:49
* bigjools does the Wayne's World thing14:49
* deryck joins in since it was time for a stretch break anyway14:50
sinzuihenninge: do you have time to review https://code.edge.launchpad.net/~sinzui/launchpad/packagebugs-search-0/+merge/4947914:51
=== jelmer_ is now known as jelmer
gary_posterlol :-)14:54
henningesinzui: r=me14:57
sinzuithank you henninge14:58
=== _starbuck is now known as _starbuck-lunch
allenaphenninge: Do you have time to review a fix for bug 718761? https://code.launchpad.net/~allenap/launchpad/new-builders-scanner-calm-down/+merge/4964515:10
_mup_Bug #718761: NewBuildersScanner schedules a new SlaveScanner every 5 minutes for new builders <Launchpad itself:In Progress by allenap> < https://launchpad.net/bugs/718761 >15:10
henningeallenap: I am currently looking at another review but will pick yours up right after that.15:11
allenaphenninge: Thanks :)15:12
dobeyhey all15:12
dobeydid something break the API this morning?15:12
dobeyi keep seeing this in tarmac:15:12
dobeyNotImplementedError: Can't look up definition in another url (https://api.launchpad.net/1.0/#branch)15:12
leonardrdobey: you're probably using edge, which is gone15:12
dobeyleonardr: ^^ that URL doesn't have edge in it though... hrmm15:13
leonardrdobey: edge redirects you to api.launchpad.net, but launchpadlib thinks it's using edge15:14
leonardrit's telling you that api.edge.launchpad.net served it urls from another server (api.launchpad.net)15:14
=== matsubara is now known as matsubara-lunch
jmlis there a step in the nodowntime rollout process for marking "Fix committed" bugs as "Fix released"?15:28
jcsackettjml: i believe people have done that manually.15:28
jcsackettor did you mean in documentation?15:28
deryckbigjools, did you ever get past your windmill test failure?15:29
jmlI meant the latter but I would have tolerated being pleasantly surprised wrt automation :)15:29
bigjoolsderyck: yes but I didn't change anything15:29
bigjoolsI get other errors in ec2 now :/15:29
bigjoolsnone of them to do with my branch of course, and since it was attempt #4 at ec2 I gave up and pqm-submitted it15:29
deryckbigjools, ah, ok.  I've got a call and review and then can look to see if something stands out to me.15:30
leonardrdobey: try this branch and see if it helps you https://code.launchpad.net/~leonardr/launchpadlib/fake-edge15:36
leonardrhenninge: would love a review of https://code.launchpad.net/~leonardr/launchpadlib/fake-edge/+merge/4965115:39
dobeyleonardr: i did this: https://code.launchpad.net/~dobey/tarmac/no-more-edge/+merge/4964915:42
leonardrdobey: you don't need to import lpnet_service_root, you can just use the string 'production'15:43
leonardrbut you have the right idea15:43
leonardrsimilarly 'staging'15:43
dobeywell i'd rather import the strings than using literals everywhere.15:45
LPCIBotProject devel build (440): STILL FAILING in 5 hr 14 min: https://hudson.wedontsleep.org/job/devel/440/15:46
LPCIBotLaunchpad Patch Queue Manager: [r=lifeless][ui=none][bug=607960] Permit turning targetnamecache off15:46
LPCIBotvia malone.disable_targetnamesearch feature flag.15:46
leonardrdobey: those constants aren't relaly meant to be re-imported15:46
leonardrmaybe i should change them to be the strings15:46
abentleyhenninge, could we mumble about https://bugs.launchpad.net/launchpad/+bug/716586 ?15:47
_mup_Bug #716586: Diverged translation cannot be converged again. <regression> <upstream-translations-sharing> <Launchpad itself:Triaged> < https://launchpad.net/bugs/716586 >15:47
henningeleonardr, abentley: otp atm15:48
* jcsackett sighs.15:48
jcsackettlocal codehosting is not the easiest thing to get working.15:48
abentleyhenninge, oic15:48
abentleyjcsackett, what problem are you having?15:49
jcsackettabentley: a general inability to push or pull branches to try and test mp stuff.15:49
jcsackettabentley: when i try to push, i get an error about needing to supply create-prefix.15:50
jcsackettwhen i try to pull, i get a NOT A BRANCH error.15:50
jcsacketti'm rebuilding something right now, when that's done i can supply you more specific errors.15:50
abentleyjcsackett, are you running "make run_all"?15:50
jcsackettabentley: no, i was not aware of run_all. i take it that gets everything else up and running?15:51
* jcsackett prepares to edit wiki page on development codehosting.15:51
abentleyjcsackett, yes.  "make run" doesn't start codehosting.15:51
jcsackettabentley: fantasitc. thanks. :-)15:51
abentleyjcsackett, I've never used "make run_codehosting" like that page says, but I guess that works, too.15:53
jcsackettabentley: make run_codehosting wouldn't run for me, thus trying make run.15:53
jcsackettoddly, make run_all *is* working. i should find out why codehosting wasn't.15:53
abentleyjcsackett, that would be very good to know.15:54
* jcsackett nods.15:54
jcsackettthanks, again, abentley. this has gotten me past the current hurdle. :-)15:54
abentleyjcsackett, np15:54
abentleyjkakar, did you get anywhere with that ClassAlias issue?15:58
jkakarabentley: Hey, sorry about that, the other day... I looked at it and then got distracted.16:00
jkakarabentley: So yeah, I looked at it, but I don't understand why you want to use ClassAlias in that code...16:00
jkakarabentley: It's usually useful when you self-join a table, which didn't seem to be the case, if I remember correctly.16:00
jkakarabentley: Anyway, it did seem a touch odd that the ClassAlias wasn't being used, because I would expect it to be.16:01
abentleyjkakar, I want to use the POTemplate table two ways: I want to find Products that link to POTemplates, and I want to find packages that link to POTemplates.16:01
=== _starbuck-lunch is now known as _starbuck
jkakarabentley: Can you paste the query again, please?16:02
abentleyjkakar, looking...16:04
jkakarabentley: Ta.16:05
abentleyjkakar,  http://pastebin.ubuntu.com/565962/16:05
abentleyjkakar, the english version is "Find me packagings where the product and the sourcepackage each have POTemplates"16:06
jkakarabentley: Hmm, are the POTemplates the same for a product and sourcepackage, or do products and sourcepackages each have their own POTemplate?16:08
jkakarIf they're not the same, I suspect you'll need to run two queries or use subselects or something.16:09
abentleyjkakar, the products will have different POTemplates from the sourcepackages.16:09
=== beuno is now known as beuno-lunch
jkakarabentley: In that case, I don't think the join you have here is going to work.16:10
abentleyjkakar, The direct SQL works just fine.16:10
jkakarabentley: The SQL that's generated at the bottom of the paste you mean?16:10
abentleyjkakar, no, I wrote this as SQL first and got a losa to run it against staging.16:10
abentleyjkakar, I'm trying to Stormify that sql.16:11
jkakarabentley: Is that SQL at the bottom your hand-written working SQL or what's generated?  If it's generated, can you paste the working SQL, please?16:11
abentleyjkakar, that's the generated SQL.  The SQL I want is: https://pastebin.canonical.com/43146/16:11
joeyjml: yeah, needs love16:12
joeyjml: fixed!16:12
jmljoey: thanks :)16:13
joeymy pleasure16:13
joeyand you're very welcome16:13
joeyI have one action I can't do on -meeting so I  had to mail off for a group request for that16:13
abentleyhenninge, ping me when you can chat.16:14
henningeabentley: now16:16
henninge;-)16:16
jcsackettabentley: so i thought i had this working, but it turns out the pushing wasn't putting anything into launchpad.dev, but just pushing into my home directory on my machine. thoughts?16:17
jkakarabentley: Hmm, my conversion of that SQL looks a bit different than yours: https://pastebin.canonical.com/43286/16:19
jkakarabentley: Does that work?16:19
abentleyjcsackett, OTP16:19
jcsackettabentley: ah, sorry.16:19
=== matsubara-lunch is now known as matsubara
henningeabentley: https://translations.qastaging.launchpad.net/mailclipper/trunk/+pots/testcase/fr/+translate16:20
jmlsinzui: would your squad be able to finish up the two remaining High priority feature-flags bugs?16:20
sinzuimaybe16:20
abentleyjkakar, I can try it, but shouldn't my version have generated a FROM statement with "AS" in it?16:21
sinzuijml: I think the answer is yes. Looks like jcsackett and wgrant have booked their next few days. I will be taking a new bug in a few hours16:21
jmlsinzui: https://bugs.launchpad.net/launchpad/+bug/670019 and https://bugs.launchpad.net/launchpad/+bug/708999.16:21
jkakarabentley: Yes, I'd expect that.  I don't understand why that isn't happening.16:21
_mup_Bug #670019: audit facility for feature flags <feature-flags> <lp-foundations> <Launchpad itself:Triaged> < https://launchpad.net/bugs/670019 >16:21
_mup_Bug #708999: code.branchmergequeue, code.incremental_diffs.enabled feature flags not documented <code> <feature-flags> <Launchpad itself:Triaged> < https://launchpad.net/bugs/708999 >16:22
jmlsinzui: thanks.16:22
abentleyjkakar, okay, I'll file a bug then.16:22
jkakarabentley: Thanks.16:22
bachi deryck16:36
deryckbac, hey16:40
allenapdanilos: Hi there. Could you triage bug 714521 if possible? If I do it, it's likely to be a guess.16:40
_mup_Bug #714521: Partial translation export feature gone <regression> <upstream-translations-sharing> <Launchpad itself:New> < https://launchpad.net/bugs/714521 >16:40
danilosallenap, well, I wanted to leave it for deryck's team to triage, but considering it's a regression, I am sure it should be critical according to our 'regression' policies16:41
allenapdanilos: Ah, yes :) I'm getting used to this slowly :) I'll update it.16:42
danilosallenap, it would be nice to get Henning's opinion as well, because he marked it as 'invalid'16:43
allenapCool, I'm in favour of that.16:44
=== henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews
cr3can someone help me understand why bugattachment.data.open() seems to return a buffer with a read() method, as per the api documentation, but the open method in the LibraryFileAlias class doesn't return anything.16:46
henningeleonardr: I won't be able to look at your mp, I am sorry.16:46
leonardrok, i'm sure i can get someone to look at it since it's a partial solution to an active emergency16:47
allenapwgrant: Mind if I ask you about a build issue? I think bug 718790 is something the user can correct himself - i.e. avoid running javadoc on .class files - but I wanted a second opinion as I am not at all familiar with builds.16:47
_mup_Bug #718790: FTBFS with java due to illegal characters <Launchpad Auto Build System:New> < https://launchpad.net/bugs/718790 >16:47
abentleyjkakar, filed as https://bugs.launchpad.net/storm/+bug/71886416:54
_mup_Bug #718864: ClassAlias does not generate AS in FROM clause <Storm:New> < https://launchpad.net/bugs/718864 >16:54
=== flacoste changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: API scripts talking to edge are broken | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews
abentleyhenninge, if a suggestion is not diverged, there's no way of knowing whether it was suggested for upstream or ubuntu, right?16:58
henningeabentley: right, and suggestions can not be diverged anyway.16:58
henningei.e. potemplate should only be not None if one (and only one) of the is_current_* flags is set.16:59
abentleyhenninge, thanks.17:00
cr3nevermind, folks, found answer in HostedFile in lazr.restfulclient17:04
jmlOff for a bit. Back later.17:05
=== deryck is now known as deryck[lunch]
=== salgado-lunch is now known as salgado
=== flacoste changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews
=== beuno-lunch is now known as beuno
leonardris there anyone who can help me understand PATCHPlugin in launchpad/javascript/client/client.js?17:49
benjileonardr: I too seek enlightenment.17:53
jtvI, on the other hand, seek review: https://code.launchpad.net/~jtv/launchpad/bug-715854/+merge/4967617:56
jtvAny takers?17:56
leonardrjtv, i'll take it if you'll take https://code.launchpad.net/~leonardr/launchpadlib/fake-edge/+merge/4965117:57
jtvleonardr: OK17:58
jtvleonardr: I wonder whether we ought to use the new LP import format for launchpadlib.18:01
jtvsrc/launchpadlib/launchpad.py: from launchpadlib.uris import STAGING_SERVICE_ROOT, EDGE_SERVICE_ROOT18:02
jtvleonardr: similar for the list constant in src/launchpadlib/tests/test_launchpad.py18:05
lifelessmoin18:11
jtvhi lifeless18:11
=== deryck[lunch] is now known as deryck
leonardrjtv: i think i need to push a more recent version18:12
leonardryeah, you didn't have the version that included the deprecation warning. sorry about that18:13
jtvleonardr: it does have that18:13
leonardrsorry, i meant...18:13
leonardrthe version that will give you a deprecation warning if you use EDGE_SERVICE_ROOT18:13
leonardrit's a minor change18:13
jtvThat's not in _dereference_alias?18:13
leonardri changed EDGE_SERVICE_ROOT to 'edge'18:14
jtvAh18:14
leonardrwhich will trigger the warning when it goes into _dereference_alias18:14
jtvas opposed to 'production'18:14
leonardrright. it'll get converted to production after the warning18:14
jtvI see18:14
jtvleonardr: my one gripe is with the test.  It seems to test multiple things at once:18:15
jtv * Looking up edge on the web service gives you production.18:15
jtv * A web lookup for edge also gives you production.18:16
jtv * Exactly one of these gives the warning.18:16
leonardrwell, that's easy to fix18:16
jtvNobody said it had to be hard. :)18:16
leonardrjtv: problem with catching the warning. the warning only happens once, and i don't know how to guarantee which test it happens in18:20
jtvsurprising… why is that?18:20
leonardrordinarily a deprecation warning only happens the first time you do the deprecated thing18:21
jtvI would maybe the first…18:21
* leonardr rereads the module doc18:21
jtvI would _have expected_ maybe the first.18:21
leonardrit's not18:22
jtvThen can you guarantee that this test won't fail arbitrarily, e.g. when run in combination with specific other tests?18:24
jtvArrgh, I have to go.18:25
leonardrjtv: pushed a new revision that should please you18:26
leonardri'll take a look at your branch now18:26
jtvcool, thanks18:26
abentleylifeless, stub still needs to sign off on database reviews, right?18:31
lifelessyes18:31
lifelesshttps://dev.launchpad.net/PolicyAndProcess/DatabaseSchemaChangesProcess18:31
lifelessboth of us need a db review requested18:31
leonardrjtv: reading your mp i kind of get what's going on but i don't know what a file reference actually is. is that the file in which a translatable string occurs?18:32
abentleylifeless, could not find that page on dev.launchpad.net.18:33
jtvleonardr: yes, the place in the project's source tree where it's found.18:33
jtv(I had that in the MP at one point but must have taken it out again)18:33
lifelessabentley: I find it from the policy and process list when I need to18:33
abentleylifeless, I mean it's there if you know the URL, but not linked to in https://dev.launchpad.net/PatchSubmission or anything.18:33
jtvleonardr: I'm done with yours.  Have to run now!18:34
lifelessabentley: ah, it probably needs to be referenced18:34
=== jtv is now known as jtv-afk
=== matsubara is now known as matsubara-afk
lifelessstatik: hi19:18
lifelessI can has review? https://code.launchpad.net/~lifeless/launchpad/bug-704446/+merge/4958019:22
jcsackettlifeless, have a moment to talk?19:43
jcsackettregarding the revision that had to be rolledback?19:43
lifelesssure19:45
lifelessirc/voice?19:45
jcsackettuh, voice might well be easier.19:45
jcsackettmumble or skype?19:45
lifelesss19:45
lifelesswhats yoiur skype id?19:47
jcsackettlifeless: j.c.sackett19:47
jcsacketti'm online now.19:47
lifelessdurham ?19:47
=== jam1 is now known as jam
gary_posterleonardr: http://code.google.com/p/httplib2/issues/detail?id=97 !  cool.20:39
leonardryay20:40
lifelessnice20:42
lifelessnasty bug there20:42
thumpermorning20:42
thumperderyck: ping20:44
jamlifeless: I just got rejection emails for proposals against loggerhead trunk...20:54
jamIs there any context I can give you that will help?20:55
jam(emails, merge proposal, etc.?)20:55
lifelessjam: what mail was rejected?20:57
lifelessjam: as in the address that was sent to20:57
jamlifeless: one was a new merge proposal, one was a comment follow up to an existing proposal20:57
jamlifeless: the rejection message was: From: launchpad-bugs-owner@lists.canonical.com20:58
jamSo I assume launchpad-bugs@lists.canonical.com20:58
LPCIBotProject devel build (441): STILL FAILING in 5 hr 12 min: https://hudson.wedontsleep.org/job/devel/441/20:58
LPCIBotLaunchpad Patch Queue Manager: [r=adeuring][bug=631206] Make Builder:+history load in 2 seconds20:58
LPCIBotinstead of timing out.20:58
jamlifeless: digging into the content, it looks like it was actually launchpad-bugs@lists.ubuntu.com that it was getting sent to20:59
jam(From an old Received: line)20:59
lifelessok thats ~launchpad21:03
lifelessyou proposed to trunk yea?21:03
lifelessflacoste: hi21:03
flacostehi lifeless21:03
lifelesswe up ?21:03
flacostei'm ready for our call21:03
thumperleonardr: mumble?21:04
leonardrthumper, i'm on it21:04
jamlifeless: yes, this is to lp:loggerhead21:10
leonardrhttps://code.launchpad.net/~thumper/launchpad/daily-ajax/+merge/4929521:11
lifelessflacoste: https://devpad.canonical.com/~lpqateam/ppr/lpnet/latest-daily-categories.html21:18
jamlifeless:  should I be adding sinzui to my loggerhead request-for-review for the ui stuff?21:20
jamor should I be targetting ~loggerhead-team and asking for ui, or how is that done?21:20
lifelessjam: generally ask here21:20
lifelessjam: I suggeset huwshimi, who is tasked with making loggerhead look more like lp, and sinzui21:20
sinzuilets give huwshimi a go first21:21
jamhuwshimi and sinzui: https://code.launchpad.net/~jameinel/loggerhead/revert-colors/+merge/49705  is the link21:21
jamsinzui: fine with me, just making sure I conformed to whatever protocol is applicable21:21
sinzuiwhy is the person picker showing me a non-active user?21:26
jmlhuwshimi: care to join me on mumble?21:31
huwshimijml: Sure21:31
jml... or not. I can't seem to sign on.21:33
pooliehello jml, huwshimi, leonardr, all21:33
huwshimijml: You look online to me now21:33
jmlpoolie: hello21:33
huwshimipoolie: Morning21:33
pooliecan i have a mini-preimpl discussion on https://bugs.launchpad.net/launchpad/+bug/64322421:33
_mup_Bug #643224: dkim whitelist should be in configuration <dkim> <feature-flags> <lp-foundations> <Launchpad itself:Triaged> < https://launchpad.net/bugs/643224 >21:33
jmlhuwshimi: skyping you instead21:33
pooliespecifically as to whether the the approach described is ok21:34
thumperleonardr: how do I change an exposed method so it doesn't appear in 'devel' api?21:37
thumperleonardr: I've changed the setRecipeText from being a callable method to being a mutator on recipe_text21:38
thumperleonardr: also, do I need to annotate the new mutator in any way to make it say devel only?21:38
poolielifeless, can you have a quick glance at 643224?21:38
leonardrthumper: put @operation_removed_in_version("devel") at the top of the annotations21:38
thumperleonardr: I'm not entirely clear on this point21:38
thumperleonardr: ok21:39
leonardryou don't need to annotate the mutator because there is no preexisting code that will break now that this field can be edited21:39
thumperok21:40
leonardri think you can make that work if you really want to, but i don't remember how--i think you would use operation_for_version21:40
thumperleonardr: is a mutator a write_operation?21:41
thumperleonardr: or more specifically, do I need @export_write_operation as well as @mutator_for ?21:42
leonardrthumper: yes, you define a write operation and _then_ make it a mutator21:43
leonardrso if you want it to be a mutator in one version and not another, you would define it in the earlier version, then put @operation_for_version() on top, and put @mutator_for on top of that21:43
wgrantallenap: There are probably better people at 4am, but sure.21:44
thumperleonardr: I'm just pushing a change, then I'll get you to look at the diff, and how I've done it to see if there is a more sane way21:46
leonardrok, i'll take a look21:46
jmlhuwshimi: http://www.ubuntu.com/community21:59
thumperleonardr: line 196(ish) of https://code.launchpad.net/~thumper/launchpad/recipe-inline-edit-recipe-text/+merge/4958522:02
leonardrthumper: you might not need two different methods. try putting @operation_for_version("devel") right on top of @operation_removed_in_version("devel")22:06
thumperleonardr: what of the mutator?22:06
thumperleonardr: it seems a bit weird to stack them like this22:06
poolieleonardr, re your comment about LPNET_SERVICE_ROOT='production'22:07
leonardrthumper: @operation_removed_in_version basically clears the slate. you can start from scratch on top of it22:07
thumperleonardr: do the annotations work from the outside in, or the inside out?22:08
leonardrthumper: they work from bottom to top22:09
leonardrthe only restriction is you can't put an older version on top of a newer version22:09
thumperleonardr: do I need two @export_write_operations ?22:10
leonardrthumper: yeah, you have to start all over22:10
leonardrincluding the parameters, i think22:10
thumperleonardr: so if I'm starting over, why do I need the @operation_for_version("devel") ?22:11
thumperisn't that the default?22:11
thumperas I don't need it for the current one22:11
leonardrthumper: you might not need it. i'd put it in just to make it clear that you're reinstating it for devel22:11
thumperhmm.... ok, let me try22:11
=== salgado is now known as salgado-afk
=== leonardr is now known as leonardr-afk
thumperwell... it works22:21
leonardr-afkok, if you can do without two methods i think that's better (although you could argue two methods is actually more readable)22:22
leonardr-afkbut i think if you do it with one method you should explicitly state @operation_for_version as a way of signalling its return22:22
wgrantsinzui: https://code.launchpad.net/~wgrant/launchpad/icing-purge/+merge/49590 seems like your sort of thing. Could you take a moment to review it?22:23
thumperleonardr-afk: yep, I've done that22:23
sinzuiwgrant: I will22:23
jamlifeless: any chance you could teddy bear on ideas for diagnosing the file handle leak issue? https://bugs.launchpad.net/launchpad/+bug/71734522:23
_mup_Bug #717345: Updates to SFTP server leak file handles in use_forking_server mode <Launchpad itself:In Progress by jameinel> < https://launchpad.net/bugs/717345 >22:23
jamI just ran hammer-ssh with 200-way concurrency22:23
wgrantsinzui: THanks.22:23
jamand got 186 concurrent connections for 60s22:24
jamwithout falling over anywhere22:24
jamat least that I can see22:24
jama bit hard to check every one of 2k connections22:24
wgrantjam: You were requesting a smartserver on every connection?22:24
jamwgrant: yep22:25
jamwgrant: 'echo hello' which is the cheapest request we have22:25
jambut still the full stack22:25
wgrant:(22:25
jamwgrant: and running locally, and running 'lsof' while connecting and afterwards shows 0 stale handles, etc.22:27
wgrantjam: :(er22:28
jamyep22:28
jmlg'night all22:28
wgrantIt sounds like productions children must just not be dying :/22:28
jamso apparently qastaging and dev is immune from whatever was killing production...22:28
jamnow, I'm not triggering failures, and some other stuff, which I can try to inject22:28
jambut something really smells here22:28
jmlg'night all.22:29
jamwgrant: and I just checked again, all of those spawned connections return a valid response22:29
jamso not only is it connecting, the requests are getting through and responded to22:30
jamI could try changing the test script to actually do something more than just 'hello', but I'm not sure what that would tell me yet22:32
lifelessjam: sure22:34
lifelessjam: did you want voice or irc?22:37
jamlifeless: irc is ok. I'm not sure what else to fill in just yet, other than what I mentioned above to wgrant. I'm trying to redo the hammer_ssh script a bit to do more actions per connection22:40
lifelessjam: one possibility is expensive queries and then detach22:40
lifelessjam: you thought error cases might be important too22:40
lifelessjam: also on loggerhead, both sinzui and huwshimi are online know, if you want to mention the theme thing to them.22:41
jamlifeless: detach? meaning disconnect, or do you mean run in the background?22:42
lifelessdisconnect22:42
lifelesshuwshimi: sinzui: bug 71896822:44
_mup_Bug #718968: trunk should use old trunk color scheme <ui> <loggerhead:Confirmed for jameinel> < https://launchpad.net/bugs/718968 >22:44
lifelessjam: I've commented on the bug too, fwiw22:47
jamlifeless: I ran 300, and it only got 1900 connections total22:48
jamso I think I'm hitting a cpu bottleneck with the ssh handshake22:48
wgrantjcsackett: So, what's youre codehosting issue?22:48
lifelessjam: it has a fd limit of 102422:50
lifelessjam: so wouldn't expect it to get passt 255 concurrent22:50
jamlifeless: sure22:50
jamwell, theoretically 34122:51
jam(1024/3)22:51
wgrantjam: Plus the SSH FD.22:51
jcsackettwgrant: broadly, it doesn't work. more specifically, when make run_all or make run_codehosting, i can neither push branches too, nor get branches from lp.dev22:51
lifelessjam: network, in, out, err == 422:51
jamwgrant: right22:51
wgrantjcsackett: Sounds like you need SSH config. Have you run utilities/make-lp-user?22:51
jamlifeless: right, and I'm guessing I'm currently bottlenecked on "network" only22:51
jcsackettwgrant: i have.22:51
jamwhich is why I'm trying to set the connection to do a bit more before it exits22:51
jamthough now after a couple secs it hangs waiting for a child to exit. but I'll work on that22:52
jcsacketti'm not sure it's ssh; the error i get when pushing is that a path or parent directory doesn't exist.22:52
wgrantjcsackett: http://paste.ubuntu.com/567140/ is what I have in my ~/.ssh/config.22:52
wgrantjcsackett: replace ppa-user with the username you gave to make-lp-user.22:52
wgrantjcsackett: It is probably SSH. It's connecting to your system sshd instead of the LP one.22:52
jcsackettwgrant: ah, that makes sense.22:53
jcsacketttrying that now.22:53
huwshimijam: In regards to the colours in loggerhead and making it themeable, I'm in the process of skinning LH so that it looks like launchpad.  Whatever we do we should make it easy to maintain different themes for LH vanilla and LH Launchpad or make them the same.22:55
jcsackettwgrant: http://paste.ubuntu.com/567142/22:55
jamhuwshimi: atm, I'm just proxying for max kanat-alexander, who was the one that preferred the old default theme (non-lp)22:55
jamand beuno who was the one that said they were requested that the themes look different22:56
jcsackettwgrant: on the plus side, that is a *different* error, which frequently implies progress. :-P22:56
huwshimijam: In that case making it themeable might be a good way to go, right?22:56
jamhuwshimi: themeable would be great22:57
jamand a good answer for the bug22:57
jambut far outside of my scope :)22:57
huwshimijam: ok sure.22:57
wgrantjcsackett: Ah, you need the forking service now.23:00
wgrantjcsackett: Or to disable the forking service.23:00
jcsackettwgrant: ?23:01
wgrantjcsackett: Set use_forking_daemon to False in the development config.23:01
wgrantThis is the new thing that jam is debugging.23:01
jamwgrant: I doubt that is the failure, but hey, eliminate variables all you want :)23:02
jamnote the IP address is also custom23:03
jamspecifically 127.0.0.88 or something like that23:03
wgrantjam: Does run_codehosting start the forking service now?23:03
jamwgrant: yep23:03
wgrantOh :(23:03
jamotherwise it wouldn't work :)23:03
wgrantIt wouldn't be the first time that development codehosting didn't work :)23:03
lifelessjam: huwshimi: I might have a quick chat to poolie about the theme23:04
jamlifeless: fine with me, time for me to EOD23:04
lifelessjam: kk23:04
wgrantlifeless: Did your testfix make it through?23:06
wgrantI don't see it.23:06
jcsackettwgrant: we may have success. no error msgs on the push, i'm syncing branches and checking the web interface.23:07
wgrantjcsackett: Excellent.23:07
* wgrant works out why it didn't work.23:07
sinzuiwgrant r=me23:08
jcsackettwgrant: looks like that was it.23:08
jcsackettthanks!23:08
wgrantsinzui: Thanks.23:08
wgrantsinzui: I wanted you to look over it because I thought you might have left them for a reason last time.23:08
wgrantjcsackett: Great,23:09
sinzuiwgrant: I remarked that something was using the translate button a few months ago, well maybe 6 months ago23:09
wgrantjcsackett: Odd. It works fine for me locally with the forking service.23:15
lifelesswgrant: huh, let me see23:15
wgrantlifeless: I bet you forgot [testfix]23:16
wgrantBut PQM should have mailed you :)23:16
wgrantOoooh, sub-second local LP pushes with the forking service.23:17
lifelessbeuno: hey, on bug 718968 - question for you23:17
_mup_Bug #718968: trunk should use old trunk color scheme <ui> <loggerhead:Confirmed for jameinel> < https://launchpad.net/bugs/718968 >23:17
wgrantThat is awesome.23:17
lifelesswgrant: I put the testfix at the end23:17
lifelesssilly regeex ordering23:17
wgrantjcsackett: Is there a launchpad-forking-service running?23:17
wgrantlifeless: Hah.23:17
lifelessresubbing in a sec23:18
wgrantThanks.23:18
wgrantTest runs with that breakage are valid, but have 4 errors?23:18
lifelessyes23:18
wgrantGreat.23:19
lifelesswgrant: so, staging appears to have restored successfully; how are you estimating its age ?23:22
wgrantlifeless: I normally look for when the stream of new bugs finished.23:24
wgrantAs long as bugs.staging.launchpad.net doesn't time out...23:24
wgrantWhich it does.23:24
wgrantAh, there we are.23:25
wgrantDoesn't look very restored.23:25
wgrantWhere is staging-restore.sh?23:26
wgrantI can't find it in any of the usual places.23:26
wgrantIt restored fine on the 5th. It should have presumably restored again on the 12th, but I wonder if it didn't do it because there was no new rev to update to.23:26
lifelessI got the restore log 2 days back23:28
wgrantYou mean the cronspam?23:29
wgrantThat it sends every time it updates?23:29
wgrantlifeless: https://pastebin.canonical.com/43311/23:32
wgrantIt always restores on a Saturday. This time it did not.23:32
wgrantPerhaps a backup was missed due to the rollout.23:32
wgrantOr something like that.23:32
lifelessah yesm wrong ting23:34
wgrantstaging_restore.sh does not always restore staging :(23:34
wgrantLOSA ping.23:35
spm`yo23:41
=== spm` is now known as spm
wgrantspm: What is in sourcherry:/srv/staging.launchpad.net/dumps_from_prod/?23:43
beunolifeless, hey, will look in a bit23:45
spmare you trying to determine what's up wit hthe staging restore?23:45
wgrantspm: Yes.23:45
wgrantLast weekend's did not.23:45
* beuno replies23:45
spmthere's nothing helpful in the staging restore email?23:46
wgrantConfig schemas with production database servers referenced: Australia says argh23:46
wgrantspm: The emails are not useful.23:47
wgrantThe logs on carob only report when a new backup is found.23:47
wgrantSo all the information I have is that it finds a new backup every Saturday except the last one.23:47
spm2011-02-09 06:38 & 2011-02-14 06:35 <== no restore23:49
spmoh I wonder. possibly the rollout on friday night may have messed things up there.23:50
lifelessspm: are you able to trigger a qastaging restore ?23:50
spmsure23:50
wgrantspm: That was my suspicion.23:50
lifelessssh: connect to host bazaar.launchpad.net port 22: Connection refused23:50
spmlifeless: as in a DB restore (to confirm)23:50
lifelessspm: yes23:50
wgrantlifeless: Again? :/23:50
wgrantlifeless: Still works fine from here.23:50
lifelesswgrant: may be intermittent23:50
wgrantWell, it's happening from at least two places, so I guess we have to investigate...23:51
spmerm. is tehre a reason we'd have 49 x /usr/bin/python2.6 /srv/bazaar.launchpad.net/production/launchpad-rev-12351/eggs/bzr-2.2.2_lp_2-py2.6-linux-x86_64.egg/EGG-INFO/scripts/bzr launchpad-forking-service --path /srv/bazaar.launchpad.net/var/launchpad_forking_service.socket --pid-file /srv/bazaar.launchpad.net/var/launchpad_forking_service.pid23:52
spmall dating from Feb 11.23:52
wgrantAre they all from Friday?23:52
wgrantYeah.23:52
wgrantKill them all.23:52
wgrantI said the process count was infalted.23:52
spmta23:52
wgrantBut nobody mentioned those :/23:52
wgrantActually.23:52
wgrantIf you haven't killed them all.23:52
wgrantMaybe keep a couple around.23:53
wgrantjam might like to investigate.23:53
lifelessspm: (yes to db restore of qastaging)23:53
wgrantAlthough that's not enough to cause much of a problem.23:53
wgrant#4402823:56
_mup_Bug #44028: cups reports "printer fault" and refuses to print <cupsys (Ubuntu):Invalid> < https://launchpad.net/bugs/44028 >23:56
wgrantEr. ECHAN, but yeah.23:56

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!