/srv/irclogs.ubuntu.com/2012/05/17/#launchpad-dev.txt

cjwatsonWould anyone else find http://paste.ubuntu.com/991587/ useful?  Should I send that to launchpad-dev?00:09
cjwatsonMy bzrlib is rusty; it probably shows.00:09
jelmercjwatson: perhaps a useful thing to stick in lp-dev-utils ?00:10
cjwatsonYeah, perhaps I should just send an MP there ...00:11
wallyworld_wgrant: the sharingdetails page for ~launchpad-security timeout cold at around 6s on qas since it is displaying ~750 bugs and that page doesn't have batching. the slowest query is the bugtask privacy filter with all those ORs, plus there's some slowish python to assemble the results. given this level of sharing will be going away and it runs ok on qas after a refresh or two, i think we can leave it go for now. the page bulk00:25
wallyworld_loads all data and query count is minimal00:25
wgrantwallyworld_: OOPS ID?00:25
wallyworld_don't have one anymore since i refresh the page with ++profile++ and it went away00:26
cjwatsonhttps://code.launchpad.net/~cjwatson/lp-dev-utils/loc-delta/+merge/10608000:27
wgrantwallyworld_: Can you use ++oops++ to grab one?00:28
wgrantWant to see the query and just how slow it is.00:28
wallyworld_wgrant: OOPS-3ce9cad8e944ce915a7b4b967eeed40500:29
wallyworld_query is the standard bug task id search00:29
wallyworld_about 1300ms00:30
wallyworld_that's the slowest one00:30
wallyworld_StevenK: does your current work add an info_type parameter to makeBranch() in factory?00:36
wgrantwallyworld_: That query is 40ms hot on DF. I wonder if qastaging is just cold.00:45
wallyworld_wgrant: could be. there's a lot of OR's in there. the page on qas now takes around 5s to load which is pushing the friendship a bit. but it's rendering 750 entries00:46
wallyworld_and since we do not expect to see that many shared artifacts moving forward, i think it's ok00:47
wallyworld_or we need to add batching00:47
wgrantWe probably will need to add batching, but we'll see.00:47
wallyworld_the core issue with regard to the number and type of queries has been addressed00:47
wallyworld_let's see what happens on prod00:48
StevenKwallyworld_: It does, yes.00:50
wallyworld_StevenK: what's the eta? i may have to put a branch up for review a bit later and then merge yours in before i land00:51
StevenKwallyworld_: I have a bunch of test failures to sort out.00:54
wallyworld_ok00:54
wgrantwallyworld_: Ahhh01:02
wgrantwallyworld_: There's so many disjunctions that the planner gets confused.01:02
wallyworld_would IN be better?01:03
wgrantwallyworld_: With <100 it's OK, but with 700 it spends a second planning and gives up.01:03
wgrantwallyworld_: So an IN is much better for huge stuff like this :(01:03
wallyworld_wgrant: i f*cking told you!01:03
wgrantYou didn't say there were 770 of them :P01:03
wallyworld_i said there were "lots"01:03
wallyworld_:-P01:03
wgrantI thought we were dealing with sensible batches!01:03
wallyworld_to quote you, "but this is launchpad"01:04
wgrantAnyway, should be easy enough to convince that function to use is_in instead.01:04
wallyworld_i'll spin up a followup branch a bit later01:04
wallyworld_wgrant: i could just replace the OR with IN in all cases01:04
wgrantYou'll need to special-case for when the PK is a single column.01:04
wgrantBut it's like 2 lines.01:04
wgrantSince technically it can be used for composite keys now too01:05
wgrantAlthough you could just assert in that case :)01:05
wgrantSince it's unlikely we'll ever want it to.01:05
wgrant                comp._relation.get_where_for_local(value)01:06
wgrant                for value in search_value.query_values])01:06
wgrantget_where_for_local can technically return more than a simple equality.01:06
wgrantYou should probably assert that it returns a simple equality.01:06
wallyworld_ok, will look into doing that01:06
wallyworld_will finish what i'm on first01:06
wgrantSure01:07
lifelessloc - http://www.ohloh.net/p/launchpad01:08
wgrant_dbify_value and _dbify_column in lp.services.database.bulk show some of the Storm molestation you might desire.01:08
* wgrant needs a reviewer for https://code.launchpad.net/~wgrant/launchpad/what-the-distromirror/+merge/106086 at some point (non-urgent now)02:10
wgrantwallyworld_: +        <div id='information-type-description' style='padding-top: 5px'>Everyone can see this information.</div>02:18
wgrantIsn't that too hardcoded?02:18
wallyworld_huh? that's template which is replaced02:18
wgrantBy JavaScript.02:19
wallyworld_like we do for the rest of our TAL02:19
wallyworld_yes02:19
wgrant+      This report contains <strong id="information-type" tal:content="view/information_type"></strong> information&nbsp;02:19
wgrant+        <a class="sprite edit" id="privacy-link" tal:attributes="href link/path" tal:condition="link/enabled"></a>02:19
wgrant+        <div id='information-type-description' style='padding-top: 5px'>Everyone can see this information.</div>02:19
wgrantThe information_type title will be replaced if it's non-public, but the description will not.02:19
wgrant(before the JS loads)02:19
wallyworld_hmmm. i think you are right02:20
wallyworld_i should fix that02:20
wallyworld_grumble. too many branches open02:21
cjwatsonSounds like an error message from Perforce.02:23
* cjwatson eyes his branch to allow granting per-pocket upload permissions. It's passing tests. I'm not sure I quite believe it can be this easy.02:26
wgrantcjwatson: It's very easy.02:27
wgrantQueue perms are a bit harder.02:27
wgrantBut not by much.02:28
cjwatsonI wonder if this would allow nuking ubuntu-security as a celebrity.  (Probably not quite since (a) they have to move over to copyPackage and (b) I have to figure out how to save them from having to manually approve all their copies.)02:28
wgrantThat was the plan.02:29
wgrantIt's only a celebrity so they can have launchpad.Append on the primary archive, to use syncSource.02:29
cjwatsonOh and copyPackage probably needs to learn how to do the librarian republishing dance.02:29
wgrantIt should already do that.02:29
wgrantBut that needs testing.02:30
cjwatsonOK, that helps.02:30
wgrantIt's in the core copy infrastructure these days.02:30
cjwatsonModulo lies about the db revision, does http://paste.ubuntu.com/991705/ look plausible?  I'm concerned that the constraint modification there is wrong, but there's no MODIFY CONSTRAINT in pg.02:30
wgrantcjwatson: Seems sort of reasonable, unless you want universe queue admins.02:31
wgrantIn which case you want component+pocket.02:31
wgrants/queue admins/SRU admins/02:32
cjwatsonI don't.02:32
StevenKcjwatson: COMMENTs are usually added to database/schema/comments.sql02:33
cjwatsonI was more concerned whether DROP/ADD CONSTRAINT was remotely sane.02:33
wgrantcjwatson: That's fine, the table is small.02:33
cjwatson$ grep COMMENT database/schema/patch-2209-* | wc -l02:33
cjwatson1202:33
wgrantcjwatson: It's a problem on large tables until PG 9.202:33
wgrantStevenK: It can be either now02:33
StevenKBleh02:33
StevenKcjwatson: grep -c ? :-)02:33
cjwatsonpicky picky02:33
StevenKHaha02:33
cjwatsonAnyway, no, that's a per-file count02:34
cjwatsonWell, in that case does anyone fancy allocating me a DB patch number for this?  I need sleep shortly but I could get at least the DB side of this going.02:35
cjwatsonwgrant: the librarian privacy bits only seem to be driven from UnembargoPackage, looking at packagecopier.py02:35
wgrantcjwatson: I'll grab a patch number.02:36
cjwatsonUnembargoSecurityPackage that is02:36
wgrantcjwatson: You're missing a crucial piece of information.02:37
wgrantcjwatson: Launchpad is not sensible.02:37
wgrantscripts.packagecopier is also called by model.queue02:37
wgrantWhen realising copies.02:37
StevenKcjwatson: You can also look at lp:~launchpad/+junk/dbpatches and ask someone to allocate you a patch number you pick.02:37
wgrantAh, but PCJs skip that :(02:37
wgrantbigjools: !!!02:37
bigjoolswhat02:38
wgrantDDs left us with four inconsistent copiers and it makes me sad.02:38
cjwatsonAh, I missed the call in realiseUpload02:38
wgrantcjwatson: That's how syncSource works.02:39
wgrantWhen it sees there are private files it produces a delayed copy.02:39
wgrantWhich is actually a PackageUpload.02:39
cjwatsonThe direct/delayed copy nomenclature refuses to fit into my head for some reason.02:39
wgrantcjwatson: 2209-18-102:39
cjwatsonThough I can see how it makes sense.02:39
StevenKCan we destroy delayed copies yet?02:39
wgrantIt doesn't make sense.02:39
wgrantStevenK: No, mostly because of this particular thing.02:40
cjwatsonwgrant: I'm adding a column, is that allowed to be -1?02:40
StevenKwgrant: Yes. :-(02:40
wgrantcjwatson: Yeah, the notes on -0 have been a lie since October.02:40
wgrantcjwatson: All patches are equal.02:40
wgrantAnd none are more equal than others.02:40
cjwatsonI've been rather confused, since the last time I asked for a patch number for ADD COLUMN lifeless allocated me a -0, and I figured he knew what he was doing.02:41
wgrantWhen was that?02:41
wgrantHe probably just opted to start a new series.02:41
cjwatson2012-05-0802:42
wgrantNot specifically for a -002:42
StevenK2209-18-0 cjwatson      Add packageset.score.02:42
wgrant'cause I deploy -1 patches that add and drop tables and columns all the time.02:42
StevenKHeh, 19-0 is already wgrant's.02:42
lifelesswe're at +4K over 5 months now, thats much better02:52
lifeless+45K for the same period a year earliy02:53
wgrantA fair bit of that will go away with the next DB refresh, too.02:54
lifeless\o/02:56
lifelessthe encouraging thing is that its a whole OOM02:56
lifelessvs say 75%02:56
lifelesswhich would have a different and sadder explanation02:56
lifelesscjwatson: are you also in perth this weke ?02:57
cjwatsonlifeless: No, just insomniac02:57
cjwatsonIs there some kind of event in Perth then?02:57
bigjoolsthat is particularly insomniac at 4am03:04
wallyworld_wgrant: the storm NEWS file seems out of date. the one in our lpwithnodatetime fork i mean. do we not need to update that if we package a release?03:18
wgrantWe don't ever actually release, we just package snapshots.03:19
wgrantI think it's up to date...03:19
wgrantwallyworld_: Why are you patching Storm?03:19
wallyworld_to make get_where_for_local work more efficiently and to handle single values and lists03:20
wallyworld_so we don't have to construct an Or expr manually in the calling code03:20
wallyworld_or worry about single or composite keys03:21
wallyworld_so it reduces down to one line in the calling code03:21
wallyworld_the work is done, i just need to package03:21
wgrantMmm, I'd just do it in our tree. There's already a couple of functions that poke the necessary bits. None of this is exposed in Storm's public API03:21
wgrantAh03:21
wgrantWhat's the diff?03:22
wallyworld_wgrant: a bit easier to read a straight cut and paste https://pastebin.canonical.com/66227/03:25
wgrantwallyworld_: Won't that break if I have a composite primary key and say "Foo.bar == (Bar.pk1, Bar.pk2)"?03:27
wgrantWhich IIRC works now03:27
wallyworld_hmm. might do. i'm not 100% familiar with how == is parsed03:29
wallyworld_i could add logic to handle that03:29
wallyworld_i was going to run the storm tests to see what broke03:30
wgrantI would just add a separate function03:30
wgrantWell, method if you want it in Storm itself.03:30
wgrantRather than overloading the existing one03:30
wgrantWhen it can probably already take an iterable.03:30
wallyworld_the implementation uses things like self.local_keys which are internal so i think i'd prefer it to be in storm. but we could do it in our tree if we wanted03:31
wgrantSometimes there's little choice but to poke in the internals, because there's no way to access this internally.03:32
wgrantI mean, look at the caller already :)03:32
wgrantcomp._relation03:32
wgrantIt already touches Storm inappropriately.03:32
wgrantNo way to access this *externally*, that is03:32
lifelesswe should push as much of this into storm as we can03:33
lifelessthe in-tree storm stuff shouldn't be, mostly.03:33
wgrantSure, but that involves talking to Storm and working out how to expose these private things sensibly.03:33
wgrant... or switching to SQLAlchemy, but I digress.03:33
wallyworld_i wish we weren't on a fork of storm03:34
wgrantThe fork is very small.03:34
wallyworld_so if i do this change, do i just push it to our fork, or do i also get it merged into trunk?03:34
wgrantIt's just got a couple of lines of Datetime stuff removed, and the With stuff added.03:34
wgrantwallyworld_: Also merge it into trunk.03:34
wgrantWe don't want to diverge any further than we have to.03:35
wgrantWhich means that if Storm doesn't accept it quickly, I'd keep it in our tree instead.03:35
wgrantAlthough Storm development has stalled enough that conflict resolution isn't too bad.03:35
wallyworld_the issue here is that i would be adding a method which is not exposed publically which we are calling03:35
wallyworld_and so asking for it to be added to trunk would be unusual03:36
wgrantRight.03:36
wgrantExactly.03:36
wgrantWhich is why it shouldn't be in Storm, unless it's part of a larger strategy to expose this stuff.03:36
wallyworld_i really don't want to go down that path right now03:36
wgrantWhich is why I did bulk.create()'s stuff in LP, not Storm.03:36
wallyworld_i might stick it with the rest of our storm stuff03:37
wgrantThere's no reason to do that.03:37
wallyworld_hide it under the carpet03:37
wgrantAll it does is make things more awkward.03:37
wgrantThe stuff in there is only there because it has to be in core, or monkeypatching everywhere.03:37
wgrant_get_where_for_local_many can easily be implemented as an isolated function in our codebase.03:37
wallyworld_well the alternative is to continue divirging our fork03:37
wgrant13:37:06 < wallyworld_> i might stick it with the rest of our storm stuff03:38
wgrantIsn't that what you meant?03:38
wgrantOr you mean in like lp.services.database? That's where I'd put it.03:38
wgrantI thought you meant in the fork :)03:38
wallyworld_yes, that's what i meant03:38
wallyworld_lp.services..03:38
wgrantRight.03:38
wgrantThere's already very similar stuff in lp.services.database.bulk03:38
wgrantI use _relation there03:38
wallyworld_at least then also the reference to _relation is shoved off to a helper03:39
wgrantPrecisely.03:39
wgrant(bulk.create() uses it to take objects and Reference columns and work out the relevant underlying columns and values -- exactly what you're doing here)03:39
wallyworld_ok, will do that. might not get it done before i have to duck out to take the kid to his occupational therapy session. but will get it done today03:40
wgrant:)03:40
wallyworld_then the performance issue should be fully squashed i hope03:40
wgrantYup03:40
wgrantSorry for misleading you, I forgot it was an unbatched page.03:41
wallyworld_it seems to work on prod now but is sliggish03:41
wallyworld_sluggish03:41
wgrantThought we were talking like 75 :)03:41
wgrantYeah03:41
wallyworld_75 what?03:41
wgrant75 bugs03:41
wgrantNot 77003:41
wgrantIt plans 75 ORs with no trouble at all03:41
wallyworld_ah, right. no need to apologise.03:41
wallyworld_and 700+ is way too many anyway. once we get stuff cleaned up, that will surely go away03:42
wallyworld_once we move to policy grants03:42
wgrantWeeell03:43
wgrantThere'll still be some big stuff, probably.03:43
wallyworld_once we find it, we can add batching :-)03:44
wgrantHeh03:44
StevenKlifeless: It's *so* handy that testr --version or -V don't work.03:51
StevenKAnd I think testr run --failing is running every test03:53
lifelessStevenK: dpkg -l testrepository04:01
StevenKwgrant, wallyworld_: https://code.launchpad.net/~stevenk/launchpad/branch-use-information_type/+merge/10610904:50
wgrantAha, the LoC offenders are revealed!04:56
StevenKHm?04:57
wgrantLinaro looks to be +3400 in total :(04:57
StevenKIs there a breakdown by squad/person?04:57
StevenKwgrant: information_type is fully populated on production, which means we can depend on it.05:17
wgrantStevenK: Oh, bah, indeed.05:22
wgrantForgot that.05:22
wgrantStevenK: Does it respect transitively_private?05:22
wgrantI suspect not.05:22
StevenKwgrant: In terms of your other comments, http://pastebin.ubuntu.com/991832/05:22
wgrantStevenK: You untaught the factory about information_type entirely?05:23
StevenKHm, so I did.05:23
StevenKBah, .transistionToInformationType respects the rules in terms of branch policy. :-/05:27
bigjoolspackageset.score is a terrible name :(05:35
StevenKwgrant: http://pastebin.ubuntu.com/991845/05:35
wgrantStevenK: Now the factory won't set information_type if you pass private but not information_type.05:41
wgrantAnd information_type silently clobbers private.05:41
StevenKAnd if you pass in information_type=InformationType.EMBARGOEDSECURITY, private=False ? :-)05:44
wgrantStevenK: assert05:47
wgrantDon't just silently clobber.05:47
StevenKwgrant: http://pastebin.ubuntu.com/991859/05:53
wgrantStevenK: You can't spell specify, and that check doesn't handle the case above.05:54
StevenKYes it does?05:55
StevenKIn [2]: b = factory.makeBranch(information_type=InformationType.EMBARGOEDSECURITY, private=False)05:55
StevenK---------------------------------------------------------------------------05:55
StevenKAssertionError05:56
StevenKBut it doesn't complain with private=True. Strange05:57
wgrantEr, yeah, that's the case it doesn't complain in.05:58
wgrantYou want both to default to none.05:58
wgrantAnd at most one of them to not be none.05:58
StevenKRight, fixed.06:00
StevenKwgrant: Now that we've spent 30 minutes talking about the factory, what was your concern with respecting transitively_private?06:01
wgrantStevenK: eg. transitively_private or private gets set on a stacked-on branch, it won't propagate up.06:19
StevenKwgrant: Yes, I'm not sure what happens in that case.06:22
StevenKI do wonder how many layers of stacked_on we have in prod06:23
StevenKwgrant: Shall I land it, or we can talk it over on the call tomorrow?06:25
wgrantStevenK: You need to investigate and probably test how it interacts with stacking.06:28
wgrantThere's not much to discuss yet.06:28
lifelessStevenK: I think 7 is the highest06:38
lifelessanyone looked at http://optimizely.appspot.com/features - specifically whether its js will work if we self host ?06:39
stubDoes a public branch stacked on a private branch leak any information? Is it possible to retrieve revisions only in the private branch via the public branch?06:42
lifelessno and no06:43
lifelesshowever, the public branch will be unusable06:43
stubah, thought it was a security issue rather than an its broken issue :)06:43
lifelessstacking: an ancient african word meaning 'we made a mistake here'06:50
lifelessstub: catchup?07:23
stublifeless: sure. let me scare up my mic07:24
lifelessstub: I should be logged into skype; if not tell me here and I'll kill-9it07:29
stublifeless: I don't see you07:29
lifelessstub: grah, yeah its hung07:44
=== 13WAA2ZBF is now known as wallyworld
lifelessstub:07:55
lifelesshttp://reorg.projects.postgresql.org/07:55
lifelessstub: http://pgfoundry.org/projects/reorg/07:56
wgrantOmg07:59
wgrantCLUSTER, but usable?07:59
wgrantGive me it now07:59
stubCLUSTER, but scary08:02
stubactually, not that scary. Looks like it creates a holding table, adds triggers to the source table, pours data into the holding table, merges in the delta, swaps holding table into place.08:07
stub'swapping into place' is the scary bit as it modifies the system catalog directly so all the dependencies don't notice the move (foreign key references, views etc.).08:08
stubLeading to lovely things like: Bugfix: VIEWs and FUNCTIONs could be corrupted that used a reorganized table which has a dropped column.08:08
lifelessstub: I'm back08:09
lifelessstub: http://www.pretotyping.org/08:23
lifelessok, night all08:37
StevenKrick_h_: Oh sigh. I see what was broken in bug 1000282.08:44
_mup_Bug #1000282: Uncaught TypeError on translations series +imports <combo-loader> <javascript> <qa-needstesting> <Launchpad itself:Fix Committed by rharding> < https://launchpad.net/bugs/1000282 >08:44
jamestunnicliffegmb: Any estimate on https://code.launchpad.net/~dooferlad/launchpad/upcomingwork_show_incomplete_bp/+merge/105846 being reviewed? If you can't get around to it today I would like to open it up to another reviewer since it is getting urgent.10:10
gmbjamestunnicliffe: I'll have an updated patch for you by 1pm.10:10
jamestunnicliffegmb: Supurb!10:10
gmbApologies for the delay; post-UDS stuff has been eating into my time.10:10
jamestunnicliffegmb: superb even :-)10:11
jamestunnicliffeOh, I can't see this morning10:11
jamestunnicliffeGood start to the day!10:11
rick_h_StevenK: yea, nothing big. I'm surprised there aren't more of those10:33
rick_h_StevenK: at some point I'll get back to that AST branch of the combo.meta that will hopefully not be as fragile with the parsing, which isn't all *that* fragile so far10:34
jelmercjwatson: Did you have any plans to put your loc script for review? If not, I can have a stab at doing that now.10:46
wallyworld_anyone else having issues with branches not being scanned?10:55
cjwatsonjelmer: https://code.launchpad.net/~cjwatson/lp-dev-utils/loc-delta/+merge/106080 (which is awaiting scanning for the latest change that renames it to the slightly more explanatory loc-contributions, c.f. wallyworld_'s comment ...)11:02
* wallyworld_ has 3 branches which have not been scanned11:02
wallyworld_all within the last 45 minutes or so11:02
wallyworld_i tried forcing a rescan and also pushing to a new test branch11:03
cjwatsonsounds like something to ask ops about, since that roughly coincides with the 9.1 upgrade11:07
cjwatsonAnyone have thoughts on plausible things I can do with bug 1000570?11:08
jelmerbug 1000570 ?11:09
cjwatsonbah, botless.  it's a column rename, which I think is reasonable; the code change that uses it has just landed but not yet been QAed or deployed11:09
cjwatsonwondering if there's any more elegant approach than backing out the code change, FDTing a rename, reapplying code with rename11:10
gmbjamestunnicliffe, Can you tell me how to get something to appear in the work items for a Person in Launchpad.dev so that I can test my  solution?11:10
gmbI just want to verify it before pinging it back to you.11:10
jelmercjwatson: I guess you could just rename it in python and leave it as is in the db.11:11
cjwatsonI could, not sure that would please bigjools though :)11:11
cjwatsonseems like this is probably about the best opportunity to get the naming right, and there isn't a desperate rush to get this deployed11:11
jelmercjwatson: On the other hand, it's marked low so it might be sensible to just leave the bug open until somebody touches this bit of the code again.11:12
jelmercjwatson: and renaming the zope bit of it at least means we don't break API users in the future.11:12
cjwatsonI guess I can ask bigjools what he thinks when he's next online.  That was easier before he inconsiderately moved. :-)11:13
jelmer:-)11:13
cjwatsonI mostly don't want to do renaming work in one direction to find that it's insufficient and it would've been easier to back out11:15
cjwatsonIYSWIM11:15
jelmercjwatson: fair enough; indeed best to ask bigjools what he means though, the rest of us can only speculate :)11:19
cjwatsonhttps://code.launchpad.net/~cjwatson/launchpad/packageset-score/+merge/105915 has the other half of his comments11:19
cjwatsonjelmer: did you see my loc merge request above that you were asking about?11:20
jelmercjwatson: yep, playing with the code atm11:21
wallyworld_cjwatson: branch scanning seems ok again12:06
cjwatsonwallyworld_: oh good, thanks12:13
wallyworld_np12:14
cjwatsonCan somebody set https://code.launchpad.net/~cjwatson/launchpad/db-pocket-permissions/+merge/10609112:17
cjwatsonto Approved so I can land it?  Looks like it has sufficient review.12:17
rick_h_cjwatson: looking12:18
rick_h_cjwatson: can you set a commmit msg please?12:19
cjwatsonOh yes, done.  Thanks, I'll go ahead and land that now then12:19
rick_h_ok12:19
=== matsubara-afk is now known as matsubara
danilosgmb, did you manage to get workitems to show up on upcoming work page?12:39
jamestunnicliffegmb: Apologies, had a few things to get done over lunch and just missed you. There is a script that didn't make it into trunk to create some users with outstanding work items that I can pastebin you if you want.12:40
danilosgmb, easiest is to create a blueprint, target it to a milestone (with target date set to a date in nearby future), and then add a few workitems in the workitem box on the BP page (eg. "[gmb] Sing the song of love: TODO")12:41
jamestunnicliffegmb: Just tested your version - it works :-)12:47
salgadojamestunnicliffe, oh, I have a script like that... it does create loads of stuff, and using WI titles from production even12:50
salgadohttp://paste.ubuntu.com/992291/12:50
jamestunnicliffesalgado: Cool - that is more extensive than the one I have. Thanks!12:51
salgadonp :)12:52
wallyworld_sinzui: hi, i'm about to go to bed but it appears there's a timeout issue submitting mps (i have one i was hoping for you to review). seems coincident with the postgres upgrade. could you ping someone for me to see what's up?12:59
wgrantwallyworld_: OOPS ID?13:02
gmbjamestunnicliffe: Okay, so, we need to find something to offset the change with. I'll be looking this afternoon and will try to get this into EC2 for you before my EoD.13:02
wallyworld_wgrant: no oops is shown, just a simple dialog13:02
* gmb -> grabbing a late lunch; bbiab.13:02
jamestunnicliffegmb: Don't worry about LOC. danilos is going to do a big delete soon.13:03
gmbjamestunnicliffe, danilos: How soon is "soon"? I'd like to be able to point lifeless at it when he asks me...13:03
danilosgmb, https://code.launchpad.net/~danilo/launchpad/kill-feedback-requests/+merge/10611913:04
danilosgmb, I'd be happy to get a review if that works for you :)13:04
danilosgmb, (i.e. to make it "sooner" :)13:04
gmbdanilos: Then I'll take a look this afternoon :)13:13
danilosgmb, thanks13:13
salgadojamestunnicliffe, I just saw that https://launchpad.net/~linaro/+upcomingwork is broken.  maybe you guys know about it already...13:15
jamestunnicliffesalgado: no, that is new to me.13:17
jamestunnicliffesalgado: is there backtrace or other info available in a log somewhere that could help me recreate it? I see that the linaro team has no blueprints, but I would hope that condition is already covered by a test.13:20
salgadojamestunnicliffe, you'll have to ask somebody from the LP team for the backtrace. I don't have the rights to see it anymore13:22
jamestunnicliffegmb: Can you get those logs ^^ or pass the request on?13:23
gmbjamestunnicliffe: There will be something soon; I'm waiting for the OOPS data to sync so I can look at it.13:25
jamestunnicliffegmb: Thanks.13:25
wgrant    Module lp.registry.browser.person, line 4469, in initialize13:30
wgrant    100.0 * total_done / float(total_items))13:30
wgrantZeroDivisionError: float division<br />13:30
wgrantjamestunnicliffe, salgado: ^^13:30
jamestunnicliffewgrant: Thanks. Should be an easy fix!13:31
wgrantjelmer: Thanks.13:36
jelmerwgrant: anytime13:39
jelmerwgrant: how are reviews generally done these days, are there still on-call reviewers?13:39
mgz...why is wgrant still awake?13:40
wgrantjelmer: Yeah, there's an OCR schedule. But it's a bit empty sometimes, since some squads are doing other things.13:41
wgrantmgz: It's not quite midnight :)13:41
wgrantjelmer: https://dev.launchpad.net/ReviewerSchedule13:41
jelmerwgrant: thanks; I'd seen it but was curious if it was still accurate13:41
wgrantIt's meant to be.13:42
jelmerI guess I should find myself a new slot.13:42
czajkowskimgz: https://dev.launchpad.net/ReviewerSchedule13:42
wgrantAnd is vaguely.13:42
wgrantjelmer: You may wish to strike out Orange for now13:42
* czajkowski and wgrant are in competition as to who can stay up the latest 13:42
jelmerI'll take Thurs/Europe13:45
=== jelmer changed the topic of #launchpad-dev to: http://dev.launchpad.net/ | On call reviewer: jelmer | Firefighting: - | Critical bugs: 3.47*10^2
wgrantThanks :)13:46
* jelmer heads out for belated lunch and to get a new headset14:06
mgzif you want to test it when you get back I brought mine into town :)14:06
=== jcsackett changed the topic of #launchpad-dev to: http://dev.launchpad.net/ | On call reviewer: jelmer, jcsackett | Firefighting: - | Critical bugs: 3.47*10^2
czajkowskijcsackett: any idea how you add content to the download section of a project page ?14:31
jcsackettczajkowski: i *think* your project needs to have a release, and on the release page there should be an "add download" button. but that information may be outdated.14:34
jcsackettsinzui: can you confirm/correct that? ^14:34
jelmermgz: feel like doing some headset testing?14:34
mgzmumblin' it up now14:36
czajkowskijcsackett: thanks14:37
jcsackettczajkowski: you're welcome. hope i'm right. :-P14:42
popeyczajkowski / jcsackett ok, so how does one do the release bit?14:42
czajkowskijcsackett: I was trying to find out for popey for his project14:44
jcsackettczajkowski: dig. popey, what project?14:44
popeyhttps://launchpad.net/ubuntu-online-tour14:45
jcsackettpopey: what are you trying to put up for downloads? b/c at a guess you're not trying to put up a tarball package of your code.14:47
popeyi am14:48
popeyubuntu-online-tour_0.11.tar.gz <- that :D14:48
jcsackettah, fantastic.14:48
jcsackettthen let's see if i can remember all of this right from the days of the registry team. :-)14:48
gmbjamestunnicliffe, salgado: https://pastebin.canonical.com/66273/14:49
gmb(that OOPs from earlier)14:49
jamestunnicliffegmb: I don't have access to the pastebin, but I am working on it (bug #1000787)14:49
_mup_Bug #1000787: upcomingwork page fails when there are no work items <Launchpad itself:Confirmed for dooferlad> < https://launchpad.net/bugs/1000787 >14:49
gmbjamestunnicliffe: Ok, cool.14:50
jamestunnicliffegmb: If the backtrace doesn't contain anything sensitive, perhaps post it as a comment on the bug?14:50
popeyjcsackett: thanks! help is appreciated14:50
gmbjamestunnicliffe: Way ahead of you...14:50
jamestunnicliffegmb :-)14:51
* jelmer waves to allenap 14:51
allenap\o jelmer14:52
jcsackettpopey: ok, so you can add a release on the series for your project, in your case https://launchpad.net/ubuntu-online-tour/trunk.14:55
jcsackettin the "Milestones and releases" section you'll see a "+ Create release" link. that will require you to make a milestone--since you're releasing a tarball for 0.11, that's a likely name for your milestone. the option to do that will appear in the form for creating a release.14:56
jcsackettpopey, once you've created the release (and i think most of the information is optional for both it and the milestone) you will find the add download button on the release's page under the Download files for this release heading.15:01
popeyyay!15:03
popeyawesome, thanks!15:03
jcsackettpopey: you're welcome. :-)15:10
cjwatsonI can't see to do what Julian's asking for in bug 1000570.  I can see how to export a property on the webservice with a different name, but I think Julian's asking for LP-internal code also to refer to this variable as relative_build_score, and only the column to be called score.  Is that possible?  I can't seem to find an example.15:36
_mup_Bug #1000570: "Packageset.score" is badly named <tech-debt> <trivial> <Launchpad itself:Triaged> < https://launchpad.net/bugs/1000570 >15:36
james_wcjwatson, you can rename the attribute on the model and specify the column to use IIRC15:54
james_wjust trying to remember an example in the codebase already15:54
james_wah, set name="score" in the constructor15:55
james_wrelative_build_score = Int(name="score")15:56
cjwatsonjames_w: oh, cool, thanks.  name= was hard to grep for, I actually tried and thought I didn't see anything16:09
cjwatsongrepping for ' [A-Z][a-z]*(name=' finds examples though16:09
cjwatsonOCR: could I have a review of https://code.launchpad.net/~cjwatson/launchpad/packageset-score/+merge/106220?16:30
cjwatsonhmm, jelmer and jcsackett may not have "OCR" on highlight, I guess :-)16:37
* cjwatson upgrades dogfood for some QA16:38
barrygary_poster: ping16:46
gary_posterbarry, pong.16:53
barrygary_poster: hi.  you probably heard about our py3 plans for 12.10, right?  i'm starting down the long arduous road of porting launchpadlib to python 3.  first stop is lazr.restfulclient.  i just wanted to coordinate to make sure i'm not duplicating effort, and so that we can eventually get releases of py3 compatible libraries.16:54
barrygary_poster: i have a few questions for you, but want to first see if you have any questions for me :)16:54
gary_postercool, barry, yeah.  Well, I'm not sure whom you need to coordinate with, but it is probably not me.  flacoste or lifeless are the obvious candidates.  I'm happy to try and help coordinate the coordination though ;-)16:56
gary_poster(since the squad rotation, my connection with lazr.* is not much more than anyone else's, and my visibility to things related to it and plans for it are much less)16:57
barrygary_poster: cool.  i'll work with flacoste and lifeless (already working with him on testtools and testresources, via jseutter).  quick question: just how married are y'all to buildout for libraries like lazr.restfulclient?16:57
gary_posterbarry, um, no idea really.  another question for lifeless.  From my perspective as long as the approach specifies the version numbers for dependencies in a python friendly way (i.e., setup declares minimal dependencies and some other file specifies dependencies for shared testing, equivalent to buildbot versions, I'm happy enough.  I think pip has had something like that for years now.16:59
gary_postermm, the parenthetical phrase was supposed to end after "equivalent to buildbot versions" :-P17:00
barrygary_poster: cool, thanks.  i'll try to chat with lifeless when he gets online17:01
gary_postercool, thanks for the py3 work barry17:01
barrygary_poster: np!  i'm not volunteering to port launchpad just yet :)17:01
gary_posterheh, darn :-)17:01
jamestunnicliffesalgado: Having a problem with https://pastebin.canonical.com/66273/ is I can't recreate it in a test, or on a dev instance. In fact, I have looked through the code it calls and have no idea how total_items (and, I assume, total_done) are 0.17:04
jamestunnicliffesalgado: Any inspiration appreciated :-)17:04
cjwatsonbarry: it had occurred to me whether it might be worthwhile to do the obvious basic porting of Launchpad (print functions and the like) and get some good practices instilled early, even if a full port is a ways off17:07
barrycjwatson: certainly making it `python2.7 -3` compatible would be a great first step17:07
cjwatsonIIRC maas has tooling to use the usual __future__ imports all over the shop17:08
salgadojamestunnicliffe, not really, can't think of anything.  but you could craft a script that just calls getWorkItemsDueBefore('~linaro', ...) and get somebody to run it against the staging DB17:09
salgadojamestunnicliffe, that would only work if you get the same OOPS on staging, though17:10
jamestunnicliffesalgado: Thanks - it is something to try at least!17:11
jamestunnicliffesalgado: https://staging.launchpad.net/~linaro/+upcomingwork - works on staging :-(17:16
=== Ursinha` is now known as Ursinha
jcsackettcjwatson: r=me your MP. if you could you add a commit message to it, i will try to get it out to land today.17:56
cjwatsonjcsackett: I have landing access these days, so I can do that, although I generally need somebody in ~launchpad to set Status to Approved first17:59
jcsackettcjwatson: i can do that, didn't realize you had landing rights or i would have already done it. :-)18:00
cjwatsonI've set a commit message, thanks18:00
cjwatsonI'm the weirdo who's in set(PQM - ~launchpad)18:00
jcsackettcjwatson: that is peculiar. you're all set on the MP now.18:00
cjwatsonGreat, thanks18:00
=== skaet_ is now known as skaet
daker-cloudhi i am looking for easy to fix bugs(html/css) anyone can pointe me?19:37
=== kirkland` is now known as kirkland
daker-cloudczajkowski: launchpad superwomen help :)19:49
=== salgado is now known as salgado-afk
rick_h_sinzui: did you fix history? /me looks up address for the "thank you beverage"21:18
sinzuiI did fix it21:18
rick_h_that will be awesome21:18
sinzuimsie has a deep bug: link.pathname is relative21:18
sinzuiI wish Lp believed my branch has revisions in it to generate the diff21:19
rick_h_bah, I hate it when adding a simple thing requires adding complex tests21:20
sinzuiThe tests were easy actually. Most of my time as in a debugger in chromium and msie to locate the point they diverge21:21
rick_h_sorry, talking about this small add to lazr.restfulclient. My issue isn't in a current set of tests so hav to add a bunch of crap21:22
rick_h_waiting for your diff to load on this one so I can peek at the changes, curious how it ended up working out21:22
sinzuirick_h_, I think I am going to repush the branch to a new location...overwrite said nothing needed to be pushed21:24
sinzuirick_h_, http://pastebin.ubuntu.com/993138/21:24
rick_h_sinzui: doh, sucky21:24
rick_h_thanks for the link, I'll peek at it tonight.21:24
sinzuijcsackett, do you have a few minutes to review https://code.launchpad.net/~sinzui/launchpad/bug-listings-urls/+merge/10626621:32
barrylifeless: ping21:39
lifelessbarry: otp21:39
=== jcsackett changed the topic of #launchpad-dev to: http://dev.launchpad.net/ | On call reviewer: - | Firefighting: - | Critical bugs: 3.47*10^2
barrylifeless: cool.  just ping me when you're free (if in the next hour)21:40
lifelesskk21:40
sinzuiian is this a start? https://code.launchpad.net/~wallyworld/launchpad/subscribe-grants-access/+merge/10627722:13
jelmerare code import failures generally considered critical?22:25
jelmergenerally that doesn't seem to be the case, but bug 932463 is22:25
_mup_Bug #932463: CVS code import failing <canonical-losa-lp> <code-import> <regression> <Launchpad itself:Triaged> < https://launchpad.net/bugs/932463 >22:25
lifelessbarry: hi22:54
lifelessbarry: I'm Off the phone22:54
barrylifeless: haha!  i just sent you an email :)22:54
lifelessjelmer: import failures per se - no; a regression in imports yes.22:54
barryliterally 5 seconds before you pinged me22:55
lifelessso short answer22:55
lifelessno resources22:55
lifelessthe team can and will review22:55
lifelesswe need to keep python 2 compat for the next 5 years.22:55
jelmerlifeless: thanks22:56
barrylifeless: python 2.6 minimal at least?22:56
lifeless2.6.5 (lucid) through to 201522:57
lifeless2017 for python 2.722:57
barrythat's fine.  nothing < 2.6 makes life much easier22:57
lifeless(basically we need to be able to do SRU's or fixes for support Ubuntu releases)22:57
lifelessif we fork into a 2 and a 3 branch that becomes harder22:58
lifelessbut it may be cheaper overall; its hard to tell22:58
barryyep.  i'm not planning on dropping python 2 support.  i think we can support both with a single code base22:58
jelmerlifeless: where regression is an actual regression in the code I assume, not a code import that used to succeed but now happens to trigger a particular bug?22:58
lifelessmuch of our stack isn't packaged and has little reason to be22:58
barrylifeless: i only care about the parts of that stack that end up on the desktop cd images.  launchpadlib is the tip of the iceberg for that.22:59
lifelessjelmer: right, so if import A suddenly has submodules added and fails, its not a regression. If extended file modes stops working its a regression.22:59
=== matsubara is now known as matsubara-afk
jelmerlifeless: fair 'nough22:59
barrylifeless: of course, what makes things trickier is trying to run the test suite under python 3 also.  that usually triggers a port of all the test dependencies.  i'm personally not comfortable testing only on py2, but it does increase the porting effort.23:00
lifelessbarry: yah. It would be nice if python packaging were more robust and safer to use on live systems ;)23:00
barrylifeless: and buildout/pypi is better? :)23:00
lifelessbarry: hugely so23:00
lifelessbarry: and its an upstream root cause :)23:01
* barry sighs23:01
barrylifeless: testtools and testresources, any eta on py3 compatible releases?23:02
jelmerbarry: testtools has a py3 compatible release that is packaged23:02
lifelessbarry: I got busy this week, haven't gotten to the reviews.23:02
lifelessbarry: other than noting the various issues and bugs :)23:02
jelmerbarry: it looks like python-testtools mostly just needs a sync from Debian (it's got a custom version in Ubuntu without py3 support)23:03
lifelessbarry: a note for LP things as well - please don't drop huge boilerplate in the projects; what we have is terrible enough :)23:03
barryjelmer: hmm, i guess jseutter's branch isn't strictly necessary then23:03
barryjelmer: oh, that's easy then23:04
* barry can do that23:04
barrylifeless: right.  some of the packages use ez_setup.  in those cases we need to switch to distribute (or drop ez_setup).  if it doesn't use it, i won't add it23:04
lifelesscool23:05
lifelessI loath the use of ez_setup too, FWIW.23:05
barryme too23:05
lifelessLP's actual needed thing is for buildout to work.23:05
* barry nods23:05
lifelessbeyond that, we don't care, if you can nuke ez_setup at the same time (while retaining compat with lucid for deploys) \o/23:05
lifelessFor now though, we need buildout to work on lucid precise and quantal23:06
barryfun23:06
lifelesswith python 2.6.5 on lucid and 2.7.x on precise and up23:06
lifelessonce we have pg9.1 behind LP, the next step is python 2.7 everywhere using the PPA for lucid23:07
lifelesswe'll still need 2.6.5 compat for client libraries23:07
barrylifeless: oh, i sure hope that'll work :)23:07
lifelessbarry: so do we :)23:08
barrylifeless: okay, thanks.  if there's anything else you can tell me in response to my email, that would be great.  otherwise, i'll just keep pinging you as mps stack up :)23:09
lifelessbarry: hah23:09
lifeless:)23:09
barrylifeless: if you get blocked, ping me.  either i can help, or i can find other folks to chip in too.  foundations team is probably going to sprint on py3 mid-june-ish23:10
lifelesswill do23:11
czajkowskidaker-cloud: whats up23:11
barrythanks!23:11
daker-cloudczajkowski: i am looking for easy to fix bugs(html/css) can you pointe me to someone who can help ?23:12
czajkowskidaker-cloud: um lemmie see23:13
czajkowskilifeless: any thoughts?23:13
czajkowskidaker-cloud: https://bugs.launchpad.net/launchpad/+bugs?search=Search&field.tag=trivial  all those bugs are tagged trivial23:15
czajkowskiperhaps there is one in there23:15
daker-cloudmeans those shouldn't be fixed, right ?23:16
barryjelmer: i'm going to do a sync from sid->quantal of python-testtools 0.9.14-2 which will give us py3 support.  i don't think there's anything to keep from the 0.9.14-0ubuntu1 version23:16
czajkowskidaker-cloud: no they should23:17
jelmerbarry: me neither - and thanks!23:17
barryjelmer: np!23:17
daker-cloudczajkowski: ah ok ok23:17
StevenKjelmer: Did you want to land cjwatson's lp-dev-utils MP?23:17
jelmerbarry: can you perhaps sync subunit too while you're at it?23:18
jelmerStevenK: sorry, yes.. hadn't gotten round to that yet23:18
barryjelmer: sure, let me look23:18
daker-cloudczajkowski: thanks :)23:19
czajkowskidaker-cloud: https://bugs.launchpad.net/launchpad/+bugs?field.tag=easy also that one as well23:20
wallyworld_StevenK: does any of your current work update BranchCollection to use information_type rather than private?23:20
StevenKwallyworld_: BranchCollection? Nope.23:20
wallyworld_StevenK: ok. i'll raise a separate bug for that23:20
wallyworld_i have some XXX in some tests which i'll link to that new bug23:21
czajkowskidaker-cloud: if I'm not around do prod people in here they don't bite and will help you if they can ok23:21
wallyworld_czajkowski: wgrant bites sometimes if he is hungry23:21
czajkowskiwallyworld_: I now owe him about 4 buckets worth of bickies!23:21
wallyworld_if we keep him well fed we are all better off23:22
barryjelmer: hahahah!  subunit's already been sync'd but it's in depwait on python3-testtools :)  that should all get unjammed when the testtools sync is processed23:22
barryjelmer: i'll keep an eye on it tho23:22
czajkowskiwallyworld_: I do wonder if we fed him red bull and sugary sweets what would happen23:22
wallyworld_czajkowski: i can tell you're not american or else it would have been cookies. actually he can legally drink now so maybe a 6 pack of beer instead23:23
jelmerbarry: ah, neat :) I didn't realize the automatic sync mechanism knew what 0build1 was for23:23
jelmerbarry: and thanks23:23
lifelessjelmer: speaking of subunit23:23
lifelessjelmer: daily build breakage :)23:23
wallyworld_czajkowski: nooo. he would never sleep at all if he had red bull23:23
barryjelmer: yep, *build*'s are ignored as deltas by the autosync23:23
daker-cloudczajkowski: ok ok :)23:23
lifelessczajkowski: trivial is indeed a good place to start23:24
czajkowskiwallyworld_: nope I'm Irish :)23:24
wallyworld_awesome. i love ireland23:24
czajkowskiit rains. it's green. it rains :)23:25
jelmerlifeless: whoops, thanks for the reminder23:25
jelmerlifeless: I'll have a look this week23:25
StevenKwgrant: http://pastebin.ubuntu.com/993320/ Was that what you envisioned?23:31
wgrantStevenK: That sort of configuration, but I'm not sure what to do about branch D23:32
bigjoolsczajkowski: you forgot the Guinness bit23:34
czajkowskiheh23:35
StevenKwgrant: Currently the test fails because D remains EMBARGOEDSECURITY.23:37
StevenKwgrant: But we all agree that EMBARGOEDSECURITY stacked on top of USERDATA makes no sense.23:38
wgrantStevenK: Right, the question is what does make sense?23:39
StevenKwgrant: Forcing all of them to USERDATA?23:39
wgrantThat could disclose them inappropriately.23:41
StevenKwgrant: Note that B does exactly that as it stands.23:42
wgrantThis is true.23:43
rick_h_wallyworld_: thanks for the quick review23:44
wallyworld_rick_h_: np. btw, the combo stuff on lp.net rocks. seems so much faster23:44
rick_h_wallyworld_: awesome! glad to hear it.23:44
rick_h_lots that could be done to be made better, but hopefully good start.23:45
wallyworld_rick_h_: so what's the timeframe for the additional optimisations?23:45
rick_h_don't forget to run the combo loader in dev and check out the jsbuild_watch script as well23:45
rick_h_wallyworld_: atm no idea since I'm off on something else for the next little bit23:45
wallyworld_rick_h_: yeah, on my todo list.23:45
rick_h_just working on bug fixes for the combo loader as they come up23:45
wallyworld_rick_h_: perhaps a reminder post to dev list about how to run combo loader etc locally is warranted. just to prod everyone to do it23:46
rick_h_yea, I tried to get jcsackett using it and even I forgot how to use it right.23:46
rick_h_so probably a good idea to email again23:46
wallyworld_rick_h_: it would be nice if you were allowed a bit of slack time to finish it all off 100% since otherwise it will not get done despiet best intentions23:47
rick_h_I should look to see if there's a good way to get the combo loader defaulted to on in dev mode actually, in the dev db data I guess it'd be23:47
rick_h_wallyworld_: yea, I know it. Had hoped to have some of that during maint, but got some higher priority proddings on other things23:47
wallyworld_rick_h_: yes, you need to add the flag and regenerate sample data and commit23:47
wallyworld_rick_h_: i do think we need to dogfood this so if you send the email, i can do the flag if you like23:48
StevenKwgrant: Do you think D -> USERDATA is okay and then I can land this thing?23:48
rick_h_wallyworld_: ok, will do. Working on closing up some work here at the moment and I'll do the email before I hit bed tonight23:49
wallyworld_rick_h_: ok, no hurry. next SOD is fine :-)23:49
wgrantStevenK: I don't think so.23:49
rick_h_wallyworld_: appreciate the assist with the flag bit, I think that'd help a ton.23:49
wgrantStevenK: But it may be,.23:49
rick_h_wallyworld_: heh don't worry about it, working late to get stuff done so I can go away this weekend. rush rush23:49
wallyworld_rick_h_: np, pleased to help. i'm just happy to have this all being used now. bring on yuii 3.5 i say23:49
rick_h_hah! now that would be freaking awesome23:49
rick_h_<3 3.523:50
StevenKAnd then the death of YUI 223:50
rick_h_yep, the calendar widget in 3.5 is shaping up nicely I believe23:50
wallyworld_rick_h_: otp, talk later23:50
rick_h_rgr23:50
rick_h_anyone have permissions to pypi for lazr.restfulclient ?23:53
StevenKI think wallyworld_ may.23:53
rick_h_k, I'll bug him on it later, thanks23:53
wallyworld_rick_h_: what's your pypi user name?23:57
rick_h_wallyworld_: mitechie23:58
wallyworld_rick_h_: you now owner, have fun23:58
rick_h_wallyworld_: ty much sir23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!