/srv/irclogs.ubuntu.com/2010/10/07/#launchpad-dev.txt

=== Ursinha-afk is now known as Ursinha
lifelesswgrant: will look for you in a minute00:55
lifelessmars: oh, you're gone.00:56
lifelesswgrant: cp has been done01:19
lifeless"Julians: Fixes critical bug where arch-independent files are01:19
lifelessgetting erroneously superseded across series boundaries, resulting in01:19
lifelessloss of data for PPA users and incorrect package status in Ubuntu01:19
lifelessSteveKs: Don't copy disabled DASes to the child distroseries during01:19
lifelessInitialiseDistroSeries."01:19
wgrantlifeless: They're both on cocoplum and germanium?01:19
lifelessdunno01:21
HudsonProject devel build (95): STILL FAILING in 4 hr 1 min: https://hudson.wedontsleep.org/job/devel/95/04:12
wgrant!!04:15
StevenK\o/04:15
mwhudsonme likey the shouting04:16
StevenKIt can also do e-mail, a'la buildbot, I've just not configured it04:17
lifeless.oO a hudson04:17
lifelessStevenK: I like twitter myself04:17
* StevenK is ignoring twitter in the hopes it all just goes away04:17
lifelessStevenK: we're organising openid04:17
StevenKlifeless: For 1.378 or 'soon'?04:18
lifelesssoon04:18
wgrantOpenID for what?04:18
lifelesshudson04:18
lifelessStevenK: please pick a different irc nick for our hudson04:19
wgrantIt doesn't support it? That's a bit odd.04:19
StevenKlifeless: Suggestions?04:19
lifelesslpci ?04:19
lifeless42?04:19
lifeless101010?04:19
lifelessback soon04:19
=== Ursinha is now known as Ursinha-afk
LPCIBotProject db-devel build (53): STILL FAILING in 15 min: https://hudson.wedontsleep.org/job/db-devel/53/04:26
StevenKOh, damn, I know why04:27
LPCIBotProject db-devel build (54): STILL FAILING in 32 sec: https://hudson.wedontsleep.org/job/db-devel/54/04:29
wallyworldStevenK: you are going to install the Chuck Norris plugin for the Hudson instance aren't you? :-)04:40
wallyworldhttp://wiki.hudson-ci.org/display/HUDSON/ChuckNorris+Plugin04:41
StevenKI wasn't planning on :-)04:43
wallyworldbut it's soooo cool04:47
wallyworldthat default butler guy is too boring. chuck makes it a lot more interesting04:49
lifelessbrucie!05:22
* StevenK blinks at subunit05:24
lifelessStevenK: the bruce schnier plugin ftw05:31
StevenKBoth of which are completly pointless? :-)05:32
=== almaisan-away is now known as al-maisan
lifelesswallyworld: you have mail06:20
wallyworldlifeless: thanks06:24
poolielifeless: thanks for your post about a flags remote api; but let's put it on that bug?06:26
pooliethat mp is big enough already06:26
lifelesspoolie: sorry :)06:28
poolienp :)06:28
poolieit's an interesting point06:28
pooliei just don't want it lost06:28
lifelesspoolie: perhaps you could copy it across?06:28
pooliesure :)06:28
lifelessthank you06:28
pooliehttps://bugs.edge.launchpad.net/launchpad-foundations/+bug/656031 in case you think of anything else or want to prioritize it06:33
_mup_Bug #656031: want non-storm way to get feature rules <feature-flags> <Launchpad Foundations:Triaged> <https://launchpad.net/bugs/656031>06:33
StevenKlifeless: Are you up for a quick testfix review for db-devel?06:39
wgrantStevenK: You wouldn't happen to know the publisher code, would you?06:41
StevenKwgrant: What about it?06:42
wgrantStevenK: I think the way that it determines which pockets and archs to generate a Release file for is far more complicated than it needs to be.06:43
wgrantAnd I'm hoping that someone who still exists has dealt with it before.06:43
wgrantBut I doubt it :(06:43
StevenKI suspect Julian, maybe al-maisan06:43
wallyworldlifeless: well, 5th time lucky on that sql logging branch. it's in the hands of the ec2 gods again. i've made a sacrifice on an old windows pc to appease them06:44
wgrantSpeaking of landing... I have a branch that ec2 has thrown a fit at three times. Could someone try it again?06:45
wgranthttps://code.edge.launchpad.net/~wgrant/launchpad/bug-629921-packages-empty-filter/+merge/3733906:45
StevenKwgrant: Doing so06:47
wgrantStevenK: Thanks.06:47
lifelessStevenK: url06:56
StevenKlifeless: https://code.edge.launchpad.net/~stevenk/launchpad/db-fix-disabled-dases-test/+merge/3781906:57
lifelessdoesn't edwin have the same thing up for review?06:57
StevenKHis doesn't do the clean-up that mine does06:58
StevenK(And I'm all for making tests shorter)06:58
StevenKlifeless: And I already spoke to Edwin about it in -reviews07:01
lifelessso InitialiseDistroSeries was the helper?07:04
StevenKlifeless: The helper removed was _create_distroseries()07:05
lifelessStevenK: does it work?07:05
StevenKlifeless: Yes, I verified the test failed before fixing it, and that it passed after fixing it.07:06
LPCIBotProject devel build (96): STILL FAILING in 3 hr 25 min: https://hudson.wedontsleep.org/job/devel/96/07:38
LPCIBot* Launchpad Patch Queue Manager: [r=EdwinGrubbs][ui=none][bug 645702] Forward small messages to the07:38
LPCIBotmoderation queue.07:38
_mup_Bug #645702: oops in holdMessage storing large message  <mailing-lists> <oops> <Launchpad Registry:Fix Committed by sinzui> <https://launchpad.net/bugs/645702>07:38
LPCIBot* Launchpad Patch Queue Manager: [r=thumper][ui=none][bug=652626] Upgrade windmill from r1440 to r154407:38
LPCIBotto fix an issue preventing some new launchpad tests from running07:38
wgrantBotwar!07:38
StevenKHaha07:38
spmdon't encourage them!07:38
wgrantWhat's with those utf8 failures?07:39
StevenKMmmm. The SCM messages are not so handy07:39
pooliedo i need to mark a bug fixreleased after qa, or just qa-ok?07:42
pooliedoes a bot do the former?07:42
wgrantpoolie: Just qa-ok07:42
pooliegreat, bug07:43
wgrantFix Released should only happen once it's on prod.07:43
pooliebug 615740 is done then07:43
_mup_Bug #615740: test_on_merge.py doesn't handle eintr <qa-ok> <Launchpad Foundations:Fix Committed by mbp> <https://launchpad.net/bugs/615740>07:43
wgrantParts of NMAF look far too much like are an initial hacked-together implementation that was meant to be immediately followed by a proper one.07:44
wgrantHacks hacks hacks.07:44
wgrantEVERYWHERE.07:44
LPCIBotProject db-devel build (55): STILL FAILING in 3 hr 53 min: https://hudson.wedontsleep.org/job/db-devel/55/08:24
adeuringgood morning08:53
mrevellHallo09:01
wgrantHullo.09:01
poolielp is readonly? no warning? ffs.09:01
wgrantIt was on identi.ca.09:02
wgrantAnd the blog.09:02
wgrantBut no in-app warning that I saw.09:02
poolietweeting 17h in advance is kind of missing the point of the medium09:02
wgrantHeh.09:02
pooliei'll do it now09:03
wgrantbigjools: Sorry I missed your ping last night; I'd left about three minutes earlier.09:16
bigjoolsnae bother09:18
wgrantI believe the CPs are done?09:19
bigjoolsyes09:19
wgrantPhew.09:19
bigjoolsalthough my fixit query didn't work, I need to look at it again09:19
wgrantWhat was the query?09:19
bigjoolshttp://pastebin.ubuntu.com/507347/09:20
bigjoolswe cancelled it after a couple of hours :/09:20
wgrantAh, that kind of not working.09:20
wgrantWhat if you just do the usual 2.5-minute SELECT into a temp table, then UPDATE from that?09:21
wgrantAlso, dateesuperseded.09:22
wgrantYou're not unsetting that.09:22
bigjoolsah true09:22
bigjoolsyeah I'll do the extra temp table09:22
wgrantYou might also want to check datepublished IS NOT NULL09:23
wgrant(since it's possible that it superseded a Pending pub)09:23
wgrantSetting that to Published would be confusing, since it would leave a file missing from disk, but it wouldn't really break anything.09:24
bigjoolshmmm yes09:24
allenapStaging was timing out on pillar pages yesterday, same today. Is this a known problem, or is there some nastiness in db-stable?09:24
bigjoolsI hate our model09:24
wgrantI mean, it's unlikely, but possible.09:24
wgrantbigjools: Sometimes I wonder why status is explicit.09:25
bigjoolswgrant: to help query performance I would guess09:25
bigjoolsI'd rather have more states09:25
wgrantMore!?09:25
bigjoolsyes09:25
bigjoolsit's a farce at the moment - superseded, but then you also have to look at dateremoved to see if it's really gone, for example09:26
wgrantWas ArchiveRemovalRedesign before your time?09:26
wgrantI think it might have been.09:27
bigjoolsyes09:27
wgrantBack in the good old days we had Pending, Published, PendingRemoval, Removed.09:27
wgrantThen ArchiveRemovalRedesign introduced the three removal candidate states, and removed the explicit on-disk state.09:27
wgrantSo we are now stuck half-way between having an explicit status field, and implying status from dates.09:28
wgrantI'm not sure if that was always the plan.09:28
wgrantOr if it only got taken half-way.09:28
bigjoolsexactly09:28
wgrantI guess removing Pending would make it pretty much sensible.09:29
wgrantHaving Pending but not Removed is stupid.09:31
wgrantBut having Published/Superseded/Deleted/Obsolete makes sense.09:31
jmlhello...10:03
=== maxb_ is now known as maxb
bigjoolswgrant: ok I've fixed staging, let's check it out10:06
wgrantThe publication which alerted me to everything is fixed.10:07
wgrantThat is encouraging.10:07
bigjoolshurray10:08
wgrantThat leaves no borked pubs in the primary archive?10:08
bigjoolsI hope so10:08
bigjoolswe're down to 20k rows that match the first query10:11
wgrantie. the first temporary table containing all supersed arch-indep pubs since 2010-08-09?10:12
bigjoolsyes10:13
bigjoolsshockingly the 2nd query now returns zero :)10:14
wgrantI hope that's the one with dateremoved IS NULL10:14
bigjoolsyes10:15
jmlanyone fixing the test failure in devel?10:24
jmlor the one in db-devel, for that matter.10:25
wgrantStevenK had a branch for the IDS db-devel failure.10:25
wgrantNot sure about devel.10:25
jmlwgrant: thanks.10:25
jmlI've forced a rebuild of both db-lp buildslaves10:26
jmlI guess I'll fix devel10:26
StevenKjml: I have a branch for devel, I was waiting for codehosting10:27
StevenKdb-devel is in buildbot now10:27
jmlStevenK: oh cool. the test_remote failures?10:27
StevenKjml: Yes10:27
jmlStevenK: yeah, but buildbot died :\10:27
jmlStevenK: sweet. may I see the merge?10:27
StevenKjml: Pushing it now10:27
jmlStevenK: thanks.10:28
wgrantOh, so Hudson wasn't on crack? Those were real failures?10:28
jmlthat reminds me.10:28
jmltime to run the full test suite against stable & db-stable to see if there's anything else to be done10:28
StevenKjml: https://code.edge.launchpad.net/~stevenk/launchpad/fix-ec2test-utf8/+merge/3783110:31
jmllooking10:32
StevenKjml: But that looks a lot bigger than what I had locally ..10:32
jmlyeah.10:32
jmlStevenK: it also looks suspiciously like mars's branch.10:32
StevenKjml: Yes ...10:32
jmlStevenK: why is that? I thought that mars's fix had already landed...10:33
wgrantWrong target...10:33
StevenKSo did I10:33
jmlwgrant: ta10:33
jmlStevenK: ok. get the right diff & we'll figure out what's making this more interesting than it needs to be.10:34
wgrantHm.10:40
wgrantWe can now kill 2.5 off, can't we?10:40
wgrantSince wildcherry no longer fails.10:40
wgrant!@!!@!10:44
wgrantI just had a branch fail EC2 for the fifth time.10:44
wgrantEach time with a different error.10:44
wgrantGrrr.10:44
jmlwgrant: I'm sorry.10:45
jmlwgrant: lifeless is going to make it better.10:46
wgrantHeh.10:46
jmlwgrant: until then, can I retry your branch for you.10:46
wgrantjml: devel's still broken, isn't it?10:46
jml(also, what's the deal with this paramiko error)10:46
jmlwgrant: I'll run it against stable10:46
jmlof course10:46
jmlstable might be broken10:47
wgrantHeh.10:47
wgrantYes...10:47
wgranthttps://code.edge.launchpad.net/~wgrant/launchpad/bug-629921-packages-empty-filter/+merge/3733910:47
StevenKjml: I'm not sure why that diff is so wrong10:48
wgrantStevenK: Targetted at lp:launchpad.10:48
wgrantAnd db-devel is missing three devel revs.10:48
jmlStevenK: it's targeted to db-devel rather than devel.10:48
StevenKOh, ...10:48
StevenKjml: https://code.edge.launchpad.net/~stevenk/launchpad/fix-ec2test-utf8/+merge/3783210:50
StevenK(That's what I get for filing MPs while on the phone to bigjools)10:50
jmlStevenK: uhh ok.10:50
jmlStevenK: do those tests pass locally for you?10:51
StevenKjml: Yup10:51
jmlhmm.10:51
jmlI suspect platform variation. mars changed the 'utf-8' to 'utf8' to fix a test failure10:51
* jml tries10:51
jmlanyone getting paramiko errors? http://paste.ubuntu.com/507903/10:52
StevenKOh, are you kidding me? Now it wants utf8, rather than utf-810:52
jmlyeah. let me look at the tests.10:53
bigjoolswgrant: I'm going to run that fixit query in an hour or so, I think it's ok unless you have any further misgivings?10:53
jmlI reckon we should relax the constraint somehow.10:53
wgrantbigjools: pastebin pls.10:53
wgrantJust to be safe.10:53
jmlStevenK: ok. here's what we should do.10:54
wgrant"charset=utf8" is wrong, though.10:54
wgrantAnything that wants that is broken.10:54
jmlStevenK: split body['Content-Type'] by ';', assert that the first part is 'text/plain'10:55
jmlStevenK: don't care about the second part.10:55
bigjoolswgrant: http://pastebin.ubuntu.com/507877/10:56
* wgrant WTFs at the differing theme between paste.ubuntu.com and pastebin.ubuntu.com10:56
jmlwgrant: for this, we just don't care. if people start having encoding issues with their ec2 mail then we'll worry then.10:56
wgrantbigjools: +1 doit.10:58
StevenKjml: MP updated11:00
jmlStevenK: thanks.11:00
jmlStevenK: have you run the tests locally?11:00
StevenKYes11:00
StevenKbin/test -vv -m devscripts -t test_remote is happy11:01
jmlStevenK: humour an old man, run bin/test -vv devscripts11:02
StevenK... Aren't you younger than me?11:02
StevenKjml: Ran 146 tests with 0 failures and 0 errors in 15.604 seconds.11:02
wgrantAlmost 10 tests a second? What sorcery is this?11:03
StevenK... A fast machine?11:03
StevenKYou should try it11:03
wgrantAh, and no DB too, I guess.11:03
jmlyeah. they are tests for the devscripts stuff11:04
StevenKwgrant: Only unittest layer, so quick11:04
jmlactually the test_remote tests are quite slow because they make real branches11:04
StevenKjml: Should I land that as a testfix?11:08
jmlStevenK: yes please11:08
jmlStevenK: sorry for the delay11:08
StevenKjml: Do you want to stamp it?11:08
jmlStevenK: sure.11:08
jmlStevenK: done11:09
jmlsorry about the delay. multitasking way too much.11:09
StevenKjml: Tis cool. I've tossed it at PQM11:11
jmlno one knows anything about that paramiko failure11:27
wgrantHm, that's an odd one.11:28
jmlyeah. I haven't sat down to serious debugging yet. Want to flush out my mail queue first.11:29
bigjoolswgrant: production fixed11:54
wgrantbigjools: Looks good, thanks.11:55
wgrantcan you grab counts of remaining broken publications?11:55
bigjoolsyeah already done a while ago11:56
deryckMorning, all.11:59
LPCIBotProject db-devel build (56): STILL FAILING in 3 hr 42 min: https://hudson.wedontsleep.org/job/db-devel/56/12:06
LPCIBotLaunchpad Patch Queue Manager: [testfix][r=lifeless][ui=none][no-qa] Fix the InitialiseDistroSeries12:06
LPCIBottest for disabled DASes.12:06
bigjoolsfunk612:08
bigjoolserr funky, even12:08
wgrantjml: Did you end up sending my branch off?12:12
wgrantIt may have some hope..12:12
bigjoolswgrant: can we talk about your bug-655614-disabled-arch-indices branch12:13
wgrantbigjools: I opened that 30 seconds ago and was about to ask you the same thing.12:13
bigjools:)12:14
wgrantIt's not so much a branch as a set of a few patches that we might want bits of.12:14
bigjoolsr9787 is confusing me12:14
wgrantIt's probably too revolting to land (but no worse than parts of the existing code :/)12:14
wgrantHm?12:15
daniloshenninge, so, in what sense does +translations on a distroseries fail?12:15
wgrantbigjools: I removed a duplicate loop and added an arch.enabled guard. Previously it was looping across the archs once to publish indices, and again to request Release files.12:16
bigjoolswgrant: why the changes other than the .enabled check?12:16
bigjoolsah12:16
wgrantIt was that or add the check twice.12:16
bigjoolsgot it12:17
bigjoolsis it all tested?12:17
wgrant9788 has some quick partial tests, but they're not thorough or pretty.12:18
bigjoolsnot series.getDistroArchSeries(architecture[7:]).enabled):12:18
bigjoolseeeurrrrghh12:18
wgrantbigjools: I stole the architecture[7:] from existing code!12:18
bigjoolsI know :(12:18
wgrantI originally did .split('-')[0], but decided to go with the... preferred method.12:18
henningedanilos: on <a tal:attributes="href context/menu:navigation/templates/url">12:19
* bigjools puts fingers in ears and goes blahblahblah12:19
henningedanilos: 'templates' does not exist12:19
wgrantbigjools: I have formulated a plan to remove all that stupidity, but it will require a bit of a-f disentanglement.12:20
wgrantSo it can't be done quickly.12:20
jmlwgrant: yes12:20
wgrantjml: Great, thanks.12:20
henningedanilos: that's when rendering DistroSeriesView.12:20
jmlStevenK: build failure just sent to the list12:21
bigjoolswgrant: if you get this branch finished I will run it on dogfood while you get it reviewed12:21
henningedanilos: that's the test that's failing, actually the last "test_" method im the file.12:21
henningedanilos: http://pastebin.ubuntu.com/507871/12:21
wgrantbigjools: I'll write the tests properly now it's no longer 3am.12:21
StevenKjml: That's lp, not lucid_lp12:22
wgrantBut I think it's good, so please try on DF, yes.12:22
jmlStevenK: I'm a little bit behind ... does lp build slave still matter?12:22
wgrantwildcherry was the end of 2.5, I believe.12:23
wgrantSo we may be safe.12:23
henningedanilos: read the backscroll on #lp-reviews for more detail ;-)12:23
StevenKWe're all on lucid now, I think12:23
bigjoolswgrant: :)12:24
henningedanilos: bac has ended his day in defeat, so it is not super-urgent atm.12:24
daniloshenninge, fwiw, I can simply create a distribution and distroseries using factory methods and browse to +translations on it12:25
henningedanilos: that's odd. How do you do that exactly?12:25
henninge(I know how to use the factory methods)12:26
wgrantbigjools: I'd test PPA and primary archives both with and without active publications in the disabled DASes. Check that the DAS' directories aren't recreated, and confirm that the series' Release doesn't include those arches.12:26
wgrantI will return in 20.12:26
daniloshenninge, in 'make harness' using http://paste.ubuntu.com/507948/12:27
bigjoolswgrant: yup12:27
daniloshenninge, oh, if you know how to use factory methods, perhaps you were asking how do I browse to it? :P12:27
henningedanilos: exactly ;)12:27
daniloshenninge, well, I open a web browser and go and look at it :)12:28
henningedanilos: I was not sure which changs to the db are presereved after make harness.12:28
henningedanilos: ok, simply 'make run'12:28
daniloshenninge, all changes that you've committed are preserved12:28
daniloshenninge, right, but I do that even before 'make harness': it's basically like two appservers talking to the same DB12:28
henningeI see12:29
daniloshenninge, I've already looked at that test for bac, but now that I think about it, it's probably a missing commit somewhere12:29
danilosor at least a .sync()12:29
henningedanilos: we were also wondering why DistroSeriesTranslationsMenu.templates is @enabled_with_permission('launchpad.Edit') when still it is shown to everybody.12:31
daniloshenninge, probably because it's not useful to anybody else all that much12:32
daniloshenninge, i.e. perhaps shouldn't be like that12:32
henningedanilos: no, I am saying that the link (and the page) is shown to unauthorized users, too.12:32
henningedanilos: *although* it is @enabled_with_permission('launchpad.Edit') ...12:33
daniloshenninge, oh, then the decorator needs to go12:33
henningedanilos: you mean it has no function any more?12:33
henningedanilos: btw, a commit makes the test pass.12:33
henninge;-)12:33
henningedanilos: where would the sync() go?12:34
daniloshenninge, where the commit is, on the object that needs syncing (sometimes a sync() is not enough, but you could try self.distroseries.sync())12:34
daniloshenninge, that also means that all the other tests (for non-LAUNCHPAD usage values) pass by accident :)12:35
bigjoolssync() is useless now I thought?12:35
jmlindeed12:36
bigjoolsstore.flush() FTW12:36
henningegood to know ;)12:36
henningedanilos: A commit does *not* help. btw. I had forgotten that I had commented out the failing parts of the template ...12:36
henninge:(12:36
danilosbigjools, ah, right, thanks :)12:37
daniloshenninge, sorry to hear that12:37
daniloshenninge, does removing the permissions decorator on the property help?12:37
henningenope12:37
henningedanilos: if I comment out the context/menu:navigation/templates line in the tmplate12:38
henningedanilos: it fails on context/menu:navigation/langpacks12:38
henninge...12:38
henningedanilos: My suspicion is it has the wrong menu. But why and how do I prove that?12:38
daniloshenninge, right, we should just get rid of the context/menu:navigation use anyway, but... that doesn't help with this branch12:39
daniloshenninge, hum, "wrong" menu is a potential issue if the entire page is included into distribution:+translations, but I am pretty sure it isn't12:39
daniloshenninge, fwiw, I'd suggest trying setting a breakpoint and going through the test with pdb (or trying it manually in 'make harness')12:43
jmlbigjools: so you've got the buildd-slavescanner work now?12:45
jmlbigjools: I can remove it from my todo?12:45
bigjoolsjml: I'll sort it, yes12:45
jmlbigjools: ta12:45
bigjoolsjml: btw have you been playing Uncharted2 then? :-)12:46
* wgrant returns.12:46
jmlbigjools: not recently. and actually it was mostly watching two of my flatmates play it12:47
bigjoolsF1 2010 is keeping me up way too late12:48
wgrantbigjools: Hm, the Release update didn't work?13:09
wgrantOr have you just deleted but not republished yet?13:09
bigjoolswgrant: still trying to get the f***ing publisher to do something13:10
wgrantHeh.13:10
wgrant♥ dogfood13:10
bigjoolsI've got a pending publication but p-d ignores it13:11
wgrantPending publications, or pending uploads?13:11
wgrantIt's easy to forget p-a...13:12
bigjoolsalready ran p-a13:12
bigjoolsthere's a pending source and binary now13:12
wgrantSo even phase A doesn't see them?13:12
bigjoolsnup13:13
bigjoolsthis is w/o your patch too13:13
wgrantYeah. I didn't touch phase A.13:13
wgrantCome on DF... show me your queue.13:13
wgrantUh, is DF's appserver hung?13:14
wgrantThere is little response.13:14
bigjools+queue?13:15
wgrantAh, there we go.13:15
* bigjools restarts DF13:15
wgrantYeah, that.13:15
wgrantIt's alive now.13:15
bigjools+queue is slow slow slow13:15
wgrantIt was going for well over a minute.13:15
wgrantWhich should have timed out.13:15
wgrantBut it's rendered now.13:15
bigjoolsbizarrely your branch conflicts in lib/canonical/launchpad/browser/launchpad.py13:16
wgrantMine is based on production-devel.13:16
wgrantSo that's possible, I suppose.13:16
bigjoolsdon't do that13:17
bigjoolsnot yet anyway13:17
bigjoolswhere did you branch from?13:17
wgrantA production-devel branch. I'll rebase on devel. Gimme a sec.13:18
=== dobey_ is now known as dobey
bigjoolsok now I'm getting hacked off, why is it not publishing13:19
wgrantWell, there is no appserver running. Is there a librarian? p-d needs one...13:19
wgrantbigjools: That branch is now based on devel.13:24
bigjoolsI have to run a db patch on DF13:24
wgrantYay.13:25
bigjoolswhich is always painful13:25
wgrantIt's not the branchrevision one, I hope.13:25
bigjoolsHWSubmissionDevice getting a new index - ffs13:25
* bigjools kills it13:25
bigjoolsand 2 others13:27
jmlwgrant: btw, I've seen a thread isolation error in the layers tests in your branch.13:28
wgrant.... #6.13:28
jmlwgrant: it might not fail13:31
jmllayer tests are hella weird13:32
wgrantHm, Ok.13:32
bigjoolswgrant: of course it would have helped to have publish=True for the main archive13:33
=== matsubara-afk is now known as matsubara
wgrantbigjools: Uh, DAS.enabled is in production-devel but not devel?13:33
wgrantbigjools: Haha.13:33
bigjoolswgrant: yes, use db-devel13:33
wgrantWell, that's a bit special.13:34
bigjoolsit's because of the late branch for the last rollout13:34
bigjoolsthe DB is patched in prod without a patch file in devel13:34
wgrantAh, I thought that did make it into devel anyway.13:34
wgrantI recall the late patch.13:34
bigjoolsand now I am going to get some food while the publisher runs13:35
bigjoolswe could do with using your domination speedup thing13:35
bigjoolsback in 30 mins13:35
wgrantI'm going to see if I can remove the temp table first.13:36
wgrantThe whole going behind Storm's back thing makes me a bit wary of duplicating it.13:36
=== Ursinha-afk is now known as Ursinha
jcsacketthenninge, danilos: hi.14:03
danilosjcsackett, hi14:03
jcsackettdanilos: i have two more bugs in translations (filed by registry) that i would like input on, if you have time.14:04
jcsackettbug 652296 and bug 65230114:04
_mup_Bug #652296: distribution translations front page contradicts itself for owner <bridging-the-gap> <confusing-ui> <Launchpad Translations:Triaged> <https://launchpad.net/bugs/652296>14:04
_mup_Bug #652301: non-soyuz distro has contradictory involvement portlet <bridging-the-gap> <confusing-ui> <Launchpad Translations:Triaged> <https://launchpad.net/bugs/652301>14:04
jcsacketti think the one about distribution contradicting itself falls into the category of things you guys are working on as part of other bugs, and the bug can be discarded. danilos, do you agree?14:04
rockstarabentley, hi14:08
abentleyrockstar: hi.14:08
rockstarabentley, so, in my merge-queues-db branch, I deleted the tests because I needed the tests to run.  thumper and I had come to the conclusion that making the db patch as small as possible was a good idea.  The actual model code gets deleted in the next pipe.14:09
abentleyrockstar: does the model code work?14:10
rockstarabentley, not without the tables underneath it, no.14:10
rockstarabentley, but there are imports and such that I didn't want to also have to go chase just to get the db-patch in.14:11
rockstar(although I have some failing tests which may force me to do that)14:11
abentleyrockstar: so you're reducing the test coverage in order to allow some code to be broken?14:12
rockstarabentley, no, just trying to keep the diff manageable.14:12
abentleyrockstar: you're reducing the test coverage in order to allow some code to be broken so that the diff is manageable?14:13
rockstarabentley, yes.  Code that isn't used (and never was) is now broken in this branch.  It is fixed in the next one.14:13
abentleyrockstar: while there may be some exceptions, I don't think this is a good general policy.14:14
abentleyrockstar: would it have been possible to remove the model code and tests first, then do the db patch?14:15
rockstarabentley, no, not at all.  I am contending though, that this is probably an okay exception.  As far as I'm concerned, the current merge queue code is nothing but technical debt.14:15
rockstarabentley, I guess, but in this next branch, I'm replacing the model code with the correct code.14:15
rockstarabentley, this is really not ideal.  Instead of creating new functionality, I get to remove old, half-baked functionality first.  By today's policy, the current branch merge queue code never would have been landed.14:18
abentleyrockstar: all of this doesn't actually matter because you won't be landing this branch by itself, right?14:18
rockstarabentley, well, it's getting to the point that I need to land it by itself, because PQM is closing.14:19
rockstarabentley, but there are still broken tests, so I may need to delete it anyway.14:20
abentleyrockstar: I understand that you're frustrated.  I'm sorry to be sticky about this.14:21
rockstarabentley, no, I'm not frustrated, just explaining.14:21
rockstarabentley, or rather, I'm frustrated that we have old stale code just festering in Launchpad.14:22
abentleyrockstar: I'll approve this, but please try to avoid reducing test coverage in the future.14:23
rockstarabentley, yeah, that's the last thing I want to do.14:23
* rockstar likes tests.14:23
rockstarabentley, it's still quite possible that I'll need to delete the models in this pipe, but I can't get the Librarian to run anymore to find out.14:24
allenapadeuring, gmb: Do either of you have time to review a branch? It's mostly a search-n-replace job. https://code.edge.launchpad.net/~allenap/launchpad/subs-for-bugtask-bug-656194/+merge/3783514:29
adeuringallenap: I'll do it14:29
allenapadeuring: Thanks.14:29
wgrantbigjools: The publisher is *still* not done?14:33
wgrantOr did I explode it?14:33
bigjoolswgrant: dogfood is slow at publishing14:33
wgrant.... apparently.14:33
bigjoolsthe "Calculating binary filelist." part is REALLY slow14:33
wgrantAnyway, I have some nonawful tests now.14:33
bigjoolsI expect it'll be another hour yet14:34
* rockstar reboots14:38
wgrantbigjools: I wonder how it can be so bad. Maverick should have fewer than 10000 binary lines.14:46
wgrantEr, 100000.14:46
wgrantStill not many.14:46
wgrantbigjools: https://code.edge.launchpad.net/~wgrant/launchpad/bug-655614-disabled-arch-indices/+merge/37849 <-- besides the greasy stolen hack, does it look OK?14:49
wgrantI will throw it at a reviewer if you have no immediate objection.14:49
wgrantThe tests now verify that the indices aren't created by either publisher, that the arch directory isn't created, and that it's not in the serise' Release.14:50
wgrantThat should be everything.14:50
bigjoolswgrant: can you put the enabled flag as a param to makeDistroArchSeries14:51
wgrantbigjools: Good point.14:52
wgrantjml: Failure #6!15:08
wgrantAwesome.15:08
wgrantThis is a record for me.15:08
jmlwgrant: yeah.  :(15:09
jmlwgrant: and that was against stable too.15:09
wgrant…..15:09
wgrantWell then.15:09
jmlwgrant: which is no longer a known good branch :(15:09
jmlwgrant: my run against stable didn't seem to work in the way I expected.15:10
jmlas in, my test run of just stable nothing merged in.15:10
wgrantHow do you mean?15:10
jmlwell, it only ran devel15:12
wgrantHm, convenient.15:12
jmlso, going to try again15:13
jmlalso, running those failing tests on my stable branch15:13
jmlffs.15:15
jmlmake schema :(15:15
jcsackettdanilos: any thoughts regarding those bugs?15:22
flacostemars: what's the status of the failing tests on the stable branch?15:25
marsflacoste, jml would know.  StevenK had a fix that was in buildbot15:25
danilosjcsackett, sorry, it usually useful to ping me every time or I can easily miss out on a followup to a discussion (IRC is famous for having multiple conversations over multiple channels all happening at the same time :)15:26
flacostemars: do we know why that happened?15:26
danilosjcsackett, I am taking a look now15:26
tyarussowgrant: Maybe.  I appear to have gotten both c-i-p and lp to run without errors.  Still no idea how to actually connect them to each other such that a "Register" link appears on LP.15:26
jcsackettdanilos: ah dig, sorry for not pinging you on all that. :-)15:26
flacostemars: and the fact that it landed in buildbot doesn't mean it's fixed, given that the failures weren't noticed by the builder in the first place15:27
marsflacoste, the accute symptom appears to be a difference between how platforms handle charset encodings: some say the mail was written as 'utf8', other say 'utf-8', and others say 'quote-printable'15:27
=== flacoste changed the topic of #launchpad-dev to: Launchpad Development Channel | Week 3 of 10.10 | PQM is open for business | firefighting: stable has test failures | https:/​/​dev.launchpad.net/​ | Get the code: https:/​/​dev.launchpad.net/​Getting
jmlflacoste, mars: see the mail I just sent15:27
wgranttyarusso: Grep around in the LP configs for 'testopenid.launchpad.dev', and change it to your c-i-p domain.15:27
jmlmars: it's deeper than that15:27
wgranttyarusso: But I am asleep.15:27
marsjml, yep, hence the 'accute symptom' - stating that "This man died from blood loss!" while ignoring the stab wounds15:28
danilosjcsackett, I agree about bug 652296, we can probably wontfix it15:29
_mup_Bug #652296: distribution translations front page contradicts itself for owner <bridging-the-gap> <confusing-ui> <Launchpad Translations:Triaged> <https://launchpad.net/bugs/652296>15:29
jmlmars: uhh, to stretch the analogy, blood loss, internal bruising and liver collapse15:29
jmlmars: there are two other failures that have nothing to do with encoding15:29
jcsackettdanilos: i cannot express how much i wanted to hear that. :-)15:29
marsjml, great :(15:29
jcsackettdanilos: the other one is less a "can we wontfix this" and more a "there are plans for dealing with distros like this in the future, what do you want to do now?" sort of thing.15:30
jcsackettwhich is a far more complicated question.15:30
flacostemars,jml: can't these failures be not noticed because of the subunit format failure we saw earlier?15:30
jmlflacoste: that would be my best guess. I haven't done *any* analysis though. my first step was trying to measure the extent of the problem...15:31
flacostemars: given that these failures are reproducible locally, can we do a binary search to find the revision at which point they started failing and went unnoticed in buildbot?15:31
jmlflacoste: still waiting on db-stable results15:31
danilosjcsackett, yeah, the other one (bug 652301) is useful in itself and should probably stay... I'd say leave it open and we'll worry about it (i.e. I don't think it's got anything to do with the bridging the gap theme)15:31
_mup_Bug #652301: non-soyuz distro has contradictory involvement portlet <bridging-the-gap> <confusing-ui> <Launchpad Translations:Triaged> <https://launchpad.net/bugs/652301>15:31
marsflacoste, yes, that would work15:32
jcsackettdanilos: okay, thanks. i'll remove the briding-the-gap tag and take it out of registry's backlog.15:32
sinzui\o/15:32
flacostemars: can you take care of that analysis, pretty please?15:32
danilosjcsackett, thanks15:32
marsflacoste, sure :)15:33
flacostethanks mars15:35
EdwinGrubbsrockstar: ping15:36
rockstarEdwinGrubbs, hi.15:37
EdwinGrubbsrockstar: On the off chance that you aren't busy, can you look at the launchpad-code bugs that are still in qa-needstesting?15:38
rockstarEdwinGrubbs, I can.  I'm about to head out for a second.15:39
LPCIBotProject devel build (97): STILL FAILING in 3 hr 52 min: https://hudson.wedontsleep.org/job/devel/97/15:48
* rockstar afks15:56
gmbjml: I cannot get xx-person-subscriptions to fail locally in stable. Neither can jcsackett, from what I understand.15:56
gmbSo why it's failing in buildbot I don't know.15:56
jmlgmb: interesting.15:56
jmlgmb: it fails for me.15:57
jcsackettgmb: that's right. i run xx-person-subscriptions on ec2, it fails as you demonstrated. i run it locally, it works (as the code currently is).15:57
stubxx-person-subscriptions.txt looks like a data ordering issue - the sort that occasionally pops up with sampledata and PG updates.15:57
* gmb `make schema`s15:57
* jcsackett groans and also makes schema.15:57
stubI've just emailed, but summary is I think +subscriptions displays whichever bugtask it finds 'first', but doesn't tell the database what 'first' means and we get an arbitrary bugtask.15:58
gmbARGH.15:58
jmlactually, a thing we should do is look at the buildbot logs, see if the failures are in the output but not detected...15:58
gmbstub: So it doesn't use bug.default_bugtask.15:58
gmbAnd I'd just assumed it did.15:58
gmbArseholes.15:58
* stub bets switching to default_bugtask causes a performance problem ;)15:59
gmbbdmurray: So, re: your email is it actually an ordering issue as you suggest or is it the issue that stub suggested above.15:59
gmbstub: Shouldn't any more.16:00
gmbI fixed that.16:00
gmb    def default_bugtask(self):16:00
gmb        """See `IBug`."""16:00
gmb        return Store.of(self).find(16:00
gmb            BugTask, bug=self).order_by(BugTask.id).first()16:00
stubThis is just my guess btw. I haven't looked at the code.16:00
bdmurraygmb: well the bugtasks could have different date_last_updated fields but I don't think the sample data should be changing ... right?16:01
gmbbdmurray: Well, no, but if we're just describing the subscriptions a user has why not just use default_bug_task?16:02
bdmurraygmb: that seems like a fine solution to me16:02
gmbbdmurray: Cool. Are you working on it now or should I put a branch together?16:03
bdmurraygmb: No, I'm not working on it now but I could be.16:03
gmbbdmurray: I'll take care of it since I'm in the code already.16:04
bdmurraygmb: okay, thanks!16:04
gmbnp16:04
=== deryck is now known as deryck[lunch]
stubsorting by date_last_updated can be dangerous, as if you modify two bugtasks in the same transaction you get identical timestamps and the ordering is undetermined.16:15
=== Ursinha is now known as Ursula
=== matsubara is now known as matsubara-lunch
bigjoolsyay postgres vuln16:44
dobeyis lp taking a horrendously long time to rescan branches for anyone else?16:47
=== al-maisan is now known as almaisan-away
=== deryck[lunch] is now known as deryck
maxbThe branch scanner was broken yesterday. Has it been fixed?17:01
marsabentley or rockstar, ^ ?17:02
marsif there is a problem, should it be listed in the channel topic?17:03
abentleymaxb: I didn't hear there was a problem.17:03
marsdobey was asking too17:04
maxbThe branch scanner was throwing SQL permission errors.17:04
abentleymaxb: any oops ids?17:05
* maxb hunts irclogs17:05
marsflacoste, jml, you are going to love this: revision 11634 is the culprit17:05
jmlA wise man once said, All you need is love.17:05
flacostemars: and what did this revision introduced?17:05
mars"Move read_transaction & write_transaction to lp.services."17:05
* jml looks at the revision17:06
flacostereally!?!17:06
marsflacoste, jml, just to be clear, that is devel r1163417:06
abentleymars: (and also stable r11634)17:07
maxbthe branch scanner issue was http://launchpadlibrarian.net/57189808/jR3X1uFDWYhXPet14K6N1hWzrkG.txt17:09
flacostemars: that's the revision where the tests started failing? does it give also the explanation why buildbot didn't spot the failures?17:09
jmlmars: test_remote passes on r11634 for me17:09
marsfails here17:09
jmlinteresting17:09
maxbhttp://irclogs.ubuntu.com/2010/10/06/%23launchpad.html#t22:2717:09
jmlare we looking at a config issue or a timing issue or what17:10
marsjml, well, I figured it must have passed for you - how else would you have done your TDD loop?17:10
jmlmars: to be clear, test_remote does not work for me with tip of stable17:10
jmlmars: and that revision doesn't do anything with devscripts17:11
mars... jml, does that include StevenK's fix?17:11
abentleymaxb: ack17:11
jmlmars: no, not including StevenK's fix17:11
marsjml, I did this (sandboxed devel setup): $ bzr branch -r 11634 devel test && cd test && bzr checkout && utilities/link-external-sourcecode ../devel && make && bin/test -cv devscripts.ec2test.tests.test_remote17:12
marsjml, are you running Maverick or Lucid?17:12
abentleymaxb: AFAICT, the scanner is running normally on most branches.  It appears to be a problem for this particular branch.17:13
jmlmars: Maverick17:14
marssame17:14
jmlhmm.17:14
marsflacoste, does it fail for you?17:14
marsa larger sample would really help here17:14
=== salgado is now known as salgado-lunch
marsI'll run it on my Lucid laptop17:16
jmlmars: I did bzr revert -r 11634... I'll try a fresh branch just in case17:16
allenapbdmurray: Btw, I also tried to investigate bug 654585, but was prevented by staging timing-out all the time.17:16
_mup_Bug #654585: Line break stripped from bug reported acknowledgement <Launchpad Bugs:Incomplete> <https://launchpad.net/bugs/654585>17:16
jmlmars: yeah. fails for me.17:18
jmlmars: trying again, and then with previous revision17:18
abentleymaxb: this is bug 634451 and a fix was applied to production around 2010-09-12.  Apparently, it didn't stick.17:21
_mup_Bug #634451: launchpad code rescans failing <branch-scanner> <oops> <qa-ok> <Launchpad Bazaar Integration:Fix Released by thumper> <https://launchpad.net/bugs/634451>17:22
flacostemars: what's the test i should run?17:22
marsflacoste, bin/test -cv devscripts.ec2test.tests.test_remote17:22
bdmurrayallenap: you must have some ubuntu bug you could report ;-)17:23
allenapbdmurray: No, it's perfect :)17:23
flacostemars: i cannot make that revision at all :-/17:24
flacostemars: compile_templates fails17:24
flacosteImportError: cannot import name SAFE_INSTRUCTIONS17:24
marsflacoste, on Lucid - strange.  Have you run 'apt-get update && apt-get install' recently?17:25
marsflacoste, and I assume you ran 'rocketfuel-get' to ensure sourcecode is up to date?17:25
marsflacoste, and this is in a fresh branch?17:25
flacosteit's a fresh branch17:26
flacostei did update this week17:26
flacostebut i didn't run rocketfuel-get17:26
flacosteonly updated the download cache17:26
marsok, it is building on Lucid here17:26
marsbut is is not finished yet17:26
marsflacoste, builds for me on Lucid17:29
marsand the tests fail17:29
jmlmars: I can confirm tat revision introduces the bug17:29
jmlthat*17:30
marsok, so we still have a "wtf" moment here though17:30
mars:)17:30
marshttp://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/revision/1163417:31
dobeyhrmm17:32
jmlmars: have you tried with the other tests?17:32
marsjml, no, I shall do so - they involved database stuff too?17:33
jmlmars: umm... the xx-person-whatever thing?17:33
flacostemars: still fails17:34
marsflacoste, you may want to talk to bigjools about using the vm builder to get a Maverick instance then17:36
jmlmars: http://paste.ubuntu.com/508043/17:36
flacostemars: so i cannot that revision17:36
* flacoste needs to lunch17:37
marsok17:37
* jml meeting17:37
abentleymaxb: I am trying to get an answer on whether the permissions have been fixed, but it's taking a while.17:40
lvhHi :-)17:47
lvhWhat's the right place to make or discuss feature requests for lp?17:47
lvhI was just thinking it would be really awesome if merge requests had diffs that looked like bzr qdiff (side by side). A bit like rietveld.17:47
=== matsubara-lunch is now known as matsubara
marslvh, best file a bug with the request, or ask about the feature on the launchpad-dev mailing list.  For MPs specifically, you would likely end up talking to abentley or rockstar.17:51
=== salgado-lunch is now known as salgado
=== gary_poster_ is now known as gary_poster
=== jam1 is now known as jam
benjiI'm upgrading to Maverick and my LP tests are now erroring out with "ImportError: No module named mailman.monkeypatches.defaults"; anyone seen this before?18:09
benjinope, I've not done anything with that yet18:10
benjiI just skimmed some KWallet stuff and it seems to be about the same design/complexity as the Gnome Keyring.18:13
benjioops, wrong chan18:13
=== Ursinha-afk is now known as Ursinha
marsbenji, I have not checked - have you run rocketfuel-get, merged devel in the branch you are working on, and run 'make clean && make'?18:17
benjimars: nope; I'll do that.18:17
benji(well, I was running the tests on devel, but the make clean I haven't tried)18:18
marsbac or sinzui, ping, you both rebuilt your systems for maverick, correct?18:18
sinzuino, I upgraded18:18
marsok, it was Brad then who did a rebuild18:19
benjimars: the make clean helped, but now I get a PG error; I tried this https://pastebin.canonical.com/38344/ but got the error you see there18:29
=== benji is now known as benji-lunch
dobeymars, maxb, abentley: did you guys figure out anything with the branch rescans yet?18:52
abentleydobey: What I know so far is we already had this problem, it was fixed on production, and the database upgrade seems to have lost the fix.18:53
abentleydobey: so I am trying to get it re-applied.18:53
abentleydobey: it was bug 63445118:54
_mup_Bug #634451: launchpad code rescans failing <branch-scanner> <oops> <qa-ok> <Launchpad Bazaar Integration:Fix Released by thumper> <https://launchpad.net/bugs/634451>18:54
dobeyabentley: ok, thanks.18:54
marsbenji-lunch, looking18:54
marsbenji-lunch, you need to open Synaptic or Update Manager and re-enable the launchpad PPA software source18:55
marsbenji-lunch, the upgrade disables all third-party repos18:55
marsbenji-lunch, then, after that, 'sudo apt-get update && sudo apt-get install'18:56
marsgary_poster, flacoste, how did the Python 2.6 upgrade go?  Can we kill the Hardy builders yet? :)18:58
marserr, database upgrade18:58
gary_postermars, it went well; see my brief email to the list for remaining step.  yes, we can kill the Hardy builders, which is part of what I have in my RT for the last step.18:59
mars\o/18:59
dobeybenji-lunch, mars: i think he meant s/install/upgrade/ for that second one. install without args won't do much :)18:59
marsthanks gary_poster.  It will be nice to see those mails stop18:59
gary_posteragreed18:59
marsdobey, I thought 'apt-get install' offered to install new versions of all of the upgradable packages?19:00
marsand that 'upgrade' did the base system19:00
maxbNo, that's not how it works19:00
dobeyupgrade installs new versions19:01
maxbAFAIK apt has no "just the base system" thingy at all19:01
dobeyindeed19:01
marsso what was the apt command to upgrade Debian (or Ubuntu) to the next major version?19:02
marsdo you have to explicitly tell it to do so, or does it just happen when the new version is released?19:02
maxbThere is no single apt command for that19:02
maxbUbuntu: Use the release-upgrader tool.19:03
maxbDebian: Follow the full instructions in the release notes19:03
marsFunny, I have been using Linux for more than 12 years, and never knew that19:05
flacostemars: what was the name of a devscripts failing test?19:08
marsflacoste, test_remote19:10
flacostemars: more specifically, there are a bunch of test_remote19:10
flacostemars: i'm trying to assess if buildbot ran the failing tests successfully, it appears so19:11
flacostemars: https://lpbuildbot.canonical.com/builders/lucid_lp/builds/195/steps/shell_7/logs/stdio19:11
marsflacoste, bin/test -cv devscripts.ec2test.tests.test_remote19:11
flacostemars: i can't reproduce19:11
marshmmm19:11
flacostemars: so i'm looking for something like a pastebin of the failing tests output19:11
marsthat is not necessarily a bad thing19:11
marsok19:12
flacostemars: i can't reproduce because my env is not working, not because i don't have the error :-)19:12
marsoh :p19:12
marsoh, to have a pastebin grep19:12
marsflacoste, http://pastebin.ubuntu.com/508177/19:14
flacostemars: thanks, these tests pass successfully on build 19519:16
flacosteso i think, this is an environmental thing19:16
flacostediff between dev env and the builder env19:16
marsI can't think of how to debug that though19:17
marswould have to dig into the code to see where those variables are being generated19:18
marsand what the heck is with the revno that caused everything to break?  It does not look related19:18
flacostenot sure how much we should chase this up at this stage19:28
flacostethe utf-8, utf8 things might be due to a package update19:28
flacostethat isn't in the builder yet19:28
flacosteiow, these were all fragile tests19:28
flacosteare all tests passing in stable locally and buildbot now?19:29
flacosteas long as we have deltas between the dev / test / production environment, we'll suffer from fragile / env tests19:29
=== didrocks1 is now known as didrocks
lifelessenvironment failures sure19:30
lifelessbut tests should be isolated from the environment, OR, we should ask all devs to develop in $prod-target-vms19:31
jmlwe fixed the utf-8 / utf8 things19:31
jmlthere's no easy way to learn that it's env dependent19:32
=== salgado is now known as salgado-afk
LPCIBotProject devel build (98): STILL FAILING in 3 hr 50 min: https://hudson.wedontsleep.org/job/devel/98/19:46
jcsackettEdwinGrubbs: what time is PQM closing today? can't seem to find the email...19:48
EdwinGrubbsjcsackett: 22:00 UTC, so in 3 hours19:49
jcsackettthanks.19:49
=== benji-lunch is now known as benji
LPCIBotProject db-devel build (57): STILL FAILING in 4 hr 8 min: https://hudson.wedontsleep.org/job/db-devel/57/19:56
=== EdwinGrubbs is now known as Edwin-lucnh
=== Edwin-lucnh is now known as Edwin-lunch
lifelessoff to a doctors visit, back in a few hours20:07
=== beuno is now known as beuno-lunch
mwhudsonjml: hey20:58
mwhudsonjml: have you looked at the lp-service branch at all?20:59
=== beuno-lunch is now known as beuno
=== ajmitch_ is now known as ajmitch
rockstarsinzui, hi.21:14
sinzuihi rockstar21:14
rockstarsinzui, I wonder if you might be able to help me sort out some things with the account merger, or point me to someone who might.21:15
sinzuirockstar, does this related to login or passwords21:15
rockstarsinzui, it relates to how the table list gets generated for finding references to Person.id21:17
rockstarsinzui, it's somehow finding a table I dropped in this branch.21:17
sinzuiinteresting21:17
sinzuiI do not know, but I want to know so you have my attention21:17
sinzuiwhich table21:17
rockstarsinzui, branchmergerobot21:18
sinzuiand you get merge errors because the master rule believes there is a condition we do not have a rule for?21:18
rockstarsinzui, I WAS getting errors for the table I created that referenced it.  Now I'm getting errors because it's trying to update a table that no longer exists.21:19
sinzuiI wonder is make schema generates a no-no list for merge21:20
rockstarcanonical.database.postgresql.listReferences seems to be returning branchmergerobot, which this branch drops.21:20
* sinzui starts reading code21:20
rockstarsinzui, lp.registry.model.person:400421:20
rockstarsinzui, somehow, in the references var, branchmergerobot is showing up.  I have no idea why, since the table is deleted.21:21
sinzuirockstar, I see 4004 as the the line that changes the user name21:21
rockstarsinzui, oh wait! It's not deleted, it's just moved to to_drop (since dropping it would break replication)21:22
sinzuioh that sucks21:22
rockstarOh yeah, I had some local changes, so the lines wouldn't match up.21:22
sinzuilistUniques or Handle all simple cases>21:23
sinzui?21:23
mwhudsonow21:27
mwhudsonis the fkey constraint still on the table when it's in to_drop?21:27
sinzuirockstar, I think listReferences needs to verify the table is not going to be dropped, or merge needs to filter that list by checking some table/column really needs updating21:27
rockstarmwhudson, no, the column that references it is also dropped.21:28
mwhudsonoh, that's something at least21:28
rockstarsinzui, handle all simple cases.21:30
jcsackettcan someone tell me why factory.makeBranch sets url to None if the branchtype is IMPORTED?21:32
sinzuirockstar, this is really old code. I think though that replication is the real issue. This is probably the first we have ever dropped a person column since replication was added21:36
rockstarjcsackett, because an import branch has a code import that points to where it imported the branch from.21:37
rockstarjcsackett, er, it has an ICodeImport...21:37
rockstarsinzui, yeah, so I'm not entirely sure how to proceed.  I could do a real hack job and just add branchmergerobot to the skip list.21:38
rockstarsinzui, replication is the real issue.21:38
sinzuirockstar, I try filtering the out the tuple  and leave an XXX to remove the hack after the DB update21:38
rockstarI guess I need to commit hairy query.21:38
jcsackettrockstar: thanks, i missed makeCodeImport when I read through factory.py21:40
sinzuirockstar, or you add a rule to your sql to add UPDATE CASCADE before your drop and trick the sanity check21:40
rockstarsinzui, yeah, that might be a good idea.21:40
rockstarsinzui, or I could just drop the column.21:41
mwhudsonjcsackett: "because our data model is a bit messed up"21:41
* jcsackett laughs.21:42
mwhudson(the answer to many questions about any sufficiently old and large project i guess!)21:42
mwhudsonjcsackett: branch.url is only about mirrored branches21:42
rockstarmwhudson, yeah, I was just talking to wgrant a few days ago about the prospect of Delorean Driven Development.21:42
mwhudsonjcsackett: really, the information about where the branch is mirrored from should be separate from the branch table, as it is for code imports21:42
mwhudsonjcsackett: but (a) chunk of work to change for no real benefit (b) ~noone uses mirrored branches any more21:43
jcsackettmwhudson: yeah, i should have actually known that since i was doing some work with imports prior to looking at factory; i just didn't see makeCodeImport and assumed makeBranch did something magical.21:43
jcsackettand then was sadly disappointed. :-P21:43
mwhudsonheh21:43
rockstarjcsackett, "there is no disappointment in no code."21:48
rockstarsinzui, what if I did this: http://pastebin.ubuntu.com/508280/21:54
sinzuirockstar, does it work?21:55
rockstarsinzui, yessir.21:55
sinzuithen I love it21:55
rockstarsinzui, yay.21:57
wgrantYay, my branch finally worked on DF.22:04
wgrantWe can release Maverick.22:04
flacostegary_poster, lifeless: do we know why the weekly and monthly performance reports are not generated?22:08
gary_posterno22:08
flacostethat's the https://devpad.canonical.com/~stub/ppr22:08
gary_posteron call22:09
pooliehi all22:09
flacostehey poolie!22:09
pooliehi flacoste22:09
pooliei'll still try to get you some bugs-closed numbers22:10
poolieit's not as easy as it should be :/22:10
flacostewell, it's actually not an easy problem22:10
flacostepoolie: i've tried gathering the data at the DB level, and found it hard22:11
pooliei can see that having some metric is useful22:11
pooliemm that's what i was going to do next22:11
flacostewhat should we count?22:11
poolie"line written" :-P22:11
flacostebugs on the bzr project22:11
flacosteacross the bazaar project22:11
* sinzui checks his query data for closed bugs by developer and milestone22:11
flacostefwiw, there were 4 bugs tagged udd closed during the quarter22:11
pooliei was going to try in bzr, udd, bzr-*22:11
pooliemm22:12
flacosteseems low22:12
poolieit seems a bit low22:12
pooliei suspect the tag is not always applied, especially when people split a bug into several etc22:12
flacostethat's surprinsgly low given the total number of bugs fixed22:13
flacosteso not sure i wanted to report that data :-)22:13
flacostetop was 'easy' bugs22:13
flacostei didn't include bugs in the udd project22:14
flacostesince i suspect they weren't tagged udd22:14
flacostei was going to add a UNION for those22:14
flacostepoolie, if you could only run the hottest script for main, that would be good22:14
flacostei can probably get the bugs data myself22:14
flacosteso don't spend too much time on that22:14
poolieone way to do it is to count things from the release notes22:15
pooliemanually classifying them now as udd relevant or not22:15
flacosteright22:15
flacostebut that excludes work that was done outside of bzr22:15
flacosteitself22:15
pooliefrom http://doc.bazaar.canonical.com/bzr.2.2/en/whats-new/whats-new-in-2.2.html and http://doc.bazaar.canonical.com/bzr.2.2/en/release-notes/index.html22:15
poolieright, and both of them exclude non-code-changing work22:15
pooliefor example john has put probably a couple of months into lp-serve22:15
pooliewhich is moderately relevant22:16
flacosteyep22:16
pooliebut not in bzr at all22:16
rockstarWhat time is PQM closing again?22:23
flacostepoolie: could we run hottest100 from devpad weekly?22:23
flacostepoolie: and have the reports available over HTTP, that could even be the first step to graphing this stuff22:24
flacosteif you set up a cron job on devpad, i'm willing to do the graphing22:24
pooliethat would be good22:24
pooliewhen i ran it last time, too many lp rpc requests failed22:24
pooliei'm not sure what's changed that it's seeing that22:25
rockstarEdwin-afk, when you return, ping.22:27
rockstar(I'm probably going to need an RC)22:28
flacostepoolie: well you ran it over a DB ugprade22:33
pooliemm, i think it was failing even earlier in the day, but then there were a couple of outages22:41
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
=== matsubara is now known as matsubara-afk
=== jam1 is now known as jam
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
LPCIBotProject devel build (99): STILL FAILING in 3 hr 24 min: https://hudson.wedontsleep.org/job/devel/99/23:10
LPCIBot* Launchpad Patch Queue Manager: [r=mars][ui=none][bug=654795] Allow a distribution's bug supervisor23:10
LPCIBotto set source package bug reporting guidelines and acknowledgment.23:10
LPCIBot* Launchpad Patch Queue Manager: [r=jml][ui=none] An ordering issue in Person:+subscriptions has been23:10
LPCIBotfixed.23:10
=== Edwin-lunch changed the topic of #launchpad-dev to: Launchpad Development Channel | Week 3 of 10.10 | PQM is Release-Critical | firefighting: stable has test failures | https:/​/​dev.launchpad.net/​ | Get the code: https:/​/​dev.launchpad.net/​Getting
=== Edwin-lunch changed the topic of #launchpad-dev to: Launchpad Development Channel | Week 3 of 10.10 | PQM is Release-Critical (Release manager: EdwinGrubbs) | firefighting: stable has test failures | https:/​/​dev.launchpad.net/​ | Get the code: https:/​/​dev.launchpad.net/​Getting
mwhudsonlosa ping23:34
spmmwhudson: yo!23:35
mwhudsonspm: the branchscanner db user can't access the distributionsourcepackage table23:35
mwhudsonspm: as seen in http://launchpadlibrarian.net/57215542/jR3X1uFDWYhXPet14K6N1hWzrkG.txt23:35
spmugh23:35
spmho ho ho. that sounds like cowboy #1 from the last release hasn't yet landed.23:36
mwhudsonspm: well, it's in devel23:36
mwhudsonspm: but i think which db was master changed recently?23:36
spmheh. *twice*. yes. :-)23:36
mwhudsonso it's possible the cowboy didn't propagate with the master switcheroo?23:37
mwhudsonspm: anyway, can you recowboy?23:37
spmyarp. so doing.23:38
mwhudsonthanks23:38
mwhudsoni don't know how to rescan the branches this affected...23:38
spmhttps://pastebin.canonical.com/36984/23:38
spmalready done23:38
spmUPDATE 3323:38
mwhudsonspm: heh, this has happened before i guess? :)23:39
spmistr stub did run sec.py, so I'd assume that zotted all the grnats nicely23:39
mwhudsonbecause otherwise that was some quick typing :)23:39
spmmwhudson: https://wiki.canonical.com/InformationInfrastructure/OSA/LaunchpadProductionStatus <== cowboy numero uno23:40
spmI am teh awesome23:40
LPCIBotProject db-devel build (58): STILL FAILING in 3 hr 43 min: https://hudson.wedontsleep.org/job/db-devel/58/23:40
LPCIBot* Launchpad Patch Queue Manager: [r=stub][ui=none][bug=654882] Add remote_name to component and23:40
LPCIBotcomponent group tables to track the original name from bugzilla,23:40
LPCIBotso we can supply it when forwarding bugs.23:40
LPCIBot* Launchpad Patch Queue Manager: [r=stub][ui=none][bug=644794] Switch out a link to23:40
LPCIBotDistroSourcePackage,23:40
LPCIBotin favor of separate links to Distribution and SourcePackage.23:40
LPCIBot* Launchpad Patch Queue Manager: [r=julian-edwards][ui=none][bug=655614] Don't publish indices for23:40
LPCIBotdisabled architectures.23:40
LPCIBot* Launchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 11683,23:40
spmI just thought; ya know, this'll effect branches that need rescanning and just typed that query in. magic.23:40
LPCIBot11684, 11685, 11686 included.23:40
mwhudsonspm: is the scanner chewing on the backlog now?23:42
lifelessnom nom nom23:42
spmnot sure yet - just getting the slaves updated as well23:42
mwhudsonpretty sure the scanner doesn't talk to the slaves23:43
spmmwhudson: ahh it's only having issues on *some* branches; so it was still mostly (for values of most) working23:44
mwhudsonspm: right23:44
mwhudsoni don't understand why "        and job.date_created > (current_timestamp at time zone 'UTC' - interval'1 day')" is in that query23:45
lifelessspm: bugger, can you cancel my pqm submission? plox?23:46
spmlifeless: sure23:46
lifelessmwhudson: https://code.launchpad.net/~lifeless/launchpad/db-code23:46
lifelessmwhudson: its just a revert; are you willing to rs it ?23:47
lifelessI propose to throw it straight at db-devel and let bb sort it out23:47
spmlifeless: sorry - too late; it's already gone thru.23:47
lifelessspm: no way, it takes longe rthan that to apply23:48
lifelessperhaps it didn't get sent . \o/23:48
spmhttps://pastebin.canonical.com/38360/ <== that one?23:49
lifelessyeah, it didn't land. thanks for looking23:49
wallyworldrockstar: you ok for a chat?23:50
rockstarwallyworld, sure are.23:50
rockstarLemme slap skype into submission.23:50
wallyworldskype?23:50
lifelessmwhudson: gnip23:51
mwhudsonlifeless: it seems reasonable23:51
pooliei wonder if we should implement "like this" in lp by linking out to one (or more) praise-giving web services?23:52
poolierypple, ohlo, ... probably more23:52
poolieflattr23:52
lifelessif we want that feature that might be a good way to do it.23:53
rockstarwallyworld, can you hear me?23:53
pooliei'm not saying i urgently want it, but adding the integration seems more tractable than writing the whole thing23:53
wallyworldrockstar: nope23:53
lifelesspoolie: its probably more complex to integrate23:54
pooliethan to write from scratch?23:54
lifelessbecause it raises questions we don't have if we do it inhouse23:54
lifelessyes23:54
lifelesslike, off the cuff:23:55
lifeless - how do we deal with liking private objects23:55
lifeless - or private people liking things for that matter23:55
lifeless - how do we deal with objects being renamed23:55
lifeless - how do we ensure it themes in well on an ongoing basis (not just when we do the integration)23:55
pooliesure, of course23:56
mwhudson"be the first of your facebook friends to like this!"23:57
mwhudsoni can see that going down well :)23:57
lifelessas long as it only shows up on oem services projects ;)23:57
poolieneeds a feature scope for "hates non-source-released web services"23:57
wgrantsinzui: Can we switch off lp and db_lp, then?23:58

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!