/srv/irclogs.ubuntu.com/2010/07/23/#launchpad-dev.txt

wgrantAre we out of testfix yet?00:31
jelmerwe were for a bit but I missed the window00:33
spmwgrant: possibly. I've kicked/forced a bunch of builds, so we remain optimistic.00:33
jelmernot sure if we're out of textfix again00:33
spmhey jelmer!00:34
jelmer'morning spm!00:34
wgrantMorning spm, jelmer.00:34
wgrantThanks.00:35
spmhey wgrant00:36
* thumper is getting sad writing the current email00:40
thumperI'm realising how far behind we are on bzr bits in LP00:41
jelmerthumper, behind in terms of the version you mean?00:46
thumperjelmer: yeah00:47
thumperwe are very behing in bzr, dulwich, bzr-git, bzr-svn and bzr-hg00:47
thumperprolly bzr-loom too00:47
jelmerthumper: well, the last three have pretty much stalled for the last couple of months00:48
thumperthere have still been a number of commits though00:48
mtaylorrockstar: hey-ho00:52
thumpermtaylor: I think rockstar is travelling00:52
mtaylorthumper: dammit00:52
mtaylorthumper: I need him to fix things in tarmac for me00:52
mtaylorthumper: it's discarding tag info, even though we thought the other day that it shouldn't00:53
wgrantWe're out of testfix, then?02:31
thumperwgrant: I'm trying to land02:32
thumperI think the force builds take us out of testfix02:32
wgrantWell, mwhudson landed something a few minutes ago.02:33
wgrantSo it seems to work.02:33
mwhudsonah cool, that landed02:36
wgrantHm.02:38
wgrantWhen did bin/test start spitting out per-test times?02:38
mwhudsonit's when you have -vvv02:38
wgrantMaybe I just added more -v than usual.02:38
wgrantAh.02:38
wgrantCan someone please land lp:~wgrant/launchpad/rework-dominator-tests?03:17
thumpermwhudson: did the email make reasonable sense?03:26
mwhudsonthumper: yes03:26
thumpercool03:26
mwhudsonthumper: although i guess i had a head start on understanding :-)03:27
thumper:)03:28
* thumper afk to pickup03:30
wgrantSome of the queries in lib/lp/archivepublisher/domination.py are extended versions of some on ArchiveSet. In a normal application, I'd call the ArchiveSet method and then .find() on the ResultSet to do further filtering.03:59
wgrantBut IResultSet doesn't contain .find(), so I can't do that in LP.03:59
wgrantHelp?03:59
thumperwgrant: I think perhaps an updated storm has it...04:23
thumpernot sure though04:24
thumpercould ask on #storm04:24
wgrantthumper: Thanks, I've asked there.04:29
wgrantthumper: Could you be convinced to ec2 https://code.edge.launchpad.net/~wgrant/launchpad/rework-dominator-tests/+merge/29668 and https://code.edge.launchpad.net/~wgrant/launchpad/link-uploaded-ddebs/+merge/29669?04:29
thumperwgrant: yep04:29
wgrantThanks.04:30
lifelessmoin04:56
wgrantMorning lifeless.04:58
* wgrant wishes that the 3.0 heading guidelines were complete.04:59
lifeless...?05:00
wgrantlifeless: Page titles were redesigned for 3.0.05:02
wgrantBut they did not consider how it should work when on a page with a non-root context.05:03
wgrantThe root context is always shown at the top of the page.05:03
wgrantBut say I'm on a page relating to a PPA. It has the owner's name at the top, and no built-in indicator of which PPA it's operating on.05:03
wgrantWhat should the h1 be?05:03
wgrant'Administer', 'Administer archive', 'Administer PPA for William Grant'?05:03
lifelessoh05:04
lifelessis this a widely known issue ?05:04
lifelesswho was doing the work, can we ask them to finish it off? Or is there a good answer ppl are just doing ?05:04
wgrantI've raised it a couple of times in the last 12 months.05:04
wgrantThere's no consistency at the moment.05:04
lifelesswhen you raised it, what happened; was there some sort of consensus ?05:05
wgrantNothing really came of it.05:05
wgrantThere's also the whole mess around how the tabs work for non-root contexts.05:05
wgrantThe issue was identified somewhat before 3.0, but never resolved.05:05
wgrantResulting in a confusing UI for non-projects.05:05
lifelessis there something you'd like to do about it ?05:06
lifelessactually05:07
lifelessa better question05:07
lifelessdo you have a proposal that would improve consistency and be, on the whole, more useful for users.05:07
lifelessand not be terrible to calculate perf wise.05:07
wgrantI don't know what would be best.05:07
lifelessI'm not talking best.05:07
lifelessbest is freaking hard man.05:07
lifelessI think some consistency is good - useless consistency isn't. We need to do each page really well, but a sane default can help a great deal.05:08
wgrantEven some pages on root contexts are pretty bad.05:14
wgranthttps://code.edge.launchpad.net/launchpad/+activereviews, for example.05:14
lifelessis there some difficulty in fixing them?05:14
wgrantThey're trivial to fix, once we define what they should be like.05:14
lifelessuh05:14
lifelesswhy do we need a pre-fix definition here ?05:14
lifeless*anything* is trivial if you can define it :P05:14
wgrantIf we are changing titles to suck less and be more consistent, we need to define what they are going to be consistent with.05:14
wgrant3.0 tried to do that, but failed.05:14
lifelessperhaps I'm over simplifying05:14
lifelessbut - a) suck less, b) be more consistent : seems we could make them suck less by /doing/ and make them more consistent by picking the nicest pattern that emerges and using it as a sane default ?05:14
wgrantPossibly.05:14
lifelesswgrant: if the only consistent thing at the moment is that they suck, surely we should fix that :)05:14
lifelesswe have a ui review process, so mistakes should be caught - thats a decent safety net05:16
wgrantYou can't make a mistake at the moment.05:17
wgrantBecause there are no guidelines to break.05:17
wgrantI think we just need to work out the undefined general cases, and define them.05:18
wgrantThis may require a change to the structure of the header.05:19
lifelesswgrant: You seem to be saying folk can't improve things here without a lot of work, which surprises me,05:34
lifelessis that right?05:34
wgrantlifeless: It can be mostly fixed by someone just declaring how much context information should go in titles.05:35
wgrantA complete fix (which fixes tabs for non-root contexts) is harder.05:35
lifelessso if I say 'the right amount to look good on a page should go there', is that useful, or am I *still* missing the point05:36
thumperwgrant: both your branches playing through ec205:38
wgrantlifeless: How much looks good on a page?05:40
wgrantAnd is that amount enough?05:40
wgrantthumper: Thanks.05:40
lifelesswgrant: that seems to be a matter of judgment and testing05:47
lifelesswgrant: You don't seem to have a hesitation doing that to lp internals; I'm unclear why you have a hesitation doing the same to page templates :)05:47
wgrantlifeless: Precisely.05:47
wgrantlifeless: I am no UI designer.05:48
wgrantLP has a severe lack of UI design05:48
wgrantAnd it shows.05:48
lifelessare you saying we lack the knowledge to improve at all?05:49
wgrantNo. I'm saying that somebody with significant user experience should be consulted before we go and fix all the titles to conform to a new standard that might still suck.05:50
lifelesswgrant: so - +1 on getting more import. -1 on doing /nothing at all/05:51
lifelesss/import/input05:51
wgrantWe have no UI designer. How do we get more input?05:51
lifelesswe have a whole design team on call, and they are extremely happy to do small things on-request.05:52
lifelessI'm not at all convinced that this is a problem we lack the knowledge for though. However, I'll grab mpt today and show him this chat and ask his opinion.05:53
wgrantAn attempt was made a year ago.05:53
wgrantIt did not work.05:53
lifelesswgrant: so try something different05:53
wgrantWe can certainly make large improvements easily.05:53
wgrantBut it would be nice to get it right.05:53
lifelessgreat!05:53
lifelessthe thing about right.05:54
lifelessis that it lasts for, oh, 2-3 days.05:54
wgrantOK, as close to right as we can easily get.05:54
lifeless:)05:54
* bryceh goes close to left05:55
lifelessbryceh: any progress on the attachments thing?05:55
brycehhmm?05:56
lifelessthe api call05:56
lifelessin bugs05:56
lifelessis there a partial branch or something like that to make it faster? If not I'll have a stab at same today.05:56
brycehnope, I'm trying to get another branch finished up before I go on vacation05:58
lifelessok06:03
lifelesslosa hi06:17
lifelessspm: hi ?06:23
spmlifeless: hola06:29
lifelesshow long till edge rolls out ?06:38
* lifeless is excited06:38
thumperlifeless: excited about what?06:39
spmlifeless: https://wiki.canonical.com/InformationInfrastructure/OSA/LaunchpadProductionStatus "Edge Updates" 0800 BST. we strikethru if they're not for some reason or another06:40
lifelessthumper: rev 11199 on stable06:40
lifelessspm: kk06:41
thumperlifeless: which has what?06:41
lifelessa /massive/ search overhead reduction06:41
thumperah06:41
* thumper EOWs06:41
lifelesshave a good weekend06:43
lifelessspm: so, another hour right ? :)07:07
* lifeless bounces07:07
bilalakhtarlifeless: Are you a core-dev in ubuntu?07:10
spmlifeless: pretty much exactly, yeah07:11
lifelessbilalakhtar: no, why?07:11
* bilalakhtar is searching for core-devs to sponsor his bugfixes07:12
bilalakhtarlifeless: ^^07:12
lifelessput it in the sponsor queue please07:12
lifelessspm: whats the url for monitoring edge rollout progress again ? I didnae bookmark it07:56
spmlifeless: we don't have one07:57
lifelessoh07:57
lifelessthats right :)07:57
lifelesswe have one for staging or so or something07:57
spmyup07:58
spmhttps://staging.launchpad.net/successful-updates.txt <== tho is more "worked/not" vs progress07:58
lifelessso how is edge going ? :)08:00
lifeless<- not keen at all08:00
danilosOOPSes while trying to log in, a known problem? https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1665ED84108:01
spmfrom memory, it'll be around 5-10 mins before it gets beyond simply building/syncing the tree08:01
lifelessdanilos: ugh08:02
lifelessspm: we may have to abort - benji's code may be bust08:02
lifelessspm: don't stop it yet08:02
lifelessdanilos: does your username have utf8 in it ?08:03
danilosspm, did we get a new openid rollout by ISD guys as well? (just to confirm we only have to look at our code for the problem)08:03
spmlifeless: not really; if it's a hard fail; edge1 will break and the rollout will stop08:03
daniloslifeless, username doesn't, but my name does08:03
spmif it's more subtle than that; rolling back is trivial08:03
lifelessspm: actually, thats already on edge. I was thinking a prod stop-point08:03
lifeless<- EUNCAFFEINATED08:03
* danilos disables edge redirection and tries again08:04
wgrantlifeless: Is it complaining about the XSRF token sent by SSO?08:04
wgrantI can't see the OOPS, but there's already a branch to fix that.08:04
lifelesswgrant: no, unicode08:04
wgrantAh.08:04
lifelessdanilos: file a bug on foundations08:07
daniloslifeless, right, my name is the culprit, I've changed it and can log in08:08
daniloslifeless, prod also works, so it's edge code08:08
lifelessits a classic 'this code wasn't QA'd' scenario :-08:08
lifelesswhich the new deployment process should address08:09
daniloslifeless, I'd also lean on marking this one as critical, but will leave that to whoever gets a chance to take care of it08:11
danilosanyway, bug 60902908:11
_mup_Bug #609029: UnicodeDecodeError OOPS on login on edge <oops> <Launchpad Foundations:New> <https://launchpad.net/bugs/609029>08:11
lifelessdanilos: I agree08:12
lifelessspm: hows edge, and how is the db load looking08:18
spmlifeless the-impatient ;-) fwiw, your email will probably know before I do, unless something breaks hard. error reports: Subject: Cron <pqm@praseodymium> /home/pqm/bin/rollout_edge.sh will have the details08:20
lifelessspm: yes, its live08:21
spmload looks normal, as a one off snapshot ish.08:22
spmlooks like edge4 is/has just been updated08:24
spmhas08:24
lifelessok, https://bugs.edge.launchpad.net/ubuntu/+filebug does seem better on edge now08:26
mrevellHowdy08:27
lifelessspm: ok, still looks ok ?08:33
spmlifeless: I assume so, not getting any alerts; which is the usual 1st line08:34
lifelessk, thanks08:35
=== almaisan-away is now known as al-maisan
wgrantDoes PQM really take half an hour?09:35
jkakarFYI, I'm getting 'Internal Server Error' here: http://bazaar.launchpad.net/~jkakar/storm/resultselect/files09:45
spivjkakar: that branch is 1.9 format, but is stacked on trunk which is 2a09:54
spivjkakar: upgrade it and it'll be fine09:54
jkakarspiv: Yeah, I figured as much...09:55
jkakarspiv: Regardless, I shouldn't see "Internal Server Error".09:55
spivOh, certainly.09:55
spivI *think* there's a bug about that already, feel free to click "affects me too" on it.09:55
jkakarCool.09:56
wgrantbigjools: Are there really no tests of NascentUpload that don't use a real upload?10:37
wgrantI can't see any :(10:38
wgrantI guess I'll work it out.10:38
bigjoolswgrant: probably not :(  I know there's some unit tests for dscfile10:40
bigjoolsthat's about it10:40
bigjoolsbut it's the direction we need to go so that soyuz tests don't take 35-40 minutes. :/10:41
wgrantYeah, I've started shuffling things around so it's more possible.10:41
wgrantarchiveuploader is really ugly.10:41
bigjoolsugly with boils10:43
lifelesswgrant: ok, mpt review done, checklist being fixed.10:58
lifelessits like the title but less so :P10:59
wgrantlifeless: Ooh, thanks.11:06
mptlifeless, https://dev.launchpad.net/UI/Reviews?action=diff&rev2=34&rev1=3311:15
wgrantmpt: Thanks.11:17
wgrantSo we're to include context in the h1, even if it's the root context?11:17
wgrant(which is already displayed at the top of the page)11:17
lifelessmpt: thanks!11:17
lifelesswgrant: mpt said verbally that folk ignore the global nav stuff, universally11:18
lifelessperhaps thats worth adding11:18
wgrantIn the root context case, it's in the breadcrumbs and header already.11:19
mptwgrant, remind me what "the root context" means?11:20
wgrantmpt: The pillar or person containing this page.11:21
wgrantThe context may be a source package, but the root context is the distribution.11:21
wgrantIt's displayed at the top of every page.11:22
wgrant(I believe the concept and term were introduced with 3.0)11:22
lifelesswgrant: the point is people don't read that stuff11:22
lifelesswgrant: mpt: anyhow: if we can transfer the info so that wgrant is unblocked, I will be ecstatic. I think the page improvement so far is very useful.11:23
wgrantIt looks like a good idea.11:24
mptAh, I should have mentioned another thing11:25
mptMore specific stuff should go earlier in the heading and the title11:25
mptless specific stuff later11:25
wgrantThat's ensured in the title, since it's reversed breadcrumbs.11:26
wgrantAlthough that does result in oddities like "10.04 : Ubuntu", which I'm not really a fan of.11:26
mptyeah, reversed breadcrumbs are an unfortunate case of automation over sensibility11:27
wgrantI think they are better than what came before them.11:27
wgrantBut not better than a fully redesigned set of custom titles.11:27
mptThey may be better technically, in that pagetitles.py was hilarious11:28
wgrantThere is at least some amount of consistency now.11:28
wgrantpagetitles.py is almost gone.11:28
mptBut at least pagetitles.py let me eyeball inconsistencies.11:28
stublifeless: Have you looked at garbo.py? It is a framework suitable for many of our hourly and daily tasks - the ones that don't need external resources besides the database.11:28
stublifeless: So for instance I'll be suggesting to jtv that the cachesuggestivetranslations.py cronjob should be a task in the garbo, avoiding yet-another-cronscript-to-manage as well as bonuses such as aborts if it takes too long and fewer notifications for people to monitor.11:30
stublifeless: It needs better plugin architecture, and it isn't a replacement for a general job handler, but I think a step in the right direction.11:31
lifelessstub: nice11:38
lifelessstub: +111:38
lifelessstub: I do think jtv's particular case would be better served by events, but the existing event queuing things are not nice enough to draw in adopters yet11:39
stubI don't know enough of the task system or the suggestions to know if that is a suitable fit.11:40
lifelessstub: making garbo replace most of the existing cron jobs would help the sysadmins a lot I think11:41
stubYup. Also makes scheduling nicer - we don't end up with batch jobs running simultaneously causing load spikes.11:42
lifelessanyohe that has oopstools working - could you see if https://bugs.edge.launchpad.net/oops-tools/+bug/608914 has a working patch ?11:46
lifelessjelmer: wb, did you see my reply?11:46
_mup_Bug #608914: Bugs not shown in the Timeouts section of oops summaries <OOPS Tools:Triaged> <https://launchpad.net/bugs/608914>11:48
=== al-maisan is now known as almaisan-away
jelmerlifeless: yep, thanks12:05
pooliejames_w, istm that <https://edge.launchpad.net/ubuntu/+source/bzr> (for example) ought to link to the packaging branches12:12
poolieif any12:12
poolieor tell us there are none12:12
james_wyes12:13
james_w"Code", but yes12:13
rockstarMorning folks!12:22
bigjoolshey rockstar12:22
rockstarbigjools, what's the status of the maverick buildd stuff?12:30
bigjoolsrockstar: still buggered as far as I know.  Are you referring to the aptitude thing?12:33
rockstarbigjools, yeah,12:33
rockstarbigjools, is there anything I can do to help that along?  I have some other tasks, but that's one of the blockers for jorge getting upstreams to use it.12:33
rockstar(I'm going to work on the other one today)12:34
bigjoolsrockstar: I don't know, I am not dealing with it.  Were you expecting me to be?12:34
bigjoolsit's a problem with the recipe stuff in the slave code12:35
rockstarbigjools, yeah, I thought that you were going to get abentley's patch applied to the buildd to fix it.12:35
bigjoolsI didn't know there was a patch :)12:35
bigjoolswe're currently having problems getting any recipe build to go through dogfood - they all hang.12:35
rockstarbigjools, okay, lemme chat with abentley when he's around, and we'll sort it out.  We need to make that a priority.12:36
rockstarbigjools, :(12:36
bigjoolsrockstar: see this for example: https://code.dogfood.launchpad.net/~abentley/+recipe/bazaar/+build/263/+files/buildlog.txt.gz12:36
bigjools"bzr: ERROR: No previous changelog to take the package name from, and --package not specified"12:36
bigjoolswtf?12:36
bigjoolsrockstar: ok when you get know where the patch is, we can ask lamont to deploy it on the DF builders.12:37
rockstarbigjools, yeah, I was just about to point that out.12:37
rockstarbigjools, ack.  Thanks.12:37
bigjoolsit takes 10 minutes to print that error out as well12:37
rockstarbigjools, since you said they were hanging, I wondered if that was an artifact of killing the build.12:38
rockstarjames_w, ping12:38
bigjoolsno, I didn't kill it12:38
rockstarbigjools, we also have some sourcecode/ updates that need to be applied to fix some more bugs.12:39
rockstarbigjools, do you have any comments on fixing https://bugs.edge.launchpad.net/launchpad-code/+bug/58340312:39
_mup_Bug #583403: Sourcepackage recipe builds need much more logging <recipe> <Launchpad Bazaar Integration:Triaged> <https://launchpad.net/bugs/583403>12:39
bigjoolsrockstar: yeah I think the logging needs to come from bzr12:41
rockstarbigjools, okay.  Are those logs just capturing stdout then?12:41
bigjoolsyes12:41
rockstarbigjools, great.  I'll get a patch together and have james_w review it.12:41
bigjoolsnyshe12:42
bigjoolsrockstar: we're not going to get far until we figure out that long hang + the error above though :(12:42
rockstarbigjools, yeah, what resources do you need in order to do that?12:42
bigjoolsrockstar: james_w :)12:43
bigjoolsit's running stuff I know nothing about unfortunately12:43
wgrantbigjools, rockstar: That recipe is buggy.12:43
bigjoolswell that's a good start.12:44
wgrantIt should be a merge, not a nest.12:44
rockstarbigjools, okay, well I'll try and reproduce it here.  james_w is kind of going into maintenance mode on some of these udd tasks, and I offered to pick up maintenance for them.12:44
bigjoolsit should fail a bit quicker though12:44
rockstar(Of course, that means I need to learn them first)12:44
wgrantHow long does it hang?12:44
bigjools10 minutes12:44
wgrantInteresting.12:44
* bigjools fixes the recipe12:44
wgrantbigjools: Just s/nest/merge/, and drop the 'debian' from the end.12:45
rockstarThat might be a bzr stupidity.12:45
rockstarLike bzr builds a whole working tree in memory just to get the single folder, or something.12:46
bigjoolsdispatching the new recipe now12:47
bigjoolswgrant: btw I have a new buildd-manager on DF.12:47
bigjoolsshould be fun to see if it breaks production :)12:47
wgrantHeh.12:47
wgrantAs in the new properly parallel one?12:47
bigjoolstesting so far shows no issue12:47
bigjoolsyes12:48
wgrantNow we just need to convince it to dump uploads in a queue, and the problem is mostly fixed!12:48
bigjoolsI do like Twisted.  I don't like the b-m code so much.12:48
bigjoolsyes, jelmer is working on that :)12:48
wgrantExcellent.12:48
wgrantI've also ported lp-buildd to use a modern system version of sbuild, so we can drop our unmaintained ancient buggy fork once Soyuz does ddebs.12:51
wgrantSo we should have a much healthier, more maintainable build farm soon, on multiple fronts...12:51
lifelesslosa ping12:52
rockstarwgrant, this, my friend, is most excellent news.12:52
lifelesshttp://pastebin.com/e9D6x3hX <- I'd like timing data for that query on each DB host please.12:52
mthaddonlifeless: hi12:52
bigjoolswgrant: \o/ \o/ \o/12:52
wgrantAlthough I had to destroy buildrecipe in the process.12:52
rockstarwgrant, now, if only we could have test coverage for the build farm.12:52
pooliejames_w, https://bugs.edge.launchpad.net/launchpad-registry/+bug/60911612:52
_mup_Bug #609116: package page should point to package branches (or not) <udd> <Launchpad Registry:New> <https://launchpad.net/bugs/609116>12:52
wgrantrockstar: Translations made a good start on testing their part of it.12:53
lifelessit the literal query running on filebug queries on edge; its timing out a lot - I'm interested in figuring out if:12:53
lifeless - there is one bad host12:53
lifeless - there are bad query plans being generated12:53
lifelessmthaddon: oh, and hai12:53
mthaddon:)12:53
wgrantbigjools: Um, where did that recipe go?12:54
wgrantIt has disappeared.12:54
wgrantI wonder if you ran into a form bug and accidentally reassigned it yourself.12:54
wgrantHeh, yes, there it is.12:54
bigjoolsthe log was there briefly12:54
bigjoolswtf12:55
* rockstar waits for the expansion of "form bug"12:55
wgrantThe owner <select> won't have been populated with the previous value, since it was abentley, and bigjools is not abentley.12:55
gmbrockstar, Could you or a suitable one of your code team cohorts take a look at the currently-failing merge between stable and db-devel please? There's a conflict but I'm not sure whether to just accept the merge-source version or not.12:56
wgrantSo it will have defaulted to the first available value.12:56
rockstargmb, sure.12:56
gmbrockstar, Thanks.12:56
rockstargmb, oh shit, if this is what I thinks it is...12:56
bigjoolswgrant: https://code.dogfood.launchpad.net/~julian-edwards/+recipe/bazaar/+build/26512:56
bigjoolsit's hanging again12:57
gmb...12:57
rockstarbigjools, it might just be that it's not logging anything properly.12:57
wgrantbigjools: Ew.12:57
wgrantThat is possible.12:58
rockstarbigjools, when I hear "hang" I think "this will not complete" but it gets back to going in a bit.12:58
bigjoolsthat is not just possible, it's highly likely12:58
wgrantbigjools: Can you check the CPU usage?12:58
bigjoolsno :(12:58
bigjoolsthe VMs don't let you ssh in12:58
rockstarIt generates an error message that makes no sense, this is true.12:58
wgrantThe error message made perfect sense.12:58
bigjoolswe need to make this run quicker, this is way too slow12:59
wgrantIt probably won't occur this time, though.12:59
rockstarbigjools, maybe we should find a way to keep metrics on the buildd CPU/mem usage.12:59
rockstarI'm sure lifeless is all for it.12:59
bigjoolsaaaaaaand fail12:59
bigjools/usr/lib/pbuilder/pbuilder-satisfydepends: line 92: aptitude: command not found12:59
bigjoolsas expected for maverick13:00
wgrantBetter fail, though.13:00
rockstarYup.13:00
bigjoolscan we just bin aptitude13:00
bigjoolsit causes no end of problems13:00
rockstarbigjools, no idea what the ramifications are.  The people who would know are sprinting currently.13:01
bigjoolspbuilder could just use apt-get and this problem would disappear13:01
wgrantWell.13:01
wgrantaptitude resolves some things differently.13:02
wgrantIt used to be vastly superior to apt-get.13:02
wgrantNot so much any more, though.13:02
rockstars/differently/stupidly/13:02
bigjoolswhere differently is wrongly, so I'm told :)13:02
wgrantIndeed.13:02
wgrantBut there was rationale for using it in the past.13:02
jelmerwgrant: also, it doesn't have moo powers.13:08
wgrantjelmer: Heh.13:09
bigjools"apt-get moo" is right up there with "bzr rocks"13:09
poolieyeah i think the moment has passed13:09
Ursinhabigjools, oh crap, I didn't know about that13:10
Ursinha:)13:10
wgrantbigjools: aptitude's moo is better...13:11
bigjoolsheh13:11
bigjoolswgrant: ok the lucid build is working now13:12
bigjoolsI wonder what it's doing that takes so long13:13
wgrantIt took 10 minutes to check out from here.13:13
bigjoolshmmm, I wonder if it needs a --lightweight13:13
bigjoolsanyway, food time13:14
wgrantA lightweight checkout might actually be a reasonable idea here.13:15
wgrantHmmmm.13:15
wgrantWe should test that.13:15
lifelessok13:17
lifelessso fti can do the search we need in 4ms13:17
lifelessbut if you rank, you're fucked13:17
lifelessand if you join out from bug, you're in trouble too13:18
wgrantSo basically, we're doubly in trouble?13:19
james_wrockstar, bigjools: if you update your copy of bzr-builder you will get more logging13:20
lifelessjust as a noddy example:13:20
lifelessSELECT bug.private FROM Bug, BugTask WHERE Bug.id = BugTask.bug AND BugTask.distribution = 1 AND Bug.fti @@ ftq('depend|eclips|error|get|instal|unmet')    LIMIT 40;13:20
james_wplus an improvement to that previous error message13:20
lifelessTime: 4.552 ms13:21
james_wand many other bugfixes too13:21
rockstarjames_w, awesome.  I need to find out how to upgrade sourcecode/ then.13:21
lifelessSELECT bug.private FROM Bug, BugTask WHERE Bug.id = BugTask.bug AND BugTask.distribution = 1 AND Bug.fti @@ ftq('depend|eclips|error|get|instal|unmet')  ORDER BY -rank(Bug.fti, ftq('depend|eclips|error|get|instal|unmet'))  LIMIT 40;13:21
lifelessTime: 7467.015 ms13:21
rockstarjames_w, a bzr-builder and bzr-builddeb update are both in my TODO list for today.13:21
wgrantrockstar: sourcecode won't help the builders.13:21
james_wtrue13:21
rockstarwgrant, I understand that, but it gives me a start.13:21
james_wit will still be useful for other fixes though13:22
james_wwhere in the log does the 10 minute hang happen?13:22
rockstarTo deploy the new changes, I can just put a new package in a ppa (location still unknown to me) and then have lamont update.13:22
rockstarbigjools, see james_w's question. ^^13:22
wgrantjames_w: Immediately after the launchpad-login warnings.13:24
james_wok13:24
rockstarjames_w, I think it's actually in the builder part at that point, so if we have better logging, we might not have to worry about it anymore.13:25
james_wrockstar: it's still in bzr-builder I think, but I believe that it may just be slow bzr access over http13:28
rockstarjames_w, yeah, that's what I was thinking.13:29
james_wrockstar: the new bzr-builder should help with that some as well13:29
rockstarjames_w, yup.  Looking to update it today.13:29
wgrantIs there a good reason for buildrecipe to be a shell script?13:31
wgrantI need to move some of it into the Python part of the slave.13:31
james_wwgrant: none that I know of13:32
wgrantAnd it all ends up simpler (particularly the error handling) if the whole thing is integrated into the slave Python.13:32
lifelessSELECT bug.private, 1 as therank FROM Bug, BugTask, to_tsquery('depend|eclips|error|get|instal|unmet') query WHERE query @@ bug.fti and Bug.id = BugTask.bug AND BugTask.distribution = 1 ORDER BY therank DESC LIMIT 40 OFFSET 0;13:32
lifelessTime: 4.171 ms13:33
lifelessSELECT bug.private, ts_rank(bug.fti, query) as therank FROM Bug, BugTask, to_tsquery('depend|eclips|error|get|instal|unmet') query WHERE query @@ bug.fti and Bug.id = BugTask.bug AND BugTask.distribution = 1 ORDER BY therank DESC LIMIT 40 OFFSET 0;13:33
lifelessSELECT bug.private, ts_rank(bug.fti, query) as therank FROM Bug, BugTask, to_tsquery('depend|eclips|error|get|instal|unmet') query WHERE query @@ bug.fti and Bug.id = BugTask.bug AND BugTask.distribution = 1 ORDER BY therank DESC LIMIT 40 OFFSET 0;13:33
lifelessbah13:33
lifelessTime: 5626.790 ms13:33
lifelessok13:33
lifelessplane time13:33
lifelessmthaddon: thanks a lot for the stats - its useful13:33
mthaddoncool13:33
wgrantI guess that sort of makes sense.13:33
james_wwgrant: there's a use for process separation I think, but the language doesn't have an impact on that13:34
wgrantjames_w: Given that it pretty much just executes a few subprocesses anyway, I don't see much value in having another layer there.13:35
jtvdanilos, btw: a very simple small improvement I discussed w arne & dpm is to discard blocked ubuntu PO uploads after a year.  If there's ever a new upload they'll probably just get re-blocked anyway, but it cuts down the queue by 40%13:35
danilosjtv, yeah, sounds good13:36
james_wwgrant: right, it's a small window of exceptions that would affect that. Making it not run builder as a subprocess and call the python functions instead probably isn't a good idea though13:36
jtvalso, arne came up with a great solution for some other process problems: when they approve an upload, do an instant approval run over other entries it's likely to affect.13:36
wgrantjames_w: Oh, certainly. Those will continue to run as subprocesses. But buildrecipe will be merged into sourcepackagerecipe.py.13:37
danilosjtv, sounds so simple ;)13:37
james_wwgrant: +113:38
danilosjtv, (ok, it's not too hard if "instant" is "in a few minutes" :)13:38
jtvdanilos: the fun is in the fine print...  this would be approvals, not blocking, and probably only needs-review uploads with the same path and for the same package/productseries13:38
wgrantjames_w: Thanks.13:39
jtvI think that's probably not too hard.13:39
danilosjtv, hum, language detection, custom language codes, different layouts? blocked is just about the problem of the same complexity so not really a big deal13:40
jtvdanilos: they don't mind if it doesn't work as well for different layouts.  I wouldn't think the rest would be that costly.13:40
jtvOr how about just the files with the same path?13:41
james_whi gary_poster, I requested a review from you of https://code.edge.launchpad.net/~james-w/launchpad/drop-default-skin/+merge/30763 which was a change that salgado discussed with you the other day. Let me know if you would like someone else to review it.13:55
gary_posterack, james_w.  I'll look at it in a few13:56
flacostegmb: subscribing to a tag is within scope of the better subscription control story right?14:12
gmbflacoste Yes.14:13
gmbflacoste, Sorry, just grabbing lunch; I'll answer any questions when I get back.,14:13
flacostegmb: no other questions, bon appétit!14:13
* rockstar fetches breakfast14:17
=== almaisan-away is now known as al-maisan
=== matsubara is now known as matsubara-lunch
=== gary_poster is now known as gary-lunch
rockstarbigjools, ping?16:20
bigjoolsrockstar: hi16:47
rockstarbigjools, we're talking recipes in mumble right now.16:48
rockstarbigjools, I suppose that was my indirect way of inviting you to talk recipes with us in mumble.16:49
mtaylorrockstar: morning16:53
rockstarmtaylor, hello sir16:53
rockstarmtaylor, are you on the west coast?16:53
mtaylorrockstar: I am.16:54
mtaylorrockstar: I have some fun tarmac things to poke you about - and now I'm in the right time zone to do it!16:54
=== beuno is now known as beuno-lunch
rockstarmtaylor, ah, yes, I am home now, so we're only an hour difference.16:55
mtaylorw00t16:55
mtaylorrockstar: well... the most annoying one is that, as lifeless was hinting might be the case, tags are not propogating16:55
rockstarmtaylor, hm...16:55
rockstarmtaylor, is there a bug?16:55
mtaylorrockstar: not yet16:57
mtaylorrockstar: I made a quick list of bugs to file, which I will do this morning16:57
rockstarmtaylor, well how do I fix a bug I don't know about?  :)16:57
mtaylorrockstar: I know I know16:58
rockstarmtaylor, also, there is #tarmac, that actually has people in it, if you get stuck and I'm not around.16:58
=== gary-lunch is now known as gary_poster
rockstargary_poster, is there a doc in the launchpad that tells me how I can update stuff in sourcecode/17:13
gary_posterrockstar: not that I'm aware of, unfortunately, but the conf file is pretty obvious.  Lemme find it for you (somewhere in utilities...)17:14
gary_postersourcedeps.conf17:14
benjiis there a way I can get a full diff between the code on edge and prod?17:15
gary_posterrockstar: utilities/sourcedeps.conf .  Take a look and then feel free to ask questions17:15
gary_posterbenji: um, yeah...you could do ``bzr diff --new=(edge) --old=(prod)`` where (edge) == lp:launchpad/stable and (prod) == lp:launchpad/production or something close to that, but that sounds to me like you're going to have an awfully unwieldy diff.  I can see why you'd ask though (the unicode login thing, I suspect)...thinking if there might be another way to approach it...17:18
benjiyeah; it turns out that I can't reproduce it in development and I can't imagine how my recent changes caused it17:19
benjithe tests for this corner of the world are pretty screwy; so much stuff is faked out that very little of the real code runs, and when it does run it often takes different code paths than in actual use17:20
gary_posterbenji, you've duped on edge or (mildly better because then you are not changing the real db) staging?17:24
benjiyep, I can dupe on edge17:24
benjiI just had to change my login.launchpad.net user name slightly, so no DB change worries17:25
gary_posterthe fact that you can't dupe locally (launchpad.dev) is concerning17:26
benjigary_poster: the problem is that it's not possible to dupe in dev, not that the error doesn't exist; there are no test users with unicode in their names and the prod OpenID provider doesn't entirely work with dev17:27
=== matsubara-lunch is now known as matsubara
gary_posterbenji, oh, I see.  So, to dupe, you would need to have a new user (or modified user) that has the state.  ...I *think* we have some helpers now to create users on the fly17:34
gary_posterbenji: utilities/make-lp-user might or might not help17:36
benjik, thanks17:36
rockstargary_poster, okay, so I just submit a merge against the pqm managed branch and then update the sourcecode.conf file with the new revno?17:41
gary_posterrockstar: right17:41
rockstargary_poster, okay, thanks.17:42
gary_posternp17:42
rockstarjames_w, ping17:56
james_whi rockstar17:56
rockstarjames_w, abentley tells me you're making packages for bzr-builder and bzr-builddeb to be used in the buildds (so I don't have to make those).  Is this true?17:57
james_wI did last time17:57
rockstarjames_w, I'm happy to make them and put them in the right place if you can provide me some details.17:57
james_wrockstar: bzr-builddeb is a native package, and I usually upload via Debian, it's easy to tweak the version number and build a pre-release package though18:08
rockstarjames_w, I'm more concerned about bzr-builder's status more than anything now.18:09
james_wrockstar: I'm just checking if there is anything I should fix before doing a bzr-builder release. If not then I will do that and we can get a package in to its PPA.18:09
=== al-maisan is now known as almaisan-away
=== beuno-lunch is now known as beuno
james_wI wanted to get the merge-subdirs change in, but it is blocked right now, so I will do a release now, and then one with it when it lands18:11
rockstarjames_w, I think the big bzr-builder bug we need the fix for is the new merge instruction.18:25
statikhola launchpad hackers18:32
statiki'm trying to install launchpad-dependencies on maverick, and can't find the python-profiler package that is wanted18:32
statikis this something i could fix by rebuilding a package for maverick in the PPA?18:33
james_wrockstar: https://edge.launchpad.net/bzr-builder/trunk/0.318:38
james_wstatik: you need multiverse enabled, at least on lucid18:38
rockstarjames_w, did you mean to have that file start with .. ?18:38
james_wrockstar: hah, no, I obviously don't have the script with that bug fixed.18:39
statikjames_w, ah thx, i will check that i have multiverse enabled18:39
rockstarjames_w, does this have the new instruction in it?18:39
james_wrockstar: no18:39
rockstarjames_w, :(18:40
james_wthat branch isn't ready yet18:40
james_wyeah18:40
rockstarjames_w, what do we need to do to get it ready?  What can I do to help it along?18:40
james_wNew tarball uploaded18:40
james_whttps://code.edge.launchpad.net/~spiv/bzr-builder/merge-subdirs-479705/+merge/1497918:41
james_wrockstar: kicking it off to build into the PPA18:43
rockstarjames_w, awesome, thanks.18:43
james_wnow I'm heading out for dinner18:44
=== Ursinha-afk is now known as Ursinha
james_wthe packages should show up here in a bit: https://edge.launchpad.net/~dailydebs-team/+archive/bzr-builder18:45
rockstarjames_w, the package is basically trunk right now, yes?18:49
=== jelmer_ is now known as jelmer
maxbstatik: Just testing, or actually going to try LP dev on Maverick? Is it time that we should be looking to properly populate the PPA for Maverick?19:03
marsabentley, ping, have a moment for a quick question about testrepository and testr?  I was wondering what you have in your .testr.conf19:24
abentleymars, I have the default value except in one branch where I added xvfb-run to the run command.19:25
=== beuno_ is now known as beuno
abentleymars, right now the lack of incremental output is a real downside, so I haven't been using it much.19:26
marsincremental output?19:26
marslike "It runs everything and spits out the buffer at the end"?19:26
abentleymars, all the stuff about setting up layers, tearing down layers, and individual test runs.19:27
abentleymars, pretty much, yeah.19:27
marsabentley, ok, thanks.  Still sounds like it would work well for my one-off "I need to run all windmill tests for failures in a background process" type of work.19:29
abentleymars, yes, it should be good for that.19:29
marsmany thanks19:29
marsabentley, ack, next question: I did the obvious thing, "testr run -t test_me_too", and it says "no such option, -t".  Quoting doesn't seem to help.  Any way to pass options right on through?19:33
marsjust a sec, thought of something19:33
marsmaybe '-- -t foo' will work19:33
abentleymars, use --19:33
marsalright, "next to least surprising thing" works :)19:33
abentleymars, once you've had a test run, you'll probably want "testr run --failing"19:35
abentleymars, though you can also run individual tests through it to knock them off the failing list.19:36
marsneat19:37
statikmaxb, yes i'm on maverick fulltime and trying to dip my toe back in the water with launchpad dev19:49
maxbI shall copy some packages and see if they install in a chroot19:51
abentleymars, (quoting doesn't work because the shell interprets quotes, so testr can't distinguish it from testr run -t\ test_me_too)19:55
maxbWhat on earth? I'm trying to copy pocket-lint from lucid to maverick in the launchpad ppa, and getting "binaries conflicting with the existing ones"19:56
maxbit's a copy with binaries, how can there be a conflict?!19:56
statikmaxb, thanks for looking after this19:59
rockstarabentley, so, bzr experts apparently can also rescore/cancel builds.  That's why you were seeing the link.20:43
rockstar(I had forgotten that thumper suggested it)20:43
abentleyrockstar, ah, okay.20:44
mtaylordaily ppas should be able to be triggered by push to branch20:52
mtaylorjust saying20:52
=== gary_poster_ is now known as gary_poster
=== Ursinha is now known as Ursinha-bbl
lifelesslosa ping22:15
mbarnettheya lifeless22:19
lifelesshey22:19
lifelessI want to generate some stats from staging's fti index22:19
lifelessthis will take hours and hours22:19
mbarnettheh22:20
lifelessso I'm wondering if someone can do it in a screen session on the box22:20
mbarnettlifeless: sure.22:21
lifelessok, I'll prep the exact thing to run form devpad then pastebin it for you22:21
lifelessactually22:26
lifelessits late, I'll skip it and get it organised over the weekend, might see if someone is around tomorrow to kick it off or some such22:27
lifelesshave a good weekend - gotta log off the wifi here22:27
=== almaisan-away is now known as al-maisan
=== matsubara is now known as matsubara-afk
wgrantbenji: You know you can run canonical-identity-provider locally, right?23:21
benjino!23:21
wgrantbenji: It's not too difficult, and lets you replicate the production setup almost exactly.23:21
wgrantbzr get lp:canonical-identity-provider23:21
benjiI need to get that going.  Any directions?23:21
wgrantThen follow the instructions in the tree.23:21
benjigreat!23:21
wgrantIt's even open source now.23:21
benjithanks, that'll make my life much better23:22
wgrantThen you just have to tweak the LP vhost config to use that rather than login.launchpad.net, configure c-i-p to send full name and email address to launchpad.dev, and it all should work.23:23
benjisounds good23:24

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!