/srv/irclogs.ubuntu.com/2012/07/19/#launchpad-dev.txt

=== jtv1 is now known as jtv
=== Pendulum_ is now known as Pendulum
micahgcjwatson: everything is confirmed published03:23
wallyworld_StevenK: did you know RemoveArtifactSubscriptionsJob doesn't handle branches where access is revoked using the sharing ui?06:03
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
StevenKwallyworld_: Uh, no. Guess I missed a callsite. :-(06:48
=== almaisan-away is now known as al-maisan
adeuringgood morning07:43
=== al-maisan is now known as almaisan-away
=== matsubara is now known as matsubara-afk
adeuringjelmer: could you please review this mp: https://code.launchpad.net/~adeuring/launchpad/bug-1020443/+merge/115721 ?12:47
salgadoI thought the comment box on a merge proposal would preserve the formatting, but it just ruined a review of mine :(12:47
salgadohttps://code.launchpad.net/~diogobaeder/ubuntuone-servers/consistency-check/+merge/115441/comments/24869412:48
salgadohas that changed recently?12:48
salgadoactually, if I get the comment from that URL it looks right, but on https://code.launchpad.net/~diogobaeder/ubuntuone-servers/consistency-check/+merge/115441 it's not formatted12:48
jelmeradeuring: on it12:49
adeuringjelmer: thanks!12:49
cjwatsonCould somebody allocate me a DB patch number?  I would like to add "ALTER TABLE ArchivePermission ADD COLUMN distroseries INTEGER;" in order to support implementation of per-pocket queue admin permissions; feedback from the relevant stakeholders has convinced me that we may need to be able to grant some people access to admin e.g. quantal-proposed but not precise-proposed.12:56
rick_h_cjwatson: will work on it, sec12:58
rick_h_cjwatson 2209-27-1 allocated13:00
cjwatsonrick_h_: Thanks13:01
deryckMorning, everyone.13:01
rick_h_morning boss13:01
deryckadeuring, https://plus.google.com/hangouts/_/8a443b035ee300fdac4f1b58feadf013d81db8e7?authuser=0&hl=en13:32
=== almaisan-away is now known as al-maisan
=== jcsackett changed the topic of #launchpad-dev to: http:/​/​dev.launchpad.net/​ | On call reviewer: jcsackett | Firefighting: - | Critical bugs: 4.0*10^2
mgzso, this looks like a good example14:14
mgzthe current head of the qa queue is qa-bad14:15
mgzso, the normal thing would be to revert that change? is that generally left to the person who landed it?14:15
jelmermgz: Yes, if they are around14:20
jelmerI guess generally it's left to the person doing the QA14:21
mgzso, you'd basically do `bzr lp-land --rollback=15645 lp:launchpad` then? or do you actually revert the change in a branch locally?14:23
mgzrollback sounds not like "merge the inverse of this change" but I assume it doesn't actually lose subsequent things in the queue14:24
jelmermgz: yeah, merge the inverse of that change14:26
jelmermgz: You'll actually have to revert the change locally and push a branch up for merging.14:27
mgzbut do you need to actually do that and put up an mp?14:27
mgzmeh.14:27
mgzso, is just tagging not fanciness.14:27
jelmermgz: well, the tagging is important for the qa bot14:27
jelmernot sure if that qualifies as fanciness..14:28
cjwatsonYou merge the inverse of that one change, not everything after it in the queue.14:29
cjwatsonThere's something about it on dev.lp.net somewhere.14:29
rick_h_right, mgz what I did the other day was to grab the branch, diff -r with the rev and the one before to generate a patch to remove that rev14:29
rick_h_then create a new branch from trunk, apply the patch, submit to pqm with bzr lp-lang14:30
cjwatsonhttps://dev.launchpad.net/QA/QAForContinuousRollouts14:30
rick_h_land that is14:30
mgzdo you just merge the branch, or put it through review?14:30
* mgz reads the page14:31
mgz"get it reviewed, or review it yourself"14:31
cjwatsonI think the general implication of that is that if you are a reviewer then this is the kind of change you can self-review.14:31
jcsackettmgz, cjwatson: correct--we allow self review for full reviewers on things like that.14:31
cjwatsonI'm not a reviewer so I think if I were doing this I would get somebody to review it.14:32
rick_h_mgz: yea, as long as you're only removing the one rev it's generally a self-review.14:32
jcsackettif you're not a full reviewer, well, i'm on call today. :-)14:32
rick_h_put jcsackett to work!14:32
rick_h_I don't have any giant JS branches today, he's going to feel lonely14:32
mgzokay, I don't expect StevenK will mind me doing this as practice14:32
jcsackettrick_h_: there's a somewhat easier way to do the rollback than the "create patch with diff, then apply" process, btw.14:32
rick_h_jcsackett: I'm all ears14:32
jcsackettbzr merge . -r [revno-to-revert]..[revno-to-revert-1]14:33
cjwatsonQAForContinuousRollouts recommends that.14:33
rick_h_ah makes sense, one less step14:33
* jcsackett nods. and when you're in qa triage, less steps are good. :-)14:33
mgzhm, interestingly StevenK already did the rollback last night, but it doesn't show up on lpqateam14:49
jcsackettadeuring: looking at your branch in review--doesn't this need to be landed against db-devel, not devel?14:49
adeuringjcsackett: no, since there is not schema change or any other "serious impact", it can be landed in devel. Seehttps://dev.launchpad.net/PolicyAndProcess/DatabaseSchemaChangesProcess14:50
jcsackettadeuring: ah, cool. thanks.14:52
rick_h_droidmgz is it in buildbot then?14:54
mgznothing on pqm.launchpad.net14:55
mgzam I looking in the right place?14:56
cjwatsonmgz: http://lpbuildbot.canonical.com/waterfall14:56
cjwatsonETA 1h54m14:56
jcsackettadeuring: the diff i see looks good, but the MP says there's a conflict in need of resolution. (the patch file appears to already exist). fix that up and i can stamp this r=me.14:57
adeuringjcsackett: argh... thanks for the heads-up!14:57
jcsackettadeuring: your welcome.14:58
cjwatsonmgz: the flow as I understand it is devel -> buildbot (whenever it next starts a run) -> buildbot completes 5/6h or so later -> qastaging's buildbot-poller runs every 15m or so IIRC and picks that up -> qastaging.lp.net updates -> the deployment report notices shortly afterwards15:00
adeuringjcsackett: done15:00
cjwatsonthis is admittedly divined from observation :)15:00
jcsackettadeuring: awesome. i'm waiting on the diff to update. :-)15:00
mgzand everyone lands with a full test run anyway...15:01
mgznot sure what the double gating helps exactly.15:01
jcsackettmgz buildbot after ec2 picks up multiple revisions. makes sure if three of us start from the same branch and do something bad with another person's work things don't get broken.15:01
jcsackett(three being an arbitrary number, of course)15:02
cjwatsonthe test run is based on whatever was current at the time you started the test run, but what lands on devel is a merge based on whatever's current when the test run ends15:02
cjwatsonand buildbot does sometimes fail as a result of that15:02
mgzah, another the-test-suite-takes-5-hours adaptation15:02
jcsackettmgz: if you like. :-P15:03
jmlmgz: exactly.15:06
jcsackettcjwatson: can you file and link bugs for both of your branches? neither seem like the sort of thing that should be landed with --no-qa.15:07
jmlcjwatson: https://dev.launchpad.net/Trunk, https://dev.launchpad.net/Trunk/Glue15:07
cjwatsonjcsackett: OK15:08
cjwatsonjml: Ah, yes, I probably read those at some point15:08
jmlmgz: although I think we were all complaining about the length of the PQM queue back when the test suite took 1hr. It was common to be waiting 16hrs or more for a branch to land15:08
jmlmgz: so arguably, mean time to land is shorter with this setup.15:09
rick_h_and when the parallel test guys save us we'll be awesome15:09
jmlalthough it's very frustrating to have a change rejected because of someone else's mistake15:09
mgzwhen we completely hosed the bzr test suite so it took going on for an hour the pqm queue became a pain15:10
jmlrick_h_: I would strongly recommend switching back to a more pqm-like model in that case15:10
mgzso the test suite was made fast again.15:10
rick_h_mgz: yea, and the parallel guys are reporting sub-50min numbers.15:10
jmlmgz: yeah. LP devs never did that. I got a bit sick of talking about it so I wrote <https://dev.launchpad.net/FasterTests>. It's probably a bit out of date.15:10
mgzwill parallel testing be done both for the buildbot step and the I'm-just-checking-my-own-branch step?15:10
jcsackettadeuring: r=me, but you'll want to update the values in INSERT INTO LaunchapdDatabaseRevision to match the patch number.15:11
jmlmgz: the pqm model scales poorly to large numbers of developers15:11
adeuringjcsackett: argh... not my best day. thanks!15:11
mgzjml: it mostly scales badly for NEWS files...15:11
jcsackettadeuring: it happens. :-P15:11
jmlmgz: arguably a work-around would be to merge them all in, run the tests, and in case of failure try again but with half of the queue, ...15:11
mgzmade me not want to ever write any, to avoid pointless conflicts15:12
jmlmgz: that's Bazaar's fault, I think.15:12
mgzright, and never getting news merge working on pqm15:12
jmlmgz: Twisted works around that by having one file per NEWS update, and building the NEWS file as part of the release process15:12
mgzyeah, that's very cute, and so twisted15:12
jelmer:-)15:13
rick_h_there's always a work around :)15:13
jmlmgz: I don't think it's a good work-around, but it's better than the pain of pointless conflicts.15:13
jelmerthe custom bzr news merger has worked quite well for us15:14
jmlI want to set up jenkins to have a pqm model for landing branches15:15
jcsackettcjwatson: i'm looking at your security upload branch. i'll confess to being unfamiliar with the processes around this. i assume without this check there are stil checks to keep just anyone from uploading to the pocket?15:15
cjwatsonjcsackett: Much like -proposed/-updates, any upload to it would require manual approval by a queue admin15:16
jcsackettcjwatson: ah, dig.15:16
jcsackettthanks.15:16
cjwatsonjcsackett: In fact, today, anyone with upload rights to Ubuntu could attempt to copy a package into it (and it'd be similarly held for approval)15:16
cjwatsonSince copy permissions == upload permissions (I actually think copy permissions should be very slightly broader, but that's a different bug)15:17
jcsackettcjwatson: ok. so this is completely unnecessary, as there's a manual check anyway, and if someone were operating in bad faith for some reason they would have a way around it anyway.15:17
cjwatsonI did ask the Ubuntu security team manager if he was OK with this, but he's on holiday this week15:17
cjwatsonThe history of that code definitely looks like a fossil though15:18
cjwatsonI actually ran into it because I was trying to test something else on dogfood and it wouldn't let me upload to -security there :)15:18
cjwatsonIn practice we probably want to stage elsewhere most of the time anyway because that makes sure everything's built before we expose it to users.  But that seems like a distro policy decision rather than something that should be hardwired into code.15:20
jcsackettcjwatson: that makes sense. thanks.15:20
jcsackettcjwatson: both your branches are r=me, but remember to file/link bugs so the qa can be tracked. :-)15:21
jcsackettah, i see you already have on one.15:21
cjwatsonyup, working on it.15:24
cjwatsonthanks15:24
mgzmeh, I should just fix this mailman thing15:24
stubadeuring: Whoops. I forgot to push my dbpatches change.15:44
stubta15:44
adeuringstub: no problem,. I added a note about your patch ;)15:44
=== matsubara-afk is now known as matsubara
=== al-maisan is now known as almaisan-away
SpamapSIs there a minimum level of performance one should be able to expect from buildds (particularly PPA builders) ?16:38
SpamapSThe juju test suite wants every test to finish in 5 seconds or less..16:38
SpamapSbut on many of the PPA builders that just doesn't happen16:38
cjwatsonThat sounds pretty wrong.16:39
cjwatsonI mean, of the juju test suite.16:39
SpamapSIts just a default, but each test is meant to be very tiny16:39
SpamapSon my Core2Duo 2.5Ghz machine with crap disk, they all finish in under 2s reliably..16:39
cjwatsonI don't think it should be allowed to assume anything in particular.  They're Xen instances, they could be timesliced off into oblivion for a while16:40
SpamapScjwatson: nannyberry, in particular, seems to be quite a bit faster than all the rest16:40
SpamapScjwatson: but, that said, I suppose we should just raise the test timeout to 20s for package builds (which is unfortunate as we will miss performance regressions)16:41
mtaylorSpamapS: I would suggest not using ppa builders as a place to test performance regressions16:41
SpamapSindeed, its not really a place to do that. :)16:41
mtaylorSpamapS: I know of this really neat software called jenkins ...16:42
mtaylorand then I'd suggest getting a bare metal machine that only runs your performance tests so that one performance test's output can be actually compared against another16:43
mtaylorbut that might just be me16:43
SpamapSmtaylor: I heard jenkins is just cron on steroids16:43
mtaylorSpamapS: you could totally do cron16:43
mtaylorSpamapS: or you could use a combination of gearman and salt16:43
SpamapSwhich means it is strong but aggressive and moody ;)16:43
mtaylorto do queuing and remote command execution16:44
cjwatsonRight, I agree.  Performance tests in package builds are a mug's game.16:44
mtaylorbut whatever you do, I would not use ppa builders for performance testing16:44
SpamapSwell up until now they've been that just because of twisted trial's default 5s timeout16:44
cjwatsonYou could even register DEP-8 format tests (autopkgtest) and then your tests will be automatically run in jenkins.16:44
* SpamapS is about to patch that away16:44
mtaylorSpamapS: you could stop using twisted of course ...16:47
SpamapSmtaylor: we are!16:47
SpamapS-> go16:47
* mtaylor facepalms16:47
mtaylorSpamapS: don't you love it how you come here to ask a simple question and we all start kicking you?16:47
SpamapSwhat, a compiled language w/ static-only-linking isn't a good answer to "twisted is hard" ?16:47
mtaylorSpamapS: well, "twisted is overkill for the task juju needs to perform" would be my first answer to "twisted is hard"16:48
SpamapSI was feeling a bit doughy.. a good kicking will get me back into shape :)16:48
mtaylorSpamapS: so, my first suggestion would have been "remove twisted and replace it with normal python calls"16:48
cjwatsonGosh, that might have interfered with religion16:48
cjwatson... was that my out loud voice?16:49
mtayloroops. sorry about that16:49
* mtaylor tries to stop interfering with religion16:49
* mtaylor stops pointing out assininery around twisted and go16:49
cjwatsonI certainly wasn't trying to stop you :)16:49
jmlhttp://www.joelonsoftware.com/articles/fog0000000069.html16:56
cjwatsonYes, I want to sellotape that URL to my head at conferences sometimes16:59
jml:)17:01
jmlI want to find a well-written article that explains that writing new software is almost always a worse idea than you think it is.17:02
mgzwouldn't bother with well written, just go for big letters17:05
cjwatson"programmers always want to throw away the code and start over" IME this is the bit where Joel missed a trick; it's far from always programmers who are the driving force behind rewrites ...17:05
SpamapStrue, though it is generally the programmers who whine about the messy code and thus the business folk figure "well its probably time for a rewrite"17:10
SpamapS"this will make us more nimble"17:10
rick_h_abentley: ping, do you have time to chat on this lp.client issue?17:17
abentleyrick_h_: lunching.  back in 30.17:18
rick_h_abentley: ack17:18
mgzwhat's aaron's fancy script for generating lp merge proposals again?17:42
rick_h_bzr lp-propose17:42
mgzas in, not just lp-propose, but the one that makes a little template too17:42
abentleyrick_h_: back.17:45
rick_h_abentley: cool, will toss a hangout your way17:46
czajkowskirick_h_: do you happen to know if you need multiple projects to have bug targets17:47
rick_h_czajkowski: otp sec17:53
czajkowskirick_h_: cheers17:54
rick_h_czajkowski: hmm, abentley can sanity check me, but to target something it could be a different distro, release, source package, etc. so not necessarily different projects18:10
czajkowskiYokoZar: there is your answer18:11
czajkowskirick_h_: thank you18:11
abentleymgz: lp-propose, with the lpreview_body plug-in.18:12
mgzabentley: thanks, where's lpreview_body in lp?18:17
YokoZarrick_h_: could you clarify how I would do this for a private project?19:19
YokoZar*commercial project19:19
barryum, i think adding comments to bug tasks may be broken.  i just got an error that says "Object:, name: u'acton'"19:39
sinzuiYokozar, I don't see your question. What is it? I know a lot about projects with private bugs and branches19:50
czajkowskisinzui:  need multiple projects to have bug targets19:52
czajkowski19:10 < rick_h_> czajkowski: hmm, abentley can sanity check me, but to target something it could be a different distro, release, source package,  etc. so not necessarily different projects19:53
sinzuitargeting rules are byzantine. In the case of a bug, a project can be retargeted to another project using ajax. Otherwise, expand the html form to select distro, package, or project19:56
sinzuiseries and series packages can only be retargeted to other series and series packages19:56
YokoZarsinzui: So, my full question is this: I currently have one commercial project registered.  In order to use Launchpad bugs instead of our own independent tracker, I'd like to be able to have different components within (eg -server, -client).  Do I need to register multiple projects for this (and pay for each one?)21:03
sinzuiYokoZar: yes you do21:04
sinzuiLp does not understand components and shared repos21:05
sinzuiYokoZar: we can create a project group for your project which will let you search all the bugs in all the projects. czajkowski or myself can create one once you have two projects to add to it21:06
sinzuiYokoZar: also, it is okay to structure your projects so that only one of them contains the proprietary code. several projects groups mix public and private code. They commonly have a private server part, or the plugins are all proprietary21:08
YokoZarsinzui: I might not code-host on launchpad at all at the moment (we have stuff in github)21:08
sinzuiunderstood21:09
YokoZarsinzui: but I do need things like private PPA and private bugs by default; I suppose I can confine the PPAs to one project21:10
sinzuiYokoZar: if your not hosting code, consider one project and use bug tags to distinguish the components21:10
sinzuippas are owned my teams, not projects. PPAs often contain packages based on many projects.21:11
sinzuiYokoZar: one you add the proprietary license to your private project, you can enable private bugs, create private teams, and create private ppas, The team can be public, and you can still have a private ppas21:12
sinzuiYokoZar: you might be tempted to create one project, with a series that represents each component. You can target bugs to the series. you can say a bug affects many series. You cannot retarget the series task from one to another, but you can delete the task and create an alternate task.21:17
=== jcsackett changed the topic of #launchpad-dev to: http:/​/​dev.launchpad.net/​ | On call reviewer: - | Firefighting: - | Critical bugs: 4.0*10^2
YokoZarsinzui: Thanks, I think that will work quite well for me23:00
StevenKFail. http://sqlformat.appspot.com/23:38
StevenKwgrant: Is http://pastebin.ubuntu.com/1101043/ a bong query for returning direct subscriptions?23:38
wgrantStevenK: Maybe. Does it work?23:51
wgrantAlso, it's a bit odd to constrain both BS.bug and BTF.bug rather than joining them explicitly.23:52
StevenKwgrant: It does not seem to work, no.23:52
wgrantStevenK: Oh23:55
wgrantStevenK: The privacy condition is inverted23:55
wgrant    AND NOT (23:55
wgrant        BugTaskFlat.information_type IN (1, 2)23:55
wgrant[...]23:55

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!