=== jtv1 is now known as jtv === Pendulum_ is now known as Pendulum [03:23] cjwatson: everything is confirmed published [06:03] StevenK: did you know RemoveArtifactSubscriptionsJob doesn't handle branches where access is revoked using the sharing ui? === almaisan-away is now known as al-maisan === al-maisan is now known as almaisan-away [06:48] wallyworld_: Uh, no. Guess I missed a callsite. :-( === almaisan-away is now known as al-maisan [07:43] good morning === al-maisan is now known as almaisan-away === matsubara is now known as matsubara-afk [12:47] jelmer: could you please review this mp: https://code.launchpad.net/~adeuring/launchpad/bug-1020443/+merge/115721 ? [12:47] I thought the comment box on a merge proposal would preserve the formatting, but it just ruined a review of mine :( [12:48] https://code.launchpad.net/~diogobaeder/ubuntuone-servers/consistency-check/+merge/115441/comments/248694 [12:48] has that changed recently? [12:48] actually, if I get the comment from that URL it looks right, but on https://code.launchpad.net/~diogobaeder/ubuntuone-servers/consistency-check/+merge/115441 it's not formatted [12:49] adeuring: on it [12:49] jelmer: thanks! [12:56] Could somebody allocate me a DB patch number? I would like to add "ALTER TABLE ArchivePermission ADD COLUMN distroseries INTEGER;" in order to support implementation of per-pocket queue admin permissions; feedback from the relevant stakeholders has convinced me that we may need to be able to grant some people access to admin e.g. quantal-proposed but not precise-proposed. [12:58] cjwatson: will work on it, sec [13:00] cjwatson 2209-27-1 allocated [13:01] rick_h_: Thanks [13:01] Morning, everyone. [13:01] morning boss [13:32] adeuring, https://plus.google.com/hangouts/_/8a443b035ee300fdac4f1b58feadf013d81db8e7?authuser=0&hl=en === almaisan-away is now known as al-maisan === jcsackett changed the topic of #launchpad-dev to: http://dev.launchpad.net/ | On call reviewer: jcsackett | Firefighting: - | Critical bugs: 4.0*10^2 [14:14] so, this looks like a good example [14:15] the current head of the qa queue is qa-bad [14:15] so, the normal thing would be to revert that change? is that generally left to the person who landed it? [14:20] mgz: Yes, if they are around [14:21] I guess generally it's left to the person doing the QA [14:23] so, you'd basically do `bzr lp-land --rollback=15645 lp:launchpad` then? or do you actually revert the change in a branch locally? [14:24] rollback sounds not like "merge the inverse of this change" but I assume it doesn't actually lose subsequent things in the queue [14:26] mgz: yeah, merge the inverse of that change [14:27] mgz: You'll actually have to revert the change locally and push a branch up for merging. [14:27] but do you need to actually do that and put up an mp? [14:27] meh. [14:27] so, is just tagging not fanciness. [14:27] mgz: well, the tagging is important for the qa bot [14:28] not sure if that qualifies as fanciness.. [14:29] You merge the inverse of that one change, not everything after it in the queue. [14:29] There's something about it on dev.lp.net somewhere. [14:29] right, mgz what I did the other day was to grab the branch, diff -r with the rev and the one before to generate a patch to remove that rev [14:30] then create a new branch from trunk, apply the patch, submit to pqm with bzr lp-lang [14:30] https://dev.launchpad.net/QA/QAForContinuousRollouts [14:30] land that is [14:30] do you just merge the branch, or put it through review? [14:31] * mgz reads the page [14:31] "get it reviewed, or review it yourself" [14:31] I think the general implication of that is that if you are a reviewer then this is the kind of change you can self-review. [14:31] mgz, cjwatson: correct--we allow self review for full reviewers on things like that. [14:32] I'm not a reviewer so I think if I were doing this I would get somebody to review it. [14:32] mgz: yea, as long as you're only removing the one rev it's generally a self-review. [14:32] if you're not a full reviewer, well, i'm on call today. :-) [14:32] put jcsackett to work! [14:32] I don't have any giant JS branches today, he's going to feel lonely [14:32] okay, I don't expect StevenK will mind me doing this as practice [14:32] rick_h_: there's a somewhat easier way to do the rollback than the "create patch with diff, then apply" process, btw. [14:32] jcsackett: I'm all ears [14:33] bzr merge . -r [revno-to-revert]..[revno-to-revert-1] [14:33] QAForContinuousRollouts recommends that. [14:33] ah makes sense, one less step [14:33] * jcsackett nods. and when you're in qa triage, less steps are good. :-) [14:49] hm, interestingly StevenK already did the rollback last night, but it doesn't show up on lpqateam [14:49] adeuring: looking at your branch in review--doesn't this need to be landed against db-devel, not devel? [14:50] jcsackett: no, since there is not schema change or any other "serious impact", it can be landed in devel. Seehttps://dev.launchpad.net/PolicyAndProcess/DatabaseSchemaChangesProcess [14:52] adeuring: ah, cool. thanks. [14:54] mgz is it in buildbot then? [14:55] nothing on pqm.launchpad.net [14:56] am I looking in the right place? [14:56] mgz: http://lpbuildbot.canonical.com/waterfall [14:56] ETA 1h54m [14:57] adeuring: the diff i see looks good, but the MP says there's a conflict in need of resolution. (the patch file appears to already exist). fix that up and i can stamp this r=me. [14:57] jcsackett: argh... thanks for the heads-up! [14:58] adeuring: your welcome. [15:00] mgz: the flow as I understand it is devel -> buildbot (whenever it next starts a run) -> buildbot completes 5/6h or so later -> qastaging's buildbot-poller runs every 15m or so IIRC and picks that up -> qastaging.lp.net updates -> the deployment report notices shortly afterwards [15:00] jcsackett: done [15:00] this is admittedly divined from observation :) [15:00] adeuring: awesome. i'm waiting on the diff to update. :-) [15:01] and everyone lands with a full test run anyway... [15:01] not sure what the double gating helps exactly. [15:01] mgz buildbot after ec2 picks up multiple revisions. makes sure if three of us start from the same branch and do something bad with another person's work things don't get broken. [15:02] (three being an arbitrary number, of course) [15:02] the test run is based on whatever was current at the time you started the test run, but what lands on devel is a merge based on whatever's current when the test run ends [15:02] and buildbot does sometimes fail as a result of that [15:02] ah, another the-test-suite-takes-5-hours adaptation [15:03] mgz: if you like. :-P [15:06] mgz: exactly. [15:07] cjwatson: can you file and link bugs for both of your branches? neither seem like the sort of thing that should be landed with --no-qa. [15:07] cjwatson: https://dev.launchpad.net/Trunk, https://dev.launchpad.net/Trunk/Glue [15:08] jcsackett: OK [15:08] jml: Ah, yes, I probably read those at some point [15:08] mgz: although I think we were all complaining about the length of the PQM queue back when the test suite took 1hr. It was common to be waiting 16hrs or more for a branch to land [15:09] mgz: so arguably, mean time to land is shorter with this setup. [15:09] and when the parallel test guys save us we'll be awesome [15:09] although it's very frustrating to have a change rejected because of someone else's mistake [15:10] when we completely hosed the bzr test suite so it took going on for an hour the pqm queue became a pain [15:10] rick_h_: I would strongly recommend switching back to a more pqm-like model in that case [15:10] so the test suite was made fast again. [15:10] mgz: yea, and the parallel guys are reporting sub-50min numbers. [15:10] mgz: yeah. LP devs never did that. I got a bit sick of talking about it so I wrote . It's probably a bit out of date. [15:10] will parallel testing be done both for the buildbot step and the I'm-just-checking-my-own-branch step? [15:11] adeuring: r=me, but you'll want to update the values in INSERT INTO LaunchapdDatabaseRevision to match the patch number. [15:11] mgz: the pqm model scales poorly to large numbers of developers [15:11] jcsackett: argh... not my best day. thanks! [15:11] jml: it mostly scales badly for NEWS files... [15:11] adeuring: it happens. :-P [15:11] mgz: arguably a work-around would be to merge them all in, run the tests, and in case of failure try again but with half of the queue, ... [15:12] made me not want to ever write any, to avoid pointless conflicts [15:12] mgz: that's Bazaar's fault, I think. [15:12] right, and never getting news merge working on pqm [15:12] mgz: Twisted works around that by having one file per NEWS update, and building the NEWS file as part of the release process [15:12] yeah, that's very cute, and so twisted [15:13] :-) [15:13] there's always a work around :) [15:13] mgz: I don't think it's a good work-around, but it's better than the pain of pointless conflicts. [15:14] the custom bzr news merger has worked quite well for us [15:15] I want to set up jenkins to have a pqm model for landing branches [15:15] cjwatson: i'm looking at your security upload branch. i'll confess to being unfamiliar with the processes around this. i assume without this check there are stil checks to keep just anyone from uploading to the pocket? [15:16] jcsackett: Much like -proposed/-updates, any upload to it would require manual approval by a queue admin [15:16] cjwatson: ah, dig. [15:16] thanks. [15:16] jcsackett: In fact, today, anyone with upload rights to Ubuntu could attempt to copy a package into it (and it'd be similarly held for approval) [15:17] Since copy permissions == upload permissions (I actually think copy permissions should be very slightly broader, but that's a different bug) [15:17] cjwatson: ok. so this is completely unnecessary, as there's a manual check anyway, and if someone were operating in bad faith for some reason they would have a way around it anyway. [15:17] I did ask the Ubuntu security team manager if he was OK with this, but he's on holiday this week [15:18] The history of that code definitely looks like a fossil though [15:18] I actually ran into it because I was trying to test something else on dogfood and it wouldn't let me upload to -security there :) [15:20] In practice we probably want to stage elsewhere most of the time anyway because that makes sure everything's built before we expose it to users. But that seems like a distro policy decision rather than something that should be hardwired into code. [15:20] cjwatson: that makes sense. thanks. [15:21] cjwatson: both your branches are r=me, but remember to file/link bugs so the qa can be tracked. :-) [15:21] ah, i see you already have on one. [15:24] yup, working on it. [15:24] thanks [15:24] meh, I should just fix this mailman thing [15:44] adeuring: Whoops. I forgot to push my dbpatches change. [15:44] ta [15:44] stub: no problem,. I added a note about your patch ;) === matsubara-afk is now known as matsubara === al-maisan is now known as almaisan-away [16:38] Is there a minimum level of performance one should be able to expect from buildds (particularly PPA builders) ? [16:38] The juju test suite wants every test to finish in 5 seconds or less.. [16:38] but on many of the PPA builders that just doesn't happen [16:39] That sounds pretty wrong. [16:39] I mean, of the juju test suite. [16:39] Its just a default, but each test is meant to be very tiny [16:39] on my Core2Duo 2.5Ghz machine with crap disk, they all finish in under 2s reliably.. [16:40] I don't think it should be allowed to assume anything in particular. They're Xen instances, they could be timesliced off into oblivion for a while [16:40] cjwatson: nannyberry, in particular, seems to be quite a bit faster than all the rest [16:41] cjwatson: but, that said, I suppose we should just raise the test timeout to 20s for package builds (which is unfortunate as we will miss performance regressions) [16:41] SpamapS: I would suggest not using ppa builders as a place to test performance regressions [16:41] indeed, its not really a place to do that. :) [16:42] SpamapS: I know of this really neat software called jenkins ... [16:43] and then I'd suggest getting a bare metal machine that only runs your performance tests so that one performance test's output can be actually compared against another [16:43] but that might just be me [16:43] mtaylor: I heard jenkins is just cron on steroids [16:43] SpamapS: you could totally do cron [16:43] SpamapS: or you could use a combination of gearman and salt [16:43] which means it is strong but aggressive and moody ;) [16:44] to do queuing and remote command execution [16:44] Right, I agree. Performance tests in package builds are a mug's game. [16:44] but whatever you do, I would not use ppa builders for performance testing [16:44] well up until now they've been that just because of twisted trial's default 5s timeout [16:44] You could even register DEP-8 format tests (autopkgtest) and then your tests will be automatically run in jenkins. [16:44] * SpamapS is about to patch that away [16:47] SpamapS: you could stop using twisted of course ... [16:47] mtaylor: we are! [16:47] -> go [16:47] * mtaylor facepalms [16:47] SpamapS: don't you love it how you come here to ask a simple question and we all start kicking you? [16:47] what, a compiled language w/ static-only-linking isn't a good answer to "twisted is hard" ? [16:48] SpamapS: well, "twisted is overkill for the task juju needs to perform" would be my first answer to "twisted is hard" [16:48] I was feeling a bit doughy.. a good kicking will get me back into shape :) [16:48] SpamapS: so, my first suggestion would have been "remove twisted and replace it with normal python calls" [16:48] Gosh, that might have interfered with religion [16:49] ... was that my out loud voice? [16:49] oops. sorry about that [16:49] * mtaylor tries to stop interfering with religion [16:49] * mtaylor stops pointing out assininery around twisted and go [16:49] I certainly wasn't trying to stop you :) [16:56] http://www.joelonsoftware.com/articles/fog0000000069.html [16:59] Yes, I want to sellotape that URL to my head at conferences sometimes [17:01] :) [17:02] I want to find a well-written article that explains that writing new software is almost always a worse idea than you think it is. [17:05] wouldn't bother with well written, just go for big letters [17:05] "programmers always want to throw away the code and start over" IME this is the bit where Joel missed a trick; it's far from always programmers who are the driving force behind rewrites ... [17:10] true, though it is generally the programmers who whine about the messy code and thus the business folk figure "well its probably time for a rewrite" [17:10] "this will make us more nimble" [17:17] abentley: ping, do you have time to chat on this lp.client issue? [17:18] rick_h_: lunching. back in 30. [17:18] abentley: ack [17:42] what's aaron's fancy script for generating lp merge proposals again? [17:42] bzr lp-propose [17:42] as in, not just lp-propose, but the one that makes a little template too [17:45] rick_h_: back. [17:46] abentley: cool, will toss a hangout your way [17:47] rick_h_: do you happen to know if you need multiple projects to have bug targets [17:53] czajkowski: otp sec [17:54] rick_h_: cheers [18:10] czajkowski: hmm, abentley can sanity check me, but to target something it could be a different distro, release, source package, etc. so not necessarily different projects [18:11] YokoZar: there is your answer [18:11] rick_h_: thank you [18:12] mgz: lp-propose, with the lpreview_body plug-in. [18:17] abentley: thanks, where's lpreview_body in lp? [19:19] rick_h_: could you clarify how I would do this for a private project? [19:19] *commercial project [19:39] um, i think adding comments to bug tasks may be broken. i just got an error that says "Object:, name: u'acton'" [19:50] Yokozar, I don't see your question. What is it? I know a lot about projects with private bugs and branches [19:52] sinzui: need multiple projects to have bug targets [19:53] 19:10 < rick_h_> czajkowski: hmm, abentley can sanity check me, but to target something it could be a different distro, release, source package, etc. so not necessarily different projects [19:56] targeting rules are byzantine. In the case of a bug, a project can be retargeted to another project using ajax. Otherwise, expand the html form to select distro, package, or project [19:56] series and series packages can only be retargeted to other series and series packages [21:03] sinzui: So, my full question is this: I currently have one commercial project registered. In order to use Launchpad bugs instead of our own independent tracker, I'd like to be able to have different components within (eg -server, -client). Do I need to register multiple projects for this (and pay for each one?) [21:04] YokoZar: yes you do [21:05] Lp does not understand components and shared repos [21:06] YokoZar: we can create a project group for your project which will let you search all the bugs in all the projects. czajkowski or myself can create one once you have two projects to add to it [21:08] YokoZar: also, it is okay to structure your projects so that only one of them contains the proprietary code. several projects groups mix public and private code. They commonly have a private server part, or the plugins are all proprietary [21:08] sinzui: I might not code-host on launchpad at all at the moment (we have stuff in github) [21:09] understood [21:10] sinzui: but I do need things like private PPA and private bugs by default; I suppose I can confine the PPAs to one project [21:10] YokoZar: if your not hosting code, consider one project and use bug tags to distinguish the components [21:11] ppas are owned my teams, not projects. PPAs often contain packages based on many projects. [21:12] YokoZar: one you add the proprietary license to your private project, you can enable private bugs, create private teams, and create private ppas, The team can be public, and you can still have a private ppas [21:17] YokoZar: you might be tempted to create one project, with a series that represents each component. You can target bugs to the series. you can say a bug affects many series. You cannot retarget the series task from one to another, but you can delete the task and create an alternate task. === jcsackett changed the topic of #launchpad-dev to: http://dev.launchpad.net/ | On call reviewer: - | Firefighting: - | Critical bugs: 4.0*10^2 [23:00] sinzui: Thanks, I think that will work quite well for me [23:38] Fail. http://sqlformat.appspot.com/ [23:38] wgrant: Is http://pastebin.ubuntu.com/1101043/ a bong query for returning direct subscriptions? [23:51] StevenK: Maybe. Does it work? [23:52] Also, it's a bit odd to constrain both BS.bug and BTF.bug rather than joining them explicitly. [23:52] wgrant: It does not seem to work, no. [23:55] StevenK: Oh [23:55] StevenK: The privacy condition is inverted [23:55] AND NOT ( [23:55] BugTaskFlat.information_type IN (1, 2) [23:55] [...]