[00:00] jelmer: thanks for your help, I'll come with more substantial questions tomorrow or thereabouts [00:00] workthrick: sure [00:04] * workthrick reboots [00:17] hi all [00:19] 'morning poolie [00:20] hi jelmer [01:06] Good morning [02:19] spiv, poolie: We had some odd branch corruption on the db-devel builder on Friday. [02:20] http://people.canonical.com/~wgrant/launchpad/pygettextpo.tar.gz is the branch. An upgrade to 2a works, then pulling lp:~launchpad-pqm/pygettextpo/trunk crashes with BzrCheckError: Internal check failed: Cannot add revision(s) to repository: missing referenced chk root keys: [StaticTuple('sha1:d34f39faee56e120a83e7cec4fe01c4fd5fd32f6',)] [02:20] A fresh checkout works fine. [02:21] Still broken on a daily 2.4 build. [02:26] wgrant: hmm [02:27] Yes. [02:27] I don't think we've had a report of that error from a fresh upgrade before. [02:27] check/reconcile are happy. [02:27] So perhaps the remote branch is bad or something... [02:28] Oh, it's probably not upgrade then, problem an issue in the remote [02:28] Only just saw that they're happy now. [02:28] But the remote branch hasn't changed in a year... [02:29] *or* if the remote is fine in isolation too (passes check), then you've possibly got a example that pinpoints a bug in fetch. [02:30] Oh, if the remote is that old, possibly it has the non-canonical-chks issue [02:30] wgrant: try 'bzr check-chk' from the lp:bzr-repodebug plugin on the remote [02:32] Hmmmmmm. [02:32] bzr was upgraded in devel recently. [02:32] But one revision after what's in db-devel at the moment. [02:33] Rather suspicious timing. [02:33] wgrant: ah, yes, check-chk finds *many* issues in lp:~launchpad-pqm/pygettextpo/trunk [02:33] I don't see how the db-devel slave would be using the devel bzr, though... [02:34] spiv: How do we fix that? [02:34] bzr reconcile --canonicalize-chks [02:35] (it's a hidden option, it's specifically for repairing damage from bug 522637) [02:35] Launchpad bug 522637 in Bazaar 2.0 "BzrCheckError: Cannot add revision(s) to repository: missing referenced chk root keys" [High,Fix released] https://launchpad.net/bugs/522637 [02:35] Time for some PQM fun, I guess... [02:35] Thanks. [02:35] And must be run on the actual damaged repo, not just done elsewhere and pulled, due to the nature of the problem. [02:35] Yep. [02:36] It's pretty impressive, actually. [02:36] I'm not sure I've seen a branch with so many non-canonical-form CHK maps before! [02:39] wgrant: thanks for reminding me of that issue! [02:39] wgrant: I just realised it accounts for some package import failures :) [02:39] spiv: Ah! [02:50] hi spiv, wgrant [03:16] Hmm. [03:16] Non-canonical CHKs were *part* of what was breaking libffi [03:16] But there's still something funky going on. === poolie changed the topic of #bzr to: Bazaar version control | try https://answers.launchpad.net/bzr for more help | http://irclogs.ubuntu.com/ | Patch pilot: vila | UDD failure ratchet: 481 [03:51] lifeless: in https://code.launchpad.net/~mbp/bzr/220464-stale-locks/+merge/62582 what do you mean by something stronger? [04:53] poolie: well, you mentioned putting a machine identifying hash in or something [04:54] mm [04:54] it could go in /home [04:54] a lot of the problem cases have shared disks so that may not help [06:31] https://code.launchpad.net/~neon/+recipe/project-neon-calligra << bzr runs out of memory on that recipe, could someone look at it? IIRC this bug was fixed a couple of months ago right? [06:33] shadeslayer: well, bzr memory usage has typically been improving with every major release [06:33] spiv: i agree, but that branch is like 97 MB's in xz format :) [06:33] Whether that means your particular out of memory case has been fixed I couldn't immediately say. [06:34] any ideas when it'll be able to build that particular size? [06:34] Depends on what the problem is, and what version of bzr (and maybe bzr-builder) the buildslave is running. [06:35] i guess, whatever launchpad uses [06:35] It *might* be as simple as getting bzr upgraded there. [06:35] Well, I say âââ"simple" but I'm sure wgrant will correct me... [06:36] well .. the source code import uses git->bzr conversion, but i have no idea what the bzr branch format is ... will look into it later this evening then [06:37] I don't mean upgrading the repo/branch format being used [06:37] Those are already current [06:37] I mean the version of the 'bzr' program being used. [06:37] ah [06:38] i think jelmer and others have a project underway to upgrade bzr [06:38] i don't think it's all done yet [06:42] according to https://code.launchpad.net/ lp is still using bzr 2.2.3 [06:43] Headers: {'Software version': '2.2.3dev'} [06:45] I don't think the PPA builders are necessarily using the same version of bzr as the rest of Launchpad. I might be wrong. [06:50] poolie, spiv, shadeslayer: The bzr upgrade has landed, and I'm QAing it now. Will be deployed in a couple of days. [06:50] But spiv is right. [06:50] The buildds don't use the same version. [06:50] They use packages. [06:50] I may converse with lamont. [06:52] poolie: re: locks - I want to avoid us trashing repositories in the lp deployed configuration which will be N hosts, one cluster FS for storage [06:53] i want that too :) [06:54] having multiple hosts, one filesystem should be safe [06:54] s//should actually be safe in the patch as proposed [06:54] i'm going to check the server side behaviour though [07:10] shadeslayer: and fwiw that branch is much larger than your xz'd 97MB. 'du -hs .bzr' says 509M. [08:09] spiv: Hi. Do you think I should file a bug for "Please upgrade bzr-builddeb on jubany", or is it not worth the process? [08:10] We should be in the clear to redo the sysvinit import as soon as current trunk of builddeb & udd are deployed, which would be nice, as it's a user request [08:11] Hmm, a lot of changes since r494 [08:12] oh yes :-) [08:14] It sounds like a good idea, and I think I'd be happy to just do it, but not at 5pm :) [08:14] So probably worth filing a bug [08:14] rihgt [08:21] * maxb is intrigued by the cpuarrayd failur [08:22] Somehow the importer has decided to import a package name which does not exist [08:23] maxb: yeah, I was wondering about that one too === tomaw_ is now known as tomaw__ === tomaw__ is now known as tomaw [09:27] hello vila [09:28] poolie: hey ! [09:28] hi [09:28] :) [09:28] i like your mails- [09:28] i might need subtitles though :) [09:29] http://www.youtube.com/watch?v=CN666q3ptAU [09:30] :) [09:34] poolie: corrections welcome nevertheless ;) === gerard_1 is now known as gerard_ [10:05] vila so actually more seriously i don't know what spam you're talking about [10:06] did people object to the previous message/ [10:07] hmm, right, so what's the saying about explaining jokes ? ;) [10:08] this was just a way to roll the drums about the policy change, people should know that there is something going on with reviews and subscriptions by now [10:09] I probably viewed too much monty python lately: http://www.imdb.com/title/tt0071853/crazycredits [10:09] i like the humour [10:09] i think perhaps a subtitle saying what's actually happening would help [10:10] right, the link to maxb message was supposed to give the serious info [10:11] well, just something to think about [10:33] vila, whoa, you sent through my stale lock branch? [10:33] i was just drafting a reply to robert [10:33] mgz approved it... [10:33] :-/ [10:33] i think it's probably ok but i was going to look at it again [10:33] did I miss a reply from Robert ? [10:33] i do appreciate you trying to flush the queue [10:34] he asked if it's safe wrt server side operations [10:34] May be I over interpreted but I read mgz's last comment as: that's fine as it is, we can do a further proposal [10:35] poolie: oh right, but this won't be deployed on lp then ? [10:36] why not? [10:37] meh, if you think you need a further proposal, this don't *have* to be deployed on lp [10:37] if you're ok, I don't have objections myself [10:38] well [10:38] on the whole we should probably land it and perhaps do follow up [10:38] i wouldn't mind brainstorming other things we could check, with you [10:40] what do you think we should do about matching up the host names? [10:42] i'm tempted to also ask a losa to kill the pqm job until we're agreed on how to do it [10:47] how about a grace period before stealing the lock ? [10:48] The issues you and Robert raised still exist with break-lock no ? [10:50] ok, i replied [10:50] a grace period could be another option [10:50] I can't think of a good way to make the host name check stronger that can't be defeated either so I'm not sure about that [10:54] ok, good night! [10:54] g'night ! [10:59] poolie: pqm failure anyway, so no worries [11:00] g'night poolie [11:07] vila: poolie: re: landing and iterating; If landing something that makes server deployment risky, how would we identify that this blocks a release/deploy to lp ? [11:08] not saying you should or shouldn't, just wondering what the process to avoid mistakes further down the line is [11:12] lifeless: add more tests ? ;) Anyway, there was a pqm failure for this proposal so it didn't land [11:38] hi all, I'm doing a "bzr shelve --all" and getting this error, what can I do to fix it? [11:38] bzr: ERROR: Could not acquire lock "/home/ed/canonical/lp-branches/copies-must-use-queue-bug-789502/.bzr/checkout/dirstate": [Errno 11] Resource temporarily unavailable [11:39] bigjools: there's no other bzr instance trying to access that branch at the same time? [11:39] jelmer: I hope not, I've not touched bzr since I booted the box, that's the first thing I typed [11:40] ah, there's a bzr grep running ... [11:40] jelmer: that was it :/ [11:40] I didn't think it'd do an exclusive lock [11:40] thanks [11:41] not one of our best error messages.. [11:41] no :) [12:09] does anyone use reviewboard with bzr? or alternatively, have suggestions on tools in this area? That is, support for code review workflows [12:10] quicksilver: I've used it. [12:11] ScottK: works well? [12:11] You need a patch and then it works. [12:11] Let me see if I can find it. [12:11] the bzr-diff-revid stuff? [12:12] Yes. [12:12] found that already in my initial researches. [12:12] trying to find a bit of automation for a good merge-request/code-review workflow. [12:12] There's also a patch to rbtools we needed. [12:13] I think that may just be because we were on an older version. [12:14] I really want something which can work on the output of "bzr merge --preview" [12:14] that is, the diff between unmerged branches. [12:14] most code review tools seem to want to work on diffs between versions of a particular branch [12:15] I don't think I've used it that way. [12:16] * quicksilver nods [12:16] maybe my workflow is odd [12:16] but I like to review changes before we pull them into mainline. [12:17] quicksilver: that's not odd at all; it's how Launchpad's code review workflow works for example. [12:17] spiv: hmm maybe running an internal launchpad instance is a better idea then? [12:17] * quicksilver tries to google info about lp code review [12:18] quicksilver: but I guess the thing is if you have a branch that's simply a bunch of revisions on top of the target branch (i.e. no merges from the target onto the branch-for-review part way through its new commits) then diff-between-versions-of-branch is the same. [12:19] right. but we always have those (merges from target onto branch-for-review) [12:19] apart from anything else it's the branch-developers obligation to keep testing against latest mainline and ensure there are no conflicts [12:19] so there should be regular merges in that direction. [12:19] * spiv nods [12:20] spiv: seems lp code review gives you a workflow and an interface to browse merge candidates, btu doesn't actually support the process of annotating the diffs? [12:21] It gives you a place to add comments about the whole diff, but no way to directly annotate a part of the diff with a particular comment, no. [12:21] * quicksilver nods [12:21] currently I review the entire output of bzr merge --preview in emacs, make notes and then discuss those notes with the developer. [12:21] (I think there was some discussion recently about maybe adding something like that) [12:21] it works OK but I was wondering if I could automate some of those parts [12:22] and having it on the intranet lets the rest of the team get some idea what's going on [12:22] which is nice. [12:22] My usual way to do reviews with Launchpad is I get the email sayingg [12:22] "review this, here's the diff" and I reply to that email, quoting the bits of the diff I'm commenting on and following them with my remarks. [12:23] s/to do/I do/ [12:23] * quicksilver nods [12:23] I don't mean to suggest my preferences are universal :) [12:23] Part of the difficulty of directly annotating LP's diffs is that they are updated automatically as the branch changes [12:24] So the comments on a review may be interleaved with "New revision: Add more comments, fix typo." etc [12:25] spiv: reviewboard (which ScottK and I were just discussing) claims to understand about different versions of diff. [12:25] I'm not sure what it looks like in practice. [12:26] I'm not either, I haven't taken a close look at reviewboard recently at all. [12:27] I think you'll have to try it to know if it fits your workflow. [12:29] * quicksilver nods [14:32] Greetings! [14:33] I faced an issue with bzr over the weekend that prevented importing some code on it. Wondering if someone already had a look at something similar: [14:33] bzr: ERROR: An inconsistent delta was supplied involving '', 'hg:usr_sgri' [14:33] reason: Parent is not present in resulting inventory. [14:34] This was a simple non-fancy import of about 8600 revisions, just one commit after the other [14:40] This seems to be the same bug as this one: [14:40] https://bugs.launchpad.net/bzr-hg/+bug/513368 [14:40] Ubuntu bug 513368 in Bazaar Hg Plugin "inconsistent delta during fetch" [Medium,Triaged] [14:41] What surprised me is that I'm hitting the bug just with plain command line interaction [14:54] niemeyer: It's not that surprising, bzr-hg is somewhat less developed that other bzr foreign plugins [14:55] maxb: I'm not using bzr-hg [14:55] maxb: bzr is crashing all by itself [14:56] maxb: I go 8600 revisions doing "bzr add; bzr remove; bzr commit" [14:56] and the resulting repository has this bug [14:57] The string 'hg:usr_sgri' from your error message is *highly* suggestive of bzr-hg being involved [14:57] maxb: Ouch.. maybe the plugin is kicking in just because there's an .hg directory? [14:57] Entirely possible [14:57] Ugh [14:57] Ok, that'd explain a lot [14:58] maxb: ...and I had it installed. I'll try to reproduce the bug without it, but it looks like you're right. That was very helpful, thanks! [15:17] maxb: OMG.. not only it works, but it's also several orders of magnitude faster [15:17] * niemeyer hugs maxb [15:17] :-) [15:17] Did you try using bzr-hg to import the branch first? [15:18] It would be somewhat simpler than an add/commit loop [15:29] reddit story about bzr - http://www.reddit.com/r/programming/comments/hseul/do_you_like_bzr_were_working_on_the_github_for/ [15:37] mergebox sounds like something that would probably help increasing bzr adoption [15:45] maxb: Heh [15:46] maxb: I'm sure it's simpler when it works [15:46] maxb: This bug is around for more than a year [15:56] wgrant: thanks! [15:56] spiv: alright, i [15:56] +i'll test it out when its rolled out [16:08] wgrant: is the new bzr out on production servers? === deryck is now known as deryck[lunch] === deryck[lunch] is now known as deryck === bigjools-afk is now known as bigjools === zyga is now known as zyga-afk === yofel_ is now known as yofel === zyga-afk is now known as zyga [23:18] hi maxb, all [23:18] hello [23:27] hi poolie, maxb [23:29] hey there [23:35] Anyone know if Bazaar has something similar to git-submodule? [23:44] there is a plugin