[00:00] when we had 15 users... we were like "well we need it" .. now we have 25 users... every user is I think $500 .. plus $100/year. [00:16] jelmer: if you're still here [00:17] jelmer: how does bzr-git's GitBranchBuilder avoid the [00:17] mwhudson: I am [00:17] *** Your name cannot be determined from your system services (gecos). [00:17] problem? [00:17] i'm saying [00:17] run_git( [00:17] 'commit', '-m', 'dsadas', '--author', 'Joe Foo ') [00:17] and the above message is making me sad :( [00:18] (run on a test server, it works locally) [00:19] i guess i can just run git config [00:19] but it seems pretty ick [00:20] ah [00:20] you might need a ~/.git/config file [00:20] mwhudson: please file a bug, we shouldn't require that to be able to run the testsuite [00:20] jelmer: it's not your tests that are failing :) [00:21] ah [00:23] mwhudson: I'm not so sure we avoid that [00:23] do we? [00:23] i can probably find out [00:23] jelmer: bzr selftest git ? [00:23] mwhudson: yep [00:24] jelmer: yeah, some tests fail === bac_afk is now known as abc === abc is now known as bac [00:26] jelmer: i'll file a bug [00:27] mwhudson: thanks [00:29] jelmer: https://bugs.edge.launchpad.net/bzr-git/+bug/348238 [00:29] Ubuntu bug 348238 in bzr-git "tests fail if "Your name cannot be determined from your system services (gecos)."" [Undecided,New] [00:58] hi...is Bazaar the VCS created by Ubuntu and/or the one they use? [00:59] the same company that largely funds ubuntu also supports bzr [00:59] ah. did Ubuntu create a VCS? [01:00] skeftomai: no, Ubuntu uses bzr [01:00] ok. that answers my question. thanks [01:13] jam: ping [01:52] Has anyone here run bazaar on aix? [01:53] Some folk have posted on the list from time to time [01:53] I've read some of those posts. [01:54] I'm having issues getting it compiled, and I can't tell if it is a issue with python or bazaar [02:00] Jimerson: pastebin the error, or you could file a bug [02:02] http://pastebin.com/m7d649346 [02:07] lifeless: pong [02:08] Jimerson: it looks like you don't have the compiler that python was compiled with [02:08] "xlc_r" [02:11] Thanks guys. [02:11] Now I have to try and find the compiler :) [02:11] jam: I'mmaking record_iter_changes a generator [02:13] lifeless: to return what? [02:13] fs hashes [02:14] its that or call tree._observed_sha1 directly, this seemed more accessible for testing/flexibility [02:16] Thank you guys so much. [02:16] That resolved my issue. [02:19] cool [02:25] lifeless: I don't have a huge opinion either way. It seems a bit odd to iterate over record_iter_changes, just because if you stop mid-way it seems to be in a strange state. [02:25] however, it is obviously an 'iter' sort of interface :) [02:26] right [02:27] anyhow, its done already :P [02:27] there are two issues, it could yield more than is put in (merge commits) or less (no stat cache calculations to update), which is why generator is better [02:32] * igc lunch [02:34] One last question and I will leave you all alone, As bazaar does not handle partial checkouts. How do you handle a situation, where you want to arrange the structure, with folders that are only their for organanization, but you want to be able to export it to a production server? [02:34] put them in separate branches [02:35] or don't use your vcs for deployment [02:35] Jimerson: I'm not entirely sure I understand the question [02:35] For example: [02:36] In bazaar I want it like /project/version/blah [02:36] But I just want to export out to the server everything under blah. [02:36] so, bzr export can do that [02:37] That means I would have to do a full overwrite everytime though correct? [02:37] yes, if you used export [02:37] uhm [02:38] for production deployments a number of folk use 'bzr upload' [02:38] I agree with bob2 though, in bzr you wouldn't normally have project/version as part of your versioned paths [02:38] note that 'bzr init-repo', if you've used that, is *not* related to versioned data, its just a storage area [02:39] How do people seperate things then, just branch them out? [02:41] Jimerson: well typically they start separate [02:41] you want one branch per project [02:41] and they would start that way - you'd bzr init each individual thing indidividually [02:41] Jimerson: I mean, examine 'version' as part of a tree [02:42] I get what you are saying. [02:42] if you made a tarball of your project, each version would be a separate tarball right? and thus in bzr each version is a separate branch, or even just separate commits in a single branch, but they aren't both versioned in the same tree [02:42] I am new to scm, so I am learning. [02:42] likewise project [02:43] Just wondering... for a checkout, should bzr push to the "checkout of" branch ever do anything? [02:44] lifeless, Thanks for all your help. I think I have enough to get rolling down the path. I'll be back. you have a nice evening. [02:44] bob2, Thank you as well. [02:45] jam: around? [02:45] or poolie [02:45] currently we do housekeeping in commit [02:45] when we implicitly unversion something, to make sure we only unversion the root of a collection of things that all got unversioned [02:46] like if we have a/b and both are missing [02:46] if we don't, then wt.unversion() blows up [02:46] I'd like to change wt.unversion([a-id, b-id]) to just deal IFF b-id is a child of a-id [02:48] lifeless: so it wouldn't blow up if you did it in reverse, right? (unversion b-id before you unversion a-id) [02:48] yes [02:49] and the issue is that we are passing in a 'set' [02:49] yes [02:49] so it doesn't know what order to do things [02:49] the problem is that you may have a/b/c/d/e [02:49] and get b-id, then e-id, then a-id, etc [02:49] as the unversion set should be generally small, I think tracking this in unversion is ok, and easier to work with [02:50] lifeless: so I would think that keeping track of "things not yet unversioned" would be fine [02:50] and unversion should complain if all the children don't get unversioned [02:50] or something like that [02:50] well unversion should complain if something provided was never versioned at all [02:50] but sure, we seem agreed that pushing this to unversion is fine [02:51] lifeless: right, I'm actually saying that unversion should complain if you unversion "a" but *don't* unversion "b" [02:51] jam: I don't think so, its meant to recurse for us [02:51] and I like that [02:52] lifeless: I think it can lead to deleting things that didn't get properly recorded as being deleted as part of the commit [02:52] say "iter_changes" somehow [02:52] for the case of "a/b" and "a/c" [02:52] somehow just saw a and a/b being deleted [02:52] suddenly the commit doesn't think about 'c' [02:52] but unversion removes it anyway [02:53] if that bug exists we have it already [02:56] if you do bzr commit a/b and a is deleted, we should just delete b [02:56] care will be needed, I agree [02:56] lifeless: I agree, but I'm saying that "record_iter_changes" is only going to have a delta for 'a/b' and not 'a/c' even though we are removing it in a follow up pass [02:56] I'm down to 20 failures [02:57] but we won't remove all of a unless we record a delete of a [02:57] I feel like it is opening up a hole, that you can catch by saying that the delta must verify itself complete [02:57] and thus a/c won't be deleted, and if we did record a delete of a, a/c will be deleted [or the inventory delta is corrupt, which is even more serious] [02:57] I agree, a delta being corrupt is serious, and you are missing a chance to catch it [02:58] jam: unversion is on tree, its not the delta committed to the repository [02:58] jam: I don't quite see the correspondence [02:58] lifeless: the delta you are committing to the repository *should* match the one that tree is applying to itself [02:59] jam: uhhhh [02:59] jam: may be we're talking about completely different thigns [02:59] so commit auto-detects missing files [02:59] and then calls tree.unversion on them [02:59] to match the fact that it commits the delete to the repo [03:00] I'm saying that the logic in unversion [03:00] can check that the logic from commit is matched properly [03:00] If commit sees that 'a' is missing, commit *better* see that a/b and a/c are missing [03:00] and thus it can pass all of those to unversion [03:01] and unversion can double check that it agrees that everything under 'a' was marked removed [03:01] well [03:02] these sets do not have an equality constraint [03:02] already unversioned things [03:04] I think that it might be good if repo.add_inventory_by_delta checked deletes remove all children correctly (by checking the basename map) [03:04] or something [03:22] lifeless: hi i'm back [03:23] lifeless: so iiuc you're saying [03:24] deleting the parent will implicitly remove the childern [03:24] children* [03:24] but explicitly removing some or all of the children as well will not be an error? [03:24] that makes sense to me [03:24] right [03:25] specifically today, unversion[b,a] works, unversion[a,b] doesn't [03:25] I think it should work [03:32] down to 16 errors [03:33] agree [03:43] poolie: one patch you may wish to review before you go on leave is http://bundlebuggy.aaronbentley.com/project/bzr/request/%3Cb87b89280902251019u212be32bv5e1b33fbe3dea83c%40mail.gmail.com%3E [03:43] thanks igc [03:43] ah right [03:43] poolie: from memory, you were involved in the email thread leading up to it [03:44] poolie: and it's been sitting there for a month now as most of us are buried in brisbane-core [03:44] sure [03:44] i read the previous version [03:44] i asked for tests and they seem to be there so it should be good to go [03:44] thanks for the nudge [03:58] bah [03:58] iter_changes skips over subtrees [04:16] 6 to go [04:24] igc: that docs fix does actually work for me even in a new checkout [04:24] which is odd [04:31] igc, i'm inclined to just send it and see if pqm agrees... [04:38] poolie: worth a try :-) [04:42] 4 tests left [04:59] lifeless: hi? [05:00] you fell offline? [05:01] Just wondering... for a checkout, should bzr push to the "checkout of" branch ever do anything? [05:01] poolie: nope [05:01] poolie: still here :) deep hack is all [05:01] hm how curious, pidgin shows you as offline [05:01] lies, its all lies! [05:16] so, I have inventory free commits [05:16] -woo- [05:46] i'm hitting a problem pushing to a remembered location with bzr. [05:47] I'm getting this when I try to push... bzr: ERROR: Generic path error: '85zdaceo7r26xzgd8t3m.fetch': Failure: unable to rename to '../packs/e1918987d0a82b7fad850f3c976fe036.pack') [05:47] any idea what's happening? [05:48] chrispitzer: hmm, are you onwindows perhaps? [05:49] nope [05:50] dev on ubuntu - pushing to shared hosting. [05:50] so I guess i don't know what the shared host is using... it's dreamhost [05:50] is it ftp? [05:51] (sorrry, on a phone call will be high latency [05:51] The remembered location is over sftp [06:01] chrispitzer: thats odd [06:02] could be permissions, or a still open file [06:03] DreamHost used to use NFS. They do something different now; probably just local ext3. Shrug. [06:03] chrispitzer: what bzr version are you using? [06:05] how do i check that? [06:06] chrispitzer: "bzr version" [06:08] Augh! [06:09] 1.6.1 [06:09] I just nuked the .bzr folder on the remote server and pushed using --use-existing-directory [06:10] so that solves it for now. [06:11] *shrug* [06:14] chrispitzer: I suspect this is fixed somewhere around 1.10 or so [06:14] I recall a similar bug report which we fixed [06:14] What's Andrew Bennetts's nick again? andrew? [06:14] oh, or someone deleted a directory [06:14] Peng_: spiv [06:14] Oh, duh, right! [06:14] Thanks. [06:14] spiv: ping [06:23] hm [06:23] how so i push a working copy to a remote location? [06:24] chrispitzer: You could use the bzr-upload plugin. [06:25] chrispitzer: Or, if you have bzr installed on the server, you could push the branch, create a working copy on the remote side ("bzr co" in the branch), and install the bzr-push-and-update plugin locally. [06:29] i think I'll need bzr-upload, as the server doesn't have bzr and I don't have control to install it [06:32] chrispitzer: DreamHost? Why not? You can install it in your homedir if you want to. [06:32] chrispitzer: I don't recommend it, since procwatch will probably murder it in the middle of large operations, but you *can*. [06:35] lol [06:38] ug... [06:38] bzr upload only allows full uploads, not differential? [06:38] it does incrementak [06:38] but each file is full copied [06:39] lol [06:39] what's the point of that? [06:39] it uploads the file, and if the file's already there it ignores the upload? [06:40] What's the point of what? [06:40] uploading everything, when you're going to discard 90% of what you upload [06:41] Why are you going to discard 90% of what you upload? [06:41] Peng_: pong [06:41] spiv: Hi! [06:42] that's what bzr upload is doing (if I'm reading it correctly) [06:42] spiv: The smart server jail stuff completely broke bzr+http with shared repos. What's the solution? File a bug? Edit my smart server script? [06:43] Peng_: possibly both [06:43] Peng_: start with filing a bug, though [06:43] I'm surprised to hear that case broke, though. [06:43] :D [06:44] In what way did it break? [06:45] spiv: The server's logs get spammed with "BzrError: jail break: 'chroot-139142476:///repo/", the client gets a similar UnknownErrorFromSmartServer. [06:46] That's very odd. That suggests a mismatch between the jail setup and the backing transport on the request handler. [06:57] igc, i did that review btw [06:57] hullo spiv [06:58] spiv: Filed bug 348308. [06:58] Launchpad bug 348308 in bzr "Smart server jail breaks bzr+http with shared repos" [Undecided,New] https://launchpad.net/bugs/348308 [06:58] chrispitzer: you're reading it wrong :P it uploads only the changed files AFAIK [07:01] it uploaded everything the first time, but only incremental since then. [07:01] so it's good. [07:02] I mean, even the first time the working copy should have matched the remote copy time stamps and all... but oh well. :P [07:03] chrispitzer: it doens't work with working copies though, because we don't have the ability to efficiently and in a user-friendly deal with concurrent changes, conflicts etc [07:08] poolie: saw that, thanks [07:09] hi all [07:09] hi vila [07:10] hi vila [07:11] it might be nice if we really could deal with full remote working copies [07:11] it's possibly possible :) [07:14] hmm, it would be nice if people stop proposing bzr-upload to upload a working tree since there is an explicit check there to ensure it will refuse to do so :) [07:14] poolie: I'm still skeptical but won't stop people doing it:) [07:15] oh sometime i'd like to talk to you about whether just adding an indirection file to the dirstate is really enough [07:15] poolie: ok [07:15] poolie: over lunch perhaps :P [07:15] as i said in the bug i thought there was a bug in that but imbw [07:15] on my plate is to analyse 'st' updates and then I have enough data for a proposal [07:17] I'll check the bug when I next think aboout that problem [07:17] for now, conversion to current chk is in progress, -> dinner [07:17] do you mean analyze the value of updating the hash from st? [07:17] cool, good night [07:19] I mean to analyse the potential race conditions of status doing that [07:19] with the alternate design === thekorn_ is now known as thekorn [08:02] hi vila [08:03] vila: a present for you in the mailing list: my 'log DIR' patch ready for you to reconsider :-) [08:03] igc: hehe, ok, will look at it [08:03] vila: that would be awesome - thanks [08:08] igc: on the other hand if you could have a look at the bbc test failures related to 'CHKInventory' object has no attribute 'filter' ... :) [08:13] vila: Sure do. I'll do that either tonight or tomorrow [08:13] * igc dinner [08:13] igc: thanks, enjoy your dinner :) [08:26] 19K test revisions converted [08:49] hi lifeless [08:49] i'm about to press send... [09:54] lifeless, jml: http://pybites.blogspot.com/2009/03/unittest-now-with-test-skipping-finally.html [10:06] spiv: well, thats good. the total lack of discussion is a bit odd [10:06] or perhaps we were looking in the wrong place? [10:11] also the implementation of class skipping is pretty bong [10:11] wtf doesn't def run() handle that [10:16] bong. [11:41] is there a command to find out if a checkout if lightweight or heavyweight? [11:41] OllieR: "bzr info", I suppose [11:42] Peng_: that gives checkout location info and type [11:42] but doesn't tell me whether it was lw or hw [11:42] annoyingly :( [11:42] Seriously? [11:42] Huh! [11:42] yah [11:42] unless it does on a later version i am running Bazaar (bzr) 1.3.1 [11:43] OllieR: I'm on bzr.dev, and the second line will say either "checkout root" or "light checkout root". [11:43] (err, third line. The first line of the Location section.) [11:46] Peng_: right yes so it does :) [11:46] Peng_: many thanks [11:46] :) [12:07] Hey there, getting a bit of a weird error. [12:07] bzr: ERROR: bzrlib.errors.TooManyConcurrentRequests: The medium '' has reached its concurrent request limit. Be sure to finish_writing and finish_reading on the currently open request. [12:08] Mez: That probably means some unknown error happened, but it got masked by that. What version of bzr? It might've been fixed. [12:08] 1.12 [12:09] Mez: Oh. That probably won't help, then. Still, 1.13.1 is out; you should upgrade. :) [12:09] Mez: Sorry I can't help you... [12:16] seems an upgrade to 1.13 worked Peng_ (after running break-lock) [12:18] Mez: Really? Great. :) [12:27] igc: did you see my commit figures? [12:30] lifeless: I did. well done [12:31] lifeless: we just need to sort out the nested trees issue & I'm be very happy [12:31] re commit in brisbane-core [12:32] This is a dumb comment, but.. is it just me, or is brisbane-core a scarily large amount of new code? [12:36] Peng_: it's a scary amount of thought ... [12:36] the code change themselves aren't huge in volume [12:37] night all [12:37] igc: G'night. [12:39] igc: 12,230 new lines according to diffstat, though they aren't all necessarily very interesting. [12:42] can you get bzr to default to a lightweight checkout? [12:43] igc: would like it if you could arrange to run usertest with bbc + my patch from bundlebuggy merged + the lineI highlighted commented out [12:43] igc: it would be very useful to know if there are surprises [12:43] igc: there is about 12MB of packs [12:43] OllieR: I guess you could make "checkout" an alias for "checkout --lightweight". [12:43] OllieR: I'm not sure how you'd make a heavyweight checkout then.. [12:43] igc: I am wondering if we want to just cherry pick from bbc a lot to do the merge [12:43] Peng_: --no-lightweight [12:44] lifeless: Oh, okay. [12:44] lifeless: Cherrypicking's no fun. [12:44] 10% of our total history isn't either :P [12:44] Peng_: yeah not bad thinking [12:45] lifeless: how do you mean --no-lightweight? [12:45] can't see that in any man pages [12:45] Once everybody upgrades to bbc, that'll only be like 20 KiB, right? So what's the big deal? :D [12:47] lifeless: 10% of history ish't *that* terrible. It'll be a pain to "bzr pull" when it lands, but it's not significant to "bzr branch" or anything. [12:47] It's only significant because it'll come all at once. [12:47] * Peng_ gets shot by someone on dial-up [12:48] Peng_: you can also always do a stacked branch [12:50] I wonder how large it would be even without history? [12:51] Sending it to BundleBuggy would be funny. :) [12:56] does the new progress ever move to a unit larger than KB? [12:57] 130000KB is too many digits for me [13:22] hi, is there a tool to print what modifications has been done by who for a given file, thx [13:23] nilg: "bzr annotate"? [13:25] yeah exactly what I wanted Peng_, thanks! [13:26] :D [13:36] vila: hi [13:37] james_w: hi ! [13:37] vila: would adding something like transport.get_transport(for_writing=True) make any sense? [13:37] then bubbling that up to things like Branch.open()? [13:38] having the intent there would allow better error messages when there is a mismatch between what you want to do and what is possible on the transport I feel [13:40] 1) I think most commands already use {branch,repo,wt}.open[_containing] so I'm not sure it's the right place [13:41] 2) You can't always decide from the url only if you will be able to write or not [13:41] and even if the scheme itself allows writing you may be denied later [13:42] You're back to the not-logged-in-launchpad error message ? [13:42] yeah [13:43] I put it there, so I feel responsible that it sucks so much [13:43] responsible does not imply gulty :) [13:43] I don't see what commands using open_containing et al have to do with it, they would indicate whether they will try and lock the branch for write or not [13:44] Branch.open_containing(for_writing=True) or similar [13:44] there may be a few cases where they don't know, but that would be acceptable I guess [13:44] your point 2 makes sense, but I believe we could at least communicate this to the directory service [13:45] the lp: service could then give an error when it needs to [13:45] How about checking that in the commands themselves via the underlying transport ? [13:46] or catch the exception and rephrase it if needed ? [13:46] :-/ [13:49] checking was my first attempt, but the way that I did it was vetoed [13:49] I think we do attempt to catch the errors in a few places, but it's hard to get them all, and it keeps shifting [13:49] plus that gives no way for the lp: service to suggest lp-login [14:03] james_w: I think we would consider a "Branch.open_locked(for_write=True)" or "Branch.open_write_locked()" [14:03] We've talked about it on the list [14:03] as a way to get around the current open + lock as a standard function [14:03] also, some internals tend to lock objects, and then unlock them to return them [14:04] which then gets locked right away [14:05] that sounds sensible [14:05] would passing that information down to the transport layer be ok? [14:05] most things wouldn't use it I imagine [14:06] or perhaps I misunderstood at what layer the directory services operate [14:11] james_w: It is a lookup that is performed by get_transport. Transports themselves don't use it. [14:11] james_w: So I think pushing it down there would be fine. [14:11] jelmer: is svn-push still required to setup a new branch folder with bzr 1.13 and related bzr-svn ? [14:12] jam: +1000 on a method for opening locked branches. [14:13] rocky: yeah [14:13] rocky: I have a patch for bzr.dev that allows it to integrate into "bzr push", but it hasn't landed yet [14:15] whoa, when did "bzr branch --stacked" get so freakishly quick? [14:16] checkout out bzr.dev takes just 7 wallseconds [14:16] jelmer: http://bazaar-vcs.org/bzr/ was upgraded to btrees recently; maybe that's why? [14:17] Peng_: yeah, I guess that'd explain it [14:23] jelmer: hrm, my svn-push is hanging :/ [14:25] rocky: Hanging or doing a lot of work very inefficiently? :D [14:29] hehe it's hard to tell the difference when it doesn't end ;) [14:32] jelmer: bzr git took me by surprise. I had some bzr commands I forgot about in some scripts. Accidentally ran them in a git repo and it just worked. Nice. [14:55] brink_: :-) [15:01] can i push a branch using sftp? [15:02] yep [15:02] james_w: thanks [15:08] jelmer: Along with the btree changes, I also recently changed the "grab the working tree" code to batch up requests into 5MB chunks [15:08] which made a big difference for the python 'branch --stacked' I was testing [15:08] (rather than requesting the content for each file separately) [15:19] jam: The need for a fast iter_references seems legitimate to me, but since the current bbc format doesn't have it, should we consider having a new format for nested trees? [15:20] abentley: it wouldn't be terribly hard to add another "chk_map" or similar to the disk format for brisbane-core [15:20] and bring it in before we merge it to stable [15:20] (we have a few more days, at least) [15:21] otherwise, if you feel it isn't possible to do efficently without a disk format bump [15:21] then we can just disable it, and plan for one [15:21] * Kinnison finally works out what brisbane-core is. "oooh" is my reaction [15:21] I'm wondering, for example, if "bzr branch meta-1 meta-2" *needs* to create the new branches [15:22] jam: I think an additional chk_map would probably work. [15:24] jam: I guess we could make it optional. [15:24] abentley: I would sort of like if the top level "inventory" record could know whether there was actually any entries, and could store a "NULL" reference, separate from a genuine sha1 reference [15:25] otherwise, I guess you just get the same null-sha1 everywhere [15:25] which isn't terrible [15:25] jam: The idea is that nested behaviour should match non-nested behavior as much as possible. [15:25] jam: not sure what you mean. Are you talking about the chk map? [15:26] abentley: we still have an inventory text, which points out the file-id for the root of the tree, the root node in the id_to_entry map, and the root node in the parent_id_basename_to_file_id map [15:26] I assume we would add a root key for the "tree_reference" map [15:26] jam: That seems like a sane optimization. [15:27] I'm just offering that it should probably consider having a "tree_reference: NULL" entry [15:27] when we don't have any actual references [15:27] it isn't a big deal [15:27] but it means avoiding paging in an empty page [15:29] jam: so about nested matching non-nested behavior: if you branch from foo, you have a new line of development for all files in foo. If you branch from bar, and bar contains baz, it makes sense that you have a new line of development for all files in baz. [15:30] Whether baz is a tree reference or a directory. [15:31] jam: We're probably also going to want some more sophisticated branch/checkout operation that knows some trees should be checkouts and some should be branches. [15:32] jam: based on user configuration. [15:33] abentley: my argument is that there are a lot of ways it could be done, I would also venture that in the most common case, you *don't* want new branches for *all* of the sub projects [15:33] I understand your arguments, and it comes down to the "implementor" gets to decide [15:35] I'm just thinking that if the only use case that *has* to have the index, is "bzr branch" in a shared treeless repository [15:36] (all other cases being ones where we are already walking the inventory) [15:36] then maybe we need to re-think that use case [15:36] jam: I would venture that you want at least two new branches in the common case: one for the top-level directory holding the project and all its libraries, and one for the project source code itself. [15:36] hello [15:36] is the bzr package on PPAs based on 1.13 or 1.13.1? [15:37] jam: That's the only one we've found so far, but I haven't looked around at the others yet. [15:39] gioele: I would guess the ppa hasn't been updated yet, as it should be "1.13.1-X" [15:39] johnf is the one who has been building them, but I haven't seen him around [15:41] then again, maybe he used -2 rather than going .1-1 [15:41] which would be incorrect, but possible [15:43] jam: I see [15:43] jam: At a glance, everything else could be redesigned to not use iter_references, not that this would be especially easy. [15:43] gioele: if you install it, you can always do "bzr --version" to find out :) [15:45] abentley: sure, like I mentioned in the post with Robert, the layering gets a bit tricky for stuff like "commit" [15:45] though I think having iter_changes always return tree references [15:45] because we don't *know* whether they have changed or not [15:45] is a reasonable change [15:46] jam: it depends on what you mean by changed. We don't know if the subtree is changed, but the tree reference is only changed if its revision doesn't match the last_revision. [15:47] abentley: but we don't know if its revision would match last_revision unless we've checked that the subtree has/hasn't changed [15:47] consider what "diff" really cares about when it wants to recurse [15:47] Arguably iter_changes in revision trees could chop off that entire subtree [15:48] jam: The subtree will commonly change without its last_revision changing. [15:48] but workingtrees seem like they should always recurse [15:48] abentley: ..... [15:48] then when you commit [15:48] it doesn't record a new reference [15:48] so that checkout [15:48] gives you the new subtree? [15:48] I thought the "content" for a tree-reference was the last-committed revision of the subtree [15:48] not the last-modified revision of the tree root [15:49] jam: last-modified revision of the *subtree* root? [15:49] right [15:49] sorry [15:50] It should be the Tree.get_revision_id() not Tree.inventory.root.revision [15:50] jam: Correct. [15:50] abentley: which means that if the subtree content changes [15:50] then it's Tree.get_revision_id() should change [15:50] possibly being "None" to indicate it doesn't know what it will be [15:51] yte [15:51] yet [15:51] jam: only if there's a commit. [15:51] abentley: I would argue that it should be None if there are changes and no commit [15:51] such that "bzr commit --no-recurse" would then know to record the last value [15:51] but "bzr commit" and "bzr diff" would both know that there are changes to be checked [15:51] jam: I don't think so. [15:52] abentley: what do you gain by having a value that is "not quite correct" ? [15:52] jam: The value is entirely correct. [15:52] (the content of the tree that is referenced, does not match exactly the content that the revision_id describes) [15:53] It's defined to be whatever the last_revision in the subtree was at the time when the last commit in the parent tree happened. [15:53] If there are no commits to the subtree, it's unchanged. [15:53] abentley: that is the "basis_revision_id" [15:53] which I think we sort of get confused with "revision_id" [15:53] because WT.last_revision() and RevisionTree.last_revision() both return something [15:53] but it doesn't actually have the same meaning [15:54] jam: No, it's MutableTree.last_revision [15:54] abentley: so if you compare the current WT versus its basis, the fact that the tree reference points at the old value is sort-of wrong [15:54] jam: I was not aware that RT had a last_revision [15:55] because it would indicate that there are no changes in the subtree [15:55] when there are [15:55] jam: You are assigning a meaning to the tree reference that I am not assigning to it. [15:55] abentley: And I'm wondering why have a value there that doesn't have meaning [15:55] if you can't use it to check for equality [15:55] then you may as well use None [15:58] jam: My mistake, for a WT the value of the tree reference should always be the subtree's WT.last_revision [15:58] abentley: you still can't use it as an equality check [15:58] and it still seems like it should be None [15:58] just like the last-modified-revision for all files/dirs in the WT [15:58] jam: You can then compare it to the basis one and decide whether to commit the entry. [15:59] jam: I think it's more like get_file_sha1. [15:59] abentley: but without scanning the subtree, you don't know if there are any modifications [15:59] I suppose "bzr commit --no-recurse" could use it [15:59] jam: and neither do I care if there are uncommitted modifications in the subtree. [15:59] abentley: commit and diff both care, don't they? [15:59] as in "bzr diff" in the parent project [15:59] should tell you there are changes in the child [16:00] even if you haven't committed [16:00] Or are "commit" and "diff" not fully recursive? [16:00] jam: Sure they do. [16:00] jam: They don't use iter changes that way, though. [16:00] abentley: I'm arguing that they should... [16:01] as it means you don't need iter_references() [16:01] jam: At the cost of damaging the clarity of iter_changes futher. [16:02] jam: If you're going to do recursion via iter_changes, you might as well just recurse in iter_changes itself. [16:02] That way, you don't have to emit unmodified entries. [16:03] abentley: except 'commit' needs to start a new commit process in the subtree [16:03] since it won't share the revision_id, etc of the containing tree [16:04] jam: commit can figure out that the containing tree doesn't own the file and start a new commit process. [16:04] abentley: that seems far more expensive [16:04] I think there should be room for a WT.iter_changes() that can return objects that may-or-may not have changed [16:04] so that we don't have to verify that things have definitely changed [16:05] until commit has finished [16:05] (to avoid double-sha, etc) [16:06] jam: I don't know how expensive it would be, but it doesn't seem like it has to be expensive. [16:06] abentley: checking that every record is in the containing tree means you have to check every file, and recurse up to its root [16:06] abentley: at a minimum, it is an extra check on every object [16:06] rather than having it handed to you [16:06] since it already knows it [16:07] when we hit a tree-reference, we *know* we are at the boundary [16:07] we don't have to check every modified file to see if it "really is" in this tree [16:07] (the check isn't very expensive, but it is still a check on all files, and even whether you have tree references or not [16:07] because there *might* be a tree reference) [16:09] jam: Don't we already look up the record for each modified file anyway? And wouldn't that automatically fail? [16:10] abentley: perhaps, though you then need to go figure out which subtree it was really in, etc. [16:11] it still seems far cleaner to have it done with commit getting a tree-reference [16:11] not that it isn't possible to do either way, just cleaner [16:12] again, whoever is willing to write the code gets the final say [16:12] I'm just describing my viewpoint [16:13] Yeah, and I disagree about all of this being cleaner. [16:13] abentley: consider that the file_id may not be present, because it was an added file [16:13] jam: what happens when you implement iter_changes betweeen two CHK trees? [16:14] abentley: we have one, but it doesn't support subtrees [16:14] because the behavior is still pretty "undefined" [16:14] also, note that WT versus basis [16:14] is *very* different from RevisionTree to RevisionTree [16:14] and will always be so [16:14] as you have to probe the content on WT [16:14] and you *don't* on RevisionTrees [16:15] and you also don't try to *commit* [16:15] It just seems that it's hard to emit the tree reference in that case unless it has changed. [16:15] the results of RT.iter_changes(RT) [16:15] abentley: I generally, agree, my main argument is that for WT.iter_changes() we don't *know* without recursing if the subtree has changed [16:15] separate from RT.iter_changes(RT) [16:16] abentley: I suppose I would agree that RT.iter_changes(RT) doesn't return tree references that haven't changed [16:16] jam: They're supposed to have the same behaviour, given the same options. [16:16] but WT.iter_changes(WT.basis_tree()) doesn't know [16:16] and *should* return something [16:16] either that, or it has to recurse into the subtree, wait for it to return whether it has changed or not [16:17] and then use that to decide the last-modified of this tree [16:17] entry [16:17] and then finish scanning [16:17] that would be okay [16:17] as it would then emit records for subtrees that really have changed [16:17] which is what commit cares about [16:17] jam: I don't think last-modified enters into it. [16:18] jam: are you thinking of reference_revision? [16:19] possibly, I'm not 100% sure what values go where [16:19] the point is that WT.iter_changes(basis) needs to actually scan, and can't rely on a cached value [16:19] is it considered "bad form" to commit code to a downstream shared branch that really belongs in the central main branch? i'm working on a feature that belongs in our trunk shared branch, but currently it has only one use case in the shared project branch i'm on... so i've been essentially shelving and unshelving to make sure that the code that belongs in trunk doesn't make it into the project branch [16:20] my question is whether or not this is unnecessary and i should just commit it and pull it upstream when i'm ready? [16:21] phinze: I'd be inclined to commit it into a separate branch, just to reduce the hassle. [16:21] phinze: I think you answered yourself, commit in branches with clear definition, create as many as you need and then merge them when you're ready [16:21] yeah i suppose i'm only running into this because in this particular case i've neglected to use a task branch [16:21] phinze: see, you knew :) [16:21] phinze: The loom plugin gives a way to automate this more. [16:22] jam: Well, iter_changes doesn't emit either, so it's just a question of whether to set the modified boolean. [16:22] okay so assuming i have a task branch were all changes belong in project branch "bar" but changes to file "dir/qux" belong in trunk [16:23] i would just merge everything into bar and then from trunk merge ../foo/dir/qux? [16:23] ooop [16:23] phinze: I'll often split things out to go into a separate feature of trunk, commit it, get it merged to trunk, and then bring it back into my project branch [16:24] that should be ../bar/dir/qux in my example === beuno_ is now known as beuno [16:27] jam: like this?: bzr branch trunk trunk-feature; cd trunk-feature; bzr merge ../bar-feature/dir/qux; bzr ci -m "Merging trunk feature from bar task branch"; cd ../trunk; bzr merge ../trunk-feature; bzr ci -m "Adding trunk feature"; cd ../bar; bzr merge ../trunk; bzr ci -m "Merging trunk into bar"; bzr merge ../bar-feature; bzr ci -m "Merging bar feature that happens to have trunk feature that I already merged from upstream" [16:27] perhaps i should have pastebinned that... :\ [16:29] jam: http://pastie.org/426694 [16:29] bah i hate it that in emacs shell the status tty stuff doesn't work very well with bzr [16:30] bbl [16:30] rocky: did your svn-push finish? [16:31] jelmer: it didn't but i cancelled it, i'm trying again right now [16:31] outside of emacs ;) [16:31] it's doing something but the status message is "discovering revprop revisions 609/" [16:33] jam: hi [16:33] so far it says 10285kB @ 30kB/s ... whatever that means [16:34] rocky: well, that's the amount of data it's transferred from the remote server [16:34] from or to? [16:34] rocky: both, subversion doesn't distinguish when reporting data transfer [16:35] it occurs to me that there is a lot of content to upload so perhaps that's the issue here [16:35] rocky: this all happens before the actual pushing [16:35] rocky: it's just checking which revisions you have in your bzr repo already exist in the svn repo [16:35] how do I get rid of [16:35] No handlers could be found for logger "bzr" [16:36] Mez: Context? Where is this happening? [16:41] Mez, try removing bzrtools [16:41] and see if it still happens [16:41] what version of bzr are you using? [16:42] Peng_: any action with bzr [16:42] using 1.13 [16:43] removing bzrtools makes no difference [16:43] Mez: Oooh. I don't know. Do you have permissions to write to ~/.bzr.log? [16:44] Mez: Do you have the environment variable BZR_LOG set? [16:44] ah...-rw-r--r-- 1 root root 66911 2009-03-25 16:42 /home/mez/.bzr.log [16:44] Mez: Better, "bzr version" will show where it puts the log file. -- but you've already got it. [16:45] that resolved it (chown) [16:45] :) [16:45] Maybe bzr should warn if the log setup fails. === Toksyury1l is now known as Toksyuryel [17:06] jelmer, phinze: sorry I didn't get back to you yet, I had a phone call, and I'm going to eat lunch real quick, bb ~30min [17:30] phinze: my guess is that doing "bzr merge ../bar-feature/dir/qux" is going to actually be a "cherrpick" because you aren't merging all of the changes from that branch. [17:31] However, it otherwise looks correct. [17:31] I might do it as... [17:31] jam: I was wondering if a combination of your two suggested solutions for subtree performance handling in bbc would work [17:32] phinze: nm, I saw that you were merging trunk back into bar, which is what I was about to mention [17:33] jelmer: there are certainly lots of possibilities. There is also the "we would like to have bbc in core by the end of this week" [17:33] so it is part of the rc1 next week [17:33] oh [17:33] I wasn't aware that was the plan :-) [17:33] so what is our immediate goal [17:33] and what will we get done later [17:33] not that I'm complaining ;-) [17:34] can we get subtree performance to not be an immediate regression such that it would block bbc [17:34] jam: in that case the "subtrees known broken" one seems most reasonable to me [17:34] jelmer: though if "known broken" is the case, and we know we need a disk format bump [17:34] then we may as well continue to leave them broken [17:34] sorry [17:34] disabled completely [17:34] and expect there to be a --dev6 before we make them an official format [17:35] so the discussion was about seeing if we reall need a --dev6 [17:35] or whether the current structures are enough [17:35] ahh [17:35] The current structures are enough for all cases but 1 [17:35] well 'hypothetically given enough coding" enough [17:35] and that 1 case could be written to happen differently [17:36] but if that is seen as a bad route to what we want ultimately [17:38] jam: but leavning them broken would mean people don't need to upgrade to a new inventory file format [17:38] jam: when they start becoming supported [17:39] jelmer: right, but if we need new data on disk [17:39] they have to upgrade *anyway* [17:39] so why allow them to shoot themselves in the foot with the current format [17:39] jam: we'd just have to do a (cheap) upgrade to a format that had that index [17:39] jelmer: sure, but why wouldn't the rest of it also be cheap? [17:40] Starting to think rename determination should be automatic. Now that I've played around with it enough I realize that it makes integration, refactoring, etc., work much better. [17:41] jam: aren't upgrades that involve inventory rewriting expensive? [17:42] jelmer: it depends on how much of the inventory you have to rewrite [17:42] XML inventories have a single text for everything [17:42] so you have to rewrite MB of data [17:42] If it is just changing a format value in the top level node [17:43] that is pretty cheap [17:43] Anyway, I don't have a problem having a serializer that can include "tree-reference" in the stream [17:43] and just set the flag "supports_subtree = False" in the RepositoryFormat [17:43] And possibly add a bit in the serializer to have it check that it really-doesn't-yet have 'tree-reference' written. [17:46] jam: ah, I hadn't considered the fact that bbc's inventory format is faster to write deltas for [17:47] jam: thanks for the explanation of all of this [17:47] jelmer: out of curiosity, how does subversion handle commits with svn:external? [17:48] Is it not possible to have an atomic update? [17:48] So would bbc make going from plain to rich roots cheap as well? [17:48] Peng_:bbc is rich-root only [17:48] at least, that is the plan [17:48] we may back down [17:48] jam: Sure, but if it wasn't, would it be? [17:48] Peng_: converting a CHK-plain => CHK-rich-root should be *much* cheaper than it is today, yes [17:49] as it is writing 2 pages [17:49] (affected page, and root) [17:49] jam: externals are a bit of a hack [17:49] How cheap? Like, "bzr pack" cheap or "instant" cheap? [17:49] jam: basically it will run "svn commit" in all underlying trees as far as I know [17:49] Peng_: well, you'd probably want to do a "pack" afterwards anyway... [17:49] but that is 10-20min cheap, not 48hours [17:50] for the MySQL repo [17:50] 48 hours? Woah. [17:50] "bzr pack" on bzr.dev takes approx 2 minutes in bbc [17:50] and recompresses all the texts [17:50] jam: externals are a bit like config-manager, in that they point at a URL that's to be checked out [17:50] jelmer: I thought it could also refer to an exact revision [17:50] possibly URL@revnum [17:51] jam: but it's possible to not reference a specific revision, and if you reference a specific revision, you have to write that into the externals property yourself AFAIK [17:51] jelmer: so you could "guess" at the right revnum [17:51] but in the end you could be wrong [17:52] jelmer: I also thought with svn there was a way to say "i'm starting a commit, when I'm ready to finish, if the revnum doesn't match what I thought it would, abort and start over" [17:52] jam: yeah, in the case of a two-phase commit there could be some other person committing in between the first and the second commit [17:52] *first and second phase [17:53] jam: that's only for the base revision [17:54] jam: so if you open /trunk for committing when the last revision is 3 [17:54] then somebody else could be committing revision 4 in /branches/foo and you wouldn't get an error === beuno_ is now known as beuno === cprov-afk is now known as cprov === beuno_ is now known as beuno === beuno_ is now known as beuno === mario_ is now known as pygi [20:11] Hello. I've been reading the bazaar workflows documentation, and I've noticed something that puzzles me. In the "Decentralized with human gatekeeper version", Bundle Buggy is given as an example. Then at the end in the notes, it says "The Bazaar developers use Decentralized with automatic gatekeeper to develop Bazaar itself." And from what I understood from reading the mailing list, Bazaar uses Bundle Buggy [20:11] for its development. So, one of these three statements has got to be wrong, no? Which one is it? [20:11] Can Bundle Buggy also do "automatic gatekeeper" (run a testsuite before commit, etc.)? [20:11] chrish1: Bundle Buggy is used for reviews. PQM is used as the gatekeeper. [20:12] chrish1: the human gatekeeper needs to track what to merge, the Bazaar developers need to track what to review (with bundlebuggy) [20:13] hi davidstrauss [20:13] Oh. So when the merge request is approved via Bundle Buggy, it forwards that to PQM to be merged into the trunk? [20:13] LarstiQ: hi [20:14] chrish1: No, when it's approved via BB, someone manually sends it to PQM. [20:16] Oh. So there's no need for any integration between the two. If I want to duplicate that setup, I just install Bundle Buggy and PQM separately, and forward manually between the two. That clarifies it, thanks! [20:17] chrish1: I guess you could make bundlebuggy submit requests to PQM, I think we like to keep some human judgement in the loop still. [20:17] but maybe it can be smoothened [20:19] I guess it's just a single command to submit a change to PQM once it's been accepted at review? [20:21] chrish1: hmm, you ask PQM to merge a branch, maybe you could point it at BB. That might not actually be mergeable depending on the state of trunk, hmm. [20:21] chrish1: try it! :) [20:25] Will try it when the project has started to get off the ground (when there's a testsuite, etc.). Btw, what's the best place to suggest a clarification to the bazaar-vcs.org web site content? (For what confused me in the Workflows page.) [20:26] chrish1: if you're confident about the change, editing the wiki. [20:27] chrish1: if not, the list or maybe here if it's something I could apply immediatly [20:29] I just want to suggest adding something like "(using Bundle Buggy for patch reviews and PQM to manage the trunk.)" after the "The Bazaar developers use Decentralized with automatic gatekeeper to develop Bazaar itself." sentence. Would have clarified things for me. [20:36] chrish1: sure, I can do that [20:38] chrish1: especially since I realise that documentation is not on the wiki :) [20:39] Thanks! [20:40] chrish1: could you point me at the exact url/section you had in mind? [20:40] chrish1: you should also look at launchpad.net/tarmac [20:41] which is meant to read review results and then test and merge automatically [20:42] LarstiQ: http://bazaar-vcs.org/Workflows (go to the end, the "Notes" section, etc.) Basically clarifying what I didn't understand before asking here... [20:43] chrish1: thanks [20:44] chrish1: so I was mislead by similar sections existing in the user guide, this _is_ the wiki afterall. [20:44] * LarstiQ edits [20:46] poolie: Wow. Looks cool. Thanks for the pointer! Is it already at a stage where it's usable, or should I wait some more before giving it a shot? [20:47] jam: Can you clarify: iter_references is slow on a RevisionTree? [20:47] abentley: yes [20:48] jam: Even though it's an all-memory operation? [20:48] chrish1: edited. [20:50] abentley: it is all memory for XML trees, it isn't for CHK, but regardless it is an O(tree) operation [20:50] so 'slow' is a bit relative [20:50] LarstiQ: Saw it, cool. Nice to see the quick turnaround time for clarifications to the documentation. :-) [20:51] it is only slightly fast for XML RevisionTrees because we already paid the cost of deserializing every entry [20:51] chrish1: it helps that you had a clear request :) [20:51] chrish1: so thank you for the feedback. [20:52] LarstiQ: Thanks. Will come back and visit (and hopefully have clear requests) if there's something I find unclear again. [20:53] Does tortoise have an interface to 'revert'? [20:53] chrish1: cool. I haven't set up PQM myself, but am here to help regardeless. [20:53] fullermd: hmm, it should. [20:54] * fullermd is on a conference call. [20:54] * LarstiQ looks at the code [20:58] fullermd: it has a call to qrevert, so I'd wager yes. [20:59] I couldn't guess how to get at it, and he couldn't find it... [21:02] I can't actually test fully without windows here. [21:02] but: gettext("Re&vert..."), gettext("Revert local changes"), [21:02] if that's not showing up in the context menu, I don't know how it works [21:02] Well, we ended up using the obvious and trivial workaround of making a new checkout of the whole tree at a given revision and copying the files. [21:02] * fullermd is sure that was good PR. [21:03] fullermd: :/ [22:03] lifeless: hi [22:06] hi [22:10] Who thought of stacked branches? They're a really great idea. :) [22:11] lifeless: You did some research before choosing a db format for bzr-search right? [22:11] lifeless: I'm trying to decide what bzr-svn should use instead of sqlite [22:12] lifeless: the main things I'm looking for are simple search keys (integers or strings), append-only, multiple concurrent writers/readers, preferably widely available (ideal would be included with bzr/python by default) [22:13] * mwhudson would also be interested in such a thing for loggerhead/revnocache [22:15] Doesn't bzr-search just use bzr indexes...? [22:15] Peng_: it uses an additional index [22:15] jelmer: Yeah. And the format is just a GraphIndex or btree index. [22:16] ah, crap [22:18] jelmer: what's the problem with sqlite? the writers-block-readers thing? [22:19] mwhudson: yeah [22:33] jelmer: yes, I did [22:34] jelmer: gimme 30 to grab food and stuff, and I'll chat about this with you [22:39] lifeless: thanks! [23:16] jelmer: so [23:16] jelmer: I researched search engines first [23:17] jelmer: with a requirement that they be able to work over ftp etc [ideally by hooking into the python transports of bzr] [23:17] non-starters, or at least 'much work needed' [23:17] for various reasons [23:18] jelmer: I ended up writing my own search engine; and yes I based it on bzr's B+Tree indices which are pretty good and have nice characteristics like write-once [23:20] jelmer: bzr-search builds a similar infrastructure to packs to get multiple writer multiple readers safely [23:22] I just had a spam that started with "Jam with your bundle!". No wonder it got past my spam filter... [23:22] spiv: 1:30 is definitely fine [23:22] lifeless: cool [23:23] lifeless: hmm [23:24] jelmer: and I have a small project aiming to replace bzr searches storage guts with a general purpose thing it could reuse [23:25] I'm feeling my way around the domain/needed heuristics at the moment [23:26] jelmer: if you need to replace the value of keys its a little more tricky than bzr-search or repositories support [23:26] do you need to do that? [23:27] lifeless: no, it's read-only [23:27] s/read/append/ [23:28] jelmer: k [23:28] basically there are three kinds of information in the cache: [23:28] - a copy of "svn log -v" on the root of the repository (incrementally updated whenever new revisions appear in the svn repo) [23:29] - a table mapping bzr revision ids to svn revno/path tuples [23:30] - a table with basic bzr metadata about each round-tripped revision [23:35] right [23:35] so bzr-search's approach would work fine for you, I think [23:36] as my generic thing isn't fit to show yet :) - its basically: [23:36] have a collection of packs with a names list (crib this from bzr-search) [23:36] with a function to merge at log2 or whatever [23:36] each pack has a directory, which the names list points at (by saying the bytes the index is found at) [23:37] the directory maps table names to byte ranges in the pack [23:37] each of those byte ranges is itself a B+Tree index, with the right tuple keywidth for the table and strings as values [23:42] lifeless: thanks, I'll look into that [23:42] bzrlib.plugins.search.index [23:42] read through that [23:42] you'll be able to discard everything specific to searching [23:56] jelmer: https://code.edge.launchpad.net/~jelmer/pqm/distutils/+merge/569 did you get notified of my review/ [23:56] ? [23:58] Is there an easy way to see the unpushed commits of a branch to the push branch? [23:58] lifeless: yeah, I just haven't gotten round to fixing it yet [23:58] mrooney: bzr missing [23:58] mrooney: e.g. bzr missing :push