/srv/irclogs.ubuntu.com/2010/07/08/#bzr.txt

pooliehi jam, spiv, lifeless00:41
lifelesshiya00:44
spivMorning.01:02
pooliehi spiv01:02
pooliespiv, i'm preparing my session for the epic01:42
pooliewhat are you up to today01:42
spivpoolie: working on bug 522637, there seems to be some disagreement between a repo and its fallback about the CHK roots for an inventory (and as a tangent having some ideas on a new hpss verb)01:50
ubot5Launchpad bug 522637 in Bazaar "BzrCheckError: Cannot add revision(s) to repository: missing referenced chk root keys (affected: 11, heat: 58)" [High,In progress] https://launchpad.net/bugs/52263701:50
spivpoolie: then thinking about the epic01:50
poolieah that sounds good :)01:50
pooliei'm just about to propose we fork off 2.2 and do 2.2b401:50
pooliei want to make the branch allow at this point non-bugfix changes but no api breakage01:51
spivOr at least controlled API breakage :)01:51
pooliei wonder if having it be different to released stable branches will cause confusion01:51
poolieno intentional api breakage :)01:51
poolieactually i think not even any deprecations01:51
pooliebut having an 'api freeze' phase is not unprecedented01:52
jbowtieI just got approval from legal to release my Bazaar plugin.02:36
jbowtieI'm planning on pushing it to Launchpad under GPLv2 or later; any best practices for publishing plugin projects?02:37
lifelessgenerally they are found on LP in bzr-pluginname projects02:38
lifelessoften people put them in the 'bazaar' project group, which gives ~bzr (the broad set of developers of bzr and its plugins) access to do bug triage etc02:38
lifelessand sometimes people make the trunk branch owned by ~bzr or a dedicated group which ~bzr is in, so that other folk can update the plugin when API changes break it.02:39
lifelessthese are all optional voluntary things of course02:39
jbowtielifeless: Thanks, the 'bazaar' project group stuff I didn't know.02:43
poolielifeless: i was just wondering why you declined bug 522637 for 2.0 and 2.103:09
ubot5Launchpad bug 522637 in Bazaar "BzrCheckError: Cannot add revision(s) to repository: missing referenced chk root keys (affected: 11, heat: 58)" [High,In progress] https://launchpad.net/bugs/52263703:09
poolieis it infeasible to fix there?03:09
lifelesschecking03:09
lifelesspoolie: it was ages ago that I declined it03:13
lifelessthe UI kind of encourages 'propose for' on *problems* but perhaps its *solutions* that should be proposed.03:13
lifelessits the conflation between bug exists and will-fix-in again.03:13
pooliemaybe so03:14
lifeless...anyhow... I suspect the fix will be non trivial03:14
pooliewell, i guess the merge can be proposed to either03:14
lifelessbut spiv is working on it I think ?03:14
pooliebut it may be nice to say "we want to try to fix it in 2.0."03:14
pooliehe is03:14
poolieif he think it's easy to backport03:14
pooliewe can do that03:14
pooliewas just curious03:14
lifelessI'd get the fix and then make an assessment of that.03:14
poolieyep03:14
EdWyse_HomeIs there a way to convert a lightweight checkout to a heavyweight one? or do I just have to re-checkout the whole thing?03:15
lifelessbzr reconfigure --checkout, I think.03:16
EdWyse_HomeClose enough... Thanks03:17
=== oubiwann is now known as oubiwann-away
jbowtieThere we go... https://launchpad.net/bzr-tfs03:44
lifeless\o/03:47
jbowtieIt's a pure python solution, too (relies on python-ntlm for authentication) - means it works nicely on Linux, not just on Windows.03:48
jbowtieI suppose now I need to write some documentation, and tests, and so on...03:48
lifelessthats really cool03:48
lifelesspoolie: brief call ?04:41
poolielifeless: hi, sure04:56
lifelesscould you ring my NZ house # ?04:56
thumperhow do I cherry pick a revision?04:56
lifelessmerge -c revno branch04:56
thumperta04:56
thumperjbowtie: that's pretty cool05:00
thumperjbowtie: I don't suppose you are looking at a visual studio plugin are you?05:00
jbowtiethumper: Not for a while, too many other things on my plate.05:17
parthmi am seeing some weird error on pqm for the bad-pattern patch. http://dpaste.com/215805/ .. the tests pass locally.05:29
parthmany ideas?05:29
parthmthe pqm-stderr has this http://pastebin.com/Fn6zSE7905:35
spivparthm: those pastes don't give many clues :(05:40
parthmspiv: i am downloading pqm-stdout to see if that has something.05:41
lifelesslook at the end of pqm-stdout generally05:43
parthmis there a quick pattern i can search for? the summary shows 3 failures: http://pastebin.com/XL5NHXu7 ... its difficult to different expected tracebacks from actual failures.05:48
lifelesshave you got subunit installed ?05:50
parthmlifeless: yes. '/usr/lib/python2.6/dist-packages/subunit/__init__.pyc'05:52
parthmis DeprecationWarning considered an error? .. http://pastebin.com/V8kEyB1z05:52
lifelessparthm: 'gunzip -c pqm-stdout.gz | subunit-filter --no-skip | subunit2pyunit'05:53
parthmlifeless: i don't have subunit-filter and subunit2pyunit. where can I get that?05:54
lifelessparthm: apt-get install subunit05:55
parthmlifeless: thats pretty neat. http://pastebin.com/hJ98AauT05:59
parthmbt.test_globbing and bt.test_osutils seem to work fine locally.06:01
parthmfor re_compile_checked the only difference is that its deprecated now. test results: http://pastebin.com/B5JaL8k906:04
spivparthm: IllegalUseOfScopeReplacer means lazy_import is involved06:06
spivparthm: which suggests that it might be sensitive to the exact order imports happen :/06:07
spiv(And so presence/absence of plugins could affect that)06:07
parthmspiv: ah yes. i see the error now.06:07
parthmspiv: there is a direct import (not lazy) "from bzrlib.trace import ( errors, ...)" ... note the trace.06:08
parthmspiv: interestingly it passes locally. i don't know why.06:08
lifelessplugins06:09
parthmspiv, lifeless: the import errors is for globbing.py .. forgot to mention.06:09
parthmi suspect that will fix the scope error. any idea on the re_compile_checked error?06:10
spivparthm: regardnig globbing.py, that is pretty weird that lazy_import is involved in the traceback when it's not used in that file.06:11
parthmspiv: yes. its surprising. also, the tests passing (locally) with that is weird.06:14
spivparthm: regarding the deprecation, I think pqm runs python with -Wall, which means warnings are raised as errors, including deprecations06:15
spivThe docs on writing tests should explain how to write tests for deprecated functions (i.e. how to expect a deprecation from a particular call)06:15
* parthm goes digging into testing docs for deprecation.06:16
spiv(I mean "should" in the sense of "I do not know if they actually cover that, but if they don't then please file a bug and/or fix that" :)06:17
spivIf they don't, you should be able to grep the test suite for how other tests do it.06:18
parthmspiv: its not mentioned in the testing doc. but HACKING.txt mentions "TestCase.applyDeprecated" without much explanation. i will file a bug for updating the testing doc.06:19
spivparthm: thanks :)06:20
parthmspiv, lifeless: thats for the help in locating the issues :) ... i will try to land this again once these are fixed.06:21
pooliehi spiv, parthm06:39
parthmpoolie: hi06:40
vilahi all07:46
lifelesshiya07:47
parthmlooks like another error. http://pastebin.com/Z4qRJUGX ... looks like re.compile is calling python2.4 re.compile directly and not the lazy one. test passes locally (python2.6)08:04
parthmlazy re_compile: http://bazaar.launchpad.net/~parthm/bzr/300062-bad-pattern-error-part-1/annotate/head:/bzrlib/lazy_regex.py#L6108:04
parthmcompile failure should be raising InvalidPattern and not re.error. any ideas?08:04
parthmlifeless: just saw the mail on your move to launchpad. congratulations and thanks for all the reviews and piloting :) good luck.08:10
lifelessthanks!08:10
parthmhmm. i ran the test with python2.4 and didn't see any problem. so its not python related.08:17
lifelessparthm: have you tried with --no-plugins ?08:17
parthmlifeless: yes. i am running it with no-plugins. the tests pass locally with 2.4 and 2.6.08:18
parthmlooks like re is not being lazy on babune. the stack trace doesn't seem to be going through lazy regex http://pastebin.com/Z4qRJUGX08:19
lifelessmmm08:20
lifelessvila: ^ :)08:20
parthmdoes the test generate a .bzr.log with exception details?08:21
parthmvila: "python -Wall ./bzr --no-plugins selftest -v -s bt.test_osutils.TestReCompile" passes locally but fails on pqm.08:22
vilaparthm: what os are you using ?08:22
lifelessparthm: oh08:22
lifelessparthm: run other tests that use re perhaps ?08:22
lifelessparthm: I suspect you're running into a test isolation issue of some sort.08:22
parthmvila: ubuntu 9.1008:23
lifelesspossibilities: something puts the real re back; something triggers the regex you expect to be lazy before your test runs (solution, use your own private re), $something else.08:23
parthmlifeless: thats the only test thats failing now (even on pqm). rest all pass.08:23
lifelessparthm: great.08:23
lifelessbbiab08:23
vilaparthm: babune is not supposed to change anything regarding loading python modules (the mere thought of it scares the hell out of me)08:24
parthmvila: is pqm on babune or is it a different system. just curious.08:25
vilaparthm: nah, pqm is a totally different host/chroot/etc08:25
parthmoh ok. then its what i am seeing on pqm. babune is fine :)08:26
vilaBut is pqm still running 2.4 ?08:26
parthmvila: yes. thats what the error shows http://pastebin.com/Z4qRJUGX08:27
parthm_sorry. i dropped off.08:29
parthm_this is the failing test case. http://bazaar.launchpad.net/~parthm/bzr/300062-bad-pattern-error-part-1/annotate/head:/bzrlib/tests/test_osutils.py#L171808:30
parthm_maybe its playing badly because i now have assertRaises + applyDeprecated together.08:30
parthm_but interestingly it works ok locally.08:31
spivparthm_: have you tried 2.4 locally?08:31
parthm_spiv: yes. it passes with 2.4 as well as 2.6.08:32
=== parthm_ is now known as parthm
spivI doubt assertRaises or applyDeprecated would interact or otherwise be the cause.08:33
spivPerhaps the deprecation decorator itself is involved?08:33
spivThough that seems a bit unlikely too.08:34
vilaparthm: too many interacting stuff here to diagnose remotely without reproducing :-/08:35
parthmvila: yes :( ... will see if i can try to reproduce it locally.08:36
vilaparthm: generally, a test subset pass but not the whole test suite, you need to first run the full suite locally to see if *that* reproduce it08:36
parthmvila: makes sense. i will try to do that.08:38
* parthm fires the full test suite08:39
vilalifeless: hmpf, best wishes for your new role but while this isn't fully unexpected it makes me sad :-(08:41
parthmi am starting to get the "can't start new thread" errors. is there something i can do? i am already using --parallel=fork.08:55
vilaparthm: bump BZR_CONCCURENCY up08:56
vilaBZR_CONCURRENCY08:57
parthmvila: what should i set it to? i have two cores.08:57
vilathe precise value is: it depends :->08:57
vilaI'd try with 4 then 6 or 8 depending on available resources08:58
vilaparthm: be ready to ^C it if it start swapping like hell08:58
parthmvila: at the moment its not set. ok. i will try with 4. hopefully my 1gb ram won't be an issue. maybe its time for an upgrade :)08:58
vila1GB seems a bit short, all babune slaves have 2GB09:00
parthmok. everything seems ok till now ... 1500 tests. ... and its fast :)09:00
vilaparthm: hehe, it sure is :)09:01
lifelessvila: THANKS09:03
lifelessbah09:03
lifelessthanks09:03
=== lionel_ is now known as lionel
parthmvila: yup. the error is reproducible half way through the full suite run. now i just need to figure out whats causing the laziness to go away.09:10
parthmforcing lazyness seems to fix the problem http://pastebin.com/b5csDHQd .. while not the _right_ solution, i feel it should be ok as the api being tested is deprecated anyway and is not used.10:03
parthmshould i be filing a bug for test isolation?10:04
lifelessnight12:59
GaryvdMHi all - Why do I get this error: http://pastebin.org/38637714:34
GaryvdMWhich differs from the documentation: http://docs.python.org/release/2.6/library/threading.html#id114:34
GaryvdMAh - nvm - must just do lock.acquire(False), not lock.acquire(blocking=False)14:38
mgzhey Gary. where are you at with the installers? is 2.2b3 is a finished-ish state?14:50
GaryvdMHi mgz15:13
mgzhey.15:13
mgzI'm just writing up a message for the list, can you read it before I post to make sure it makes sense?15:13
GaryvdMmgz: 2.2b3-2 does the -OO backed out...15:14
GaryvdMlet me try again..15:14
GaryvdMmgz: 2.2b3-2 is built with your org  -OO patch backed out...15:14
mgzneed to leave in an hour, won't be around again till Tuesday, so make any final choices on that for me15:15
GaryvdMmgz: I would like to try you py2exe hack15:15
GaryvdMmgz: Ok - I'm only going to start trying to build 2.2b4 next week any way15:16
mgzah, cool.15:16
GaryvdMSo - yhea - 2.2b3 probably  won't get any more bulids....15:16
GaryvdM(from me)15:16
GaryvdMmgz: I was just about to go to ice hockey practice, so I will only be able to read your mail much later.15:17
mgzah, I'll just post it when I'm done then.15:18
GaryvdMok15:18
GaryvdMmgz: What is it re?15:18
mgzwhat plugin authors need to know about docstring stripping15:19
mgzbascially summing up what's been said in the merge proposal and in here the last few days15:19
GaryvdMOh - ok.15:19
GaryvdMmgz: I just want to make sure that we are on the same page with the -OO issue: We want to get it so that library.zip is -OO, but the exe's are -O.15:21
mgzideally, yup.15:22
GaryvdMmgz: ok cool.15:22
GaryvdMbye15:22
=== deryck is now known as deryck[lunch]
mgzurk, running out of time16:06
mgzokay, email sent, and I'm leaving16:15
mgzas did it in a hurry, probably full of mistakes, feel free to correct me on things16:15
mgzback Tuesday.16:15
=== davidstrauss_ is now known as davidstrauss
=== davidstrauss_ is now known as davidstrauss
=== mordred_ is now known as mtaylor
=== mtaylor is now known as mordred_
=== mordred_ is now known as mtaylor-away
=== mtaylor-away is now known as mtaylor
=== mtaylor is now known as mtaylor|away
=== mtaylor|away is now known as mtaylor
=== oubiwann-away is now known as oubiwann
=== deryck[lunch] is now known as deryck
LeoNerdI don't suppose there's much by way of bzr/perforce integration, is there?18:45
rockstarLeoNerd, I know some Nvidia folks that are doing it, but I don't think it's publicly available.18:46
LeoNerdRight.. ahwell18:46
james_wLeoNerd: there is https://code.launchpad.net/bzrp418:57
james_wno idea what state it is in18:58
idnarwhat are branch nicknames for?19:05
chaosaddictIt seems like with a large repository (6000 commits, 40gb of files+history), routine commands take about an hr to return and use up all available memory. Does anyone know if this is a known issue and if it will be fixed in the future? I'm looking into migrating from Perforce to Bazaar for my company, but right now it looks like it would be much too costly.19:25
idnaris there an easier way to do "bzr merge -r before:ancestor:trunk.. feature-branch"?19:28
mkanatchaosaddict: I think one of the problems there is that most VCSes don't expect to be storing enormous binary blobs.19:35
mkanatchaosaddict: It is a known issue, though, that bzr uses up a lot of memory when dealing with large files.19:35
mkanatchaosaddict: I'll take a wild guess and say that this is a VCS for a game?19:36
mkanatThose are the only people I know who store enormous binary blobs in the VCS, are game developers.19:36
mkanatI understand why, it's just not something that most VCSes are geared toward.19:36
mkanatidnar: They show up in the log history.19:37
mkanatidnar: So you can tell what branch a commit was made on.19:37
idnarokay19:37
chaosaddictmkanat: It's not for a game. I think we just have a lot of files. It's been complicated by Perforce storing branches as copies of files, so we often have maybe 30 copies of the same file.19:43
mkanatchaosaddict: All right. But a single checkout is 40GB?19:43
mkanatchaosaddict: Or just the history is 40GB?19:44
chaosaddictmkanat: I imported all the code for one product, which probably has multiple logical projects that would normally be tracked separately in bazaar. Additionally, there are maybe 20 branches, that have no concept of a main trunk, so all the files are duplicate each time. The fast-import dump file was 30gb, and the resulting bazaar repository after import is 40GB for all the files, with the history.19:56
mkanatchaosaddict: Hmm. I wonder if you'd want to somehow hack up the importer to understand that some of those files have a common history.19:57
chaosaddictI think it did a good job of replicating what was in Perforce. I'm not quite sure how I would fix it. Maybe split off each branch into its own bazaar repository and merge it back into a main branch to preserve the history.20:02
mkanatchaosaddict: Well, if they have identical files, that won't work.20:14
mkanatchaosaddict: Because bzr doesn't recognize files by name, but by an internal id.20:14
=== davidstrauss_ is now known as davidstrauss
chaosaddictmkanat: ah. So if the files don't have the same origin, as far as Bazaar knows, then they can't be merged with history preserved? We have fields in the files that Perforce updates with revision numbers and date submitted, etc, so the files won't even hash to the same value, even if they were the same as far as Perforce was concerned.20:20
mkanatchaosaddict: Right.20:20
mkanatchaosaddict: The importer has to understand from the start that those files have a common history.20:20
lifelessmorning20:46
chaosaddictgood morning20:48
detrituxhi22:14
hichambzr is acting weird when cloning a repo from lp22:40
hichami have 50 MB of history for a 15 revisions branch, and it not finished yet22:44
EdWyse_OfficeIs there a way to fix an InconsistentDelta?23:20
EdWyse_OfficeI can find a lot of things that tell how to get to that state, but nothing about how to repair from it.23:21

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!