/srv/irclogs.ubuntu.com/2011/07/27/#bzr.txt

peitschiehiya everyone06:42
peitschieis there someone here that can lend a hand troubleshooting a corrupted repo?06:42
AuroraBorealisoh gee06:42
spivpeitschie: sure06:43
peitschieI'm getting the following error every time I run a command: bzr: ERROR: No such file: u'/vsl/bedrock/BSDSRG/Projects/Bond Advance/Bazaar/.bzr/repository/indices/1243d19cced51e076aaf9e36f173c9ee.rix': [Errno 2] No such file or directory: u'/vsl/bedrock/BSDSRG/Projects/Bond Advance/Bazaar/.bzr/repository/indices/1243d19cced51e076aaf9e36f173c9ee.rix'06:43
peitschiehi spiv :)... it's been a long time btw... bzr has been humming along without incident for almost 10months since the svn ghosting issues :)06:43
spivpeitschie: hmm, take a look in .bzr/repository/obsolete_packs, it might have that file06:44
peitschieit looks similar to this: https://answers.launchpad.net/bzr/+question/96346 ... I'm walking through those now06:44
peitschieno joy on the obselete packs06:44
spivWas there a system crash around that time?06:44
peitschieonly one file in there which has a vastly different name06:44
peitschiespiv: looking into it now...06:46
jammorning all06:49
peitschiespiv: looks like some nfs issues somewhere...06:52
spivpeitschie: ah, ouch06:52
spivpoolie's just-landed patch to call fdatasync may help avoid this problem in future.06:53
peitschiespiv: mm... could be fun... what are the chances I can save the repo if this has caused some kind of file corruption?  the thing will have done this in the last few hours06:54
peitschiespiv: interestingly, I can see the desired pack file listed in the pack names, just the actual indicies file seems to be missing06:55
peitschiespiv: there also appears to be no actual pack name with that file under packs06:55
spivpeitschie: the suggestions on that link you found are probably your best bet06:56
spivpeitschie: i.e. remove that entry from pack-names, on the assumption it was only that new pack that is missing.06:56
peitschiespiv: ok.  I'll give that a shot and see what happens :).  What will that do to any clients that believe the file was uploaded to the server?06:57
spivpeitschie: most likely there's a single new revision that's been lost06:58
spivIf there's a client that had a repository stacked on this one, that might be an issue (although probably they'll have the necessary data locally)06:59
spivIf there's a lightweight checkout using that repo that thinks it's current version is the lost revision it'll be understandably sad and confused :)07:00
spivProbably though other repositories will be fine.  If there's a branch in that particular repo that was pointing to the missing revision it'll be broken and need to be repaired to point to an existing revision07:01
AuroraBorealisseems like bzr is pretty easy to break.07:01
AuroraBorealisis there no safeguard for when one file goes magically missing?07:02
peitschiespiv: mmm... well.. once IT gets their NFS stuff together again we shall start the great exploration I guess.  Most of these are straight checkouts so hopefully things are not lost yet :)07:02
spivAuroraBorealis: if the filesystem randomly loses data from under you without warning?  yes07:02
AuroraBorealisi mean...if the OS crashes, if the internet dies in the middle of a commit, seems like a lot of things could cuase this...07:02
spivAuroraBorealis: the repair tools could certainly be better, but usually the best answer to FS corruption is "restore from your backup"07:02
spivAuroraBorealis: we're robust against network connection dropouts07:03
AuroraBorealiseven if the repo is on a dumb ftp server?07:03
spivAuroraBorealis: this case is bzr has committed it's transaction, i.e. renamed files into place, then finally updated the central index file to refer to the new files, and then somehow those files that were totally definitely there a moment ago are gone07:03
spivAuroraBorealis: yes, even on FTP07:04
spivAuroraBorealis: at worst bzr might ask you to run 'bzr break-lock'07:04
spivAuroraBorealis: but it won't damage the repository07:05
AuroraBorealisok07:05
fullermdWe need a bzr plugin that punches you in the head if you use FTP.  And ideally, the server's admin too.  Twice.07:09
AuroraBorealisuhhh07:09
AuroraBorealisi use ftp07:09
AuroraBorealisbecause i dont have root access to my box07:09
* fullermd winds up...07:09
AuroraBorealiswhat else am i supposed to use07:10
fullermdPunching the person with root in the head.07:10
AuroraBorealisthat doesn't answer my question07:10
AuroraBorealisits a cheap hosting plan, they never give you root access07:10
AuroraBorealisand since the documentation for the supposed 'bazaar smart server' is laughably nonexistant07:10
fullermdThat probably calls for high explosive.07:11
fullermdThere are things in life more infuriating and revolting than the continued existence of FTP.  But it's a short list.07:11
AuroraBorealissince you since to be a troll, i'll stop now :>07:11
pooliehrm07:11
poolieAuroraBorealis: if the os dies in the middle of a commit, bzr has various ways to recover07:12
AuroraBorealisah ok.07:12
pooliethe recent sync patch is to respond to ext4 and xfs caching very aggressively07:12
pooliewhich means if the machine crashes or powers off suddenly, a lot of data can be lost07:12
AuroraBorealisi thought that the caching time of ext4 was shortened for that reason hehe07:13
fullermdpoolie: Speaking of that, I wondered in passing how much of the added time in your test on that could come from it rooting around to find fdatasync || fsync || nothing on every call (as it looked to do)07:13
* fullermd has no idea at all of the expense ballpark on that.07:13
pooliefullermd: almost certainly nothing07:14
pooliethat's just one python object lookup07:14
poolieand this should only be hit about say 5 times in a bzr commit command07:14
poolieit's trivial compared to physically moving disk heads around07:14
pooliereasonable question though07:14
poolieif it was wrapping a very cheap operation and called very often it could be a probelm07:15
fullermdWell, you did your test on a memory filesystem, AIR.  So it occured to me.07:15
spivpoolie: Unless testing the flag accidentally triggered a fresh reload of the various potentially-relevant config files...07:16
fullermdThe time delta did look a little higher than I'd expect just for the extra jumping into the kernel.07:16
poolieactually that is more feasible07:16
spivpoolie: a bit like not opening the wt object in the test tear down (to check isolation) was apparently causing locations.conf to be re-parsed07:17
spivOr maybe I'm getting confused with Branch.open reading the stacked_on_location value07:18
spivWhich we also fixed to avoid looking at the whole config stack :)07:18
poolieyou are quite right this might cause more config work07:18
spivI think vila has some preliminary bits to count config file opens in the test suite07:19
pooliein the test suite on a tmpfs i would have thought that io would be pretty cheap too, though perhaps the cpu overhead is significant07:26
spivpoolie: I guess do a run with and without the patch and compare what 'time' says for user and system time?07:29
pooliethat should have been in there...07:29
fullermdGoing into the kernel to look at files is expensive, even if it's all in memory.  See that comment I made on the find_branches bug...  last week?07:29
spivOr use the new-fangled perf thingy that gives more numbers and less clarity ;)07:29
pooliewow, interesting07:30
poolieand, there is indeed a lot more userspace cpu time07:30
spivfullermd: I guess all that repeatedly resolving paths to dentries takes some work07:30
fullermdYeah.  Almsot 5 minutes longer, but only 9 more seconds system.07:30
spivpoolie: hmm07:30
spivpoolie: I would actually start to be suspicious of the config system at this point.07:31
poolielikewise07:31
pooliei might profile a single run of a commit07:31
spivpoolie: I suppose you could try hacking the points that test the flag to just be hard-coded True without looking at the config?07:31
poolieindeed07:31
fullermdWell, probably not dentries in this case of course   ;)07:31
fullermdBut going into the kernel and walking through the VFS isn't free, especially when you do it a crapload of times.07:31
pooliespiv, i'll try that07:32
jelmer'morning spiv, poolie, fullermd07:49
poolieistm that the tests probably want to by default just not have a file for the per-user or per-location config07:49
pooliewe know it won't have anything in it07:49
pooliehi jelmer07:49
* fullermd waves at jelmer.07:51
spivpoolie: and generally they don't07:54
pooliegenerally they won't care07:54
spivpoolie: yet apparently the cost of looking for them is noticeable07:55
poolieof course it does make an interesting benchmark in this case, but not a totally representative one07:55
poolieis anyone else seeing test_unicode_bzr_home failing on linux?07:55
jelmerjam: hi07:55
spivGrar, wireless dropping out.07:55
jamhi jelmer07:56
pooliehi jam07:56
poolieit looks like you touched this last in https://code.launchpad.net/~jameinel/bzr/2.3-unicode-home/+merge/4601507:56
spivAh, back.  I'll just assume a neighbour was using the microwave…07:56
pooliethe cosmic rays of our time08:02
jampoolie: that code is all done inside an "if win32" block08:05
poolietrue08:05
Riddellhappy Wednesday all08:06
pooliehello riddell08:06
poolieok, good night all08:46
spivpoolie: g'night08:48
jelmerhmm, is there a UDD meeting today?10:48
jelmerit has been two weeks since the last one but I don't see anything on the wiki10:49
pooliehi10:49
pooliei was expecting one10:49
exarkunWhat is the state of https://bugs.launchpad.net/bzr/+bug/427773 ?  It's not clear why it is "Confirmed" for "Bazaar" and "Fix Released" for 2.0.10:58
ubot5Ubuntu bug 427773 in Bazaar "empty limbo dirs cause error about left-over files" [Medium,Confirmed]10:58
poolieexarkun, vila's last message is not very helpful is it?10:59
poolieexarkun: are you hitting this bug, or something that looks like it?11:00
poolieif so, saying so on the bug would help11:00
exarkunI'm hitting it on a somewhat old version of bzr that will be a real pain to upgrade.11:00
jamjelmer, Riddell, poolie: Hey guys, Kareem just came home with a 41C fever. So I'll be out for the afternoon. At this point I have to figure out if I can still go on vacation...11:01
pooliesorry to hear that jam, i hope he gets better soon11:01
Riddellouch, good luck jam11:01
pooliethere seems to be a lot of it around11:01
exarkunHm, not that old though, 2.1.1.11:02
jampoolie: yeah, I didn't get nearly as bad of a fever. And the only childrens medicine they seem to have is a suppository, which he is not taking very well... :(11:03
jelmerjam: ouch :( good luck, I hope he gets better soon11:06
jamjelmer: do you just not have childrens liquid paracetamol ?11:08
jam(or motrin/ibuprofen )11:08
jelmerI dont think I have ever seen it.11:12
jelmerjam: I would expect a pharmacy to have it though, maybe not a drugstore11:13
jelmerjam:11:17
jelmerI am off again, back in a couple of hours11:21
jamjelmer: well, I went to the pharmacy and asked for something in liquid form, and this is what they gave me.11:23
jambut maybe if I try harder11:23
jelmerp11:27
spivjam: eek11:31
spivjam: hope he gets better quickly11:32
jelmerjam: they should be able to recommend something else in the pharmacy perhaps?11:35
jamjelmer: yeah, we see the doctor in 20 min, we'll certainly ask then11:39
jamspiv: your comment on: https://code.launchpad.net/~jameinel/bzr/2.4-launchpad-package-freshness-609187/+merge/6921811:39
jamit seems to be rendering like I wanted. Did you have something in mind?11:39
poolieriddell, jelmer, #ubuntu-meeting?12:02
jelmerI am not really here, on my cell12:04
poolienp12:06
spivjam: no, just that the ReST looks weird to me, but it must be a corner of the syntax I'm not familiar with.12:24
spiv(Or have forgotten)12:24
SeTTleRhi, how can i create such a shortcut like lp: for bzr, so that I do not have to write a full url everytime i want to create or delete a branch?13:17
fullermdTake a look at the bookmarks plugin.13:19
SeTTleRok, will do that. thx!13:20
jimisIs there a way to mark a branch as closed, so that I don't accidentally commit in the future?13:20
fullermd`chmod -R a-w .bzr`?   ;)13:21
fullermdNo explicit way.  I could probably dream up a few more horrific hacks that would pull it off...13:22
jimis:-)13:24
jimisthanks fullermd, I also found this has been asked before: https://answers.launchpad.net/bzr/+question/8072313:25
fullermdOoh, I think there's some way to put a plugin directly in a branch (so it only triggers on that).  So maybe you could make a plugin that hooks in pre-commit and puts on the brakes there.13:26
jimisit would be useful13:26
jmllooks like loom is broken in oneiric?15:42
jmlhttp://paste.ubuntu.com/653183/15:42
=== Mkaysi_ is now known as Mkaysi
=== beuno is now known as beuno-lunch
=== zyga is now known as zyga-afk
=== zyga-afk is now known as zyga
=== med_out is now known as medberry
=== yofel_ is now known as yofel
=== beuno-lunch is now known as beuno
peitschieyou around spiv?22:31
=== cinerama_ is now known as cinerama
pooliehi all23:49
poolie4rgbmjcn323:49
pooliewell, i won't be using _that_ one again23:50
poolie:)23:50
fullermdRed Gallumphing Bottles of Merely Juvenile Collected Nailpolish?  :p23:51
pooliehi fullermd23:53

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!