=== cpg|away is now known as cpg
=== cpg is now known as cpg|biab
=== cpg|biab is now known as cpg
popeymorning ubuntuoners09:37
duanedesignmorning popey10:02
duanedesignhello sir. Good weekend I hope10:19
ryeduanedesign, 012:02
ryeSo, I'm testing user designated folders. That means that you can get any folder in your /home and say "I want to have this in Ubuntu One". The syncdaemon supports this, the web ui does not support it at the moment.12:04
* rye checks what happens next ...12:04
popeyrye: does it share all folders below the one you choose or just the folder you select?12:11
ryepopey, all the hierarchy, I believe12:11
* popey would be interested in testing that12:11
kklimondais the gstreamer0.10-fluendo-mp3 package going to be moved to main now that the music store depends on it?12:12
ryepopey, this is also a pre-requisite to "publish the file" so that it is accessible via HTTP by everyone12:14
ryetesting that as well12:14
duanedesignrye: Is the pyinotify error followed by gibberish in syncdaemon.exception.log telling us anything?12:20
duanedesignEX: http://paste.ubuntu.com/386257/12:21
=== teknico is now known as teknico_away
ryeduanedesign, grab that and cat it12:22
rye2010-02-18 08:52:41,543 - pyinotify - ERROR - The path /home/damns/Ubuntu One/новая папка of this watch <Watch wd=2 mask=3064 auto_add=False proc_fun=None path=/home/damns/Ubuntu One/новая папка dir=True > must not be trusted anymore12:22
rye2010-02-18 21:19:57,259 - pyinotify - ERROR - The path /home/damns/Ubuntu One/новая папка-wrong-path of this watch <Watch wd=2 mask=3064 auto_add=False proc_fun=None path=/home/damns/Ubuntu One/новая папка-wrong-path dir=True > must not be trusted anymore12:22
ryeand this is where we need someone who knows what that means12:22
* rye summoned someone... waiting for someone to appear12:23
ryehttps://answers.edge.launchpad.net/ubuntuone-client/+question/102820 ? - Previously saved files have disappeared ?12:44
duanedesignrye: that reminds me. I wanted to ask about. https://answers.edge.launchpad.net/ubuntuone-client/+question/10260712:46
duanedesignwas unsure the correct answer on that one12:47
ryeduanedesign, yes, for now the answer - syncdaemon will panic and write No space left on device to the logs until it fills up the remaining space with the logs12:47
ryeduanedesign, that's why i linked the question to it12:59
=== teknico_away is now known as teknico
webm0nk3ypgraner ping13:35
pgranerwebm0nk3y: hello13:35
webm0nk3ypgraner, hi. you filed #528698?13:35
webm0nk3ybug #52869813:36
ubottuLaunchpad bug 528698 in ubuntuone-client "All files missing in the Cloud but directory entries are there." [High,New] https://launchpad.net/bugs/52869813:36
pgranerwebm0nk3y: yep13:36
webm0nk3ythere's mup13:36
webm0nk3ypgraner, need some more details13:36
pgranerwebm0nk3y: sure13:36
webm0nk3ypgraner, in the Web UI what does it show as far as storage space used?13:36
facundobatistapgraner, question: did you have two or three machines involved in the incident?13:37
webm0nk3ypgraner, can you tell you have our *complete* attention? :)13:38
pgranerwebm0nk3y: 251.2 KB Used (0.0%) today, on Friday it was 0 KB Used (0.0%)13:38
webm0nk3ypgraner, ok, so it sounds like it is syncing new files right?13:39
pgranerfacundobatista: There are 3 machines, I had two previously set up and running (zorak & desktop), I was trying to add a third on Fri (air)13:39
pgranerwebm0nk3y: nope I have killed the sync daemon from all my boxes13:39
facundobatistapgraner, you gave me logs about the first one and the laptop13:40
webm0nk3ypgraner, k13:40
facundobatistapgraner, I would need logs from the second machine to discard the client in the equation13:40
pgranerfacundobatista: I gave you the ones from desktop & air13:40
webm0nk3yfacundobatista, I'm going to setup a new machine and see if I have similar issues13:40
pgranerfacundobatista: ok standby13:40
facundobatistapgraner, thanks13:40
pgranerwebm0nk3y, facundobatista: bug updated with logs and info13:50
webm0nk3ypgraner, thank you13:50
facundobatistapgraner, thans!13:52
webm0nk3ypgraner, are you positive you logged in with the same account when you setup the new computer?14:30
pgranerwebm0nk3y: yep I only have *one* U1 account and its all done with openid14:31
pgranerwebm0nk3y: ie. I only have one openid account which is my canonical email addr14:31
webm0nk3ypgraner, did any local files on your other machines get deleted?14:32
pgranerwebm0nk3y: the only onces got deleted on desktop,  zorak was powered off (its my netbook) and when I brought it up I killed syncdaemon so it couldn't do any damage14:33
webm0nk3ypgraner, and I assume all files got deleted?14:33
webm0nk3ypgraner, in the bug report, you mentioned that directories showed up. Can you explain that a little more?14:34
pgranerwebm0nk3y: When I saw the notifier pop up and say it was syncing files and I new there were no changes, I looked on the local system and saw things going byebye, I killed the syncdaemon14:34
webm0nk3ypgraner, ok14:35
webm0nk3ypgraner, did you share your root folder with anyone?14:35
pgranerwebm0nk3y: When I went to add air (the 3rd machine) after adding the computer to U1, it took me to the web interface, thats when I noticed I had a directory hierarchy but no files in the dirs14:35
pgranerwebm0nk3y: Hell NO, this is my working canonical data14:36
webm0nk3ypgraner, ahh...14:36
webm0nk3ypgraner, when you got to https://one.ubuntu.com/account/machines/, which machines show up?14:46
pgranerComputerDate Added14:47
pgraner  air (tt3KVTmRwgM8qRXh5PhN) 26 Feb 201014:47
pgraner  desktop (0CbL4P0jkQRj0GzTjNSw) 17 Feb 201014:47
pgraner  zorak (9K4HbMNXxGfb6R70FLm5) 17 Feb 201014:47
webm0nk3ypgraner, thanks14:47
webm0nk3ypgraner, when you setup air, this was a new machine right? not an upgrade and not on a computer that had Ubuntu One on it?14:54
FNDaquarius: can I bug you for a minute? I understand the DesktopCouch database requires authentication - but it's not simple username/password, but fanc14:59
aquariusFND, yes14:59
FND*fancy stuff which isn't easy to reproduce independently? background is that I'm working on a "regular" CouchDB app but would wanna allow users to connect to DC, optionally15:00
FNDhas anyone done anything like this before?15:00
dobeyit's not that fancy15:00
FNDI remember seeing discussions about python-keyring and stuff, which might have scared me off15:01
aquariusFND, is your app Python?15:01
pgranerwebm0nk3y: yep new Lucid install15:01
aquariusFND, then the easiest thing to do is use desktopcouch.records.server. You don't have to use the records API, but desktopcouch.records.server takes care of providing roughly the python-couchdb interface and handling all teh oauth stuff for you.15:02
FNDah great - so I can do try: import desktopcouch.records.server except ImportError: import couchdb.server ?15:03
FNDso it will work on a headless server with python-couchdb, on Ubuntu desktop with DC15:04
Chipacabeuno: aquarius: rodrigo_: jblount: last call15:07
beunoChipaca, why not just ping us to start with?  :)15:07
Chipacabeuno: you should have MEETING BEGINS ping you :)15:07
beunoChipaca, good idea!15:08
* Chipaca rolls eyes15:08
beuno(typical manager delegating work)15:08
* Chipaca is but an egg15:08
teknicodelegating work to machines, isn't it all we do here?15:08
ChipacaDONE: lats of talk, little coding. Less than I would've liked on oauthdesktop.  TODO: *lots* more talk. Shove oauthdesktop off on somebody else if possible (bad manager, doing coding! bad!). Talk some more; if you're in desktop+ and haven't talked with me by EOBD, ping me.  BLOCKED: I refuse to be blocked  NEXT: CardinalFang15:08
CardinalFangI wish xchat groked alert lines.  Mine alerts on "meeting" OR "begins".  Quite a pain.15:09
teknico(well, in addition to silly talk)15:09
CardinalFangDONE: fixed up and merged find-pid branch.  Merged get-port program branch.  Merged docs change that elucidates put_record mutation of argument.  Lots of merging!15:09
CardinalFangTODO: Help kenvandine get d-c packaged.15:09
CardinalFangBLOCKED: None.15:09
CardinalFangnext, urbanape, winner of three gold medals!15:09
urbanapeDONE: Finished phones/ ajax branch, submitted for review.15:09
urbanapeTODO: Land it, start in on a new contacts/ branch.15:09
urbanapeTOTO: I bless the rains down in Africa!15:09
urbanapeBLOCK: None15:09
urbanapeteknico: europe15:09
teknicoDONE: reviewed and integrated another branch from beuno; looked into local sync problem15:09
teknicoTODO: finish fixing the local sync problem; removing the ME contact from the contacts web ui; showing the web desktop+ guys around our phone sync code15:09
teknicoBLOCK: none15:09
tekniconext: dobey15:09
teknicourbanape, I rope?15:09
dobey☺ DONE: Found/fixed bugs in StorageThrottlingFactory move, More CP button work15:09
dobey☹ TODO: Finish branch to add Connect to CP, Finish the rest of the CP work15:10
dobey☹ BLCK: None.15:10
dobeyvds: che l'italiano dici?15:10
vdsDONE: investigated on problems with web/phones/test_views, fixed funambol json connector, updated trunk to use new funambol_cared revno, investigated on zombie contact again but not had time to really focus on it15:10
vds TODO: re-land patch_13, continue the invetigating on contact zombies15:10
vdsBLOCKED: no15:10
vdsbeuno: please15:10
beunoDONE: Landed the better-phone-index branch, dupe detection and merging is about to land15:11
beunoTODO: Kill the me contact, fix the oopses related to it, figure out why I can no longer sync my phone on production15:11
beunoBLOCKED: No (finally!)15:11
beunoaquarius, bring it home15:11
aquariusDONE: numerous small music store things, like translatable names; phone meetings; apiservers rollout15:11
aquariusTODO: work with rodrigo on download progress; make library page links work; #oppdev talk15:11
aquariusBLOCKED: only got ten fingers15:11
aquariusrodrigo_, go for it15:11
rodrigo_• DONE: Vacation. Notes problems fixing. Music store downloads polling15:11
rodrigo_• TODO: Conflict resolver tool in pair tool. Make sandy's snowy test suite work with our server (http://git.gnome.org/cgit/snowy/tree/api/tests.py). Discuss with jdo and aquarius about oauth token per app, not per machine? Add jslint tests to check. & in note titles.15:11
rodrigo_• BLOCKED: no15:11
rodrigo_nobody next, right?15:12
CardinalFangaquarius, spacebar <= forehead15:12
aquariusCardinalFang, to quote the late great Eric Morecambe, the spaces between the notes might be the important thing, but you still need the notes15:12
dobeynotes do help pay the rent.15:14
jblountDONE: Some html and css stuff for the music store, trying to figure out a way to better handle the phone sync instructions15:14
jblountTODO: Phone sync instructions parsing and learning. Keep Lernid on in the background to learn how to be a better developer during "Opportunistic Developers" week.15:14
jblountBLOCKED: Never!15:14
dobeyvds: yeah, my italian sucks :)15:15
vdsdobey: nope! :)15:15
dobeythat was valid italian?15:16
ChipacaMEETING ENDS. Thanks everybody!15:16
teknicoaquarius, John Cage would disagree ;-)15:17
facundobatistapgraner, I may be looking to something strange...15:33
facundobatistapgraner, http://paste.ubuntu.com/386297/ and http://paste.ubuntu.com/386298/ seems to be equal15:33
facundobatistapgraner, do you have two equal logs in your disk?15:33
pgranerfacundobatista: they are not the same: look at http://paste.ubuntu.com/386362 that is the ls -al of the log directory, they are a few bytes difference15:38
pgranerfacundobatista: also it might be helpful if you guys put hostnames into the log files, it really gets confusing trying to figure out what log came from where15:40
facundobatistapgraner, they have similar sizes because they rotate per size15:42
facundobatistapgraner, the problem is that I don't have a relationship between your pastebin and the real log name15:43
pgranerfacundobatista: pastebin 386297 == syncdaemon.log.2010-02-23_08-50-33 & pastebin 386298 == syncdaemon.log.2010-02-23_11-12-1115:45
facundobatistapgraner, ok15:47
pgranerfacundobatista: they are easy to coordinate, I ran the following to get the pastebin entries: for file in sync*; do pastebinit -i $file -b http://paste.ubuntu.com; done15:49
pgranerfacundobatista: so if you look at the list in the bug they are in order with the zero length files removed15:50
facundobatistapgraner, the problem is that "sync*" is disk order, not alphabetical one15:50
CardinalFangkenvandine,  https://edge.launchpad.net/desktopcouch/trunk/0.6.215:51
CardinalFangkenvandine, new release of desktopcouch15:51
pgranerfacundobatista: nope they came out exact15:51
pgranerpgraner@zorak:~/.cache/ubuntuone/log$ for file in sync*; do echo $file; done15:51
pgranerfacundobatista: either way pastebinit returns the pastbin URL, just match them up throwing out the zero length file names and you'll have the proper matching15:52
facundobatistapgraner, thanks!15:52
facundobatistapgraner, question... I'm seeing strange stuff in these logs15:53
facundobatistapgraner, these files you once had in the server... when you uploaded them?15:53
facundobatistaFeb-23, or before?15:53
pgranerfacundobatista: before15:53
facundobatistapgraner, I'm looking into the files of your second machine, and they appear to be new in the disk15:54
pgranerfacundobatista: I had desktop & zorak on karmic and did an upgrade to lucid which broke syncing15:54
facundobatistapgraner, I mean, the sytem is finding all the files new in the disk, not having metadata at all for them15:54
pgranerfacundobatista: so I removed the two from ubuntu one15:54
facundobatistapgraner, how do you removed them?15:54
pgranerfacundobatista: deleted the Ubuntu One directory15:54
pgranerfacundobatista: readded the computer to U115:55
facundobatistapgraner, how do you deleted the Ubuntu One directory?15:55
pgranerfacundobatista: then synced, and it moved all the files from the server back down15:55
facundobatistapgraner, do you deleted the folder using nautilus? command line? other programs like mc?15:55
pgranerfacundobatista: I did a rm -rf "Ubuntu\ One"15:55
facundobatistapgraner, ok15:56
pgranerfacundobatista: and did the same process to the other computer15:56
pgranerfacundobatista: both were working fine for a few weeks15:56
pgranerfacundobatista: then on Fri I went to add air into the mix and noticed that files were missing off the server15:56
facundobatistapgraner, "rm -rf" generates a delete on each file, and that removes the files in the server15:57
pgranerfacundobatista: the files were still there for weeks after I did that15:57
pgranerfacundobatista: the U1 daemon was not running at the time nor was I on a network15:58
facundobatistapgraner, maybe because the client didn't have the opportunity to remove them from the server15:58
facundobatistapgraner, the daemon has stuff inside to know what you did while he was not running... he later found the deleted files, and removed everything15:58
pgranerfacundobatista: your missing the point after I did that on a clean Ubutnu One dir is synced all the files on the server back down to the client15:59
facundobatistapgraner, in which machine?15:59
pgranerfacundobatista: then why did it sync everything for weeks, even when I added new files, then one day wake up and decide to delete everything but leave only the directory structure?16:00
pgranerfacundobatista: on both16:00
facundobatistapgraner, we have a bug that is hitting us all of the time, and that I saw in your logs, that the client gets stuck16:01
facundobatistaso the deletion may have been latent16:01
facundobatistapgraner, then, something happened that restarted the daemon16:01
facundobatistapgraner, and the deletion was there (we call it 'trash'... those files that we tried or should have tried to delete but we couldn't)16:02
facundobatistaso, we got the trash, and removed all the files16:02
facundobatistapgraner, at the same time it found the stuff in disk, and tried to upload16:02
facundobatistapgraner, that surely created a mess and maybe because that we're seeing dirs and no files16:03
facundobatistapgraner, also, we prioritize metadata and not content, so makedirs may have got to the server first16:03
pgranerfacundobatista: strange I was syncing for weeks with no prob16:03
pgranerfacundobatista: I added lots of data and it was working fine16:04
facundobatistapgraner, regarding trash, I found 972 lines like:16:05
facundobatista2010-02-23 08:52:57,280 - ubuntuone.SyncDaemon.local_rescan - INFO - unlink from trash: share_id: ''   parent_id: '9cbead56-f9e9-41e6-bb56-bae9df502961'   node_id: '0bf10521-f6a1-4c01-9536-39c9b4d7a6ad'16:05
facundobatistathat's why I pointed to that...16:05
webm0nk3ylooks like the syncdaemon started up last tuesday then16:05
pgranerwebm0nk3y: startup? It should have been running, I used to be able to tell by the applet, but now its not there anymore16:06
pgranerwebm0nk3y: so your telling me one machine was not connected then magically started and whiped everything out?16:07
webm0nk3ypgraner, I meant on the machine where the files were deleted16:10
=== beuno is now known as beuno-lunch
pgranerwebm0nk3y: I did the same procedure on both computer exactly I deleted the U1 directory while offline, removed the computers from the U1 web interface, reauthorized them and they both synced with all the files that were on the server and worked for weeks16:24
pgranerwebm0nk3y: and I did the procedure one computer at a time and waited for the first computer to sync prior to doing the 2nd one16:24
facundobatistapgraner, in your second machine, the SD process started on 2010-02-23 08:50:33,253, and it had all those trash full, waiting16:27
pgranerfacundobatista: at this point I don't know, this should have been a simple. "I want to get rid of my local crap and give me whats on the server" operation16:30
facundobatistapgraner, mmm... I understand16:30
statikhi kenvandine, CardinalFang: I understand there are some desktopcouch bugfixes that need to get released and uploaded to lucid, and I'd like to help with that. where can I start?16:30
facundobatistapgraner, discard everything locally and start from scratch16:31
kenvandinestatik, last i looked, the fix branch was still pending review16:31
facundobatistapgraner, removing the files is not the way to achieve it16:31
kenvandinestatik, but i am quite anxious to get it into lucid16:31
kenvandineit makes gwibber suck way less :)16:31
facundobatistaChipaca, in your GUI plans, did you thought about having some way to trigger something like ^ ?16:31
CardinalFangkenvandine, statik, I think all is ready.  I closed the milestone and uploaded a source tarball an hour ago.16:32
kenvandinestatik, can you upload that?16:32
statikkenvandine: yessir I will get on it now16:32
statikCardinalFang, thanks16:32
* kenvandine loves statik having upload rights :)16:32
* Chipaca does too16:32
Chipacafacundobatista: something like what, sorry?16:33
kenvandineCardinalFang, thanks for getting that release done, it seems to really make gwibber start reliably16:33
Chipacafacundobatista: ah, the "just nuke everything, already"?16:33
CardinalFangkenvandine, my pleasure.16:33
facundobatistaChipaca, a "discard everything and sync back with what's in the server" button16:34
CardinalFangstatik, I want to help test the package before you upload.16:34
facundobatistaChipaca, maybe with a shorter name16:34
Chipacafacundobatista: sounds like something we could do for mutant mantis16:34
statikCardinalFang: ok, I'll upload to the hackers nightly PPA before putting it to lucid16:34
statikand talk with you about testing16:35
statiki need a 500GB SSD, I keep having to delete build trees16:35
* kenvandine could use one too16:35
Chipacastatik: easy, get 500GB of RAM, and just make a ramdisk16:36
* kenvandine chuckles16:36
statikthat is some ceo-level handwaving chipaca. careful or you'll get promoted16:36
* Chipaca rubs his hands gleefully16:37
jblountstatik: Do you have an extra drive bay?16:45
statikjblount: no, not even a cd drive.16:46
* statik hugs his tiny x200s16:47
* jblount is quietly contemplating losing his disc drive for a small ssd / big hd combo16:47
=== beuno-lunch is now known as beuno
pfibigerjblount: is it a hard mod?16:52
* jblount looks for the url16:52
jblountpfibiger: I don't think so16:52
pfibigerah, found it16:53
pfibigerlooks easy16:53
statikkenvandine, any particular gwibber bug that I should mention in this desktopcouch changelog?16:53
pfibiger$200 gets you the mounting hardware plus an external enclosure for the dvd drive you pull out16:53
pfibigerso $200 + $300 for the 80gb intel ssd.16:54
kenvandinestatik, one sec16:55
kenvandinestatik, 51944416:58
CardinalFangstatik, I put some notes in the release changelog, fwiw.17:05
duanedesignif someone has some corrupted metadata. The error they are getting 11087e34.... Would the directory structure be 1/10/87/11087e34...17:08
duanedesigni am used to seeing numbers like 617e34...which is easy ~/.local/share/ubuntuone/syncdaemon/vm/shares/6/1/7/617e24...17:11
statikCardinalFang: oh, thanks!17:12
statikCardinalFang: I'll use that instead of what i was writing up by looking at the commits. too bad uscan doesn't download that from launchpad, i had totally missed it17:14
ryeduanedesign, i don't think so... could you please give the bug number? I believe syncdaemon does only a/b/c/abc metadata partitioning (if this can be called this way)17:30
duanedesignrye: ok thank you...17:33
duanedesignbug 53009217:33
ubottuBug 530092 on http://launchpad.net/bugs/530092 is private17:33
ryeok, hacked a script for detection of blank notes, now need to make the fix17:37
ryeduanedesign, unmarked that as private since that report does not contain anything personally identifiable more than launchpad login could give17:37
duanedesignrye: so the key error is caused by blank notes?17:41
ryeduanedesign, the pickle loading seems to be related to fsm, which means that something has probably removed... file_shelf.py, _load_pickle raises KeyError if there is except (IOError, OSError)17:41
ryeduanedesign, no, that was unrelated to this bug report, we are going to provide the steps on how to fix blank notes17:41
duanedesignlol, ok17:41
ryeduanedesign, and I decided to create the script to make people with 10+ notes happy17:42
rwlyonsjrIs anyone having problems with the web interface of Ubuntu One?17:44
beunorwlyonsjr, more specifically?17:46
rwlyonsjrWhen I log into the web interface, I intermittently can not see any of my files17:46
rwlyonsjrI am also not able to sync my notes at all.... I saw the post on the blog that said they were switching things to read-only, but I can not see anything at all17:47
Technovikingwould the Ubuntu One note issue be affecting syncing with tomboy17:54
rwlyonsjrTechnoviking, I did not see anything in the post that would indicate that...they only said it would be read only17:55
ryerwlyonsjr, Technoviking, the notes are now in read-only on the web interface and Tomboy sync is failing due to a different issue that is now identified and being worked on17:56
ryerwlyonsjr, are you receiving a Something Wrong (500) page?17:56
rwlyonsjrrye, thanks! Any info on files not showing up at all on the web interface.... The problem is intermittent...17:57
ryerwlyonsjr, hm17:58
rwlyonsjrrye, when I log on to the web interface it shows I have no files at all, then I hit refresh and they came back.... another refresh and they were gone again... Just in and out like that, with no real pattern17:59
ryerwlyonsjr, confirming18:02
ryerwlyonsjr, no, wait, this is my testing account, it has 0 files18:02
rwlyonsjrrye, I just tried again... same results for me.... No files, I have not refreshed yet18:03
rwlyonsjrwith a refresh it comes back again.... Looking at the issue more, it may be that the "My Files" folder is not showing up on first log-in for me.... It goes to the "Shared with me Folder", with no other folders viewable...18:04
rwlyonsjrrye, were you able to duplicate the issue?18:13
ryerwlyonsjr, how many files do you have in ~/Ubuntu One ?18:14
rwlyonsjrrye, standby18:14
rwlyonsjrrye, about 50-75, some of them are in folders.... it is not a lot of data18:15
ryerwlyonsjr, ok, I think I know the reason and it has something to do with web interface aborting information loading when it takes more time than expected. Since for every file a new background request is created this may lead to the problems.18:16
ryedesktop+ guys, need info on why web interface would want to load every file info separately via separate XMLHttpRequest18:17
ryeeven firefox has a limit on concurrent connections to the server18:17
rwlyonsjrok..... is there something I can do to help?18:19
dobeyjblount, urbanape, beuno: ^^18:19
* beuno looks up18:20
beunowe need to re-work /files18:20
beunowe have a call on Wed to start planning that  :)18:21
urbanaperye: basically, historical reasons. That part of the code hasn't changed since first implemented, even though the layout (and a lot of the js accompanying it) has18:25
urbanapeand what beuno said.18:25
ryeurbanape, beuno, because that started to time-out for me in my IRC logs folder which has only 180 files.18:26
beunorye, can yuo test on edge as well?18:26
beunothere's some new code from jdo that makes listing faster18:27
urbanaperye: I'm not disputing it, just making excuses. *grin*18:27
ryethisfred, may I poke you about update_fields again, you told me that it is possible to use ['application_annotations','Tomboy','some-property'] as a key for update_fields. May I inquire about the syntax of update_fields in this case?18:37
ryebeuno, testing the edge18:37
ryerwlyonsjr, could you please check your files on https://edge.one.ubuntu.com as well ?18:38
rwlyonsjrrye, sure.... Standby18:38
ryebeuno, I like the compiz effect on non-responding window when I load my IRC logs... :)18:39
Technovikingrye: thanks18:40
rwlyonsjrrye, The problem persist there, however it does not happen as often at all.... Instead of every other refresh, I can refresh several times before my files vanish18:41
thisfredrye, can I get back to you on that? have to briefly go out to walk the dog now18:41
ryethisfred, say hello to the dog from me :)18:41
thisfredwill do bbiab18:41
ryehm, maybe python keys in dicts do not need to be scalars like in Perl?...18:41
ryenope... TypeError: unhashable type: 'list'18:43
ryeTechnoviking, the notes are now under heavy fixing. There are issues with WYSIWYG editing and saving as well as displaying the result of the save. Tomboy note sync is also affected by HTML to XML conversion and note blanking that has happened earlier and now we are putting up the solution for this.18:45
thisfredrye: keys can be composite, but have to be immutable types, so you can't have lists18:57
thisfredrye, but tuples work18:57
* rye went to find out what tuple means...18:58
Kandanalori hve a little question about storing and editing large files in the cloud18:59
thisfredrye, ('foo', 'bar', 'baz') rather than ['foo', 'bar', 'baz']18:59
thisfredso for that method:18:59
Kandanaloris only the part that i edited downloaded and uploaded or the whole file?18:59
thisfred    def update_fields(self, record_id, fields, cached_record=None):18:59
thisfredrye: fields could be of the form: {('application_annotations','Tomboy','some-property'): new_value}19:00
dobeyKandanalor: currently, the entire file is uploaded again19:01
ryethisfred,   File "/usr/lib/pymodules/python2.6/simplejson/encoder.py", line 260, in iterencode19:02
rye    return _iterencode(o, 0)19:02
ryeValueError: keys must be a string19:02
thisfredrye, you are using update_fields, correct? You can't set keys like this in a record directly19:03
rye   path = ('application_annotations', 'Tomboy', 'last-sync-revision')19:03
rye        self.notes_db.update_fields(self.uuid, \19:03
rye                { path: self.last_sync_revision + 1 })19:03
ryethisfred, ^19:03
thisfredrye, and you're using desktopcouch trunk?19:04
dobeyKandanalor: and it should only get uploaded again when you close the file19:05
=== teknico is now known as teknico_away
ryethisfred, i am using lucid lynx version, and I'd really want to have it working in karmic as well :)19:05
thisfredrye: it will only work if update_fields in server_base.py looks like this: http://friendpaste.com/3XtkfLWeUNaXHv1JE7qWva19:06
thisfredI am not sure whether that has been uploaded to lucid yet19:06
dobeyKandanalor: you don't need to /msg me19:07
Kandanalorso does anybody know when editing parts of a file without downloadig and reupping the whole file would be available?19:08
dobeyKandanalor: there's some ideas floating around about how to do diffs, but it only would resolve part of your issue19:08
Kandanaloryeah ok19:09
dobeyKandanalor: primarily, a large file, such as an encrypted fs would still only get diffed and synced after it was closed. we wouldn't want to sync arbitrary bits at random points while the file was open19:09
dobeythat could be bad19:09
Kandanaloryes I understand19:09
ryethisfred, no, my server_base.py does not look like this19:10
thisfredrye, ah, then it does not yet work like that... :(19:10
Kandanalorthink Ill have to think about this problem maybe I find a solution that works for me19:11
ryethisfred, i believe I will need to read all info from couchdb, then update fields and save that... hitting json exception on the way... probably...19:11
Kandanalorthen I just wanted to thank you for your work. I think you do a great thing to the community!19:11
Kandanalorso bye19:11
thisfredrye: if you just load the document, change the field, and save it, you won't get any json exceptions19:12
dobeyKandanalor: thanks19:12
thisfredrye: the only thing that can happen, that the update_fields method protects against somewhat, is a conflict, if something else has written to the same record in the meantime19:13
ryethisfred, but I am changing application annotations. isn't that special for couchdb?19:13
thisfredrye: not for couchdb, for desktopcouch it's special in that you have to access them like this: record.application_annotations['Tomboy']['some_field'] but under the hood, application annotations is just a regular json dictionary. We just want to hide it from people who don'19:14
thisfredt need it19:15
thisfredrye: i.e if you loop through all the fields of a record, application_annotations won't show up19:15
ryethisfred, awesome. put_record works with simple fetch doc, update doc, put doc19:16
ryenow I need to check whether that works in carmic19:17
thisfredrye: I think it will19:17
thisfredrye: though you should have a try: except: around the put, that can handle a resource conflict19:18
thisfreddepending on how bad it is to get an error sometimes19:19
BookmanCan .u1conflict files be deleted safely?19:27
duanedesignBookman: The way to resolve conflicts is to pick from the original file (if there is one) and the conflict file that you wish to keep and to delete the conflict file or move the conflict file over the original one, depending on your choice.19:33
ryerodrigo_, joshuahoover: http://paste.ubuntu.com/386500/19:38
ryerodrigo_, joshuahoover: tomboy needs to be shut down prior to executing this script. I am still learning python, so, probably it does not pass any pylint tests... hm, need to check that19:39
joshuahooverrye: nice work!19:40
ryewow, 7.13/1019:40
joshuahooverso tomboy needs to be shutdown...anything else?19:40
ryejoshuahoover, no, it will make sure desktopcouch is started properly, then it will find out the dir for tomboy within xdg directories, read all the notes that are there, load these notes from couchdb and check whether content is blank. If it is, then we bump the last-sync-revision in couchdb and try to act naturally.19:41
ryejoshuahoover, let me check this in karmic...19:41
ryeand it would be really nice if someone with python background had a look at that :)19:42
joshuahooverrye: ran fine in my one karmic env...i didn't have any notes that were blank previously19:42
ryejoshuahoover, now you have :-P :)19:42
ryeok, /me is back to being serious19:42
ryewow, it worked in karmic as well19:45
ryethis script does not check resource conflict since it does not expect anything to modify the notes between the read and save operation19:46
thisfredrye: for a script like this I think that's fine: if you get a conflict error, just run it again19:47
thisfreddepending on who the target audience is19:47
joshuahooverthisfred: we'd point users to run this who were affected by bug #52433919:48
ubottuLaunchpad bug 524339 in ubuntuone-servers "Tomboy notes are blank after sync" [Critical,Fix released] https://launchpad.net/bugs/52433919:48
thisfredjoshuahoover: right, in that case maybe mention that conflict errors could occur and aren't a real problem19:48
ryejoshuahoover, but we will still need to have a hope that the user has not compacted their database19:49
joshuahooverthisfred: and just run it again if you do get conflict errors?19:49
thisfredthey'd be rare enough that I don't think it warrants defensive coding against them in such a script19:49
joshuahooverthisfred: cool19:49
joshuahooverrye: but isn't that an issue either way? manual or using your script?19:49
ryejoshuahoover, true19:50
joshuahooverrye: so, i think this script is MUCH better than the manual steps, which are a huge hassle for most users, especially if there are a lot of notes needing fixed19:50
ryejoshuahoover, but if they have synced these blank notes to the couchdb then things start to get more complicated, we will need to dig through revisions and find those which are not blank. And I don't know how to browse through revisions in dc, only futon...19:51
joshuahooverrye: ah, true19:52
joshuahooverrye: so thoughts on how to best guide users through this?19:55
joshuahooverrye: seems like we could have them try your script first (least painful) and then if it doesn't we suggest...????19:56
wharpI'm following the quickly tutorial and it says that if the (desktop couch) page I'm redirected to doesn't work, I probably just need to clear the browser cache. I've tried that and its still not working, also tried in a different browser. What else could be wrong?20:00
joshuahooverwharp: what is the url of the page you're redirected to?20:03
joshuahooverwharp: and it comes up with an error?20:08
joshuahooverthisfred, rye: if the futon web interface doesn't come up, what do you do? does that mean couchdb isn't running?20:09
ryejoshuahoover, if this doesn't work we suggest go to futon and browse through revisions via 'Older revision' and then bump the version there20:09
thisfredjoshuahoover: what does it say? asking for a login?20:09
joshuahooverthisfred: trying to help wharp ^^20:10
wharppage not found20:10
wharpwhat/where is futon?20:11
ryejoshuahoover, if couchdb is running then futon is running, but it might not be running exactly on the port that is written in couchdb html file20:11
thisfredpage not found implies couchdb not running yes, unless you have done something to remap localhost, if that is even possible20:11
ryewharp, http://paste.ubuntu.com/386516/20:11
thisfredwharp: futon is couchdb's admin web interface20:11
joshuahooverrye: browse through revisions via 'Older revision'? not sure how to tell a user to do that without wading through (potentially) tons of documents20:12
wharpwell file:///home/wes/.local/share/desktop-couch/couchdb.html loads20:12
thisfredah, yes, the portnumber may be out of sync20:12
ryewharp, that script will launch firefox and connect to your desktopcouch instance, w/o couchdb.html file which may be out of date20:12
ryejoshuahoover, there is [ Showing revision 14 of 14 ] and [  ← Previous Version | Next Version →  ] links on every document that is in couchdb in futon20:13
ryethisfred, is it possible to browse through older revisions in desktopcouch?20:13
joshuahooverrye: ah, ok, i didn't see that before :)20:14
thisfredrye: no, I don't think so20:14
wharpah, that works, so I should just upset the couchdb.html with the correct port number?20:14
thisfredrye: I think if you have the exact revision number, you can still access them by that url, but that's sort of a back door20:15
ryethisfred, futon can :)20:15
thisfredrye, ok, if futon can do it, it's probably an intentional feature20:15
ryethisfred, ?revs_info=true20:15
thisfredI thought it was discouraged to rely on them20:15
thisfredrye ah ok20:16
ryeand "_revs_info":[{"rev":"18-e8f76906531ed01e37b51972e25a95f0","status":"available"} ... ]20:16
thisfredthat will work for regular http access as well then20:16
ryenot sure how to ask for that but that might be a nice to have feature in such cases...20:16
thisfredrye, it will only work as long as you don't compact though. After that, the revision numbers will be there, but not the actual revisions20:17
thisfredthat's probably what status available means20:17
joshuahooverthisfred: i can't remember, do we automatically compact the database for the user?20:18
thisfredrye, so if you do a regular http call into couch instead of through futon, the ?revs_info=true parameter will work. I'm not sure if we can do this through python20:18
thisfredjoshuahoover: AFAIK not yet20:19
joshuahooverthisfred: well, that's good in this case :)20:19
thisfredyep :)20:19
ryejoshuahoover, no, we don't compact, but some users (like me) like to press whatever buttons they find...20:19
thisfredanother argument against premature optimization ;)20:19
ryejoshuahoover, thisfred i believe there are plans to start compacting users database much like replication is being performed...20:20
joshuahooverrye: yes, i think that is correct20:21
thisfredrye: yes, and we definitely should, since we'll use up the entire hard drive if we don't20:21
ryethisfred, true... btw, is there any particular reason why gwibber started putting the messages to couchdb, not only configuration and accounts but messages20:22
ryeIt puzzled me while I was writing http://blog.rtg.in.ua/2010/02/ubuntu-one-internals-notes.html but I came up with nothing really useful20:23
thisfredrye: because they could, I guess ;) I think the messages make more sense to store in d-c than the configuration, myself: configuration should be in easy to reach places. Flat text files, preferably20:23
thisfredsince if stuff breaks, you don't want to have to learn how to use couchdb first20:23
thisfredBut I may be in the minority there. Doesn't mean the majority's right though ;)20:24
thisfredrye: desktopcouch is about storing structured data, and sharing it between computers (and, in the future, users) I think of twitter messages as data, more than I would application configuration20:26
thisfredof course it generates quite a bit of data and traffic, but I think that's good, we'll shake out some more bugs soon20:27
joshuahooverrye: ok, so i'm going to recommend people run your script first, if that doesn't work, then i'm going to give steps for going through the revisions (noting this will only work if the database has not been compacted)...for those steps, will the user find the revision with the content (versus the notes that are blank) and set the last-sync-revision to the maximum plus 1?20:40
ryejoshuahoover, let me try that....20:46
ryejoshuahoover, that won't work out of the box, the _rev will need to be updated as well20:48
joshuahooverrye: can that be set manually? (the _rev)20:48
ryejoshuahoover, hm, does not work... still resource conflict20:49
joshuahooverrye: just the _rev max + 1?20:49
joshuahooverrye: yeah, that's what i thought....then the user would probably be best to modify the content and increase the last-sync-revision to max + 1? i think that will up the _rev and take care of the last-sync-revision20:50
joshuahooverrye: this is a pretty horrible process for the user20:50
ryethe user will need to copy the last non-empty content to the latest revision and then my script will be able to bump the revision but this is too much work20:51
joshuahooverrye: yeah...hmmm...20:51
rodrigo_rye, wow, thanks for the script!21:12
ryerodrigo_, feel free to tell me what you think about the code itself :)21:13
CardinalFangAw, I got an email messaage, ""Comee back to Dropbox!!"21:48
beunoCardinalFang, ask them if they have integration with Ubuntu One21:49
rwlyonsjrI had to get off line earlier, but is there still a problem with the web interface displaying files every time?21:51
joshuahooverthisfred: do we limit couch syncing by using the "excluded_names" key in the ubuntu_one_pair_record doc within the management database?22:37
thisfredjoshuahoover: yes, that has the names of databases that should not be synced22:38
joshuahoovercool, kudos to duanedesign for providing that answer in our forums!22:39
joshuahooverthisfred: is that documented somewhere already?22:39
thisfredjoshuahoover: not sure, that's a question for CardinalFang/aquarius22:39
joshuahooverthisfred: ah, ok...i was creating an faq since this was the first i'd ever seen/heard about this22:40
thisfredyeah, my guess would be no22:40
CardinalFangjoshuahoover, It's not documented because it's not well supported or tested.  It's also not thought-out very well.22:41
joshuahooverCardinalFang: ah, ok :)22:41
CardinalFangWe provide no API for anyone to query or change it, and it is pairing-specific.22:42
aquariusanswers that question22:43
joshuahooveraquarius: great! thanks!22:44
aquariusCardinalFang, why would desktopcouch-service be pegging the CPU23:07
CardinalFangaquarius, Hrm, I don't know.23:08
CardinalFangaquarius, I'm afk for 30 minutes.  I'll be back to see if you say anything.23:09
aquariuswe think it's d-bus23:10
=== jamalta is now known as jamalta-afk
duanedesigni have two bug reports with similar erors. I am looking for any help to better understand the issue :) _ssl.c:326: error:0B084009:x509 certificate routines:X509_load_cert_crl_file:PEM lib23:13
duanedesignbug 52916823:13
ubottuLaunchpad bug 529168 in ubuntuone-client "ubuntu one x509 load error on start" [Undecided,New] https://launchpad.net/bugs/52916823:13
duanedesignbug 52228523:19
ubottuLaunchpad bug 522285 in ubuntuone-client "Authorization Error - [Errno socket error][Errno 185090050] ... nes:X509_load_cert_crl_file:system lib" [Undecided,Incomplete] https://launchpad.net/bugs/52228523:19
duanedesignwell, its family time. i leave my client open if anyone has any input. Have a nice evening all.23:29
duanedesignoh and aquarius i enjoyed your session today, good job.23:30

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!