/srv/irclogs.ubuntu.com/2010/11/24/#ubuntuone.txt

karnishane4ubuntu: you can do that in ubuntu preferences. right?00:00
karniok, then you're safe00:00
shane4ubuntukarni: I have all my files backed up, because u1 was eating my files randomly anyway.00:00
karniyou can remove your files from webUI or from a computer (or move them), that is still connected00:00
karniand let it sync up the meta (so they'll get removed from the cloud)00:00
karnishane4ubuntu: you will find scripts to remove your couchDB data from the cloud in the link from the topic00:01
shane4ubuntukarni: I still have to un-subscribe my folders on the laptop, so I don't want to touch the WebUI for a few days, I will clean that up later.00:01
karnishane4ubuntu: it's always good to make a backup, though, if you keep your contacts synced with couchDB or something. you know, so that you're safe00:01
karnishane4ubuntu: when you disconnect all the machines, you can clean up under webUI, plus to remove logs00:02
shane4ubuntuok, but basically I can sudo apt-get -purge remove ubuntuone00:02
karnishane4ubuntu: you'll find them under ~/.local/share/ubuntuone and desktop-couch00:02
shane4ubuntukarni: ok, thanks!00:02
karnishane4ubuntu: I think you could do that, yes00:02
karnishane4ubuntu: mind you, I'm giving those instructions for the first time00:02
karnishane4ubuntu: so the last thing I need is you loosing some data becase of me ;)00:02
shane4ubuntukarni: lol, I do have my files backed up, so not to worry too much.00:03
karniok shane00:03
karnishane4ubuntu: I hope you'll get back to U1 one day, when it's more rock solid and suits your needs00:03
shane4ubuntukarni: I will be back, I'm just pretty disappointed in some stuff, I filed bugs, and everyone is too busy with other Ubuntu stuff to be dedicated to u100:04
karnishane4ubuntu: it might be becase majority of the team was away for the last week, but I understand you.00:05
karnishane4ubuntu: I hope you're bugs will get fixed soon, anyway :) thanks for your support and input00:05
shane4ubuntukarni: I tried to help troubleshoot, but bug has been unattended for a while now, and I don't have time to mess with it if their isn't the interest in fixing it.00:05
karnishane4ubuntu: that's appreciated00:05
karnishane4ubuntu: i hope that'll change soon :)00:05
shane4ubuntukarni: I appreciate the help that you have given, and I know others have helped as well, and it was appreciated, just don't seem to be making headway.00:06
sircramhello, is there a UbuntuOne music streaming app for iphone?00:06
karnisircram: I'm pretty sure there is, but I might be wrong00:07
karniduanedesign: ↑00:07
karnibeuno: ↑00:07
sircramI didn't see one in the appstore, so I was worried00:08
=== nessita1 is now known as nessita
=== rodrigo__ is now known as rodrigo_
toroshi09:05
torosis something wrong with the u1 servers?09:07
duanedesigntoros: hello11:31
duanedesigntoros: still having an issue?11:31
torosduanedesign: I will check it11:48
duanedesignkk11:50
toros"WARNING - Connection lost: Connection to the other side was lost in a non-clean fashion." :(11:53
torosI'll try to restart the u1sdtool11:53
torosit is still rather slow...11:55
torosthe connection has been closed again :(11:59
torosby the way, I had the same issue at home yesterday evening12:00
toroswith a different u1 account12:00
hrwhi12:10
nessitatoros: hi there. Yesteday we were updating our servers, so the connections were dropped12:10
nessitatoros: today, can you check in your log file if you have something like this? "ubuntuone.SyncDaemon.ActionQueue - INFO - The request 'protocol_version' failed with the error: [('SSL routines', 'SSL23_READ', 'ssl handshake failure')] and was handled with the event: SYS_UNKNOWN_ERROR"12:11
nessitatoros: log file is located at ~/.cache/ubuntuone/log/syncdaemon.log12:11
toros2010-11-24 13:13:41,183 - ubuntuone.SyncDaemon.ActionQueue - INFO - The request 'protocol_version' finished OK.12:15
hrwany ideas with bug 558712/12:16
ubot4`Launchpad bug 558712 in ubuntuone-servers "N900 fails to PhoneSync with error 401 (affects: 6) (heat: 18)" [Wishlist,Triaged] https://launchpad.net/bugs/55871212:16
nessitabeuno: would you have a pointer for hrw?12:17
torosnessita: the syncdaemon starts syncing but after a while it drops the connection12:17
torosit uploaded 3 files (out of 12) in 25 minutes12:18
beunohrw, hi  :)12:18
beunothe N900 isn't supported12:18
toros(614 KB)12:18
hrwbeuno: is there something other then gnomebuntu/androind/windows supported then?12:19
nessitatoros: yes, we're currently debugging what is going on, we're getting similar disconnection ourselfves12:20
hrwbeuno: saying 'n900 is not supported' is cheap. looking why it got http 401 is hard?12:20
nessitaourselves*12:20
torosohh, ok. thank you!12:22
nessitatoros: thank you!12:22
nessitamandel or vds: would you be available for a review?12:23
beunohrw, right, so, phone sync is provided by a third party application (funambol)12:23
vdsnessita: sure12:23
beunohrw, we know it fails with N900's12:23
beunoit is a problem in the client implementation of syncml12:23
hrwbeuno: scheduleworld also uses funambol but it syncs with n90012:24
hrwwith same app12:24
beunohrw, right, we have escalated it to Funambol many times12:24
beunohrw, the problem is outside of our code12:24
nessitavds: Thanks!!! https://code.launchpad.net/~nataliabidart/ubuntu-sso-client/split-gui/+merge/4136912:24
beunohrw, and our main focus is android and iphone, so no work on our part is going to go into other OSes12:25
hrwok12:26
ryeFYI: A server-side issue has been discovered that causes the clients to disconnect after some period of time. We are working on diagnosing and fixing this issue at the moment.12:30
torosrye: can I share this information on identica/twitter?12:31
torosother people might be affected too... :)12:32
ryetoros, sending that message to !ubuntuone group @ identi.ca atm12:35
=== teknico is now known as teknico_away
torosrye: thank you!12:36
hrwbtw - how to get to ubuntuone filesystem from shell app?12:38
hrwsorry - found12:40
duanedesignu1sdtool ?12:41
Chipacatoros: rye: could you try to connect now and tell me how it goes?12:49
torosI restarted the syncdaemon... let's see how it works12:53
diverse_izzueHi all, honk, need help. I have a U1 installation which is messed up in that it hangs upon initialisation. we looked at that in the past together, but could not figure out what's going wrong. i'm about to leave for a longer trip and need u1 to work and do not have time for debugging. could i please have my account reset and start from scratch?12:55
ryeChipaca, 'checking client version',12:55
ryediverse_izzue, hangs upon initialization - during connection or when syncdaemon starts up?12:55
ryediverse_izzue, if the first one - we are now looking into this since that affects all the users12:55
diverse_izzuerye, it's not a very recent problem, we looked at that a month ago or so but then i gave up on it and left it disabled since12:56
diverse_izzuerye, if i remember correctly it failed to crawl some of the folders, just started the daemon, will see what happens12:57
diverse_izzuerye, where are the logs again?12:58
ryediverse_izzue, ~/.cache/ubuntuone/log/syncdaemon.log12:58
toros2010-11-24 13:57:45,182 - ubuntuone.SyncDaemon.ActionQueue - WARNING - Connection lost: Connection to the other side was lost in a non-clean fashion.12:58
toros2010-11-24 13:57:45,177 - ubuntuone.SyncDaemon.StorageClient - INFO - Connection lost, reason: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.12:58
hrwbtw - U1 music store is available only by banshee or are there other methods?13:05
diverse_izzuerye, so far it doesn't fail in the way it did earlier on, but disconnects very often, is that the issue you say you are investigating?13:10
ryediverse_izzue, exactly13:10
JamesTaithrw: Also from within Rythmbox13:10
hrwok, so not for me - kubuntu13:10
* JamesTait throws another 'h' in there.13:10
diverse_izzuerye, so basically this seems to be a bad point in time to try and figure out my other issue...13:13
alecuhi all13:17
nessitahi al13:19
nessitahi alecu*13:19
nessitaalecu: so, how can I help you?13:19
nessita(btw, you forgot to do the review yesterday?)13:19
alecunessita, oh, I forgot, yeah.13:20
nessitaalecu: no problem I chased someone else13:20
alecunessita, sorry.13:20
nessita:-)13:20
alecunessita, is it already done?13:20
nessitayes, thanks13:20
alecuok, great.13:20
alecuso, zeitgeist13:20
alecuI been looking at syncdaemon, and I'm trying to understand what would be the best place to log the events into zg13:21
alecunessita, ^13:21
nessitaaja13:21
alecunessita, so, it can be either at the time that SD events are sent to the event queue, or by subscribing to those events13:22
alecunessita, also, I'm trying to think of a good layering to have SD not depend much on zeitgeist13:22
nessitaalecu: what about:13:23
alecunessita, but my first idea would mean having one function per logged event, and that does not scale.13:23
alecuso...13:23
alecushall we mumble?13:23
nessitaalecu: having a new module (even installable in another package?) that defines the handle_EVENT_NAME?13:23
alecuright13:24
ryeChipaca, no, disconnecting as usual13:24
nessitaalecu: we can certainly use some python power to avoid programming several handle_bla13:24
alecunessita, what is the SD queue that was recently disabled because of performance issues?13:25
hrwhttp://marcin.juszkiewicz.com.pl/2010/11/24/ubuntu-one-good-or-bad/13:25
Chipacarye: right, we need to roll back to the previous version while we debug this. We're leaking memory all over the place for some strange reason.13:25
nessitaalecu: hum, I'm not aware of any queue being disabled13:25
nessitaalecu: I know content queue has an exponential growth in trunk syncdaemon13:26
alecunessita, hmmm... what about some events (perhaps dbus events) that were disabled?13:26
nessitabut is not disabled, afaik13:26
popeytwice today I have had "Temporary maintenance" page come up when i go to one.ubuntu.com/files - refreshing the page "fixes" it13:26
alecuoh, I heard some of that recently. perhaps verterok or facundobatista can shed some light?13:26
nessitaalecu: I don't know about that either :-) shall we ping them?13:26
nessitaalecu: maybe when they woke up? :-P13:27
alecunessita, right. they must still be in Disney Time.13:28
nessitalucky them13:28
alecunessita, so, a new module that listens for all (event/action?) queue events, and handle_SOMETHING them?13:28
nessitaalecu: the listen setup is only one, no need to list events of interest13:29
alecunessita, I assume that those events have the live syncdaemon objects passed into them, so we can fill up all zg fields.13:29
nessitaalecu: and yes, handle_FOO. No syncdaemon object attached, just a few parameters13:30
nessitaalecu: each event may have a particular set of parameters, you can find that listing in event.py13:30
JamesTaitpopey: Hi! We're having a spot of bother at the moment, see https://wiki.ubuntu.com/UbuntuOne/Status#Files13:30
nessitaalecu: ubunutone/syncdaemon/events.py13:30
aleculookin13:30
popeyah, ok13:30
nessitaalecu: sorry, event_queue.py13:31
* nessita realizes that module should be named events.py :-P13:31
alecufor instance: 'AQ_FILE_NEW_OK': ('volume_id', 'marker', 'new_id', 'new_generation')13:31
JamesTaitpopey: We are working hard to rectify it, although I don't currently have an ETA.13:31
nessitaalecu: yes13:33
alecunessita, let's say I'm handling that event, and sending a zg "File was created on the server, syncdaemon creating locally" event.13:34
alecunessita, zg needs the local path, and the current HD partition uuid.13:34
alecunessita, is there a way to get at that info?13:34
nessitaalecu: that we need to consult with chicharra team. But I wonder: can't we store custom info?13:35
nessitaalecu: I mean, why would we need the HD partition uuid?13:36
alecunessita, we can store custom info in zg events, but it would make no sense for the programs reading it.13:36
nessitaalecu: can be leave some fields empty?13:36
alecunessita, (the programs == "gnome-activity-journal")13:36
alecunessita, and the aggregation program thisfred will be working on.13:37
alecunessita, I wouldn't worry about the partition. I can get the partition if I can get at the local file uri.13:38
nessitaalecu: can we leave fields empty? since in the case of U1, every single file/folder would be located under home13:38
alecunessita, and that's a piece of info I think we *must* store.13:38
alecunessita, then I can query the partition at the start of syncdaemon and cache it for the rest of the sd life. Don't worry about the partition.13:39
alecunessita, let's worry about the filename13:39
nessitaalecu: the path can be retrieved, yes, by accessing filesystem_manager13:39
nessitaexample is located at: (looking)13:40
nessitaalecu: still looking :-)13:42
nessitaalecu: can't find the code right now but you can query volume_manager13:43
nessitaalecu: that module tracks the metadata for every node13:43
verteroknessita, alecu: hi13:44
verterokwhat are you looking for?13:44
nessitaverterok: we would need the path of file/folder when handling events13:44
verteroknessita: which events?13:44
nessitaverterok: and right now, the events pass the volume_id and node_id13:44
nessitaverterok: can we access the path somehow? I'm thinking that volume_manager has that info13:44
nessitaverterok: any event that involves a file/folder/share/etc13:45
verteroknessita: volume_manager only knows about volumes13:45
verteroknessita: what events?13:45
nessitaverterok: any event that involves a file/folder/share/etc13:45
hrwbye13:45
verteroknessita: event is a bit fuzzy, a FS_FILE_CLOSE_WRITE, SV_FILE_DELETED, dbus signal?13:46
nessitaverterok: we would track events for creation/deletion of files/folders both happening locally and remotly13:47
nessitaverterok: so, we'll use SV_ and AQ_ levels, I think13:47
verteroknessita: ok, but those are two different things13:47
=== teknico_away is now known as teknico
verteroknessita: we now get deltas for the changes on the server, a fire the SV_FILE|DIR events internally (sync.py)13:48
verteroknessita: what are the AQ events?13:48
verterok*levels13:48
nessitaverterok: we have no prior list right now13:48
nessitaalecu: or do we?13:49
alecuverterok, would you mind taking a look at the index on this spec? https://wiki.ubuntu.com/UbuntuOne/Specs/ZeitgeistIntegration/EventsSpec13:49
alecunessita, prior list? a list of prior events?13:49
nessitaalecu: I mean, a list of events from event_queue that we will be using13:49
alecunessita, not at all.13:49
nessitaright13:50
nessitaverterok: after a quick review, we would be interested in AQ_ and SV_ events13:51
verteroknessita: ok(?)13:51
nessitaverterok: I didn't understand what you've said about generations and fire13:51
verteroknessita: mn13:51
verterok*nm13:51
nessitaverterok: ideally, we would be defining new handle_BLA for the events we care about13:51
verteroknessita: a new subscriber with handle_EVENT_NAME13:51
dobeyverterok: that stable-1-4 branch is just having the same build issue as trunk was, on narwhal.13:52
verterokdobey: k, thanks13:52
dobeyverterok: and why did you resubmit the trunk branch; it was not necessary to do so13:52
verterokdobey: it was complaining about needing another review :/13:52
verteroktarmac ^13:52
nessitadobey: FYI, verterok reported bug #680719 and I assigned to you13:52
ubot4`Launchpad bug 680719 in ubuntuone-client "landing branches for stable-1-4 is broken! (affects: 1) (heat: 6)" [Critical,Confirmed] https://launchpad.net/bugs/68071913:52
verteroknessita: please please, don't mix this thingy into a EQ existing subscriber :)13:53
nessitaverterok: what?13:53
nessitaverterok: we would be building a new module, that subscribes a new listener13:53
alecuverterok, you mean creating a separate subscriber, right?13:53
verterokyes13:53
dobeyverterok: yes because you set it to approved before launchpad rescanned, so it tried to merge the old revision13:53
verterokI'ld like to be able to completely turn it off, with a config option13:53
verterokdobey: ahh, ok13:54
nessitaverterok: ideally, we won't be editing existing code13:54
alecuverterok, yes. And we would shut that off it zg is not installed or if you have turned it off with an option.13:54
verterokalecu: :)13:54
verteroknessita: *ideally*13:54
verterok:)13:54
dobeyok, brb; must install a pci sound card13:55
nessitadobey: we have stand up in 513:55
alecuverterok, so, I heard about some events that were recently disabled for performance reasons.13:55
nessita(just FYI)13:55
alecuverterok, were those just dbus events?13:55
dobeynessita: standup or mumble?13:55
nessitadobey: I didn't get any invite13:55
verterokalecu: no, dbus_interface doesn't send events, it handle events and send signals :)13:56
alecuverterok, oh, right.13:56
nessitawhich makes me remember that Chipaca said he would be re-setting the weekly call13:56
verterokalecu: just to make it clear, let's name dbus stuff signals ;)13:56
dobeynessita: i thought we agreed last week to do the mumble meeting today this week, and thursday from now on13:56
verterokalecu: and the internal events: just events13:56
nessitadobey: we didn't set a time for today13:56
alecuverterok, so, I heard about some *signals* that were recently disabled for performance reasons.13:56
dobeynessita: but if it's not mumble then i will wait to fix my sound13:56
dobeyirc i can do13:56
nessitadobey: let's have the standup in 4 minutes and schedule the weekly call13:56
verterokalecu: I'm not aware of such thing13:56
nessitadobey: thanks13:56
verterokalecu: we disabled sending a dbus signal for each internal event a long time ago13:57
nessitaalecu: me neither. You heard from who?13:57
verterokalecu: because it's really slow13:57
alecuverterok, oh, it must be that.13:57
* dobey tries to figure out what all he did yesterday13:58
alecuverterok, but it's only on the dbus level that was disabled, right?13:58
verterokalecu: dbus_interface.py line 52013:58
verterokalecu: yes13:58
dobeygrrrrrrrrrr14:01
nessitame14:03
nessitaalecu, CardinalFang, thisfred, mandel, dobey, Chipaca: stand up?14:03
nessitavds: ?14:03
mandelme14:03
vdsme14:03
alecunessita, didn't see your "me"14:03
alecume14:03
CardinalFangme14:03
alecuoh, just did.14:03
thisfredme14:03
verterokalecu: there isn't an event for conflicts14:04
dobeynessita: please do not circumvent tarmac like that again.14:04
nessitadobey: I didn't, I ran tarmac locally14:04
dobeyyes, you did14:04
nessitaDONE: branches for bug #627496 and bug #677518, destopcouch reviews14:05
nessitaTODO: build new package of ussoc, try to land natty package for u1cp, help alecu with zg14:05
nessitaBLOCKED: nopes14:05
nessitaNEXT: mandel14:05
nessitaNOTES: tomorrow and Friday I'm not coming14:05
dobeyyou ran it locally because the one configured to land branches did not go exactly according to your desire.14:05
ubot4`Launchpad bug 627496 in ubuntu-sso-client (Ubuntu) (and 1 other project) "Registration screen looks cramped when big fonts selected (affects: 2) (dups: 1) (heat: 51)" [High,Triaged] https://launchpad.net/bugs/62749614:05
ubot4`Launchpad bug 677518 in ubuntu-sso-client (Ubuntu) (and 1 other project) "Split gui code to allow other implentations (affects: 1) (heat: 817)" [High,Triaged] https://launchpad.net/bugs/67751814:05
dobeyregardless of how you did it, you did it.14:05
mandelDONE: add kwalet support, worked on windows code fr desktopcouch14:05
mandelTODO: file bugs regarding the above mentioned code (sorry)14:06
mandelBLOCKED no14:06
* mandel looks at vds14:06
dobeymeh14:06
vdsDONE:  fixed the patch of python-couchdb to port the oauth session from DC to python-couchdb, code review, installing natty14:06
vdsTODO: land the branch for #675551, do some more porting to python-couchdb14:06
vdsBLOCKED: not at all14:06
vdsalecu: please14:06
alecuDONE: discussed on #zeitgeist bug #676090. Started working on bug #674252, a branch for review: https://code.launchpad.net/~alecu/ubuntuone-client/add-simple-zeitgeist/+merge/4166714:06
alecuTODO: more discussion on the above two bugs, on #ubuntuone and on #zeitgeist14:06
alecuBLOCKED: no14:06
alecuCardinalfang: the last to jump gets to code in C++... Geronimooooo!!!!14:06
CardinalFangDONE: Bug #680929.  Poked at zeitgeist to see how hard it would be to add to d-c14:06
CardinalFang now; decided against for now.  Got python-couchdb packaged and pushed to PPA; n14:06
CardinalFangot built yet.14:06
CardinalFangTODO: Merges.  Half day.  Remainder this weekend, packaging.14:06
CardinalFangBLOCKED: No14:06
ubot4`Launchpad bug 676090 in ubuntuone-client (Ubuntu) (and 1 other project) "Define the U1 Zeigeist ontology types for all events (affects: 1) (heat: 8)" [Undecided,In progress] https://launchpad.net/bugs/67609014:06
ubot4`Launchpad bug 674252 in ubuntuone-client (Ubuntu) (and 1 other project) "Syncdaemon needs to store events into zeitgeist (affects: 1) (heat: 8)" [High,In progress] https://launchpad.net/bugs/67425214:06
ubot4`Launchpad bug 680929 in desktopcouch "some tests run against personal couchdb (affects: 1) (heat: 6)" [Medium,In progress] https://launchpad.net/bugs/68092914:06
thisfredDONE: Stage #2 of bug 510159 TODO: wrap that up and start on the debian package split, and fix last small issues BLOCKED: no14:06
ubot4`Launchpad bug 510159 in desktopcouch (Ubuntu) (and 1 other project) "Split desktopcouch in two: a records library that can be used on the server and a desktop application/library (affects: 1) (heat: 8)" [Medium,In progress] https://launchpad.net/bugs/51015914:06
thisfred1 sec brb14:07
dobeyλ DONE: banshee backports (lucid), fixed 680501, 680593, 68055314:07
dobeyλ TODO: nightlies, banshee store tests, more releases14:07
dobeyλ BLCK: None.14:07
thisfredre14:07
nessitawe need to set a time for the weekly call that would take place today14:07
nessitais one hour from now ok with everyone?14:08
mandelnessita, kind of bad for me14:08
mandelnessita, I need to have lunch14:08
nessitamandel: oh gosh, you may be starving14:08
nessitamandel: how long would you need?14:09
dobeyat least spamassassin recognizes all google meeting invites as spam14:09
mandelnessita, not too much, 4:30 would be nicer :)14:09
dobeyhe's spanish, so he needs like 4 hours for lunch, you know14:09
alecumandel, that's 1:20h from now, right?14:10
nessitamandel: 4:30 UTC?14:10
mandelnessita, yes14:10
nessitaChipaca: is that time good for you? ^14:10
nessitawhat about the rest of the crowd?14:10
alecumandel, that's not 1:20h from now!14:10
mandelnessita, if not, I can wait, no worries, dobey the spanish things is to have lunch late14:11
mandelok, no big deal, we can have it in an hour14:11
dobeymandel: yes, and siesta after :)14:11
alecuit's 14:11 gmt now, right?14:11
nessitamandel: 1:30 from now you meant? or 4:30 UTC? :-)14:11
mandelya me liado!14:11
alecudobey, hahaha14:11
mandelok, we do it when you said, I do not care about lunch or anything14:12
dobeywhen the planets are aligned in full eclipse14:12
dobeyis a good time for me14:12
nessitamandel: 2 hours from  now?14:12
nessitaand that's my final offer :-P14:12
mandelnessita, cuando quieras14:13
nessitaactually, 1:45 from now14:13
mandelI'll adapt14:13
mandelok14:13
nessitathat being 4pm UTC14:13
mandelnessita, so 5 CET14:13
mandelor something like that14:13
nessitaalecu, CardinalFang, dobey, thisfred, vds, Chipaca: weekly call at 4pm UTC?14:13
alecunessita, +114:14
vdsnessita: sure14:14
Chipaca+114:14
CardinalFangokay.14:14
thisfrednessita: +1, that's in 1h~45m right?14:16
nessitaChipaca: is there someone else having access to the "official" tarmac? we need someone else being able to access it if dobey is not around14:17
dobeywhat the hell does that mean?14:18
dobeyit's a cron job14:18
nessitadobey: today tarmac wasn't landing a branch becasue it wasn't happy with the approvers (not sure why). I'm asking who else can debug this issue (or issues like this) when you're not around14:19
nessitaalecu: question re your branch: with ubuntuone/syncdaemon/zeitgeist_log.py is a module inside syncdaemon?14:19
dobeyyou didn't ask ANYONE to debug the issue; and didrocks is not a member of ubuntuone-hackers, so launchpad sees his review as one from community.14:20
nessitaalecu: shouldn't that be outside syncdaemon, at the same (project) level?14:20
nessitadobey: as far as I know you're the only one with access to tarmac, and I knew it was way too early for you. Could anyone else helped me?14:21
alecunessita, yes, it makes more sense for it to go outside syncdaemon. fixin it14:21
nessitaalecu: thanks14:21
dobeynessita: #tarmac perhaps. or you could have waited the hour or so for me to come on-line.14:22
alecunessita, you are proposing to move it as ubuntuone.zeitgeist_log.py, right?14:23
nessitadobey: my point exactly. I think we need more than person being able to access tarmac.14:23
dobeynessita: and i don't even have "access" to all of the things being handled by tarmac14:23
nessitathan one* person14:23
dobeynessita: the stuff in the DC is not directly accessible by me14:24
dobeyit requires an admin14:24
nessitaalecu: I was thinking on a separated module14:24
nessitaalecu: like ubuntuone/zeitgeist/14:24
dobeynessita: really, nobody should need to access tarmac. there is nothing with either of those two ussoc branches that having access to the machine running tarmac would have helped you to answer14:24
nessitadobey: so, for example, when we need to tweak a requirement like not every approver must be a u1hackers or similar, how do you usually fix that?14:25
dobeybut circumventing the policies we're trying to enforce with tarmac, by simply running it yourself without the configuration, is not the correct course of action for any problem14:25
nessitadobey: can you please answer my question?14:26
dobeynessita: that requirement is not specifiyable in the tarmac config14:26
nessitadobey: where is specifiable?14:26
dobeyyou can not say "oh this one person is ok to review"14:26
nessitadobey: where is specifiable?14:26
dobeynessita: the isPersonValidReviewer() call on the Launchpad API's branch object for the target branch, is what determines if the review is valid for counting14:27
nessitadobey: why didrocks wasn't a valid person reviewer?14:27
dobeynessita: because he is not a member of the review team or branch owner (or team).14:27
nessitadobey: how can we solve this in the future?14:28
didrocks(well, I reviewed more the functionnality than the integration in the code as I'll need it in the future)14:28
dobeynessita: you will need to more specifically describe the exact issue.14:28
dobeynessita: you could have gotten another u1-hackers person to review and approve it14:29
nessitadobey: I could, yes. I didn't see the point or gain on that14:29
dobeynessita: well it is our team's policy14:30
nessitadobey: it is? I wasn't aware of that14:30
dobeytwo reviews from team members, yes14:30
dobeythe point is to cross-polinate knowledge of different parts of our code, across our whole team14:30
nessitadobey: ok then. I have another question: the other day you said "I'll disable this new plugin so your branch can land". How do you accomplish that?14:31
dobeynessita: the plug-in in question is only used if a certain option is available, and i disabled that option. but i was trying to get that plug-in working for us at the time, because it is a valuable plug-in to have, and i was actively working on making it work. that is a different plug-in, and we have been using the review count policy for quite some time now14:33
nessitadobey: where can the option be disabled? is a config file? where that config file is located at?14:33
nessitaI just want to understand the picture14:33
dobeyyes it's a config file. and obvioiusly it is located on the machine where tarmac is running14:34
dobeygranted, we actually have two separate instances of tarmac running currently.14:34
dobeyone in DC, and one I'm maintaining due to the interdependent nature of some of our projects.14:34
alecunessita, so verterok tells me that files and directory events are not mapped easily from SD to ZG14:35
alecuverterok, let's try to focus on one event, so we can understand the rest.14:36
nessitaalecu: I may be outdated... why not? I see we have AQ_FILE_NEW_OK, AQ_DIR_NEW_OK\14:36
verterokalecu: not  mapped to dbus14:37
alecunessita, verterok says we can easily look at dbus_interface for shares and UDFs... and not so easily for the rest.14:37
alecuverterok, so, let's focus on "File was created locally, syncdaemon creating on the server"14:38
verterokalecu: right, so. AQ_[FILE|DIR]_NEW_OK14:38
verterokalecu: that means the file/dir was created on the server14:38
alecuverterok, ok, it means it was succesfully created on the server. cool.14:38
dobeyok, must get sound working again. brb14:38
nessitaalecu: I think that maybe you're mixing DBus events with raw SD events14:39
alecunessita, no, I'm not.14:39
nessitaalecu: ok, so at bus level we have no notif of files and folders events, but at SD level we do have14:40
nessitabut maybe the params are not exactly ideal14:40
alecunessita, verterok says we should look on dbus_interface.py to see what raw SD events generate the udf/shares dbus events. And use those for our udf/shares mapping.14:41
alecunessita, so we are now mapping files and directorys SD events to zg14:41
verterokalecu, nessita: AQ_[DOWNLOAD|UPLOAD]_FINISHED -> down/upload ok14:42
alecuverterok, so, from the list you think that "File synchronization conflict" is the one that's not propagated, right?14:42
verterokalecu: no, we don't even have an event for that14:42
verterokalecu: one that might be interesting is FS_INVALID_NAME14:43
verterokanother one is SYS_BROKEN_NODE14:43
verteroknessita: ^14:43
nessitaverterok: what is a SYS_BROKEN_NODE?14:44
verteroknessita: it's from generations, when SD can't apply a delta on a node14:44
verteroknessita: that's also loggin in the broken-nodes log file14:44
nessitaverterok: and how's that relevant to end users? i mean, if I'm a user, what that means? I lost the node? it will no longer synched?14:45
nessitait was fixed?14:45
verteroknessita: it will not be synced, we have a problem with that node that we can recover from14:45
verteroknessita: the next delta might apply ok, but we don't know14:46
verterok...at the time we find it's broken14:46
verteroknessita, alecu: for AQ_[FILE|DIR]_NEW_OK and AQ_[DOWNLOAD|UPLOAD]_FINISHED, that have a (share_id, node_id) you can use "fsm.get_by_node_id(share_id, node_id).path" to get the path14:46
alecuverterok, I think we won't be storing recoverable errors, but only definite errors.14:46
alecuverterok, cool.14:47
alecuverterok, and regarding those two sets of events...14:47
alecuverterok, when *_NEW_OK is sent, does it mean that the file was created on the server but with no content yet?14:47
verterokalecu: yes14:48
alecuverterok, that's a bit different of the way I was planning.14:48
verterokalecu: so, just listen to AQ_UPLOAD_FINISHED :)14:49
alecuverterok, ideally I would like to send the "syncdaemon creating on the server" event when the file is completely uplodaded.14:49
dobeyyay sound14:49
alecuverterok, I will need to listen to both!14:49
verterokalecu: not only that, there are cases when you will not know if the file was just created or it was updated14:49
alecuverterok, why?14:50
verterokalecu: e.g: the client creates a file: AQ_FILE_NEW_OK, starts uploading14:50
verterokalecu: the client dies/quit/whatever14:50
alecuright, I see.14:50
verterokalecu: the client start again, you only get the AQ_DOWNLOAD_FINISHED :)14:50
nessitaalecu, verterok: one thing. Listening to only one signal (the DOWNLOAD) can make the user think that nothig is happening14:51
nessitanothing*14:51
nessitabecasue between the file was created and the upload actually finished, can pass a lot of time14:51
verteroknessita: we have upload progress indicator signals14:52
verteroknessita: and events :p14:52
verterokwe send those events via dbus14:52
verterokas signals14:52
verterokhehe14:52
verterokAQ_UPLOAD_FILE_PROGRESS14:52
nessitaverterok: what's the event name?14:52
nessitaah!14:52
alecubut we won't be storing in-progress events in zg14:52
alecuand a "empty file created on server, but no contents there yet" is an in-progress event.14:53
nessitaalecu: right, but we may need to store the NEW_OK and the DOWNLOAD_FINISHED14:53
nessitahum14:53
nessitaI disagree a bit, but I understand your point14:54
alecunessita, it's useless for the user to know that a bit of space was allocated on the server. :-)14:54
verterokalecu: no, isn't in progress. the file was created14:54
verterok:)14:54
nessitaalecu: and I think it was allocated with all the needed space14:54
verterokalecu: all this might (or not) change in the following weeks/months14:54
alecuverterok, the user wants to know when the contents of the file are finally on the cloud.14:54
nessitaverterok: is that fruit or true? ^14:54
alecujajajaj14:55
verteroknessita: which fruit? manzana?14:55
verteroknessita: we don't allocate space14:55
alecuany vegetable!14:55
verteroknessita: a file with no content uses 0 bytes of quota14:55
alecu(cualquier verdura?)14:55
nessitaalecu: I agree. But the user also needs to know that the file is being synched. I also think we can leave this for later in the cycle, that meaning: let's handle DOWNLOAD_FINISHED for now14:55
nessita:-)14:56
alecuThe user just cares about his thesis being on the cloud so he can finally close that damn laptop.14:56
verteroklet's ask a user? :)14:56
alecu:-)14:56
nessitaalecu: that's completely acceptable for now14:56
nessitaalecu: so, 'AQ_DOWNLOAD_FINISHED': ('share_id', 'node_id', 'server_hash'), and with what verterok said fsm.get_by_node_id(share_id, node_id).path we get the path14:58
alecunessita, right. But the only zg event we can send with that is MODIFY_EVENT14:58
nessitaalecu: why?14:58
alecuwe have to track two events in order to send the CREATE_EVENT14:59
alecu"track two SD events"14:59
alecuand even then, we are not sure if SD disconnected...14:59
nessitaalecu: why DOWNLOAD_FINISHED info is only enough for a modify event?14:59
alecunessita, let's look again at "File was created locally, syncdaemon creating on the server"15:00
alecunessita, how should we report that?15:00
nessitaalecu: report where? you mean how shall we store that in zg?15:00
alecuyes, "report" as in store it in zg.15:01
nessitaalecu: I have no ZG foo to answer that other than the wikipage15:01
nessitaalecu: you tell me what info do you need and I'll try to provide it15:02
alecuhmm15:02
nessitaalecu: we have path, and the HD uuid you said it was calculatable\15:02
aleculet's say a AQ_DOWNLOAD_FINISHED arrives15:02
nessitayes15:03
alecuhow do we know if we need to store a CREATE_EVENT or a MODIFY_EVENT ?15:03
nessitaah, I see your point15:03
alecuwe need to save (in a python dict, perhaps) all pending  AQ_FILE_NEW_OK15:03
alecuand check for each AQ_DOWNLOAD_FINISHED if a pending AQ_FILE_NEW_OK was there15:04
alecuso:15:04
alecuwe need more code that I would have liked15:04
nessitaalecu: you were expecting a single event?15:04
alecunessita, ideally yes :-)15:05
alecunessita, but it's not so complex *yet*.15:05
nessitaalecu: hoepfully for the rest of the events we'll get luckier15:05
nessitaalecu: are you taking notes somewhere? can I contribute? googledoc maybe?15:05
alecunessita, let's googledoc, right!15:07
alecucreating.15:07
verterokalecu, nessita: we could add an extra arg to the event to signal if it's the "first" upload or just an update :)15:08
verterokit's a hack, but it might work :p15:09
nessitaverterok: how wasy is to do that?15:09
verterokin AQ, we could check if the previous server_hash is != ""15:09
=== JamesTait is now known as JamesTait_school
* nessita browses code15:10
verterokactually if it's not bool(previous_server_hash)15:10
verterokdoor bell, bbiab15:10
nessitaverterok: this would be DownloadFinishedNanny ?15:12
alecunessita, seems like the nanny, yes.15:18
nessitaalecu: I'm just seeing that we may not need new code there. The server_hash is sent in the event15:19
nessitaalecu, verterok: what if we check the server_hash in our zg logger?15:19
alecunessita, right! the nanny is for the download file dance15:20
nessitayes15:20
alecunessita,  'AQ_UPLOAD_FINISHED': ('share_id', 'node_id', 'hash', 'new_generation'),15:20
nessitahum15:20
alecunessita, perhaps we can look at the "generation" number?15:20
nessitaalecu: perhaps. verterok. can we? (we need to confirm semantics)15:21
verteroknessita: the generation num is sent by the server15:23
verteroknessita: how do you will know something about the gen num?15:23
nessitaverterok: can that indicates if the file/folder is new or not?15:23
alecuverterok, does it start at 0 for each server?15:23
verteroknessita: not at all15:23
alecuverterok, does it start at 0 for each file?15:23
verterokalecu: nope15:23
nessitaverterok: so, with AQ_DOWNLOAD_FINISHED, can we check the server_hash in out own listener to decide if it's new or not?15:25
nessitaverterok: ping?15:30
alecunessita, look at signal_event_with_hash in sync.py15:30
alecunessita, def build_hash_eq(...)15:31
alecuit seems to be using a two letter code, made up from the first letters of "True" and "False"15:32
nessitaalecu: that's for the spreadsheet, not sure of that's being sent in this event? I'll try a IRL event15:33
=== kbn_ is now known as kbn
nessitaalecu: I'm getting:15:37
nessita2010-11-24 12:37:16,528 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: AQ_DOWNLOAD_STARTED, args:(), kw:{'share_id': '', 'node_id': 'f324de5b-259c-43d9-96ff-394cc8aacc44', 'server_hash': 'sha1:c00a437101275f3aa9b762643dc84e584a521972'}15:37
nessita(file created on server being synched locally)15:37
alecunice15:37
nessita2010-11-24 12:37:36,567 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: AQ_DOWNLOAD_FINISHED, args:('', 'f324de5b-259c-43d9-96ff-394cc8aacc44', 'sha1:c00a437101275f3aa9b762643dc84e584a521972'), kw:{}15:37
nessitathe server hash is not empty15:38
alecunessita, what about uploads?15:38
nessitalet's try the other way around15:38
verteroknessita: no, to check the hash you need to do it in AQ15:38
nessitaverterok: that's becasue AQ sets the new server hash?15:39
verteroknessita: no, because AQ has the hash15:39
nessitaverterok: so, you're saying that the server hash sent in the event is not the server hash? :-)15:40
verteroknessita: it's the new hash15:41
nessitaalecu: 2010-11-24 12:41:01,206 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: AQ_UPLOAD_STARTED, args:(), kw:{'share_id': '', 'hash': 'sha1:7287a592845c932df0154bcf6f2e2c1fb012c7d6', 'node_id': 'f278f66c-0b3e-4491-afa7-9cf7c0baf84e'}15:41
verteroknessita: AQ has the previous hash15:41
nessitaverterok: ah. Can we send both in the event, and we minimize the modifications to syncdaemon?15:42
alecunessita, I would go for the "no mods to syncdaemon" route.15:42
nessitaalecu: yeah but we can t decide if the file is new without that modification (or without listening to 2 events)15:43
nessitaalecu: you say we settle with 2 events?15:43
alecunessita, yeah15:43
alecuthe only problem I see with that is sometimes logging a modify when we should have logged a create.15:44
alecubut it's not so grave.15:44
nessitaalecu: ok, let's put this (modifying syncdaemon) on hold and assume we're using 2 events. Let's move on to the next event15:44
alecu"File was created on the server, syncdaemon creating locally"15:45
nessitathat is a download, isn't it?15:46
alecuright.15:46
nessitaalecu: so this is the case we just discussed?15:47
alecunessita, no: we were discussing uploads15:47
nessitaupload finished:15:47
nessita2010-11-24 12:45:45,310 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: AQ_UPLOAD_FINISHED, args:(), kw:{'node_id': 'f278f66c-0b3e-4491-afa7-9cf7c0baf84e', 'hash': 'sha1:7287a592845c932df0154bcf6f2e2c1fb012c7d6', 'new_generation': 318L, 'share_id': ''}15:47
nessitaalecu: the nanny was for downloads...15:47
alecunessita, right15:48
alecuso, the nanny generates AQ_DOWNLOAD_FINISHED15:48
alecuhow do we know if it was a new download?15:48
alecuhmm15:48
alecuhow do we know if it was a new file?15:48
verteroknessita: sorry, yes...maybe we need to talk with facundobatista about it15:51
nessitaverterok: ok15:51
facundobatistanessita, lo qué?15:51
nessitaalecu: plugging in headset for weekly call, get back to you in a minute15:51
verterokalecu: currently you can15:51
verterokalecu: you need to change syncdaemon or keep track of AQ_FILE_NEW_OK events :/15:51
nessitafacundobatista: if I'm a listener to AQ_DOWNLOAD_FINISHED, is there a way to know if the download was a newly created file in the server or was an update?15:52
alecuverterok, AQ_FILE_NEW_OK means an empty file was created on the server, right?15:52
verterokyes15:52
alecuverterok, I want to know if an empty file was created locally15:52
verterokhuh?15:53
facundobatistanessita, 4215:53
verterokalecu: what would that be?15:53
facundobatistanessita, I mean, you don't understand the question :)15:53
verterokalecu: the file is created when it's downloaded15:53
alecuverterok, that way I can know if a "download finished" is for a new file or not.15:53
nessitafacundobatista: I've asked you a yes/no question, you can't answer 4215:53
nessita:-)15:53
facundobatistanessita, you never download created files, so it always an update15:53
alecunessita, facundobatista: wait15:54
facundobatistanessita, sometimes it's an update from non-content, other is an update from old-content15:54
* facundobatista es pera15:54
verterokalecu: SD knows about new files during delta processing, but only the metadata is created15:54
verterokalecu: then we start downloading it15:54
nessitafacundobatista: we're abstracting us from the fact that creation and upload are split15:54
alecufacundobatista, nessita: we need to know if a file I've just downloaded from the server existed locally or not.15:54
verterokalecu: there are no empty files waiting for content on the client15:54
facundobatistaalecu, what do you mean with "existed locally"?15:54
alecuverterok, guessed so. I was trying to make an analogy with the upload steps.15:55
alecufacundobatista, if the file existed before downloading it. If it was created by syncdaemon or modified by syncdaemon.15:55
facundobatistaalecu, existed in the syncdaemon metadata? or in the user disk? with "was created by syncdaemon or modified by syncdaemon" you are *excluding* that the user created it?15:56
* facundobatista still doesn't understand15:56
nessitafacundobatista: created by syncdaemon would be the user created it15:57
nessitafacundobatista: did you read https://wiki.ubuntu.com/UbuntuOne/Specs/ZeitgeistIntegration/EventsSpec?15:57
facundobatistanessita, no, I didn't15:57
nessitafacundobatista: we need to track events to summarize them and show them to the user15:57
facundobatistanessita, if the user created the file, syncdaemon did not15:57
nessitafacundobatista: so, from a user POV, we need to log "there is a new file on the server that we're synching locally"15:58
nessitafacundobatista: and "there is a new file locally that we will upload to the server"15:58
nessitafacundobatista: so, for the former we would listen to AQ_DOWNLOAD_FINISHED, but we need to distinguish between:15:59
nessita* syncdaemon downloaded a whole new file that was created somewhere else15:59
nessita* syncdaemon downloaded an update to a file that is already in this machine15:59
facundobatistanessita, for "there is a new file on the server that we're synching locally", we would need to issue a signal, we had SV_FILE_NEW, but it's not an event anymore16:00
facundobatista"there is a new file on the server that we're synching locally" implies creation, not "downloadation"16:00
alecunessita, let's re-redact those paragraphs, so they refer to things done, like so:16:00
nessitafacundobatista: from the user POV, we want to track successful uploads/downloads16:00
=== JamesTait_school is now known as JamesTait
facundobatistanessita, you keep changing me the assertions -.-16:01
alecu"there was a new file on the server that have just finished synching locally"16:01
nessitafacundobatista: so file creation with empty content is not a significant event16:01
nessitaalecu: thanks16:01
alecufacundobatista, "a new file on the server" implies that the file did not exist on the local drive.16:02
facundobatistaalecu, we can not say that in an easy way16:02
alecufacundobatista, can it be inferred by listening to a sequence of events?16:02
alecufor instance:16:02
alecufor uploads we can listen for AQ_FILE_NEW_OK followed by AQ_UPLOAD_FINISHED for the same (volume_id, node_id)16:03
facundobatistaalecu, what about "SV_FILE_NEW_OK" and "AQ_DOWNLOAD_FINISHED"?16:04
alecuwhat does "SV_FILE_NEW_OK" means?16:04
facundobatistaalecu, sorry, it's "SV_FILE_NEW", a new file from the server16:04
alecuniiiice.16:04
alecufacundobatista, so, let me get this straight.16:05
facundobatistaalecu, we don't currently have an event like that, we removed for generations, but we could add it back16:05
alecu"SV_FILE_NEW" was removed for generations?16:05
facundobatistaalecu, I mean, we have the situation, we don't send an event to fly around16:05
alecufacundobatista, ok, so it's not an event that an event listener can handle right now.16:07
facundobatistaalecu, exactly, it's trivial to add it, though16:07
nessitafacundobatista: does that event mean the file was already downloaded?16:08
alecufacundobatista, so, what's exactly the situation when that event would happen?16:08
alecunessita, I understand it's similar to AQ_FILE_NEW_OK, but viceversa.16:08
nessitaalecu: yes, so not sure of that is what we need16:09
alecufacundobatista, I understand it means that a new file showed up on the server that does not exist on the client.16:09
facundobatistanessita, no, it means that there's a new file in the server16:09
facundobatistait doesn't even implies that it was created locally by syncdaemon!!! the user may just added it to the disk, also16:10
facundobatistaalecu, it means that a new file showed up on the server that didn't exist in the client when the client asked for a GetDelta16:11
nessitafacundobatista: so, after a (recently removed) SV_FILE_NEW we get a AQ_DOWNLOAD_STARTED and then a AQ_DOWNLOAD_FINISHED16:11
alecufacundobatista, that's very good enough.16:11
facundobatistaalecu, nessita, sorry about being such a PITA with the assertions, but it's tricky, and I don't want for you to get a bad idea of how it works or should work16:11
nessitafacundobatista: if we listen just to AQ_DOWNLOAD_FINISHED, is there a way of knowing if the file was a new adding or was a modification to an existent file?16:11
facundobatistanessita, no, AQ_DOWNLOAD_FINISHED means just the file finished downloading, it could be new or old16:12
alecufacundobatista, so, a SV_FILE_NEW followed by AQ_DOWNLOAD_FINISHED for the same (volume_id, node_id) would mean that a file did not exist when  the client asked for a GetDelta16:12
alecuthat's the event we want to log.16:12
facundobatistaalecu, but16:13
alecuthere's always a but.16:13
facundobatistaalecu, you could have a file that did not exist when the client asked for a GetDelta, and it could generate a SV_FILE_NEW but NOT a AQ_DOWNLOAD_FINISHED16:13
facundobatistaalecu, there's always a butt16:13
alecufacundobatista, people would't finish otherwise.16:14
facundobatistaje16:14
alecuok, so we'll store the SV_FILE_NEW (and the AQ_FILE_NEW_OK) with an expiry time.16:15
alecu(store in memory, waiting for the corresponding AQ_(UP|DOWN)LOAD_FINISHED)16:15
alecunice.16:15
facundobatistaalecu, what about new dirs?16:16
alecufacundobatista, what about them?16:16
facundobatistaalecu, you'd need to listen SV_DIR_NEW16:17
alecufacundobatista, verterok, nessita: would you mind if we keep talking about this in 1:30h, or so? We have a meeting in 15' and I want to grab a sandwich.16:17
facundobatistaok16:17
nessitaalecu: ok16:17
alecufacundobatista, oh, so I need to add that event back as well. good point.16:18
alecuok, ttly.16:18
alecuttyl16:18
facundobatistaje16:18
=== beuno is now known as beuno-lunch
=== beuno-lunch is now known as beuno
diverse_izzuehonk17:47
nessitaalecu_, alecu: you let us know when we restart zg analysis?17:53
nessitaalecu_, alecu: question about txsecrets on ussoc: we're using BUS_NAME = "org.gnome.keyring". If we (or someone else) want to switch to use kwallet, how we need to modify our code?17:54
nessitashall we make that a dbus parameter?17:54
=== alecu__ is now known as alecu
nessitaalecu: ping?18:14
alecunessita, pong.18:15
nessitaI said before: alecu: you let us know when we restart zg analysis?18:15
nessitaand also:L18:15
nessitaalecu: question about txsecrets on ussoc: we're using BUS_NAME = "org.gnome.keyring". If we (or someone else) want to switch to use kwallet, how we need to modify our code?18:15
nessitashall we make that a dbus parameter?18:15
alecunessita, don't know about that. I believe there must be an automatic way to query dbus for what bus implements a given object18:16
alecunessita, but I haven't gotten around to finding it yet.18:17
nessitaalecu: ok, for now this will be as is18:17
alecuregarding zg:18:17
alecuI'll be working on more zeitgeist awesomeness by joining the syncdaemon sprint next week.18:18
alecunessita, so during this week I'll focus on adding all the events that map 1:1 to SD events18:18
nessitaok then18:18
nessitaalecu: can you check out this trivialísimo branch? https://code.launchpad.net/~nataliabidart/ubuntu-sso-client/remove-gnomekeyring-from-docs/+merge/4177618:19
alecufacundobatista, verterok: I'll join you during the SD sprint next week, so I can poke you on SD -> ZG event conversion.18:19
alecunessita, absolutely.18:20
facundobatistaalecu, ok18:22
alecunessita, approved as trivial.18:23
alecunessita, oh, do we need two reviews anyway?18:23
nessitaalecu: apparently.18:23
alecueven for trivial branches? BS :-)18:24
nessitadobey: can you please review https://code.launchpad.net/~nataliabidart/ubuntu-sso-client/remove-gnomekeyring-from-docs/+merge/41776 ?18:24
nessitaalecu: yes, not sure of can set a trivial flag to tarmac\18:24
nessitas/of/if18:24
alecureview: Approve (trivial)18:24
alecuthat *should* do it.18:25
dobeyno18:27
diverse_izzuehonk :-)18:55
nessitadiverse_izzue: hey there, what can we do for you?19:10
diverse_izzuehi nessita19:12
nessitadiverse_izzue: hello19:12
diverse_izzueso i had a udf which was misbehaving. it wasn't synching all files in it and so on, even though u1sdtool was claiming it's done and IDLE.19:13
diverse_izzuei tried to remove said UDF, by clicking the checkbox in the nautilus bar19:13
diverse_izzueU1 crashed in the process of removing the UDF, see http://paste.ubuntu.com/535985/. the UDF is now removed on the webspace one.ubuntu.com, but still shown as active locally when i execute u1sdtool --list-folders19:14
duanedesignhello diverse_izzue19:16
diverse_izzuehi duanedesign19:16
duanedesigndiverse_izzue: when you run u1sdtool --list-folder does it say subscribed=True ?19:19
diverse_izzueduanedesign, yes, it does19:20
nessitadiverse_izzue: you need to refresh your volumes locally. This is a know bug. To do so:19:21
nessitau1sdtool --refresh-volumes19:21
diverse_izzuenessita, done, should i see an immediate effect after executing that?19:22
nessitadiverse_izzue: after syncdaemon reaching IDLE, yes19:22
nessitadiverse_izzue: let me know how this goes19:22
duanedesignnessita: what is the known bug? THe volumes not refreshing after removing a UDF from nautilus?19:25
diverse_izzuenessita, it sais IDLE, but --list-folders still lists the udf which i cannot see online19:25
nessitaduanedesign: the volumes not refreshing all the time, this includes shares19:25
duanedesignnessita: okies, thanks :)19:26
nessitadiverse_izzue: can you please paste the output od u1sdtool -s and u1sdtool --list-folders ?19:26
nessitaduanedesign: you're welcome, I'm looking for the bug #19:26
=== zyga_ is now known as zyga
diverse_izzuenessita, there you go, http://paste.ubuntu.com/536014/. the ~/NBI folder is the one making trouble19:27
nessitalooking19:28
nessitafacundobatista: can you assist me with a chicharra issue?19:31
diverse_izzuechicharra?19:32
facundobatistanessita, yes, what happens?19:32
facundobatistadiverse_izzue, it's the codename of part of the project19:32
nessitafacundobatista: diverse_izzue has deleted and UDF and he says is no longer in the web ui. u1sdtool keeps listing it, even after a refresh-folder call19:33
nessitafacundobatista: udf is /home/hunzikea/NBI in http://paste.ubuntu.com/536014/19:33
facundobatistadiverse_izzue, how did you delete de UDF?19:33
diverse_izzuefacundobatista, via nautilus ui19:33
nessitadiverse_izzue: just to be sure, you deleted the folder?19:34
facundobatistadiverse_izzue, you are in Lucid? Maverick?19:34
diverse_izzuefacundobatista, i should say that u1 crashed in the process of removing the udf, see http://paste.ubuntu.com/535985/. also, the udf was messy to beging with (=not synching right)19:34
nessitadiverse_izzue: deleted with the 'del' key, I mean?19:34
diverse_izzuenessita, no, i unchecked the checkbox in that U1 bar that nautilus shows in folders19:35
diverse_izzuefacundobatista, maverick19:35
nessitadiverse_izzue: unckecking will not delete the UDF but unsubscribe from it19:35
nessitadiverse_izzue: how did you delete it from the web ui?19:35
diverse_izzuenessita, i didn't.19:35
nessitadiverse_izzue: so, what does it mean that "the udf is gone in the web ui"?19:36
facundobatistadiverse_izzue, nessita: I don't see any checkbox in my nautilus :|19:36
diverse_izzuenessita, it means that on https://one.ubuntu.com/files/ i cannot see that folder listed under "my synced folders"19:36
nessitafacundobatista: do you have ubuntuone-client-gnome installed?19:37
nessitadiverse_izzue: can you please share with me a screenshot of that web page?19:37
nessitafacundobatista: is SD running?19:37
facundobatistaubuntuone-client-gnome:19:37
facundobatista  Instalados: 1.5.0+r749~maverick119:37
facundobatistanessita, running, connected and idle19:37
diverse_izzuenessita, will do19:38
nessitafacundobatista: where are you looking for a checkbox?19:38
nessitadiverse_izzue: thanks19:38
facundobatistanessita, I see the checkbox that says that the folder is synchronized ok19:38
nessitafacundobatista: right, diverse_izzue says he unchecked that19:38
facundobatistanessita, I'm looking for it in the folder drawing19:38
nessitafacundobatista: no no, in the ribbon19:38
facundobatistanessita, ribbon?19:39
nessitafacundobatista: 0.019:39
nessitafacundobatista: the banner at the top of special folders, such as Documents or an UDF19:39
diverse_izzuenessita, http://ubuntuone.com/p/QfJ/19:39
facundobatistaahhhhhhhh, ok19:39
nessitadiverse_izzue: interesting! can I please have your logs from syncdaemon?19:41
nessitafacundobatista: look, an UDF that is not listed in the web ui it is listed on syncdaemon19:41
nessitafacundobatista: how can we debug further?19:41
facundobatistanessita, the logs, the server rescan part, there it details what ListShares answer19:42
nessitaduanedesign: reference bug for the volumes not refreshing: bug #67191319:42
ubot4`Launchpad bug 671913 in ubuntuone-servers (and 1 other project) "Multiple instances of a single UDF in a local machine (or, deleted UDFs were not cleaned up) (affects: 1) (heat: 6)" [Medium,Invalid] https://launchpad.net/bugs/67191319:42
duanedesignnessita: oh cool. Great I will add it to my 'cheatsheet' of bugs :)19:43
diverse_izzuefacundobatista, nessita, is it best to restart u1 daemon to get the right part of the log?19:43
facundobatistadiverse_izzue, yes, but please set them in DEBUG first19:43
diverse_izzuefacundobatista, how do i set to debug?19:43
nessitaduanedesign: awesome!19:44
facundobatistanessita, I unchecked the folder through the "ribbon" and I don't see the UDF listed in --list-folders19:45
facundobatistanessita, are you sure it unsubscribes it?19:45
facundobatistanessita, no, it runs a DeleteVolume19:46
nessitafacundobatista: it does?!?!?!19:46
facundobatistanessita, it does19:47
nessitafacundobatista: ok, #nessitafail then19:47
facundobatistanessita, diverse_izzue: so, it's ok removed in the web ui, the issue is why it keeps listing it in the client19:47
nessitafacundobatista: anyways, using this new info, and using the first error diverse_izzue pasted (http://paste.ubuntu.com/535985/)19:48
facundobatistanessita, diverse_izzue, as it had issues *before*, maybe there was something broken before the volume deletion, so it may not be a problem there19:48
nessitafacundobatista: seems like SD has dirty metadata19:48
facundobatistanessita, diverse_izzue, the real issue now is to remove the UDF there19:48
facundobatistaI mean, fix the metadata19:49
facundobatistahowever, I'd love to see what the client says when restarting in debug mode19:49
facundobatistadiverse_izzue, add the following lines to your $HOME/.config/ubuntuone/syncdaemon.conf (create it if not there)19:50
facundobatista[logging]19:50
facundobatistalevel = DEBUG19:50
facundobatistanessita, note that in the pastebin you copied here, there is an error when handling AQ_DELETE_VOLUME_OK, so clearly the volume was deleted19:51
nessitafacundobatista: true19:53
diverse_izzuefacundobatista, the log: http://ubuntuone.com/p/QfP/19:55
facundobatistadiverse_izzue, what u1sdtool --list-folders tell you now?20:00
diverse_izzuefacundobatista, same as before20:01
diverse_izzuenbi is still listed and subscribed20:01
facundobatistadiverse_izzue, awesome!20:01
facundobatistaverterok, ping20:01
verterokfacundobatista: pong20:01
diverse_izzuefacundobatista, awesome?!? :-)20:01
verterokfacundobatista: what's the problem?20:02
verterokfacundobatista: I got disconnected and don't have the backlog20:02
facundobatistaverterok, diverse_izzue removed a volume, but it got an error while handling the AQ_DELETE_VOLUME_OK (he claims that the volume had issues from before, and we fixed a couple of bugs around there), but so far so good20:02
facundobatistaverterok, so diverse_izzue restarted the client: http://ubuntuone.com/p/QfP/20:03
facundobatistaverterok, see that that folder seems to not be there (the path for it is /home/hunzikea/NBI)20:03
facundobatistaverterok, and in the logs, we can even read:20:03
facundobatista2010-11-24 20:53:13,956 - ubuntuone.SyncDaemon.VM - DEBUG - Share (id: 72ceeb1a-246c-4a7b-b16c-237cf496a8c2) deleted.20:03
facundobatista2010-11-24 20:53:13,956 - ubuntuone.SyncDaemon.VM - WARNING - Got a share deleted notification ('72ceeb1a-246c-4a7b-b16c-237cf496a8c2'), but don't have the share20:03
verterokfacundobatista: that's for a share...not a UDF20:04
facundobatistaverterok, *however*, if diverse_izzue does --list-folder, he sees the folder there :| "nbi is still listed and subscribed"20:04
verterokfacundobatista: k, I think this is bug #67409220:05
ubot4`Launchpad bug 674092 in ubuntuone-client (Ubuntu Maverick) (and 2 other projects) "Deleting UDF on one computer does not delete it from others. (affects: 1) (heat: 320)" [Undecided,New] https://launchpad.net/bugs/67409220:05
verterokfacundobatista: --refresh-volumes should fix the issue20:05
verterokdiverse_izzue: ^20:05
verterokhi, btw :)20:05
diverse_izzuehi verterok20:05
diverse_izzueverterok, we tried the refresh-volumes thing already, no effect20:06
diverse_izzueverterok, should i repeat now that DEBUG is enabled, and see what it says in the log?20:06
verterokdiverse_izzue: yes, please20:07
diverse_izzueaha! a crash20:08
diverse_izzuewill paste log20:08
diverse_izzueverterok, http://ubuntuone.com/p/QfP/20:11
diverse_izzueor not, wait20:11
nhainesI would like to get ahold of the Ubuntu One beta client for Windows a bit earlier than usual because I am writing a print article on Ubuntu One.  So if this is possible, please let me know.  :)  honk20:12
facundobatistamandel, ^20:13
diverse_izzuefacundobatista, verterok, there we go: http://ubuntuone.com/p/QfW/20:14
verterokdiverse_izzue: ok, looks like a problem with the metadata20:15
duanedesignnhaines: https://wiki.ubuntu.com/UbuntuOne/Windows20:16
verterokdiverse_izzue: can I use/attach your logs in a bug?20:16
duanedesignnhaines: https://wiki.ubuntu.com/UbuntuOne/Tutorials/Windows <-- and how to setup20:16
diverse_izzueverterok, i guess so20:16
verterokdiverse_izzue: k20:17
nhainesduanedesign: thanks, I signed up last week, but have not received a reply, and this week I was approached to do an article On Ubuntu One.20:17
nhainesBut the tutorial is very useful.20:17
verterokdiverse_izzue: so, in order to fix this, we need to mess with the metadata, I can give you a script to fix it...if you will be around for 10-15min20:17
diverse_izzueverterok, i will be20:17
diverse_izzueverterok, can you explain in two lines what's going on/wrong?20:18
verterokdiverse_izzue: I can try :)20:18
verterokdiverse_izzue: we have two sets of metadata, one for volumes (shares, UDFs) and one for the nodes (files, directories) that includes the root of each volume (share or UDF)20:19
verterokdiverse_izzue: your client is missing the metadata for the root of the UDF, and when it tries to delete it...it fails20:20
duanedesignnhaines: ahhh, i see. yeah mandel can maybe help you with that.20:20
nhainesduanedesign: thanks.  :)20:20
duanedesignnhaines: [m]andels blog might be of interest if you are writing an article. http://www.themacaque.com/?paged=220:23
verterokdiverse_izzue: could you run a script to dump the metadata, before trying to fix it? :)20:24
nhainesduanedesign: Oh wow, I had never seen his blog.  I'll check that out!  I'm not sure the article will be much improved but it looks like the techy stuff I love to read about at least.  :)20:24
diverse_izzueverterok, of course20:24
verterokdiverse_izzue: the script is: http://pastebin.com/S3rti6s820:24
verterokdiverse_izzue: save it as: dump_metadata.py, and execute it: python dump_metadata.py > sd_metadata_dump.txt20:24
diverse_izzueverterok, shouldn't you use U1 yourself? :-)20:26
verterokdiverse_izzue: heh, pastebinit is my muscle memory :p20:27
duanedesignnhaines: i posted the link to the second page(because it had most the windows client stuff). He also has some newer posts that are good as well.20:28
diverse_izzueverterok, like a mercedes dealer who drives a toyota :-)20:28
diverse_izzueanyway, here's the dump: http://ubuntuone.com/p/Qff/20:29
verterok:)20:29
=== Franxesk is now known as Franxesk_afk
verterokdiverse_izzue: something very wrong is going on with this metadata...I'ld like to wait for facundobatista and discuss how to fix it without breaking anything :)20:36
diverse_izzueverterok, ok, i'll be around for at least two hours20:37
verterokdiverse_izzue: basically, there is a directory named: '' in the metadata...which I think it's impossible to create20:37
karniverterok: will you be on-line tomorrow, too? I'd like to catch you and ask about an issue with IConnector (that's probably me doing something wrong). I'm learning for a test tomorrow.20:39
karni*test that's tomorrow20:39
verterokkarni: sure20:40
karniverterok: ok then. I'll probably try to catch you tomorrow :) have a great afternoon20:40
verterokkarni: :) you too20:40
karnithank you :)20:41
facundobatistaverterok, wtf? a '' dir??20:51
facundobatistawow20:51
verterokexactly20:51
facundobatistaverterok, what about removing that node from the fileshelf? 2ca22cf5-934b-4d10-b386-1c09c56f785620:51
verterokfacundobatista: that should be ok, but deleteing the UDF will still fail20:53
verterokfacundobatista: the udf should be unsubscribed...local rescan does that when it can't find the root20:53
facundobatistaquizás se está pisando algo mal, porque >>> os.path.join("/home/foo", "")20:56
facundobatista'/home/foo/'20:56
facundobatistay eso quizás nos rompe cosas20:56
facundobatistadamn20:56
facundobatistamaybe it's stepping badly into itsledf20:56
facundobatista*itself20:56
facundobatistabecause of that "" dir20:56
nessitafacundobatista: english?21:07
nessitaah!21:07
verterokdiverse_izzue: hi, would you mind to try something? :)21:27
diverse_izzueverterok, maybe :-D21:27
verterok:)21:28
verterokdiverse_izzue: quit syncdaemon, u1sdtool -q21:28
diverse_izzuedone21:28
verterokdiverse_izzue: then execute: find ~/.local/share/ubuntuone/syncdaemon -type f -name 2ca22cf5-934b-4d10-b386-1c09c56f7856*21:28
verterokdiverse_izzue: it should return at most 2 files21:28
diverse_izzueit returns 1 file21:29
verterokdiverse_izzue: ok21:29
verterokdiverse_izzue: please execute: find ~/.local/share/ubuntuone/syncdaemon -type f -name 2ca22cf5-934b-4d10-b386-1c09c56f7856* | xargs rm21:29
verterok:)21:29
diverse_izzuefile is gone21:30
verterokdiverse_izzue: and then start syncdaemon again, u1sdtool --start21:30
verterokdiverse_izzue: please check if there is an error in the logs :)21:31
diverse_izzueverterok, the log is 2500 lines long...21:31
diverse_izzuewhat am i looking for?21:31
verterokdiverse_izzue: grep ERROR <log file>21:32
verterok:)21:32
verterokdiverse_izzue: or pastebin/share the file and I can check21:32
diverse_izzueno error21:32
verterokdiverse_izzue: please, connect the client, u1sdtool -c21:32
verterokdiverse_izzue: and then execute: u1sdtool --list-folders21:33
verterokis the UDF still there?21:34
diverse_izzueverterok, yes, still there21:35
diverse_izzuei had one warning in the log21:35
verterokdiverse_izzue: please pastebin the log file21:35
diverse_izzueverterok, is there a way to pastebin from command line?21:36
verterokdiverse_izzue: pastebinit -b http://paste.ubuntu.com <path to file>21:37
verterokdiverse_izzue: probably you will need to install pastebinit21:37
diverse_izzueverterok, http://paste.ubuntu.com/536058/21:39
verterokk, thanks21:40
dobeyverterok: yo21:50
dobeyverterok: commit message please :)21:50
verterokdiverse_izzue: hi, I'm back21:54
verterokdiverse_izzue: so, the udf is still listed using --list-folders?21:55
verterokright?21:55
verterokdiverse_izzue: try running: u1sdtool --refresh-volumes21:55
verterokdiverse_izzue: and pastebin the logs please21:55
diverse_izzueverterok, aha! now it's gone21:56
diverse_izzuerefresh-volumes helped21:56
verterokyes,the fix for the bug  about running refresh-volumes to cleanup dead UDF is already proposed for merge in trunk and stable-1-4 (lucid)21:57
verterokdiverse_izzue: no idea about what caused the metadata issue21:57
verterokwill try to replicate it locally21:57
diverse_izzueverterok, thanks for the help. if it happens again i will let you know, then maybe we can reproduce21:57
diverse_izzueverterok, so now it should be safe to enable said folder again?21:57
verteroksure, thanks a lot!21:57
verterokdiverse_izzue: yes21:58
diverse_izzueverterok, will try21:58
verterokk, let me knows if there is any problem22:02
duanedesignverterok: (reading scrollbaack) when you say two sets of metadata, is that the difference between ~/.local/shares/ubuntuone/syncdaemon/vm and fsm22:11
verterokduanedesign: yes, fsm (FileSystemManager) and vm (VolumeManager)22:12
duanedesignahhh, volume manager :)22:13

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!