[08:55] hey ubuntuone tesm is anyone there? [09:37] duanedesign, cool post about interesting things to do with U1 :) === JamesTait is now known as jayteeuk [10:09] ping anyone home? [10:12] psypher246, yup [10:14] rye: hey. i need to encrypt some data on my u1 folder, so i created a new encrypted folder using cryptkeepr (ecryptfs) and moved all the data withint u1 folder to that newly mounted encrypted folder. as far as I can tell u1 has indexed the data but is not uploading [10:14] tried killing and restarting, no change [10:15] huge list in waiting content [10:15] psypher246, what's the u1sdtool --status ? [10:16] State: QUEUE_MANAGER [10:16] connection: With User With Network [10:16] description: processing queues [10:16] is_connected: True [10:16] is_error: False [10:16] is_online: True [10:16] queues: WORKING_ON_BOTH [10:16] u1sdtool --waiting-metadata [10:16] Oops, an error ocurred: [10:16] Traceback (most recent call last): [10:16] Failure: dbus.exceptions.DBusException: org.freedesktop.DBus.Python.UnicodeEncodeError: Traceback (most recent call last): [10:16] File "/usr/lib/pymodules/python2.6/dbus/service.py", line 702, in _message_cb [10:16] retval = candidate_method(self, *args, **keywords) [10:17] File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/dbus_interface.py", line 204, in waiting_metadata [10:17] waiting_metadata.append(str(cmd)) [10:17] File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 1442, in __str__ [10:17] for attr in str_attrs] [10:17] UnicodeEncodeError: 'ascii' codec can't encode character u'\xbb' in position 10: ordinal not in range(128) [10:21] psypher246, i suspect this is lucid, right? waiting metadata was not encoding characters properly... Could you please pastebin your syncdaemon.log (~/.cache/ubuntuone/log/syncdaemon.log). Since ecryptfs encrypts file names it should be ok [10:24] http://paste.ubuntu.com/502027/ [10:24] yes lucid [10:24] latest updates etc [10:25] aquarius: thank you. :) [10:25] oh, and morning all [10:26] duanedesign, I hope to put together a lot more of those sorts of cool ideas :) [10:27] psypher246, waiting until we know the real value of %r a44de60d-5d05-4e69-81a5-b5c46374b73f - hmm [10:27] psypher246, it is actually not uploading anythin [10:27] facundobatista, ping ^ [10:28] aquarius: that would be great. I have since had a couple of suggestions. I hope to try them out soon [10:29] duanedesign, let's talk about this over a beer at UDS. I have a number of ideas :) [10:29] \o/ [10:30] rye: yeah doesn't look like it, no upload traffic coming from any python processes [10:30] * rye relogins [10:31] aquarius: sounds good. I have also been meaning to do some screencasts of U1...That way I am killing two birds with one stone, lol. Contributing to two projects I participate in at once [10:42] hmm where did rye go? [11:18] rmcbride, psypher246: I see the client running ok [11:21] facundobatista: yet it's not uploading [11:22] psypher246, in your logs, I mean [11:22] psypher246, it's not uploading data because it's busy creating files [11:22] then what does the errors that rye refer to? [11:22] how logn does that have to take? [11:22] been at least an hour or 2 [11:22] psypher246, it depends of how many files you created [11:23] but there is no disk acces happening [11:24] psypher246, could you please go to your log directory and do: "grep MARK syncdaemon.*" and pastebin the results? [11:27] http://paste.ubuntu.com/502055/ [11:32] psypher246, see: [11:32] ...12:22:16,322 ... queues: metadata: 32816; content: 24567; ... [11:32] ...12:24:16,322 ... queues: metadata: 32754; content: 24567; ... [11:32] ...12:26:16,322 ... queues: metadata: 32712; content: 24567; ... [11:32] (from your last pastebin) [11:32] psypher246, there you can see that the metadata queue is going down [11:33] ok [11:33] psypher246, it seems you put to work tens of thousands of files: it will not be instantaneous [11:33] so what is it busye doing? [11:33] and taking so long at it? [11:33] psypher246, from your other pastebin, it seems they are all MakeFiles: creating the files in the server [11:34] psypher246, from the numbers I just pasted, in average it's taken 2.8 secs per operation, which is not that much [11:35] psypher246, we have planned a speed improvement when dealing with tens of thousands of files, we're not there yet [11:35] ok [11:35] rye, ^ [11:35] is there no easier way a user can see what is happening [11:36] like just clicking on ubuntu one and having stats like this displayed [11:36] psypher246, there is this open source project that will show the info, it's called Magicicada [11:36] it will make a big diffrence to the user experiencing just seeing progrssion stats [11:36] psypher246, it's in Universe in Maverick, but in Lucid you can install it from the PPA: sudo apt-add-repository ppa:chicharreros/ppa [11:37] facundobatista, i lost a bit of the conversation due to figuring out why my network broke but the last time i saw the pasted log the syncdaemon was waiting on something [11:37] rye, no, it was not, I can help you to understand that part of the logs if you want [11:37] rye 11:27 [11:37] psypher246, waiting until we know the real value of %r a44de60d-5d05-4e69-81a5-b5c46374b73f - hmm [11:37] psypher246, it is actually not uploading anythin [11:37] rye, nevertheless, never forget for the "grep MARK" helper, it will show you the queues very easily [11:38] 24 thousands of nodes? [11:39] facundobatista, do we have any ready reference numbers for how long some operation will take... we keep saying that "this will take a while" but not defining that "while" [11:39] rye, 32 thousands of metadata operations, 24 thousands of content operations, yes [11:40] rye, we're about 1-3 seconds per operation, when all is ok, including all roundtrips (say, viewing it from the client POV) [11:40] rye, of course, I'm not including uploads and downloads in that number, as they depend of the file size [11:42] busy morning in here :) [11:44] facundobatista, yes, so 24000 seconds (best weather conditions) for metadata queue is nearly 7 hours. After that uploads will start to happen [11:44] rye, yeap [11:45] facundobatista, then we add hdd chewing during metadata loading at startup [11:45] rye, how "then"? [11:45] facundobatista, on next restart :) [11:45] rye, startup normally comes before [11:45] rye, ah, yes [11:46] rye, we have improvement plans on all these fronts [11:46] facundobatista, yes, but to have these numbers in order not to give any false hopes === didrocks1 is now known as didrocks === teknico is now known as teknico_away [13:06] facundobatista: how do you exatly tell that the queue is going down, looking at the output of grep MARK syncdaemon.* there seems to be no change [13:08] psypher246: i like to use the command: u1sdtool --waiting-metadata | wc -l [13:08] still the same error i got this morning [13:08] u1sdtool --waiting-metadata | wc -l [13:08] Traceback (most recent call last): [13:08] Failure: dbus.exceptions.DBusException: org.freedesktop.DBus.Python.UnicodeEncodeError: Traceback (most recent call last): [13:08] File "/usr/lib/pymodules/python2.6/dbus/service.py", line 702, in _message_cb [13:08] psypher246, but we saw the number going down in the last pastebin you passed [13:08] retval = candidate_method(self, *args, **keywords) [13:08] File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/dbus_interface.py", line 204, in waiting_metadata [13:08] waiting_metadata.append(str(cmd)) [13:08] File "/usr/lib/python2.6/dist-packages/ubuntuone/syncdaemon/action_queue.py", line 1442, in __str__ [13:08] for attr in str_attrs] [13:09] UnicodeEncodeError: 'ascii' codec can't encode character u'\xbb' in position 10: ordinal not in range(128) [13:09] but i'm told it's processing, so i dunno [13:09] facundobatista: not uqite sure how you read that number, which number is it precisley and what does the number represent [13:09] ...12:22:16,322 ... queues: metadata: 32816; content: 24567; ... [13:09] ...12:24:16,322 ... queues: metadata: 32754; content: 24567; ... [13:09] ...12:26:16,322 ... queues: metadata: 32712; content: 24567; ... [13:09] psypher246, ^ "queues" are the operation queues [13:10] psypher246, you have meta operations, and content operations, the number besides each is the quantity of operations in the queue [13:10] psypher246, the MARK log line has more data in it, search for that structure [13:12] ok now suddenly it changed [13:12] for the last 15 minutes the log stayd the same [13:12] so it's not updating line by line? [13:12] ok why do i get that error above when doing u1sdtool --waiting-metadata? [13:13] psypher246, it's not updating line by line, the MARK is logged every 2 minutes [13:14] psypher246, the u1sdtool error is something we fixed in more recent versions of the client [13:14] so i have to be running mavrick? [13:15] +++/18 [13:15] ugh [13:15] mark is not updating every 2 mins [13:15] :2010-09-28 14:10:16,322 - ubuntuone.SyncDaemon.Main - NOTE - ---- MAR [13:15] thats the last in the log [13:15] psypher246, note that log rotates [13:15] i see it happens every 2 mins [13:15] but the log ye not updated every 2 mins [13:16] psypher246, how can you see it happen if the log is not updated? [13:17] just saying looking at the ones above, something is logged every 2 mins, just not sent to the log, log updates periodically as a batch [13:17] so a bit confusing when you trying to monitor a queue going down [13:17] i'm trying to understand how this happens but yeah, it's a bit confusing [13:21] psypher246, I don't understand this part of what you said "something is logged every 2 mins, just not sent to the log" [13:22] 2010-09-28 14:08:16,322 - ubuntuone.SyncDaem [13:22] 2010-09-28 14:10:16,322 - ubuntuone [13:22] but if i run grep MARK syncdaemon.* [13:22] that same log comes up [13:23] last entry 14.10 [13:23] so in the log, something is logged every 2 mins [13:23] but the whole log is only updated as a batch [13:24] log is updated now with: 2010-09-28 14:20:16,322 - u [13:24] but it will take longer than 2 mins to log the next occurrence [13:24] , then after 10 or so minutes the log file is updated with several occurences which happned evey 2 minutes [13:25] so does that log say there is still 30197 files to create metadata for? [13:26] and it does about 29-30 every 2 minutes [13:26] psypher246, metadata operations, could be file creation, file deletion, moves, etc... it depends on what you did with your files, but basically everything except data transfer [13:32] am i right that it will then take 33 hours to process 30000 transactions? [13:36] psypher246, I calculated 25hs, yeap [13:36] see now it's been 15 minutes now yet the last transaction logged is 7:2010-09-28 14:20:16,3 [13:36] wow 25 hours [14:10] bug #109023 [14:10] Launchpad bug 109023 in mozilla-thunderbird (Ubuntu) "[FEISTY] mozilla-thunderbird crashed [@??] [@nsWindow::OnDragEnter] (dup-of: 103906)" [High,Incomplete] https://launchpad.net/bugs/109023 [14:10] Launchpad bug 103906 in mozilla-thunderbird (Ubuntu) "MASTER mozilla-thunderbird-bin crashed [@ ??]!! [@ nsWindow::OnDragEnter] (dups: 6) (heat: 28)" [High,Invalid] https://launchpad.net/bugs/103906 [14:11] sorry nm [14:14] hm, Rhythmbox gives me the following link for a song I'm playing: https://one.ubuntu.com/music/l/4012239/0 which shows the front of teh correct album but says "This song is not available to buy from the Ubuntu One Music Store in your country. Sorry!" but it *is* available when I look in the store itself in Rhythmbox? [14:18] rye: hey was just talking to aquarius, told me to give you a shout regard U1 not working on initial setup [14:19] ie. following install instructions on the site get to step 8 and there is no add my computer button === jorge_ is now known as jcastro_ === jcastro_ is now known as jcastro [14:22] regards the FAQ where it says it's not opening anything fast enough it's perfect, click on manage my account in the U1 client and straight away new tab opens wiht my account details [14:24] ah ok on running the u1sdtool I get an error: "ubuntuone-login(14714): Operation not permitted" === teknico_away is now known as teknico [14:26] felimwhiteley, wait, does xdg-open http://www.ubuntu.com work for you? [14:26] rye: yeah [14:27] oh weird [14:28] a bunch of other tabs has suddenly appeared, one for adding the computer, the other saying something has gone wrong then the other two were the instructions I was reading and initial google search tab I had open [14:28] felimwhiteley, operation not permitted - where do you see the error when you run u1sdtool ? [14:28] o_O [14:28] rye: yes [14:28] oh and one more tab, the ubuntu.com homepage! [14:28] clearly being the one we wanted.. [14:29] rye: presume I'll add my machine or before I do you want me to close all apps and try again see if it fails again? [14:30] I've seen a couple of the bugs have trouble recreating errors.. [14:30] felimwhiteley, the thing is that id did open the tab [14:30] if I can preserve the weirdness for you I will [14:31] felimwhiteley, which is weird, it should either break completely or work properly, in this case we have mixed results [14:31] well I'm not sure where it was displaying.. [14:32] felimwhiteley, so, let me recollect all that - you opened ubuntuone-preferences, nothing opened in your browser, you went forward and tried u1sdtool but that did not give anything interesting too we ran xdg-open and the tab opened [14:33] no ubuntuone preferances when run from the me menu open my account in the browser immediatly [14:33] it's step 8 where I had no add this machine button, so yes then I did the u1sdtool stuff and it happened as you wrote there [14:34] felimwhiteley, where do you see 'Operation not permitted' message? [14:35] that was during the sd1tool command from the FAQ page where it goes on about the add computer button being missing [14:36] sd1tool -q; etc [14:39] felimwhiteley, could you please pastebin the contents of ~/.cache/ubuntuone/log/oauth-login.log ? to !paste [14:39] !paste [14:39] For posting multi-line texts into the channel, please use http://paste.ubuntu.com | To post !screenshots use http://tinyurl.com/imagebin | !pastebinit to paste directly from command line | Make sure you give us the URL for your paste - see also the channel topic. [14:40] sure [14:41] rye: eh it's 2 lines long!? [14:42] felimwhiteley, is there something about Operation not permitted? [14:42] no just startup message [14:42] login manager v 1.2.2 [14:43] still want it? [14:43] felimwhiteley, no, thanks, i have these lines, they are not that interesting... Thinking.... [14:43] rye: I figured :) [14:45] felimwhiteley, your machine is not authorized now, right? You have not added it using that tab that magically opened, is that correct? [14:47] rye: I didn't add it in case you wanted it to still be in unauth state [14:48] felimwhiteley, is there anything xdg-open running now in the processes? [14:48] no [14:49] oh hang on.. [14:49] I assume it would show up in a grep xdg-open then.. jsut tried with xdg and there is a lot but that just looks like path being caught [14:50] rye: put it this way "ps ax | grep xdg-open" shows nothing [14:51] felimwhiteley, ok, is there anything interesting in the last lines of ~/.xsession-errors - pastebining that may not be a good idea since all sort of debug info ends up there [14:52] rye: can't find tomboy on dbus.. which is fine it's not running [14:53] couple of aplication open closed for ubuntuone-preferences [15:03] felimwhiteley, i guess it is too late to try debugging that. Unfortunately this happens only once. Fortunately, in Maverick the whole process is changed completely and no browsers will be involved [15:04] rye: will I give it a restart see can it happen again? [15:04] felimwhiteley, before you do, could you please patch the sources a little bit? [15:05] rye: sure [15:05] felimwhiteley, i.e. /usr/share/pyshared/ubuntuone/oauthdesktop/logger.py - change LOG_LEVEL line to read LOG_LEVEL = logging.INFO [15:06] felimwhiteley, erm [15:06] rye: np [15:06] felimwhiteley, LOG_LEVEL = logging.DEBUG [15:06] :) [15:08] rye: do I need to do anything process wise for it to take effect? [15:08] felimwhiteley, wait, i am trying to add tracing to xdg-open [15:08] rye: oh sure no prob [15:11] felimwhiteley, ... and add "set -x" right below a long disclaimer in /usr/bin/xdg-open [15:13] felimwhiteley, should look like this - http://paste.ubuntu.com/502136/ [15:14] done [15:18] felimwhiteley, and now you can try running the same steps, btw, could you please also check whether you have ubuntuone-login process running? [15:20] rye: 2 processes it seems [15:20] felimwhiteley, o_O [15:21] felimwhiteley, could you please paste the entries? === pedronis_ is now known as pedronis [15:21] ah [15:21] one is the pid of the one that complained in the command line faq stuff [15:21] you want full output of ps? ps axf? [15:25] felimwhiteley, ps auxw | grep [u]buntuone-login [15:30] argh... you won't believe this one... it's other user logged into system in background... no wonder it couldn't quit it.. [15:30] I never thought a 2nd account was running on the [insert swear word] laptop [15:31] rye: I'll kick that account out and retest? or should it still function anyway? [15:32] o_O [15:32] felimwhiteley, ah, yes [15:32] so log that user out right? [15:33] then your question about ubuntuone-login, it should or shouldn't be running for the test [15:34] ok only have the one process for ubuntuone-login running now.. [15:35] and I've closed all previous browser tabs and shutdown firefox, I should run me menu ubuntuone client and follow steps 1-10? [15:48] felimwhiteley, you should not have ubuntuone-login process running at all, since it is usually the case with new installations [15:51] rye: just kill it I presuem then [15:51] felimwhiteley, yup [16:13] rye: sorry about delay was caught up in call there, I've killed login prcess, closed FF, open meMenu and clicked manage accoutn as all set to unknonw [16:14] opened my accoutnpage automatically in Firefox (FF has my password precached so logged in no problem) [16:14] felimwhiteley, well, this happens every time we try to debug it, it starts working [16:14] rye: where should the Add Machine button be? [16:15] ah but I got this far before.. [16:15] unless I'm not reading the instructions correctly I can't see how to add a machien [16:15] felimwhiteley, basically it should look like http://ubuntuone.com/p/DFm/ [16:17] rye: well my account page in ubuntu1 prefs never changes then [16:17] I'm still following the vid.. [16:18] I never get the add this machine then [16:18] same bug [16:18] when I click manage accounts it takes me to the main "Account" tab in ubuntu one, all me details filled in correctly [16:19] I already had an account... [16:19] seems we recreated the bug... no? [16:20] felimwhiteley, when you open ubuntuone-preferences application it should trigger a new tab to be opened in the browser or a new browser window - did that happen? [16:20] yes [16:20] brings me to the accoutn page [16:21] "Your accoutn": with name, email, change password all ok, your plans with 0 x 2GB, view machines set up phone, then tickbox to get email and then an ask about account link [16:22] click on "your machines" and I get a thing telling me havn't added any computers and a link to the installation details page === zyga is now known as zyga-dinner [16:23] where I go step 1, skip to step 8 as it works for me but then clearly I don't get the right page on login as all I get is the Accoutns page.. ?! [16:23] by which I mean the "Your Account" page.. [16:24] rye: had an idea, do you want to use gitso or something to log into this machine? [16:24] I might be describing stuff poorly.. [16:29] felimwhiteley, the browser window should be opened automatically, without the need of clicking anything [16:30] I open U1Prefs Name, email etc is Unknown, I click manage accoutns and yes it open FF, and FF auto logs me into my U1 account page.. that's all that happens [16:30] I presume FF doesn't open till the manage account is clicked? [16:37] rye: http://paste.ubuntu.com/502169/ [16:37] got some info in there finally [16:39] felimwhiteley, you may want to killall ubuntuone-login now, ubuntuone-login has switched to the web server mode and waits for the token to be supplied to it from the browser [16:40] rye: I did kill it last time as well.. re-kill and try again? [16:41] hmm ok well in U1Prefs my account stuff still reads as unknown, I wen to the Devices pane and clicked connect and all of a sudden new tab in FF opened up and asking to add the machine [16:43] rye: want me to add it? === zyga-dinner is now known as zyga [16:44] felimwhiteley, this behaviour is so weird i can't really understand where to poke now. xdg-open calls gnome-open under gnome and it launches the browser, well, asks the browser to open the page. There is no 'deferred' execution.... [16:45] felimwhiteley, could you please re-post oauth-login.log ? [16:47] rye: it's number 502175 [16:54] felimwhiteley, nothing looks weird, the xdg-open process is launched so it should be working [16:54] but the fact that it requires a second xdg-open to open the first tab seems weird [16:55] there is no ipc between xdg-opens :) [16:59] felimwhiteley, hm, could you please retry the steps and if ubuntuone-preferences do not trigger browser opening then see whether there is a hanging xdg-open process anywhere? [17:16] so to clarify, kill any ubuntuone-login processes, close all apps,open ubuntu prefs and FF should automatically open? [17:17] felimwhiteley: see wasn't this better than giving out it wasnt working :) [17:21] czajkowski: it's still not working and it's eaten hours of rye and myself day ;) I'd hardly call that "better" [17:22] felimwhiteley, yes, that's the intention [17:22] felimwhiteley, sorry for not replying earlier - please mention my nick so i can see immediately that there is something waiting for my response [17:23] * rye is hacking on something Ubuntu One-related [17:24] rye: np; Right killed ubuntuone-login... omg it's opened browser this time! It took a good while must be said [17:25] felimwhiteley: well it is better, it may get resolved, which is better than it not working [17:26] Everybody say thanks to nessita for implementing a stable solution for Maverick that does not involve any browser magic! :) [17:26] rye: for sure.. thanks nessita! [17:27] and we now know that running xdg-open from dbus-autostarted service may not work at all w/o being able to track it down in the virtual machine... [17:28] hey! it's my job! [17:28] thank you for choosing Ubuntu :-) === beuno is now known as beuno-lunch [17:54] duanedesign, here? === beuno-lunch is now known as beuno === ChrisWoollard_ is now known as ChrisWoollard === teknico is now known as teknico_away [21:34] hmm. quiet channel. === karni is now known as mkarnicki === lifeless_ is now known as lifeless === teknico_away is now known as teknico === yofel_ is now known as yofel