[01:01] pmatulis: that is strange [01:04] duanedesign: yes [01:07] i get redirected to https://media.one.ubuntu.com/offline.html [06:20] Hi Gents. [07:03] I have a 300GB U1 account and I have been trying to sync +- 100GB over the last 3 weeks to my U1 account. Thus far only 8.5GB has been uploaded. [07:05] syslog doesnt show any errors, but i have a sneaky feeling the problem may lie in the naming conventions of some of the files, any ideas? [07:57] why would the ubuntu one synch be disabled on one of my share folders? (on both client and local) [07:58] i mean, i can't even toggle it on or off [08:03] csdwifi: hello [08:04] hello kingmilo still around? [08:05] csdwifi: what version of Ubuntu are you on? [08:07] yes duanedesign [08:07] hi [08:08] duanedesign, 11.04 natty x86 [08:08] 2.6.8/10 on kernel [08:08] can't remember exact [08:10] csdwifi: when you look at the folders in the Ubuntu One Control Panel are they checked? [08:12] kingmilo: can you look at this log file to see if their are any errors ~/.cache/ubuntuone/log/syncdaemon-exceptions.log [08:14] csdwifi: oh i see. "both client and local" meaning in the Control Panel and in Nautilus (file manager)? [08:15] yes [08:15] duanedesign: will do [08:16] hmmm the only thing i'm really concerned about now is how to add something to a local network cloud, or is ubuntu one entirely web based? [08:17] csdwifi: is this a folder you are Sharing with another user or a folder you are Syncing between just your computers and cloud? [08:18] just on the local network, all computers with access need to have the files available at all times [08:18] even if all but one of the sources is off [08:19] csdwifi: all Cloud Folders are synced with the cloud. So you can not just sync between machines on a local network [08:19] (the folder is on an external drive on my main fileserver) [08:19] csdwifi: all synced Cloud Folders need to be in the users $HOME directory [08:20] ok, i've got everything synching up now [08:20] csdwifi: great [08:21] duanedesign: http://pastebin.com/RTWvjUGu <-- tail that file if you want more ill try upload the entire log [08:23] kingmilo: looks like your hunch might be correct [08:25] duanedesign: What are my options? Try and format a 100GB of files to remove whitespace and and any abnormal strings? [08:26] kingmilo: i have a script you can use to identify the offending files. You can run it with the following: [08:26] wget http://people.canonical.com/~roman.yepishev/us/utf8-filename-check.py [08:26] python utf8-filename-check.py [08:30] duanedesign: excellent ill give it a shot [08:32] kingmilo: i think their is a way to batch rename the files... [08:36] duanedesign: works nicely thank you, gotta love python! There are less than 10 offending files so ill just run another python script to rename, ill give it a shot and let you know if it works - thanks! [08:38] kingmilo: great! definetly, let me know [08:42] Hi. Is there an online view of my music based on tags, the way the mobile app sees it? [08:47] j0nr: at one.ubuntu.com their is not [08:54] duanedesign: Ok so far so good, removed offending files, U1 recognizes the DEL of said files, now the state is: [08:55] duanedesign: ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: ; queue: 76314; hash: 0) ---- [08:55] kingmilo: ok State:READY means you need to issue the command: u1sdtool --connect [08:56] duanedesign: ahh, im connected remotely will have to NX in and run it I think [08:57] kingmilo: you want connection'*With* User *With* Network' [08:57] duanedesign: got ya [08:58] cool. Took me awhile to get used to the states. A little cryptic. [08:58] duanedesign: ok UNlinking from bad files... [08:58] duanedesign: ubuntuone.SyncDaemon.DBus - INFO - connect was requested. Are we autoconnecting? False [08:59] duanedesign: can we set to autoconnecting True :) [08:59] duanedesign: yea a little but your a big help so thanks very much [08:59] kingmilo: you should have an Ubuntu One entry in 'Startu Applications' [09:00] duanedesign: Yea i do, think it might be getting confused because the user is logged in twice and this session is a remote NX session. [09:00] kingmilo: fwiw the command it runs is: /bin/sh -c '[ -d "$HOME/Ubuntu One" ] && ubuntuone-launch' [09:01] in case you want to check it [09:02] duanedesign: oh shucks - tail: cannot watch `.cache/ubuntuone/log/syncdaemon.log': No space left on device [09:02] duanedesign: how do i clear the cache, 3 weeks of writing to log files has taken it toll i think :/ [09:03] root / has 605GB avail [09:03] might be a inode problem with small files etc. [09:04] kingmilo: you can safely remove all the files from .cache/ubuntuone/log/ [09:05] done [09:06] doing some exciting stuff here haha [09:07] I am really enjoying using Canonical Landscape to monitor my Ubuntu LTSP server and syncing my backups from all those servers to the U1 cloud [09:07] makes my life so much easier [09:08] This U1 problem was an issue but thanks to you duanedesign I understand how to manage it a lot better [09:08] kingmilo: you mentioned inodes [09:08] kingmilo: thought i might mention this just in case [09:09] kingmilo: here is a bug report where max_user_watches was set low and caused an error [09:10] it has a syncdaemon-exceptions.log so you can see what the error is. Comment #2 is the fix [09:10] bug #614161 [09:10] Launchpad bug 614161 in ubuntuone-client (Ubuntu) "ubuntu one applet crash on login (affects: 1) (heat: 8)" [Undecided,Expired] https://launchpad.net/bugs/614161 [09:11] you might not need that bit of knowledge but never now :) [09:12] duanedesign: brilliant I believe that might be part of the problem, going to increase it! [09:17] duanedesign: Ok the state now is on LOCAL_RESCAN I am going to assume its building a 'list' of the files needing to sync, will then compare to the U1 cloud and then start syncing? [09:18] duanedesign: apologies for bombarding you with questions! [09:18] ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: ; queue: 38604; hash: 0) ---- [09:25] kingmilo: that is correct [09:25] and quues is the number of files (and metadata) to sync [09:26] kingmilo: you can watch the queue if you want to keep track of progress with the command: u1sdtool --waiting | wc -l [09:27] i'll brb. gotta pick up breakfast :) [09:42] enjoy :) [09:45] duanedesign: thanks but it requires X again and im logged in remotely via ssh, just watching the log file for now, no exceptions as of yet so far so good! [12:25] DiegoSarmentero: take a look at: http://timgolden.me.uk/pywin32-docs/shell.html [12:26] mandel, thanks...... on it [12:27] DiegoSarmentero: no idea which version of pywin32 it has that, mine does not [12:55] nessita, --temp-directory= === m_conley_away is now known as m_conley [13:37] alecu, nessita, DiegoSarmentero, mandel: volunteers for review: https://code.launchpad.net/~ralsina/ubuntu-sso-client/no-thread-execute/+merge/69280 [13:37] ralsina, on it [13:45] duanedesign: let me know when ur around again :) [14:14] C:\Temp\_trial_temp\tmp\tests.syncdaemon.test_localrescan\ComparationTests\test_deep_and_wide\shares\ro_share\a\b\c\d\e\f\g\h\i\j\k\l [14:16] mandel: any clues? http://paste.ubuntu.com/652441/ [14:21] is there a u1 files client for osx? [14:23] lamalex: nope not yet [14:24] so there's going to be one? [14:25] lamalex: well we want to support as many platforms as possible and mac is on that list but it wont be too soon from now [14:25] lamalex: we are still working on the windows client [14:26] aye aye [14:29] duanedesign, you might find http://askubuntu.com/questions/54446/login-to-ubuntu-one-from-iframe/54463#54463 interesting :) [14:35] kingmilo: hello [14:35] thank you aquarius [15:07] hey guys [15:08] HazRPG: hi [15:08] ah, seems my question is half answered from the topic links ^_^ [15:08] nice [15:08] duanedesign: since chatting to you the status hasn’t changed and no errors have been logged, my concern is why hasn’t it started to upload do you think? [15:09] duanedesign: ubuntuone.SyncDaemon.Main - NOTE - ---- MARK (state: ; queue: 76312; hash: 0) ---- [15:09] Anyone know if there's an update to the status of u1ms [15:09] ?* [15:09] HazRPG: how do you mean? [15:10] dobey: Well according to the wiki it says as of 2011-07-20 some people have been having troubles downloading music purchases... I seem to be one of those people, placed the order last night. [15:11] reference: https://wiki.ubuntu.com/UbuntuOne/Status#MobileStreamingMusic [15:12] ah, wrong anchor link, but its still on the bottom of that page [15:12] rye, ^ [15:12] ah [15:14] Anything I can try to resolve it? [15:14] kingmilo: looks like you need to connect the syncdaemon. You can do that by running the Terminal command: u1sdtool --connect [15:14] HazRPG, hello, yes, we are working on the fix to the server-side which will make purchases appear instantly again. At the moment some number of purchase downloads are delayed [15:15] rye: Ah, okay. Thanks for the update. :) [15:15] rye: I'm guessing all current orders are placed into a queue at the moment? [15:16] HazRPG, some of the files may download properly, could you please PM me your Ubuntu SSO e-mail address you are using for Ubuntu One so I could look up the status? [15:18] sure [15:24] ralsina, http://pastebin.ubuntu.com/652476/ [15:32] alright, lunch time. bbiab [15:35] duanedesign: that command hates being run in the terminal / remotely, only works when you are within the X server and in terminal, ill login remotely now and let you know. [15:35] duanedesign: FYI, i restarted the server because its not production and I would have thought that it would start the sync auto without having to run said command. [15:39] duanedesign: Ran the cmd, no change in the log file no exceptions either, opened up U1 Control Panel and status is 'File sync Starting' [15:40] kingmilo: can you try running the Terminal command: u1sdtool -s [15:41] facundobatista, http://oopsmygeekisshowing.com/uploads/estimation.png [15:41] duanedesign: sure. output is: per line --> State: Local_Rescan /n connection: With User With Network /n description: doing local rescan /n is_connected: False /n is_error: False /n is_online_ False /n queues: WORKING [15:42] duanedesign: lot's of 'false' in their :\ [15:42] duanedesign: Local_rescan surely cannot take THAT long, ie since we chatted earlier this morning, it's lots of files total size +- 100GB [15:47] Ok we are getting a bit more action in the log file.. . [15:47] kingmilo: once the local rescan finishes it will connect to the server and some of those Falses will change to True [15:47] mandel, http://bugs.python.org/issue4944 [15:47] duanedesign: aka being patient :) [15:48] be* [15:48] duanedesign: Either way thanks for your help and your python script, I have learnt a lot today! [15:48] duanedesign: are you a U1 developer? [15:49] kingmilo: I work on the team but i am not a developer. [15:49] duanedesign: OK :) [15:51] kingmilo: at least i am not a developer for U1. I do some development in my off-time [15:52] duanedesign: Ok kool, python? [15:52] kingmilo: mostly [15:52] kingmilo: i am trying to do more C [15:53] duanedesign: nice, i love python, im not very good at coding a bit of a jack of all trades but so enjoy python [15:53] yes python is noce [15:53] s/noce/nice [15:56] duanedesign: I recently read an article about a Germany Insurance company, I think it was called, LVD or something along those lines, they are using Ubuntu as their Primary OS, around 10,000 installs, do you think Canonical would be interested to know about a small South African company who has done the same but on a much smaller scale, 200 instances? [15:56] kingmilo, LVM [15:56] kingmilo, and we would :) [15:56] We use the Canonical Landscape service, use their eLearning and then all our users run Ubuntu Natty :) [15:56] beuno: Yes that was it, awesome! [15:58] beuno: How should I go about it, we are very proud of our setup and would like to share the experience with others, plus we can be a good test case for other company's in our country. At the moment we are setting up another small company to replace OS's (read Microsoft) in companys with Ubuntu. [15:59] kingmilo, let me find out who's the best person to forward this [15:59] beuno: Ahh, and we are backing up all our data to a central server via Rsync, 4 IBM servers that provide LTSP to all our users. Those IBM servers then rsync all user data to a central IBM server running Ubuntu which then sync's to the U1 cloud, hence my parking in this channel for the day. [15:59] thanks beuno, that would be great [16:01] kingmilo, contact pr@ubuntu.com [16:02] beuno: Excellent, thanks! [16:03] much appreciated [16:08] duanedesign: We are making progress, some of the options have moved to true, seems like local scan is done and now the queue is being setup, so thanks for your assistance! [16:25] kingmilo: awesome! [17:01] cheers gents. [17:14] facundobatista,: https://code.launchpad.net/~nataliabidart/ubuntuone-client/avoid-circular-imports/+merge/69329 [17:16] DiegoSarmentero: https://code.launchpad.net/~nataliabidart/ubuntuone-client/avoid-circular-imports/+merge/69329 [17:21] nessita, http://paste.ubuntu.com/652558/ [17:23] nessita, mandel: https://code.launchpad.net/~facundo/ubuntuone-client/win-attrs-only-user/+merge/69334 [17:26] facundobatista: looking [17:28] DiegoSarmentero: can you please apply this diff in installer? http://paste.ubuntu.com/652561/ [17:31] facundobatista: line 60 it removes everyone, which might be a problem because even if you user is not allowed, if everyone is then your user will be to [17:32] s/to/too [17:33] * dobey puts on the lone ranger theme song :P [17:35] facundobatista: what about using this guys: http://support.microsoft.com/kb/243330 [17:36] facundobatista: should fix the issue of using the group name [17:41] DiegoSarmentero, facundobatista: ahora sí: https://code.launchpad.net/~nataliabidart/ubuntuone-client/avoid-circular-imports/+merge/69329 [17:45] mandel, facundobatista: http://support.microsoft.com/kb/157234 [17:47] nessita, http://paste.ubuntu.com/652568/ [17:51] facundobatista, alecu: http://www.icodeguru.com/WebServer/Python-Programming-on-Win32/ch16.htm look for 'well known' [17:55] facundobatista: in ntecuritycon you have this defined: http://msdn.microsoft.com/en-us/library/cc245516(v=prot.10).aspx === beuno is now known as beuno-lunch [17:56] facundobatista: aca: http://docs.activestate.com/activepython/2.5/pywin32/PySID.html [17:57] facundobatista: constructor: http://docs.activestate.com/activepython/2.5/pywin32/win32security__SID_meth.html [17:59] mandel, facundobatista: http://docs.activestate.com/activepython/2.4/pywin32/win32security__CreateWellKnownSid_meth.html [18:01] facundobatista, mandel: win32security.CreateWellKnownSid(win32security.WinBuiltinAdministratorsSid) [18:02] facundobatista, mandel: win32security.CreateWellKnownSid(win32security.WinWorldSid) [18:03] mandel, http://msdn.microsoft.com/en-us/library/aa379650(v=vs.85).aspx [18:09] alecu, mandel: [18:09] >>> win32security.CreateWellKnownSid(win32security.WinBuiltinAdministratorsSid) == win32security.LookupAccountName("", "ADMINISTRADORES")[0] [18:09] True [18:09] >>> win32security.CreateWellKnownSid(win32security.WinWorldSid) == win32security.LookupAccountName("", "TODOS")[0] [18:09] True [18:38] grr. reimports should be fatal errors in lint checkers [18:55] mandel, nessita: https://code.edge.launchpad.net/~facundo/ubuntuone-client/win-user2sid/+merge/69342 === beuno-lunch is now known as beuno [19:04] sigh [19:05] verterok, nessita, mandel: contrib/dbus-docs is totally broken right now, due to the various platform changes. not sure why it is causeing me problems now though [19:05] dobey: broken how? [19:05] dobey: ah, ok, I read that wrong :-) [19:05] well it's importing stuff that apparently got moved [19:06] some of those were re-imports, which are evil. [19:13] dobey: why is causing problems? [19:13] dobey: it's being executed in make ? [19:14] make docs, yes [19:17] dobey: can you just remove it from the make target? [19:17] dobey: everything gor shuffled :/ [19:17] dobey: I just fixed the imports, but now is missing: contrib/testing/dbus-session.conf [19:18] dobey: because contrib/dbus_util.py is also broken [19:18] yeah, i'm fixing it [19:19] i just had to express my displeasure :) [19:19] dobey: :) [20:04] hah [20:05] because i was using 'make docs' instead of 'make -C docs' [20:05] :-/ [20:22] nessita: patience :) [20:22] dobey: what did I do? :-) [20:23] nessita: i just saw a couple merges in my e-mail, where you approved the branches before launchpad finished rescanning them :) [20:24] dobey: oh, sorry, I thought they were scanned [20:30] nessita: hrmm. and i see this trial temp dir bug on ubuntuone-dev-tools that looks rushed, and more of a workaround than a solution [20:30] dobey: why a workaround? [20:30] dobey: we need trial's temp customized when running tests in windows [20:31] dobey: definitely outside the source tree in our cases [20:32] nessita: because it just adds an env var it looks for. and it seems like a rushed feature to get around a problem you hit while being in a rushed state to get work done. :) [20:32] the bug does not describe a problem at all, but the "need" for a specific workaround. [20:32] dobey: not sure what you mean with rushed [20:32] dobey: the problem is: the trial temp is written in the same source tree [20:32] we need to have the trial temp in a custom location, due to perm issues [20:33] Tags: u1-zomg-windows <- rushed :) [20:34] nessita: ok. i think i would like to understand those issues better. [20:34] dobey: we talked about this with the team, and we evaluate different options. We consider this a good solution. Would you have any other proposal to have the trial temp outside the source tree? [20:34] there is absolutely no mention of permissions issues on the bug. the bug is "we need to customize the dir, so we can have the source tree in a different place" :) [20:35] dobey: well, that's the need in the bug report regarding the project [20:35] nessita: i don't have a proposal right now because i don't even know what the problem is exactly. [20:35] dobey: the problem is that the trial temp can't be created in the source tree we're mounting in windows due to perm issues (I don't have a backtrace right now) [20:35] bug reports should describe problems, not solutions. branches describe solutions :) [20:36] the problem is that we can't customize the trial temp directory using u1trial and trial does allow the --directory-temp or something like that [20:37] we need more flexibility for u1trial regarding that, we consider this the less invasive change [20:37] ok, i think that is a separate issue (u1trial not expositing options which trial has) [20:37] probably. But, like I mentioned before, we evaluated exposing trial options and doing this fix, and we decided going with this one [20:38] well i generally prefer things to "just work" without having to pass options or set env variables, unless there is an absolute last resort need for them and there's no other way. [20:38] dobey: I know, and I'm glad you do that [20:39] nessita: i understand why you did it. i'm not questioning that. i just want the information about the actual problem to be documented. i have no idea what all you discussed and didn't discuss exactly, at the sprint. i'm not there eating alfajores with you :) [20:40] nessita: if you could reproduce the problem, and explain the issues in more detail, i would be happy. :) [20:41] dobey: sure! [20:42] dobey: we have VMs to do the windows develop. We have linux hosts, so we defined mount point inside the VM pointing to linux's folders [20:42] dobey: so, we can run the tests over "linux" directories that are mounted inside the VM into another "drive" (e: for example) [20:42] nessita: i'm not upset that you made the change or anything. i just want the info documented, so that when i see it, i can possibly come up with a better solution to the problem. and if not then we can agree that your solution is best or whatever. [20:43] nessita: can you put the info in the bug report please? i won't remember anything on irc :) [20:43] ralsina, https://code.launchpad.net/~alecu/ubuntuone-client/remove_watcher_q [20:43] dobey: ack, and thanks for understanding [20:43] ralsina, and here's how to run it: http://pastebin.ubuntu.com/652658/ [20:43] dobey: I will update the bug report [20:43] alecu: ack [20:43] nessita: great, thank you. :) [20:45] alecu: if we are terribly desperated we can try the following: http://doc.qt.nokia.com/latest/qfilesystemwatcher.html#details [20:54] dobey: I added a comment to bug #816418, would you please let me know if it makes sense? not sure I made my point there [20:54] Launchpad bug 816418 in ubuntuone-dev-tools "We need to customize trial's temp dir (affects: 1) (heat: 6)" [High,Fix committed] https://launchpad.net/bugs/816418 === m_conley is now known as m_conley_away [20:58] nessita: windows == windows 7? or also xp and/or vista? [20:59] dobey: let me confirm with the rest here [20:59] dobey: at least win 7, but we're not running other win ATM [21:01] nessita: what type of mount is it? i guess it's a readonly drive? [21:01] dobey: no, we explicitely set it to read write [21:01] dobey: let me show you a screenshot [21:04] nessita: then i wonder why it can't be written to :) [21:05] dobey: the error is not "i can't write", but some "security bla foo" error [21:05] dobey: trying to reproduce the error now [21:05] nessita: ok. traceback would be nice, yes :) [21:06] nessita, https://pastebin.canonical.com/50293/ [21:06] dobey: ^ [21:07] dobey: all facundo, alejandro and me got the same trace [21:07] dobey: that is raised as soon as we try to create folders inside the temp dir [21:08] ah ok. interesting [21:09] so u1trial isn't failing, but the tests are [21:09] dobey: right, I may clarify that in the bug report [21:10] clarification added [21:10] hello again, [21:11] ok. the details about how that drive is mounted (fs type, permissions, etc), are important here i think. so would be very useful for me to see those (since i can't look directly) [21:11] I am finding quite a few music files are not having their ID3 tags read properlyat all. [21:11] beuno: ^^ see j0nr's message [21:12] j0nr, let me take a look at the servers. When did this start happening? [21:13] beuno: well I uploaded my music for the first time about 10 days ago [21:13] dobey: other that specifying how I setup that in the vm, I don't know what is going on behind scenes. Does that work? [21:13] j0nr, and not all of it got scanned? [21:13] since it finished syncing, looking at music on U1Mobile, there are many 'unknown' files, some of which I have determined so far, definately have tags [21:14] j0nr, what's your email address? [21:14] nessita: well it's a start. if it's not enough, we can figure out how to get more info about it :) [21:14] beuno: I do wonder if it is just a scanning thing... as I re-wrote some tags (albeit with exactly the same detail) and it recognised the changes [21:14] dobey: I'll do that [21:14] beuno: jon@jcrdevelopments.com [21:14] nessita: great. thanks [21:15] j0nr, let me check real quick what your account looks like and some server logs [21:15] beuno: cool, thanks! [21:16] j0nr, these are mp3s? [21:18] beuno: yes [21:19] j0nr, can you give it an minute and look again? I've queued your music to be re-scanned [21:19] beuno: ok. Is that something I coulod have done? [21:20] j0nr, no, not at all. There could of been a glitch on our side, I'd need to investigate [21:21] beuno: no I mean the rescanning of the music? [21:25] j0nr, oh, no, we don't expose that to users [21:25] I have another question... if I accidently delete something out of a U1 synced folder... how can I use U1 to restore? Quickly disable the daemon so it doesn't delete on the server then manually download the files elsewhere/ [21:26] beuno: ok. thanks for doing it [21:26] j0nr, did it get fixed? [21:27] j0nr, we're working on a tool for users to be able to do that, but in the mean time, just popping in and asking someone from support will do it [21:27] beuno: not yet.... just hit refresh at top of Music tab, but still shows same results. [21:29] j0nr, lets try and experiment then. Can you pick any random file that has incorrect tags, and copy it to a different folder (that is also synced) [21:35] beuno: correct tags, but not displayed in U1M properly? [21:36] j0nr, yes [21:36] beuno: ok done... unfortunately I made some changes to other files so there is a bit fo syncing gong on...may take a while [21:37] * beuno goes make a sandwich [21:39] have a good evening all! [21:59] beuno: ok, sync complete [21:59] beuno: file copied to U1 folder... [22:13] beuno: gotta go now... will see how it goes tomorrow. cheers [22:36] ok, I'm off [22:36] see ya all tomorrow!