/srv/irclogs.ubuntu.com/2012/06/26/#ubuntuone.txt

mmccdinner time - see everyone later00:11
karniNight all o/00:22
dobeyanyone around?01:53
ralsinadobey: I am now01:58
ralsinadobey: need reviews?01:58
dobeyralsina: https://code.launchpad.net/~dobey/ubuntuone-storage-protocol/fix-pep8/+merge/11198601:59
dobeytrivial01:59
ralsinadobey: on it01:59
dobeythanks01:59
ralsinadobey: global +102:00
ralsinadobey: pep8 complains of != None now?02:00
dobeyyep02:03
dobeythe version in Q does02:03
ralsinanice, it's an old pet peeve of mine. Almost the only proper usage of is in python.02:14
karniGood morning o/05:41
=== lisettte` is now known as lisettte
kazademorning aquarius - you got a couple of mins for some U1DB questions? :)08:38
aquariuskazade, heya! Go for it; I'll be in and out 'cos I'm sprinting, but I'll try and answer as quickly as I can08:38
kazadeok, well, I kinda fell at the first hurdle..08:39
kazadeIf I have to include U1DB in my app... which is a C module - that's gonna complicate things isn't it :)08:39
kazadeI guess my packaging just got more complicated :p08:39
kazadeanyway, this is what I'm writing: http://i.imgur.com/tYIhX.png08:40
aquariusah, you don't need the C version08:40
kazadeoh!08:40
aquariusyou can use the reference implementation, which is Python :)08:40
kazadeah!08:40
kazadecould you point me at it?08:40
kazadehmm, this: http://people.canonical.com/~aquarius/u1db-docs/reference-implementation.html points me at lp:u1db08:41
aquariuslp:u1db contains everything, including the reference Python version...08:41
aquariusit does :)08:41
kazadeok, I should've spent more time looking through the folders08:41
kazadeOK that's awesome - now the fun part of moving from Sqlite -> U1DB :/08:42
aquariusthat's a reasonably big change, indeed, because U1DB is not the same kind of database at all08:43
kazadeyeah, luckily I've used non-rel before (on Google AppEngine)08:43
kazadewell... I use it every day :p08:43
aquariusI'd put each task in one document, I think :)08:43
kazadeyep :)08:44
kazadeone more thing..08:44
kazadethe docs mention running a server..08:45
kazadedo I need to do that to use it?08:45
kazadeI'm guessing this: db = u1db.open(":memory:", create=True) isn't persistent..08:45
=== mandel` is now known as mandel
aquariusyou don't need to run a server at all, no08:47
aquariusindeed, opening :memory: is not persistent :)08:47
aquariusif you specify a real file name there then it'll persist08:47
aquariusthe server is for syncing to08:47
aquarius(or from)08:47
aquariusyou can run the reference server in order to test your syncing code, when you get to that point08:47
kazadeok, I'll start by just storing it in a file and then tackle the syncing part08:48
aquarius(it may be easier than testing against the live Ubuntu One server, firstly because you can moe easily see the results, and secondly because the refernce server doesn't need authentication :))08:48
aquarius(and it's all local, too, so you don't need the net to test syncing)08:48
kazadeis there any sample code around for syncing with the user's Ubuntu one?08:48
kazadedoes Ubuntu Accomplishments use U1DB?08:48
aquariusthere is, but it's not in the docs yet. It's in the presentation I gave at UDS, which I shall find you a link to08:48
aquariusAccomplishments uses Ubuntu One file sync, because it has different requirements -- it needs sharing (which U1DB doesn't do) and a created synced trophy does not change once it's created (which is not the case for a task, obviously :))08:49
aquariushttp://ubuntuone.com/5KKNLvpKe76zgRBmdyFen5 for the presentation08:50
aquariusI'd grab it from there rather than just bookmarking the URL :)08:50
kazadealready done ;)08:50
kazadethanks :D08:50
kazadeaquarius: that sample code takes care of auth yeah? Would that automatically work if the user was connected to their U1?08:51
aquariuskazade, yep -- see the code mentioned in the presentation, which should be a fully functional example08:53
kazadeconveniently the sample is a todo list :D08:53
kazadecool, I think I've got enough to go on - I'm gonna have a busy lunch hour :)08:53
kazadethanks again!08:53
aquarius;)08:55
aquariusno worries! have a play08:55
aquariusthisfred is your man for detailed code questions, although I can probably help :)08:56
kazadeok cool :)08:57
JamesTaitGood morning all! :)09:18
gatoxgood morning11:14
thisfreds11:19
thisfredkazade: hi :) the todo app is still a little rough around the edges, but it does sync (though synchronously, so it freezes the ui. I will make it do it async soon, so there'll be an example of that as well)11:22
kazadethisfred: awesome :) I'm gonna try and switch over to U1DB tonight - be prepared for questions :D11:24
thisfredkazade: that's awesome, bring 'em on! :) Here is fine, but there is also #u1db. If I'm unresponsive, feel free to email me as well: eric.casteleijn at canonical dot com11:25
* thisfred walks dog11:26
=== zyga is now known as zyga-afk
aquariusralsina, ping about http://askubuntu.com/questions/156135/is-this-ubuntu-one-dbus-signal-connection-code-correct -- is that something you can answer?12:44
=== zyga-afk is now known as zyga
ralsinaaquarius: maybe12:44
ralsinaaquarius: I'll give it a try later today12:44
ralsinaaquarius: C++? Do you hate me that much? ;-)12:45
aquariusralsina, I know not much about both C(++?) and D-Bus and U1's D-Bus API, but I figured either you would or your team would :)12:45
ralsinaaquarius: probably me or gatox. I think I may delegate ;-)12:45
alecuhey all, good morning!12:47
ralsinahola alecu!12:47
gatoxalecu, hi12:47
gatoxralsina, c++ \o/12:47
gatoxkind of rusty..... but fun12:48
alecuc++ /o\12:48
gatoxjejeje12:48
ralsinagatox: all yours :-)12:48
ralsinac++ o/~12:48
* alecu loves this line:12:48
alecusignature = "a{ss} (Dict of {String, String})";12:48
ralsinawhich means "stinks like armpit"12:48
alecuhow come dbus definitions are sooo funny?12:48
ralsinaalecu: I suspect parts of dbus are a  joke we just don't get yet12:49
ralsinaalecu: for example http://dbus.freedesktop.org/doc/dbus-python/api/dbus.Dictionary-class.html12:49
alecuI didn't get that either :P12:49
ralsinaalecu: here's the good line from that page "the key and value signatures will be guessed from an arbitrary element of the Dictionary."12:49
gatoxralsina, jeje you are traumatize with that line12:50
ralsinagatox: yes I am12:50
alecuralsina: it's arbitrary because a dict has no order. That's just why; otherwise it would use the first.12:51
ralsinaalecu: it still makes no sense12:51
ralsinaalecu: it should not guess signatures, it should fail12:51
ralsinaalecu: or it shoud check the signatures of all items12:51
ralsinaalecu: checking a random item is insane12:51
alecuralsina: I think it puts the burden on the user to include items of the same type12:52
alecuralsina: so it let's the user behave like a grown adult12:52
ralsinaalecu: it's like doing 10 holes on the floor and covering 9 with glass.12:52
alecuralsina: there's obviously an impedance mismatch between the dbus need for types and python's cuacking12:53
ralsinaindeed12:53
alecuso, this solution works for most cases, and breaks horribly in a few :-)12:53
alecuanyway, I think I know the answer to aquarius riddle.12:53
alecuI'll reply now in askubuntu12:54
ralsinaalecu: thanks!12:54
=== zyga is now known as zyga-food
gatoxalecu, did you have the time to review my branches?13:10
dobeyhmm13:10
alecugatox: I'm almost done with the first; I've got a few comments.13:11
gatoxok13:11
dobeywtf askubuntu13:21
=== zyga-food is now known as zyga
=== yofel_ is now known as yofel
* mandel back13:46
mandelralsina, shall we try and have the 1-1?13:50
ralsinamandel: am on mgmt call, so in ... 40 minutes?13:50
mandelralsina, sure, ping me when done :)13:50
ralsinamandel: ack13:50
alecummcc: ping13:57
alecummcc: you might be interested in this: http://stackoverflow.com/questions/8314348/cocoa-fsevents-kfseventstreamcreateflagfileevents-flag-and-renamed-events13:57
alecugatox: ^ too13:57
gatoxalecu, looking13:57
dobeyhrmm. do i go for triple redundancy for my big data raid; or span 2 disks and mirror to the other 213:58
ralsinadobey: raid 1+013:58
ralsinadobey: best performance while keeping good safety13:58
ralsinadobey: you can lose 2 disks if you are lucky ;-)13:59
gatoxalecu, mmm do you think that i would be helpful if i adapt my testing script to do a lot of rename operations and check if they are successful?14:01
alecudobey, ralsina: triple redundancy is like burning money. Offsite backups ftw14:01
ralsinaalecu: if there was only an online service where we had gigabaytes for free as canonical employees!14:02
alecuexabytes!14:03
dobeyif only there was a free infiniband connection to it :)14:04
ralsinadobey: there is, but it involves a jumbo jet full of HDDs crashing into london14:04
alecuralsina: that does not sound exactly like "free". Perhaps it's the "free love" jumbo jet that Austin Powers rides.14:05
ralsinaalecu: well, if it crashes you get a refund, don't you?14:05
gatoxalecu, so.... let me know if we should use that to test it.... also, let me know when you finish reviewing my branches :P so i can check that and update everything as soon as possible... in the meantime i'm working on this Bug #1012706  for fsevents on darwin14:05
ubot5Launchpad bug 1012706 in Ubuntu One Client "File Moved from partial missing on MAC OS" [High,In progress] https://launchpad.net/bugs/101270614:06
dobeyand all your data lost14:06
ralsinadobey: details!14:06
alecuralsina: they refund you an unlimited number of random bits; you'll have to put them back together.14:06
ralsinaalecu: here's a 1-generator and a 0-generator, you mix them14:06
alecugatox: re: script to "do a lot of renames", it sounds very useful.14:08
gatoxalecu, ack14:08
alecugatox: anyway, the link I pasted is regarding to a new feature in the FSEvents API that mmcc found14:08
alecugatox: it's a way for FSEvents to report "changed files" too. It's part of darwin 10.7, but it's poorly documented.14:10
mandelalecu, I updated https://code.launchpad.net/~mandel/ubuntuone-client/better-encoding/+merge/11158014:10
alecugatox: and according to that stackoverflow question, it's also not reliable in some cases.14:10
gatoxalecu, yes..... we are not having that problem using the macfsevents lib14:10
gatoxalecu, or it seems we don't..... i'll check with the script14:11
alecugatox: but we should consider contributing that feature to macfsevents at some point, because in theory it sounds like it might reduce a lot our code.14:12
alecuand it sounds like it might make it faster, too.14:12
alecuand make it more compatible with the sandbox.14:12
alecu(but only if we can make the API work reasonably)14:13
gatoxalecu, yes of course.....14:13
gatoxalecu, but yes, if the api works properly14:13
mandelralsina, looks like bug #1017922 happens also in windows but we never did a thing about it, so I solved both (is a stupid defer.succeed(self) to keep things clean + a test ran by all platforms14:15
ubot5Launchpad bug 1017922 in Ubuntu One Client "'NoneType' object has no attribute 'cancel' on darwin" [Medium,Triaged] https://launchpad.net/bugs/101792214:15
ralsinamandel: ack14:15
ralsinamandel: 1-1?14:36
mandelralsina, sure, let me launch the thing14:37
* dobey wonders why quantal instance died14:43
gatoxalecu, ping14:50
alecugatox: pong14:51
gatoxalecu, the thing with this lib, it seems that when you stress it a lot, creating a lot of events at once, it tends to lose something, the first script create 1000 files, and rename those 1000 files instantly.... and it only detects around 650..... now i added a little sleep between renames.... and it's detecting everything14:52
alecugatox: is it the lib or is it the FSEvents API?14:53
gatoxalecu, right..... i should check with the c code now... i was testing at python level14:53
gatoxi'll test that14:54
alecugatox: another thing: try running the fslogger.c code at the same time when you are running your tests14:54
alecugatox: and see if fslogger.c finds out that the lost events match any special event14:55
alecugatox: I'm guessing this is caused by the event from /dev/fsevents that signals that the event queue was full.14:55
gatoxalecu, ack14:56
alecugatox: aha14:57
gatoxalecu, what?14:57
alecugatox: are you doing all the 1000 renames in the same folder?14:57
gatoxalecu, yes14:58
alecugatox: there you go.14:58
gatoxwhat what?14:58
alecugatox: try this:14:58
alecugatox: base_folder/folder999/file99914:58
mmcchi folks. just back from a kernel panic. alecu, saw your link in the backtrace, interesting. I suspect there are relevant flags he's missing14:58
gatoxthe files are: 1.txt, 2.txt..... and i'm renaming everything adding "aa"...... like 1aa.txt, 2aa.txt14:59
alecugatox: and do the rename of file999 instead14:59
alecugatox: right, so now my guess is that events are lost because they all happen in the same folder14:59
briancurtinme15:00
gatoxme15:00
alecugatox: and the FSEvents API that your lib uses "merges" changes in a given folder.15:00
dobeyme15:00
mmccme15:00
thisfredme15:01
alecume15:01
mmccalecu, gatox - does macfsevents pass through the FSEventStreamEventFlags to look at?15:01
gatoxmmcc, what?15:02
alecuralsina, mandel: standup!15:02
ralsinasorry otp15:03
ralsiname15:03
mandelme15:03
mmccgatox: FSEvents includes flags with each event with some additional info - one flag it could set is 'kFSEventStreamEventFlagMustScanSubDirs', which means it coalesced multiple file events (or even multiple dir events) into one event, and you have to manually scan everything under the event's path recursively15:03
alecubriancurtin: go15:03
briancurtinDONE: windows xp issue debugging15:03
briancurtinTODO: windows xp issue, installing a new VMWare right now so i can make snapshots with/without 2008 CRT, build installer on XP itself15:03
briancurtinBLOCKED: no15:03
briancurtinNEXT: gatox15:03
gatoxDONE:15:03
gatoxStart working on Bug #1012706 , debugging renames on darwin.15:03
gatoxTODO:15:03
gatoxcheck the fsevents api, keep working (and finish) with the previous bug and Bug #101270915:03
gatoxBLOCKED:15:03
gatoxNo15:03
ubot5Launchpad bug 1012706 in Ubuntu One Client "File Moved from partial missing on MAC OS" [High,In progress] https://launchpad.net/bugs/101270615:03
gatoxdobey, go15:03
ubot5Launchpad bug 1012709 in Ubuntu One Client "Add Watches to udf ancestors" [High,In progress] https://launchpad.net/bugs/101270915:03
dobeyDONE: release day15:03
dobeyTODO: finish releases/uploads15:03
dobeyBLCK: Quantal Tarmac instance down.15:03
dobeymmcc: go15:03
mmcc DONE: fixed default reactor issue on darwin,15:03
mmcc TODO: REVIEWS, polish up a merge for CP, hack more at CP15:03
mmccBLOCK: none15:03
mmcc NEXT: thisfred15:03
thisfredDONE: Bug #999562 TODO: wrap up Bug #999562 | https://bugs.launchpad.net/u1db (As in plenty to do, just haven't picked yet ;) BLOCKED: no NEXT: alecu15:03
ubot5Launchpad bug 999562 in U1DB "retry logic on 503 " [High,In progress] https://launchpad.net/bugs/99956215:04
alecuDONE: reviews, more debugging for the failing branch, more fsevents discussion15:04
alecuTODO: more mac reviews, catch up with py3k in sso with brian15:04
alecuBLOCKED: still can't find why the branch won't merge15:04
alecuNEXT: ralsina15:04
ralsinaDONE: mgmt call, tech leads call, setup XP VM, setup Q VM, reviews. TODO try to debug in both VMs + look at testability BLOCKED: I can't run both VMs at the same time :-/ NEXT mandel15:04
alecuralsina: you should get more ram!15:05
mandelDONE: Bug #1017922 bug #1017886, reviews15:05
mandelTODO: Look at inhibitor with more detial, more reviews15:05
mandelBLOCKED: no15:05
ubot5Launchpad bug 1017922 in Ubuntu One Client "'NoneType' object has no attribute 'cancel' on darwin and windows" [Medium,Triaged] https://launchpad.net/bugs/101792215:05
ubot5Launchpad bug 1017886 in Ubuntu One FsEvents daemon "There is a typo in the API" [Medium,Fix committed] https://launchpad.net/bugs/101788615:05
ralsinaalecu: I need a faster disk, actually15:05
ralsinacomments?15:05
ralsinammcc: how's the status on packaging?15:06
mmccralsina: packaging works up to the point that I need to fix bugs in controlpanel to make packaging progress15:07
ralsinammcc: awesome15:07
ralsinammcc: so, after the default reactor thing, does u1cp start?15:07
mmccralsina: oh, yes15:07
ralsinacool!15:08
mmccyep, forward motion :)15:08
gatoxmandel, ping.... i've updated the darwin3 branch, and darwin4 is ready for review15:08
mandelmmcc, do you get to the point where the control panel has the animation?15:08
mandelmmcc, is there a branch I can test with15:08
mandelgatox, ok, may I have the mp urls15:08
* mandel is lazy..15:08
mmccmandel: yes, it will show the setup page and buttons work, etc15:08
gatoxmandel, yes15:08
ralsinamandel, mmcc, gatox: let's try to get something packaged this friday15:09
mandelmmcc, awesome!15:09
ralsinaI don't even expect it to *work*15:09
gatoxmandel, https://code.launchpad.net/~diegosarmentero/ubuntuone-client/darwin3-fsevents/+merge/111666  -  https://code.launchpad.net/~diegosarmentero/ubuntuone-client/darwin4-fsevents15:09
ralsinabut I would like to have something that I can install and try and report failure with15:09
mmccralsina: well if you don't expect it to work, then I can send you something today :)15:09
mandelmmcc, can you pass me the lp branch I'll like to test it with the sd I have syncing to maybe sync a share or something of the kind :)15:09
gatoxralsina, well, the non root fsevents implementation should be working.... we need to land this branches :P15:09
mmccmandel, sure -- just a sec15:10
gatoxralsina, there are yet 2 open issues that i'm working on about fsevents..... for 2 particular things15:10
ralsinagatox: I have lots of confidence in you15:10
ralsinagatox: also, we have the other events implementation ;-)15:10
gatoxralsina, :P15:11
mmccmandel, you need to use the sso branch from this MP: https://code.launchpad.net/~mikemc/ubuntu-sso-client/fix-1017672-delayed-reaction-in-tcpactivation/+merge/11194515:11
mmcc(which you could also review if you like)15:11
mandelmmcc, I will15:11
mmccand then use controlpanel from here: https://code.launchpad.net/~mikemc/ubuntuone-control-panel/fix-1015825-reorder-reactor15:11
mmccwhich I'll propose as soon as I can test it, provided VBox doesn't panic my kernel again15:12
=== eu is now known as adorilson
dobeyquantal is back. but client build in archive isn't done yet15:12
mandelmmcc, ha, I think I'm the one to blame for that import reactor..15:12
gatoxmandel, please review my branches...... so i can annoy alecu later :P15:12
gatoxjeje15:13
mmccmandel, I wasn't going to name names ;)15:13
mandelmmcc, got bzr blame for that hehe15:13
mandelgatox, sure, let me look at mmcc branch first that is not a gazillion lines long :)15:14
gatoxmandel, :P ok15:14
* gatox lunch15:16
=== gatox is now known as gatox_lunch
mandelralsina, I forgot to mention, the perissions error is expected but we should talk with ux to have a better interaction with the user15:16
mandelralsina, like telling him, we did not update the file 'cause we don't have the rights, or something of the kind15:16
dobeywtf15:17
dobeymandel: what branch landed in fsevents that had a --fixes for bug #1013119?15:17
ubot5Launchpad bug 1013119 in Ubuntu One FsEvents daemon "SBJson must be removed due to license issues" [High,Fix committed] https://launchpad.net/bugs/101311915:17
mandeldobey, less error prone was base on the rejected one.. I'll set that as invalid15:17
mandeldobey, sbjson is there in trunk15:18
mandelmmcc, small needs fixing: https://code.launchpad.net/~mikemc/ubuntu-sso-client/fix-1017672-delayed-reaction-in-tcpactivation/+merge/11194515:18
dobeyugh15:20
dobeyi didn't realize you were importing it into the tree15:20
mmccmandel: thanks, d'oh15:20
mandeldobey, yes.. that is why I wanted to remove it15:20
mandelmmcc, ping me when done and I'll +115:21
briancurtinoh cool, VMWare workstation is free for 30 days as long as you don't actually *use* it. helpful...15:21
dobeydoh15:22
ralsinamandel: we don't claim to keep metadata, including permissions15:25
ralsinamandel: so we could just change them15:25
dobeymaybe i should backport the new pep815:25
mandelralsina, well, is something worth thinking at some point, now know :)15:25
ralsinamandel: consider it known ;-)15:25
alecumandel: ping15:28
mandelalecu, pong15:29
alecumandel: can you give me a bit more of detail re: "it looks like the env var that sets the xdg_config location is not working correctly"15:29
alecumandel: where is that being set?15:29
alecumandel: I'm talking about this branch: https://code.launchpad.net/~alecu/ubuntu-sso-client/use-pycurl-1-4/+merge/11063615:29
dobeythisfred, mmcc: trivial branch when you get a chance https://code.launchpad.net/~dobey/dirspec/fix-pep8/+merge/11214315:30
dobeyalecu: it should be getting set by u1trial15:30
mandelalecu, so AFAIK u1trial sets the xdg values for the tests under _trial_temp if you are getting diff values is either because the env value is not set correctly of the test is harcoded to use a path that depends on the env var15:30
thisfreddobey: +1ed15:31
mandelalecu, the fact that in our systems is ok and not in tarmac might mean we have to check what is happening there or fix the tests to be less fragile to changes in the env15:31
alecumandel, dobey: do you guys know if any of that changed recently on u1trial?15:31
dobeyno it didn't change15:31
mandelalecu, but it is a guess of where the problem could be15:31
dobeyand the version on natty definitely hasn't changed15:31
dobeymandel: i highly doubt it's a "change to the environment" unless the tests themselves are changing the environment15:32
dobeyin which case, the tests are probably broken anyway15:32
alecudobey: do you know if tarmac uses the u1trial from nightlies? I tested on natty with nightlies and it did not exhibit this issue15:32
mmccdobey, approved your dirspec branch15:32
dobeyalecu: no; the natty version is using the version in natty15:33
dobeythanks mmcc15:33
alecuok, I'll try like that15:33
dobeyhmm15:34
alecugatox_lunch: small needsfixing and I'll approve: https://code.launchpad.net/~diegosarmentero/ubuntuone-client/darwin2-fsevents/+merge/11142715:34
dobeyalecu: ah i see15:35
dobeyalecu: the version in natty doesn't set XDG_CONFIG_HOME. it's only setting XDG_CACHE_HOME15:35
alecudobey: good catch15:36
alecudobey: should we change the branch to account for that?15:36
mmcchey, should u1lint take > 4 minutes on one file? seems like something must be wrong here15:38
dobeyalecu: no. i'll upgrade ubuntuone-dev-tools there, to the version from oneiric, which i think has that fix in u1trial15:38
alecudobey: great, thanks.15:39
dobeyalecu: so don't worry about it. i'll poke at it after lunch. if i think you need to do anything else to your branch i'll ping you. :)15:39
alecudobey: thanks!15:39
gatox_lunchalecu, great, thx!15:40
dobeyand now. need to get lunch. bbiab :)15:40
mandeldobey, alecu, so I was more or less right? is the env var :P15:42
* mandel wants some recognition hehehe15:42
mmccoh, u1lint ignores its args and just lints everything in $CWD. oh.15:43
dobeymmcc: yeah u1lint only has an --ignore option15:45
dobeyok, really off to get lunch15:46
mmccmandel, pushed the pylint fix you pointed out to that branch15:49
ralsinalunch it is15:50
mandelgatox_lunch, some evil review: https://code.launchpad.net/~diegosarmentero/ubuntuone-client/darwin3-fsevents/+merge/11166616:06
mandelgatox_lunch, sorry but I think we need to clean the code a little before it lands16:06
mandelgatox_lunch, I think we can dramatically reduce the number of lines of darwin3-fsevents if we merge the tests from windows and darwin16:13
=== gatox_lunch is now known as gatox
gatoxmandel, we already talk about that in the mumble16:15
gatoxmandel, we said that we are going to do this branches this way, and then refactor the tests16:15
mandelgatox, ok, well there are a little more things than the tests :)16:16
gatoxack16:17
mandelgatox, I went through the code very carefully but I  might have missed something, please read the review and let me know if I make sense16:18
mandelgatox, specially because i'm close to my EOD :P16:18
gatoxmandel, i agree with your comments, and thanks for the careful review.... i'll work fix that (except the merging tests :P that we already agree different things before)16:21
mandelgatox, super :)16:21
mandelmmcc, do you have a windows vm?16:28
mmccmandel: yes why?16:30
mmccI'm just about to run controlpanel tests there16:30
mandelmmcc, can you run the tests of your branch and sso trunk, I think we broke sso on windows :)16:30
mmccmandel: I ran windows sso tests, what's breaking?16:31
* mmcc checks email16:31
mandelmmcc, I might have an outdated version of dev-tools I needed someone else to be sure they are not broken :)16:31
mmccmandel: paste?16:32
mandelmmcc, give me a sec, I just updated devtools, it can be just a deprecated dependency16:33
mandelmmcc, which it was, awesome +1 :)16:33
mandelok, EOD here, see you all tom!16:38
mandelo/16:38
gatoxmandel, bye16:38
leo-unglaubhey, aquarius i have a question according to your session about u1db the other day16:41
leo-unglaubdo you have a minute?16:41
thisfredleo-unglaub: maybe I can help?16:42
leo-unglaubmaybe :)16:42
leo-unglaubaquarius was talking about how we developers should not be worrieing about writing your own sync tools for our tools and use u1 for that...so i wanted to integrate u1 in all my tools for syncing and provide better ubuntu support16:43
leo-unglaubbut i looked at the specs...16:43
leo-unglaubTHERE IS NO CLIENT SIDE ENCRIPTION16:43
leo-unglaubi thought it was a joke, but there is really nothing is there?16:43
thisfredI'm not sure if you're talking about u1db or ubuntuone file sync?16:44
leo-unglaubboth16:44
thisfrednot that it matters much for the answer I think :)16:44
thisfredso: we don't encrypt, because we want users to be able to access and use their data in the cloud by default. Of course we transfer the data over a secure connection, so it's not readable on the wire.16:45
thisfredIf an app developer or a user wants their data to be encrypted, there is nothing stopping them from encrypting it client side16:46
ralsinaleo-unglaub: if we did the encryption and decrypted on download, any other app would still be able to read. If you want the data to be secure, just sync encrypted data.16:46
leo-unglaubhmm, but what kind of data should i store in the u1db if it is not encripted?16:47
leo-unglaubcanonical can read all the user data in the current version16:47
leo-unglauband that is simply not okay for every kind of user data16:48
thisfredleo-unglaub: well, maybe not your banking software passwords, but there is a world of data that is less sensitive than that16:48
ralsinaleo-unglaub: for that kind of data, encrypt before uploading.16:48
thisfredleo-unglaub: yeah, as an app developer and user, you need to think about the risks (which is no different than with any other online storage). If you want encrypted everything by default, there are other options, u1 might not be the best fit16:49
leo-unglaubhmmm, i have 3 types of data i wanted to adapt to u1, thunderbird contacts, filezilla server settings and pidgin account informations16:49
leo-unglauband there is no way that i put those data in u1db unencryptet16:50
leo-unglaubokay, sure i can do my own encription on top of that16:50
leo-unglaubbut...16:50
ralsinaleo-unglaub: are you storing them on disk unencrypted?16:50
leo-unglaubnow every tool has do there oen encription, there own keys....the point of using u1 is for me, that i have 1 interface to do all that16:51
leo-unglaubralsina: of course NOT16:51
leo-unglauball discs are encripted...16:51
thisfredleo-unglaub: that is of course a completely valid choice, but most users are not as sensitive about most of their data16:51
ralsinaleo-unglaub: but every process after boot can read it16:51
leo-unglaubralsina: every process with read permissions to my home dir, yes...exception the pidgin accounts..there is a special password on that encfs partition16:52
ralsinaleo-unglaub: I am all for encryping it. Don't use per-app keys, use the user's gpg keys from the keychain, if you want. Those should already be protected by a passphrase16:52
thisfredleo-unglaub: also I take it you don't use gmail or any mail provider, but run your own smtp? ;)16:52
ralsinaleo-unglaub: like thisfred said, it's very possible that u1 is not what you want to use in this case. Keep in mind that for other services, all you have is their word that they can't decrypt your data ater upload.16:53
leo-unglaubthisfred: well, as i am working in this business...yes, i have my own smtp/imap servers running. but even without..all messages are crypted..16:53
leo-unglaubthunderbird/enigmail FTW ;)16:54
leo-unglaubralsina: Keep in mind that for other services, all you have is their word that they can't decrypt your data ater upload.<- where is the difference to ubuntu one?16:54
thisfredleo-unglaub: well, again, perfectly reasonable, but not like most people's requirements16:54
ralsinaleo-unglaub: if you do your own encryption, you don't have to take our word for it.16:54
ralsinaleo-unglaub: you can use the same gpg settings you use in enigmail, even.16:55
dobeygrr dpkg16:55
leo-unglaubi don't get the point of "all the others  also don't to it"16:58
leo-unglaubu1 is a native linux client..16:58
leo-unglauband i think every wayy to make it better is soe thing to think about..16:58
leo-unglaubwe are not apple where we do like your clients are stupid..16:58
dobeybetter is not an objective thing16:58
leo-unglaublinux users always care about security..16:59
thisfredleo-unglaub: yes but encrypted all the way is not objectively better. Obviously better for your use case, not great if you want to view your contacts on the web or stream your music16:59
dobeylinux users don't care any more or less about about security than any other users16:59
thisfredit's a tradeoff between features and levels of security16:59
beuno_leo-unglaub, our target also isn't "linux users", we have a Windows client, android, iOS16:59
beuno_building more17:00
=== beuno_ is now known as beuno
thisfredand for some data, for some users encrypting by default is not the best choice17:00
leo-unglaubwell, i know you have clients for other os, but everyone knows that even on linux there are not so much users..17:03
dobeys/knows/assumes/17:03
thisfreds/everyone/?/17:04
leo-unglaubyou hear things in some channels ;)17:04
leo-unglaubbut thats not the point..17:04
beunoleo-unglaub, the point is Ubuntu One's main focus is not maximum security, it's convenience17:05
beunoso that's what drives everything we do17:05
beunomaking things more convenient to users17:05
dobeythe most secure data, is no data17:05
ralsinadobey: the most secure data is sorted data. bit-sorted.17:06
thisfredmost secure sync is cp * /dev/null17:06
leo-unglaub....17:07
dobeyralsina: i have the bestest encryption method ever. it's also the best compression. it just replaces everything with 0s17:07
leo-unglaubwell, i thought it woul be in your interest to have a sync for thunderbird, filezilla, pidgin in u1, but sadly you donÄt care..17:07
dobeynobody can read it after, not even you!17:07
leo-unglaubokay, so i won't implement it17:07
ralsinaleo-unglaub: we do care17:07
ralsinaleo-unglaub: it's just that we are not going to implement ecryption across the whole stack to get it17:07
dobeyleo-unglaub: login information is not something you should just blindly sync17:08
dobeyleo-unglaub: and thunderbird has u1 support17:08
ralsinaleo-unglaub: and break file publishing, folder sharing, and other stuff to get it17:08
leo-unglaubdobey: the thunderbird support is broken sience a few versions17:08
dobeyleo-unglaub: i don't mean the desktopcouch thing17:09
leo-unglaubi don't know any other way of doing it..17:10
leo-unglaubbut maybe i missed something there..17:10
dobeythere's a new thing in thunderbird that has support for u1, but i forget what it's called17:11
dobeythough i don't think it is for syncing contacts17:11
leo-unglaubyou mean the eds contacts?17:11
dobeyoh, "filelink"17:12
dobeyeds is how thunderbird contacts sync currently works17:13
leo-unglaubwith don't work as expected17:13
leo-unglaubbut..again...thats not the point i am trying to make17:13
leo-unglaubso, to make this short..you are not planing to add encription to securen the user data and respect there privacy?17:16
thisfredleo-unglaub: we have no plans to add encryption by default at this point, no17:17
leo-unglaubno one is talking about default...simply an option to allow it would be also fine..give users the choice..17:17
dobeyyou have the option now17:18
thisfredthey have the choice :)h17:18
thisfredapp developers can choose to use encryption, as can individual users17:18
ralsinaleo-unglaub: we respect their privacy, thank you very much.17:19
leo-unglaubsry, brb we can continue this later17:30
=== eu is now known as adorilson
joshuahooverralsina: any idea what would cause this error on ubuntu? ubuntuone.SyncDaemon.StorageClient - INFO - Connection lost, reason: [Failure instance: Traceback (failure with no frames): <class 'OpenSSL.SSL.Error'>: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]17:50
mandel__gatox, ralsina, alecu, may I have reviews for https://code.launchpad.net/~mandel/ubuntuone-client/darwin-inhibitor/+merge/11217917:50
ralsinamandel: will review17:50
ralsinajoshuahoover: looking17:50
mandel__is super easy, just fixes the inhibitor issues in windows and darwin17:50
gatoxmandel_, yes17:51
joshuahooverthanks17:51
ralsinajoshuahoover: looks like it maybe failed to connect to the server17:51
mandel__gatox, thx!17:51
mandel__mandel, dude, you are goood looking!17:51
ralsinaalecu: any ideas for joshuahoover ^17:51
mandel__:P17:51
joshuahooverralsina: right, i haven't seen that particular error before...and user has tried connecting with no luck so far17:51
gatoxmandel__, i'm still fixing the branch with your comments..... when i finish (the first time), i realize i did it in a different branch17:51
* gatox wants to kill himself17:51
mandel__gatox, hehe17:52
* gatox thinks he should sleep more17:52
ralsinamandel: +117:52
mandel__ralsina, thx!17:53
gatoxwhen i see from ralsina : +1 code review...... i understand: you, the next one..... run the tests!17:54
gatoxralsina, yes sir! :P17:54
mmcclunchtime...17:54
alecuralsina: catching up with the backlog....17:56
alecumandel__: do I owe you more re-reviews? can you send me the links?17:57
mandel__alecu, let me check17:57
mandel__alecu, this is the only one https://code.launchpad.net/~mandel/ubuntuone-client/better-encoding/+merge/11158017:58
gatoxmandel__, +118:02
mandel__gatox, thx18:03
alecujoshuahoover: can you get SD logs for that error?18:09
joshuahooveralecu: i have them...i'll paste a sample for you18:09
=== zyga is now known as zyga-afk
=== leo-unglaub is now known as Franzi4Ever
=== Franzi4Ever is now known as LongDongLeo
=== LongDongLeo is now known as leo-unglaub
=== leo-unglaub is now known as bigball
=== bigball is now known as leo-unglaub
gatoxfuuuuuuu never again a branch so big......18:48
gatoxalecu, ping18:56
alecugatox: tell me18:57
alecugatox: (I've got 5 mins before leaving for kinder)18:57
gatoxalecu, your comment in my second branch: if not isinstance(path, unicode):18:58
* gatox types fast18:58
gatoxalecu, i fix that in the next branch, where i actually add the things for mac.....18:58
gatoxwhere i added a assert to see if we receive bytes18:58
gatoxwhich is actually what the lib wants18:58
gatoxalecu, so, if it's ok with you, in the second branch i should only fix the docstring18:58
dobeywhat a day18:59
alecugatox: no problem!18:59
gatoxalecu, cool18:59
gatoxalecu, mandel did a really complete review of darwin3..... and i already fix that.... so you can maybe take a look at that one when you have a moment19:00
alecugatox: sure19:00
gatoxalecu, muchas thanks!19:00
alecugatox: you're nada!19:00
gatox:P19:00
alecugatox: i mean "de welcome".19:01
gatoxthat doesn't sound very wellll19:01
gatoxjejeje19:01
alecugatox: lols, yes.19:01
gatoxjejeej19:01
gatoxalecu, branc updated19:25
dobeyralsina, briancurtin, joshuahoover: what's the bug # for the "doesn't start in win xp" problem?19:35
briancurtinlooking19:35
briancurtindobey: #101701919:36
joshuahooverbeat me to it19:36
dobeybug #101701919:36
ubot5Launchpad bug 1017019 in Ubuntu One Client "3.0.2 not run on XP" [High,Confirmed] https://launchpad.net/bugs/101701919:36
dobeythanks19:45
mmccugh, more implicit reactor installation on windows than on darwin...20:00
mmccdo we *really* need to import controlpanel.backend just to get UBUNTUONE_LINK ?20:02
mmcc(in ubuntuone/controlpanel/gui/__init__.py:26)20:03
gatoxok...... eod for me..... and i need to go to the doctor in a while...... so, bye people!! see you tomorrow!20:03
mmccbye gatox20:04
mmccso we have a toplevel 'constants.py' (generated from .in in setup) where UBUNTUONE_LINK (and a lot of other stuff in gui/__init__.py ) should probably go, IMO20:05
mmccanyone want to comment on moving more constants into toplevel constants.py.in?20:06
mmccalecu, ralsina, dobey ^20:06
dobeynot sure20:06
ralsinammcc: I am ok with it, in principle, but I would ask nessita for her opinion, too20:07
mmccok20:11
mmcchmm, nessita not around right now?20:12
ralsinammcc: looks like she isn't20:12
mmccwell, the other solution is to install the qt4reactor first on windows, since that seems to work (not sure why), and move it after the UniqueApplication init just for darwin20:14
mmccthat'd require less moving things around20:14
briancurtinah wtffffffff XP20:16
dobeymmcc: it's tuesday. she's at uni in the afternoon20:16
ralsinabriancurtin: details, please20:20
ralsinabriancurtin: not that I disagree, in general20:20
mmccah, ok thanks dobey20:21
briancurtinralsina: just trying to get an XP-built installer to work on XP. i have the env setup but something is missing. its less of an XP problem that im currently complaining about. i cant tell if bitrock or py2exe is behaving differently here or what because pkg_resources isnt being found (from distribute) even though its in the env and i can import it.20:23
briancurtinanyway, yeah, just trying to build an installer on XP itself which i can then try out on my 100% clean XP image (which contains no vs2008 crt)20:23
ralsinabriancurtin: ack :-(20:24
briancurtin$200 later i have a nice VM setup to test vanilla XP, though20:24
ralsina$200?20:31
briancurtinralsina: that's what it costs to buy VMWare Workstation. the free ones don't let you snapshot or easily create duplicates. now i have a base install with nothing, cloned it and built a dev environment, and when i can make a functioning installer out of it, i'll run it on the vanilla XP image20:32
ralsinabriancurtin: ouch20:32
briancurtinoh, and they have a free 30-day trial which is only useful if you just want to start it up and look at it. actually turning on a VM requires that you pay20:32
ralsinabriancurtin: virtualbox has those things... It does have an unfortunate tendency at exploding every 4or 6 months for me, butnot for everyone!20:33
briancurtini've been meaning to get VMWare Workstation for a while, never really knew about virtualbox. i probably should have researched...just wanted to get this going ASAP so i can get it over with20:34
ralsinahave to EOD to pick my kid from football20:34
briancurtinsee ya20:34
ralsinabriancurtin: good luck with that, send me a status email please?20:35
ralsinawill drop by and do stuff late at night. bye!20:35
briancurtinralsina: hopefully i have more than "XP is awful", but yeah i'll write something up20:35
ralsinabriancurtin: hehe, let's hope :-)20:38
mmccurgh.20:41
dobeyi suppose i should name my new workstation the same as my current workstation is named20:41
mmccreactor imported in filesystem_notifications too, I just missed it because I don't have gatox's branch yet20:41
dobeyas i have done for the past however many times I've upgraded it20:42
dobeythisfred, mmcc: sanity check please https://code.launchpad.net/~dobey/ubuntuone-dev-tools/update-4-0/+merge/11221720:46
thisfredyours or mine?20:49
mmccapproved, dobey20:53
dobeythanks20:53
alecummcc: ralsina: tuesday evening is the time nessita goes to teach, so better ask her tomorrow.21:02
alecudoh, dobey already said so.21:03
dobeyheh21:05
dobeyhrmm21:08
dobeytoday has been a bad brain day21:08
briancurtinoh wtf. am i really going to have to build this installer, see what fails, add a new file, build it, see what fails, over and over.........21:14
briancurtinjeuss21:14
briancurtinjesus, even21:14
dobeybriancurtin: did you not read the fine print in the job description? pretty sure it said "mechanical turk" in there. :)21:18
briancurtinit seems like the build process on XP included all standard library modules which *aren't* needed, rather than trimming to just the ones it needs21:19
dobeylovely21:20
briancurtinoh py2exe, how fun you are21:20
mmccargh, even importing setup_logging eventually creates a reactor21:24
mmccvia filesystem_notifications this time21:24
mmcc(on windows, and soon on darwin too)21:24
dobeyheh21:25
mmccI think I'm going to need to fix it now on windows, then wait for the various filesystem_notifications darwin branches to land, and fix it there too...21:25
mmccwhere fix it means move the 'import reactor' into a few functions so we don't create a new one too early... that's already been done in a few other places, by nessita no less21:26
alecummcc: yes, some of those bits are awful21:27
mmccyeah, I was trying to think just now what I'd prefer twisted to do. obviously not start the wrong reactor when I import it. I think I could handle needing to do something like 'from twisted.internet import get_reactor' and 'reactor = get_reactor()' or something21:31
dobeyok, i'm off21:34
=== salgado is now known as salgado-afk
dobeyhave a good evening all21:34
briancurtinralsina: i got a trunk installer to work on XP after manually running vcredist before installing. i think we may need to condition the installer to run vcredist on XP - i am 99% sure 7/vista won't need it but im setting up clean VMs for them right now21:43
mmccbriancurtin: how much do you know about pyqt/qt4reactor on windows? I'm about to make a change so that on windows we install the reactor after we've inited the QApplication. On darwin this makes qt4reactor create a QCoreApplication, which messes up the GUI event handling. I swear windows should have the same problem, but it doesn't...21:56
briancurtinmmcc: nothing21:56
mmccok, cool. well, if it blows up I know how to make it work again21:57
briancurtinmmcc: i know how to install pyqt and that's the extent of my pyqt experience21:57
mmccdo you know much about straight Qt? the issue is really that we create a QCoreApplication when we want a QApplication21:57
mmccI haven't read up on what exactly that changes, but it's clear that GUI apps need a QApplication21:58
mmccanyway, thanks :)21:58
briancurtinmmcc: nope, ive never done anything relating to Qt of any form. i have somehow avoided it up until apparently now21:58
briancurtinor, until this testability debacle as well21:58
alecummcc: I'm not a fan of messing too much with the qtreactor + pyqt stuff on windows... I recall it took a while to make it work properly.22:05
alecummcc: I hate the qtreactor in fact, and as soon as we can get rid of it, I'll be 38% happier.22:07
mmccalecu, understood. were the earlier problems this "reactor already installed" error, or somethign else?22:07
alecummcc: "reactor already installed" is the milder of the problems :-)22:07
mmccbecause I think I have a handle on that, but if I'm about to smack another beehive I'd like to know22:08
alecummcc: I've got a few segfaults22:08
mmcc:(22:08
mmccwell, I could certainly leave the win32 specific code as-is, and just do different stuff on darwin...22:08
alecummcc: "already installed" has to be worked around by moving imports around and into functions, as you've already appreciated...22:08
alecummcc: but in my experience initialization order issues are much trickier22:09
mmccI wonder if the segfaults are related to having the QCoreApp instead of the QApp...22:09
alecummcc: for the reactor initializations, having different stuff on both platforms is just fine with me.22:09
mmccok, cool.22:10
mmccthat said, as I mentioned above, I'm missing something because the code as it is *should* blow up on windows too22:10
mmccso - despite my curiosity about what's going on with windows, I'll just leave it alone and fix it for darwin separately22:16
mmcchrm, installing the reactor in main() breaks tests, which have already installed their own reactor.22:50

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!