/srv/irclogs.ubuntu.com/2015/01/30/#ubuntu-quality.txt

elopioveebers: (and alesage if still around): I have a problem selecting a subset of the tests. If we want to return an error when the test doesn't exist, then the host needs to have all the test packages installed too.02:24
elopioso far, only the phone needed all the test packages.02:24
elopiodo you see that as an issue?02:24
veeberselopio: hmm, that's a good point (I've come across something similar just recently where there was code in webbrowser that isn't on utopic (but is on vivid)02:25
veeberselopio: so if we want the test on the host machine too we'll have to expect that the user is running vivid.02:26
elopiooh, right, that's an additional problem. If the host is in a different distro, the check is worthless.02:26
elopioveebers: alesage: I'm now inclined to let adt-run fail when we specify non-existing tests, instead of catching the error earlier.02:37
veeberselopio: yeah, that sounds good to me. It's a good start at least. If we get user feed back we can go from there02:37
veebers(Do the min. to get a card done and iterate with the users for further enhancements)02:38
elopioveebers: do you see any problem if we put the testsuite_list in the ubuntu_sanity_tests folder?02:39
veeberselopio: where is it at the moment?02:39
* veebers looks02:40
veeberselopio: I can't think of a better place off the top of my head02:42
elopioveebers: do you mean, you can't think of a better place than debian/test/ ?02:43
veeberselopio: sorry, I can't think of a better place than what you've suggested02:44
elopioack.02:44
veebersthis is for the work of separating out the code from d/t/ right? So it'll need to be in a discoverable place02:44
elopioveebers: yeah, I want to put it under test to then be able to test the subset story.02:45
veebersack02:45
veebers+102:45
elopioveebers: I'm thinking ubuntu_sanity_tests/external_tests/testsuite_list02:45
elopiowith updates in the README, of course.02:45
alesageelopio, something funky with my phablet-network on the serial branch: http://pastebin.ubuntu.com/9947891/03:03
veebersalesage: doc looks good, have left notes.03:04
alesageweird actually I'm getting that same return for the success case above :/03:04
alesageveebers, thx03:04
veebersalesage: hey, that looks like the error that I've had in the past (as per my comments re: flashing and starting tests)03:05
elopioalesage: I have no idea what that error code means.03:05
alesageelopio, please tell me all the answers03:05
elopioalesage: do you have the serial on the config, or not?03:05
alesageelopio I started fresh and no I didn't give the serial03:06
alesageelopio, but I think I just demonstrated that phablet-network itself does give that code for me raw03:06
veebersalesage: when you say fresh, did you delete your config file?03:07
elopioalesage: yeah, no errors here.03:14
elopioalesage: you might want to try jibel's alternative with nmcli: https://bugs.launchpad.net/ubuntu-sanity-tests/+bug/1408720/comments/203:14
ubot5Error: launchpad bug 1408720 not found03:14
elopiothat's something we need to do anyway, I think.03:14
alesageelopio I'm being selfish with reviews ATM :( , but also need to eat, will get a couple in03:23
elopioalesage: you should also rest. I'm here only because I slept all evening :D03:24
alesageelopio, maybe I can *reserve* either the reviews or the "subset of tests" for tomw, subset would enable some pairing03:25
alesageelopio, or you're already knee-deep on that one, eh?03:26
elopioalesage: I've splitted it in two, and took the smaller task first.03:26
elopiogetting the existing code into test.03:26
elopioalesage: main thing are reviews. Then, whatever is on top.03:26
alesageelopio, I'll focus on reviews and getting everything running AM03:27
elopiook.03:28
veebersnote, I added a new card in the review column re: timeout03:29
alesagemaybe we can leave those in the lane, e.g. if brendand also reviews03:29
veeberswell, they do need to acks to merge :-)03:30
elopioveebers: brought back your timeouts branch. It is one line, but I still think it should be tested, and we now have the helpers to make it quickly.03:47
veeberselopio: ah good point. I'll look into that shortly03:47
veeberselopio: I see that you voted for plivo, what's the main reason for that? (e.g. I see that the python lib is not python303:49
veebers)03:49
elopioveebers: main reason, it's free.03:50
elopiothe lib is small, so quickly we can make it py3. At a first glance, I didn't see any big changes required for that.03:50
veeberselopio: no it's not, the first line says it'll cost money03:50
veebershmm, ok fair enough as long as they take that contribution back, It would suck to have to distro patch that just for our own use03:51
elopioveebers: free as in freedom. We can install our own plivo server, and it won't cost money. Well, only the cost of the call.03:51
elopioveebers: I doubt they won't accept our contribution. Since I signed in, they send me constant emails, it seems it's a company that's alive.03:52
veeberselopio: I may have missed something, why would we install our own server? We only need a webservice (for either provider) right? They have a REST api that we hit03:52
elopiobut, we have to check, you are right.03:52
veeberselopio: I'm not disagreeing with you, just wanting to know the reasons and talk through them03:53
elopioveebers: I'm not saying that we need our own server. I'm saying that we can have it.03:53
veebersack03:53
elopiofor security reasons, cost reasons, or anything. But for me, just the open source code makes me feel better.03:53
=== chihchun_afk is now known as chihchun
=== chihchun is now known as chihchun_afk
=== chihchun_afk is now known as chihchun
=== chihchun is now known as chihchun_afk
=== chihchun_afk is now known as chihchun
=== chihchun is now known as chihchun_afk
brendandelopio, hey14:58
elopiobrendand: hello!14:58
brendandelopio, let's try to land as much as possible today!14:59
elopiobrendand: yes indeed. Are you in need or a review?14:59
brendandelopio, top approve: https://code.launchpad.net/~brendan-donegan/ubuntu-sanity-tests/fix_wizard_test/+merge/24799514:59
elopiobrendand: top approved.15:00
brendandelopio, review: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/specific_config/+merge/24784115:00
elopiobrendand: yes, the same test as autopilot, I like it. Thanks.15:01
brendandelopio, oh really, what a coincidence ;)15:01
elopiobrendand: approving. alesage: can you please give the second review to the specific config branch? ^15:02
elopiobrendand: and one thing for discussion. I prefer to keep the imports at the module level, not the object level.15:04
elopiolike import argparse, and then use it like argparse.ArgumentParser(...)15:04
elopiobecause when you read the code, it's easier to tell which module is it that you are calling. In this example, it's obvious that ArgumentParser comes from argparse, but there are other symbols harder to link to a module.15:04
elopiobrendand: do you have any preference there?15:04
brendandelopio, i think if the only symbols you're using are obvious then it's worth importing that way since it makes the code look cleaner15:08
brendandelopio, we couldn't use the other symbols if we don't import them anyway15:09
elopiobrendand: I find it cleaner if it is consistent. But that's a fair point.15:09
brendandelopio, why use 'from' at all then?15:10
elopioballoons: to only use one level of modules.15:10
elopiofrom ubuntu_sanity_tests import tests, instead of import ubuntu_sanity_tests.tests.15:11
elopios/balloons/brendand15:11
brendandtrue15:11
elopioalesage: you left a needs fixing here: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/optional_options/+merge/24788115:11
elopiocan you please check if you are happy with it now?15:12
elopiobrendand: now lets talk about the coverage in https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/no_serial/+merge/24794015:13
elopiowe are testing the same thing as before, the difference is that now we are not putting mocks everywhere.15:13
elopioso, I wouldn't call it a coverage drop. I would call it an increase in accuracy :)15:13
elopioto get everything under test in this module, we have the big problem that it needs subprocess execution. So we need to figure out how to do it properly.15:14
brendandelopio, run_sanity_tests is not covered at all now15:14
elopiobrendand: before, it was run, but all the things that were hard were patched.15:15
elopioso it was the same as not running it.15:15
elopiothis branch is about serial, so the tests only check that the serial was passed or not.15:15
elopiowe need to put the other things into a test, but that's a different card. A harder one.15:16
brendandelopio, sounds like you're saying code that is trivial is not worth testing?15:16
elopiobrendand: not at all. This run_sanity_tests method is not trivial at all.15:17
elopioand it needs to be tested.15:17
elopiowhat I'm saying is: it was untested before, this serial card was not about putting it under test.15:17
brendandelopio, it was tested before. maybe not thoroughly, but it was15:18
elopiowe need a card to increase the coverage of command_line execution, and I have no idea how to do it properly. Needs discussion.15:18
brendandelopio, see: http://people.canonical.com/~brendan-donegan/ubuntu-sanity-tests/trunk/htmlcov/ubuntu_sanity_tests_command_line.html15:18
elopiobrendand: no, it was run, but not tested. You reviewed the tests in the original serial branch.15:20
elopiowhat I did there was to call run_sanity_tests, but patch the IO, patch the report generation, patch popen, and only assert that -s was passed.15:21
elopioif you look at the new tests, we are testing the same. And now it's clear that run_sanity_tests needs tests.15:21
brendandelopio, did you remove test_main_must_setup_and_run_with_serial because it would fail with the new code?15:26
elopiobrendand: no. Look at rev 59: https://bazaar.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/no_serial/revision/5915:27
elopioI first made the new code pass with the old style of tests.15:28
elopiothen I followed vila's suggestion to split the commands into build and run, and test only the build, which removes the need of mocks leaving us with the same tests.15:28
=== roadmr is now known as roadmr_afk
elopiobrendand: I can revert to rev 59, which will give us a high but deceiving coverage number, and ugly tests.15:29
brendandelopio, what i'm asking is does anything stop you from reinstating test_main_must_setup_and_run_with_serial15:30
elopiobrendand: no, I can revert to rev 59.15:31
brendandelopio, but if you revert won't you lose other tests you added/changed?15:32
saqman2060I was testing the autoresize feature and was unable to continue the install. The "install" button was grayed out. I was able to resize the partition but not finish the install. I am testing daily version " 20150129" using virtualbox 4.3.20.15:32
brendandelopio, i think all the new tests you added are good and valuable15:32
elopiobrendand: I would lose the cleanups I did on the tests. I didn't added new tests. I split them and removed the mocks, except the IO ooooooooone.15:33
elopioone15:33
brendandelopio, are you looking at this diff: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/no_serial/+merge/24794015:34
brendand?15:34
alesageelopio I'll get on those reviews15:34
brendandelopio, the diff on test_command_line shows test_main_.. being removed and six new tests added15:35
brendandelopio, ah you split them15:35
brendandok15:35
elopiobrendand: I am. Compare the tests in rev 59 with the tests in rev 65.15:35
elopioalesage: thanks.15:36
brendandelopio, anyway next move is yours, reply on the MP15:38
elopiobrendand: I'd say, next move: add a card to put run_sanity_tests under test. But the only thing that comes to mind is to patch Popen and check the order of popen calls.15:40
elopiowhich is a little better than what we had before, but not good enough.15:40
elopiobrendand: do you want me to do it in order to get this branch landed? Or we put it in the backlog and decide later when to do it?15:41
brendandelopio, if you could reinstate the test (in addition to the ones you added), then put a card or a bug to do the tests 'right', if that will require a significant amount of time15:42
elopioIMO, that makes no sense. Between 59 and 66 I added no tests, so that would be testing the same thing twice, once ugly and once nice. I will just make a new branch to raise the coverage.15:45
elopiobrendand: btw, I think you moved the wrong card back to doing.15:47
elopiounless I'm missing something. The one you moved has your +1.15:47
brendandelopio, ok reply in the comment what you think to do next15:54
brendandelopio, fixed the board.thanks15:54
brendandelopio, and get some feedback from alesage15:59
elopiobrendand: alesage: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/run_main_tests_tests/+merge/24813516:06
elopiothat excercises run_main_tests just as how it did the serial branch, but has a check that makes a little sense.16:07
=== roadmr_afk is now known as roadmr
brendandelopio, we don't have sudo inside the tests themselves?16:26
alesageelopio concerning this last MP, and I was studying this a bit yesterday, this feels a bit tortured to me, why don't we just fake those calls in run_sanity_tests and then test those functions separately?16:29
elopiobrendand: we can, but it makes some things harder.16:29
elopiowe can tell in debian/tests that we require root access.16:29
brendandelopio, not having it also makes some things harder :)16:29
alesagethe patented "fails only in one place" method as Mr. Richards is always saying16:29
elopiothen we will be running with the root user, and have to switch to phablet at some point.16:30
alesagealso I'm not sure I understand why __enter__ is executed here instead of __init__16:30
elopioalesage: Popen is called from with, thus we need to patch enter.16:30
elopioI was trying to split things and test them separately, but brendand requested to bring back the run_tests test16:31
alesageok it's brendand's fault16:31
elopiono, it's mine for making the ugly test to begin with.16:32
knomeit has to be balloons' fault16:32
* knome runs16:32
* balloons desperately tries to catch a fleeing knome, but he's gone16:33
alesageelopio, I see that it works but I want to refactor it :) , can I approve and then do so in a separate MP?16:35
elopioalesage: the branch is shared. You can just make your changes and push to it.16:36
elopiojust bring the card back to doing, and assign it to yourself.16:37
* alesage grabs a bunch of strings from balloons floating away16:37
elopioalesage: but, please do the missing reviews first. We are only three today, so we need your reviews before brendan leaves.16:37
alesageelopio, ok thanks16:37
alesageelopio, ok shall do16:37
* elopio looks at the browser branches.16:38
brendandalesage, a top approve for https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/specific_config/+merge/247841 pretty please16:40
alesageI like that everyone needs my approval16:42
alesagebrendand, elopio I have a lunch invite at our standup time, maybe we could meet quickly earlier to let brendand go earlier?16:51
brendandelopio, i could write a helper which switches to root and another which switches back to phablet16:51
brendandalesage, wouldn't mind meeting something in the next 30 minutes16:51
brendandalesage, so i can EOD :)16:52
elopioalesage: good for me.16:52
brendandelopio, top of the hour?16:52
elopiobrendand: sounds ok to me. We tried it some time ago, and it was easier to put the root commands in the setup. But if you make it work, seems the same to me.16:52
alesagebrendand, top o' the hour to you :)16:53
elopiobrendand: alesage: in 7 minutes. I'll prepare the document.16:53
brendandalesage, i had literally no idea you'd say that...16:54
alesagebrendand, I'm so unpredictable!16:54
alesagealso it's Friday16:54
elopiobrendand: meeting time.17:00
brendandalesage, i'm not leaving until that mp is approved :)17:19
alesagegoing to be a loooong night17:19
elopioalesage: please top-approve anything that you see as ready, and move the cards. I'm going to take a little break.17:19
alesageelopio, ok17:20
alesagebrendand, need a push there17:20
alesagebrendand, poke17:24
brendandalesage, oh might have got stuck, been having problems with that today17:25
brendandalesage, repoke17:25
alesagebrendand, k17:25
brendandindeed, bzr push was hanging17:25
brendandgrrr17:25
alesagebrendand, took the liberty of moving that card thx17:26
brendandalesage, elopio - thanks and good night!17:30
brendandemail me if anything urgent17:30
elopioenjoy the weekend brendand.17:31
cgoldberghola 0/17:39
balloonscgoldberg, hola :-)17:40
elopiocgoldberg: o/17:40
cgoldbergi'm itching for an afternoon self-project.  I might pave my desktop and start running Vivid17:42
cgoldbergim still on Trusty17:42
balloonscgoldberg, oi, that's a longer term decision, but running -devel is fun17:44
alesagecgoldberg, big snows over there?18:02
cgoldbergalesage, yea.. like 2+ feet the other night... but Boston cleared it out pretty quick.. supposed to get more soon too18:03
elopiothanks for the reviews alesage. Now we are only two, so we can't land anything else. But the queues are actually pretty decent.19:09
=== roadmr_afk is now known as roadmr
alesageelopio, manually testing this no_serial one and then want to pick over the main testing one a bit19:10
elopioalesage: ok. I already top approved that one as it had +2. But it's always nice to have more reviews.19:11
elopioif you find something, we'll do it in a new branch.19:11
alesageelopio, ok, sure it's fine, although this quickie needs to get in on your serial branch fwiw http://paste.ubuntu.com/9961484/19:12
elopioalesage: oh, good catch. Let me see if I can stop jenkins.19:13
elopiojust in time.19:14
alesageelopio, I have to lunch, will do the rest upon return19:14
elopionow, how did it got in there? I suppose I borked one of the merges.19:15
alesageelopio, no brendand's branch introduced it19:15
alesagedon't know what else it affects19:15
alesage(i.e. into what else it's merged)19:15
elopioalesage: ah, I see. I didn't run that one.19:16
elopiook, so trunk is broken. I'll make a new branch.19:16
alesageelopio, have to assume Brendan didn't either :)19:16
Letozaf_balloons, hi19:42
balloonsLetozaf_, heelo19:44
Letozaf_balloons, I fixed pyflakes and pep8 on yesterdays mp19:45
Letozaf_balloons, by the way how's your wrist ?19:45
elopiowe broke trunk on friday :D19:48
elopiothere's a lesson there, somewhere.19:48
knomewrist? what have you done, balloons...19:48
balloonsknome, I was in a soft cast for my wrist for a couple weeks at the beginning of the month19:49
balloonsdoing great now Letozaf_ thanks for asking19:49
Letozaf_balloons, great :)19:49
davmor2elopio: is it don't release on FRIDAYS EVA!!!!!19:49
knomeaha... because? :)19:49
Letozaf_hello knome  :)19:49
elopiodavmor2: we release on thursdays, every two weeks. So the problem has not been released.19:49
knomehullo Letozaf_19:50
Letozaf_:)19:50
balloonsLetozaf_, approved19:50
knomedid you know "hullo" was the word stephen fry and hugh laurie used when they met each other the first time?19:51
Letozaf_balloons, thanks19:51
Letozaf_knome, hullo sounds strange to me, I prefer hello :P20:12
knomeheh20:13
knomeLetozaf_, how does "hyvää päivää" sound to you then? ;)20:13
elfyrude ...20:14
knomeelfy, hah :)20:14
elfyis what I'd say :p20:15
elfyif asked20:15
Letozaf_knome, ah man don't even know how to pronounce it20:15
knomeone of the few non-rude things you can say in finnish20:15
knome:P20:15
Letozaf_knome, elfy what does it mean?20:15
elfyLetozaf_: I think that the h,y,v,p's and a's are all silent :)20:15
knomeLetozaf_, http://www.forvo.com/word/hyv%C3%A4%C3%A4_p%C3%A4iv%C3%A4%C3%A4!/20:15
elfyLetozaf_: absolutely no idea - all dutch to me :)20:16
knomedutch.. ugh :D20:16
Letozaf_knome, OMG weired :P20:16
knomedutch is a weird language20:16
elfyhttp://en.wikipedia.org/wiki/Greek_to_me20:16
Letozaf_elfy, :) same for me20:17
elfy:)20:17
knomeLetozaf_, there you go: http://www.forvo.com/word/laadunvarmistus/#fi20:18
Letozaf_knome, :S20:18
knomewhat :P20:25
Letozaf_knome, means "confused" :P20:27
Letozaf_knome, as elfy said sound greek to me20:28
knomedo you mean hämmentynyt?20:28
Letozaf_sounds20:28
Letozaf_knome, if only I remembered Afrikaans well I could have answered you in Afrikaans, then :P20:29
Letozaf_knome, but I remember only a few words20:29
knome:)20:30
knomebut afrikaans is relatively understandable20:35
Letozaf_knome, yeah compared to finnish yes :)20:35
knome;)20:36
knomethey say finnish is one of the hardest languages in the world to learn...20:36
elfyMartian would probably be easier20:37
Letozaf_knome, lekker, biltong, Droëwors20:37
Letozaf_elfy, ha ha :)20:37
elfyhttp://www.effectivelanguagelearning.com/language-guide/language-difficulty20:38
Letozaf_knome, dronkie, krimpie. toppie20:38
elfyas related to English that is20:38
knomeelfy, yep..20:39
Letozaf_:D20:39
alesageelopio, I'm realizing that if two are pairing then the other two will be responsible for the reviews23:21
ubuntu-plainshort feedback: when upgrading from 12.04 to 14.04 with german language settings, ubuntu switched to firefox in english. firefox-locale-de was missing. ps: please make a simple feedback form, there are so many places to report or file bugs on that launchpad thingy, i dont know where to turn to23:42
knomeubuntu-plain, what would be a simple feedback form?23:45
knomeubuntu-plain, and how would the people who read it figure out what the feedback is about, if no categorization was made?23:45
ubuntu-plainone webpage with forms or a package selector. or a working ubuntu-bug without 7 windows and redirect to some webpage to register an account23:53
knomei don't understand how those forms or the package selector could be any easier, or less complex23:54
knomedo you realize how many packages there are in ubuntu?23:54
knomeanyway, for the registration part... without that, launchpad would be full of spam23:54

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!