/srv/irclogs.ubuntu.com/2015/02/06/#ubuntu-quality.txt

=== teward is now known as teward_
=== teward_ is now known as teward
pittielopio, dobey: there is no need to pass -v to autopilot tests, that's the default now; it also produces a subunit stream in the --output-dir06:44
pittifgimenez: also, I think we should discuss that in the public channel08:08
pittifgimenez: so, http://paste.ubuntu.com/10070375/ is the output of autopkgtest08:09
pittifgimenez: so you didn't call adt-run yourself, but it is called through some wrapper?08:09
fgimenezpitti: that's right, python3 -m ubuntu_sanity_tests.command_line from the trunk of ubuntu-sanity-tests08:09
pittiwow, wrappers around adt-run :)08:10
fgimenezpitti: with this diff applied http://paste.ubuntu.com/10068247/08:10
pittiso that one does --setup-commands 'mount -o remount,rw /; apt-get update; mount -o remount,ro /'08:10
pittifgimenez: I suppose the second mount (for ro) fails then08:10
pittifgimenez: not sure why, perhaps an additional 'sync' or 'sleep 5' or so works there? this needs checking for some running processes (lsof perhaps) what keeps / busy08:11
pitti(I just ran adt-run directly, without the apt-get update)08:12
fgimenezpitti: ok, now trying sync after apt-get update and before the ro mount in the wrapper08:14
=== chihchun_afk is now known as chihchun
=== vrruiz_ is now known as rvr
fgimenezpitti: yes, the sync solves the busy / issue, but it is still unable to install the upgrade, as you know http://paste.ubuntu.com/10088869/09:55
pittifgimenez: yeah, I figure that's the issue that elopio brought up on the ML10:55
pittifgimenez: probably better to entirely remove that --setup-commands (see my reply)10:55
jibelfgimenez, I replied to elopio's email too. For sanity tests the image must not be modified at all, it would make the test invalid.10:58
fgimenezpitti: ok thanks11:07
rhuddiepitti, hey. I seem to have a problem with adt-run11:33
rhuddiepitti, it seems that when I run tests for a click, not all the required dependencies are getting installed11:33
rhuddierunning tests for the camera app with: adt-run --click com.ubuntu.camera --- ssh -s adb11:34
rhuddieI get: ImportError: No module named 'wand'11:34
rhuddiepython3-wand and python3-mediainfodll are both defined in the debian/control file for camera-app-autopilot11:36
rhuddieso when I install tests directly on device and run, it works fine11:36
rhuddiebut I get the import error when I try and use adt-run11:37
rhuddie(reason for this is that the dashboard is reporting this failure)11:37
pittirhuddie: could you please pastebin the complete command and log?11:38
pittithere might be some information there11:38
pittirhuddie: you might just as well open a bug with the log, as we have a bug *somewhere* :)11:39
rhuddiepitti: http://pastebin.ubuntu.com/10090310/11:39
rhuddiepitti, will do, thanks11:39
pittirhuddie: indeed, no python3-wand installed11:40
pittirhuddie: I suppose the reason is that there is no camera-app-autopilot test dependency11:40
pittirhuddie: so it looks like its manifest is simply missing that?11:40
pittirhuddie: note that you can now use --override-control /path/to/fixed/manifest if you want to do a test run with a fixed manifest11:41
rhuddiepitti, oh thanks. let me give that a try11:41
pittijibel: hm, http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#gcc-4.9 has a bunch of "in progress" tests which finished long ago; state files getting out of sync again?11:44
pittijibel: how can this be fixed on the britney host?11:44
rhuddiepitti, my connection just dropped, i might have missed your reply12:24
pittirhuddie: I didn't write anything further to you after your "let me give that a try" (and didn't see a further response)12:24
rhuddiepitti, oh strange!12:25
rhuddiepitti, I was looking at some other click manifests, but can't see any references to the autopilot dependencies in those http://pastebin.ubuntu.com/10090759/12:25
rhuddieam I looking in the right place?12:25
pittirhuddie: yeah, those don't have any additional test deps12:28
pittirhuddie: you can just add a "depends" field like in https://people.debian.org/~mpitt/autopkgtest/README.click-tests.html12:29
rhuddiepitti, right. thanks for clarification.12:29
elopiogood morning.13:29
rhuddiepitti, unfortunately I am seeing another problem similar to the one I saw with imagemagick previously: http://pastebin.ubuntu.com/10091944/13:50
rhuddiebut this time: ImportError: MagickWand shared library not found13:51
rhuddieI tried adding this directly to the list of dependencies in the manifest, but it didn't make a difference13:51
rhuddieI have autopkgtest 3.9.413:52
pittirhuddie: ah, that looks like something in the test clobbers LD_LIBRARY_PATH, but a bit hard to say just from that log13:59
pittirhuddie: so, bug report with -d (debug) output appreciated; I'll look into it, maybe it's possible to hack around this14:00
rhuddiepitti, yes. I'll put all the details into a bug. thank you :)14:01
pittiand meh -- folks, don't expect a gazillion *apt* packages for *click* package tests!14:01
pittithe unpack/env var trick only works that far..14:01
pittijibel: I removed all the *.state files now and re-ran the tests; hope that helps14:23
dobeypitti: where does the output stuff go when using adt-run with qemu? afaict, the VM gets destroyed at the end, and all the data is gone with it15:00
brendandelopio, from your uninstall_click branch? http://paste.ubuntu.com/10093282/15:23
elopiobrendand: that's because you are on utopic.15:23
elopiobrendand: fixed here: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/remove_tests_import/+merge/24881715:23
brendandelopio, ok top-approved that one15:24
brendandelopio, i have this feeling that a lot of our test code is a bit messy and inconsistent15:32
brendandelopio, like different tests doing different things in the setUp compared to the test itself15:32
brendandelopio, lots of duplicated code actually15:32
brendandelopio, i think we might take some time to refactor it in the next sprint if you think it's worthwhile15:33
brendandelopio, normally i'm not a fan of refactoring code for the sake of it, but i think we might start causing ourselves problems if we don't address it now15:34
elopiobrendand: sounds ok. Are you talking about the self tests or the autopilot tests?15:36
brendandelopio, no the selftests are fine15:37
brendandelopio, the sanity tests - i.e. the main purpose of the project :) are looking a little slapdash15:37
brendandelopio, for example there are a number of steps which any test that launches an app will do15:38
elopiobrendand: ok. How would you like to do it? report a bug for each issue that you see?15:38
brendandelopio, there should be a class derived from BaseTestCase to do those steps in the setup15:38
brendandelopio, yeah i can raise a bug for each issue15:38
brendandelopio, something for next week at this stage15:39
elopiobrendand: ok. Take into account the argument that veebers and thomi always make of not hiding steps in the set up.15:40
elopiobut I suppose we can improve things with fixtures or just common nicely named methods.15:40
brendandelopio, yep15:44
=== teward is now known as teward_
brendandelopio, did you push the branch mentioned in https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/remove_update/+merge/24885316:46
elopiobrendand: not yet. I was looking at the bq phones.16:46
brendandelopio, :)16:46
elopioI want one white with headphones.16:46
elopiobrendand: sorry, I'll do it now.16:47
brendandelopio, you've already got one :)16:47
elopiobrendand: yes, but it's black. I have three phones for testing now, one for each hand and one on the ear. I need another to test with the other ear.16:51
brendandelopio, i know, phones everywhere16:51
=== PaulW2U_ is now known as PaulW2U
elopiobrendand: does veebers approval counts for the timeout branch? should I top approve?17:36
=== Guest45840 is now known as phillip
=== roadmr is now known as roadmr_afk
elfyballoons: ping18:23
=== roadmr_afk is now known as roadmr
balloonselfy, pong20:10
elfyoften20:18
=== vrruiz_ is now known as rvr

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!