/srv/irclogs.ubuntu.com/2013/02/04/#ubuntu-quality.txt

jibelgood morning07:50
Noskcajevening jibel07:53
Noskcajand dholbach07:53
dholbachgood morning07:54
dholbachhi Noskcaj07:54
jibelHey Noskcaj07:56
mlankhorstI want to hook some autopkgtests up for some xorg packages, but the testsuite is in a separate git repository (xorg-integration-tools, and piglit for mesa). Is it still possible?11:52
pittimlankhorst: our jenkins machines have rather restricted network access12:32
pittimlankhorst: it would be better to package those and add as test dependencies12:32
pittimlankhorst: you can reach launchpad and *.ubuntu.com, but almost certainly not fd.org12:32
mlankhorstaw, was afraid of that12:35
pittimlankhorst: well, package or just put a recent copy into debian/tests/, of course12:40
pittilike, in a tarball12:40
=== _salem is now known as salem_
=== salem_ is now known as _salem
=== _salem is now known as salem_
jibelpitti, my attempt to clean-up xvfb after make check in jhbuild http://paste.ubuntu.com/1608681/, WDYT?13:30
pittijibel: oh, that looks clever!13:33
pittijibel: that also ought to mop up those leftover dbus-daemons, right?13:34
jibelpitti, right, in theory13:34
pittijibel: FYI, xvfb-run also has an -a option which sounds better than hardcoding :8713:34
pittiso maybe we should call it with -n 10 -a13:35
pittijibel: btw, I'm watching rabisu and keep killing the colord test which hangs indefinitely; there were some transient errors over the weekend but stuff is clearing up again13:35
jibelpitti, sounds good, I'll use -a13:37
jibel2 weeks ago it was pango to hang forever. I'll see if I can implement a timeout in jhbuild13:44
mlankhorstpitti: would be annoying since it has some external deps as well13:54
mlankhorstand circular13:54
mlankhorstthe test is for xorg-server and some drivers, so putting it in debian/tests would cause things to break quite badly13:55
jibelmlankhorst, can you package the testsuite? This is for example what packages with a big testsuite like firefox, thunderbird, mysql, bzr, samba do.14:34
mlankhorstis there an example I could look at for that?14:39
jibelmlankhorst, any package I mentioned above. for bzr the testsuite is python-bzrlib.tests, for mysql-5.5 the testsuite is mysql-testsuite-5.5 (on raring that is)14:42
jibelmlankhorst, in debian/test/control of the package there is a dependency on the testsuite14:43
jibelmlankhorst, then the test script called by adt call the runner in testsuite14:44
jibelin the case of mysql-5.5, the test dependency in debian/tests/control is mysql-testsuite, the test script in this same control file is called 'upstream' and there is a shell script that cd to /usr/lib/mysql-testsuite then run the mysql testsuite with ./mysql-test-run.pl14:47
mlankhorstah14:53
=== salem_ is now known as _salem
letozaf_Hi balloons19:57
balloonshello!19:57
letozaf_balloons, did you read my emails on autopilot ?19:57
balloonsyes I did19:58
balloonsglad your around now19:58
letozaf_balloons, :)19:58
balloonsso which to discuss first?19:58
balloonsyour right on about the english issues19:58
balloonsfor now, I'm trying to avoid adding english strings to tests to keep them working across locales19:59
balloonswe'll have to do something about using translations later19:59
letozaf_balloons, yes, but for instance what I discovered on firefox19:59
balloonsyes, that was really weird20:00
balloonswhy would the same keypresses not work?20:00
letozaf_balloons, yes..20:00
* balloons notes I'm glad you all have int'l exposure and can help20:00
balloonsletozaf_, does it break the english test to add this?20:00
letozaf_balloons, didn't try20:00
balloonsif not, then just add it  :-) and note it's to ensure compatibility with locales20:00
letozaf_balloons, I can now20:00
balloons'll try right now20:00
balloonsok, go ahead then20:01
balloonsif you've got it up20:01
* balloons is elsewhere atm20:01
letozaf_balloons, we could ask dkessel if this happens also to him20:01
letozaf_balloons, the firefox thing20:01
balloonsyes20:01
* letozaf_ is looking at the firfox autopilot test20:03
letozaf_balloons, no If I add the \n the test fails20:04
letozaf_balloons, I mean if I have english language on my laptop20:04
balloonsahh20:05
balloonsso so weird20:05
letozaf_balloons, I know makes no sense20:05
letozaf_balloons, but I tried it various times20:05
balloonswell, note it in the test.. we'll find a way around it, or it will just have to be known as broken20:05
balloonswe could add a hack to detect locale, but I'd rather not do that20:05
balloonssince we have wonderful things such as bugs, hehe, you could file a bug on it :-)20:06
letozaf_balloons, :D20:06
letozaf_balloons, but a bug on firefox ? or on autopilot ?20:07
balloonson our project20:07
letozaf_balloons, oh! yes20:07
balloonshttps://bugs.launchpad.net/ubuntu-autopilot-tests/+filebug20:07
balloonshttps://bugs.launchpad.net/ubuntu-autopilot-tests/+bug/111278120:07
ubot5Launchpad bug 1112781 in Ubuntu Autopilot Tests "firefox autopilot test fails to input text correctly, then restarts firefox too early, then aborts abruptly" [Undecided,New]20:07
balloonsin fact, ^^20:07
balloonsdkessel has already reported it, in a way20:08
letozaf_balloons, yes it just happened to me, the20:08
balloonsadd a comment to that bug, I edited it a bit20:08
letozaf_another instance is already running20:09
balloonsit's now firefox test fails on non-english locale20:09
letozaf_balloons, ok20:09
balloonson the shotwell stuff, yea, I think putting zenity in there is ok20:13
balloonswe should talk about splitting this off into semi-automated?20:13
balloonsit's a good discussion to have20:13
balloonswe'll need to update to require zenity, but it's installed by default, so no worries imho20:14
letozaf_balloons, oh yes, so I will continue with zenity in the test20:14
balloonsin fact, when you propose your merge, you can edit the depends to include it :-)20:14
letozaf_balloons, ok20:14
balloonswe should ping thomi about his thoughts on this semi-automated ideas as well.. not something they've done or have interest in I'm sure20:15
letozaf_balloons, ok for the semi-automated chat and thomi ping20:15
letozaf_balloons, maybe thomi can tell if there is something better to use20:16
letozaf_balloons, or if it's ok as we are thinking to do it20:16
letozaf_balloons, there is also the network manager test to be done as semi-automated20:17
balloonsit would be interesting to pick his brain.. anyways, I see zenity as a good solution. the piece I'm worried about is how to split this out so they are known to be non truly atuomated tests20:17
balloonsor do we need that, etc.. that's a discussion for us20:17
balloonsthey won't be able to run via jenkins, etc20:17
thomihi guys - I'm just in a call right now, but I'll be along afterwards20:18
balloonswe are able to push them via ppa, so manual execution works.. so the theory is definitely sound20:18
balloonslol, we should keep saying his name.. he'll get pinged more..20:18
balloonsI kid, don't do it :-)20:18
letozaf_balloons, :-D20:19
letozaf_balloons, anyway I do not think we have other alternatives to run autopilot tests on shotwell or network manager20:20
letozaf_balloons, we cannot emulate someone plunging  in a camera on the PC20:20
letozaf_balloons, or attaching a network cable20:20
balloonsyes.. we do it this way or that stay as pure manual20:21
letozaf_balloons, oh!20:21
letozaf_balloons, right!20:21
letozaf_balloons, but isn't semi-automated better than manual ?20:21
letozaf_balloons, :D20:21
balloons:p20:22
letozaf_balloons, unfortunately I do not know much about jenkins so maybe you're right after all ;)20:23
* letozaf_ is commenting dkessels bug 20:30
balloonswell letozaf_ obviously atm, we're running the tests ourselves.. however, since the test is automated, why not have the computer also run the test.. that's the idea.. after the computer also runs the tests, we can use jenkins to help us see what happened20:31
letozaf_balloons, I see, great! but maybe we can make testers carry out not only manual tests, but also the semi-automated ones20:33
letozaf_balloons, when computers learn to plug-in a camera, we can let them do it :)20:33
balloonsletozaf_, yes.. we can have them do both manual and semi-automated20:34
balloonsand yes, they've done things with hw to automatically connect and disconnect things like network cables and cameras :-)20:34
balloonsso, we could ask gema what they can do.. you never know, it might be possible for them to rig that piece up20:34
letozaf_balloons, it would be great!20:35
balloonsregardless, you'll need the semi-automation for writing and testing it20:35
phillwcan this be done by enabling / disabling the kernel kooks, or would that need a reboot? I'm only vaguely familiar with enabling / disabling lspci stuff etc.20:38
balloonsphillw, there is some trickery that has been done.. pitti also might have some insights.. no matter if it can be done or not, using zenity atm so carla can write the test i think is a good way forward20:39
letozaf_balloons, I commented bug 1112781 if you wanna take a look at what I wrote20:40
ubot5bug 1112781 in Ubuntu Autopilot Tests "firefox test fails on non-english locale" [Undecided,Confirmed] https://launchpad.net/bugs/111278120:40
thomihi balloons20:40
phillwokies, just a thought... as you know, (semi) automated testing is not be strong suite :D20:40
phillws/be/my/20:41
=== _salem is now known as salem_
balloonsphillw, :-)20:52
balloonsI'm going to rope you in for a little surprise btw20:52
balloonsI want your help planning a manual testing hackathon20:52
balloonshello thomi20:52
balloonsletozaf_, thanks for updating the bug.. we should be set.. hopefully at some point we can solve it, but it's documented now20:53
letozaf_balloons, ok20:54
phillwballoons: can I get the virtualisation ones out of the way first?... Pretty please :D20:57
balloonsphillw, lol, yes of course.. I have to write the tutorials for it remember.. including getting resources for lp20:58
balloonsso your safe for now20:58
phillwgood, just awaiting either "yeah, it's okay", or a telling off for running Version 26.0.1386.0 Ubuntu 12.10 (177362) :D21:02
phillwI found a bug, but am still not sure if that build is any where near the 'official radar' yet.21:02
balloonschilicuil, are you about?21:04
chilicuilballoons: hi o/21:05
balloonsexcellent ;-)21:05
balloonsI was looking at your new branch for manual tests early21:05
balloonsfirst of all, thanks for putting it together..  I spent some time today migrating over the other open issues, so the bug tracker should have all the current needs in it21:06
balloonsanyways, do you know how to propose a merge? I'd be happy to review it and get it included21:06
chilicuilballoons: yep, I just want it link first, I was not sure it was ok21:07
balloonsawesome, yes, I took a quick look at it, we'll review it when you propose.. Nothing extreem stood out to me besides the reference to the dash.. in general we try and stay desktop agnostic in our tests to promote re-use. So instructions on using the unity dash can instead refer to running in generically21:09
balloons*refer to running an application generically21:09
balloonsthat way our lubuntu, xubuntu, etc friends can also utilize the test21:09
balloonsand vice versa of course21:09
balloonsobviously unity or ubuntu specific tests will be just that.. they also have things like mythbuntu or ubuntu studio specific tests.. but in this case, I think it's safe to be generic21:10
chilicuilgot it balloons, I'll do it shortly after I change the references to the dash21:10
balloonsdoes that make sense?21:10
balloonsawesome21:10
letozaf_balloons, but about the semi-automated thing, should I carry on with shotwell, or pick something else that is not semi-automated until something is decided about semi-automated tests ?21:22
balloonsletozaf_, do carry on21:26
balloonseven if we found a way to automate it, you need to be able to write the test21:27
balloonsand zenity makes it easy ;-)21:27
balloonswe could always swap that step out later if a solution is found21:27
letozaf_balloons, :) ok21:27
letozaf_balloons, do you know what this error could be ? http://paste.ubuntu.com/1610439/ the MismatchError on the bottom...:(21:45
letozaf_balloons, I will check it tomorrow, going to bed now :) good night!21:49
=== salem_ is now known as _salem
balloonsthomi, did we lose you in all the chatter.. if you get a moment, I'd still love your thoughts on the idea of a semi-automated autopilot test22:37
phillwNoskcaj: hopefully, final edit... https://wiki.ubuntu.com/Testing/Activities/Classroom/Section3#Classroom_Session_3 can you check to make sure nothing I'm adding as 'extras' will kill test-drive. AFAIK, you just need me to keep VBox at 4.1.18?23:40
thomiballoons: sorry, I was at a meeting - I'm back now, if you want to char23:42
thomi*chat23:42
balloonskk23:43
balloonsyea, quickly23:43
balloonsany thoughts?23:43
balloonsbot to hit dinner23:44
balloons:-)23:44
thomiummm, well, I'm not sure what you're asking23:44
thomiballoons: if you're about to eat perhaps we should do this next week? (I'm on Holiday from tomorrow onwards)23:44
phillwthomi: when balloons goes for dinner, do not expect an early reply. Like my self, family then takes over :)23:47
balloonslol23:58
balloonskk23:58
balloonsthomi, we're writing tests with ap that can't be fully automated23:58
balloonsthat's all23:58
balloonsthey will prompt during the test run23:59
balloonsgood, bad indifferent.. not as intended, but this semi-automated style will help us test some harder to test things23:59
thomiballoons: hmmm, seems to me that negates the main advantage of using AP in the first place?23:59
balloonslike attaching/detaching devices, etc23:59
thomiwhat are the things that you can't automate?23:59
balloonsthat said, there are ways around those, so hopefully we'll fix it :0)23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!