/srv/irclogs.ubuntu.com/2015/02/03/#ubuntu-quality.txt

veebersalesage: sorry missed the ping00:22
veebersalesage: "move it over"? As in take it out of the debian/tests folder and make it another module?00:23
alesageveebers, isn't that something we desire?  i.e. to live under ubuntu_sanity_tests?00:25
alesagefacilitates testing at the least00:25
veebersalesage: yes it is, just wanted to confirm what your intentions are00:26
alesageveebers, MP forthcoming :)00:26
veeberselopio: you still around?00:33
alesageveebers, https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/move-sanity/+merge/248325 <= elopio00:34
veebersalesage: which card does this correspond to :-)?00:35
alesageveebers, to one I'll create right now00:52
alesageveebers, I see you have reviews for me but I'm EOD, will take up tomw if they remain :)00:55
veebersalesage: ack, that would be appreciated (as I'm currently at my WIP limit ;-))00:55
alesageveebers, and with only one non-veebers card available for review ;)00:56
veebersalesage: heh, ack looking now00:57
elopioveebers: I got a ping earlier. Do you still need me?03:58
veeberselopio: hey, just had a question re: the blocked card and to ask if you could review the cards I hve in to-review04:02
elopioveebers: :)04:03
elopiofor your pending reviews, I think I'm just missing to give them a run.04:03
veeberselopio: aight sounds good. I'm just about to head off to Code Craft. Probably won't be back on tonight04:03
elopioI dist-upgraded earlier and now phablet-network doesn't work. Let me workaround that, and I'll get your cards approved before my EOD.04:04
elopioveebers: ok, see you tomorrow.04:04
veeberslet me know if you have any other issues with those branches to fix. And I'll hit it in my morning04:04
veeberso/ night04:04
=== chihchun_afk is now known as chihchun
fgimenezhi thomi06:28
thomihi fgimenez - I accidentally left my IRC client on08:32
=== chihchun is now known as chihchun_afk
=== chihchun_afk is now known as chihchun
doug5balloons, hey, you there?12:50
=== chihchun_ is now known as chihchun
elfydoug5: usually a bit later - Pacific time or something I think13:03
doug5elfy, shit, right13:13
elopioalesage: brendand_: a reminder that we are missing a review here: https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/webbrowser-test-using-system-helpers/+merge/24808014:39
elopioit would be nice if one of you can get to it so we have it merged before veebers arrives anad he can get a new card.14:39
brendand_elopio, approved and top-approved14:43
elopiobrendand_: thank you!14:44
elopioI will get to yours in a moment.14:44
rhuddieelopio, hey. did the sanity tests ever get run on emulator?14:48
elopiorhuddie: my emulator breaks my machine. I have to rseiub every time I try to run it.14:49
elopioso, unknown. I haven't been able to give it a try.14:49
rhuddieelopio, ok thanks. I am getting 'evdev.uinput.UInputError: "/dev/uinput" cannot be opened for writing'14:51
elopiorhuddie: hum, can you please leave that as a comment on the leankit card about running in an emulator?14:52
rhuddieelopio, sure. I am not totally sure my environment is correct, but everything esle seems to be working. I'll add the comment to the card.14:53
elopiorhuddie: and if you have some time, ask rsalvetti or sergiusens about it. We might need a new input type for autopilot, or they need to fix evdev on their side.14:54
elopiorhuddie: if you don't have time, don't worry. We'll do it as part of that card when jibel puts it in the top.14:54
rhuddieelopio, sure. I'm investigating running the automated sanity tests as part of silo landing process (emulator was easiest target to start with)14:55
elopiorhuddie: and that means writable image too, right?14:56
rhuddieelopio, for that I also raised a bug about being able to specify additional external tests more easily: https://bugs.launchpad.net/ubuntu-sanity-tests/+bug/141755614:56
ubot5Error: launchpad bug 1417556 not found14:56
rhuddieelopio, yes, it would do.14:56
elopiorhuddie: the writable part needs a new card on the board, or a bug for sure. Please add one with all the info you can find.14:57
rhuddieelopio, I will do that14:58
elopiorhuddie: for that bug, what we can give you on friday is to first run the full sanity, and then run additional tests.14:58
rhuddieelopio, the purpose of the bug was to add a new method which could easily be called from a silo script, where you specify some additional tests that you want to run for a specific silo14:59
rhuddieelopio, as you need to specify the dependencies as well as the test ids in 2 different files14:59
elopiorhuddie: the dependencies bit sounds harder, but nice to have. And being able to run the internal and external tests + extra, with a single command is something I have no idea how to do. Maybe adding an argument --extra-tests.15:00
elopiorhuddie: if you need any of these requests by friday the 20th, please make sure to discuss about them with jibel. Today we will meet to define the top priorities for next sprint.15:01
elopiorhuddie: and thanks for all this, it's really useful to have somebody giving it a try.15:02
rhuddieelopio, ok. I don't have idea on time scale right now. just trying to find out what work is needed. I'll discuss.15:02
rhuddieelopio, yeah, its quite interesting to be using it as an end-user :)15:02
rsalvetiI know I tested autopilot before on the emulator and it worked fine15:03
rsalvetinot sure if there is any new specific thing we need to do now15:03
rhuddiersalveti, good to know thank you. I'll keep investigating what is going on.15:04
rhuddieelopio, I was thinking that for adding new external tests and dependencies, a new "add_external_test()" method would be called first and would directly modify the testsuite_list and control file before running the tests as normal? that way no new command options needed.15:17
dobeypitti: can we *PLEASE* break the multiple tests feature of adt-run that nobody actually uses? the positional arguments thing is really annoying15:32
pittidobey: I'm certainly open to that, but I can't know whether anyone is using that; this should at least get some discussion on the ML, perhaps CC'ing debian-devel@15:34
pitti(plus, it's quite some work, so it ceratinly won't happen overnight)15:34
dobeypitti: i just spent way too much time switching between utopic and vivid images with proposed enabled or not, only to discover that all the 404 issues were because the update and proposed were not actually being used, because i put the -U and --apt-pocket arguments after --setup-commands15:36
dobey:-/15:36
pittidobey: well, -U and --apt-pocket are both setup-commands, so these will always stay order dependant15:36
dobeythat makes no sense15:37
dobeyand the documentation clearly doesn't specify that they must appear *before* the --setup-commands argument15:38
elopiorhuddie: I don't know about modifying the control field. That sounds like something we shouldn't do.15:41
pittidobey: well, they don't :) they will be executed in the order you give them15:41
pittidobey: so if your setup commands depend on having -proposed, you need apt-pocket and -U before; if enabling dist-upgrade depends on your setup-commands, you have -U after; etc.15:42
rhuddieelopio, I agree it seems a bit dubious... :)15:42
elopiorhuddie: I'm not quite sure the right way to do it is with a single adt-run call. Maybe one adt-run call, + one phablet-test-run will make things a little less messy.15:43
elopiorhuddie: but anyway, put all your ideas and input in the card. When it's time to write it, we'll research and discuss about it.15:43
dobeypitti: that is even more crazy :)15:44
dobeypitti: and i don't see why ubuntu-touch-session would depend on those being before15:45
dobeyor why it would affect the argument parsing15:45
rhuddieelopio, yes. I was just thinking whether it should all need to be done in the sanity suite, or kept separate. In terms of reporting it would be easier to have it all as one suite, but as you say, phablet-test-run would also be a good option.15:47
elopiorhuddie: the tests for the silo should be specified in their debian/tests15:48
pittidobey: well, it's the same as specifying --setup-commands twice -- these are for sure ordering dependant15:48
elopiorhuddie: so it's not like a random list of tests that you would like to run. We have a way to discover them and their dependencies.15:48
elopioof course, that's not happening now. But should.15:48
dobeypitti: but then surely -U must come after --apt-pocket (though that requirement doesn't exist)15:49
pittidobey: right15:49
dobeythough honestly, i don't see how this could ever really be usable without -U15:49
dobeyeven without --setup-commands or --apt-pocket15:49
elopiorhuddie: that might be easier. Receive a list of additional autopkgtests to run.15:50
pittidobey: indeed I think --apt-pocket should do an apt-get update automatically15:50
pittidobey: so that you can use it withoutu -U15:50
dobeypitti: right, but the only time not doing "apt-get update" is going to work, is if all the dependencies are already installed15:51
dobeywhich is basically never the case with qemu15:51
pittidobey: oh, I pretty much always use it without -U locally, as it takes effing long and isn't needed when my VM is fresh :)15:52
rhuddieelopio, only problem with running all of them might be time constraints? it might be that we want to run a couple of high priority tests, instead of entire suites. But that's not clear right now.15:52
pittidobey: it is true that currently just using --apt-pocket by itself doesn't make much sense without also running apt-get update (that's the issue I mentioned above)15:53
dobeypitti: well, if you're using lxc/chroot, then it's easy enough to have stuff already installed15:53
pittidobey: I'm not entirely sure whether enabling -proposed (and apt-get update) *without* apt-get dist-upgrade makes a lot of sense; probably very little15:54
pittidobey: so I'm ok with disallowing that use case, and make --apt-pocket imply -U15:54
dobeypitti: but even so, the ordering of such arguments as pased to adt-run should not be order-dependent. the execution of such things inside the VM may be though15:54
dobeypitti: so, i think any apt-related args (-U and --apt-pocket) should always be executed prior to any --setup-commands arguments, in the VM, regardless of where they appear in the arguments list to adt-run, and any shell scripts passed with --setup-commands should probably be executed in the order passed (because they are arbitrary scripts and requiring adt-run to know what they are doing would be excessive)15:57
pittidobey: that means you could never use --setup-commands to enable e. g. a PPA or other third-party source15:57
pittibut we need that15:57
pittior you couldn't use -U and had to spell it out15:58
pittiand that actually is current behaviour that people do use and depend on15:58
dobeypitti: it does. but it means your setup-commands should be doing an update as well, if they are touching apt stuff15:59
pittiright, which is precisely -U; -U is just a pre-defined --setup-commands15:59
dobeypitti: if you have a setup-commands script which adds an apt repository, but doesn't do apt-get update, then you're doing it wrong15:59
pittiwell, it's --setup-commands "add-apt-repository foo" -U16:00
dobeypitti: that is an implementation detail though. exposing such an implementation detail via argument ordering, is bad :)16:00
pittisure you could argue that we take away the -U shortcut for this case, but as I said that's something people do use16:00
=== chihchun is now known as chihchun_afk
dobeypitti: well, i'd say make it superfluous i guess, and deprecate it, telling people to do "add-apt-repository foo && apt-get update" instead. but as it is right now, i am finding it incredibly painful to use. :-/16:08
pittidobey: add-apt-repository foo && (apt-get --quiet update || (sleep 15; apt-get update)) 2>&1'16:09
pittivery convenient to type :)16:09
pittiwell, probably not necessary that often for a local run, but very important for CI16:09
pitti(all hail the dreaded apt hash sum mismatches..)16:10
jderosepitti: as something changed that's causing the hash mismatch to happen for frequently?16:12
jderoseer, can't type16:13
pittijderose: they've been a problem for years really16:13
pittijderose: the above (or more clever variations thereof) has been copied into our buildds, Launchpad, and other places16:13
jderosemaybe i'm just doing more automated stuff that get's hung up by it. happens a lot using the internal tools system76 uses for updating our images16:13
pittiwe've had tons of spurious autopkgtest CI runs before I added that16:14
jderosepitti: gotcha, thanks16:16
dobeypitti: well, put it in a shell-script "smart-add-repository foo" :)16:19
dobeyanyway, need to get lunh. bbiab16:32
=== chihchun_afk is now known as chihchun
brendand_elopio, i followed up on that MP17:37
* alesage is doing some reviews18:19
slickymasterWorkelfy, FYI http://cdimage.ubuntu.com/ is up now18:20
elfynot here18:21
balloonsit's no longer up for me, but was yesterday. I snagged an image then :-)18:22
balloonselfy beat me too mentioning those issues on the list; thanks!18:22
slickymasterWorkthere's still a huge delay loading it, but it's up18:24
=== balloons changed the topic of #ubuntu-quality to: Welcome to Ubuntu Quality | The vervet is currently serving vivid goodness | http://wiki.ubuntu.com/QATeam | For help with autopilot, try #ubuntu-autopilot.
balloonsI tried to clean up the milestones on the tracker.. wow was it a big list18:26
alesageelopio I too get the webbrowser failure, investigating, evidently not the same as the bug though19:00
elopiothanks alesage.19:01
alesageelopio, I stand corrected, same err as reported in bug for moi for webbrowser test19:07
elopioalesage: which bug are you talking about?19:07
alesageelopio, https://bugs.launchpad.net/ubuntu-sanity-tests/+bug/140872319:08
ubot5Error: launchpad bug 1408723 not found19:08
elopioalesage: yup, same here.19:08
elopioreproduced in trunk, so nothing to do with brendan's branch.19:08
elopiobrendand_: you need to resubmit your branch, to trunk.19:28
brendand_elopio, ! oh wth happened there. no wonder the jenkins tests didn't run19:30
brendand_elopio, alesage - you need to redo your approvals: https://code.launchpad.net/~brendan-donegan/ubuntu-sanity-tests/wizard_remove_connection/+merge/24844019:36
brendand_elopio, alesage - and a top approve19:36
elfyballoons: seems that sometimes you can actually download via the http links - try and do anything useful like zsync and it has a hissy fit19:51
=== roadmr is now known as roadmr_afk
=== roadmr_afk is now known as roadmr
wxlin lieu of my developers being awake, is it possible this could be fixed with a rebuild? sure is strange that it's only affecting one particular image and has no consistency across type of image or arch https://bugs.launchpad.net/ubuntu/+source/lubuntu-meta/+bug/141778423:14
ubot5Launchpad bug 1417784 in lubuntu-meta (Ubuntu) "xserver-xorg-input-synaptics missing from Lubuntu 14.04.2 manifest" [High,Triaged]23:14
alesageelopio, veebers another review pretty please https://code.launchpad.net/~canonical-platform-qa/ubuntu-sanity-tests/move-sanity/+merge/24832523:46
veebersalesage: can do shortly23:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!