/srv/irclogs.ubuntu.com/2015/09/30/#launchpad-dev.txt

lifelessblr: tdd = developing by bouncing off the rails00:48
lifelessblr: I *love* that quote [for all that I also love tdd]00:48
blrheh yes01:01
cjwatson_wgrant: I think I'm up to date with your reviews now.10:18
wgrantcjwatson_: Thanks.10:25
wgrantcjwatson_: I went back and forth between doing the unicode case in the xref layer and not.10:27
wgrantcjwatson_: We could certainly cast on the way in, but how would it work on the way out?10:28
wgrantIn findFromMany, would we magically turn anything that looked like an int into an int?10:28
wgrantI expect it will eventually be covered by an intermediate layer that knows how to resolve LP DB objects.10:29
wgrantFor example, if we had a type which used a name as a key, what would happen if the name looked integral?10:29
wgrantI'd query for [('project', 'foo'), ('project', '123')], and get [('project', 'foo'), ('project', 123)] back and crash with a KeyError.10:30
cjwatson_wgrant: True, that would be problematic.10:44
=== cjwatson_ is now known as cjwatson
cjwatsonwell, after spending most of a day on it, I think I now have parallel testing working (vivid host, precise guest)16:10
cjwatsonthings I had to do: https://github.com/lxc/lxc/pull/667; use venv with testrepository 0.0.14, since newer versions expect subunit v2 and we aren't emitting that yet; https://code.launchpad.net/~cjwatson/launchpad/testrunner-uuid/+merge/272942; minor fiddling with .testr.conf; install python-gi and dbus-x11 in base container to make html5browser happier16:13
lifelesscjwatson: you can use subunit1to222:06
lifelesscjwatson: to get v2 into newer testr's22:07
cjwatsonI have a working solution now though :)22:16
cjwatsonI think I would rather it continue to be a little bit inconvenient (but not too much) for me to use v1 locally, because in that case there's at least a chance I'll get round to hiking us up to v322:16
cjwatsoner, v222:17
lifelesscjwatson: your call :)22:49
cjwatsonProbably need to get better dev control of buildbot first though22:50
lifelesscjwatson: I just wouldn't want you to miss out on shiny new testr features22:55
lifelesscjwatson: e.g. https://rbtcollins.wordpress.com/2015/09/18/testrepository-roadmap-201516/22:56
cjwatsoncertainly don't want to be held back forever, but we see occasional reliability problems due I think to being on subunit v1, so that's some kind of priority in its own right22:57
cjwatsonalleged buildbot passes with failed tests and a low test count are particularly worrisome22:57
lifelesswhat testr version are you using ?22:58
lifeless(on buildbot)22:58
cjwatsonI don't think I know for sure, but I believe it's precise's, which is 0.0.522:59
lifelessok so22:59
cjwatsoncould be the one in https://code.launchpad.net/~yellow/+archive/ubuntu/ppa23:00
lifelessI think (set -o pipefail; existing_command | subunit1to2) and a testr build including 83dff0a51b3ed3f66d5c5f2313c505723431266323:00
lifelessshould fix that for you23:00
cjwatsonok, that may be worth trying out, thanks.  would need to hunt down exactly what version we're using23:01
lifelessthat was fixed by 0.0.8 (perhaps earlier, but def 0.0.8)23:03
cjwatsonwhat I really want to do is to convert buildbot into a juju-deployed thing on the new developer-managed stagingstack, for multiple reasons: (a) direct access so that we can see just what's going on with these kinds of problems (b) way easier to upgrade (c) brownie points for jujuifying stuff (d) could very likely distribute builds across workers on multiple compute nodes rather than needing a couple of enormous ones23:03
lifelesscjwatson: testr has hooks for distributing work itself now23:03
cjwatsonthere'll be a bit of a cost to syncing the tree out to remote workers but not a prohibitive one23:04
cjwatsonah, cool23:04
lifelesscjwatson: but you could also schedule the work yourself and use testr load to coalesce the results23:04
lifelesscjwatson: https://rbtcollins.wordpress.com/2013/01/14/multi-machine-parallel-testing-of-nova-with-testrepository/ shows one approach23:05
cjwatsonI think it would be sufficient to prepare the workers before calling testr and then just have a suitable test_command23:06
lifelessyes; testr's current setup glue for this is serialised, so probably want a hybrid approach23:07
cjwatsonright, a bit like that approach but for the time being with manual provisioning/cleanup23:07
lifelessthe next gen stuff (see the roadmap blog post) will want more visibility, and that should enable really tuned things like optimising dispatch of per-layer things23:09
wgrantcjwatson: Oh, you're sharing a non-COW working tree between concurrent test runs? Ambitious.23:56
wgrantBut yes, your buildbot plan roughly matches mine.23:57

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!