/srv/irclogs.ubuntu.com/2011/11/20/#launchpad-dev.txt

poolieawesome10:56
pooliemarkup10:56
rick_h_sweet poolie12:37
pooliehey12:37
pooliethanks12:37
pooliejfdi ftw :)12:37
rick_h_I like the markdown since there was the JS renderer for it12:38
rick_h_client side instant preview ftw12:38
rick_h_lol, often the only way to go jfdi12:38
pooliei think i will stop for tonight soon12:43
pooliebut it does render some stuff12:43
poolierecognizing our existing patterns will be a little bit of work12:43
pooliebut not too hard12:43
pooliejust a 40-line regexp12:43
lifelesserm, argh:19:08
lifelessThe following packages have unmet dependencies:19:08
lifeless  launchpad-dependencies: Depends: python-apt (>= 0.7.94.2ubuntu6.4) but 0.7.94.2ubuntu6 is to be installed19:08
lifelessE: Version '0.7.94.2ubuntu6.4' for 'python-apt' was not found19:10
mtaylorlifeless: fail19:21
lifelessmtaylor: not exactly success, no20:24
lifelessmwhudson: thanks :P21:19
mtaylorlifeless: I try to be helpful21:31
mwhudsonlifeless: ?21:35
lifelessmwhudson: recordSuccess21:37
mwhudsonlifeless: ah right21:37
mwhudsonlifeless: it occurred to me that in some ways codehosting has some of the properties of a microservice already21:38
lifelessmwhudson: it does21:38
lifelessmwhudson: its ripe for split out - see for instance the thing thomi and thumper did21:38
lifelesswhich includes a split out, but not a migration to the split out code21:38
thumperalso a simplification as we didn't care about sftp21:39
mwhudsonlifeless: well, in as much as "it does not talk to the db directly"21:39
mwhudsonlifeless: yeah, split should be relatively straightforward21:39
lifelessmwhudson: yes, though that is merely one component of the microservice criteria :)21:40
wgrantWasn't it originally more of a microservice?22:17
wgrantTalking to XML-RPC rather than the DB?22:17
lifelesswgrant: codehosting still talks xmlrpc, and yes it started that way22:21
lifelesswgrant: you may be thinking f the codebrowsing url mapper22:21
lifelesswhich was an API but was moved to DB22:21
wgrantI thought codehosting talked to the DB for some things now.22:24
wgrantI forget.22:24
wgrantlifeless: rmadison is your friend22:25
lifelesscodehosting itself? no22:27
lifelesswe have db access on the machine for oops prune22:27
wgrantlifeless: Speaking of oops-prune...22:32
lifelessggrrr22:42
lifelessdpkg: error processing /var/cache/apt/archives/mountall_2.15.3_i386.deb (--unpack):22:42
lifeless unable to make backup link of `./lib/init/fstab' before installing new version: Invalid cross-device link22:42
* lifeless embugginates on lxc22:42
wgrantYes :/22:43
wgrantI can't remember how I fixed that.22:43
wgrantGoogle might know.22:43
wgrantLXC is extremely fragile.22:43
wgrantAnd buggy as hell.22:43
wgrantIt takes over my TTYs every couple of weeks :(22:44
StevenKAnd we want to run our testsuite, which is extremly fragile, and buggy as hell on top of it ...22:44
StevenKSounds like win.22:44
lifelessfortunately the bugs don't intersect much22:44
wgrantYeah22:44
wgrantThis is probably the sort of thing that LXC is suitable for.22:44
wgrantie. no security requirements22:44
lifelessubuntu-cloud folk want to run openstack test runs with openstack deployed on lxc22:45
lifelesspoolie: on markdown, yes, we do need the nofollow rule.23:05
pooliek23:06
pooliethat should be easy enough to add23:07
pooliedo you need person descriptions treated differently to all other text?23:07
lifelessper curtis' rules?23:07
lifelessuhm23:07
mwhudsonwgrant: 'codehosting' in general talks to the db a bit, eg for jobs23:07
lifelessArguably no, but perhaps we should treat -all- comments by low karma folk as not-capable-of-making-links.23:08
mwhudsonwgrant: but the ssh server daemons & bzr lp-serve processes do not23:08
wgrantmwhudson: Ah, right.23:08
lifelessput another way, I htink the no-links-for-newbies is a good thing, and the limitation of only doing that on the persons homepage is what should change23:08
lifelesshowever, I'd suggest getting a definite from curtis - I don't have a strong enough opinion any which way to override his preference, which appeared to be 'do not link low karma person homepages'23:09
poolieit would be interesting to run them all through eg http://www.surbl.org/23:10
pooliei think 'not enough reputation to make links' generically could be good23:10
pooliemm23:10
pooliemore so if you only earn reputation by doing useful things23:10
huwshimiAgain, I'm guessing this test failure is nothing to do with me? http://paste.ubuntu.com/744818/23:19
mwhudsonhuwshimi: allenap fixed a bunch of those bugs recently i think?23:21
mwhudsonas in, over the weekend23:21
huwshimiHmm.. guess I should just land it then23:22
wgranthuwshimi: I believe that was fixed on Friday.23:22
wgrantSo yes, land away.23:22
huwshimimwhudson, wgrant: thans23:23
huwshimi*thanks23:23
pooliehuwshimi, hi23:23
huwshimipoolie: Morning23:23
poolieso, markdown! :)23:23
huwshimipoolie: Markdown, indeed23:24
wgrant+ Alternative fix from #postgresql is to change the sort to 'datecreated +23:24
wgrant+ interval '0'' which runs this query otherwise unmodified in 300ms on23:24
wgrantlifeless: wtf?23:24
wgrant+ qastaging.23:24
lifelesswgrant: there are 12K bugs found by the bug supervisor rules23:25
lifelesswgrant: grabbing those and sorting separate -> fast23:25
lifelesswgrant: walking 150K tasks one by one consulting to see if the task is in that 12K -> slow, as there are only 4 bugs matching the full filters23:26
wgrantAh23:26
pooliecan i send https://code.launchpad.net/~mbp/launchpad/ec2-region/+merge/8248723:26
lifeless+interval '0' makes the sort computed and not satisfiable by index. Today anyhow.23:27
pooliei have used it locally for several tests and it seems pretty solid23:27
poolieor actually i suppose https://code.launchpad.net/~mbp/launchpad/ec2-kill/+merge/82631 which incorporates it23:27
mwhudsonpoolie: i can't see why you shouldn't land the ec2 changes23:38
poolieyup23:38
mwhudsonpoolie: monday am is probably a good as time as any to break it, and i can't think of anything more you can do that would make landing safer really23:38
poolieexactly23:38
mwhudsonnow someone finish off parallelization and let's have a high cpu quadruple extra large instance or whatever it's called at the problem :-)23:39
poolieyeah23:40
poolieyou're right the times are extremely variable so it's hard to say if tmpfs is faster23:41
pooliejust a funny coincidence i got plausibly stable times23:41
wgrantI haven't tested LP on tmpfs on the cloud before.23:41
poolieperhaps 3h30m is the "if nothing goes wrong" time23:41
wgrantOnly locally.23:41
pooliemaybe if there's no contention23:41
mwhudsonpoolie: yeah, i guess it depends how much disk io other vms on the physical box are doing blah blah blah23:42
wgrantIt's critical when doing it parallel on a physical machine.23:42
poolieyes23:42
mwhudsoni wonder if there is any way we could have ec2 test report run time to some central location, trends and averages should still be meaningful23:42
pooliei have heard ec2 io can bog down23:42
pooliemm23:42
pooliewould be good23:42
poolieeven just mail to a mailbox23:42
pooliesince it already knows how to send mail23:43
mwhudsonpoolie: apparently EBS is pretty slow23:43
mwhudson(if you have a database on EBS SOP is to raid 0 stripe it, apparently)23:43
mwhudsonbut can believe local io is slow too23:43
wgrantA DB on EBS?23:43
wgrantSounds somewhat insane.23:43
mwhudsonwgrant: it's what simpledb probably does, i think?23:44
wgrantNo clue.23:44
mwhudsonmy ec2 neurons are fading23:44
lifelesswell23:44
lifelesssimpledb is a distributed hash right ?23:44
mwhudsonmaybe i mean the other thign :)23:45
lifelessI am pretty sure simpledb is dynamo23:45
mwhudsonrds?23:45
mwhudsonyes, rds23:45
lifelessyes, rds is sql dbs23:45
pooliewgrant, uh, we run a db on ebs :)23:46
poolieor, we did prior to my branch landing23:47
wgrantpoolie: Do we?23:47
mwhudsonpoolie: no we didn't23:47
wgrantI thought we ran a test DB on instance storage.23:47
wgrantNot a real DB at all.23:47
poolieoh, true, sorry23:47
wgrantAnd certainly not a real DB on EBS.23:47
pooliewell, my point is, what is "real"23:48
poolieyou could have large but fairly disposable dbs23:49
huwshimiI have changed the way tags are ordered in the portlet. This breaks this test: http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/view/head:/lib/lp/bugs/stories/bug-tags/xx-official-bug-tags.txt in this way: http://paste.ubuntu.com/744836/23:50
huwshimiAny suggestions about how to fix that doctest in a way which isn't just re-ordering those tags23:50
pooliei'm really keen to see that land23:50
huwshimiI don't want the output in the doctest to just be a jumbled mess, or at least that seems like a bad idea to me23:51
poolie"then why are you using doctests?" :)23:51
mwhudsondelete the test?23:52
huwshimipoolie: Thanks, very helpful :P23:52
poolierewrite it as python23:52
poolieis the test meant to be asserting the official tags come first or something?23:52
huwshimipoolie: I don't know!23:53
mwhudsonhuwshimi: semi seriously, the question you have to answer here is "what is the intent of this test"23:53
mwhudsonwell, entirely seriously now23:53
mwhudsoni was being semi serious before23:53
mwhudsonit seems to be testing that all the official tags are displayed, but not all of the unofficial ones23:54
StevenK-        self.assertThat(recorder, HasQueryCount(LessThan(100)))23:54
StevenK+        self.assertThat(recorder, HasQueryCount(LessThan(101)))23:54
StevenK:-(23:54
huwshimimwhudson: I can't even make sense of the original comments/output23:54
mwhudsonif that's still true, then maybe printing out the number of tags that .startswith('official') and .startswith('unofficial') is a good fix?23:54
poolieif the test is not adding value i think you should bias towards deleting it23:55
mwhudsonhuwshimi: it doesn't seem /that/ cryptic to me :)23:56
mwhudsonbut +1 poolie23:56
huwshimimwhudson: "The 10 unofficial tags will be the 10 most popular tags"23:56
mwhudsonhuwshimi: ah yeah, that bit is harder i guess23:56
pooliewrite a python test that clearly says what you want the behaviour to be23:57
huwshimimwhudson: Oh I see, they are more popular, so 10 and 11 are pushed out23:57
lifelessStevenK: what is increasing the query count?23:57
mwhudsonhuwshimi: right23:57
mwhudsonhuwshimi: it's a pretty terrible test :-)23:57

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!