[00:01] <mwhudson> huwshimi: http://t.co/O68m8Ur7 if you haven't seen this sort of thing before
[00:03] <huwshimi> mwhudson: Oh, yeah, I saw that :)
[00:03] <mwhudson> good good
[00:07] <StevenK> lifeless: My bug supervisor change, I'd wager
[00:08] <StevenK> lifeless: So, on one hand it's just one query, but on the other, I'd prefer to reduce it.
[00:08] <StevenK> However, I think this branch is large enough.
[00:09] <lifeless> StevenK: if its one Full Stop, its ok. If its one per row, aieee.
[00:09] <poolie> i think his talk is insufficiently smug
[00:09] <poolie> i know some people who could help though
[00:11] <StevenK> lifeless: One full stop. The test case adds 5 bug tasks.
[00:12] <lifeless> StevenK: they all have different supervisors etc?
[00:12] <lifeless> StevenK: [paranoid]
[00:12] <StevenK> I doubt it.
[00:29] <poolie> wgrant, ok looking at jubany now
[00:30] <wgrant> poolie: Thanks.
[00:30] <lifeless> StevenK: it may not matter, make an educated assessment
[00:30] <poolie> is banana the front end for both edge and lpnet?
[00:30] <lifeless> StevenK: I'm just noting the possibility that the test isn't able to assess a regression here
[00:30] <poolie> s/the/a
[00:30] <lifeless> yes
[00:30] <StevenK> poolie: One of.
[00:30] <lifeless> actually its primary
[00:31] <lifeless> normally all traffic goes through it
[00:31] <StevenK> So nutmeg usually sees next to no traffic?
[00:31] <lifeless> because haproxy doesn't know how to cooperate in a cluster
[00:31] <lifeless> yeah
[00:31] <lifeless> any traffic nutmeg gets it sends to banana
[00:31] <lifeless> if banana goes down nutmegs backup path is direct to the appservers
[00:32] <StevenK> And if nutmeg drops, banana doesn't care.
[00:33] <lifeless> right
[00:35] <wgrant> To clarify, clients send to both.
[00:35] <wgrant> But nutmeg normally forwards to banana.
[00:36] <wgrant> They should really be the frontends for all LP services.
[00:36] <wgrant> But codehosting/PPA are a bit special at the moment, unfortunately.
[00:36] <wgrant> And mailman.
[00:36] <lifeless> nutmeg apache forwards to banana
[00:37] <lifeless> banana apache forwards to banana haproxy
[00:37] <lifeless> haproxy then does the same dance because we can't rely on apache
[00:37] <poolie> i like the fact they're actually related
[00:37] <poolie> anyhow, udd certainly does try to use lpnet
[00:37] <poolie> restfulclient's api is so wacky perhaps it's not having the intended effect
[00:38] <poolie> hm
[00:38] <poolie> that is our ip though
[00:39] <huwshimi> poolie: So, with this change to the bug portlet, the ordering has changed from alphabetical, to usage count. Would you add a test for that, or should I just delete these current (now mostly useless) tests?
[00:40] <poolie> i would add a test for it
[00:41] <poolie> it's probably not so much likely they will come back in the wrong order as that it will blow up
[00:41] <huwshimi> poolie: Ok thanks
[00:41] <poolie> a python test obviously
[00:43] <poolie> wgrant, it certainly thinks it has an lpnet connection
[00:43] <huwshimi> poolie: Yeah :)
[00:43] <wgrant> poolie: Hmm. I wonder what's using edge, then.
[00:43] <wgrant> That IP address looks like jubany, doesn't it?
[00:43] <wgrant> Yes
[00:43] <poolie> wgrant the apache log line you quoted is to api.l.n, not edge
[00:44] <wgrant> Erm, really?
[00:44] <wgrant> So it is.
[00:44] <wgrant> I may have synced the wrong log. That would be bad......
[00:44] <wgrant> AHEM
[00:44] <wgrant> Yes
[00:44] <wgrant> That was an lpnet log.
[00:44] <wgrant> Sorry
[00:45] <wgrant> Nothing from package-import in the actual edge logs.
[00:47] <poolie> that's ok :)
[00:48] <lifeless> wgrant: so, I nagged brian for nought?
[00:51] <wgrant> lifeless: No, I found bdmurray in my correct analyses a couple of weeks ago. He's the second-top user on real edge
[00:51] <lifeless> phew. tanks
[00:53] <wgrant> didrocks 28614, bdmurray 10237, ubuntuqa 5671
[00:53] <wgrant> Top three from yesterday
[00:55]  * StevenK looks forward to edge.launchpad.net being NXDOMAIN
[00:57] <lifeless> wgrant: want to mail didrocks ?
[00:59] <wgrant> Once I have more data.
[01:01] <wgrant> I think didrocks' thing is new, actually.
[01:01] <wgrant> It's showing up every day now.
[01:01] <wgrant> But wasn't there when I last checked a couple of weeks back, IIRC.
[01:22] <lifeless> bbs, grocery shopping time
[01:27] <poolie> hm
[01:28] <poolie> i'm trying to get its tests to run in semi isolation
[01:49] <poolie> hm, launchpad's TestCase now depends on having rabbit running?
[01:58] <poolie> wgrant, https://code.launchpad.net/~mbp/launchpad-buildd/lpbuildd-tests/+merge/82837(small)
[01:58] <poolie> wgrant, https://code.launchpad.net/~mbp/launchpad-buildd/lpbuildd-tests/+merge/82837   (it's pretty small)
[01:58] <poolie> pht
[02:18] <lifeless> poolie: TestCase? shouldn't.
[02:19] <lifeless> poolie: specific tests? yes, absolutely
[02:28] <wgrant> poolie: Any reason to continue bumping to a new version so rapidly?
[02:28] <wgrant> poolie: Also, your wraping in debian/control's Depends line is sort of screwy.
[02:43] <lifeless> mwhudson: is there a generic django facility for 'I need an odd bit of metadata like a timestamp for my whole project'
[02:43] <lifeless> mwhudson: ?
[02:45] <huwshimi> lifeless: Can you elaborate a little more about what you want to do with it?
[02:46] <huwshimi> I'm just coming in on the conversation now, so I might be being unhelpful :)
[02:47] <lifeless> huwshimi: that was the entire conversation
[02:47] <lifeless> huwshimi: I have a single datetime I need to store for python-oops-tools
[02:47] <lifeless> huwshimi: (that is lp-oops.canonical.com)
[02:47] <lifeless> huwshimi: it records the point in time which pruning has been done to
[02:48] <huwshimi> lifeless: And you just need a way of storing that timestamp?
[02:48] <lifeless> and reading it back, yes
[02:53] <huwshimi> lifeless: There isn't a generic global config table or anything of that sort. You could do it by setting up a simple model and could probably use the unique flag. I'm just checking.
[02:54] <lifeless> yeah, I can do it manually
[02:54] <lifeless> was just wondering if I could avoid that overhead
[02:55] <huwshimi> lifeless: Actually, you might be able to use the site model
[02:55] <huwshimi> lifeless: You might be able to hook something on to that
[02:56] <lifeless> looks equivalently complex - http://stackoverflow.com/questions/2821702/how-do-you-extend-the-site-model-in-django
[02:57] <huwshimi> lifeless: yeah, quite possibly
[02:57] <huwshimi> lifeless: It's the only unique site wide table though
[02:59] <huwshimi> lifeless: It might still be simplest to add another model that is unique to a Site to store the timestamp
[03:00] <lifeless> huwshimi: I very much doubt that the oops app supports multiple sites as-it is
[03:01] <lifeless> huwshimi: so I'm going to do the simplest thing I can, which is a model with one row
[03:02] <huwshimi> lifeless: Sure, I just thought that would be a clean way to do it. That way you can just do Site.objects.get_current().my_timestamp
[03:03] <huwshimi> A default site is created when you set up the django project
[03:03] <lifeless> I see; it probably is pretty clean
[03:03] <lifeless> however, I've gotten all my stuff setup in the mean time
[03:04] <huwshimi> lifeless: Yeah, well doing it another way would be fine too
[03:05] <huwshimi> lifeless: Oh actually it probably would have been Site.objects.get_current().configs.my_timestamp
[03:05] <huwshimi> lifeless: It's just how I would have done it if I was setting up project wide configs
[03:05] <mwhudson> lifeless: not sure i understand
[03:06]  * mwhudson catches up
[03:06] <mwhudson> lifeless: model with one row sounds easiest, tbh
[03:26] <poolie> lifeless, yep does fairly clearly depend on rabbit
[03:26] <poolie> will file a bug i guess
[03:27] <lifeless> poolie: that doesn't make sense to me, as our unit tests would die horribly wouldn't they ? (the ones with no layer)
[03:28] <poolie> maybe none of them have no layer?
[03:28] <poolie> istr rabbit says it can't be torn down
[03:28] <poolie> so things with no layer always have it accidentally running?
[03:29] <poolie> anyhow, https://bugs.launchpad.net/launchpad/+bug/892938 has a simple demonstration
[03:29] <_mup_> Bug #892938: lp.testing.TestCase inherently depends on rabbit <Launchpad itself:Triaged> < https://launchpad.net/bugs/892938 >
[03:29] <lifeless> argh django. datetime should *always* have tzinfo. What are you *thinking*
[03:30] <wgrant> Django has a lot of similar moments.
[03:30] <mwhudson> lifeless: you assume much by mentioning thought
[03:30] <mwhudson> lifeless: https://code.djangoproject.com/ticket/17062 is fun
[03:31] <mwhudson> oh hey look, that's fixed apparently
[03:31] <lifeless> hah
[03:31] <mwhudson> nice job with the bug mail, trac
[03:31] <lifeless> 19 hours ago
[03:31] <poolie> wgrant, i don't know, do you think i should stay on the same debian version?
[03:31] <poolie> it just seemed likely to cause less confusion if i did increment it
[03:31] <poolie> especially as it's sometimes rebuilt and might lose the recipe version etc
[03:32] <lifeless> mwhudson: thanks for the link !
[03:32] <poolie> also, do you think i should not wrap the depends?
[03:32] <poolie> or just wrap them more tidily
[03:33] <wgrant> poolie: Wrap them more tidily.
[03:33] <wgrant> I think we should bump the version for releases.
[03:33] <wgrant> Not for every revision.
[03:34] <poolie> what is a release in this context?
[03:34] <poolie> every time we ask it to be deployed?
[03:34] <lifeless> mwhudson: does delete() return the row count deleted ?
[03:34] <poolie> anyhow the basic thing is ok with me
[03:35] <mwhudson> lifeless: don't know
[03:35] <poolie> i'm not sure when it will actually get deployed so i suppose i'm being optimistic
[03:35] <poolie> any other comments on that patch?
[03:35] <lifeless> hah, win
[03:35] <lifeless>   File "/home/robertc/source/launchpad/oops-tools/working/parts/django/django/db/models/query.py", line 430, in delete
[03:35] <lifeless>     "Cannot use 'limit' or 'offset' with delete."
[03:35] <lifeless> AssertionError: Cannot use 'limit' or 'offset' with delete.
[03:36] <wgrant> Is that surprising? I didn't think postgres supported that.
[03:36] <wgrant> MySQL does on UPDATE, IIRC.
[03:37] <StevenK> I thought LIMIT worked with DELETE?
[03:38] <lifeless> no, the surprising thing is that django generated it in the query
[03:38] <lifeless> and barfs on it
[03:38] <poolie> :)
[03:38] <lifeless> rather than e.g. doing a subselect to identify the rows to delete
[03:39] <wgrant> removed: lib/canonical/launchpad/icing/style-3-0.css
[03:39] <wgrant> It cannot be!
[03:39] <StevenK> lifeless: And you're suprised Django is naive?
[03:39] <StevenK> wgrant: Wait. jtv will accidently resurrect it via lint changes.
[03:39] <wgrant> Heh
[03:40] <Dr_Who> anyone around that might be able to help with increasing the size of a pap ?
[03:40] <Dr_Who> err ppa I mean
[03:40] <wgrant> Dr_Who: How urgent is it?
[03:40] <huwshimi> wgrant: Did that just get merged?
[03:41] <wgrant> huwshimi: Yep
[03:41] <Dr_Who> well I'm trying to get a large set of packages built against libjpeg-turbo so if things continue well, we'll be able to replace libjpeg with libjpeg-turbo in precise
[03:41] <Dr_Who> (it's about a 2x-4x perf boost for intel and armel)
[03:41] <poolie> funnier in scotland
[03:42] <Dr_Who> if tomorrowish was possible wgrant that'd be awesome
[03:42] <wgrant> Dr_Who: Probably best to ask at https://answers.launchpad.net/launchpad/+addquestion
[03:42] <Dr_Who> ok thanks
[03:43] <huwshimi> wgrant: Oh, so it did.
[03:43] <lifeless> wgrant: https://code.launchpad.net/~lifeless/python-oops-tools/prune/+merge/82840
[03:44] <wgrant> Grar, I hate tests that touch DB users in bad ways.
[03:45] <wgrant> Like TestPersonSetMerge
[03:55] <lifeless> wgrant: https://code.launchpad.net/~lifeless/python-oops-tools/bug-892917/+merge/82841
[03:56] <wgrant> lifeless: How does oops-tools' prune differ from oops-datedir-repo, apart from having an implied path and DB-backed last prune date?
[03:57] <wgrant> lifeless: As for the other branch, don't you need to change the current model too>?
[03:59] <lifeless> wgrant: https://code.launchpad.net/~lifeless/python-oops-tools/bug-892914/+merge/82842
[03:59] <lifeless> wgrant: yes, I do, will fix that
[04:00] <lifeless> wgrant: oops-tools prune only prunes the db, doesn't touch disk.
[04:00] <lifeless> wgrant: for two reasons; A) if it does delete everything, I wanted a Plan B. and B) two-phase commit is hard.
[04:00] <lifeless> wgrant: so I just plan on us running both pruners.
[04:01] <lifeless> wgrant: other than UI cruft like help text, the duplication is ~ 4 lines long.
[04:01] <lifeless> wgrant: well below my generalise-it threshold
[04:04] <poolie> lp is in testfix mode or something?
[04:04] <wgrant> lifeless: Ah, it should probably say that.
[04:04] <wgrant> lifeless: It currently says it deletes stuff from the repository.
[04:04] <wgrant> poolie: No
[04:05] <poolie> Commit message [[r=mbp] delete canonical.buildd, now its moved to launchpad-buildd] does not match commit_re [(?# Strong suggestion: use ``bzr lp-land`` or ``ec2 land``.  Manual submission notes: your submission message needs at least one of [r=...] [rs=...] or [release-critical=...] AND at least one of [no-qa] [incr] [rollback=...] [bug=...].)(?is)(?=(\s*\[[^\]]+\])*\s*\[(release-critical=[^\]]+|rs?=[^\]]+)\])(?=(\s*\[[^\]]+\])*\s*\[(incr|
[04:05] <poolie> no-qa|bugs?=\d+(,\s*\d+)*|rollback=\d+)\])]
[04:05] <poolie> huh
[04:05] <wgrant> poolie: Needs a QA tag
[04:05] <poolie> it's associated with a bug
[04:05] <poolie> pht
[04:05] <Noldorin> poolie, hi
[04:05] <Noldorin> poolie, so, i'll definitely need to get a version of LP running locally?
[04:06] <poolie> yeah that's a good idea
[04:06] <poolie> dev.launchpad.net has scripts for how to do it
[04:06] <poolie> it is mostly scripted but it may take a while
[04:06] <poolie> or, rather, it's all scripted, it will take a while, it is possible but unlikely the scripts may get snagged and then we  can help you get them going again
[04:07] <Noldorin> poolie, guess  i can always have a go at designing the source-controlled wiki feature i'm interested in too then :-)
[04:07] <poolie> test_poppy failed again :/
[04:07] <poolie> that would be great
[04:07] <Noldorin> i discussed that with mgz or somehting
[04:07] <Noldorin> a few weeks ago
[04:07] <wgrant> poolie: Hm, never seen that.
[04:07] <poolie> i was just starting to put in markdown support on the weekend
[04:07] <wgrant> poolie: Apart from your email.
[04:08] <Noldorin> poolie, oh awesome. in what area? using python-markdown i guess
[04:08] <poolie> yes
[04:08] <Noldorin> poolie, mind linking me to the appropiate bug so i can now when to begin my efforts? :-)
[04:10] <lifeless> wgrant: 'repository'. But yes, I will change it to say 'database' to avoid confusion
[04:11] <poolie> Noldorin, https://code.launchpad.net/~mbp/launchpad/391780-markdown/+merge/82832
[04:11] <poolie> that is the markdown thing
[04:11] <poolie> i suggest you get some smaller patches in first to warm up
[04:11] <poolie> and get familiar with how it works
[04:11] <Noldorin> poolie, yeah, like the download types thing?
[04:11] <poolie> yeah
[04:11] <huwshimi> I appear to have forgotten how to merge a working branch with our main branch. Can I just do "rocketfuel-get" and then "merge ../devel" from my branch?
[04:12] <wgrant> huwshimi: That will work, yets.
[04:12] <Noldorin> poolie, ooh so you've already finished it, jsut ready to mergew
[04:12] <wgrant> yes
[04:12] <lifeless> wgrant: tweaked help pushing now
[04:13] <huwshimi> wgrant: Is that not the recommended way? Or am I reading too much into the way you said that?
[04:13] <lifeless> wgrant: I'm going to cook dinner; I would like to land all three and deploy tonight, for hopefully obvious reasons
[04:13] <poolie> i've finished a small part of it
[04:13] <wgrant> lifeless: Have you also fixed the model lengths?
[04:13] <poolie> lifeless, i will look at the mail bug now
[04:14] <lifeless> wgrant: yes, pushed that an age ago
[04:14] <wgrant> huwshimi: Some discourage rocketfuel-get, but I think it's fine.
[04:14] <wgrant> lifeless: Thanks.
[04:14] <poolie> are you suggesting that i broke it, or are you just keen to accept my offer to look at it?
[04:14] <lifeless> wgrant: thank you for noticing
[04:14] <lifeless> poolie: bit of column A, bit of column B
[04:14] <huwshimi> wgrant: Ah right, it seems to work for me, but I don't do very complicated things
[04:14] <lifeless> poolie: there is some guilt by association with that area of the code, but also just that you are familiar with it, which is a Good Thin
[04:15] <lifeless> g
[04:16] <lifeless> wgrant: our oopses compress to about 100K - thats using a 7MB as reference
[04:16] <lifeless> wgrant: I propose to add gz compression to amqp2disk to tide us over to a server with more disk
[04:17] <wgrant> lifeless: If we indeed turn rabbit on by Wednesday, that sounds like a good workaround.
[04:17] <Noldorin> poolie, i'm most encouraged by how active this channel is :-)
[04:17] <Noldorin> bedtime now
[04:17] <Noldorin> but i'll have a go at that soon
[04:17] <Noldorin> and poke a dev if necessary
[04:18]  * wgrant renames reconnect_stores() to reconnect_stores_DONT_YOU_DARE_USE_THIS()
[04:19] <Noldorin> night folks
[04:19] <wgrant> Night Noldorin.
[04:20] <Noldorin> bye
[04:23] <poolie> happy hacking
[04:24] <lifeless> wgrant: right, really off cooking. Can you ack you're reviewing those?
[04:24] <wgrant> lifeless: Yu[
[04:25] <wgrant> Yup
[04:25] <lifeless> thanks.
[04:27] <poolie> huwshimi, would you be so kind as to read https://code.launchpad.net/~mbp/launchpad/888353-microformats/+merge/82767 for me
[04:27] <huwshimi> poolie: sure
[04:27]  * huwshimi reading
[04:27] <poolie> and https://code.launchpad.net/~mbp/launchpad/meta-description/+merge/82769
[04:37] <poolie> could someone please try running lp.poppy.tests.test_twistedsftp.TestSFTPServer.test_file_creation on oneiric?
[04:38] <huwshimi> poolie: I think that looks ok, but I don't really know enough about how google handles that stuff
[04:40] <poolie> it's hard to tell for sure ahead of time
[04:40] <poolie> until we see how they parse the actual pages
[04:40] <poolie> do you think it will be any worse?
[04:40] <StevenK>     self.assertEqual(os.stat(file_name).st_mode, 0100644)
[04:40] <StevenK> AssertionError: 33204 != 33188
[04:40] <StevenK> poolie: ^
[04:40] <poolie> i thought so
[04:40] <poolie> thanks StevenK
[04:40] <huwshimi> poolie: Not sure how it could be
[04:41] <wgrant> poolie, StevenK: Yeah, there are a couple of tests that break due to the insane default umask change.
[04:41] <wgrant> I have a list somewhere.
[04:41] <poolie> oh ok
[04:41] <poolie> https://bugs.launchpad.net/launchpad/+bug/892955
[04:41] <_mup_> Bug #892955: lp.poppy.tests.test_twistedsftp.TestSFTPServer.test_file_creation fails on oneiric <poppy> <spurious-test-failure> <twisted> <Launchpad itself:Triaged> < https://launchpad.net/bugs/892955 >
[04:42] <poolie> do we actually care?
[04:42] <wgrant> We will in a few months.
[04:42] <wgrant> Until then we just curse Ubuntu for doing bad things.
[04:43] <StevenK> wgrant: It's now 002?
[04:43] <StevenK> It is.
[04:43] <StevenK> Madness.
[04:44] <StevenK> I thought we set the umask inside poppy?
[04:48] <lifeless> poolie: re depends on rabbit - no, it doesn't
[04:49] <lifeless> poolie: your environment claims rabbit is available, but it isn't
[04:55] <poolie> what environment?
[04:57] <wgrant> lifeless: But you want the oldest, not the first loaded.
[04:57] <wgrant> Since AFAICT you use the real age everywhere else.
[04:57] <wgrant> Not the loaded age./
[04:59] <poolie> lifeless, oh i see
[04:59] <poolie> but having configuration data for rabbit does not imply it's running
[05:00] <ajmitch> ±
[05:16] <lifeless> wgrant: for pruning we want real not claimed
[05:16] <lifeless> poolie: yes it does :)
[05:16] <lifeless> poolie: if its configured, and not running, thats an environmental issue
[05:17]  * wgrant shops for a reviewer for https://code.launchpad.net/~wgrant/launchpad/reconnect_stores-is-a-horrible-person/+merge/82844
[05:18] <wgrant> +81/-188
[05:18] <lifeless> lookin
[05:24] <wgrant> lifeless: Thanks.
[05:29] <huwshimi> poolie: From line 59 is my test I've added, does this look ok? https://code.launchpad.net/~huwshimi/launchpad/tag-cloud-removal-709009/+merge/81689
[05:31] <poolie> lifeless, so re "environmental problems" i just want to be able to run the tests within launchpad's buildout environment
[05:31] <poolie> that seems like a reasonable thing to want
[05:32] <lifeless> poolie: which tests?
[05:32] <poolie> the buildd tests
[05:32] <poolie> post splitout
[05:32] <lifeless> they should be independent
[05:32] <lifeless> it Must Not import from launchpad
[05:32] <lifeless> and launchpad Must Not import fro it
[05:32] <lifeless> *from* it.
[05:32] <poolie> pht
[05:33] <lifeless> I don't know what pht means here. But LP is a horrendous environment with a deep stack of assumptions in its code and structure - things like the config system are merely part of it.
[05:34] <lifeless> I don't see it as *at all* interesting to let importing things from LP work for other projects: I see it as interesting to extract code from LP such that that code can be reused sensibly.
[05:34] <poolie> i'm just trying to gradually unpick the horro
[05:34] <poolie> anyhow
[05:34] <poolie> with one trivial exception, they do no longer import from lp
[05:34] <poolie> i will fix that now
[05:34] <poolie> i guess it needs its own buildout config for things it does depend upon
[05:34] <lifeless> I know, and I'm glad you're doing that - it doesn't mean that using an LP specific test helper in a misconfigured environment is reaosnable
[05:35] <lifeless> (yes, 'development' is misconfigured - deliberately so, until make run or bin/run are executed)
[05:35] <poolie> ok, whatever
[05:35] <poolie> if using it outside of bin/test is not supported, i'll close the bug
[05:36] <lifeless> its not
[05:37] <lifeless> fixing things so that tests really can run in isolation, get an automatic config etc would be wonderful - but I think you'd need to start at the other end of the chain : the symptom you ran into is in ok code, its the rest of the stack that is flawed.
[05:37] <lifeless> amongst other things, your developer db would be wiped, etc, running with the 'development' config.
[05:38] <poolie> yeah
[05:38] <poolie> i guess bzr has or had problems where test classes counted on setup being done by bzr selftest
[05:38] <poolie> i think those are bugs
[05:39] <poolie> but, perhaps this is not a good place to start
[05:39] <poolie> it's closed
[05:39] <lifeless> certainly, and I'd totally accept 'LP Tests don't work outside of bin/test' as a bug - and be happy if you want to start on that yak shaving exercise
[05:39] <lifeless> its deep and nasty; both jml and I have spent weeks stabbing at it and making various partial improvements
[05:40] <lifeless> for instance, currently you must have a test runner that can reinvoke itself because there is no guarantee for an arbitrary testA, testB pair, that testA can run in the same process as testB
[06:23] <poolie> ok
[06:23] <poolie> soryr for the misunderstanding
[06:23] <poolie> lifeless, i'm happy to say launchpad-buildd no longer imports launchpad at all
[06:24] <poolie> there are still tests in launchpad that import lpbuildd
[06:24] <poolie> production code does not
[06:25] <poolie> lifeless, could you read https://code.launchpad.net/~mbp/launchpad/892427-service-failure/+merge/82766 for me?
[06:52] <poolie> allenap, hi?
[08:05] <poolie> allenap, hi?
[08:06] <rvba> Hello poolie, allenap should be here in about 1h.
[08:11] <poolie> ooh
[08:11] <poolie> rvba, how about some reviews?
[08:11] <rvba> poolie: yep, I just saw that you have a few branches up for review ;)
[08:12] <poolie> :)
[08:12] <poolie> i felt inspired on the weekend
[08:12] <rvba> I see that!
[08:12] <poolie> by how bad some search results were, etc
[08:47] <poolie> rvba, thanks
[08:48] <rvba> np
[08:49] <poolie> i had an idea there was meant to be no space after the chevron but i can't see anything that says so
[09:12] <allenap> Morning poolie, sorry I forgot to change the topic :-/
[09:14] <poolie> np
[09:14] <poolie> was just going to say i ended up finishing off the rabbit startup failure patch you suggested
[09:14] <poolie> raphael reviewed it
[09:15] <mrevell> Hello
[09:16] <rvba> Morning mrevell.
[09:37] <wgrant> rvba: Was it you who was working on preloading specific jobs for Builder:+history?
[09:37] <poolie> mrevell, i think the only really scary bit of https://bugs.launchpad.net/launchpad/+bug/391780
[09:37] <_mup_> Bug #391780: Support Markdown "stack overflow" style hyperlinks markup <feature> <lp-foundations> <markdown> <Launchpad itself:In Progress by mbp> < https://launchpad.net/bugs/391780 >
[09:37] <poolie> is hooking it into the edit widget
[09:37] <rvba> wgrant: yep
[09:37] <poolie> and it may not be hard
[09:38] <wgrant> rvba: Are you aware of the large OOPS regression?
[09:38] <rvba> wgrant: oops, no…
[09:38] <poolie> and i guess see if lifeless has any real objection
[09:38] <wgrant> 2285 InconsistentBuildFarmJobError: Could not find all the related specific jobs. Bug: https://launchpad.net/bugs/891600
[09:38] <_mup_> Bug #891600: InconsistentBuildFarmJobError: Could not find all the related specific jobs.  <oops> <Launchpad itself:Triaged> < https://launchpad.net/bugs/891600 >
[09:38] <wgrant>       13 https%3A//launchpad.net/ubuntu/karmic/%2Bsource/libatasmart/%2Bbuilds (SourcePackage:+builds)
[09:38] <wgrant>         OOPS-0307a9c4a7c9430eeb6a7952a3fb138c, OOPS-1e170c1660c5e4b23a4fa8db662b267c, OOPS-2ae836060fa3b0c90416132f78e4c6cc, OOPS-2d3458326e2328888803cce42c71ae2f, OOPS-4220ac65deb478aa8b47f4ddc65290d9
[09:44] <rvba> wgrant: sorry, was otp.
[09:44] <rvba> wgrant: I'm looking into it right now.
[09:46] <rvba> wgrant: I remember wondering about this but I made the new code do what the old code did: raise an InconsistentBuildFarmJobError if no specific job can be found… I really wonder how that's a problem now.
[09:48] <poolie> how hard/easy is it to override a utility for the duration of a test?
[09:48] <wgrant> rvba: Hmm
[09:48] <rvba> wgrant: do you think this is so bad that we need a cowboy to stop the bleeding?
[09:49] <wgrant> rvba: No, it's been around for a few days.
[09:49] <wgrant> poolie: lp.testing.fixtures has ZopeAdapter and ZopeViewReplacement fixtures. ZopeUtility would be similar, I imagine.
[10:05] <poolie> yeah, i think this will work
[10:05] <poolie> surely this is the whole point of the complicated dependency injection thing?
[10:05] <poolie> s//a
[10:06] <wgrant> Hah
[10:08] <poolie> it's a religious thing?
[10:08] <wgrant> poolie: In its defence, raw_sendmail does have a comment saying that it's untested.
[10:12] <poolie> the court finds this argument unpersuasive
[10:15] <rvba> wgrant: I think I'll need your help to pin point where the problem is… having this InconsistentBuildFarmJobError means that one of the specific jobs could not be found: is that possible? I mean I'm trying to understand if the bug is in the way I fetch the specific jobs or if the condition to raise this error is too strict.
[10:20] <wgrant> rvba: That is a little odd.
[10:20] <wgrant> rvba: I note in the query log of https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-0307a9c4a7c9430eeb6a7952a3fb138c that the first few BFJ IDs in query 138 are duplicated.
[10:22] <rvba> Right.
[10:22] <wgrant> Which would probably do it.
[10:23] <wgrant> Since it's not going to get duplicates back.
[10:23] <wgrant> So the counts will differ.
[10:24] <rvba> Very true. I wonder where this duplication comes from
[10:24]  * wgrant scratches head
[10:24] <wgrant> Ah, rendering error
[10:24]  * wgrant kicks WebKit.
[10:25] <wgrant> rvba: It's also already doine tonnes of BFJ/PB queries before it gets to that.
[10:25] <rvba> Yes, I just saw that.
[10:25] <wgrant> Which is, I must say, a little bit odd.
[10:26] <wgrant> Huh.
[10:26] <wgrant> Ah, nevermind.
[10:26] <poolie> wgrant, ok, well, kinda fixed
[10:26] <poolie> i added a test but it doesn't fail and it's not obvious how it would
[10:26] <poolie> but i think you and i should stop soon
[10:27] <wgrant> Heh
[10:27] <wgrant> rvba: It's reproducible on DF, which is nice.
[10:27]  * wgrant pokes around in the DB.
[10:27] <rvba> Thanks wgrant.
[10:27] <wgrant>  distro_arch_series |   id    | package_build | source_package_release
[10:27] <wgrant> --------------------+---------+---------------+------------------------
[10:27] <wgrant>                  95 | 1739878 |       1739878 |                 664115
[10:27] <wgrant>                  95 | 1739878 |       1739878 |                 664115
[10:27] <wgrant>                  94 | 1739877 |       1739877 |                 664115
[10:27] <wgrant>                  94 | 1739877 |       1739877 |                 664115
[10:27] <wgrant>                  93 | 1739876 |       1739876 |                 664115
[10:27] <wgrant>                  93 | 1739876 |       1739876 |                 664115
[10:27] <wgrant> etc
[10:27] <wgrant> It is indeed duplicated
[10:27] <wgrant> wtfwtf
[10:28] <wgrant> Ah
[10:28] <wgrant> There's an SPPH join in there.
[10:28] <wgrant> That's really interesting.
[10:28] <wgrant> It should be causing builds to actually show up twice when they've been copied.
[10:29] <wgrant> Did you change the main query at all?
[10:29] <wgrant> Query 12
[10:29] <rvba> No.
[10:29] <wgrant> So this may have revealed a long-standing bug.
[10:30] <wgrant> Probably in SourcePackage.getBuildRecords
[10:30] <wgrant> However, you should probably fix getSpecificJobs to work on distinct IDs.
[10:30] <rvba> Yep.
[10:30] <wgrant> Possibly making it crash if it's given a non-distinct set.
[10:30] <rvba> Will do, thanks again for the help wgrant.
[10:30] <wgrant> Yeah, SourcePackage.getBuildRecords needs a DISTINCT.
[10:36] <poolie> wgrant, i did something towards https://bugs.launchpad.net/launchpad/+bug/885972 but i can't really understand why it's failing
[10:36] <_mup_> Bug #885972: raw_sendmail creates TimedActions with invalid detail <oops-infrastructure> <regression> <Launchpad itself:In Progress by mbp> < https://launchpad.net/bugs/885972 >
[10:36] <wgrant> rvba: Confirmed from the oops-tools DB that only SourcePackage:+builds is affected.
[10:37] <wgrant> poolie: Why what's failing?
[10:37] <poolie> it doesn't fail for me
[10:38] <poolie> i don't know why it's failing for you
[10:38] <rvba> wgrant: great, I'll finish what I'm doing right now and then work on a fix for that right away.
[10:38] <wgrant> poolie: It doesn't crash.
[10:38] <poolie> do you have a traceback or repro instructions?
[10:38] <poolie> oh it's just lost
[10:38] <wgrant> poolie: It just generates a bad OOPS.
[10:38] <wgrant> Which crashes old versions of oops-tools, and lacks the detail that was intended.
[10:39] <wgrant> rvba: Thanks.
[10:39] <poolie> i wonder if this is a 2.4ism
[10:39] <rvba> Thank *you* wgrant ;)
[10:40] <wgrant> poolie: What's a 2.4ism?
[10:40] <wgrant> poolie: This worked before because our RFC822 encoder stringified everything.
[10:40] <wgrant> json/bson do not.
[10:40] <wgrant> json crashes, bson silently omits
[10:42] <poolie> afaics message['subject'] is a string
[10:42] <wgrant> It's an email.header.Header
[10:42] <wgrant> Its repr and str are a string
[10:42] <wgrant> So it looks like a string
[10:42] <wgrant> until you type() it
[10:44] <poolie> nup, when i run it, i really get a string
[10:44] <poolie> that's why i was wondering what path it was following to get there
[10:45] <wgrant> Are you on 2.6 or 2.7?
[10:46] <poolie> i am, that's why i said maybe a 2.4 thing
[10:46] <wgrant> Oh.
[10:46] <wgrant> Prod has been 2.6 for 18 months now.
[10:46] <poolie> python 2.4 that is
[10:46] <poolie> oh
[10:46] <wgrant> So it could be a 2.6 vs 2.7, nothing to do with 2.4
[10:47] <poolie> i will try it in ec2
[10:47] <poolie> it's not documented as changed in 2.7
[10:53] <poolie> wgrant, anyhow if you can give me a clue how to reproduce the failure i will have another go
[10:53] <poolie> not nececssarily tonight
[11:01] <rvba> wgrant: do you think I should mimic what setupCompleteBuilds did before: i.e. keep duplicates jobs?
[11:05] <rvba> wgrant: I think I should not mess up with the batch size.
[11:06] <wgrant> rvba: I'd preserve the dupes, I think.
[11:06] <wgrant> Then fix the duping issue separately.
[11:06] <rvba> Agreed.
[11:53] <rick_h_> morning all
[12:32] <rvba> wgrant: If you're still up for a quick review (otherwise I'll grab benji later): https://code.launchpad.net/~rvb/launchpad/relatedjobs-bug-891600/+merge/82870
[13:01] <rick_h_> poolie: ping
[13:08] <rvba> Morning benji.
[13:09] <benji> morning rvba; how goes it?
[13:10] <rvba> benji: Great, I hope you've had a nice weekend because you need to be ready for some reviewing action :)
[13:10] <benji> heh
[13:11] <rvba> benji: I'm gonna grab a late lunch then finish allenap's review when I'm back.
[13:11] <benji> k, I'll take a look at the reviews in the queue
[14:39] <deryck> rick_h_, https://dev.launchpad.net/JavaScriptReviewNotes
[14:39] <deryck> abentley, ^^
[14:46] <sinzui> My computer does not like the latest kernel update. If I know updating would be unstable, I would be on precise now
[14:53] <mrevell> Hey deryck, how are we looking for taking custom bug listings into beta tomorrow?
[14:53] <deryck> mrevell, It will be Wednesday.  Sorry.
[14:53] <mrevell> No problem; I'd rather it were right than rushed.
[14:54] <deryck> mrevell, agreed.  I'll send you an email by my EOD to let you know if we're still on track, but I feel good about hitting Wed.
[14:54] <mrevell> Cool.
[15:06] <abentley> sinzui: I have a request for a mailing list archive dump.  Who knows about those things?
[15:06] <sinzui> losas
[15:07] <sinzui> abentley, we ask a losa to send the mbox to the user if the user is a member of the team
[15:07] <abentley> sinzui: Okay.
[15:07] <sinzui> abentley, we restrict to team members because the mbox can contain deleted messages
[15:07] <abentley> sinzui: I see.
[15:51] <gary_poster> mars, hi.  Is https://bugs.launchpad.net/launchpad/+bug/663923 still active for you?  I'm probably not going to take it immediately, but it's on LP's escalated bug list, so it would be good to have a current status on it.
[15:51] <_mup_> Bug #663923: Cannot view list archive of private team <escalated> <mailing-lists> <ml-archive-sucks> <regression> <Apache OpenID:New> <Launchpad itself:In Progress by mars> < https://launchpad.net/bugs/663923 >
[15:53] <rick_h_> I just got that this morning gary_poster
[15:53] <rick_h_> I was trying to view the archive of a list I got onto and log out/back in/etc couldn't get it to play nice
[15:53] <rick_h_> heh, the same group actually
[15:53] <gary_poster> rick_h_, :-) and :-/
[15:57] <sinzui> jcsackett,  I think you QAed your branch that is in the kanban landing column.
[15:57] <jcsackett> sinzui: you are correct; i have moved the card.
[16:50]  * deryck goes offline for lunch, back soon
[17:38] <mars> gary_poster, Hi, that bug is still active but on hold for the moment.  I do not have the resources to work on it right now, but stuartm is trying to resolve that.
[18:17] <lifeless> allenap: if you're still around, I would like to know more details on how scriptactivity is flawed
[18:45] <rick_h_> deryck: is the inline editor in use? It looks like it's supposed to be in the merge proposal ui for the description, but not seeing it work out that way
[18:47] <deryck> rick_h_, yeah, it is.  There are Zope widgets that spit out the html/css for the js widgets.
[18:47] <deryck> rick_h_, let me find the file to point you at....
[18:47] <rick_h_> yea, saw them in lazr stuff
[18:47] <rick_h_> app/browser/lazrjs.py?
[18:49] <deryck> rick_h_, yeah.  And the doctest helps understand it too:  lib/lp/app/doc/lazr-js-widgets.txt
[18:49] <rick_h_> thanks, will head there next
[18:50] <gary_poster> mars, ok, cool.  Thanks for update.  Could you mention status on bug, maybe, if you have not already?
[18:56] <dobey> i'll try this over here instead;
[18:57] <dobey> you guys know what would be awesome?
[18:57] <dobey> having private attachments on public bugs :)
[18:58] <rick_h_> deryck: thanks, found it
[18:58] <deryck> rick_h_, cool!
[19:28] <sinzui> dobey, bug 512085
[19:28] <_mup_> Bug #512085: Secrecy settings for attachments <lp-bugs> <privacy> <Launchpad itself:Triaged> < https://launchpad.net/bugs/512085 >
[19:29] <dobey> sinzui: ooh, thanks!
[19:55] <flacoste> bac: i've marked bug #891641 as untestable
[19:55] <_mup_> Bug #891641: Use of random.seed(n) in tests needs cleanup <qa-untestable> <Launchpad itself:Fix Committed by bac> < https://launchpad.net/bugs/891641 >
[19:56] <flacoste> let me know if i was wrong
[19:59] <lifeless> sinzui is the master of bugs
[19:59] <bac> flacoste: yes, tahnks
[20:00] <sinzui> I am? Do I have triage all 6000 again?
[20:11] <deryck> flacoste, abentley has his qa done.  just fyi.
[20:21] <sinzui> My wife and daughter are now looking for house in regions with unsafe water, earthquakes, flooding, mud slides, alligators, and no Ikea
[20:21]  * sinzui stops work to do emergency presentation about when to live
[20:22] <sinzui> In case you are wondering, I do have an presentation prepared in case of just such an emergency.
[20:25] <dobey> about *when* to live?
[20:25] <sinzui> s/when/where/
[20:25] <dobey> oh. so no exploding universe at the end?
[20:25] <dobey> disappointing :)
[20:26] <sinzui> My universe will explode if I have to live near alligators. They are first on my list of things to make extinct.
[20:27] <dobey> sinzui: well that's not a bad thing. they are tasty, and make great shoes
[20:29] <sinzui> exactly. We can make the world safe, and feed the people, and look great.
[20:29] <dobey> i want a pet alligator
[20:29] <dobey> but they are illegal in VA :(
[20:33] <nigelb> dobey: ...
[20:35] <dobey> nigelb: yes?
[20:36] <nigelb> dobey: I'm just o_O about the pet alligator line.
[20:37] <dobey> haha
[20:38] <sinzui> That did not go well. I failed to take into account that my family are geographically impaired. They do not believe that Maryland and Virginia and technically part of the South
[20:40] <sinzui> BTW, the video out on the macbook air just works
[20:41] <dobey> without Virginia, "The South" doesn't exist
[20:42] <dobey> sweet tea, pulled pork, and fried chicken == the south
[20:43] <huwshimi> I have a merge proposal that I merged with devel on, but now it's showing the diff as empty: https://code.launchpad.net/~huwshimi/launchpad/style-removal-one/+merge/82096
[20:43] <sinzui> I live in Alexandria. A Northern enclave with a statue to honour the confederate dead
[20:43] <huwshimi> Is this a known bug?
[20:43] <dobey> now, Florida on the other hand, is not part of the south
[20:43] <sinzui> dobey, EXACTLY
[20:43] <rick_h_> heh, I heard more southen accents in VA than I ever did in OK
[20:43] <sinzui> They do not believe me
[20:43] <rick_h_> they must have courses on twang
[20:44] <dobey> OK?
[20:44]  * rick_h_ has family in VA we visit every year
[20:44] <dobey> OK is not the south
[20:44] <rick_h_> Oklahoma
[20:44] <dobey> OK is the plains
[20:44] <sinzui> Oklahoma in midwest, fly-over-country
[20:44] <rick_h_> well I was 30min from the TX border
[20:44] <rick_h_> so I got the worst of both worlds
[20:45] <dobey> TX is also not the south; it's just exas
[20:45] <dobey> err, just texas
[20:45] <rick_h_> hmm, I think if you visit you might keep that to yourself :)
[20:45] <sinzui> rick_h_, Yeah, I think suicide is a viable option in that case
[20:45] <dobey> or excess; however you prefer to pronounce it
[20:46] <rick_h_> moving to VA sinzui ?
[20:46] <dobey> he's in va
[20:46] <dobey> well, DC
[20:46] <dobey> but the VA side
[20:46] <rick_h_> gotcha
[20:46] <rick_h_> my family's down charlottesville way
[20:46] <sinzui> rick_h_, I can barely pay bills with 3 children. I think I need to move
[20:46] <rick_h_> live on both sides of the mountains, always fun driving for visiting
[20:47] <rick_h_> sinzui: heh, why I've stopped at 1 :)
[20:47] <dobey> sinzui: heh; well, alexandria is probably the wrong place to be; though the schools are good
[20:47] <rick_h_> I don't know, I think keeping away from DC is just good judgement
[20:47] <sinzui> I thought my argument to live within 1 hour of an Ikea and an airport would be the point of contention.
[20:48] <dobey> but that's to be expected given the average income in Alexandria
[20:48] <rick_h_> what if that stuff spreads out there?
[20:48] <rick_h_> shush on ikea
[20:48]  * rick_h_ grumbled fake wood crappy crap
[20:48] <dobey> you could just build furniture out of legos. same thing
[20:49] <rick_h_> legos at least have some sturdiness to them when assembed right
[20:49] <dobey> legos might be sturdier though
[20:49] <sinzui> My son has already done that
[20:49] <dobey> heh
[20:49] <sinzui> I think a bed of nails would have been more comfortable
[20:49] <rick_h_> my other hobby is woodworking, no have lots of bad things to say on ikea
[20:49] <rick_h_> /no/so
[20:50] <benji> lego blocks about 10X the normal size for furniture building would appeal to me
[20:51] <benji> ...made from hardwood and stained
[20:51] <sinzui> rick_h_, dobey, benji, http://www.youtube.com/watch?v=X-Kf-R1RKNk
[20:54] <benji> now I just need an army of slaves to build my lego house for me
[20:58] <sinzui> I have just solved the unity dash window ordering problem. I can fix it by plugging, then unpluging an external onito
[20:58] <sinzui> monitor
[20:59] <sinzui> rick_h_, You can feel smug to be in the same company are David Mitchell http://www.youtube.com/watch?v=X-Kf-R1RKNk
[21:00] <rick_h_> I'll see if I can work on my smugness
[21:13] <benji> sinzui: is that the dash-comes-up-below-the-active-window-but-still-has-keyboard-focus-so-confuses-the-crap-out-of-me bug?
[21:14] <sinzui> yes
[21:33] <lifeless> bbs, hard disk rails have arrived
[21:33] <flacoste> huwshimi: i think that's because your branch was merged, so it doesn't have a diff anymore
[21:34] <huwshimi> flacoste: Ah right. Was a bit confusing
[22:00] <bac> hey sinzui, got a second to talk about https://bugs.launchpad.net/launchpad/+bug/480123
[22:00] <_mup_> Bug #480123: Milestone names/version should be unique to series <escalated> <linaro> <lp-registry> <Launchpad itself:In Progress by bac> < https://launchpad.net/bugs/480123 >
[22:01] <sinzui> bac: I do not at this time I am looking for  a quite room to have the purple standup
[22:01] <sinzui> bac: maybe in 40 minutes?
[22:01] <bac> sinzui: ok.  ping me when you're free
[22:03] <sinzui> wallyworld, jcsackett, wgrant, I am having audio troubles.I can barely hear you all
[22:04] <wallyworld> sinzui: do you want to speak, not sure if we can hear you
[22:15] <lifeless> allenap: thanks for the feedback
[22:25] <lifeless> poolie_: can you put a featureflag around markdown ?
[22:25] <lifeless> poolie_: (if there isn't one already)
[22:26] <lifeless> poolie_: rvba's performance figures are a little concerning
[22:27] <poolie_> i did
[22:27] <poolie_> i'd like to talk to you about it briefly after this call
[22:28] <lifeless> sure
[22:29] <StevenK> sinzui, wgrant, wallyworld, jcsackett: http://pastebin.ubuntu.com/745424/