[00:06] hi wallyworld,thumper [00:06] wgrant [00:06] poolie: g'day [00:06] wallyworld: so remember the query parameters thing [00:06] wallyworld: O hai. How were your flights? [00:06] Morning poolie. [00:06] lifeless: yeah [00:06] wallyworld: matsubara says that oops-tools /should/ handle queries with parameters already substituted [00:07] wallyworld: so the simplest thing is ok to do. [00:07] lifeless: \o/ [00:07] if it doesn't handle them, it has code to normalise that we can just fiddle with [00:07] wallyworld: I thought that might make you happy ;) [00:07] hi poolie [00:07] lifeless: very, cause it means i already have the coding done :-) [00:08] i need to finish a couple of other things and then i'll get a mp up [00:08] StevenK: flights were good - had a spare seat next to me :-) [00:08] * StevenK grumbles [00:09] StevenK: your flight was full then? [00:09] Utterly [00:09] Surprised they weren't people being asked to sit on others laps [00:10] wow. you fly to sydney and then cancerra? [00:10] s/cancerra/canberra === henninge changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: builds are not retrying at the moment | On call reviewer: - | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews [00:10] wallyworld: Why would I do that? [00:10] StevenK: i thought you lived in canberra? [00:10] wallyworld: Heh. No. [00:11] * wallyworld should change his nic to rambo [00:14] Yes! === wallyworld is now known as rambo [00:16] StevenK: don't mess with me [00:17] Haha [00:22] righto [00:22] time to fire up a garbo job I think [00:23] I feel the need to code [00:30] thumper: do you know if there is a bug open about the 'edit' link for a reviewers prior vote taking you to a different page (vs ajaxing it up) [00:31] lifeless: not sure [00:35] thumper: fyi 707217 [00:35] bah [00:36] thats a bug number [00:36] Anyone to review https://code.launchpad.net/~wgrant/launchpad/bug-707189-forgetful-copier/+merge/47341? [00:36] I'll do it [00:36] Thanks. [00:36] It's pretty simple. [00:36] uhm [00:36] the unmerged revisions list is huge [00:36] It is, yes. [00:36] I was wondering about that. [00:36] I wonder if jtv's branchrevision change caused that? [00:37] I presume so. [00:37] it didn't look like it could [00:37] No, it didn't. [00:37] But I don't see what else it could be. [00:37] Was going to investigate after getting this through. [00:37] wgrant: while I read, care to file a bug, tagged regression [00:37] (and thus critical) [00:38] lifeless: I'm ready to +1 it, if you want to mentor my rewview [00:38] *review [00:38] sure [00:40] http://www.flickr.com/photos/mbp_/5386185146/ [00:41] wgrant: tweak [00:42] StevenK: you need to read a little closer I think :) [00:42] Hm [00:42] - distroarchseries=distroarchseries) [00:42] 26 + distroarchseries=arch) [00:42] thats the actual bugfix [00:42] wgrant: Isn't that supposed to be target_archs ? [00:42] the rest is sugar to make it clearer, and tests [00:43] lifeless: Ugh, sorry, copied that from a test above. [00:43] wgrant: I suspected :) [00:43] StevenK: 'for arch in target_archs:' precedes that. [00:43] wgrant: there may be others, that stood out to me [00:43] StevenK: I could rename arch to target_arch, i suppose. [00:43] lifeless: I deliberately fixed them all. [00:43] wgrant: No, it's fine [00:43] But apparently not. [00:45] lifeless: https://code.launchpad.net/~jtv/launchpad/forget-branchrevision-id/+merge/46955 <- in lib/lp/code/model/branchmergeproposal.py, the SourceRevision.branch_id == self.target_branch.id condition is new. [00:46] not bad timing. [00:46] jtv: Morning. [00:46] hi wgrant! Evening here. [00:47] jtv: Any ideas on why https://code.launchpad.net/~wgrant/launchpad/bug-707189-forgetful-copier/+merge/47341? has lots of merged revisions listed as unmerged? [00:48] There is an extra condition that you added in getUnlandedSourceBranchRevisions. [00:56] wgrant: hi [00:56] maxb: How did you notice the lpia issue? [00:56] I presume you don't actually have any lpia users. [00:57] another package unexpectedly went to dependency-wait [00:57] Ah, of course. [00:57] You're right, if it had been a leaf package, I'd never have noticed :-) [01:13] Project devel build (388): FAILURE in 5 hr 27 min: https://hudson.wedontsleep.org/job/devel/388/ [01:16] hmm [01:16] I wonder if we can get rid of the tree structure of messages for bugs [01:16] it seems to add significant overhead [01:17] Aha. [01:17] The librarian failures have now shown up on Hudson. [01:17] aha? [01:17] lifeless, it would give me a warm glow if you run and like Wrested [01:17] not necessarily right now [01:17] hi poolie [01:17] poolie: I've put it in my toys to play with box [01:17] poolie, did you start a new library? [01:17] that box is a little full right now though :( [01:17] hi james_w [01:17] :) [01:18] 'win' https://hudson.wedontsleep.org/job/devel/388/changes [01:19] damn [01:19] I'm slightly confused [01:20] I remember in dallas removing a PPA from a recipe and having it work [01:20] but now it doesn't [01:20] and according to the source, it shouldn't have worked before [01:20] abentley: (trying to rule stuff out) did you land your translations patch via ec2 land, or direct ? [01:20] and I don't know why it did [01:21] james_w, i did start a new library [01:21] i think it currently imports something from txrestfulclient but not very much [01:21] i don't mean any disrespect [01:22] i just wanted to start from zero so i could understand what was happening [01:22] lplib has kind of a lot of layering between the app and what's on the wire [01:22] i would be happy to turn this into a patch to txrestfulclient etc [01:22] but it will probably change the apis a lot [01:22] right, I've just seen your mail [01:25] replied [01:25] (twice, sorry) [01:28] np, thanks [01:29] turning them into lower and higher layers could be good [01:29] i still think getting an object and then separately populating it is likely to cause bugs [01:29] but imbw [01:29] agreed [01:30] that's what I meant by using this as the building blocks, sorry for not being clear [01:30] that was me trying to keep it familiar to people who had used lplib, but that wasn't the right approach [01:32] right [01:32] are there enough users of txrestfulclient at the moment that we need to worry about keeping it's api stable? [01:32] (that probably is true for launchpadlib for example) [01:33] nope [01:38] thumper: if a branch has a sourcepackage, did we want to include the source package's linked_branches in the related branches list? [01:39] rambo: maybe? [01:39] and if yes, then do we need to collect the linked_branches for each sourcepackage in product.distrosourcepackages when the branch is a product branch? [01:40] would be good to have a proper dataset to try it on [01:47] StevenK: can we have a mumble chat? [01:57] rambo: Sure [01:58] StevenK: see you at the Blue Oyster [01:58] s/Blue Oyster/Blue Room [01:58] rambo: You're tempting me to find a clip of the Blue Oyster Bar music [01:59] * rambo LOL [02:00] ahha [02:00] 84 / 192 BugTask:+index is back at ze top [02:01] StevenK: you got cold feet? [02:04] rambo: Sorry, you're breaking up very badly [02:04] * rambo :-( [02:11] wgrant: OOPS-1850PPA1004 [02:16] Does anyone know where the javascript is that handles the advanced search? I've been told it exists, but I can't see it anywhere. [02:17] huwshimi: what javascript ? [02:17] huwshimi: its a form submission [02:17] (which is why the url is terrible; stock html forms don't know about 'optional' fields.) [02:18] lifeless: This is what is confusing me. [02:19] wgrant: sorry urgent stuff elsewhere… don't know what's wrong with that MP you pointed out, but could it be that the branch came off devel? It's proposed for merging into db-devel. [02:19] huwshimi: you're talking about e.g. https://bugs.launchpad.net/launchpad-project/+bugs?advanced=1 [02:19] lifeless: Yeah [02:19] jtv: lp:launchpad is devel these days [02:19] oh! [02:20] lifeless: so I'm having a look at simplifying those urls and now I see that the suggestion wasn't to modify the javascript but rather to add it :) [02:20] huwshimi: :) [02:20] man, we have a tonne of boilerplate in the source for that page [02:20] we redefine make_picker for each person picker instance on the page :) [02:21] :( :( :( [02:21] lifeless: Thanks. There was a reason I couldn't find it beyond my lack of familiarity with the source [02:21] yeah, it doesn't exist :> === rambo is now known as wallyworld [02:33] thumper: just talked with stevenk, will include link_branches off the context branch's sourcepackage in the related branches list [02:34] s/link_branches/linked_branches [02:41] wallyworld: ok [02:43] ok, i'm going crazy [02:45] whats the difference between [02:45] IBugComment [02:45] and [02:45] IBugMessage [02:45] other than spelling [02:47] ... one is in browser code [02:47] [03:04] * thumper wandesr off [03:04] * thumper needs coffee badly [05:27] * StevenK blinks at his new MP including lots of unmerged revs [05:40] StevenK: We believe that it's fallout from jtv's BranchRevision.id changes a couple of days back. [05:40] I haven't investigated thoroughly. [05:40] Right [05:40] That makes a vague sort of sense [05:44] thumper: rofl: [05:44] # XXX MichaelHudson 2010-01-13: Write _mergeSourcePackageRecipes! [05:44] #self._mergeSourcePackageRecipes(cur, from_id, to_id)) [06:04] heh [06:12] StevenK: so, I think you're changing the wrong part of the system [06:12] StevenK: I've suggested a better change in the review. [06:12] StevenK: the red flag that went off was 'filtering in python' [06:12] You haven't yet, it seems [06:14] lifeless: I'm about to head out, but I would like to get the interval request_daily_builds runs at down to 10 minutes, which I think is sufficent to not really worry with more granularity [06:15] StevenK: why 10 minutes? whats the overall goal here. [06:15] Out of time, sorry [06:15] later then [06:15] anyhow, my comment applies regardless of the granularity [06:19] Project devel build (389): STILL FAILING in 5 hr 5 min: https://hudson.wedontsleep.org/job/devel/389/ [06:19] * Launchpad Patch Queue Manager: [r=abentley][ui=none][bug=705197] Replaces use of storm.base.Storm [06:19] with a new class, Stormbase, [06:19] which descends from base.Storm but adds SQLObject's __storm methods. [06:19] * Launchpad Patch Queue Manager: [r=deryck][ui=none][no-qa] Migrate translations to new API [06:54] * huwshimi signs off === almaisan-away is now known as al-maisan [08:32] good morning [08:56] moin adeuring :) [08:57] hi al-maisan! === al-maisan is now known as almaisan-away === gmb changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: builds are not retrying at the moment | On call reviewer: gmb | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews === Ursinha-afk is now known as Ursinha [11:28] good morning launchpad [11:37] Ursinha: good morning. === leonardr changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: builds are not retrying at the moment | On call reviewer: gmb, leonardr | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews [12:03] Morning, all. [12:28] * gmb lunches [13:56] morning, all. [14:00] benji: do you have a prefered day to do OCR? since i'll be mentoring you we'll both need to commit to that day. my slot is currently friday. [14:02] adeuring, ping for standup [14:02] oops, thanks [14:19] abentley: I'm pushing lp:~adeuring/launchpad/translation-fixing3 to LP righ now [14:25] hi jml, quick question: if I want to know in more detail how the LP api docs are generated and published, who should I best talk to? [14:25] dpm_: i can help you [14:26] leonardr, ah, great. [14:27] leonardr, I've got a few questions on that, let me send you an e-mail. [14:27] ok [14:42] adeuring, ack [14:44] where can one lookup what the timeout thresholds are for qastaging/staging? [14:45] jcsackett: good questions [14:45] jml: my calendar still show the product stand-up, i thought you changed it yesterday, google brokeness or you reverted that devision? [14:45] flacoste: starting next week [14:46] jcsackett: lp:lp-production-configs [14:46] jml: ok! [14:46] flacoste: thanks. [14:46] flacoste: you are welcome to join us. [14:51] salgado: do you have time to review https://code.launchpad.net/~wallyworld/launchpad/recipe-find-related-branches/+merge/47367 [14:51] sinzui, sure. can it be after my lunch? [14:52] I think that will be fine. wallyworld is asleep for the next few hours [14:52] cool; I'll do it then === salgado is now known as salgado-lunch === Ursinha is now known as Ursinha-lunch [15:13] jml: hi [15:14] bigjools: hi. on a call atm. [15:14] ah ok, will wait around [15:28] jml: so when you're off your call I could do with some help fixing an ec2/paramiko problem, it can't find my ssh keys :( [15:28] bigjools: how can I help you [15:28] bigjools: ahh. [15:29] heh, snap [15:29] I figured you're a knowledgeable chap [15:29] bigjools: can you paste the error? [15:29] ec2: ERROR: You must have an ssh agent running with keys installed that will allow the script to access Launchpad and get your branch. [15:29] I know some things [15:29] if I run the paramiko code it uses, I can re-create. get_keys() returns nowt. [15:29] I do have an ssh agent running [15:30] bigjools: what keys are in the agent? [15:30] oh god, do I need to manually ssh-add them? .... :/ [15:30] bigjools: umm... I don't *think* so. [15:30] bigjools: ssh-add -l should list [15:30] I just did ssh-add and it works now [15:31] ahh. [15:31] :( [15:31] it ought to just get them from... somewhere [15:31] gmb, or anyone else who wants an easy branch to review: https://code.launchpad.net/~leonardr/lazr.restful/web-link-wadl/+merge/47404 [15:31] * jml feels embarrassed for not knowing [15:31] it ought to [15:31] leonardr: Sure, I'll take easy work. [15:31] this is my maiden ec2 run [15:31] bigjools: I can't recall manually adding a key using ssh-add on this laptop [15:32] it might be an artefact of using kubuntu === gmb changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: builds are not retrying at the moment | On call reviewer: gmb, leonardr | reviewing: leonardr, - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews [15:32] Normally you need to ssh-add keys if you're using ssh-agent [15:32] bigjools: maybe. your key is in ~/.ssh/id_[rd]sa(.pub)?, right? [15:32] that's what I thought too [15:32] * gmb thinks that we need a better way to maintain state on the review queue than using the topic. There's too much of it to be helpful in this channel. [15:32] Later Ubuntu's gnome keyring stuff does weird stuff, which I carefully turn off [15:33] jml: yes [15:33] maxb: maybe that's it. [15:33] you'd think that paramiko would look in ~/.ssh [15:33] gmb: yes. [15:33] i was noting that yesterday. [15:34] jcsackett: I'll mail the list about it after I've done this review. Maybe we should just use +activereviews and claim reviews as we start them. [15:35] gmb: that seems a sensible approach. [15:35] Yay, I said something that made sense. The jet lag must be receding. [15:36] * gmb waits for the obvious rejoinder [15:40] I am all out of joke juice this morning [15:43] leonardr: In your diff it looks like there's a missing or extra single quote: [15:43] 113 + (specifically $[web_link']) [15:43] gmb, thanks [15:48] leonardr: r=me. === gmb changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: builds are not retrying at the moment | On call reviewer: leonardr | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews [15:48] * gmb goes off call === deryck is now known as deryck[lunch] [16:23] sinzui: do you recall where one finds oops logs for qastaging? [16:29] jcsackett: yes [16:29] jcsackett: https://devpad.canonical.com/~lpqateam/ contains the reports we are gathering and the historical reports [16:30] sinzui: ah, thanks. [16:30] * jcsackett bookmarks === beuno is now known as beuno-lunch === Ursinha-lunch is now known as Ursinha [16:44] henninge_: can you give me a hint how to replace the call of updateTranslation() in stories/standalone/xx-translationmessage-translate.txt? [16:55] sinzui: any notion where the raw oops files go? i recall you pointing it out to me once. i need to fetch a particular oops that happened on qastaging while i was qaing. [16:55] i want to make certain my branch is not the cause. [16:55] jcsackett: yes, somewhere in var [16:55] I can look in a minute [17:02] sinzui: i can dig through var, just needed to narrow it down from / === salgado-lunch is now known as salgado [17:18] sinzui: found what i needed, thanks. :-) === deryck[lunch] is now known as deryck [17:21] deryck, we're seeing Return of the Living Unknown with bug #707478 [17:21] <_mup_> Bug #707478: Freedesktop bug watches are (incorrectly) updated with "importance unknown" < https://launchpad.net/bugs/707478 > [17:21] bryceh, ah, that sucks. [17:21] * deryck looks more closely at the bug === benji is now known as benji-lunch [17:27] bryceh, so if this just appeared today, I would guess something suddenly changed in the upstream tracker, as you noted in the bug. [17:27] bryceh, did you notice anything upstream that seems different? [17:28] deryck, no, however my upstream cgi tool thingee quit working about a month ago [17:28] which I suspect was due to upstream changes to their new bug form [17:29] ah [17:29] * bryceh goes to look [17:29] bryceh, if you can spare the time to hunt down what's changed upstream, and dump it in the bug, that bug gets seriously easier to fix. [17:35] bryyce: Do you know why all these bug watches are getting their importance set to unknown? [17:35] was just going to ask about that -- it looks like a bug in the gnome bugzilla status parser? [17:36] benji, gary_poster: wikipedia's zope article has this sentence: "BlueBream (earlier called Zope 3) is less widespread but underlies several large sites, including Launchpad" [17:36] I'm not quite sure what to make of it :) [17:36] heh [17:37] until we get rid of zope.app.*, I'd say they have a point, jml :-) === bigjools changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: - | On call reviewer: leonardr | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews [17:42] Yippie, build fixed! [17:42] Project devel build (390): FIXED in 4 hr 59 min: https://hudson.wedontsleep.org/job/devel/390/ === beuno-lunch is now known as beuno === Ursinha-afk is now known as Ursinha [17:53] how freakin awesome is this https://code.launchpad.net/+daily-builds - 250! [18:02] bigjools: that is pretty good :) [18:03] I like that it goes down to 158 when you select "last 30 days". Software is hard. [18:03] it's been about 1 year since we started the daily builds project [18:03] yeah. [18:04] the hard bit went surprisingly quickly [18:04] then the niggles came [18:04] incidentally, we really need to display lists of data better than that. [18:06] hey, gary [18:06] a while ago i had a lazr problem with tests picking up the system libraries instead of the libraries in the source tree i was testing [18:06] you fixed this by changing the [interpreter] recipe to z3c.recipe.scripts [18:06] i believe you helped me fix lazr.restful [18:07] i'm having the same problem with lazr.restfulclient now, and i can't figure out the solution === benji-lunch is now known as benji [18:12] deryck, well, dunno if this has to do with the Importance bug, but I sorted out the problem with my upload tool - had to switch from POSTing the data to bz, to doing it via GET [18:13] leonardr: I didn't fix lazr.restful [18:13] how often is loggerhead updated for bazaar.launchpad.net? [18:13] It is using a recipe that isn't upgraded to the new stuff [18:13] lazr.restfulclient should be easier [18:13] bryceh, hmm, ok. likely not causing the importance issue, but could be related to the same change. [18:13] deryck, https://bugs.freedesktop.org/page.cgi?id=release-notes.html isn't mentioning anything obvious to have to do with that change [18:14] leonardr: zc.recipe.egg -> z3c.recipe.scripts, and then use the new zc.buildout [18:14] (1.5.2 IIRC) [18:14] bryceh, I'll triage it, and hopefully someone on one of the maintenance teams can take a look. [18:14] deryck, also btw kees' assumption of breakage with gnome bugzilla turned out to be a false positive one we investigated. So this seems localized to the fdo bz [18:15] gary: i think i'm stuck on "use the new zc.buildout". how? [18:15] bryceh, ok, thanks [18:15] deryck, thanks. [18:16] leonardr: 1) versions.cfg 2) new bootstrap.py 3) maybe update Makefile if it seems to refer to a specific version of buildout when it calls bootstrap [18:17] ok, trying it [18:17] lifeless: what steps are left for removing our dependence on z.testing layers? [18:17] (it seems a thing I can tug away at in my spare hacking time) [18:19] gary: i'm going to paste this stuff in rather than try to try to figure out exactly what's going on [18:19] The version, 1.2.3b2, is not consistent with the requirement, 'zc.recipe.egg>=1.3.0'. [18:19] ah, maybe i figured it out [18:19] k [18:22] gary: i got it to work, but only with allow-picked-versions=true. what do i need to do now? [18:23] leonardr: figure out the versions that are being used, and update them in versions.cfg. To figure out, ./bin/buildout -vv | grep 'Picked:' . I usually then sort the output in Python or my editor or something [18:23] (and remove dupes) [18:24] gary, thanks a lot [18:24] np leonardr [18:26] jelmer: btw, what was the RT for the bzr/bzr-builder stuff for the buildds? [18:26] gary: i can now run buildout but i'm still getting the error. i'm going to try completely form scratch, but any other ideas? [18:27] leonardr: still what error? you mean, finding some package or other? [18:27] * gary_poster has call in 3 [18:27] gary: when i run the tests it still uses the local packages [18:27] * leonardr can work on something else, np [18:28] leonardr: put branch up somewhere and tell me what it is and I will look [18:28] i think there's a bootstrap.py problem [18:28] ah, may be [18:36] leonardr: i have some more questions from what i was asking you about yesterday. have some time? [18:37] jcsackett, sure [18:38] leonardr: so, i ran with pdb in the section of _resource you recommended, and it's entering there but skipping the "if IClient..." bit. [18:39] digging in, i discovered that webservice_error only works on exceptions raised by the exported method. but i've set the exported method to reraise, and still no dice. thoughts? [18:39] leonardr: if mumble is better for you than irc, let me know. this does get muddled in text form. :-P [18:46] gary, whenever you have time, lp:~leonardr/lazr.restfulclient/test-2 [18:46] ok, jcsackett... === matsubara is now known as matsubara-lunch [18:46] ack [18:46] leonardr: yeah. lot of info to parse. feel free to force me to give it in smaller chunks. :-) [18:51] jcsackett: try calling lazr.restful.error.expose on the exception before re-raising [18:52] we seem to have switched to a system where individual exceptions must be marked--i don't remember this code [18:54] leonardr: got it in one. i had been told to avoid expose in the past, and evidently i then forgot about it. thanks for the reminder. [19:12] * jml dinner [19:14] jml: graph optmisation for fixtures [19:15] lifeless: which I guess depends on a declarative syntax for fixtures. [19:15] jml: I don't think it does [19:15] * jml blinks [19:15] I think it depends on an external dependency graph api to be exposed by fixtures [19:16] lifeless: morning [19:16] lifeless: hmm. I think I remember you talking about this before and me not quite understanding. [19:16] hi bigjools [19:17] lifeless: I will consult my archives. [19:17] lifeless: meanwhile, I solicit your feedback on https://bugs.launchpad.net/launchpad/+bug/707524 [19:17] <_mup_> Bug #707524: Debugging branch access problems requires running custom scripts against live data < https://launchpad.net/bugs/707524 > [19:17] lifeless: I've been experimenting with queries/schemas and adding the debversion_sort_key as a column turns a 350ms query into a 200ms one on dogfood. I'm going to prepare a schema patch in advance of code changes if you still agree it's a good direction? [19:27] jml: I will look at that shortly [19:28] bigjools: I think that that is a conservative denormalisation we should be able to trivially keep synced which can offer significant performance benefits [19:28] bigjools: e.g. 'fine by me' [19:28] :) [19:29] bigjools: I'm going to send a mail this morning as perf tuesday wrapup talking about the analysis I did on this [19:29] great [19:29] once we get the new column I can stick an index on it as well [19:29] there may be other such cross-table situations where we have missed the actual cost [19:29] bigjools: what is binarypackagename for ? [19:30] leonardr: The bootstrap you have in test-2 is not right. use the one from launchpadlib [19:30] lifeless: in what context? [19:30] Launchpads db schema [19:30] it, er, stores binary package names :) [19:30] gary: i'm pretty sure i did that before i pushed. let me double check [19:30] obviously i did something wrong if you're not seeing that though [19:30] on call again :-P [19:31] bigjools: why ;) - was it simply 'well thats third normal form', or something deeper ? [19:31] I need to go cook breakfast [19:31] back shortly [19:31] lifeless: it's been like that since well before my time - I assume it was to save db space [19:32] bigjools: note that if it was inlined into binary package release we could sort from index [19:32] (even without a debversion_sort_key column) [19:33] possibly [19:33] (we probably would want a debversion_sort_key column still) [19:33] yes, it's effectively pre-caching the result of a slow function === matsubara-lunch is now known as matsubara [20:04] bigjools: sinzui: bug 707478 - would one of you like to nab this as a zomg situation ? [20:04] <_mup_> Bug #707478: Freedesktop bug watches are (incorrectly) updated with "importance unknown" < https://launchpad.net/bugs/707478 > [20:05] deryck: hey [20:06] deryck: wondering if you can help me figure out how to qa the front of the queue [20:06] I do not think this is ready to code yet. No one on my team could start this until it is clear what has to change. [20:06] same here - I am on my own until tomorrow when Gavin is around, he could look then if it can wait [20:07] lifeless, hey, let me look at the queue and see. [20:07] so, on operational issues, I don't know that waiting for RTC makes a lot of sense : there is investigation needed for sure, but thats no different to needing to do db analysis when figuring out teamparticipation corruption, for instance. [20:08] flacoste: what do you think? === henninge_ is now known as heninge === heninge is now known as henninge [20:09] morning [20:09] lifeless: i'd agree, but at the same time, i think it makes sense to leave that for allenap to look at tomorrow [20:09] jcsackett: you question-state bug might be one test and one guard, but is `./bin/test -vvc -m lp.answers` fails, talk to me [20:09] lifeless, we usually mark checkwatches bugs qa-untestable. With some trackers -- maybe mantis is one -- we can run checkwatches from staging. Sometimes we get odd connection issues with this. usually to do with ssl, IIRC. [20:10] unless someone is ready to start something fresh [20:10] sinzui: dig. thanks. [20:10] in which case, they could start, but they'd likely to have to talk to allenap or gmb at this point [20:11] deryck: so I might mark this qa-untestable then [20:11] lifeless, deryck: we have a long-standing RT to set-up some bug trackers for QA purpose [20:11] it sat very high the queue [20:11] "Bug watch updates for Red Hat Bugzilla are disabled. [20:11] but we never got to it [20:11] :( how come? [20:11] deryck: does that seem ok ? [20:12] bigjools: would it be ok with you if we assign this fdo bug to allenap ? [20:13] yep, I was going to suggest it [20:13] SpamapS: dunno. [20:13] lifeless: what; the bug? I'll do it [20:13] what's [20:13] https://bugs.launchpad.net/launchpad/+bug/707478 [20:13] <_mup_> Bug #707478: Freedesktop bug watches are (incorrectly) updated with "importance unknown" < https://launchpad.net/bugs/707478 > [20:13] thanks! [20:14] lifeless, yes, that seems fine with me. [20:14] flacoste, we never got that RT finished off because it required coordination with LOSAs and they never responded on it before we moved on to other work, so I never pushed it further. [20:15] deryck: we meant losa in this case [20:15] bigjools: https://bugs.launchpad.net/launchpad/+bug/660433 - I'm inclined to untestable that as well [20:15] <_mup_> Bug #660433: lucid support timeframe information not updated for NEW packages in lucid-updates < https://launchpad.net/bugs/660433 > [20:16] bigjools: but I don't have a deep enough understanding of this area to be sure that that is wise :) [20:16] lifeless: that's perfectly testable on DF [20:16] bigjools: ah! what is required to test it ? [20:16] I usually get pitti to do an upload, run the publisher, then ask him to look at the Packages file [20:17] ok, so in principle we could do on qas once we have an archive for it [20:17] please don't skip QA on publisher changes :) [20:17] yes [20:20] bigjools: this is cron.germinate [20:20] yeah [20:20] does it actually need an upload at all ? [20:20] yes, or the publisher has nothing to do [20:20] it looks like it will do work regardless [20:21] bigjools: would an upload to universe be sufficient ? [20:21] it will, but it depends on whether new input is needed [20:21] I am not very familiar with the changes [20:21] https://code.launchpad.net/~mvo/launchpad/support-timeframe-fix-660433/+merge/38503 - the english at the top is reasonably clear [20:22] packages that come into NEW [20:22] were not getting support timeframe set correctly [20:22] ok it's going to change existing stuff [20:23] AFAICT we could just run it [20:23] and diff the more-extras.override files [20:24] ok [20:24] I'll do it [20:25] it doesn't make it clear what the expected changes are though [20:25] gary, still the same problem: lp:~leonardr/lazr.restfulclient/test-2 [20:26] bigjools: thanks! [20:27] bigjools: its changing from suite=`$LAUNCHPADROOT/scripts/ftpmaster-tools/lp-query-distro.py development` [20:27] to [20:28] SUITES=`$LAUNCHPADROOT/scripts/ftpmaster-tools/lp-query-distro.py supported` [20:28] so the big thing AFAICT is that a) its going to take significantly longer and b) rewrite frozen distros [20:29] hmmm [20:29] and its doing this because NEW packages in lucid are not getting support durations exported [20:30] I am assuming that the ubuntu 'development' series is 'supported' too [20:30] otherwise it seems buggy >< [20:30] leonardr: zc.recipe.testrunner needs to be updated too, because it generates bin/test. I will try it and then confirm if that helps. [20:31] lifeless: so re-writing overrides for older series will make no difference [20:31] because the next invocation of the publisher will ignore them [20:31] we never, ever change stuff on released series, other than -updates etc. I'm not sure if this is what he intended. [20:32] lifeless: I want to wait to speak to him before saying this is ok, because it needs two publisher runs. Germinate sets up data that the following publisher run uses. [20:34] bigjools: does that mean we also need to change the publisher to not ignore changes to the overrides ? [20:35] * lifeless can see significant overheads arriving [20:35] bigjools: should we roll this patch out then, if its going to stall ? [20:36] lifeless: 1. no, no and thrice no. 2. the patch is not for the nodowntime set so it won't break anything if you mark it untestable on the provisio we look at it before the next rollout [20:37] 1. I meant rollback, not deploy ;) [20:37] and I meant you don't need to do that [20:37] not right now anyway [20:38] ok [20:38] so, I propose to: [20:38] - mark it untestable [20:38] - file a new bug saying that we have this time bomb [20:38] the code will never run anywhere except cocofigpineapplecumquat [20:38] - assign it to you, mail mvo, and cross every available limb [20:38] how does that sound? [20:38] great [20:39] cool [20:39] I'll co-ordinate with him to do tests [20:39] when's our next rollout date? [20:39] Feb 9, I guess [20:39] leonardr: http://pastebin.ubuntu.com/558269/ then it works for me (bin/test passes) [20:39] Ursinha! [20:40] :) [20:40] did you like the cat video? [20:40] bigjools, I had a hard time laughing [20:40] huh, no 2011 calendar [20:40] I was sure edwin made one [20:41] bigjools: while you are around, http://launchpad.net/bugs/707189 [20:41] <_mup_> Bug #707189: Architecture-independent direct copies can sometimes forget to copy some architectures < https://launchpad.net/bugs/707189 > [20:42] lifeless: actually looking at the merge again, I think his intent is only to set the timeframe data for new stuff in old releases [20:42] bigjools: If I understand correctly I could qa that via the web UI ? [20:42] bigjools: yes, thats his intent [20:42] lifeless: yes, copy an arch-indep package w/rebuild, and make sure it creates builds for all three PPA archictectures (which means copying a hardy package) [20:43] flacoste: hey [20:43] lifeless: so the patch is fine - but I'll test it with him anyway since I don't want to fuck anything up with the publisher === salgado is now known as salgado-afk [20:43] flacoste: I'm digging into more lazrjs widgets today [20:44] bigjools: so NEW stuff will honour overrides? [20:44] lifeless: yes [20:44] flacoste: the multiline text editor needs some work, which I'm going to do [20:44] great, my knowledge expands :) [20:44] lifeless: because it lives in -updates [20:44] flacoste: I want to get it to the same state as the picker widget, so you just render the widget and it all works [20:44] flacoste: which isn't the case right now [20:44] lifeless: only the release pocket is frozen [20:48] thumper: that sounds very good! [20:48] bigjools: bug 707630 for your qa pleasure [20:48] <_mup_> Bug #707630: qa needed for cron.germinate changes in rev 12250 < https://launchpad.net/bugs/707630 > [20:48] ok [20:51] bigjools: so from hardy to hardy? or from hardy to lucid would work (https://launchpad.net/bugs/707189) [20:51] <_mup_> Bug #707189: Architecture-independent direct copies can sometimes forget to copy some architectures < https://launchpad.net/bugs/707189 > [20:52] lifeless: you need a series that has lpia in it - hardy does [20:52] (the target series) [20:53] lifeless: well, anything up to karmic is ok [20:54] so arch indep only generates i386 though? [20:56] Does launchpad use mod_xsendfile by any chance? [20:56] no [20:58] for files served from the librarian, does the web server read and stream the file or the launchpad librarian web app do that? [20:58] the librarian daemon serves on http [20:58] the squid front end caches [20:58] and the apache front end does ssl [20:58] which web server of those three are you asking about ? [20:59] oh, and the haproxy does load balancing [21:00] lifeless, Were the issues with serving files from the librarian caused by timeouts in the librarian daemon? [21:00] cody-somerville: what issues? [21:00] lifeless, the timeouts [21:00] cody-somerville: I don't know what you're talking about [21:00] bug #? [21:01] lifeless, I'll look it up, one second. [21:02] bigjools: I think I'll wait for wgrant, my understanding here isn't sufficient for me to be confident [21:02] lifeless: it's trivial to test [21:02] bigjools: I'd expect a source copy of an arch-all package to only make an i386 build [21:03] bigjools: I copied langpack-locales from my hardy ppa to https://qastaging.launchpad.net/~bzr-beta-ppa/+archive/obsolete/+packages [21:03] lifeless: yes, but it needs publishing entries in all arches [21:03] bigjools: that requires a buildd to build it first, right ? :) [21:04] sorry I was confusing you earlier by saying builds, I should have said "builds published" [21:04] it does [21:04] confusion corrected. [21:04] I can update dogfood [21:04] and we don't have a buildd for qastaging yet [21:04] then we can do it there [21:04] bigjools: that would be great, I don't think the patch has propogated to staging yet [21:05] abentley: your patch has had a good test run with buildbot, FYI [21:10] lifeless: so I can easily QA his change but it would be nice to spread some knowledge, I can take you through it if you want [21:12] lifeless, I can't find the particular bug at the moment but I know you helped fix what ever was wrong :P [21:12] lifeless, anyhow, was just curious if you guys used it [21:13] lifeless, I saw that. Also saw that the bug is looking not buildbot-specific. [21:14] abentley: yeah [21:14] abentley: which is both good and bad [21:14] bigjools: I'd like that [21:15] lifeless: ok just bringing up DF with newest code [21:15] cody-somerville: are you thinking of the apport incident months ago? [21:15] lifeless: do you know off hand if the revision made it to db-devel et? [21:15] yet [21:15] lifeless, no, thinking of the timeouts when accessing files from the private librarian [21:15] bigjools: I haven't looked [21:15] cody-somerville: that would be apport then [21:16] cody-somerville: so the 'timeouts' are also known as 'firewall rules' :) [21:16] cody-somerville: or if you go far enough back, we were serving private librarian content via the front end app servers [21:16] cody-somerville: so what would happen is this: [21:17] - request for a 100MB (or whatever) file hits zope [21:17] - zope copies it from the librarian [21:17] - its not in the OS page cache so disk IO happens [21:17] - request times out [21:17] once its in the OS page cache the copy to the zope server was fast enough that things would work, but that could take multiple requests [21:18] what we do know is have the appserver issue a redirect when someone is authorised to access a private file [21:18] s/know/now/ [21:20] cody-somerville: anyhow, no, we don't use sendfile [21:20] no particular urge to do so either [21:21] I just figure apache2 is probably pretty good at reading and streaming files. ;) [21:21] cody-somerville: so is twisted [21:22] cody-somerville: and twisted can do our token authentication checks directly rather than having a somewhat awkward external helper to write [21:22] cody-somerville: as well as the mapping from url to disk (which is db dependant) [21:22] lifeless, you can do that with xsendfile too [21:23] lifeless, your python app can do authentication and what ever and then send the x-send-file header to have apache take over and handle the heavy lifting let your app get back to other things [21:23] cody-somerville: what we have now works great; and given how average apache2 actually is at serving from disk, I'm really not inclined to fiddle. [21:23] lifeless, no disagreement. [21:30] abentley, do you want me to review https://code.edge.launchpad.net/~abentley/launchpad/translation-fixing4/+merge/47461 or did you deliberately give it to deryck and henninge? [21:31] leonardr, I want henninge to review it. [21:31] ok, just checking [21:31] * leonardr has had a lonely tenure as ocr today [21:32] leonardr, I know the feeling. But I want hennninge to review it, because I'm rewriting translations tests and I want him to make sure I'm not changing their meaning. [21:33] got it [21:37] leonardr: how do I get the exported_as attribute out of a exported field from the Interface [21:37] leonardr: for example if I have ISomeInterface['fieldname'] [21:39] thumper: you'll probably need to root around in the annotations. why do you need this? [21:39] leonardr: I'm wanting to pass the interface field through to the lazrjs text editing widgets like we do for the popup [21:39] leonardr: so we don't have to explicitly specify the exported name, and accept empty values [21:40] leonardr: ideally I want to have it automatically generate the text to show too [21:40] leonardr: I'm refactoring the lazrjs text widgets [21:40] to make them more magic and awesomer [21:41] thumper: one complication comes from the fact that a single field may have multiple exported_as attributes in different versions. of course, you'll want the 'devel' name... [21:43] thumper: this should get you in the vicinity [21:44] leonardr: ok, thanks [21:44] no, i wasn't done [21:44] that wasj ust me thinking, here's the actual helpful part: [21:44] :) [21:44] anyone ever seen '__storm_table__ missing' in a SQLBase child class ? [21:44] has me a little flummoxed [21:45] ah [21:45] figured it out. [21:45] thumper: sorry, my head is abuzz with ideas. let's nail down what we want [21:45] you have ISomeInterface['fieldname'], which is exported_as('fieldname2') [21:45] I was returning BugMessage.bug, had to return BugMessage.bugID [21:45] leonardr: yes, [21:46] leonardr: IProduct['programminglang'] in fact [21:46] you are writing some python that takes as an argument the Field object ISomeInterface['fieldname'] [21:46] is that right? [21:46] yes [21:47] ok. one way of doing this would be to find the IEntry adapter corresponding to IProduct [21:47] this would be called something like IProductEntry_devel [21:47] but i think there's a simpler way to do it [21:48] give this a try and see what you get [21:49] call .queryTaggedValue(LAZR_WEBSERVICE_EXPORTED) on IProduct['programminglang'] [21:49] L_W_E is a constant you can import from lazr.restful.declarations [21:50] thumper -^ [21:50] * thumper tries [21:50] you can get IProductEntry_devel by calling EntryAdapterUtility.forSchemaInterface(IProduct, request) [21:51] but then you have the opposite problem--how to see which field was originally called 'programminglang' [21:51] however, i do see code that does that: [21:51] tagged_values = field.getTaggedValue( [21:51] 'lazr.restful.exported') [21:51] original_name = tagged_values['original_name'] [21:52] [21:52] ok, we can do this [21:52] what's its items? it should have ['as'], and that should be the value you're looking for [21:52] I get 'programminglang' from the versioned dict [21:53] 'as' is a simple string value [21:53] which is 'programming_lang' [21:53] which seems right [21:53] but what about the problem with devel vs other versions? [21:54] thumper: it's fine. we are always using the latest version, and the default state of a VersionedDict is for the latest version's values to be on top [21:54] on top? [21:54] a VersionedDict is a stack of dicts [21:54] with bleedthrough [21:54] ok [21:55] how can I see the stack? [21:55] just for my interest [21:55] * leonardr checks [21:55] thumper: it's available as .stack [21:56] cook [21:56] cool [21:57] thumper: we have a EntryAdapterUtility to hide this kind of detail (getTaggedValue) when it comes to the generated IEntry interfaces [21:57] we should consider adding a similar utility to manage the tags on the source interfaces [21:57] hmm... [21:57] yep [21:58] I'll go with this for a first cut refactoring [21:58] sure [22:13] matsubara, do you need a review? i'm eod but i can do one if it's quick [22:13] leonardr, yes, I'm writing the mp. just a sec. [22:13] wgrant: hi? [22:14] leonardr, https://code.launchpad.net/~matsubara/oops-tools/fix-graphs/+merge/47470 [22:17] so basically the script I added is a python script that replaces the bash script in devpad. It uses the new report objects to generate the reports rather than calling the analyse script. (which I'm going to deprecate once I get rid of all of the scripts/cronjobs using it) [22:17] matsubara: what kind of dsl is that in the setup.py? [22:18] leonardr, dsl? [22:18] 'graph_report = oopstools.scripts.graph_report:main', [22:18] that's not python [22:18] esp. because it's in a string [22:18] what is it? i'm just curious--it looks good judging by the context [22:19] right, that's how setup.py sets up new scripts in the bin/ directory [22:19] is it normal to have two underscores in name__in? [22:19] graph_report is how the script will be called and oopstools.scripts.graph_report:main is the entry point [22:20] yep, that's django's orm syntax [22:20] leonardr, setup.py will turn that into this script https://pastebin.canonical.com/42317/ in bin/ [22:21] btw, what do you mean by dsl? [22:22] domain-specific language [22:22] like the makefile language [22:22] ah right. makes sense now :-) [22:23] r=me === leonardr changed the topic of #launchpad-dev to: Performance Tuesday! | Launchpad development https:/​/​dev.launchpad.net/​ | PQM is open | firefighting: - | On call reviewer: - | reviewing: - | queue: [] | https://code.launchpad.net/launchpad-project/+activereviews === matsubara is now known as matsubara-afk [23:46] lifeless: Hi. [23:46] I'm not here today. [23:46] But what's up? [23:49] ah [23:49] so, I thought you might have triggered the kde build on rubudinium [23:50] Which? [23:51] its gone now [23:51] shrug [23:51] enjoy your awol :) [23:53] I am offski, see y'all tomorrow [23:54] Night bigjools.