=== salgado is now known as salgado-lunch [16:02] me [16:02] #startmeeting [16:02] Meeting started at 11:02. The chair is Ursinha. [16:02] Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] [16:02] Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. [16:02] no need to rush boss :) [16:02] me [16:02] me [16:02] me [16:02] hehe [16:02] I know, danilos is being a suckup [16:02] me [16:02] me [16:02] me again ;) [16:03] ok, so matsubara is in behalf of foundations and bigjools is half-here [16:03] rockstar, I'd use an \[ agreed\] on that :) [16:03] Chex, hi [16:04] stub isn't here, so [16:04] half of bigjools is more than enough for anybody [16:04] matsubara: hello [16:04] stub is excused from the meetings due to the time [16:04] [action] send email to stub about the dba report [16:04] ACTION received: send email to stub about the dba report [16:04] matsubara: that's ok, I'll add a note in the MeetingAgenda page [16:04] so, we're all here [16:04] [TOPIC] Agenda * Actions from last meeting * Oops report & Critical Bugs & Broken scripts * Operations report (mthaddon/Chex/spm/mbarnett) * DBA report (stub) * Proposed items [16:04] New Topic: Agenda * Actions from last meeting * Oops report & Critical Bugs & Broken scripts * Operations report (mthaddon/Chex/spm/mbarnett) * DBA report (stub) * Proposed items [16:05] sigh [16:05] well, you got the idea :) [16:05] [TOPIC] * Actions from last meeting [16:05] New Topic: * Actions from last meeting [16:05] * matsubara and/or Ursinha to add a count of untriaged bugs per team to the oops section [16:05] * Done, I have them here :) [16:05] * Chex to verify why oops-pruner is failing and reply to the failure email with more information. [16:05] https://lp-oops.canonical.com/oops.py/?oopsid=pruner [16:05] * This was fixed: spm removed checking from gangotri and added to wampee and soybean [16:06] * sinzui to work with losas to set the increase threshold for the product release finder monitoring script. [16:06] Not done. I will follow up today [16:06] oops-pruner action item was sorted out [16:06] https://lp-oops.canonical.com/oops.py/?oopsid=pruner [16:06] matsubara: I've added a note there :) [16:06] thanks ubottu [16:06] thanks sinzui [16:06] oops, missed that :-) [16:06] [action] sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script [16:06] ACTION received: sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script [16:06] matsubara: :) [16:07] next! [16:07] [TOPIC] * Oops report & Critical Bugs & Broken scripts [16:07] New Topic: * Oops report & Critical Bugs & Broken scripts [16:07] only one bug, bug 535071 [16:07] Launchpad bug 535071 in launchpad-foundations "Better error handling when librarian is offline" [High,Triaged] https://launchpad.net/bugs/535071 [16:07] matsubara: I only would like to ask if there's hope to fix this this cycle [16:08] matsubara: now that the LocationError bug is fixed, this is the next in the oops rank [16:08] Ursinha, not sure, I'll bring it up with Gary to have it scheduled [16:08] (for reference: LocationError bug is bug 538207) [16:08] thanks matsubara [16:08] Launchpad bug 538207 in launchpad-foundations "Oops calling view/isRedirectInhibited from non-launchpadview" [High,Fix committed] https://launchpad.net/bugs/538207 [16:09] [action] matsubara to talk to gary_poster about bug 535071 [16:09] ACTION received: matsubara to talk to gary_poster about bug 535071 [16:09] [action] matsubara to talk to Gary about scheduling bug 535071 [16:09] Launchpad bug 535071 in launchpad-foundations "Better error handling when librarian is offline" [High,Triaged] https://launchpad.net/bugs/535071 [16:09] all critical bugs are fix committed [16:09] great, thanks Ursinha [16:09] and [16:09] I see that librarian-gc failed on 16, but haven't seen any other failures, will keep an eye [16:09] matsubara: any failing scripts I'm missing? [16:10] nope, we already have an action item for prf [16:10] great, next! [16:10] will talk about the untriaged bugs in the Proposed items section [16:10] [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett) [16:10] New Topic: * Operations report (mthaddon/Chex/spm/mbarnett) [16:10] Ursinha, you didn't bring up my critical bug... [16:11] rockstar: hmm I right before the meeting all critical bugs were fix committed... [16:11] s/I right/right/ [16:11] rockstar: hmm they are, which one is your critical bug? [16:12] Ursinha, oh, well, yeah, it's fix committed, but a critical bug wouldn't be done 'til fix released (I'd figure) [16:13] rockstar: well, I always assumed that having it fixed, the devel would make it to the end.. are you having issues to have your fix cherrypicked? [16:14] Ursinha, no, but I was just prepared to give my statement. If you don't need it, I'll shut up. :) [16:14] rockstar: c'mon :) [16:15] rockstar: go ahead, please [16:16] rockstar: ok ok [16:16] :) [16:16] Chex: hi :) stage is yours [16:17] * rockstar apologizes for interruption [16:18] hello everyone [16:18] here is the LOSA report for this week, a bit brief: [16:18] * bigjools reads scrollback and throws wet fish at danilos [16:19] - LP Memory Leaks: We have gone through a couple rounds of testing trying to track down these appserver memory leaks. [16:19] (Bug #531071) [16:19] Launchpad bug 531071 in launchpad-foundations "lpnet app servers are leaking memory again" [High,Triaged] https://launchpad.net/bugs/531071 [16:20] - Codebrowse crashes: We have a new debugging procedure to capture the python crashdump for now, we are [16:21] waiting for GDB debugger syntax give better crash info to the developers. [16:21] - LP incidents of note: ; LP Cherry-picks: [16:21] 16-Mar: CP 9091 to lpnet* [16:22] 18-Mar: CP 9093 to librarian2 [16:23] and thats it for this week. any comments/questions?? [16:23] I'm fine, anyone else? [16:23] Chex, nice, is there any process in place to escalate those crashes? [16:25] ok, I guess that's a no :) [16:25] or I am offline :) [16:25] danilos: you're not [16:25] or we're both on a parallel universe [16:25] danilos: not really, right now michael hudson asked us to trigger a coredump, and let me know where the file is, for now, and he will work on a GDB way of tracing [16:26] Chex, cool, so it's basically a per-request basis, right? iow it won't happen automatically when we get crashes [16:27] danilos: thats correct, he asked us to do this for now: ' gcore $loggerhead_pid ' [16:27] Chex, ok, thanks a lot, very useful to know if we ever come to need it (though, hopefully not) [16:28] danilos: yes sure. welcome [16:28] anything else? [16:28] I'll take that as a no :) [16:28] moving on [16:28] [TOPIC] * DBA report (stub) [16:28] New Topic: * DBA report (stub) [16:29] stub is excused, I have an action for getting the report [16:29] next! [16:29] [TOPIC] * Proposed items [16:29] New Topic: * Proposed items [16:29] I have a few :) [16:29] * qa tagging: NEW! launchpad queries and "qa summary" [16:29] * untriaged bugs and QA stats of the week [16:29] * Feedback on the new process, improvement suggestions and comments welcome :) [16:30] ok, so the first one [16:30] I've created a list of queries to make qa life easier: https://dev.launchpad.net/PolicyAndProcess/PreReleaseQAProcess/Experiment/QueryList [16:30] have sent them to the dev list, but I want to make sure you're not in unnecessary pain [16:30] :) [16:30] there are queries per devel and tag, so it's easy to find a list in lp for a person [16:30] but I see this is not enough, team leads need team overall and we can't have it using launchpad UI [16:30] so I created a "qa summary" for each team, you can find yours here: https://devpad.canonical.com/~lpqateam/testplans/ [16:31] I've filed a RT to have these synced to rookery, to be accessible to public [16:31] questions? [16:32] we should email all the TLs about these! [16:33] * Ursinha adds to her notebook [16:33] [action] Ursinha to send email to TLs about QA summaries [16:33] ACTION received: Ursinha to send email to TLs about QA summaries [16:33] I just add the qa urls to the milestone page. [16:33] sinzui: is that helpful? === leonardr is now known as leonardr-lunch [16:34] sinzui, the problem is that we can't search by all the persons in a team, so if someone has done work outside your core app, it's hard to see it [16:34] danilos: exactly [16:34] team != lp project [16:34] Anyone from my team or user can see the bugs we ware working and and see our QA status. Since we do not necessarily QA our own landings, I do not care about which person has the tag. I care about the team [16:35] Ursinha, code team's summary is blank. [16:35] rockstar: it's because it's being generated now [16:35] (really) [16:35] every 15 minutes [16:35] Ursinha, oh, I assumed it was because we were awesome. [16:35] lol [16:35] sinzui, right, and malone doesn't offer the option to search per-team, only per-application or per single person [16:36] danilos: sinzui, bug 520569 [16:36] Launchpad bug 520569 in malone "Add the ability of searching bugs from various assignees" [Low,Triaged] https://launchpad.net/bugs/520569 [16:36] Ursinha: yes, but when anyone fixes a bug in registry, I wan that report because my team is responsible for the app. If a contributor lands something bad in the registry project, it is not the contributor ot the QA members who fix it; the registry team fixes it [16:37] sinzui, right, but sometimes people from your team will land stuff in... launchpad-web project [16:37] sinzui, and who'll ensure that QA happens there? [16:37] sinzui: thanks for explaining your case [16:37] I search launchpad-project too [16:37] tags work for project [16:38] sinzui, this report should give you a smaller list to go through instead of going through launchpad-project, and we can have RM worry about launchpad-project [16:38] sinzui, nobody will mind if you always worry about launchpad-project :) [16:38] I still think this is a useful list to have [16:38] if that's what we are arguing [16:38] :) [16:39] I'm not sure I got the idea, but if sinzui needs a list of lp-registry items, it's easy to have it using Launchpad ui [16:39] I do not need a list. [16:39] if that's what we are arguing :P [16:40] sinzui: are you happy with the things you have today? [16:42] No, but that is because I think I want to build a way to find the intersection of a team with a project or series or milestone to get a report of bugs and blueprints [16:42] Ursinha, sinzui: let's move on, and we can discuss the merits of this on the list, and suggest improvements as well; Ursinha, what's the LP project to file bugs/wishes against? [16:43] sinzui: if I add a list of launchpad-registry to that list, would help? [16:43] There is still a problem that no report understands that I and a canonical hacker and a contributor. My team is not responsible for QAing what I contribute [16:43] danilos: it's lp-qa-tools [16:43] s/I and a/I am a/ [16:43] sinzui: in general those items fall in the launchpad itself team, and me and matsubara take care of that [16:43] sinzui, well, you are responsible for that, and LP team is responsible for not letting unQAd items through, so we'd either have to back it out or QA it [16:44] sinzui, at least IMHO, but it's a different topic, so let's not discuss it now :) [16:44] You have never QAed my contributions to blueprints, answers, or foundations === salgado-lunch is now known as salgado === gary_poster is now known as gary-lunch [16:45] sinzui, danilos, I'll send the email to the list, and we can discuss the details in there, what about that? [16:45] sinzui, that's because we've done a bad job with QA in general [16:45] And I do QA all contributors work who land something in blueprints, answers or registry. [16:46] sinzui, that's very nice, and nobody is questioning that; whether we should rely on sinzui to QA all the items like that is an open question with a very simple answer ("no, we all should do it or help community do it") [16:47] anywaay, let's move on [16:48] ok [16:48] thanks danilos and sinzui for speaking up [16:48] :) [16:48] list of untriaged bugs in launchpad-project, a picture of a moment before the meeting: http://paste.ubuntu.com/397314/ [16:48] thanks [16:48] or [16:48] [16:49] Soyuz (soyuz): 79 [16:49] launchpadlib (launchpadlib): 25 [16:49] OOPS Tools (oops-tools): 22 [16:49] Launchpad Developer Utilities (lp-dev-utils): 9 [16:49] Launchpad QA Utilities (lp-qa-tools): 7 [16:49] Launchpad Development Wiki Moin theme (launchpad-dev-moin-theme): 6 [16:49] Launchpad Bugs (malone): 5 [16:49] Launchpad Auto Build System (launchpad-buildd): 4 [16:49] Launchpad Help Wiki Moin theme (launchpad-help-moin-theme): 4 [16:49] launchpad-web (launchpad-web): 3 [16:49] Launchpad Translations (rosetta): 3 [16:49] Launchpad CSCVS (launchpad-cscvs): 2 [16:49] launchpad-loggerhead (launchpad-loggerhead): 2 [16:49] bigjools, do you think soyuz will need any help in triaging? [16:49] Launchpad News WordPress Theme (launchpad-news-wordpress-theme): 2 [16:49] Launchpad Buildbot Configuration (lpbuildbot): 2 [16:49] trac-launchpad-migrator (trac-launchpad-migrator): 2 [16:49] Launchpad Documentation (launchpad-documentation): 1 [16:49] [16:49] if you think you can help, yes please [16:50] if it's obvious what to do, do it (but let me know) [16:50] bigjools, I'll go 'invalidate' a dozen or so, just to give a hand [16:50] bug fixing for dummies [16:50] danilos: I have a script that does that.... kidding [16:50] :P [16:50] I'll take care of the 22 New items for oops-tools [16:50] bigjools, and I'll mark a bunch of others as 'incomplete' with a comment "Why do you think it is so?" [16:50] [action] matsubara to triage open oops-tools bugs [16:51] Fail. launchpad-code isn't in that list. [16:51] rockstar, this time it probably means you are amazing [16:51] that's because you have 0 new oopses [16:51] rockstar, good job! [16:51] :-) [16:51] daniloff, yeah, I was fishing... [16:51] :) [16:51] s/oopses/bugs/ [16:51] rockstar: because it has no new bugs [16:51] you are all so funny today :) [16:51] [action] matsubara to triage open oops-tools bugs [16:51] ACTION received: matsubara to triage open oops-tools bugs [16:52] Ursinha, looks aren't everything though [16:52] [action] Ursinha to triage open lp-qa-tools bugs [16:52] ACTION received: Ursinha to triage open lp-qa-tools bugs [16:53] rockstar: sorry? :) [16:53] Ursinha, you are all so funny today :) [16:54] anyway, matsubara and I want to reactivate a section in this meeting, QA stats of the week [16:54] then we can discuss the status of bug triage and QA [16:55] that's all from me, I'm done here [16:55] anyone willing to add something? [16:56] ok, so sorry for taking so long [16:56] Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. [16:56] #endmeeting [16:56] Meeting finished at 11:56. [16:56] thanks everyone === leonardr-lunch is now known as leonardr === gary-lunch is now known as gary_poster === Ursinha is now known as Ursinha-food === noodles785 is now known as noodles775 === Ursinha-food is now known as Ursinha === salgado is now known as salgado-brb === salgado-brb is now known as salgado === salgado is now known as salgado-afk