[16:00] <matsubara> #startmeeting
[16:00] <MootBot> Meeting started at 10:00. The chair is matsubara.
[16:00] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[16:00] <matsubara> [TOPIC] Roll Call
[16:00] <MootBot> New Topic:  Roll Call
[16:00] <sinzui> me
[16:00] <matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[16:00] <matsubara> me
[16:00] <henninge> me
[16:00] <bigjools> me
[16:00] <stub> me
[16:00] <intellectronica> me
[16:00] <matsubara> rockstar, hi
[16:01] <matsubara> flacoste, hi
[16:01] <rockstar> em
[16:01] <matsubara> apologies from herb and ursula
[16:01] <matsubara> [TOPIC] Agenda
[16:01] <matsubara>  * Actions from last meeting
[16:01] <matsubara>  * Oops report & Critical Bugs
[16:01] <matsubara>  * Operations report (mthaddon/herb/spm)
[16:01] <matsubara>  * DBA report (stub)
[16:01] <MootBot> New Topic:  Agenda
[16:02] <matsubara> [TOPIC] * Actions from last meeting
[16:02] <MootBot> New Topic:  * Actions from last meeting
[16:02] <matsubara>  * danilos to discuss with herb a fix for bug 388825
[16:02] <matsubara>  * Ursinha to talk to matsubara and spm later about the codebrowse taking 10 mins to restart
[16:02] <matsubara>  * Ursinha to talk to flacoste about buildbot and storm updating for testing when he's available today
[16:02] <flacoste> me
[16:02] <matsubara> ok, Ursula did talk to me and there's a bug filed about the codebrowse issue
[16:03] <matsubara> flacoste, did ursula talk to you about the buildbot thing?
[16:03] <matsubara> henninge, do you know if danilo discussed the fix with herb?
[16:03] <henninge> mthaddon installed an updated version of pytz to fix bug 388825
[16:03] <matsubara> ok, it's fix released. so he did :-)
[16:03] <flacoste> matsubara: we did talk about storm
[16:03] <flacoste> matsubara: not sure what the buildbot stuff was about
[16:03] <henninge> matsubara: yes, I'd expect so.
[16:04] <matsubara> henninge, thanks
[16:04] <matsubara> flacoste, hmm I'll re-add the entry for next meeting to remind her
[16:04] <matsubara> [action] * Ursinha to talk to flacoste about buildbot and storm updating for testing when he's available today
[16:04] <MootBot> ACTION received:  * Ursinha to talk to flacoste about buildbot and storm updating for testing when he's available today
[16:05] <matsubara> ok, moving on
[16:05] <matsubara> [TOPIC] * Oops report & Critical Bugs
[16:05] <MootBot> New Topic:  * Oops report & Critical Bugs
[16:05] <matsubara> two bugs, bug 386759 and bug 361026. first one for rockstar, second one for flacoste
[16:06] <matsubara> rockstar, could you get someone to fix 386759 for 2.2.7?
[16:06] <rockstar> matsubara, yes.
[16:06] <matsubara> rockstar, it's blocking code review for some people
[16:06] <rockstar> Is that deployed on prod now?
[16:07] <matsubara> flacoste, any news about 361026?
[16:07] <matsubara> rockstar, yes
[16:07] <flacoste> matsubara: last news is that it's not easy to fix
[16:07] <sinzui> matsubara: I see other critical bugs we need to watch
[16:07] <rockstar> matsubara, so is it a candidate for CP then as well?
[16:07] <matsubara> sinzui, I'll get there :-)
[16:08] <matsubara> rockstar, might be
[16:08] <matsubara> flacoste, so, can you re-target it to 2.2.7?
[16:08] <flacoste> stub: "no easy fix" was your comment on bug 361026, how not easy is it?
[16:09] <stub> The registration forms on login.launchpad.net need to all stop creating and modifying Person records, and any fallout with that dealt with.
[16:09] <stub> I don't know how much fallout that will be - I'm not that familiar with them.
[16:11] <flacoste> matsubara: yes, retarget to 2.2.7
[16:11] <matsubara> stub, can you assess that and reply back in the bug report? if it's too difficult and the oops is not happening frequently we might want to decrease the importance
[16:11] <matsubara> flacoste, cool. thanks
[16:11] <matsubara> now for the critical bugs
[16:11] <matsubara> we have 8 critical bugs
[16:12] <flacoste> 8!!
[16:12] <matsubara> 4 Fix committed
[16:12] <matsubara> 2 in progress and 2 triage
[16:12] <matsubara> triaged
[16:12] <matsubara> flacoste, bug 390861 is one of the triaged ones
[16:12] <matsubara> sinzui, bug 391175 is the other one
[16:13] <matsubara> I take none of those will make the re-roll today?
[16:13] <matsubara> wait, that last one was in Triaged state a few minutes ago!
[16:13] <matsubara> sinzui, you're fast :-)
[16:13] <sinzui> matsubara: Edwin is having difficulties getting things landed in PQM
[16:14] <sinzui> matsubara: I think it will miss the reroll today.
[16:14] <matsubara> sinzui, the Absent content factory thing?
[16:14] <flacoste> matsubara: actually the 390861 one isn't in effect
[16:14] <flacoste> matsubara: i'll decrease it to high, since the storm update has been reverted
[16:14] <sinzui> matsubara: I don't think so. BjornT landed Bug 388112 for Edwin, but that too does not appear to be in db-devel
[16:15] <matsubara> re-roll will include up to r8203 from db-devel only
[16:15] <matsubara> flacoste, thanks
[16:15] <BjornT> sinzui: what isn't in db-devel?
[16:16] <matsubara> sinzui, that's on r8199
[16:16] <sinzui> matsubara: Given how quick thing are moving the the next release. I think we should assume a CP next week, and  cheer if it is ready for today
[16:16] <matsubara> sinzui, ok, so CP be it.
[16:16] <matsubara> thanks sinzui
[16:16] <sinzui> matsubara: EdwinGrubbs reported that when he pulled db-devel, it was missing that rev
[16:17] <EdwinGrubbs> sinzui: it exists now
[16:17] <matsubara> ok, I think that's it for this section
[16:17] <matsubara> thanks everyone
[16:17] <sinzui> matsubara: bug 287248 is the most pressing critical item my team has. Barry and Edwin are working on it. It may be a data corruption problem in prodution
[16:17] <matsubara> sinzui, that's the other one in progress, right?
[16:18] <sinzui> it is
[16:18] <matsubara> sinzui, so, we'll need to CP that one then
[16:18] <sinzui> If we need to change launchpad/mailman, it will be a CP
[16:18] <matsubara> sinzui, as BjornT cut db-devel on r8203  for the re-roll
[16:19] <matsubara> let's move on
[16:19] <matsubara> [TOPIC] * Operations report (mthaddon/herb/spm)
[16:19] <MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
[16:19] <matsubara> herb and the other losas are sprinting
[16:19] <matsubara> so herb will email the report to the list later on today
[16:19] <matsubara> [TOPIC] * DBA report (stub)
[16:19] <MootBot> New Topic:  * DBA report (stub)
[16:20] <stub> Database part of the rollout seems to have gone smoothly. We still need to rebuild the slave db used for read only mode, which needs to happen some time before the next DB outage so not urgent.
[16:20] <stub> The Storm update was rolled back in case it was causing or contributing to timeouts and memory issues noticed during QA. I'll reland this branch once release mode is over so we can test more fully on staging and edge.
[16:20] <stub> Nothing else to report.
[16:20] <matsubara> cool. thanks stub
[16:20] <matsubara> one final announcement before closing up
[16:21] <matsubara> we need to QA the last itens that landed since the rollout. I've asked Ursinha to fix the test plan script which seems broken and I'll ping the owners of each item after the meeting
[16:22] <matsubara> that's all
[16:22] <matsubara> anything else before I close?
[16:23] <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs.
[16:23] <matsubara> #endmeeting
[16:23] <MootBot> Meeting finished at 10:23.