[16:01] <bigjools> me
[16:01] <Ursinha> :)
[16:01] <henninge> me :)
[16:02] <Ursinha> wait wait
[16:02] <bigjools> come on get it together Ursula :)
[16:02] <salgado> Ursinha, we waiting for matsubara?
[16:02] <Ursinha> #startmeeting
[16:02] <Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[16:02] <Ursinha> [TOPIC] Roll Call
[16:02] <allenap> me
[16:02] <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[16:02] <sinzui> me
[16:02] <Ursinha> me
[16:02] <bigjools> meh
[16:02] <Ursinha> salgado: he's not coming today
[16:02] <henninge> still me
[16:02] <Ursinha> bigjools: lol
[16:02] <salgado> me (on behalf of the Foundations team)
[16:02] <Ursinha> Chex, rockstar: hi
[16:03] <rockstar> ni!
[16:03] <Ursinha> salgado: oh, hi then :)
[16:03] <Ursinha> stub isn't coming, he sent one email
[16:03] <Ursinha> anyway
[16:03] <Ursinha> [TOPIC] Agenda * Actions from last meeting * Oops report & Critical Bugs & Broken scripts * Operations report (mthaddon/Chex/spm/mbarnett) * DBA report (stub) * Proposed items
[16:04] <Ursinha> grrr
[16:04] <Ursinha> this is not nice
[16:04] <Ursinha> I don't see MootBot :/
[16:04] <rockstar> MootBot isn't here right now-leave a message at the beep.
[16:05] <salgado> who cares about MootBot anyway?  he won't help us fixing any bugs
[16:05] <Ursinha> salgado: he helps us with the meeting :)
[16:06] <Ursinha> [TOPIC] * Actions from last meeting
[16:06] <Ursinha>  * matsubara to email tim about  https://bugs.edge.launchpad.net/launchpad-code/+bug/507487
[16:06] <Ursinha>     * Emailed Tim, Paul is already working on this one
[16:06] <Ursinha>  * allenap to file a bug about OOPS-1474EA771 and discuss it with Bugs team.
[16:06] <Ursinha>  * henninge to fix bug 507498
[16:06] <Ursinha>  * matsubara to email tim about allocate-revision-karma script still blowing up
[16:06] <Ursinha>     * Emailed Tim about it
[16:06] <Ursinha>  * matsubara to talk to someone from soyuz about critical bug 506489
[16:06] <Ursinha>     * emailed Julian and pinged on IRC about it
[16:06] <bigjools> might as well close that, it's sorted for now
[16:06] <Ursinha> allenap: have you filed a bug for that oops?
[16:07] <allenap> Ursinha: It was marked as a dupe of an existing bug. I'll try and dig out the master bug.
[16:07] <Ursinha> thanks allenap
[16:07] <Ursinha> [action] allenap to dig the master bug of OOPS-1474EA771
[16:07] <Ursinha> thanks bigjools
[16:07] <Ursinha> henninge: I see yours is fix committed, good :)
[16:07] <henninge> yup
[16:08] <Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[16:08] <Ursinha> bug 504291 is fix committed, that's our most offender in last weeks
[16:08] <Ursinha> we had a bunch of those in staging a few days ago: https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1479S1000, I guess it's foundations to take a look?
[16:08] <Ursinha> salgado: ^
[16:08] <allenap> Ursinha: https://bugs.launchpad.net/bugs/508302
[16:08] <Ursinha> thanks allenap!
[16:09] <bigjools> OOPS-1480CMP1
[16:09] <salgado> Ursinha, well, the OOPSes happened before the fix reached staging, right?
[16:09] <Ursinha> salgado: which fix?
[16:10] <Ursinha> salgado: those are type errors, not the DisconnectionErrors
[16:10] <salgado> Ursinha, the fix for bug 504291, which landed two days ago
[16:10] <Ursinha> unless I've pasted the wrong oops
[16:10] <Ursinha> :)
[16:10] <Ursinha> salgado: yes, but I said it's fix committed, the oopses are other kind
[16:10] <salgado> oh, no, I thought the OOPS was of the same kind of the one you mentioned earlier
[16:11] <Ursinha> salgado: no, it's not
[16:11] <salgado> ok, I'll have a look at that OOPS
[16:11] <salgado> the TypeError one
[16:11] <Ursinha> thanks salgado
[16:11] <Ursinha> [action] salgado to take a look in the TypeError oopses (OOPS-1479S1000)
[16:12] <Ursinha> rockstar: what about the oops bigjools mentioned?
[16:12] <bigjools> I got it emailing a MP in
[16:13] <Ursinha> allenap: OOPS-1481A2038 is the second one in number of oopses in lpnet
[16:13]  * rockstar looks
[16:13]  * allenap looks
[16:13] <Ursinha> allenap: I see it's referencing bug 329917
[16:14] <allenap> Ursinha: Okay, it should reference bug 508302 instead.
[16:14] <Ursinha> allenap: great, I'll fix the reference
[16:14] <allenap> Ursinha: There are two NotImplementedError OOPSes, but I think they're unrelated bugs.
[16:14] <allenap> Ursinha: Thanks :)
[16:14] <Ursinha> allenap: are there any plans to fix that?
[16:15] <rockstar> bigjools, wtf?
[16:16] <allenap> Ursinha: Deryck says he'll look at it next week, or, failing that, we'll definitely do it next cycle.
[16:16] <bigjools> rockstar: that's what I said too
[16:16] <Ursinha> allenap: right, thanks, I'll make a note in the bug
[16:17] <Ursinha> bigjools, rockstar, is there a bug number for that?
[16:17] <allenap> Ursinha: That is, the +filebug OOPS, but I think the same will be true of bug 329917.
[16:17] <rockstar> Ursinha, I'm filing one now.
[16:17] <Ursinha> rockstar: thanks
[16:17] <bigjools> there's no bug
[16:17] <Ursinha> allenap: right, thanks :)
[16:17] <Ursinha> bigjools: there will be :)
[16:17] <Ursinha> rockstar: can you take a look in this problem?
[16:18] <rockstar> Ursinha, bigjools' problem?
[16:18] <bigjools> I have many problems :)
[16:18] <Ursinha> rockstar: that oops is not a problem but a feature? :{
[16:18] <Ursinha> :P
[16:19] <rockstar> Ursinha, I will look, but I'm willing to bet it'll be hard to reproduce.
[16:19] <rockstar> bigjools, does ungodly things to his bzr repos.
[16:19] <Ursinha> rockstar: that's ok, trying to reproduce is fine :)
[16:19] <bigjools> rockstar: I think it was when I did an MP for a branch with no changes
[16:19] <rockstar> bigjools, that makes this problem ever weirder.
[16:20] <Ursinha> bigjools, can you write that in the bug? as soon as rockstar files one, of course
[16:21] <rockstar> bigjools, I'll note it in the bug.
[16:21] <Ursinha> [action] rockstar to take a look in OOPS-1480CMP1
[16:21] <Ursinha> thanks bigjools
[16:21] <Ursinha> moving on
[16:21] <Ursinha> we have two critical bugs, one soyuz and on lpbuildbot, both in progress
[16:22] <Ursinha> so, we're fine
[16:22] <Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[16:22] <mbarnett> heya
[16:22] <Ursinha> hi mbarnett :)
[16:22] <mbarnett> LOSA launchpad activities and concerns this week include
[16:22] <mbarnett> * Testing is coming along the new method for switching to read-only mode.
[16:22] <mbarnett> * Getting ready for next week's rollout
[16:22] <mbarnett> * Bug filed regarding oident issues on the importd servers (up to almost 200 oident processes running on galapagos has been observed)
[16:22] <mbarnett> * Codebrowse continues to need frequent restarts
[16:22] <mbarnett> * checkwatches likely to be turned back on later today
[16:23] <mbarnett> i believe that is everything we wanted to raise in the meeting this week.
[16:23] <Ursinha> thanks mbarnett
[16:24] <Ursinha> does anyone have something to say to mbarnett?
[16:24] <mbarnett> the bug for oident things is also listed in the incident log
[16:24] <Ursinha> mbarnett: right
[16:25] <Ursinha> thanks
[16:25] <Ursinha> moving on then
[16:25] <Ursinha> [TOPIC] * DBA report (stub)
[16:25] <Ursinha> stub sent by email:
[16:25] <Ursinha> Nothing exciting this week.
[16:25] <Ursinha> Discussing requirements for minimal downtime PostgreSQL 8.4.2 upgrade. PG 8.4.2 packages but will need Slony-I 1.2.20 packages for both PG 8.3 and PG 8.4
[16:25] <Ursinha> +which might be problematic. The alternative is several hours of downtime.
[16:25] <Ursinha> Production systems running happily. Nothing else to report.
[16:25] <Ursinha> oot. :)
[16:26] <Ursinha> [TOPIC] * Proposed items
[16:26] <Ursinha> No proposed items, anyone else has something that want to discuss?
[16:26] <sinzui> Ursinha:
[16:26] <Ursinha> sinzui: me
[16:27] <sinzui> Ursinha: I think http://people.canonical.com/~lpqateam/test-plan-report-10.01.html is not updating
[16:27] <Ursinha> sinzui: let me see
[16:27] <Ursinha> sinzui: I'll check if the script is running fine, and will let you know after the meeting
[16:27] <Ursinha> sinzui: thanks for reporting
[16:27] <Ursinha> anyone else?
[16:28] <Ursinha> ok then
[16:28] <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
[16:28] <Ursinha> #endmeeting
[16:28] <Ursinha> thanks all
[16:28] <bigjools> thanks Ursinha
[16:28] <mbarnett> thanks.
[16:29] <allenap> Obrigado Ursinha.
[16:30] <Ursinha> oh :)
[16:30] <Ursinha> allenap: de nada :)