=== Ursinha_ is now known as Ursinha-afk
=== noodles785 is now known as noodles775
=== mrevell is now known as mrevell-lunch
=== Ursinha-afk is now known as Ursinha
=== mrevell-lunch is now known as mrevell
=== gary_poster is now known as gary-lunch
=== Ursinha is now known as isitoutyet
=== isitoutyet is now known as Ursinha
[17:00] <Ursinha> #startmeeting
[17:00] <danilos> koo
[17:00] <Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[17:00] <MootBot> Meeting started at 11:00. The chair is Ursinha.
[17:00] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[17:00] <Ursinha> [TOPIC] Roll Call
[17:00] <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[17:00] <MootBot> New Topic:  Roll Call
[17:00]  * rockstar  
[17:00] <Ursinha> me me
[17:00] <EdwinGrubbs> me
=== salgado is now known as salgado-lunch
[17:01] <matsubara> me
[17:01] <Ursinha> matsubara, Chex, bigjools, hello
[17:01] <Ursinha> :)
[17:01] <danilos> me
[17:01] <allenap> me
[17:01]  * Ursinha throws a shoe on bigjools 
[17:02]  * bigjools dodges the shoe and returns fire with a custard pie
[17:02] <Chex> me
[17:02] <Ursinha> so we're all here hehe
[17:02] <Ursinha> [TOPIC] Agenda
[17:02] <Ursinha>  * Actions from last meeting
[17:02] <Ursinha>  * Oops report & Critical Bugs & Broken scripts
[17:02] <Ursinha>  * Operations report (mthaddon/Chex/spm/mbarnett)
[17:02] <Ursinha>  * DBA report (stub)
[17:02] <MootBot> New Topic:  Agenda
[17:02] <Ursinha>  * QA stats of the week
[17:02] <Ursinha>  * Proposed items
[17:02] <Ursinha> [TOPIC] * Actions from last meeting
[17:02] <MootBot> New Topic:  * Actions from last meeting
[17:02] <Ursinha> * allenap to follow up with deryck about bug 230106
[17:02] <Ursinha> * gary_poster to triage bug 568456
[17:02] <Ursinha> * Chex to work with gary_poster or salgado to sort out how to use the meliae hooks to debug librarian and LP memory leaks
[17:02] <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
[17:02] <ubottu> Launchpad bug 568456 in launchpad-foundations "GpgmeError raised importing public gpg key" [Low,Triaged] https://launchpad.net/bugs/568456
[17:02] <Ursinha> * matsubara to ask stub for the DBA report
[17:02] <Ursinha>     * Done.
[17:02] <Ursinha> * matsubara to update qa stats in the MeetingAgenda page
[17:02] <Ursinha>     * Done.
[17:03] <Ursinha> bug 568456 is triaged, so done
[17:03] <Ursinha> I'll be talking about bug 230106 in the oops section
[17:03] <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
[17:03] <Ursinha> so, moving on
[17:04] <Ursinha> ah, not that fast, Chex, was your item sorted out?
[17:04] <Ursinha> Chex, hello :)
[17:04] <Chex> Ursinha: yes It was.. I will be notifying the losa's about the
[17:04] <Chex> proper procedure for crash-dump generation on the lp servers today
[17:05] <Ursinha> thanks Chex!
[17:05] <Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[17:05] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[17:05] <Chex> I touched base with salgado today
[17:05] <Ursinha> the most offenders are old ones
[17:05] <Ursinha> still a lot of oopses daily due to bug 553361
[17:05] <Ursinha> matsubara, do you know if that is going to be fixed in time for the rollout?
[17:05] <ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
[17:05] <Ursinha> this is really annoying and it's "tainting" oops summaries :/
[17:05] <matsubara> Ursinha, it will not
[17:05] <Ursinha> matsubara, :(
[17:06] <Ursinha> matsubara, do you know if that can be fixed for a CP later then?
[17:07] <matsubara> Ursinha, always
[17:07] <Ursinha> matsubara, not much later :)
[17:07] <matsubara> I'll bring it up to gary on today's call
[17:07] <Ursinha> thanks a lot matsubara
[17:07] <Ursinha> [action] matsubara to talk with gary_poster about  a CP for bug 553361
[17:07] <MootBot> ACTION received:  matsubara to talk with gary_poster about  a CP for bug 553361
[17:07] <ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
[17:07] <Ursinha> also, we're having about 270 oopses of the "None: None" kind (OOPS-1579CEMAIL1) on a daily basis
[17:07] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
[17:08] <Ursinha> we cannot say what's the problem because the oops report is almost empty, and we'd need to fix bug 230106 to have more info
[17:08] <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
[17:08] <Ursinha> deryck said it won't be fixed soon, but I guess that given the number of oopses maybe we should try something to diagnose that problem
[17:08] <Ursinha> allenap, any suggestions?
[17:08] <allenap> Ursinha: I'll bump the bug up to High and explain why. It is scheduled to happen soon, this will make it happen sooner.
[17:08] <Ursinha> or anyone else
[17:09] <Ursinha> thanks a lot allenap
[17:09] <matsubara> Ursinha, of course we know what's the problem
[17:09] <matsubara> it's bug 54005, isn't it?
[17:09] <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
[17:09] <Ursinha> matsubara, no, we're not sure because the bug is too old
[17:09] <matsubara> the fact they show up a None None is 230106
[17:10] <Ursinha> yes, that's what I said :) we need to fix 230106 in order to find out if the 270 oopses are really 54005
[17:10] <Ursinha> [action] allenap to bump bug 230106 to High and explain why
[17:10] <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
[17:10] <MootBot> ACTION received:  allenap to bump bug 230106 to High and explain why
[17:11] <matsubara> Ursinha, we don't need bug 230106 fixed to fix bug 54005
[17:11] <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
[17:12] <Ursinha> matsubara, read what I said again :)
[17:12] <matsubara> it's either 54005 is invalid because it's too old or we re-purpose it to fix OOPS-1579CEMAIL1
[17:12] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
[17:12] <Ursinha> we're having a higher number of timeouts as well, about 800, and that doesn't seem to be specific to a part of launchpad
[17:12] <matsubara> I'm disagreeing that 230106 needs to fixed first
[17:13] <Ursinha> matsubara, I didn't say that we need to fix one to fix the other, I said we need to fix one to be able to see if the oopses are really the other
[17:13] <Ursinha> does anyone have a clue about the higher number of timeouts?
[17:14] <matsubara> and that's what I'm disagreeing about
[17:14] <Ursinha> matsubara, are you sure that oops is 54005?
[17:15] <Ursinha> not all oopses None None are bugs email
[17:15] <matsubara> pretty sure, but as I said, one doesn't need to be sure to fix OOPS-1579CEMAIL1
[17:15] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
[17:15] <matsubara> yes, some are from the spec tracker
[17:15] <matsubara> which is also mentioned in the bug report
[17:16] <Ursinha> matsubara, we discussed that two meetings ago, I guess, that's where this conclusion came from
[17:17] <Ursinha> matsubara, but of course, you can discuss that bug with gary as well, that would be much appreciated :)
[17:18] <matsubara> ok
[17:18] <Ursinha> [action] matsubara to discuss bug 54005 with gary_poster
[17:18] <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
[17:18] <MootBot> ACTION received:  matsubara to discuss bug 54005 with gary_poster
[17:18] <Ursinha> bigjools, distributionmirror-prober script has failed twice today, is that under soyuz?
[17:19] <bigjools> Ursinha: registry
[17:19] <Ursinha> bigjools, thanks
[17:19] <Ursinha> EdwinGrubbs, do you know what's going on with distributionmirror-prober script, that failed twice today?
[17:20] <EdwinGrubbs> Ursinha: no, I don't know anything about it. can you point me at the error messages? I'll look into it.
[17:20] <Ursinha> EdwinGrubbs, sure, I'll do that as soon as the meeting finishes, thanks!
[17:21] <Ursinha> we have no critical bugs! yay!
[17:21] <Ursinha> I'm moving on
[17:21] <Ursinha> thanks guys
[17:21] <Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[17:21] <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
[17:21]  * Ursinha hands Chex the mic
[17:23] <Ursinha> Chex, stage is empty, c'mon
[17:23] <Chex> hello everyone
[17:24] <danilos> hello Chex
[17:24] <Chex> it was a quiet week LP-wise as us LOSA's were in release prep all week.
[17:24] <Chex> I just have these incidents to report:
[17:24] <Chex>  - LP incidents of note: : 22-Apr: CP 9194 to librarian : 25-Apr: each app server on wampee using > 1.1G RSS - restarted
[17:25] <Chex> Does Anyone have any questions or comments for us?
[17:25] <Ursinha> anyone?
[17:26] <Ursinha> thanks Chex
[17:26] <Ursinha> [TOPIC] * DBA report (stub)
[17:26] <MootBot> New Topic:  * DBA report (stub)
[17:26] <Ursinha> I sent one email to stub asking for the report
[17:26] <Ursinha> next :)
[17:26] <Ursinha> [TOPIC] * QA stats of the week
[17:26] <MootBot> New Topic:  * QA stats of the week
[17:26] <Ursinha> launchpadlib: 10
[17:26] <Ursinha> launchpad-buildd: 10
[17:26] <Ursinha> lp-dev-utils: 9
[17:26] <Ursinha> launchpad-dev-moin-theme: 6
[17:26] <Ursinha> launchpad-code: 5
[17:26] <Ursinha> soyuz: 4
[17:26] <Ursinha> malone: 4
[17:26] <Ursinha> launchpad-registry: 3
[17:26] <Ursinha> lp-qa-tools: 3
[17:27] <Ursinha> lpbuildbot: 2
[17:27] <Ursinha> trac-launchpad-migrator: 2
[17:27] <Ursinha> launchpad-news-wordpress-theme: 2
[17:27] <Ursinha> launchpad-help-moin-theme: 2
[17:27] <Ursinha> launchpad-cscvs: 2
[17:27] <Ursinha> launchpad-loggerhead: 1
[17:27] <Ursinha> launchpad-documentation: 1
[17:27] <Ursinha> tickcount: 1
[17:27] <Ursinha> so I guess we're doing pretty well triaging, those numbers look better every week
[17:27] <Ursinha> I'll triage the lp-qa-tools ones
[17:27] <bigjools> what are those numbers?
[17:28] <Ursinha> bigjools, untriaged bugs for each of those projects
[17:29] <Ursinha> bigjools, soyuz has 4 :)
[17:29] <Ursinha> [action] Ursinha to triage lp-qa-tools bugs
[17:29] <MootBot> ACTION received:  Ursinha to triage lp-qa-tools bugs
[17:29] <bigjools> QA stats evokes something else for me
[17:30] <Ursinha> bigjools, I agree with you :) why took you so long to say that? :)
[17:30] <bigjools> I was trying to say it in a way that wouldn't offend :)
[17:30] <bigjools> not sure I didn't fail
[17:31] <Ursinha> Untested items per team:
[17:31] <Ursinha> Code: 4
[17:31] <Ursinha> Foundations: 4
[17:31] <Ursinha> Registry: 2
[17:31] <Ursinha> Bugs: 6
[17:31] <Ursinha> Translations: 3
[17:31] <Ursinha> Soyuz: 7
[17:31] <bigjools>  /o\
[17:31] <Ursinha> Strategy: 1
[17:32] <Ursinha> bigjools, no, that's ok :) I'm asking because I guess we're having this section of the meeting for over a month now
[17:32] <Ursinha> bigjools, not sure that helped you :P
[17:32] <bigjools> :)
[17:33] <Ursinha> I'll try to come up with a better way to use that info here
[17:33] <Ursinha> but I can say that all teams are pretty good comparing to past cycles :)
[17:33] <Ursinha> I'm moving on then
[17:33] <Ursinha> bigjools, thanks :)
[17:33] <Ursinha> [TOPIC] * Proposed items
[17:33] <MootBot> New Topic:  * Proposed items
[17:33] <Ursinha> None
[17:34] <Ursinha> anyone wants to say something before this meeting closes?
[17:34] <Ursinha> ok then :)
[17:34] <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
[17:35] <Ursinha> #endmeeting
[17:35] <MootBot> Meeting finished at 11:35.
[17:35] <Ursinha> thanks all, and happy Ubuntu release everyone!
=== Ursinha is now known as IsItOutYet
=== gary-lunch is now known as gary_poster
=== IsItOutYet is now known as itsNOTout
=== salgado-lunch is now known as salgado
=== itsNOTout is now known as LucidIsOut
=== LucidIsOut is now known as Ursinha
=== gary_poster_ is now known as gary_poster
=== matsubara is now known as matsubara-afk
=== salgado is now known as salgado-afk
=== Ursinha is now known as Ursinha-afk