[16:00] <matsubara> #startmeeting
[16:00] <MootBot> Meeting started at 10:00. The chair is matsubara.
[16:00] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[16:00] <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[16:00] <matsubara> [TOPIC] Roll Call
[16:00] <MootBot> New Topic:  Roll Call
[16:00] <sinzui> me
[16:00] <henninge> me
[16:00] <intellectronica> me
[16:01] <matsubara> herb, rockstar, hi
[16:01] <matsubara> bigjools, hi
[16:01] <rockstar> Ni!
[16:01] <bigjools> me
[16:02] <herb> me
[16:02] <flacoste> me
[16:02] <sinzui> ecky-ecky-ecky-ptang-zoop-boing-bigwam-ohhh
[16:02] <matsubara> lol
[16:02] <matsubara> ok, stub can join in later
[16:02] <matsubara> [TOPIC] Agenda
[16:02] <MootBot> New Topic:  Agenda
[16:03] <matsubara>  * Actions from last meeting
[16:03] <matsubara>  * Oops report & Critical Bugs & Broken scripts
[16:03] <matsubara>  * Operations report (mthaddon/herb/spm)
[16:03] <matsubara>  * DBA report (stub)
[16:03] <matsubara> [TOPIC] * Actions from last meeting
[16:03] <MootBot> New Topic:  * Actions from last meeting
[16:03] <matsubara>  * flacoste to take a look and triage bug 397224 and will move bug 373837 to 2.2.7 and see if it's possible to fix
[16:03] <matsubara>  * Ursinha to file a bug about OOPS-1285J112 and tell flacoste
[16:03] <matsubara>    * filed bug 397485
[16:03] <matsubara>  * Ursinha to watch the lang-pack-exporter script and poke henninge if it fails again
[16:03] <matsubara>    * It failed, but danilo noticed that the warning was sent because actually the script wasn't scheduled to run, as per his email to lp list.
[16:03] <matsubara>  * Ursinha to check if all accounts requesting fix on feedback@ were fixed
[16:03] <flacoste> so i looked at both
[16:03] <matsubara> thanks flacoste
[16:03] <stub> me
[16:03] <matsubara> [action] * Ursinha to check if all accounts requesting fix on feedback@ were fixed
[16:03] <MootBot> ACTION received:  * Ursinha to check if all accounts requesting fix on feedback@ were fixed
[16:03] <flacoste> and we won't be able to fix any of them this cycle
[16:04] <matsubara> flacoste, can you set status/importance 397224
[16:04] <matsubara> ?
[16:04] <flacoste> ok
[16:04] <matsubara> thanks
[16:05] <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[16:05] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[16:05] <matsubara> two bugs for soyuz and two for code
[16:06] <matsubara> rockstar, can you schedule a fix for bug 400020?
[16:06] <matsubara> rockstar, will OOPS-1291EC577 be fixed by the fix for 371469 or should I report another bug?
[16:06] <rockstar> matsubara, thumper acked it last night, I'll chase.
[16:06] <matsubara> bigjools, bug 400269 and bug 393625
[16:06] <matsubara> thanks rockstar
[16:07] <matsubara> bigjools, isn't 393625 gonna bite us in production?
[16:07] <bigjools> no
[16:07] <herb> why not?
[16:08] <bigjools> we'll fix the OOPS but very few people have permission to do that operation
[16:08] <matsubara> bigjools, I just filed 400269, can you triage it accordingly? It doesn't look like very important though, since you can only get to that URL manually or following a link
[16:08] <bigjools> should get it done for 2.2.7
[16:08] <bigjools> right, the URL has to be hand-hacked
[16:08] <bigjools> we don't link to it from anywhere
[16:09] <bigjools> the other bug is waiting on a response to stub's question
[16:09] <matsubara> bigjools, yes, the OOPS I added to the report has the referrer from a mailing list. someone posted that
[16:09] <bigjools> (we'll fix that oops by redirecting away from the page so you can never get to it)
[16:10] <matsubara> bigjools, shouldn't it raise an Forbidden error or something like that?
[16:10] <bigjools> herb, could you check the memory usage for update-pkgcache in production and respond to the bug please
[16:11] <bigjools> matsubara: no, the page simply should not exist for anyone
[16:11] <herb> bigjools: will do.
[16:11] <bigjools> thanks herb
[16:11] <matsubara> bigjools, ok
[16:12] <matsubara> thanks bigjools
[16:12] <bigjools> matsubara: it's trying to render a PPA page using the contents of the main archive
[16:12] <bigjools> np
[16:12] <matsubara> we have 3 critical bugs, all fix committed
[16:13] <matsubara> and we have 3 failing scripts: updatebranches, language-pack-exporter and productreleasefinder
[16:13] <matsubara> language-pack-exporter was already sorted by danilos
[16:14] <matsubara> I think sinzui fixed the productreleasefinder one already, just need to be released
[16:14] <sinzui> matsubara: productreleasefinder is failed to run, not failed during execution I think
[16:14] <matsubara> rockstar, can you check why updatebranches failed?
[16:14] <sinzui> I am testing a a super fix today that will address most of the errors reported in the prf log
[16:15] <matsubara> great, thanks sinzui
[16:16] <matsubara> rockstar, ?
[16:17] <matsubara> [action] matsubara to chase rockstart about failure on updatebranches script
[16:17] <MootBot> ACTION received:  matsubara to chase rockstart about failure on updatebranches script
[16:17] <matsubara> let's move on
[16:17] <matsubara> [TOPIC] * Operations report (mthaddon/herb/spm)
[16:17] <MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
[16:17] <herb> 2009-07-10 - Rolled out a bug fix to production and edge.
[16:17] <herb> There aren't any cherry picks or queries awaiting approval.
[16:17] <herb> Any update on bug #287304? That now accounts for the majority of the incidents we encounter.
[16:18] <rockstar> matsubara, was chasing...
[16:18] <stub> Nobody has looked into that yet - it isn't assigned or scheduled.
[16:18] <rockstar> matsubara, I know there had been problems with it.
[16:19] <matsubara> rockstar, all right, let me know what you find out after the meeting and I'll file a bug and get that scheduled
[16:19] <herb> stub: it would make 3 LOSAs very happy if it were at least assigned. :)
[16:19] <matsubara> rockstar, thanks
[16:19] <stub> flacoste: One for me?
[16:19] <herb> anyway. that's it from us. otherwise it's been a quiet week.
[16:19] <flacoste> stub: yes, it could well be, but after the load testing tool is ready
[16:20] <flacoste> herb: like i said in an email, in August, i want us to focus on that bug and the other ones affecting our deployment
[16:20] <herb> flacoste: excellent
[16:21] <matsubara> thanks stub, herb, flacoste
[16:21] <matsubara> moving on
[16:21] <matsubara> [TOPIC] * DBA report (stub)
[16:21] <MootBot> New Topic:  * DBA report (stub)
[16:21] <stub> Person trimming is so slow it is impractical to QA it on staging, so we will just run on production. Foreign key constraints will protect us from removing anything actually linked so we shouldn't be able to cause any damage.
[16:21] <stub> Nothing else to report.
[16:21] <stub> (that I can think of)
[16:22] <matsubara> ok, thanks stub
[16:23] <matsubara> I think that's all for today.
[16:23] <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs.
[16:23] <matsubara> #endmeeting
[16:23] <MootBot> Meeting finished at 10:23.
[16:23] <intellectronica> thanks matsubara
[16:23] <herb> thanks everyone
[16:24] <flacoste> thanks