=== salgado-afk is now known as salgado === danilo__ is now known as danilos [16:00] #startmeeting [16:00] Meeting started at 10:00. The chair is matsubara. [16:00] Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] [16:00] Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. [16:00] [TOPIC] Roll Call [16:00] New Topic: Roll Call [16:00] me [16:00] me [16:00] me [16:01] herb, rockstar, hi [16:01] bigjools, hi [16:01] Ni! [16:01] me [16:02] me [16:02] me [16:02] ecky-ecky-ecky-ptang-zoop-boing-bigwam-ohhh [16:02] lol [16:02] ok, stub can join in later [16:02] [TOPIC] Agenda [16:02] New Topic: Agenda [16:03] * Actions from last meeting [16:03] * Oops report & Critical Bugs & Broken scripts [16:03] * Operations report (mthaddon/herb/spm) [16:03] * DBA report (stub) [16:03] [TOPIC] * Actions from last meeting [16:03] New Topic: * Actions from last meeting [16:03] * flacoste to take a look and triage bug 397224 and will move bug 373837 to 2.2.7 and see if it's possible to fix [16:03] * Ursinha to file a bug about OOPS-1285J112 and tell flacoste [16:03] * filed bug 397485 [16:03] * Ursinha to watch the lang-pack-exporter script and poke henninge if it fails again [16:03] * It failed, but danilo noticed that the warning was sent because actually the script wasn't scheduled to run, as per his email to lp list. [16:03] Launchpad bug 397224 in launchpad-foundations "TraversalError in person page accessing openid_identity_url" [Undecided,New] https://launchpad.net/bugs/397224 [16:03] * Ursinha to check if all accounts requesting fix on feedback@ were fixed [16:03] Launchpad bug 373837 in launchpad-foundations "DisconnectionError should log a soft OOPS" [High,Triaged] https://launchpad.net/bugs/373837 [16:03] https://lp-oops.canonical.com/oops.py/?oopsid=1285J112 [16:03] Launchpad bug 397485 in launchpad-foundations "DisconnectionError in +login-register" [Low,Triaged] https://launchpad.net/bugs/397485 [16:03] so i looked at both [16:03] thanks flacoste [16:03] me [16:03] [action] * Ursinha to check if all accounts requesting fix on feedback@ were fixed [16:03] ACTION received: * Ursinha to check if all accounts requesting fix on feedback@ were fixed [16:03] and we won't be able to fix any of them this cycle [16:04] flacoste, can you set status/importance 397224 [16:04] ? [16:04] ok [16:04] thanks [16:05] [TOPIC] * Oops report & Critical Bugs & Broken scripts [16:05] New Topic: * Oops report & Critical Bugs & Broken scripts [16:05] two bugs for soyuz and two for code [16:06] rockstar, can you schedule a fix for bug 400020? [16:06] Launchpad bug 400020 in launchpad-code "TraversalError: (None, 'bzr_identity') in Product:revisions.atom" [High,Triaged] https://launchpad.net/bugs/400020 [16:06] rockstar, will OOPS-1291EC577 be fixed by the fix for 371469 or should I report another bug? [16:06] https://lp-oops.canonical.com/oops.py/?oopsid=1291EC577 [16:06] matsubara, thumper acked it last night, I'll chase. [16:06] bigjools, bug 400269 and bug 393625 [16:06] thanks rockstar [16:06] Launchpad bug 400269 in soyuz "OOPS accessing +copy-packages if you don't have permissions" [Undecided,New] https://launchpad.net/bugs/400269 [16:06] Launchpad bug 393625 in soyuz "update-pkgcache using too much memory on staging" [High,Incomplete] https://launchpad.net/bugs/393625 [16:07] bigjools, isn't 393625 gonna bite us in production? [16:07] no [16:07] why not? [16:08] we'll fix the OOPS but very few people have permission to do that operation [16:08] bigjools, I just filed 400269, can you triage it accordingly? It doesn't look like very important though, since you can only get to that URL manually or following a link [16:08] should get it done for 2.2.7 [16:08] right, the URL has to be hand-hacked [16:08] we don't link to it from anywhere [16:09] the other bug is waiting on a response to stub's question [16:09] bigjools, yes, the OOPS I added to the report has the referrer from a mailing list. someone posted that [16:09] (we'll fix that oops by redirecting away from the page so you can never get to it) [16:10] bigjools, shouldn't it raise an Forbidden error or something like that? [16:10] herb, could you check the memory usage for update-pkgcache in production and respond to the bug please [16:11] matsubara: no, the page simply should not exist for anyone [16:11] bigjools: will do. [16:11] thanks herb [16:11] bigjools, ok [16:12] thanks bigjools [16:12] matsubara: it's trying to render a PPA page using the contents of the main archive [16:12] np [16:12] we have 3 critical bugs, all fix committed [16:13] and we have 3 failing scripts: updatebranches, language-pack-exporter and productreleasefinder [16:13] language-pack-exporter was already sorted by danilos [16:14] I think sinzui fixed the productreleasefinder one already, just need to be released [16:14] matsubara: productreleasefinder is failed to run, not failed during execution I think [16:14] rockstar, can you check why updatebranches failed? [16:14] I am testing a a super fix today that will address most of the errors reported in the prf log [16:15] great, thanks sinzui [16:16] rockstar, ? [16:17] [action] matsubara to chase rockstart about failure on updatebranches script [16:17] ACTION received: matsubara to chase rockstart about failure on updatebranches script [16:17] let's move on [16:17] [TOPIC] * Operations report (mthaddon/herb/spm) [16:17] New Topic: * Operations report (mthaddon/herb/spm) [16:17] 2009-07-10 - Rolled out a bug fix to production and edge. [16:17] There aren't any cherry picks or queries awaiting approval. [16:17] Any update on bug #287304? That now accounts for the majority of the incidents we encounter. [16:17] Launchpad bug 287304 in launchpad-foundations "App Servers: Remove need for restart on logrotation" [High,Triaged] https://launchpad.net/bugs/287304 [16:18] matsubara, was chasing... [16:18] Nobody has looked into that yet - it isn't assigned or scheduled. [16:18] matsubara, I know there had been problems with it. [16:19] rockstar, all right, let me know what you find out after the meeting and I'll file a bug and get that scheduled [16:19] stub: it would make 3 LOSAs very happy if it were at least assigned. :) [16:19] rockstar, thanks [16:19] flacoste: One for me? [16:19] anyway. that's it from us. otherwise it's been a quiet week. [16:19] stub: yes, it could well be, but after the load testing tool is ready [16:20] herb: like i said in an email, in August, i want us to focus on that bug and the other ones affecting our deployment [16:20] flacoste: excellent [16:21] thanks stub, herb, flacoste [16:21] moving on [16:21] [TOPIC] * DBA report (stub) [16:21] New Topic: * DBA report (stub) [16:21] Person trimming is so slow it is impractical to QA it on staging, so we will just run on production. Foreign key constraints will protect us from removing anything actually linked so we shouldn't be able to cause any damage. [16:21] Nothing else to report. [16:21] (that I can think of) [16:22] ok, thanks stub [16:23] I think that's all for today. [16:23] Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. [16:23] #endmeeting [16:23] Meeting finished at 10:23. [16:23] thanks matsubara [16:23] thanks everyone [16:24] thanks === salgado is now known as salgado-lunch === salgado-lunch is now known as salgado === noodles775 is now known as noodles775-afk === matsubara is now known as matsubara-lunch === matsubara-lunch is now known as matsubara === Edwin is now known as Guest2986