=== salgado-afk is now known as salgado
=== daniloff is now known as danilos
[17:02] <matsubara> #startmeeting
[17:02] <MootBot> Meeting started at 11:02. The chair is matsubara.
[17:02] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[17:02] <matsubara> sorry I'm late
[17:02] <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[17:02] <matsubara> [TOPIC] Roll Call
[17:02] <MootBot> New Topic:  Roll Call
[17:02] <matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[17:02] <sinzui> me
[17:02] <matsubara> Chex, rockstar, gary_poster, danilos, allenap: hi
[17:02] <Ursinha> moi
[17:03] <allenap> me
[17:03] <chex> me
[17:03] <gary_poster> me
=== chex is now known as Chex
[17:03] <matsubara> no one from soyuz?
[17:04]  * rockstar  
[17:04] <Ursinha> matsubara, julian is on leave
[17:04] <matsubara> ok. let's move one then
[17:04] <matsubara> [TOPIC] Agenda
[17:04] <MootBot> New Topic:  Agenda
[17:04] <matsubara>  * Actions from last meeting
[17:04] <matsubara>  * Oops report & Critical Bugs & Broken scripts
[17:04] <matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
[17:04] <matsubara>  * DBA report (stub)
[17:04] <matsubara>  * QA stats of the week
[17:04] <matsubara>  * Proposed items
[17:04] <matsubara>  * Ursinha to send email to TLs about QA summaries
[17:04] <matsubara>  * matsubara to triage open oops-tools bugs
[17:04] <matsubara>  * Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
[17:04] <matsubara>  * allenap to talk to chex after the meeting about the calculate_bug_heat failing script
[17:04] <matsubara>    * Suspect it was due to the roll-out; the script did actually run
[17:04] <matsubara>      but took a long time to get through the backlog. Will see if it
[17:04] <matsubara>      happens again. -- allenap
[17:04] <matsubara>  * Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
[17:04] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
[17:05] <matsubara>  * rockstar to find someone to look at bug 536486 and update it
[17:05] <ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
[17:05] <matsubara>  * Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
[17:05] <matsubara> oops
[17:05] <matsubara> [TOPIC] * Actions from last meeting
[17:05] <MootBot> New Topic:  * Actions from last meeting
[17:05] <matsubara> * Ursinha to send email to TLs about QA summaries
[17:05] <matsubara>  * matsubara to triage open oops-tools bugs
[17:05] <Ursinha> matsubara, I've commented on two of my items there
[17:05] <matsubara>  * Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
[17:05] <matsubara>  * allenap to talk to chex after the meeting about the calculate_bug_heat failing script
[17:05] <matsubara>    * Suspect it was due to the roll-out; the script did actually run
[17:05] <matsubara>      but took a long time to get through the backlog. Will see if it
[17:05] <matsubara>      happens again. -- allenap
[17:05] <matsubara>  * Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
[17:05] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
[17:05] <matsubara>  * rockstar to find someone to look at bug 536486 and update it
[17:05] <matsubara>  * Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
[17:05] <matsubara> sorry, forgot to reload the page
[17:05] <matsubara> I did triage all open oops-tools bugs
[17:05] <Ursinha> I've filed a bug, bug 558448
[17:05] <ubottu> Launchpad bug 558448 in launchpad-registry "Threshold for the product release finder monitoring script needs to be increased" [Low,Triaged] https://launchpad.net/bugs/558448
[17:06] <Ursinha> oops-prune haven't failed again. expire-ppa-files is failing because it was removed. Is that on purpose? spm sent one email to lp list asking that
[17:06] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
[17:06] <matsubara> [action]  * Ursinha to send email to TLs about QA summaries
[17:06] <MootBot> ACTION received:   * Ursinha to send email to TLs about QA summaries
[17:06] <matsubara> [action] * Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
[17:06] <MootBot> ACTION received:  * Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
[17:06] <matsubara> Ursinha, are those two correct to be re-added to the action items?
[17:07] <sinzui> Ursinha, I have looked into it. There is no clear fix yet. The two leading ways is to make the processes in nightly.sh run faster, or run them in parallel
[17:07] <Ursinha> matsubara, I'm writing the untriaged bugs email right now; you can keep them if you want, I'll manage to do it
[17:07] <matsubara> rockstar, how about yours? did you find someone to look at bug 536486
[17:07] <ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
[17:07] <matsubara> ?
[17:08] <rockstar> matsubara, yeash.  The bug reflects the actions being taken (very little currently)
[17:08] <rockstar> We're not focusing on ruby for bzr-git, we're focusing on the kernel import.
[17:09] <matsubara> rockstar, all right. thanks for chasing that
[17:10] <matsubara> ok, let's move on then
[17:10] <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[17:10] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[17:10] <matsubara> allenap, thank deryck for looking at https://bugs.edge.launchpad.net/malone/+bug/556515. please let him know this is one of the top oopses for this week
[17:10] <ubottu> Launchpad bug 556515 in malone "Changing the status of a task causes an error 500" [Undecided,Confirmed]
[17:11] <matsubara> gary_poster, I see that https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1557EA572 is still happening as of 2010-04-06
[17:11] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
[17:11] <allenap> matsubara: Will do.
[17:12] <matsubara> rockstar, have you seen https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1553EC1332 ? oops retrieving the feed for person branches. not sure if this is a bug for code or registry
[17:12] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1553EC1332
[17:12] <gary_poster> matsubara: ack.  I think I asked about that before but don't remember answer.  will investigate and reopen or open anew as appropriate
[17:13] <matsubara> thanks gary_poster
[17:13] <sinzui> matsubara, branches is the code team
[17:13] <rockstar> matsubara, it's a code issue
[17:13] <sinzui> matsubara, the registry only manages project announcements
[17:13] <matsubara> [action] gary_poster to investigate OOPS-1557EA572 and re-open or file a new bug for it
[17:13] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
[17:13] <MootBot> ACTION received:  gary_poster to investigate OOPS-1557EA572 and re-open or file a new bug for it
[17:13] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
[17:13] <matsubara> [action] matsubara to file a bug for OOPS-1553EC1332
[17:13] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1553EC1332
[17:13] <MootBot> ACTION received:  matsubara to file a bug for OOPS-1553EC1332
[17:14] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1553EC1332
[17:15] <matsubara> we have 3 critical bugs, 2 fix committed and one confirmed
[17:16] <matsubara> the one confirmed is for soyuz :-(
[17:16] <Ursinha> :/
[17:16]  * rockstar is glad it wasn't for code
[17:16] <matsubara> [action] matsubara to chase critical bug 556839 with noodles or someone from soyuz
[17:16] <MootBot> ACTION received:  matsubara to chase critical bug 556839 with noodles or someone from soyuz
[17:16] <ubottu> Error: Could not parse data returned by Launchpad: list index out of range (https://launchpad.net/bugs/556839)
[17:16] <ubottu> Error: Could not parse data returned by Launchpad: list index out of range (https://launchpad.net/bugs/556839)
[17:16] <Ursinha> oops
[17:17] <matsubara> we have a few scripts failing since last week
[17:17] <matsubara> retry-depwait is failing frequently
[17:17] <matsubara> Ursinha, do you know what's up with that one? ISTR you asked in the list or something about it
[17:18] <Ursinha> matsubara, there's an open bug for that, let me find it
[17:18] <matsubara> there's also expire-ppa-files script which seems to have been moved or removed
[17:18] <Ursinha> I asked about expire-ppa-files
[17:18] <matsubara> [action] matsubara chase someone from soyuz about expire-ppa-files failing script
[17:18] <MootBot> ACTION received:  matsubara chase someone from soyuz about expire-ppa-files failing script
[17:19] <matsubara> update-cache also failed due to a missing user
[17:19] <matsubara> fixed by spm already
[17:19] <matsubara> that's it. thanks everyone. let's move on
[17:19] <matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[17:19] <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
[17:19] <Ursinha> matsubara, bug 553068
[17:20] <ubottu> Launchpad bug 553068 in soyuz "buildd-retry-depwait.py crashing" [High,In progress] https://launchpad.net/bugs/553068
[17:20] <Chex> hello everyone
[17:20] <Chex> here is the LOSA report for this week:
[17:20] <matsubara> thanks Ursinha
[17:20] <Chex>         : 08-Apr: Librarian1 rapidly gobbling memory, restarted to free up.  Bug 556245.
[17:20] <Chex>         Any more info on this issue?
[17:20] <ubottu> Error: Could not parse data returned by Launchpad: list index out of range (https://launchpad.net/bugs/556245)
[17:20] <Chex>         : Issue with LP staging_restore: replication DB issue.
[17:20] <Chex>         fixed the problem yesterday, Staging restore are working now.
[17:20] <Chex>         : Buildbot issues: having problems pulling sourcecode earlier - issue still not
[17:20] <Chex>         resolved.  Does anyone have more information on this issue?
[17:21] <matsubara> gary_poster, ^
[17:21] <Ursinha> Chex, I see that edge updates aren't working yet
[17:22] <gary_poster> Chex, no more info on Librarian issue, but aware of it.
[17:24] <gary_poster> pulling sourcecode: that's a code issue IMO, but I don't think we've raised it because we don't know what to do about it.  The buildbot issue I was talking to you about was that jml wanted buildbot to no longer allow a failed update to proceed.  I'm fine with this, but his change didn't work, and I don't know why.
[17:25] <Chex> gary_poster: ok, thanks for librarian.  about buildbot issues, thats fine, anything we can do you help you debug why the change didnt work?
[17:25] <gary_poster> matsubara, rockstar: salgado reports about OOPS-1557EA572:
[17:25] <gary_poster> "gary_poster, the OOPS above is different from the one I'd seen when fixing the bug.  that's in the view that generates merge-proposal diffs.  that view should either use StreamOrRedirectLibraryFileAliasView (which knows what to do when the librarian is down) or do something similar to that"
[17:25] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
[17:25] <Chex> Ursinha: edge updates.. I will have to take a look at that.
[17:26] <matsubara> gary_poster, thanks!
[17:26] <gary_poster> sure
[17:26] <Ursinha> Chex, I see lp stable branch is currently on r10650, but edge is running other branch
[17:26] <matsubara> [action] matsubara to file a bug on launchpad-code about OOPS-1557EA572 including details from salgado ("the OOPS above is different from the one I'd seen when fixing the bug.  that's in the view that generates merge-proposal diffs.  that view should either use StreamOrRedirectLibraryFileAliasView (which knows what to do when the librarian is down) or do something similar to that")
[17:26] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
[17:26] <MootBot> ACTION received:  matsubara to file a bug on launchpad-code about OOPS-1557EA572 including details from salgado ("the OOPS above is different from the one I'd seen when fixing the bug.  that's in the view that generates merge-proposal diffs.  that view should either use StreamOrRedirectLibraryFileAliasView (which knows what to do when the librarian is down) or do something similar to that")
[17:26] <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1557EA572
=== salgado is now known as salgado-lunch
[17:30] <matsubara> ok, let's move on. thanks Chex and everyone
[17:30] <matsubara> [TOPIC] * DBA report (stub)
[17:30] <MootBot> New Topic:  * DBA report (stub)
[17:30] <matsubara> I'll ask stub to send the dba report if he hasn't yet
[17:31] <Ursinha> he has
[17:31] <matsubara> [TOPIC] * QA stats of the week
[17:31] <MootBot> New Topic:  * QA stats of the week
[17:31] <matsubara> great
[17:31] <matsubara> Soyuz (soyuz): 28
[17:31] <matsubara> launchpadlib  (launchpadlib): 25
[17:31] <matsubara> Launchpad Developer Utilities (lp-dev-utils): 9
[17:31] <matsubara> Launchpad Bazaar Integration (launchpad-code): 8
[17:31] <matsubara> Launchpad Auto Build System (launchpad-buildd): 8
[17:31] <matsubara> Launchpad Development Wiki Moin theme (launchpad-dev-moin-theme): 5
[17:31] <matsubara> Launchpad Foundations (launchpad-foundations): 3
[17:31] <matsubara> Launchpad Buildbot Configuration (lpbuildbot): 2
[17:31] <matsubara> trac-launchpad-migrator (trac-launchpad-migrator): 2
[17:31] <matsubara> launchpad-loggerhead (launchpad-loggerhead): 2
[17:31] <matsubara> Launchpad News WordPress Theme (launchpad-news-wordpress-theme): 2
[17:31] <matsubara> Launchpad QA Utilities (lp-qa-tools): 2
[17:31] <matsubara> Launchpad Help Wiki Moin theme (launchpad-help-moin-theme): 2
[17:31] <matsubara> Launchpad Bugs (malone): 2
[17:31] <matsubara> Launchpad CSCVS (launchpad-cscvs): 2
[17:31] <matsubara> Launchpad Registry (launchpad-registry): 1
[17:31] <matsubara> Launchpad Documentation (launchpad-documentation): 1
[17:31] <matsubara> Tickcount (tickcount): 1
[17:32] <matsubara> I guess I should've formatted this better
[17:32] <matsubara> anyway, soyuz and launchpadlib still high on the number of untriaged bugs
[17:33] <Ursinha> matsubara, I guess launchpadlib is somehow related to foundations people
[17:33] <matsubara> yes, it is. I'll talk to the team about it
[17:33] <Ursinha> I'm about to send one email to the list to discuss that
[17:33] <matsubara> [action] matsubara to talk to foundations about launchpadlib
[17:33] <MootBot> ACTION received:  matsubara to talk to foundations about launchpadlib
[17:33] <matsubara> [TOPIC] * Proposed items
[17:33] <MootBot> New Topic:  * Proposed items
[17:34] <matsubara> there's no new proposed items
[17:34] <matsubara> anything else before I close?
[17:35] <Ursinha> just a reminder
[17:35] <Ursinha> don't forget to check outstanding 10.03 bugs, so we can close the cycle
[17:35] <Ursinha> that's all :)
[17:35] <matsubara> ok. thanks Ursinha
[17:35] <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda  for the logs.
[17:35] <matsubara> #endmeeting
[17:35] <MootBot> Meeting finished at 11:35.
=== salgado-lunch is now known as salgado
=== Ursinha is now known as Ursinha-brb
=== Ursinha-brb is now known as Ursinha
=== Ursinha is now known as Ursinha-lunch
=== salgado is now known as salgado-afk