[16:01] <Ursinha> #startmeeting
[16:01] <MootBot> Meeting started at 10:01. The chair is Ursinha.
[16:01] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[16:01] <Ursinha> Happy new year!
[16:01] <noodles775> me
[16:01] <Ursinha> Welcome to this week's Launchpad Production Meeting.  For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[16:01] <Ursinha> [TOPIC] Roll Call
[16:01] <MootBot> New Topic:  Roll Call
[16:01] <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[16:01] <allenap> me
[16:01] <sinzui> me
[16:01] <Ursinha> hehe :)
[16:01] <Ursinha> me
[16:02] <Ursinha> stub isn't here, that's kinda fine
[16:02] <Ursinha> rockstar, hi
[16:02] <rockstar> ni!
[16:02] <Ursinha> :)
[16:02] <salgado> me
[16:02] <Ursinha> Chex, hello
[16:02] <jtv> I'm keeping one eye on the meeting, but not really here :P
[16:03] <Ursinha> jtv, thanks :)
[16:03] <Ursinha> let
[16:03] <Ursinha> let's go then
[16:03] <Ursinha> [TOPIC] Agenda
[16:03] <MootBot> New Topic:  Agenda
[16:03] <Ursinha>  * Actions from last meeting
[16:03] <Ursinha>  * Oops report & Critical Bugs & Broken scripts
[16:03] <Ursinha>  * Operations report (mthaddon/Chex/spm/mbarnett)
[16:03] <Ursinha>  * DBA report (stub)
[16:03] <Ursinha>  * Proposed items
[16:03] <Ursinha> [TOPIC] * Actions from last meeting
[16:03] <MootBot> New Topic:  * Actions from last meeting
[16:03] <Ursinha>  * Chex to file a bug about the multiple git import failures on the importd
[16:03] <Ursinha>  * Ursinha to try to come up with an older working version of oops-tools (non oops-db version)
[16:03] <Ursinha>    * Done, it's running on devpad and generating the partial summaries since before holidays. Used to generate the daily summaries as well when the db version fails for any reason.
[16:03] <Ursinha>  * Ursinha to send one email to stub about the db report
[16:03] <Ursinha>    * Sent. stub sent the report.
[16:04] <Chex> here.. sorry
[16:04] <Ursinha> Chex, hey :)
[16:04] <Ursinha> Chex, so, did you file that bug?
[16:04] <Chex> Ursinha: yes I did, let me get the bug number for you
[16:05] <Ursinha> thanks Chex
[16:05] <Ursinha> I'll keep the ball rolling while Chex finds the bug number :)
[16:05] <Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[16:06] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[16:06] <Ursinha> the failing scripts are being handled already, right jtv? :)
[16:06] <jtv> Ursinha: yes, I got distracted for a while by something about the database, but back on it now
[16:06] <Ursinha> jtv, haha thanks :)
[16:06] <Ursinha> and, we had a bunch of DisconnectionErrors on 4th, on staging, and are having them now on lpnet and edge
[16:06] <Ursinha> I've filed a bug for them, bug 504291, jtv kindly did his analysis
[16:06] <Ursinha> salgado, could you take this to foundations, please?
[16:07] <salgado> again!?
[16:07] <salgado> yeah, I'll have a look at it
[16:07] <Ursinha> salgado, unfortunately :(
[16:07] <Ursinha> another issue that needs to be investigated by foundations is why is staging not being updated
[16:07] <Ursinha> mthaddon filed a bug with the error
[16:08] <Ursinha> bug 504300
[16:08] <salgado> Ursinha, do you have the number?
[16:08] <Ursinha> salgado, sorry, was searching the tab
[16:08] <Chex> Ursinha: I filed a bug, and was immediately redirected to this as a duplicate bug: bug #486076.
[16:08] <Ursinha> right Chex, thanks
[16:09] <Ursinha> I'll take a look
[16:09] <Chex> Ursinha: which, when I look at it, I am not sure directly addresses our issue, but its a start, I think.
[16:09] <Ursinha> [action] salgado to take bugs 504300 and 504291 to foundations discussion
[16:09] <MootBot> ACTION received:  salgado to take bugs 504300 and 504291 to foundations discussion
[16:10] <Ursinha> salgado, is that ok for you?
[16:10] <salgado> yep
[16:10] <Ursinha> right, thanks
[16:11] <Ursinha> Chex, right, do you think it's not a duplicate? maybe a code guy could enlighten us
[16:11] <Ursinha> rockstar, ^
[16:11] <Chex> Ursinha: I was under the impression that if the code tree was very large and big, it overwhelmed the import process, with memory usage.. that doesn't seem like a memory leak to me, but I could be mistaken about that.
[16:12] <Ursinha> rockstar doesn't love us anymore
[16:13] <rockstar> Chex, we can probably sleuth whether or not it's a duplicate.  I'd suggest filing the bug.
[16:13] <Chex> Ursinha: here is the orginal bug I filed: Bug #497945 : Large git imports into bzr tree uses lots of memory
[16:13] <Ursinha> rockstar, ^
[16:14] <Chex> Ursinha: I can discuss this offline with you and/or rockstar later, not to hold up the meeting
[16:14]  * rockstar agrees
[16:14] <Ursinha> Chex, thanks :)
[16:14] <Ursinha> rockstar, thanks :)
[16:14] <Ursinha> moving on then
[16:14] <rockstar> These kinds of bugs are harder to track down, but we know they exist.
[16:15] <Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[16:15] <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
[16:15] <Chex> here is our report for this week, folks:
[16:15] <Chex> - LP edge updates broke today (CSS broken) because make build was relying
[16:15] <Chex>     on python2.4, salgado is helping to fix this issue now.
[16:15] <Chex> - LP staging updates are broken at the moment, Bug 504300 has been filed
[16:15] <Chex>     addressing this issue.
[16:16] <Chex> - LP seeing intermittent 500s on shipit servers, we are
[16:16] <Chex>      investigating that more to see exactly what is causing those.
[16:16] <Chex> - LP incidents of note:
[16:16] <Chex>         ; LP Cherry-picks: revno 8809 rolled out to lpnet 30-Dec,
[16:16] <Chex>             revno 8810 rollout to lpnet 07-Jan;
[16:16] <Chex>         ; Crowberry upgraded from 8Gb to 32GB RAM 23-Dec
[16:16] <Chex> and thats our report for this week, any questions/comments?
[16:16] <Ursinha> not here
[16:16] <Ursinha> anyone?
[16:16] <Ursinha> [action] Chex to discuss with rockstar about bug 497945
[16:16] <MootBot> ACTION received:  Chex to discuss with rockstar about bug 497945
[16:17] <Ursinha> all right
[16:17] <Ursinha> thanks Chex!
[16:17] <Ursinha> [TOPIC] * DBA report (stub)
[16:17] <MootBot> New Topic:  * DBA report (stub)
[16:17] <Ursinha> sent by email to the list
[16:17] <Ursinha> [TOPIC] * Proposed items
[16:17] <MootBot> New Topic:  * Proposed items
[16:17] <Ursinha> anyone?
[16:17] <Chex> Ursinha: your welcome, thanks..
[16:17] <Ursinha> no items proposed in the meeting agenda page
[16:18] <Ursinha> 5
[16:18] <Ursinha> 4
[16:18] <Ursinha> 3
[16:18] <Ursinha> 2
[16:18] <Ursinha> 1
[16:18] <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
[16:18] <Ursinha> #endmeeting
[16:18] <MootBot> Meeting finished at 10:18.
[16:18] <Ursinha> thanks everyone
[16:19] <noodles775> Thanks Ursinha
[16:20] <jtv> thanks Ursinha