[19:00] <matsubara> ok
[19:00] <matsubara> it's that time
[19:00] <matsubara> #startmeeting
[19:00] <mthaddon> here
[19:00]  * matsubara pokes MootBot 
[19:00] <matsubara> bah
[19:00] <matsubara> Welcome to this week's Launchpad development meeting. For the next 45 minutes or so, we'll be coordinating Launchpad development.
[19:01] <matsubara> [TOPIC] Roll Call
[19:01] <matsubara> who's here today?
[19:01] <sinzui> me
[19:01] <bac> me
[19:01] <barry> me
[19:01] <mwhudson> me
[19:01] <mars> me
[19:01] <adeuring> me
[19:01] <mthaddon> me
[19:01] <allenap> me
[19:01] <intellectronica> me
[19:01] <matsubara> Ursinha: ?
[19:01] <EdwinGrubbs> me
[19:01] <Ursinha> me
[19:01] <cprov> me
[19:02]  * \sh 's lurking to catch some news about the api ;)
[19:02] <matsubara> please check that your teams are here
[19:02] <matsubara> salgado: ?
[19:02] <salgado> me
[19:02] <matsubara> releases is here
[19:02] <bac> leonardr: meeting ping
[19:02] <abentley> me
[19:03] <intellectronica> matsubara: bugs are here minus BjornT (sprinting) and gmb (holiday)
[19:03] <matsubara> so, we're missing code, foundations, losas, soyuz.
[19:04] <matsubara> cprov: you're the only one from soyuz, is that right?
[19:04] <cprov> soyuz is - bigjools (sprinting) - al-maisan (apologies)
[19:04] <matsubara> mthaddon: only you from losas?
[19:04] <mthaddon> matsubara, herb's on holiday this week, spm is asleep :)
[19:04] <matsubara> danilos: ?
[19:04] <matsubara> mthaddon: okie
[19:04] <bac> foundations is here minus flacoste (sprinting), leonardr, and stub
[19:05] <stub> me!
[19:05] <matsubara> hmm I forgot the apologies section
[19:05] <matsubara> # Team Leads (sprinting)
[19:05] <matsubara> # herb
[19:05] <matsubara> # gmb
[19:05] <matsubara> # sinzui
[19:05] <matsubara> # mwhudson
[19:05] <matsubara> # mrevell
[19:05] <mwhudson> rockstar: ping
[19:05] <mwhudson> (i am here anyway!)
[19:05]  * sinzui is still here
[19:05] <matsubara> okie, let's move on, we have at least one representative from each team
[19:05] <matsubara> [TOPIC] Agenda
[19:05] <matsubara>  * Next meeting
[19:05] <matsubara>  * Actions from last meeting
[19:05] <matsubara>  * Oops report & Critical Bugs (matsubara/ursinha)
[19:05] <matsubara>  * Operations report (mthaddon/herb/spm)
[19:05] <matsubara>  * DBA report (stub)
[19:05] <matsubara>  * Sysadmin requests (Rinchen)
[19:05] <matsubara>  * New packages required (salgado)
[19:06] <matsubara> same bat-time, bat-channel next week?
[19:06] <Ursinha> +1
[19:06] <rockstar> me
[19:06] <intellectronica> bat-?
[19:06] <matsubara> all right, no complains is good.
[19:07] <matsubara> intellectronica: that's a joke. maybe it only works for brazilians.
[19:07] <intellectronica> matsubara: apologies, i won't be here - i'm going on a much needed holiday
[19:07] <matsubara> intellectronica: nm that ;-)
[19:07] <abentley> intellectronica: http://en.wikipedia.org/wiki/Batman_(TV_series)
[19:07] <matsubara> abentley: exactly :-)
[19:07] <matsubara> intellectronica: ok. please add yourself to the apologies list
[19:07] <intellectronica> abentley: cheers for the cultural reference
[19:07] <matsubara> [TOPIC] Actions from last meeting
[19:07] <matsubara> * LOSAs to contact LP Devs ASAP when staging gdb breakpoint reached for interactive debugging.
[19:08] <matsubara> mthaddon: any news about that ^?
[19:08] <mwhudson> yeah, i made some comments on the bug
[19:08] <mwhudson> https://bugs.edge.launchpad.net/launchpad/+bug/247227
[19:08] <mthaddon> matsubara, we've had a good gdb dump and it's suggested an upgrade to psycopg2
[19:08] <mthaddon> matsubara, which is in progress
[19:09] <matsubara> all right, so the interactive debugging was done and we moved forward with the bug. cool. thanks mthaddon and mwhudson!
[19:09] <mwhudson> although i had a chat with jamesh about that yesterday, and maybe maybe it's a bug in zope
[19:09] <mwhudson> (it's pretty a pretty subtle issue)
[19:10] <matsubara> mwhudson: right.
[19:10] <matsubara> mwhudson: do you need any more input from LOSAS re: interactive debbuging?
[19:11] <matsubara> ok, let's move on and that can be discussed in the bug report.
[19:11] <mwhudson> no
[19:11] <matsubara>  * Oops report & Critical Bugs (matsubara/ursinha)
[19:11] <mwhudson> (more stacktraces would still be interesting)
[19:11]  * Ursinha waves
[19:11] <Ursinha> okay guys, i'll merge bugs and critical bugs into one today
[19:12] <Ursinha> this is gonna be tough: 8 bugs, of these, 1 candidate to critical (CC), 2 critical (C)
[19:12] <Ursinha> the bugs: 3 for foundations (262328, 261915 (CC), 259440 (C)), 2 for code (260206, 260140), 1 for bugs (252947), 1 shipit (259947) and 1 for translations (261507) (C)
[19:12] <Ursinha> foundations first
[19:12] <Ursinha> bug 262328 (leonardr?)
[19:12] <Ursinha>  bug 261915 (+participation) (CC) - let's make it critical?
[19:13] <Ursinha> bug 259440 (MailinglistApiView) (C)
[19:13] <barry> i'm working on it.  stub helped me with the magic to cut the queries in about 1/4 in the test suite
[19:13] <Ursinha> ok barry, thanks
[19:13] <barry> but mthaddon reports that it's still oopsing on staging
[19:13] <barry> so still working on it
[19:13] <matsubara> salgado: should the bug in +participation be made critical?
[19:13] <salgado> matsubara, the bug won't stop the OOPSes
[19:13] <mthaddon> barry, have you had a chance to look at the logs yet, or after meeting?
[19:14] <barry> mthaddon: after the meeting
[19:14] <salgado> matsubara, I mean, fixing the bug won't stop them
[19:14] <salgado> matsubara, to stop them we need to get approval to run the SQL script I posted yesterday night to launchpad@
[19:14] <Ursinha> barry, it's indeed oopsing on staging
[19:14] <matsubara> salgado: I was expecting that the resolution to the bug would include the page stop oopsing :-)
[19:14] <Ursinha> barry, thanks for taking care of it
[19:14] <barry> Ursinha: we may have to take a more radical approach then :/
[19:15] <matsubara> salgado: oh right, I see. and all the people that can approve it are meeting now :-/
[19:15] <salgado> matsubara, there's no need to wait for the bug resolution to run the SQL script
[19:15] <salgado> matsubara, correct
[19:15] <intellectronica> zorry. got disco
[19:15] <matsubara> salgado: maybe stub could approve that query?
[19:15] <matsubara> can you stub?
[19:15] <Ursinha> salgado, but it may be raised to critical?
[19:15] <salgado> Ursinha, the bug is not critical, IMO
[19:16] <salgado> fixing the data is
[19:16] <stub> Which query is this?
[19:16] <Ursinha> salgado, got it
[19:16] <stub> I like to see things before I approve them ;)
[19:16] <salgado> stub, https://pastebin.canonical.com/8613/plain/
[19:17] <salgado> stub, seeing stuff before approving is for wussies ;)
[19:17] <matsubara> Ursinha: what else?
[19:17] <stub> Approved. No idea if it is correct, but we can always rebuild that table from scratch if we mess it up too much.
[19:17] <Ursinha> may i change to code?
[19:18] <matsubara> Ursinha: go ahead, it's better to parallelize things in this section otherwise we take the whole meeting time
[19:18] <salgado> stub, thanks. I'll coordinate with mthaddon to try it on staging first, btw
[19:18] <stub> A run on staging first wouldn't hurt though ;)
[19:18] <Ursinha> ok
[19:18] <Ursinha> now, for code
[19:18] <mwhudson> Ursinha: i'll take 260206
[19:18] <Ursinha>  bug 260206 (another resolve_lp_path problem, maybe mwhudson?), and bug 260140 (revisions.atom), how's that?
[19:18] <Ursinha> thanks mwhudson
[19:19] <Ursinha> very fast :_
[19:19] <Ursinha> :)
[19:19] <mwhudson> revisions.atom is thumper's
[19:19] <Ursinha> and he's not here
[19:19] <matsubara> [ACTION] stub approved salgado query to be run on production db, after salgado has run it on staging to check everything works as expected
[19:19] <rockstar> As far as I know, thumper is still working on revisions.atom
[19:19] <Ursinha> rockstar, thanks for the info
[19:19] <Ursinha> moving on
[19:19] <Ursinha> now, bugs
[19:20] <Ursinha> bug 252674 - the bugs/+index pain
[19:20] <Ursinha> i'd like to know how is that, someone from bugs?
[19:20] <matsubara> intellectronica: ^
[19:20] <intellectronica> Ursinha: i think BjornT was working on this
[19:20] <intellectronica> obviously he's sprinting now, so i guess it's delayed
[19:20] <Ursinha> intellectronica, i'll ask him later so
[19:21] <Ursinha> intellectronica, thanks
[19:21] <Ursinha> the one for translations, a critical, bug 261507
[19:21] <Ursinha> jtv or danilos, what is the status? it seems half-fixed reading the bugs comments
[19:22] <Ursinha> danilos, ?
[19:22] <intellectronica> Ursinha: looks like they're both MIA, you'll have to ask them later
[19:22] <matsubara> jtv is sprinting and danilos doesn't seem to be here
[19:22] <Ursinha> i'll ask them later too
[19:22] <Ursinha> and the latest shipit strange bug:  bzr_version_info.py not found bug - bug 259947
[19:23] <matsubara> [ACTION] Ursinha to ask danilo /jtv about bug 261507
[19:23] <Ursinha> how's that going, it keeps happening from time to time
[19:23] <matsubara> [ACTION] Ursinha to ask Bjornt about bug 252674
[19:24] <Ursinha> mthaddon, ^
[19:24] <Ursinha> oh man
[19:24] <Ursinha> ok
[19:24] <matsubara> Ursinha: did it happen again lately?
[19:24] <Ursinha> a few times
[19:24] <Ursinha> it's sporadic
[19:25] <Ursinha> anyway, i'll ask mthaddon later too
[19:25] <Ursinha> that's all for now, thanks anyway guys
[19:25] <matsubara> ok. thanks Ursinha
[19:25] <matsubara>  * Operations report (mthaddon/herb/spm)
[19:25] <mthaddon> • App servers dying with pidfile seems to have been traced to psycopg2, so that's hopeful - SA working with packagers to get that taken care of - mentioned earlier in the meeting
[19:25] <mthaddon> • Had one CP this week, to codehosting
[19:25] <mthaddon> • Codebrowse has been giving us problems since 2.1.8, but I think mwhudson has identified the issue
[19:25] <mthaddon> • MailingListApi OOPSes are a real problem in terms of the amount of space the OOPSes use up (on production and staging, esp as logs are synced) - mentioned earlier in the meeting
[19:25] <mthaddon> • That's about it from herb, spm and I unless there are any questions
[19:26] <Ursinha> so here is the man
[19:26] <matsubara> any questions?
[19:26] <matsubara> moving on
[19:26] <matsubara>  * DBA report (stub)
[19:27] <stub> Growth of the Librarian has been noticed. I sent out a report on the break down of usage. We should set the expiry date on the LibraryFileAlias when possible, which will allow the garbage collector to remove the file from disk when it is no longer needed. The entries remain in the database - just rendering the LibraryFileAlias will give a (deleted) marker instead of a hyperlink and the Librarian will give 404s if someone attempts to retriev
[19:27] <stub> I've still got a branch landing blocked on psycopg2 being upgraded on the PQM environment, and we won't know if the bug fixed version solves our appserver crashes until we try. As launchpad-database-dependancies has been updated, devs should already be running the updated version. Tracked in RT #31577
[19:27] <stub> losas are moving the db graphs from cricket to their new system, which is great. Generating all the metrics every 10 mins is a big load, and now we will be able to do most of them once per day, which is all we need for the trends.
[19:28] <stub> oot
[19:28] <matsubara> thanks stub
[19:28] <matsubara> and thanks mthaddon, forgot to say in the previous section
[19:28] <matsubara>  * Sysadmin requests (Rinchen)
[19:28] <mthaddon> matsubara, I'll survive
[19:28] <matsubara> anyone blocked on RT requests?
[19:29] <stub> RT #31577 as mentioned two or three times this meeting :)
[19:29] <matsubara> pass them on to me and I'll follow up with IS/Joey
[19:29] <matsubara> stub: yep, noted that.
[19:29] <matsubara> ok, moving on.
[19:29] <matsubara>  * New packages required (salgado)
[19:30] <salgado> anything this week?
[19:30] <salgado> matsubara, quick, move on!
[19:30] <salgado> before kiko shows up
[19:30] <matsubara> okie, thanks salgado
[19:31] <matsubara> Thank you all for attending this week's Launchpad Developer Meeting. See the channel topic for the location of the logs.
[19:31] <matsubara> unless there's something else?
[19:31] <matsubara> #endmeeting
[19:31] <mwhudson> thanks matsubara
[19:31] <intellectronica> matsubara: thanks, great meeting!
[19:31] <barry> matsubara: thanks!
[19:31] <bac> thanks matsubara and Ursinha
[19:31] <Ursinha> matsubara, great job! :)
[19:32] <stub> salgado, mthaddon: Should I run salgados SQL or will a losa be handling it?
[19:32] <stub> Oh.. nm....
[19:32] <Ursinha> everybody is gone
[19:32] <Ursinha> it's sad
[19:32] <stub> Its bed time