[16:00] <matsubara> #startmeeting
[16:00] <MootBot> Meeting started at 10:00. The chair is matsubara.
[16:00] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[16:00] <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[16:00] <matsubara> [TOPIC] Roll Call
[16:00] <MootBot> New Topic:  Roll Call
[16:00] <matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
[16:01] <sinzui> me
[16:01] <gary_poster> me
[16:01] <Chex> me
[16:01] <henninge> me
[16:01] <matsubara> rockstar, allenap, hi
[16:01] <henninge> hi matsubara
[16:02] <henninge> ;)
[16:02] <matsubara> hi henninge, thanks for standing in for daniloff
[16:02] <allenap> me
[16:03] <matsubara> ok, let's move on. rockstar can join in later
[16:03] <matsubara> apologies from Ursula and bigjools
[16:03] <matsubara> [TOPIC] Agenda
[16:03] <MootBot> New Topic:  Agenda
[16:03] <henninge> matsubara: rockstar's in Wellington AFAIK
[16:04] <mrjazzcat> Brian is also attending
[16:04] <matsubara> oh, ok, so apologies from rockstar as well :-)
[16:04] <matsubara> hi Brian, welcome!
[16:04] <mrjazzcat> thanks
[16:04] <matsubara> mrjazzcat, ^
[16:04] <matsubara>  * Actions from last meeting
[16:04] <matsubara>  * Oops report & Critical Bugs & Broken scripts
[16:04] <matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
[16:04] <matsubara>  * DBA report (stub)
[16:04] <matsubara>  * Proposed items
[16:04] <matsubara> [TOPIC] * Actions from last meeting
[16:04] <MootBot> New Topic:  * Actions from last meeting
[16:04] <matsubara>  * salgado to take bugs 504300 and 504291 to foundations discussion
[16:04] <matsubara>  * Chex to discuss with rockstar about bug 497945
[16:05] <matsubara> Chex, did you have a chance to discuss that bug with rockstar?
[16:05] <matsubara> gary_poster, any news about those two foundations bugs?
[16:05] <matsubara> hmm
[16:06] <matsubara> ok, I can see that both are in progress
[16:06] <gary_poster> 1 sec
[16:06] <gary_poster> ty
[16:06] <matsubara> so that's fine
[16:06] <Chex> matsubara: no I did not, sorry.
[16:07] <matsubara> Chex, 497945 is a dupe of 486076, can it be considered actioned upon?
[16:07] <matsubara> not sure on the nature of the discussion from the previous meeting action
[16:07] <Chex> matsubara: I think the git import issue is less of an issue as I think that server received a large RAM upgrade, but it should still be looked at..
[16:07] <matsubara> Chex, it's assigned to Jelmer
[16:08] <matsubara> Chex, would you like this action item to be brought again in the next meeting?
[16:09] <Chex> matsubara: no I think we can close it down for now, I will bring it up again if it becomes an issue later, thank you
[16:09] <matsubara> thanks Chex
[16:09] <matsubara> so let's move on
[16:09] <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[16:09] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[16:10] <Chex> hi everyone, quick report today..
[16:10] <matsubara> We have 3 oopses needing attention, one for henninge, one for allenap and another one for rockstar
[16:10] <matsubara> Chex, hang in there, buddy
[16:10] <Chex> - LP Librarian space issue: Bug# 506489: We still need help with
[16:10] <Chex>      addressing the space issues on the librarian, can someone let us
[16:10] <Chex>      know the latest status of helping us cleaning up space?
[16:10] <Chex> - LP incidents of note:
[16:10] <Chex>         ; LP Cherry-picks: revno 8811 rolled out to lpnet 08-Jan,
[16:10] <Chex>           revno 8812 rolled out to lpnet 13-Jan
[16:10] <Chex> oh sorry
[16:10] <matsubara> hehe
[16:10] <matsubara> no worries
[16:11] <henninge> matsubara: bug 506925 is mine and the fix is next up in pqm - after the current cp is through ....
[16:11] <matsubara> allenap, https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1474EA771 doesn't look like bug 329917. it has the same exception type but looks like a differnt bug
[16:11] <matsubara> can you confirm?
[16:11] <matsubara> henninge, I was wondering about https://bugs.edge.launchpad.net/rosetta/+bug/507498
[16:11]  * allenap looks
[16:12] <matsubara> and the one for the code team is https://bugs.edge.launchpad.net/launchpad-code/+bug/507487
[16:12] <matsubara> which I'll email tim about
[16:12] <matsubara> [action] matsubara to email tim about  https://bugs.edge.launchpad.net/launchpad-code/+bug/507487
[16:12] <MootBot> ACTION received:  matsubara to email tim about  https://bugs.edge.launchpad.net/launchpad-code/+bug/507487
[16:13] <allenap> matsubara: That does look like a different bug. Very odd. I'll file a bug and take it to the team.
[16:13] <matsubara> henninge, sorry for the crap description. not sure if it describes the problem well. it looks like a high priority bug since it OOPSes on GET to that page
[16:13] <matsubara> [action] allenap to file a bug about OOPS-1474EA771 and discuss it with Bugs team.
[16:14] <henninge> matsubara: seems spurious, I can GET that page now ...
[16:14] <MootBot> ACTION received:  allenap to file a bug about OOPS-1474EA771 and discuss it with Bugs team.
[16:14] <matsubara> thanks allenap
[16:14] <matsubara> henninge, it still oopses for me
[16:14] <matsubara> so likely to be a permission issue
[16:14] <matsubara> maybe because you're a rosetta admin?
[16:14] <henninge> matsubara: yes
[16:14] <henninge> oh, probably
[16:14]  * henninge logs out
[16:15] <matsubara> henninge, can you (or assign someone in Translations) to get that one fixed this cycle?
[16:15] <henninge> matsubara: all sick or on sprint, I'll do it.
[16:15] <henninge> ;-)
[16:15] <matsubara> thanks a lot henninge
[16:15] <matsubara> [action] henninge to fix bug 507498
[16:15] <MootBot> ACTION received:  henninge to fix bug 507498
[16:16] <matsubara> I'll add a note to the bug report that it doesn't oops for rosetta admins :-)
[16:16] <henninge> cheers
[16:17] <matsubara> we had a couple of script failures since last week
[16:17] <matsubara> rosetta-export-queue
[16:17] <matsubara> translations-import-queue-gardener
[16:17] <henninge> matsubara: that's what my current fix in pqm is fore (export-queue)
[16:18] <matsubara> allocate-revision-karma
[16:18] <henninge> matsubara: jtv submitted a fix for the gardener
[16:18] <matsubara> and another one for update-cache
[16:18] <henninge> matsubara: and some sql for the immediate fix.
[16:18] <matsubara> sinzui, any news about the allocate-revision-karma and update-cache?
[16:18] <matsubara> henninge, that's great. thank you
[16:19] <sinzui> matsubara: the former stopped the latter from running
[16:19] <matsubara> sinzui, and is there work in progress to fix the karma script?
[16:19] <sinzui> matsubara: the former (allocate-revision-karma) is something that the code-team thought was fixed, but we may be experiencing a reversion
[16:20] <sinzui> matsubara: revisions are code-team
[16:20] <matsubara> oh, it's a code team issue.
[16:20] <matsubara> all right. I'll email tim about it as well
[16:20] <matsubara> thanks sinzui
[16:20] <matsubara> [action] matsubara to email tim about allocate-revision-karma script still blowing up
[16:20] <MootBot> ACTION received:  matsubara to email tim about allocate-revision-karma script still blowing up
[16:20] <sinzui> matsubara: That was broken a few weeks ago because it tried to recalculate the ENTIRE history. and it went into recursion. Tim landed a fix only work with recent changes
[16:21] <matsubara> we have 8 critical bugs, 4 fix committed, 2 in progress, 1 triaged and 1 new (bad!)
[16:21] <matsubara> gary_poster, can you take a look at the one which is new (bug 504696)?
[16:21] <gary_poster> matsubara: yes
[16:21] <matsubara> [action] matsubara to talk to someone from soyuz about critical bug 506489
[16:21] <MootBot> ACTION received:  matsubara to talk to someone from soyuz about critical bug 506489
[16:22] <matsubara> [action] gary_poster to triage and assign bug 504696
[16:22] <MootBot> ACTION received:  gary_poster to triage and assign bug 504696
[16:22] <matsubara> thanks gary_poster
[16:22] <gary_poster> matsubara: stub is working on it.  Will adjust bug status to show
[16:22] <matsubara> [action] matsubara to cancel previous action item. it's already done
[16:23] <MootBot> ACTION received:  matsubara to cancel previous action item. it's already done
[16:23] <matsubara> thanks gary_poster
[16:23] <matsubara> sinzui, was it cp?
[16:23] <matsubara> maybe it's still blowing up because the code is not running with the fix?
[16:23] <sinzui> matsubara: I believe it was because the errors disappeared for a few fays
[16:23] <matsubara> sinzui, oh, right. I'll talk to tim about it them. thanks for the info
[16:24] <matsubara> moving on. thanks everyone
[16:24] <matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[16:24] <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
[16:24] <matsubara> Chex, now it's your turn, take the stage please :-)
[16:24]  * mbarnett prepares to heckle 
[16:25]  * henninge looks up heckle
[16:25]  * matsubara too
[16:25] <henninge> ah! we are all quiet, though... ;-)
[16:25] <Chex> sorry everyone, I will repost the report
[16:25] <Chex> - LP Librarian space issue: Bug# 506489: We still need help with
[16:25] <Chex>      addressing the space issues on the librarian, can someone let us
[16:26] <gary_poster> bah, you all don't know what heckle means?  What kind of IRC participation is this?!
[16:26] <Chex>      know the latest status of helping us cleaning up space?
[16:26] <Chex> - LP incidents of note:
[16:26] <Chex>         ; LP Cherry-picks: revno 8811 rolled out to lpnet 08-Jan,
[16:26] <Chex>           revno 8812 rolled out to lpnet 13-Jan
[16:26]  * gary_poster demonstrates heckling
[16:26] <henninge> gary_poster: lol!
[16:26] <Chex> and thats the report for this week..
[16:26] <flacoste> about the librarian space issue
[16:27] <flacoste> bigjools was testing a query to reclaim some space yesterday
[16:27] <flacoste> Bjorn was to approve it
[16:27] <flacoste> i don't know if it happened or not
[16:27] <flacoste> there is no record on the bug
[16:27] <flacoste> nor on LPS
[16:27] <flacoste> so we'll have to ask when they wake up in Wellington
[16:28] <matsubara> flacoste, I'll email bigjools about that bug today and will ask for an update in the bug report
[16:28] <Chex> flacoste: ok, sounds good, thanks for the update
[16:29] <matsubara> thanks Chex and flacoste (and gary_poster for the heckling demo :-))
[16:29] <matsubara> let's move on
[16:29] <gary_poster> :-) np
[16:29] <matsubara> [TOPIC] * DBA report (stub)
[16:29] <MootBot> New Topic:  * DBA report (stub)
[16:30] <matsubara> stub sent the report to the list. if you have question it's better to follow up there
[16:30] <matsubara> I won't paste it here because it was sent to the private list
[16:31] <matsubara> so let's move on
[16:31] <matsubara> [TOPIC] * Proposed items
[16:31] <MootBot> New Topic:  * Proposed items
[16:31] <matsubara> there is no proposed item
[16:31] <matsubara> anything else before I close?
[16:32] <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
[16:32] <matsubara> #endmeeting
[16:32] <MootBot> Meeting finished at 10:32.