[15:00] <matsubara> #startmeeting
[15:00] <MootBot> Meeting started at 09:00. The chair is matsubara.
[15:00] <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
[15:00] <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
[15:00] <matsubara> [TOPIC] Roll Call
[15:00] <MootBot> New Topic:  Roll Call
[15:00] <al-maisan> me
[15:00] <sinzui> me
[15:00] <Ursinha> me
[15:01] <matsubara> rockstar, Chex, allenap: hi
[15:01] <al-maisan> brb
[15:01] <allenap> me
[15:03] <matsubara> ok, let's move on, others can join in along the way
[15:04] <matsubara> [TOPIC] Agenda
[15:04] <MootBot> New Topic:  Agenda
[15:04] <matsubara>  * Actions from last meeting
[15:04] <matsubara>  * Oops report & Critical Bugs & Broken scripts
[15:04] <matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
[15:04] <matsubara>  * DBA report (stub)
[15:04] <matsubara>  * Proposed items
[15:04] <matsubara> [TOPIC] * Actions from last meeting
[15:04] <MootBot> New Topic:  * Actions from last meeting
[15:04] <matsubara>  * gary_poster to try to land branch that cherry picks lazr.restful updates on lpnet for bug 331990
[15:04] <matsubara>  * Ursinha to ask matsubara about his outstanding items from last meeting
[15:04] <matsubara>  * Ursinha to ask translations to triage bug 462891
[15:04] <matsubara>     * Ursinha asked henninge in the meeting
[15:04] <matsubara>  * allenap to follow up with pitti about bug 453203
[15:04] <matsubara>  * Ursinha to send one email to lp list explaining the qa-tags experiment
[15:04] <Ursinha> also bug 462891 is being discussed in the ml
[15:05] <allenap> Ehrm, I haven't done bug 453203 yet. Sorry, it's still on my list.
[15:05] <Ursinha> and I started working on the wiki page to then send the email, but haven't finished
[15:05] <Ursinha> will do
[15:05] <Ursinha> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
[15:05] <matsubara> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
[15:05] <MootBot> ACTION received:  Ursinha to send one email to lp list explaining the qa-tags experiment
[15:06] <matsubara> [action] allenap to follow up with pitti about bug 453203
[15:06] <MootBot> ACTION received:  allenap to follow up with pitti about bug 453203
[15:06] <matsubara> the one from gary_poster is probably done now that we rolled out, right?
[15:07]  * matsubara tries to remember his outstanding items from the last meeting
[15:08] <matsubara> * allenap and matsubara to talk about the timeouts on bug pages and * matsubara to talk to stub about the DBA report when he gets back
[15:08] <sinzui> Ursinha: I reported bug 475433  oops leaving milestone code_name empty today. This edit form was broken by thumper's changes to StrippedTextLine last week.
[15:08] <Ursinha> thanks sinziu
[15:08] <stub> meep
[15:08] <Ursinha> sinzui,
[15:09] <matsubara> ok, I did talk to allenap about timeouts on bug pages
[15:09] <allenap> matsubara: We didn't really come to any conclusions iirc.
[15:09] <gary_poster> matsubara: yes, should be rolled out
[15:09] <matsubara> and I sent an email to stub about the DBA report while he was on vacation
[15:10] <stub> There is generally little to report about databases when I'm on vacation. I could send some holiday snaps if it would make people happy.
[15:10] <matsubara> allenap, yeah. let's see if after this rollout timeouts will improve
[15:10] <matsubara> stub, if it's like the one sinzui sent a long time ago, it'd be hilarious
[15:11] <allenap> matsubara: Okay. I've back to Bugs as usual next week so I hope to have more time to look at this.
[15:11] <matsubara> allenap, thanks
[15:11] <matsubara> let's move on. thanks everyone
[15:11] <sinzui> Does it involve hemorrhoid cream?
[15:12] <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
[15:12] <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
[15:12] <Ursinha> LOL
[15:12] <Ursinha> I'm not able to see the oopses from after the rollout yet due to an oops-tools problem, they're being generated since this morning, yet not finished
[15:12] <Ursinha> the issues I'm aware are all being handled, scripts failing and this bug on milestone sinzui reported
[15:13] <matsubara> we have one critical bug on launchpad-code which is in the New state
[15:13] <matsubara> and rockstar is not around
[15:13] <matsubara> the other one is on launchpad-foundations and it's fix committed
[15:14] <Ursinha> sinzui, this milestone one is a candidate for reroll?
[15:14] <sinzui> umm
[15:14] <sinzui> I do not know. I suppose it is since I had to read the code to know that I had to enter a value to make my change work
[15:15] <Ursinha> sinzui, if you think it's not :)
[15:15] <sinzui> Ursinha: The fix is easy and I can get it reviewed today. It is certainly good for a CP
[15:15] <Ursinha> sinzui, alright
[15:16] <Ursinha> I'd ask you if you are working on bugs for the reroll (if it happens), please tag your bugs with a current-rollout-blocker tag
[15:16] <matsubara> thumper, if you're around can you update https://bugs.edge.launchpad.net/launchpad-code/+bug/475394 status and leave a comment explaining what's up and what's being done about it?
[15:17] <noodles775> matsubara: abentley is currently working with mthaddon on #lp-code
[15:17]  * noodles775 goes again.
[15:17] <matsubara> noodles775, thanks
[15:17] <mthaddon> I was, but he quit on me :(
[15:19] <matsubara> some scripts failing likely to be due to the rollout
[15:19] <matsubara> garbo-hourly failing since some time ago due to https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464161 and https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464155
[15:19] <matsubara> stub, shouldn't the latter be more important than medium?
[15:19] <stub> garbo isn't serious thankfully - we can cope.
[15:20] <stub> other scripts might be affected by the same bug though (at least one has been reported), so it is my priority.
[15:20] <matsubara> thanks stub
[15:21] <stub> (464161 is the priority - it might even be the cause of the other bug)
[15:21] <matsubara> I see
[15:21] <matsubara> Ursinha, anything else on this section?
[15:21] <Ursinha> matsubara, no, not from me
[15:21] <matsubara> thanks everyone
[15:21] <matsubara> moving on
[15:21] <matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
[15:21] <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
[15:22] <mthaddon> LP rollout today, and some ongoing issues because of that (see "Cowboys" section of LPS)
[15:22] <mthaddon> Can we get someone to review the IncidentLog and fill in the QA section?
[15:22] <mthaddon> I think that's about it
[15:23] <matsubara> [action] matsubara to talk to francis about the IncidentLog QA section
[15:23] <MootBot> ACTION received:  matsubara to talk to francis about the IncidentLog QA section
[15:23] <matsubara> thanks mthaddon
[15:23] <Ursinha> mthaddon, do you know if we're considering a reroll?
[15:23] <Ursinha> maybe noodles775 know
[15:24] <Ursinha> as he's the almighty release manager :)
[15:24] <al-maisan> Ursinha: he's the *tired* RM :)
[15:24] <mthaddon> we'll definitely need a reroll, as we already have a bunch of stuff cowboyed (per the LPS wiki page)
[15:25] <Ursinha> https://wiki.canonical.com/InformationInfrastructure/OSA/LaunchpadProductionStatus
[15:25] <Ursinha> to help who wants to see it :)
[15:26] <Ursinha> anyway, I'll check up the oops today and see if we have serious issues that should be fixed before the reroll
[15:27] <matsubara> thanks Ursinha
[15:27] <matsubara> let's move on
[15:27] <matsubara> [TOPIC] * DBA report (stub)
[15:27] <MootBot> New Topic:  * DBA report (stub)
[15:27] <stub> Set to go with testing of the rosetta message sharing data migration. Looks like this might shrink the size of the big rosetta datasets by 30+%. W00t.
[15:27] <stub> There are not many databases in Angkor, but my mother had a lovely time anyway.
[15:27] <stub> The code that needed to land to get staging DB restores back under way landed. Early next week baring distractions I hope.
[15:27] <stub> First test of the sanitized-database dump generator will be kicked off tomorrow.
[15:27] <stub> It would be good if people can look over lib/lp/scripts/utilities/sanitizedb.py to see if I've missed anything in the sections of the schema they are familiar with. There should be a dump for Canonical devs to run on ec2 or at home if they are brave next week.
[15:28] <stub> (The dumps should remain in company - there may be leaks in there now and because we use a blacklist approach, leaks can appear in the future. At least until teams have signed off on what we have and we have some sort of process for maintaining the tool).
[15:28] <stub> oot.
[15:29] <matsubara> [action] qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
[15:29] <MootBot> ACTION received:  qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
[15:30] <matsubara> stub, can you add one person from each team to the merge proposal that includes that script? that way people will look into it easily
[15:30] <stub> Its already landed
[15:31] <Ursinha> hehe, oops :)
[15:31] <stub> Anything people find has been missed is a bug. Anything removed that shouldn't be is a bug.
[15:31] <matsubara> ok, so the action stands for everyone, please pass the word to your teams
[15:32] <matsubara> ok
[15:32] <stub> Its all simple to follow and in small, discreet steps.
[15:32] <matsubara> let's move on
[15:32] <matsubara> cool. I'll also email the list to remind people
[15:33] <matsubara> [action] matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script
[15:33] <MootBot> ACTION received:  matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script
[15:33] <matsubara> thanks stub
[15:33] <matsubara> [TOPIC] * Proposed items
[15:33] <MootBot> New Topic:  * Proposed items
[15:33] <matsubara> no proposed items
[15:34] <matsubara> anything else before I close
[15:34] <matsubara> ?
[15:34] <matsubara> 3
[15:34] <matsubara> 2
[15:34] <matsubara> 1
[15:34] <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
[15:34] <al-maisan> thanks
[15:34] <matsubara> #endmeeting
[15:34] <MootBot> Meeting finished at 09:34.
[15:36] <Ursinha> thanks everyone