* Ursinha looks14:08
* Ursinha hugs MootBot 14:08
Ursinhayou're here!14:08
UrsinhaWelcome to this week's Launchpad Production Meeting.  For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.15:02
Ursinha[TOPIC] Roll Call15:02
UrsinhaNot on the Launchpad Dev team? Welcome! Come "me" with the rest of us!15:02
MootBotMeeting started at 09:02. The chair is Ursinha.15:02
MootBotCommands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]15:02
MootBotNew Topic:  Roll Call15:02
Ursinhahi MootBot15:02
Ursinharockstar, ping15:03
Ursinhahenninge is mia15:03
rockstarme (barely)15:03
Ursinhawell, no issues for translations, so no much of a problem15:03
Ursinha[TOPIC] Agenda15:04
Ursinha * Actions from last meeting15:04
Ursinha * Oops report & Critical Bugs-15:04
Ursinha * Operations report (mthaddon/herb/spm)15:04
Ursinha * DBA report (DBA contact)15:04
MootBotNew Topic:  Agenda15:04
Ursinha[TOPIC] * Actions from last meeting15:04
Ursinha 1) matsubara to remove the next meeting from the agenda and add a note to the MeetingAgenda page that it should be added again when we need to change the time15:04
Ursinha 2) TL (sinzui, flacoste, bigjools) to send people to cover for them due the TL meeting next week (26th to 30th Jan)15:04
Ursinha 3) matsubara to file bugs for OOPS-1116EC265 (bug 320293), OOPS-1113EB6 (bug 276144)15:04
MootBotNew Topic:  * Actions from last meeting15:04
ubottuLaunchpad bug 320293 in launchpad-bazaar "OOPS traversing to branch on person page" [Medium,Confirmed] https://launchpad.net/bugs/32029315:04
ubottuLaunchpad bug 276144 in launchpad-bazaar "OOPS when trying to delete stacked-on branches." [Medium,Triaged] https://launchpad.net/bugs/27614415:04
Ursinha1 - I did that. From now on to discuss meeting time changes just add it to the list of meeting topics, on MeetingAgenda page15:04
Ursinha2 - okay as well15:04
Ursinha[TOPIC] * Oops report & Critical Bugs15:05
MootBotNew Topic:  * Oops report & Critical Bugs15:05
Ursinhathree oopses and one bug15:05
Ursinhathe oopses15:05
UrsinhaMissingMergeDirective: OOPS-1125CEMAIL115:05
Ursinhathis is yours rockstar?15:05
* Ursinha kicks ubottu 15:05
rockstarUrsinha, I can look at it15:05
Ursinharockstar, thanks15:06
Ursinhabac, to registry: OOPS-1125A165, OOPS-1125A1096 - this second one is the same in the email sinzui sent to barry15:06
Ursinhahi henninge!15:07
henningeUrsinha: hi! :)15:07
bacUrsinha: barry is working on the second one15:07
henningesorry for the delay ...15:07
Ursinhabac, do you know if there's an open bug for that?15:07
Ursinhaintellectronica, bug 279561, that's affecting people more frequently lately15:08
ubottuLaunchpad bug 279561 in malone "No url for <Message at ...> when trying to access bug messages through the API" [Medium,Triaged] https://launchpad.net/bugs/27956115:08
* intellectronica shoegazing15:08
bacUrsinha: i don't.  i'll check with barry when he returns from afk15:08
intellectronicasorry, it's still a mystery15:09
intellectronicai'll go back to working on it now15:09
Ursinhaintellectronica, do you have time to deal with that? it's causing a lot of oopses and annoying people15:09
Ursinhabac, thanks15:09
intellectronicaUrsinha: i do now15:09
Ursinha[action] bac to check with barry if there's an open bug for  OOPS-1125A1096, if not, Ursinha to file one15:10
MootBotACTION received:  bac to check with barry if there's an open bug for  OOPS-1125A1096, if not, Ursinha to file one15:10
Ursinhabac, about the other one, do you have any clues?15:10
Ursinhaintellectronica, thanks15:10
Ursinha[action] intellectronica to work on bug 27956115:10
MootBotACTION received:  intellectronica to work on bug 27956115:11
ubottuLaunchpad bug 279561 in malone "No url for <Message at ...> when trying to access bug messages through the API" [Medium,Triaged] https://launchpad.net/bugs/27956115:11
Ursinha[action] rockstar to check OOPS-1125CEMAIL115:11
MootBotACTION received:  rockstar to check OOPS-1125CEMAIL115:11
Ursinhaany other issues you may want to point?15:11
bacUrsinha: no clue ATM.  will check it out15:11
Ursinhathanks bac15:12
UrsinhaI appreciate that15:12
Ursinha[action] bac to take a look at OOPS-1125A16515:12
MootBotACTION received:  bac to take a look at OOPS-1125A16515:12
Ursinhawell, moving on15:12
Ursinha[TOPIC] * Operations report (mthaddon/herb/spm)15:12
MootBotNew Topic:  * Operations report (mthaddon/herb/spm)15:12
herb* 2008-01-28 - Yesterday - We rolled out 2.2.1. Total downtime was approximately 35 minutes.15:12
herb* Even after the rollout, we continue to have problems as a result of bug #156453 and bug #118625. I cannont emphasize enough how much of a pain point this is becoming for the LOSAs. More than a quarter of the incidents that we've had to deal with in the last year have been related to these two bugs.15:12
ubottuLaunchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/15645315:12
ubottuLaunchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/11862515:12
herb* We had a couple of incidents in the last week relating to bug #260171.15:12
ubottuBug 260171 on http://launchpad.net/bugs/260171 is private15:12
herb* Do we expect to roll out any additional patches this week? If so, when?15:12
Ursinhaherb, I think at least one, I'll talk to kiko and confirm that to you15:13
herbUrsinha: do you suspect it will be rolled out today or tomorrow?15:14
henningeUrsinha: He approved one of mine, too.15:14
Ursinha[action] Ursinha to check with kiko if any other rollouts will happen this week15:14
MootBotACTION received:  Ursinha to check with kiko if any other rollouts will happen this week15:14
herbI can wait, I was just curious if you have a best guess.15:14
Ursinhaherb, guess tomorrow, but it depends on if we're having more issues to be fixed15:14
Ursinhahenninge, cool15:15
Ursinhathanks herb15:15
UrsinhaI took note of the "pain to the LOSAs" about that two bugs15:15
herbUrsinha: thanks. much appreciated15:16
Ursinhawell, next15:16
Ursinha[TOPIC] * DBA report (DBA contact)15:16
Ursinhastub sent one email about it:15:16
UrsinhaLooks like the upgrade went smoothly and nothing exciting is happening. Yay.15:16
UrsinhaAlthough neither db server is particularly heavily loaded on average, we do see spikes sometimes. Also, the slave is still more loaded than production. As I don't expect us to get a second slave in the near future, I'm thinking we need to look into some better load balancing to move some of the slave load back to the master.15:16
MootBotNew Topic:  * DBA report (DBA contact)15:16
UrsinhaConfig changes on one or two of the appserver instances to use the master as the slave would work in the short term. Long term I think we could be better with a load balancer like pgbouncer or pgpool (1 or 2).15:16
Ursinhathat's all from stub15:16
Ursinhaanything else?15:16
Ursinhaanybody wants to point or discuss something?15:16
UrsinhaThank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs.15:17
MootBotMeeting finished at 09:17.15:17
Ursinhathe fastest eva15:17
gary_posterThanks Ursinha :-)15:17
Ursinhathank you all15:17
Ursinhagary_poster, :)15:17
cprovUrsinha: thanks!15:17
=== salgado is now known as salgado-lunch
=== salgado-lunch is now known as salgado
=== Ursinha is now known as Jorjao
=== Jorjao is now known as Ursinha
=== EdwinGrubbs is now known as Edwin-lunch
=== salgado is now known as salgado-afk
=== bac is now known as bac_afk
=== bac_afk is now known as bac

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!