| === salgado-afk is now known as salgado | ||
| === salgado is now known as salgado-afk | ||
| === mrevell is now known as mrevell-lunch | ||
| === mrevell-lunch is now known as mrevell | ||
| === salgado-afk is now known as salgado | ||
| === salgado_ is now known as salgado | ||
| === sinzui1 is now known as sinzui | ||
| === rockstar` is now known as rockstar | ||
| matsubara | #startmeeting | 15:00 |
|---|---|---|
| MootBot | Meeting started at 09:00. The chair is matsubara. | 15:00 |
| MootBot | Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] | 15:00 |
| danilos | me | 15:00 |
| sinzui | me | 15:00 |
| rockstar | me | 15:00 |
| danilos | and now, who's here? | 15:00 |
| bigjools | me | 15:00 |
| stub | me | 15:00 |
| intellectronica | me | 15:00 |
| matsubara | me | 15:00 |
| herb | me | 15:00 |
| matsubara | [TOPIC] Roll Call | 15:01 |
| MootBot | New Topic: Roll Call | 15:01 |
| matsubara | oops, forgot to change it to the right topic | 15:01 |
| mrevell | me | 15:01 |
| matsubara | Ursinha, ? | 15:01 |
| matsubara | flacoste, | 15:01 |
| Ursinha | me | 15:01 |
| flacoste | me | 15:01 |
| Ursinha | sorry | 15:01 |
| matsubara | ok, everyone seems to be here. let's move on | 15:02 |
| matsubara | [TOPIC] Agenda | 15:02 |
| MootBot | New Topic: Agenda | 15:02 |
| matsubara | * Next meeting | 15:02 |
| matsubara | * Actions from last meeting | 15:02 |
| matsubara | * Oops report & Critical Bugs | 15:02 |
| matsubara | * Operations report (mthaddon/herb/spm) | 15:02 |
| matsubara | * DBA report (DBA contact) | 15:02 |
| matsubara | so, next meeting, same time next week? | 15:02 |
| Ursinha | +1 | 15:02 |
| danilos | +1 | 15:03 |
| matsubara | all right. so be it | 15:03 |
| matsubara | [topic] actions from last meeting | 15:03 |
| MootBot | New Topic: actions from last meeting | 15:03 |
| rockstar | It's early for me, but that's alright I guess. | 15:03 |
| matsubara | * intellectronica to continue diagnosing bug 279561 | 15:03 |
| matsubara | * intellectronica to discuss bug 95822 (app server core dump bug) with Bugs team and try to find a quick workaround | 15:03 |
| matsubara | * matsubara update core dump bug with progress made last week | 15:03 |
| matsubara | * herb to find or file a bug about codebrowse being unresponsive and needing restarts | 15:03 |
| ubottu | Launchpad bug 279561 in malone "No url for <Message at ...> when trying to access bug messages through the API" [High,Incomplete] https://launchpad.net/bugs/279561 | 15:03 |
| ubottu | Launchpad bug 95822 in apport "Malone connection generates an "Internal Server Error" on large file attachments" [Medium,Confirmed] https://launchpad.net/bugs/95822 | 15:03 |
| matsubara | I think I did the progress update | 15:04 |
| intellectronica | matsubara: i think bjorn is dealing with 95822, i don't know the status, though | 15:04 |
| herb | Codebrowse bug(s): Bug #118625 and Bug #156453 | 15:04 |
| ubottu | Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Confirmed] https://launchpad.net/bugs/118625 | 15:04 |
| ubottu | Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,Confirmed] https://launchpad.net/bugs/156453 | 15:04 |
| matsubara | thanks herb | 15:04 |
| intellectronica | 279561 is a data issue, and the priority is low, since it's very rare, and we haven't seen any recent oopses | 15:04 |
| matsubara | intellectronica, can you update the bug report with the importance + rationale? | 15:05 |
| intellectronica | matsubara: sure, will do | 15:05 |
| matsubara | thanks intellectronica | 15:05 |
| matsubara | all right, moving on | 15:05 |
| matsubara | [topic] * Oops report & Critical Bugs | 15:05 |
| MootBot | New Topic: * Oops report & Critical Bugs | 15:05 |
| matsubara | Ursinha, take the stage please | 15:05 |
| Ursinha | look ma, that's me! | 15:05 |
| Ursinha | hi guys | 15:06 |
| Ursinha | Have three bugs | 15:06 |
| Ursinha | bug 286401, bug 294689, bug 294719 | 15:06 |
| * rockstar hopes they aren't for code. | 15:06 | |
| ubottu | Launchpad bug 286401 in launchpad-registry "Contact this user OOPSes when displayname has non-ASCII" [High,Triaged] https://launchpad.net/bugs/286401 | 15:06 |
| ubottu | Launchpad bug 294689 in malone "OOPS passing order_by=datecreated parameter to API searchTasks" [Undecided,Triaged] https://launchpad.net/bugs/294689 | 15:06 |
| ubottu | Launchpad bug 294719 in launchpad-registry "OOPS when trying to subscribe a private team to a bug" [Undecided,New] https://launchpad.net/bugs/294719 | 15:06 |
| Ursinha | cool | 15:06 |
| Ursinha | so, the first one, I think barry is taking care, but not sure | 15:06 |
| danilos | rockstar: most bugs are for code :P | 15:06 |
| rockstar | danilos, :) | 15:07 |
| Ursinha | it's annoying and very easy to reproduce :/ | 15:07 |
| danilos | Ursinha: have you tried contacting me? | 15:07 |
| Ursinha | sinzui, do you know if barry is taking care of that? | 15:07 |
| intellectronica | Ursinha: i'll take 294689, of course | 15:07 |
| Ursinha | intellectronica, great, thanks | 15:08 |
| Ursinha | about bug 294719 | 15:08 |
| ubottu | Launchpad bug 294719 in launchpad-registry "OOPS when trying to subscribe a private team to a bug" [Undecided,New] https://launchpad.net/bugs/294719 | 15:08 |
| sinzui | 286401 will be in review today | 15:08 |
| stub | It is assigned to barry and scheduled for this cycle, so I guess he is handling it. | 15:08 |
| Ursinha | sinzui, ok, thanks | 15:08 |
| intellectronica | Ursinha: and i'll either take or try to find someone to deal with 294719 | 15:08 |
| Ursinha | intellectronica, nice! I've discussed it briefly yesterday with bac and EdwinGrubbs | 15:09 |
| Ursinha | it was an "accident", but happened again, so needs some love | 15:09 |
| Ursinha | :) | 15:09 |
| intellectronica | unless someone from registry already knows more about it and wants to deal with it :) | 15:09 |
| Ursinha | sinzui, ? | 15:09 |
| sinzui | I think I can pass 294719 to Edwin | 15:09 |
| intellectronica | sinzui: cool, thanks | 15:10 |
| sinzui | or possibly salgado | 15:10 |
| * sinzui targets bug | 15:10 | |
| Ursinha | danilos, now I understood your question :P I didn't, but it'd oops for sure | 15:10 |
| Ursinha | great, thanks sinzui | 15:10 |
| Ursinha | ok guys, that's all from oops land | 15:10 |
| === salgado is now known as salgado-lunch | ||
| matsubara | thanks Ursinha. | 15:11 |
| matsubara | we have 1 critical bug report which is fix committed | 15:11 |
| Ursinha | no critical bugs, so fine | 15:11 |
| Ursinha | yes | 15:11 |
| matsubara | so, moving on | 15:11 |
| Ursinha | thanks matsubara | 15:11 |
| matsubara | thanks guys | 15:11 |
| Ursinha | thanks guys | 15:11 |
| matsubara | [topic] * Operations report (mthaddon/herb/spm) | 15:11 |
| MootBot | New Topic: * Operations report (mthaddon/herb/spm) | 15:11 |
| herb | - 2008-10-16 -- Had a service affecting issue related to proxied requests using HTTP/1.1 vs. HTTP/1.0 | 15:11 |
| herb | - 2008-10-17 -- Rolled out r7188 to production | 15:11 |
| herb | - 2008-10-20 -- Finally isolated and fixed the issues relating to proxied requests that affected is on 2008-10-16 and again on 2008-10-20 | 15:12 |
| herb | - 2008-10-20 -- Cherry pick r7204 | 15:12 |
| herb | - 2008-10-29 -- Cherry pick fix for bug #289661 and a fix for the mirror prober | 15:12 |
| herb | - 2008-11-04 -- Cherry pick r7226 and r7231 | 15:12 |
| ubottu | Launchpad bug 289661 in launchpad-bazaar ""Active code reviews" page returns oops in "live" LP (not edge)" [High,Triaged] https://launchpad.net/bugs/289661 | 15:12 |
| herb | - 2008-11-05 -- Cherry pick r7219 | 15:12 |
| herb | - We continue to be affected by the codebrowse bugs several times a week. See bug #118625 and bug #156453. | 15:12 |
| ubottu | Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Confirmed] https://launchpad.net/bugs/118625 | 15:12 |
| ubottu | Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,Confirmed] https://launchpad.net/bugs/156453 | 15:12 |
| herb | that's it from us unless there are questions. | 15:12 |
| rockstar | herb, we worked on loggerhead this last two weeks. I think we've narrowed the problem down, and can get a good idea what's going on. | 15:12 |
| herb | rockstar: good to know. thanks. | 15:13 |
| rockstar | Er, have a good idea what needs fixing. | 15:13 |
| stub | Leonard will be in contact to discuss why certain HTTP headers are being seen on production and not on staging, breaking Launchpad APIs on staging. | 15:13 |
| herb | stub: ok | 15:13 |
| matsubara | rockstar, can you assign those bugs to someone in your team and add a small comment on their status for everyone else benefit? | 15:13 |
| rockstar | matsubara, yes, doing it now. | 15:14 |
| herb | stub: he queried me right before the meeting. | 15:14 |
| matsubara | thank you rockstar | 15:14 |
| matsubara | anything else for the LOSAS? | 15:14 |
| matsubara | all right, moving on. thanks herb | 15:14 |
| herb | thanks | 15:14 |
| matsubara | [topic] * DBA report (DBA contact) | 15:14 |
| MootBot | New Topic: * DBA report (DBA contact) | 15:15 |
| stub | Staging is now running replicated. I managed to track down the variable that triggered the replica subscription failures. Our idle connection reaper was detecting one of the slony connections as evil and killing it, and Slony didn't report this in any meaningful way or abort the operation that could no longer be completed. | 15:15 |
| stub | I've added a whitelist facility to our reaper and installed it into production and staging. I've opened a bug upstream - I suspect it will be a WONTFIX, but the information should be useful to others when they get bitten (the error message we where seeing is reported on the mailing list about once per month, but no help there apart from retrying until it works). | 15:15 |
| stub | I think we are still on track to make production replicated next rollout. | 15:15 |
| stub | I'm aware of one outstanding DB patch that still needs to be dealt with - ProductRelease -> Milestone linkage. I think there is an agreement already so it is just a case of landing the patch tomorrow with the others unless further issues get raised overnight. | 15:15 |
| stub | oot | 15:15 |
| matsubara | thanks stub | 15:16 |
| matsubara | I'd like to make a quick request for you all | 15:16 |
| matsubara | if you have open items on https://edge.launchpad.net/launchpad-project/+milestone/2.1.10 please close them (mark as fix released/ implemeented or move to another milestone) | 15:17 |
| matsubara | I need to close the 2.1.10 milestone | 15:17 |
| matsubara | anyone has anything else before I close the meeting? | 15:17 |
| flacoste | sinzui: do you have any comments for stub on the ProductRelease -> Milestone linkage? | 15:18 |
| stub | Its in email | 15:18 |
| flacoste | ok | 15:18 |
| matsubara | all right. I think that's all then. | 15:18 |
| matsubara | Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. | 15:18 |
| matsubara | #endmeeting | 15:19 |
| MootBot | Meeting finished at 09:19. | 15:19 |
| * sinzui was satisfied with his email | 15:19 | |
| Ursinha | thanks matsubara | 15:19 |
| mrevell | nice meeting people | 15:19 |
| intellectronica | thanks matsubara | 15:20 |
| === salgado-lunch is now known as salgado | ||
| === bac is now known as bac_afk | ||
| === leonardr_ is now known as leonardr | ||
| === mrevell is now known as mrevell-afk | ||
| === salgado is now known as salgado-afk | ||
| === bac_afk is now known as bac | ||
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!