/srv/irclogs.ubuntu.com/2010/05/27/#launchpad-meeting.txt

=== _thumper_ is now known as thumper
=== mrevell is now known as mrevell-lunch
=== mrevell-lunch is now known as mrevell
=== Ursinha-afk is now known as Ursinha
matsubaramoo17:00
sinzuicluck17:00
gary_posterhee-haw17:00
danilosmeow17:01
Ursinhahello17:01
Ursinha#startmeeting17:01
UrsinhaWelcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.17:01
MootBotMeeting started at 11:01. The chair is Ursinha.17:01
MootBotCommands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]17:01
Ursinha[TOPIC] Roll Call17:01
MootBotNew Topic:  Roll Call17:01
UrsinhaNot on the Launchpad Dev team? Welcome! Come "me" with the rest of us!17:01
sinzuime17:01
Ursinhameeee17:01
gary_postersmee17:01
matsubarame17:01
Ursinharockstar, Chex, hello :)17:02
UrsinhaI see no soyuz people :(17:03
UrsinhaI know we'll have no bugs people here, so ok17:03
Ursinhawell adeuring is here, but not sure if it's for our meeting :)17:03
UrsinhaI'll move on and expect people to show up17:03
Ursinha[TOPIC] Agenda17:03
Ursinha * Actions from last meeting17:03
Ursinha * Oops report & Critical Bugs & Broken scripts17:03
Ursinha * Operations report (mthaddon/Chex/spm/mbarnett)17:03
Ursinha * DBA report (stub)17:03
MootBotNew Topic:  Agenda17:03
Ursinha * QA stats of the week17:03
Ursinha * Proposed items17:03
adeuringUrsinha: yes, that's why I'm here, but I have another (mumble) meeting right now.17:03
Ursinha[TOPIC] * Actions from last meeting17:04
Ursinha * DONE: matsubara to chase someone from Bugs about https://bugs.edge.launchpad.net/malone/+bug/58338517:04
MootBotNew Topic:  * Actions from last meeting17:04
=== salgado is now known as salgado-lunch
Ursinhacool, all done17:04
Ursinhaadeuring, thanks :)17:04
ubot5Error: Could not parse data returned by Launchpad: The read operation timed out (https://launchpad.net/bugs/583385)17:04
Ursinha[TOPIC] * Oops report & Critical Bugs & Broken scripts17:04
MootBotNew Topic:  * Oops report & Critical Bugs & Broken scripts17:04
Ursinhamain offenders are bug 504124 (spam processing bug?) and bug 58018117:04
ubot5Launchpad bug 504124 in Launchpad Foundations "process-mail.py "need more than 1 value to unpack" (affected: 2, heat: 22)" [High,Triaged] https://launchpad.net/bugs/50412417:04
ubot5Launchpad bug 580181 in Soyuz "DistributionSourcePackageRelease page still oopsing with NotOneError/LocationError (affected: 1, heat: 6)" [High,Triaged] https://launchpad.net/bugs/58018117:04
UrsinhaI see the latter should be worked by noodles as soon as he got rid of more urgent problems17:04
* rockstar is here... had computer problems17:04
* Ursinha hugs rockstar 17:04
ChexUrsinha: All us LOSAs are unavailable this week as we are sprinting in Montreal.17:04
UrsinhaChex, oh, that's bad, LOSAs' report is so useful17:05
* Ursinha thinks17:05
sinzuithe process-mail.py bug is a spam attack. Do we want to suppress oopses when the header is malformed?17:05
Ursinhathis meeting is crippled :/17:05
Ursinhasinzui, good question17:05
Ursinhagary_poster, we're having annoying high oops counts of 504124, maybe we should do something about it now the counting seems to be raising?17:05
Ursinhagary_poster, even what sinzui suggested17:05
matsubarasinzui, I think we should not log an oops in that case as you suggested in the bug report17:06
sinzuiUrsinha, gary_poster. The problem is not the app, but the data so we should gracefully recover I think17:06
matsubarawith a try:except when the code is processing the To: header17:06
Ursinhathat's my opinion as well17:06
gary_posterUrsinha: yeah, I had that one open already.  If it is really bothering us then let's do it.  Agree with sinzui's approach17:06
Ursinhacool17:06
Ursinhagary_poster, should I update the bug report with that?17:07
sinzuiwell, that is now a trivial fix I think17:07
gary_posterUrsinha: I'll handle it, thank you :-)17:07
Ursinhathanks gary_poster :)17:07
Ursinhanice17:07
Ursinhathanks all :)17:07
UrsinhaI'd need a soyuz people here now17:07
UrsinhaI'll go with the code one then17:07
Ursinharockstar, so, not sure if code team knows about it: OOPS-1607EA65817:08
ubot5https://lp-oops.canonical.com/oops.py/?oopsid=1607EA65817:08
sinzuiI think the soyuz bug has a deeper root cause...17:08
sinzuiI looked at it last month and could not see what was happening. I think it goes back to changes made in Jan/Feb17:08
Ursinhasinzui, might have, this was "fixed" previously and now shows two different oopses17:08
rockstarUrsinha, so, I didn't know about it, but this area still hasn't been tested much...  :/17:08
rockstarUrsinha, it won't be released.17:09
Ursinharockstar, oh, right17:09
Ursinharockstar, was that QAed on edge? I'm pointing the oops as it might be a consequence of QAing the feature17:09
rockstarUrsinha, well, so no, we can't QA on edge much because we're blocked on two RTs...17:09
Ursinharockstar, I see :/ do you know if the blockage is something that might last for long?17:10
rockstarUrsinha, well, the RT was filed as high priority more than a week ago, so your guess is as good as mine.17:11
Ursinharockstar, maybe we should poke some people? :)17:11
* Ursinha cries for a losa17:11
gary_posterrockstar, Ursinha, is this ...17:11
rockstargary_poster!17:11
gary_poster39402?17:12
rockstarUrsinha, gary_poster is the one who's been chasing for us.17:12
gary_posterRT 39402?17:12
Ursinhaah, I see17:12
rockstargary_poster, yes, that's it.17:12
gary_posterUrsinha, rockstar, mthaddon has said that he will look into it today17:12
rockstargary_poster, ta17:12
gary_posteror to not misrepresent: "member:gary: I'll try and take a look at the latter one (the first one is marked resolved) sometime today" :-)17:12
Ursinhacool!17:13
Ursinhathanks gary_poster and rockstar :)17:13
gary_posternp17:13
Ursinharockstar, I'll keep my eyes on that oopses and let you know if something shows up17:13
Ursinhathanks17:13
danilosrockstar, my suggestion is to also talk to bigjools and lamont to make sure your request is similar to what is being done for "unsupported" packages already17:14
danilosrockstar, about that RT at least17:14
Ursinha[action] talk to bigjools about the 300 timeouts in the DistroSeries:+index pages everyday, is that expected/known? e.g.: OOPS-1607C128217:14
ubot5https://lp-oops.canonical.com/oops.py/?oopsid=1607C128217:14
MootBotACTION received:  talk to bigjools about the 300 timeouts in the DistroSeries:+index pages everyday, is that expected/known? e.g.: OOPS-1607C128217:14
ubot5https://lp-oops.canonical.com/oops.py/?oopsid=1607C128217:14
matsubaraUrsinha, isn't that the one bigjools replied to recently?17:14
matsubarathe one that is making an xmlrpc request to another server but is being blocked by a firewall17:14
Ursinhamatsubara, not sure if that's the same, I guess that one was about builders17:14
sinzuiUrsinha, That is my oops17:15
matsubaraok, just wondering17:15
Ursinhamatsubara, thanks for that :)17:15
Ursinhasinzui, the DistroSeries:+index?17:15
danilosUrsinha, yeah, that sounds like registry17:15
Ursinhaif so, even better, you're here :)17:15
sinzuithe distroseries-portlet-packaging  is the root cause. I have a branch that add3 3 hours caching to it17:15
danilosand fwiw, storm taking too long to serialize stuff17:15
Ursinha[action] forget last action17:15
MootBotACTION received:  forget last action17:15
sinzuiEdwin's definitve SQL fix will not land until next release17:16
gary_posterUrsinha, so you know, thumper alerted me last night that this soft timeout is causing timeouts (hard, I assume) on the branch merge proposal page: https://lp-oops.canonical.com/oops.py/?oopsid=1607EA56 .  Therefore I need to make a bug and look into it.17:16
gary_poster(Which sucks because pretty much none of know librarian code, but oh well :-) )17:16
Ursinhagary_poster, thanks for that17:16
Ursinhasinzui, do you have the bug number?17:16
sinzuiMy oops is caused by a monster query. bug 535430 is the root cause17:17
ubot5Launchpad bug 535430 in Launchpad Registry "+needs-packaging link times out regularly (affected: 1, heat: 6)" [High,In progress] https://launchpad.net/bugs/53543017:17
Ursinhasinzui, right17:17
sinzui^ this is really a model problem that manifests itself on three pages17:17
Ursinhasinzui, which ones?17:18
sinzuidistroseries +index, +needs-packaging +packaging-links  (distroseries-portlet-packaging) plus two full pages17:19
Ursinhathank you17:20
* Ursinha takes notes17:20
Ursinhathanks everyone17:20
sinzui^ +packaging, not +packaging-links17:20
* Ursinha fixes her notes17:20
sinzuihttps://edge.launchpad.net/ubuntu/maverick shows that the issue centers on the Upstream packaging data17:21
Ursinhasinzui, so your fix will "fix" only part of the problem17:22
sinzuiyes. timeouts will be reduced by 50% to 80%17:22
sinzuiThat is still disappointing17:22
Ursinhathat's something17:22
UrsinhaI guess the model problem won't be fixed (if fixed) anytime soon..17:23
sinzuiThe fix will be too complicated for a CP17:23
Ursinhasinzui, do you think that will be fixed soon?17:24
sinzuiIt will be fixed in week 1 on staging17:24
Ursinhaoh, cool17:24
Ursinhabetter than I imagined17:24
Ursinhathanks sinzui17:25
UrsinhaI might move on, otherwise the meeting will last forever :)17:25
Ursinhawe have no critical bugs! \o/17:25
gary_poster\o/17:25
Ursinharockstar, upgrade_branches is still failing17:26
Ursinhagary_poster, :)17:26
rockstarUrsinha, yeah, I'll look into it.  I have some other P1 bugs that need to be fixed first.17:26
Ursinharockstar, sure. Thanks for that. Do you know if there are any bugs opened for that? I can do that!17:26
rockstarUrsinha, can you please open one?17:27
Ursinharockstar, sure :)17:27
Ursinharockstar, I'll do that and let you know. Thanks17:27
rockstarUrsinha, thanks.17:27
Ursinha[action] Ursinha to open a bug for the failing upgrade_branches script17:28
MootBotACTION received:  Ursinha to open a bug for the failing upgrade_branches script17:28
Ursinhacool, moving on17:28
Ursinha[TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)17:28
MootBotNew Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)17:28
Ursinhalosas are sprinting, so no donut for us17:28
Ursinha:/17:28
UrsinhaChex, may I ask you to send any important news to the list, when you have time? please? :)17:29
* Ursinha values that report17:29
Ursinhait's more a wish than anything else, as you're sprinting17:29
Ursinha:)17:29
Ursinhamoving on!17:29
Ursinha[TOPIC] * DBA report (stub)17:29
MootBotNew Topic:  * DBA report (stub)17:29
UrsinhaEmail asking for the report sent!17:30
Ursinha[TOPIC] * QA stats of the week17:30
MootBotNew Topic:  * QA stats of the week17:30
Ursinhauntested stuff goes this way:17:30
UrsinhaCode: 717:30
UrsinhaFoundations: 317:30
UrsinhaRegistry: 417:30
UrsinhaBugs: 317:30
UrsinhaTranslations: 717:30
UrsinhaSoyuz: 317:30
UrsinhaStrategy: 017:30
UrsinhaI see we're kind of stable re. the number of untested items every week, which is good :)17:31
Ursinharight17:31
Ursinhaabout the untriaged bugs17:31
UrsinhaI've sent one email to lp list asking your opinions about all projects we should take care of17:31
UrsinhaI don't think pasting the numbers here will be useful now, I'd like you to reply that thread so we know what to do about those17:32
Ursinhapretty please?17:32
danilosstats for untested stuff seem incorrect for translations :)17:32
Ursinhadanilos, it was like that 30 mins ago17:32
danilosUrsinha, I doubt it, maybe something like 1h or more ago :)17:32
gary_posterheh17:32
* gary_poster is huungry :-D17:33
Ursinhadanilos, how come? give me a paper bag, please17:33
Ursinhaok ok17:33
Ursinhadanilos, you're right, I see only three now17:33
danilosUrsinha, oh, the graph is probably slow to update, don't worry about it17:33
Ursinhadanilos, thanks :)17:34
Ursinhaso, please, answer the thread!17:34
Ursinha:_)17:34
Ursinha[TOPIC] * Proposed items17:34
UrsinhaNone from me.17:34
MootBotNew Topic:  * Proposed items17:34
Ursinhaanyone wants to say something?17:34
Ursinhaokay :)17:34
UrsinhaThank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.17:34
gary_posterI'm preparing an email to Ursinha and matsubara about orphan branches17:34
Ursinha#endmeeting17:34
MootBotMeeting finished at 11:34.17:34
gary_posterbye17:34
gary_posterthank you17:35
=== gary_poster is now known as gary-lunch
Ursinhagary_poster, branches or commits?17:35
Ursinhaoh, nevermind, I can read the thread later :P17:35
gary-lunchUrsinha: commits, from perspective of qa tagging :-)17:35
Ursinhagary-lunch, :)17:35
Ursinhathanks everyone, and bye :)17:35
daniloscheers17:35
matsubarathanks Ursinha17:36
=== salgado-lunch is now known as salgado
=== gary-lunch is now known as gary_poster
=== matsubara is now known as matsubara-afk
=== salgado is now known as salgado-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!