=== salgado-afk is now known as salgado === noodles is now known as noodles-afk === bac` is now known as bac === Ursula-logbot is now known as Ursinha === mrevell is now known as mrevell-lunch [15:00] #startmeeting [15:00] Meeting started at 10:00. The chair is matsubara. [15:00] Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] [15:00] Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. [15:00] [TOPIC] Roll Call [15:00] New Topic: Roll Call [15:00] me [15:00] Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! [15:00] me [15:00] me [15:00] me [15:00] meeee [15:00] me [15:01] rockstar: hi [15:01] me [15:01] intellectronica: hi [15:01] me [15:02] all right. flacoste can join later [15:02] [TOPIC] Agenda [15:02] New Topic: Agenda [15:02] * Actions from last meeting [15:02] * Oops report & Critical Bugs [15:02] * Operations report (mthaddon/herb/spm) [15:02] * DBA report (stub) [15:02] [TOPIC] * Actions from last meeting [15:02] New Topic: * Actions from last meeting [15:02] * matsubara to chase rockstar about OOPS-1152XMLP1 [15:02] * talked to mwhudson about this one and filed bug 338535 [15:02] * Ursinha to talk to rockstar about https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1159EA69 [15:02] * Ursinha to file a bug about OOPS-1160ED105 and assign to intellectronica [15:02] Launchpad bug 338535 in launchpad-bazaar "OOPS creating a branch for a private team" [High,Triaged] https://launchpad.net/bugs/338535 [15:02] * done: 337811 [15:02] * matsubara to chase the code guys about bug 337942 [15:02] * talked to thumper about this one. Importance was lowered and explained in the bug report. [15:02] Bug 337942 on http://launchpad.net/bugs/337942 is private [15:03] hey rockstar :) [15:03] can you take a look on that oops? [15:03] Hi Ursinha [15:03] Ursinha, that looks like a Soyuz oops. [15:04] soyuz? [15:04] rockstar: huh? [15:04] NoSuchDistroSeries: No such distribution series: 'totem'. [15:04] it looks like source package branches? [15:05] bigjools: do you agree with rockstar? [15:05] Oh, huh. Looking at the traceback, it's doing something with the XML-RPC server. [15:05] Ursinha: no [15:05] rockstar: :) [15:05] So that might be a code thing after all... [15:06] I would say that's a relatively low priority, since source package branches aren't completely working. I'll talk to jml about it. [15:06] rockstar: thanks. Want me to file a bug? [15:06] [action] Ursinha to file a bug about OOPS-1159EA69 [15:06] Ursinha, yes please. [15:06] ACTION received: Ursinha to file a bug about OOPS-1159EA69 [15:06] thanks rockstar [15:07] all right. thanks rockstar, Ursinha [15:07] [TOPIC] * Oops report & Critical Bugs [15:07] New Topic: * Oops report & Critical Bugs [15:08] one issue for bugs: intellectronica, https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1166F631 [15:08] https://devpad.canonical.com/~jamesh/oops.cgi/1166F631 [15:09] * Ursinha wonders if the internet is off again [15:09] haven't seen anything like this before. will investigate [15:09] Ursinha: you gonna file a bug, or should i? [15:10] thanks intellectronica [15:10] intellectronica: I will [15:10] [action] Ursinha to file a bug about OOPS-1166F631 and assign to intellectronica [15:10] https://devpad.canonical.com/~jamesh/oops.cgi/1166F631 [15:10] ACTION received: Ursinha to file a bug about OOPS-1166F631 and assign to intellectronica [15:10] https://devpad.canonical.com/~jamesh/oops.cgi/1166F631 [15:10] oh, it's some problem working with data from apport [15:11] Someone needs to teach ubottu about the new OOPS url. [15:11] intellectronica: looks like apport data isn't sending the correct headers [15:11] yes [15:11] all right. thanks intellectronica [15:12] we have 1 critical bug which is in progress already. [15:12] bug 341251 [15:12] Launchpad bug 341251 in launchpad-foundations "Semantics of shortlist was changed, without making sure the callsites expect it" [Critical,In progress] https://launchpad.net/bugs/341251 [15:12] or that our parsing of the headers is incorrect [15:12] right, that's all from me [15:12] ok. thanks Ursinha [15:12] [TOPIC] * Operations report (mthaddon/herb/spm) [15:12] New Topic: * Operations report (mthaddon/herb/spm) [15:12] 2009-03-10 - Cherry picked r7907 to the scripts server to fix bug #300634. [15:12] Launchpad bug 300634 in malone "Bug watches aren't getting updated in an ordered fashion" [High,Fix committed] https://launchpad.net/bugs/300634 [15:12] Bug #156453 and bug #118625 continue to be a daily problem. [15:12] Bug #260171 is still causing a problem every few days. [15:13] There are currently 3 pending cherry picks, two of which need approval. [15:13] matsubara: bugs 341085, 341117 landed, but misses the edge update [15:13] Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,Triaged] https://launchpad.net/bugs/156453 [15:13] Error: Could not parse data returned by Launchpad: The read operation timed out (https://launchpad.net/bugs/118625/+text) [15:13] Error: Could not parse data returned by Launchpad: The read operation timed out (https://launchpad.net/bugs/260171/+text) [15:13] Error: Could not parse data returned by Launchpad: The read operation timed out (https://launchpad.net/bugs/341085/+text) [15:13] Error: Could not parse data returned by Launchpad: The read operation timed out (https://launchpad.net/bugs/341117/+text) [15:13] whoops [15:14] ouch [15:14] ubottu should really start using the api [15:14] Error: I am only a bot, please don't think I'm intelligent :) [15:14] * sinzui thinks those bugs are private [15:14] sinzui: thanks for fixing it so quickly. [15:14] at least one of them is. [15:14] sinzui: are we going to need a cp for those? [15:15] matsubara: they could be, I'm inclined to push for it since the next release on on April 1 === mrevell-lunch is now known as mrevell [15:15] [action] sinzui to request CP for bugs 341085 and 341117 [15:15] Bug 341085 on http://launchpad.net/bugs/341085 is private [15:15] ACTION received: sinzui to request CP for bugs 341085 and 341117 [15:15] Bug 341085 on http://launchpad.net/bugs/341085 is private [15:16] hey rockstar, any news about the loggerhead work that would make the LOSAs happier? [15:16] matsubara, well, nothing concrete. [15:16] :-( [15:17] Every time we commit something, we *think* it'll fix it, but it never completely fixes it. [15:17] We are planning on chasing down the right people at PyCon to give us some definitive answers. [15:18] Profiling/debugging an application like this isn't trivial, so we're kinda doing our best with the voodoo we have. [15:18] rockstar: last meeting, I think stub suggested contracting someone to look at those problems. did you consider that? [15:19] matsubara, probably not. [15:20] rockstar: bring it up with the Code team. see what they think about it [15:20] anyway, let's move on. [15:20] thanks rockstar and herb [15:20] [TOPIC] * DBA report (stub) [15:20] New Topic: * DBA report (stub) [15:20] thanks matsubara, rockstar [15:20] Database maintenance tools are being updated to work with multiple slaves, including bringing them up and dropping them. The new slave should be live early next week. [15:20] Nothing else to report. [15:21] I forgot one thing, herb [15:21] herb: staging is running in its new hardware now, right? [15:21] the staging db is running on it's new hardware, yes. [15:22] s/it's/its/ [15:22] ok, cool! [15:22] thanks stub, herb [15:22] anything else before I close? [15:23] Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. [15:23] #endmeeting [15:23] Meeting finished at 10:23. [15:23] thanks matsubara [15:24] thanks matsubara [15:24] thanks matsubara [15:25] intellectronica: /11 [15:25] you're welcome [15:25] intellectronica: sorry, bug 341766 [15:25] Launchpad bug 341766 in malone "AttributeError OOPS when receiving data from apport on +filebug" [Undecided,New] https://launchpad.net/bugs/341766 [15:25] Ursinha: never saw that one before [15:25] :) [15:26] intellectronica: irssi fail [15:26] ah, of course :) [15:26] Ursinha: thanks [15:26] Ursinha: b.t.w have we seen this oops many times, or just this single instance? [15:27] i'm asking so that i can determine the importance [15:29] intellectronica: I've seen this one a few times a day [15:30] really? wow, that's bad. i wonder if apport changed [15:30] maybe it changed it's a jaunty/apport bug? [15:31] hmm, worth more checking [15:33] intellectronica: I don't think it's a apport change, because I guess there would be a lot more it that was the case, no? [15:33] Ursinha: don't know. if it's a very recent change, then maybe not many people have that version [15:33] Ursinha: https://dev.launchpad.net/LaunchpadBugTags [15:34] matsubara: thanks [15:34] Ursinha: the malone code we're looking at hasn't changed in a long long time [15:34] intellectronica: hmmm, maybe. I'm using jaunty and already "reported" many incidents [15:34] didn't hit any problems so far [15:35] Ursinha, intellectronica: could be some specific error report triggering the error. Are all oopses caused by the same person? [15:36] * Ursinha looks [15:36] is there now way to get the username from the oops report? [15:37] i only see the full name and db id [15:39] intellectronica: indeed [15:39] intellectronica: I'll open a bug about it and matsubara will check [15:40] anyway, given that the user is not member of any team, i would guess that it's probably not the case that he's using a super latest version of apport [15:40] intellectronica: I lied, I saw a few occurrences but not daily [15:40] intellectronica: do you want to see the oopses? [15:40] I'll append them to the bug report [15:41] Ursinha: yes, that would be great === salgado is now known as salgado-lunch [16:31] intellectronica: I finally managed to convince my internet to edit the bug 341766 [16:31] Launchpad bug 341766 in malone "AttributeError OOPS when receiving data from apport on +filebug" [Undecided,New] https://launchpad.net/bugs/341766 [16:31] I placed there all oopses I could find [16:31] this year [16:31] Ursinha: thanks muchly! [16:32] intellectronica: my pleasure! :) [16:32] oh, were there ones from previous years? [16:32] so, basically, this isn't a very recent thing? [16:32] yes, but very rare [16:32] unfortunately not :( [16:35] intellectronica: talking about apport, another one, but this is quite frequent: bug 329908 [16:35] Launchpad bug 329908 in malone "DownloadFailed OOPS when reporting a bug with apport" [Undecided,New] https://launchpad.net/bugs/329908 [16:38] Ursinha: happy days === matsubara is now known as matsubara-lunch === salgado-lunch is now known as salgado === matsubara-lunch is now known as matsubara === mrevell is now known as mrevell-dinner === thumper_laptop is now known as thumper === salgado is now known as salgado-afk