=== mwhudson_ is now known as mwhudson === jelmer__ is now known as jelmer === jelmer is now known as Guest85315 === Guest85315 is now known as jelmer === salgado-afk is now known as salgado === salgado is now known as salgado-lunch [16:01] ahem [16:01] #startmeeting [16:01] Meeting started at 10:01. The chair is Ursinha. [16:01] Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] [16:01] me [16:01] Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. [16:02] [TOPIC] Roll Call [16:02] New Topic: Roll Call [16:02] Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! [16:02] :) [16:02] me [16:02] me [16:02] me [16:02] rockstar, Chex, ping [16:02] me [16:02] me but team lead call is winding down [16:02] gary_poster, ok, so half-me :) [16:02] :-) [16:02] me [16:03] gary_poster, want to have another person to join in your behalf? [16:03] sinzui, guess your case is the same as gary_poster's [16:03] me [16:03] I am attending two meetings [16:03] Ursinha: no, I think I need to multitask :-) thank you though [16:03] sinzui, you're a ninja === salgado-lunch is now known as salgado [16:03] gary_poster, ok, thanks :) [16:04] stub and rockstar are missing, they can join later, I suppose [16:04] [TOPIC] Agenda [16:04] New Topic: Agenda [16:04] * Actions from last meeting [16:04] * Oops report & Critical Bugs & Broken scripts [16:04] * Operations report (mthaddon/Chex/spm/mbarnett) [16:04] * DBA report (stub) [16:04] * Proposed items [16:04] [TOPIC] * Actions from last meeting [16:04] New Topic: * Actions from last meeting [16:04] * Chex to follow up with thumper about the multiple git import failures on the importd [16:04] * matsubara to talk to bugs team about https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1439EB784 and file a bug on oops-tools to handle LaunchpadTimeoutError correctly [16:04] https://lp-oops.canonical.com/oops.py/?oopsid=1439EB784 [16:04] * filed bug 495609, haven't talked to bugs team about it yet [16:04] Launchpad bug 495609 in oops-tools "api timeouts should be in the timeouts section" [High,Fix released] https://launchpad.net/bugs/495609 [16:04] * matsubara to add +filebug timeout oopses to the bug report [16:04] * added [16:04] * matsubara to email stub about the DBA report [16:04] * emailed [16:04] Chex, what do you say about your item? [16:05] all the others are ok [16:05] So I spoke with Thumper about this, and he is aware of the issue, and has been trying to talk to the bzr team about this. [16:05] He suggested that I also file a bug to track this issue, which I am working on doing now. [16:05] thanks Chex [16:06] [action] Chex to file a bug about the multiple git import failures on the importd [16:06] ACTION received: Chex to file a bug about the multiple git import failures on the importd [16:06] moving on [16:06] [TOPIC] * Oops report & Critical Bugs & Broken scripts [16:06] New Topic: * Oops report & Critical Bugs & Broken scripts [16:06] == OOPS report == [16:06] sadly the partial oops reports aren't ready yet, because automated generation is disabled and it takes about 4 hours for the lpnet one to complete [16:06] the script is still running on devpad since I put it to work about 3 hours ago [16:06] I know this is a performance problem that will be worked on by matsubara when he returns in January [16:06] danilos, answering your earlier question, I don't think it's possible to have the old oops-tools easily, because it was changed to record oopses in the database instead of merely parsing the oops files (the new oops-tools, called oops-db) [16:06] https://lp-oops.canonical.com/oops.py/?oopsid=db [16:06] BUT I'll talk to matsubara to see if there's something we can do about it, besides fixing the performance/locks problems in this new version (using the older version only to have partial summaries, for instance) [16:07] thanks ubottu :P [16:07] in this meantime I'll do some investigation myself [16:07] also, as soon as I have a list of oopses for lpnet, I'll let you all know - should be in one hour or so (hopefully) [16:07] and sorry about that [16:08] == failing scripts == [16:08] all scripts that were failing last week haven't failed today (karma-update, allocate-revision-karma and a few others) [16:08] I'll keep watching for the next days to be sure the problem is fixed [16:08] == critical bugs == [16:08] there's currently one critical bug, bug 495250 [16:08] sinzui, is this really critical? I see it's targeted to 3.1.13 now [16:08] Launchpad bug 495250 in launchpad-registry "there goes the neighbourhood (launchpad is getting owned by spammers)" [Critical,In progress] https://launchpad.net/bugs/495250 [16:08] YES IT IS [16:08] sinzui, do you have plans to try to include it in a reroll? [16:09] Ursinha: we need to see this on staging and give it a good review, so we decided to pursue this as a CP, not for roll out [16:09] Ursinha: There is a small change for a reroll [16:09] sinzui, right, thanks for the info [16:09] Ursinha, still, we just discussed it during TL call and we feel we should still try to use the old version; it can't be that hard to go through bzr log and come up with an older version [16:09] Ursinha: Chex is putting the branch on staging now [16:09] danilos, that's what I'll work on to figure out [16:09] that was about oops tools, sorry [16:09] Ursinha, thanks [16:09] danilos, I got it :) [16:10] sinzui, good [16:10] danilos, are we planning to have a reroll? [16:10] Ursinha, no re-roll unless OOPS summaries or we see hordes of people complaining about something on #launchpad [16:11] [action] Ursinha to try to come up with an older working version of oops-tools (non oops-db version) [16:11] https://lp-oops.canonical.com/oops.py/?oopsid=db [16:11] ACTION received: Ursinha to try to come up with an older working version of oops-tools (non oops-db version) [16:11] https://lp-oops.canonical.com/oops.py/?oopsid=db [16:11] sinzui: that branch is there now [16:11] danilos, right, as I expected [16:11] \o/ [16:11] :) [16:11] ok, thanks everyone [16:11] [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett) [16:11] New Topic: * Operations report (mthaddon/Chex/spm/mbarnett) [16:12] * Ursinha waves to Chex [16:12] I wonder if I'm still connected [16:12] Ursinha, you are not [16:13] danilos, thanks [16:13] Chex don't want to talk with us :) [16:13] sorry folks [16:13] LOSA report for this week: [16:13] The LP 3.1.12 roll-out was yesterday. The rollout went well overall, but there were some issues that we are continuing to address. Please see the Incident report here: https://wiki.canonical.com/IncidentReports/2009-12-16-Launchpad-Rollout [16:13] - LP read-only mode had issues during the rollout last night. [16:13] - The LP librarian has been adjusted so that we should be fine for space over the holidays. [16:14] - Importd bug on code-branches being left behind: [16:14] : https://bugs.edge.launchpad.net/launchpad-code/+bug/497569 [16:14] Ubuntu bug 497569 in launchpad-code "code imports are not cleaned up on disk after an import times out" [Undecided,New] [16:14] and thats all for us this week. [16:15] anything for Chex? [16:15] ok, cool [16:15] thanks Chex [16:15] [TOPIC] * DBA report (stub) [16:15] New Topic: * DBA report (stub) [16:15] well, stub isn't here so I'll mail him about the report [16:15] [action] Ursinha to send one email to stub about the db report [16:16] ACTION received: Ursinha to send one email to stub about the db report [16:16] [TOPIC] * Proposed items [16:16] New Topic: * Proposed items [16:16] none in the page, does anyone have something? [16:16] I'll take this as a no :) [16:17] Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. [16:17] Happy holidays and see you all next year! [16:17] #endmeeting [16:17] Meeting finished at 10:17. [16:17] thanks everyone [16:17] thanks Ursinha [16:18] Ursinha: thank you. (stub is on vacation and will be back Dec 21) [16:18] oh I have an lpnet summary! weeeee [16:18] https://devpad.canonical.com/~ursula/lpnet-oops.html [16:18] danilos, ^ [16:19] Ursinha, thank you === salgado is now known as salgado-afk [22:15] who knows about GPG key?