| === salgado-afk is now known as salgado | ||
| === salgado is now known as salgado-brb | ||
| === salgado-brb is now known as salgado | ||
| === salgado is now known as salgado-lunch | ||
| === salgado-lunch is now known as salgado | ||
| barry | Rinchen: sigh. why is the last mootbot log for launchpad-meeting dated 10-jul? | 18:49 |
|---|---|---|
| sinzui | That looks right to me | 18:49 |
| Rinchen | barry, it's manual update. I'll go poke the owner if he's around | 18:49 |
| barry | Rinchen: thanks | 18:50 |
| Rinchen | #startmeeting | 19:00 |
| Rinchen | Welcome to this week's Launchpad development meeting. For the next 45 minutes or so, we'll be coordinating Launchpad development. | 19:00 |
| MootBot | Meeting started at 13:02. The chair is Rinchen. | 19:00 |
| MootBot | Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] | 19:00 |
| Rinchen | [TOPIC] Roll Call | 19:00 |
| MootBot | New Topic: Roll Call | 19:00 |
| bigjools | me | 19:00 |
| abentley | me | 19:00 |
| matsubara | me | 19:00 |
| sinzui | me | 19:00 |
| Rinchen | you! | 19:00 |
| mpt | me | 19:00 |
| barry | me | 19:00 |
| thumper | me | 19:00 |
| adeuring | me | 19:00 |
| allenap | me | 19:00 |
| mars | me | 19:00 |
| BjornT | me | 19:01 |
| bac | me | 19:01 |
| intellectronica | me | 19:01 |
| flacoste | me | 19:01 |
| jtv | me | 19:01 |
| rockstar | me | 19:01 |
| intellectronica | Rinchen: gmb apologises. he's traveling back oop north from london | 19:01 |
| bigjools | Celso and Muharem send their apologies in an unpologetic kind of way | 19:01 |
| Rinchen | apologies from mrevell, statik, and Edwin | 19:01 |
| leonardr | me | 19:01 |
| salgado | me | 19:01 |
| Rinchen | releases team is here | 19:01 |
| flacoste | Foundations is here | 19:01 |
| thumper | Code is here | 19:02 |
| Rinchen | looks like bugs is here | 19:02 |
| herb | me | 19:02 |
| Rinchen | mthaddon, ping | 19:02 |
| kiko | me | 19:02 |
| mthaddon | me | 19:02 |
| Rinchen | OSAs are here | 19:02 |
| Rinchen | and the 1 man soyuz team is here | 19:02 |
| Rinchen | super | 19:02 |
| Rinchen | [TOPIC] Agenda | 19:03 |
| MootBot | New Topic: Agenda | 19:03 |
| Rinchen | * Next meeting | 19:03 |
| Rinchen | * Actions from last meeting | 19:03 |
| Rinchen | * Oops report (Matsubara) | 19:03 |
| Rinchen | * Critical Bugs (Rinchen) | 19:03 |
| Rinchen | * Bug tags | 19:03 |
| Rinchen | * Operations report (mthaddon/herb/spm) | 19:03 |
| Rinchen | * DBA report (stub) | 19:03 |
| Rinchen | * Sysadmin requests (Rinchen) | 19:03 |
| Rinchen | * New packages required (salgado) | 19:03 |
| Rinchen | * A top user-affecting issue (mrevell) | 19:03 |
| Rinchen | * Doc Team report (mrevell) | 19:03 |
| Rinchen | No doc team or user issues today though | 19:03 |
| kiko | even I'm here today! | 19:03 |
| Rinchen | [TOPIC] Next meeting | 19:03 |
| MootBot | New Topic: Next meeting | 19:03 |
| Rinchen | OSCON is next week | 19:03 |
| mars | Foundations/Commercialization sprint is next week | 19:04 |
| Rinchen | kiko and I won't be able to run the meeting next week. We have a session to be in | 19:04 |
| Rinchen | anyone want to run the mtg next week? | 19:04 |
| * kiko volunteers flacoste! | 19:05 | |
| kiko | oh, he's at a sprint. | 19:05 |
| kiko | mpt? :) | 19:05 |
| flacoste | kiko: well, if I host the meeting, you can be sure that all sprinters will attend :-) | 19:05 |
| mpt | sure, I don't mind | 19:05 |
| flacoste | but mpt is such a cool host! | 19:05 |
| Rinchen | thanks mpt | 19:05 |
| kiko | and a great 2.0 UI hacker too it turns out! | 19:06 |
| Rinchen | so next week, same time, same channel | 19:06 |
| Rinchen | allenap, sinzui - I missed your items in the agenda but we'll do them. | 19:06 |
| Rinchen | [TOPIC] Actions from last meeting | 19:06 |
| MootBot | New Topic: Actions from last meeting | 19:06 |
| sinzui | Rinchen: I know you did | 19:06 |
| Rinchen | none | 19:06 |
| Rinchen | [TOPIC] Oops report (Matsubara) | 19:06 |
| MootBot | New Topic: Oops report (Matsubara) | 19:06 |
| matsubara | Today's oops report is about bugs 249543 | 19:07 |
| ubottu | Launchpad bug 249543 in rosetta "Too many queries to render +products-with-translations page" [Undecided,New] https://launchpad.net/bugs/249543 | 19:07 |
| matsubara | jtv: can you take that one for next week? | 19:07 |
| kiko | it's our highest query count, which means congratulations to everybody else who worked hard to fix the other pages that were hurting us | 19:07 |
| jtv | matsubara: OK | 19:08 |
| Rinchen | +10 kiko | 19:08 |
| matsubara | yes, huge congrats to the team. current edge oops summary shows 3 hard timeouts and lpnet's only ~40. | 19:08 |
| kiko | and of course congrats to rosetta who managed to move to being an outlier when it comes to timeouts :) | 19:08 |
| kiko | storm n all! | 19:08 |
| Rinchen | anything else for matsubara? | 19:09 |
| matsubara | Rinchen: no, I'm done. thanks everyone | 19:09 |
| jtv | kiko: 2 soft ones a day, I believe :) | 19:09 |
| matsubara | and thank you jtv | 19:09 |
| kiko | matsubara, can we get a report with the slowest pages? | 19:09 |
| Rinchen | [AGREED] jtv to investigate bug 249543 | 19:09 |
| MootBot | AGREED received: jtv to investigate bug 249543 | 19:09 |
| ubottu | Launchpad bug 249543 in rosetta "Too many queries to render +products-with-translations page" [High,New] https://launchpad.net/bugs/249543 | 19:09 |
| Rinchen | thanks matsubara and jtv | 19:09 |
| kiko | matsubara, i.e. create a new section and finally get rid of the hard/soft timeout sections? | 19:09 |
| kiko | the section would have Time Page ID and N (7?) Sample OOPSes | 19:10 |
| kiko | and a page ID would only appear once | 19:10 |
| kiko | maybe 10 slowest pages | 19:10 |
| matsubara | kiko: yes, I'll give it a shot on that next week the latest | 19:10 |
| kiko | cool | 19:10 |
| Rinchen | [TOPIC] Critical Bugs (Rinchen) | 19:10 |
| MootBot | New Topic: Critical Bugs (Rinchen) | 19:10 |
| Rinchen | Bug 248691 and bug 196364 | 19:10 |
| ubottu | Launchpad bug 248691 in launchpad "Many pages are mostly blank in Internet Explorer 7" [Critical,In progress] https://launchpad.net/bugs/248691 | 19:10 |
| ubottu | Launchpad bug 196364 in rosetta ""Upload a file" link available when I don't have permission" [Critical,In progress] https://launchpad.net/bugs/196364 | 19:10 |
| kiko | matsubara, we should also add more OOPS samples to the time out count summary table we have there | 19:10 |
| Rinchen | mpt and jtv - how are you coming with these? | 19:11 |
| mpt | Rinchen, 248691 is already fixed, I just haven't got to the PQM message in my Inbox yet. | 19:11 |
| Rinchen | k, thx mpt | 19:11 |
| jtv | Rinchen: mine didn't quite make it in yesterday, so have to resubmit when PQM's open. (Problems fixed up already) | 19:11 |
| Rinchen | fantastic. | 19:11 |
| Rinchen | thanks gents | 19:11 |
| Rinchen | [TOPIC] Bug tags | 19:12 |
| MootBot | New Topic: Bug tags | 19:12 |
| Rinchen | no new ones this week | 19:12 |
| Rinchen | [TOPIC] Operations report (mthaddon/herb/spm) | 19:12 |
| MootBot | New Topic: Operations report (mthaddon/herb/spm) | 19:12 |
| herb | Several times over the last week an app server has died and left a stale pidfile lying around. See Bug #247227. | 19:12 |
| herb | On a couple of occasions in the last week we've had to restart codebrowse. Codebrowse wasn't responding and had grown > 1.5GB resident. | 19:12 |
| ubottu | herb: Bug 247227 on http://launchpad.net/bugs/247227 is private | 19:12 |
| herb | Yesterday we rolled out the new UI to production. Woohoo! | 19:12 |
| herb | Bug #224623, high load on the DB server, crept up last week while the LOSAs were sprinting. This is at least the 5th time in the last 4 months. If there is anything else we can to do help isolate the problem, please let us know. | 19:12 |
| ubottu | herb: Bug 224623 on http://launchpad.net/bugs/224623 is private | 19:12 |
| herb | that's it from Tom, Steve and me unless there are any questions. | 19:13 |
| Rinchen | herb, is there any more detail/logs from the pidfile issue that can be added to the report? | 19:13 |
| mthaddon | Rinchen, it's repeatable in a dev environment, so I don't think too much else could be given | 19:14 |
| kiko | herb, does the appserver dying vary? | 19:14 |
| Rinchen | mthaddon, I didn't know that. Thanks. | 19:14 |
| mthaddon | Rinchen, kiko: per sinzui's comment | 19:14 |
| herb | Rinchen: We pulled the access logs, launchpad log and nohup.out and there's nothing jumping out. | 19:14 |
| herb | kiko: does it vary in what sense? | 19:14 |
| kiko | herb, i.e. not always the same instance/server? | 19:14 |
| kiko | mthaddon, sinzui's comment? | 19:15 |
| herb | kiko: ah, yes. it does vary. different servers, different times. | 19:15 |
| kiko | mthaddon, did mwhudson or someone on code fix the new codebrowse up enough to get it deployed? | 19:15 |
| kiko | herb, gotcha. | 19:15 |
| mthaddon | kiko, on the bug report | 19:15 |
| sinzui | I'm mistaken for everyone now. I have become the generic LP developer | 19:15 |
| thumper | kiko: we are running the new codebrowse | 19:15 |
| mthaddon | kiko, yes | 19:15 |
| kiko | thumper, hmmm, I was hoping that memory would be less of an issue with the new code | 19:16 |
| thumper | it is | 19:16 |
| thumper | but obviously not enough | 19:16 |
| mthaddon | kiko, thumper: as far as we can tell, it could be mysql browsing that kills it | 19:17 |
| kiko | hmm | 19:17 |
| thumper | hmm | 19:17 |
| mthaddon | or certain large branches... | 19:17 |
| mthaddon | mwhudson would know more, though | 19:17 |
| thumper | probably inefficiencies in the code | 19:17 |
| kiko | okay | 19:17 |
| kiko | should look into that, don't want us showing off for 2.0 and CB going legs up :) | 19:18 |
| thumper | will do | 19:18 |
| Rinchen | anything else for the OSAs? | 19:18 |
| Rinchen | thanks herb and mthaddon | 19:19 |
| Rinchen | [TOPIC] DBA report (stub) | 19:19 |
| MootBot | New Topic: DBA report (stub) | 19:19 |
| Rinchen | no stub today | 19:19 |
| * Rinchen sighs. | 19:19 | |
| Rinchen | [ACTION] Rinchen to email stub for DBA report | 19:19 |
| MootBot | ACTION received: Rinchen to email stub for DBA report | 19:19 |
| jtv | Rinchen: religious holiday here. | 19:19 |
| kiko | jtv, last I checked stub wasn't religious. | 19:20 |
| jtv | kiko: but the country he lives in is. | 19:20 |
| Rinchen | [TOPIC] Sysadmin requests (Rinchen) | 19:20 |
| Rinchen | Is anyone blocked on an RT or have any that are becoming urgent? | 19:20 |
| MootBot | New Topic: Sysadmin requests (Rinchen) | 19:20 |
| Rinchen | [TOPIC] New packages required (salgado) | 19:21 |
| MootBot | New Topic: New packages required (salgado) | 19:21 |
| salgado | anything for me this week? | 19:21 |
| salgado | guess not | 19:22 |
| Rinchen | k | 19:23 |
| Rinchen | skipping mrevell's sections this week | 19:23 |
| Rinchen | [TOPIC] When is AccountStatus.SUSPENDED? How are bad users such as spammers locked out? - sinzui | 19:23 |
| MootBot | New Topic: When is AccountStatus.SUSPENDED? How are bad users such as spammers locked out? - sinzui | 19:23 |
| sinzui | I sent an email to the launchpad list for the LOSA and LP developers to look at today. I'm concerned that we have not clearly marked the accounts of bad users we want to suspend. | 19:23 |
| sinzui | https://bugs.edge.launchpad.net/launchpad/+bug/246320. | 19:23 |
| ubottu | sinzui: Error: This bug is private | 19:23 |
| sinzui | I have a script that will update these accounts, and a replacement script to use when we want to suspend an account. | 19:23 |
| matsubara | Rinchen: sorry, he mailed me asking to do the user-affecting section for hiom | 19:23 |
| matsubara | him | 19:23 |
| sinzui | There is a third script that I think is a starting point for identifying broken accounts that we need to fix. These accounts are in an consistent state. We need to decide what state they should be in. | 19:23 |
| Rinchen | matsubara, ok, we'll come back to that then. Thanks | 19:24 |
| Rinchen | sinzui, I currently believe having a clear delineation between deactivated and suspended is needed. | 19:24 |
| Rinchen | For normal folks who deactivate, we want them to be able to reactivate | 19:25 |
| sinzui | Last week we saw about 3000 accounts in an inconsistent state | 19:25 |
| Rinchen | for bad folks, like spammers, we want them banned. | 19:25 |
| Rinchen | That's my interpretation at least. | 19:25 |
| sinzui | mthaddon: provide me with the script that we have used. It is not good enough, but it did a very good job of clearly marking who we intended to SUSPEND. | 19:26 |
| sinzui | I would like to get the SUSPENDED accounts really suspended this week | 19:27 |
| Rinchen | sinzui, was your intent at today's meeting to seek a +1 on the need for delineation? | 19:27 |
| flacoste | i think he was looking for a +1 on running his scripts | 19:27 |
| sinzui | Rinchen: last week was to understand the deliniation | 19:27 |
| sinzui | This week I'm in the position to offer a plan to fix the accounts. | 19:28 |
| kiko | I am +1 on fixing the inconsistent data | 19:29 |
| Rinchen | me too. +1 | 19:29 |
| kiko | I also am happy that you've taken on the matter of clarifying this SUSPENDED stuff which looks half-baked | 19:29 |
| Rinchen | +1 to kiko's comment | 19:29 |
| sinzui | fab | 19:29 |
| Rinchen | any objections? | 19:29 |
| herb | sinzui: you have email. | 19:30 |
| Rinchen | ok, moving on | 19:30 |
| sinzui | hate mail? | 19:30 |
| Rinchen | [TOPIC] Can we respond better to user questions raised in Answers? See the thread in launchpad@ and launchpad-users@. - allenap | 19:30 |
| MootBot | New Topic: Can we respond better to user questions raised in Answers? See the thread in launchpad@ and launchpad-users@. - allenap | 19:30 |
| allenap | Hobbsee observed that 11 questions (in Answers) against Launchpad had expired because the LP staff hadn't addressed them. | 19:30 |
| Rinchen | allenap, I answered this publicly | 19:30 |
| herb | sinzui: nope. just letting you know how we handle things currently. | 19:30 |
| Rinchen | releases team will start to do some of this | 19:30 |
| allenap | Rinchen: I know, I'm getting to that. | 19:30 |
| allenap | It struck me as strange that we weren't all answer contacts for Launchpad, so I wrote to the launchpad@ list. Some good responses, but it was all kind of summed up in Rinchen's reply to sinzui's statement that "the Release Team should be answer contacts". | 19:30 |
| kiko | Rinchen, allenap: the solution to this is to have support rotations. | 19:30 |
| allenap | Rinchen said: "... this is actually on my roadmap to begin when my second triage resource arrives and is trained up. So, a few weeks." | 19:30 |
| Rinchen | I also agree with kiko that we should at least try the support rotations | 19:31 |
| allenap | But I think intellectronica's idea of a weekly report (from Rinchen's triager?) was good. | 19:31 |
| kiko | we should not try | 19:31 |
| Rinchen | re: community help spec from Dec | 19:31 |
| kiko | we should DO a rotation | 19:31 |
| kiko | batching is nonsense, IMO | 19:31 |
| abentley | kiko: Channeling your inner yoda? | 19:31 |
| kiko | we should just make sure that there's somebody on-call at least once every 24h period | 19:31 |
| kiko | so that when I go on vacation | 19:32 |
| kiko | support requests still get answered! | 19:32 |
| kiko | abentley, I try. oops. I mean I do. | 19:32 |
| intellectronica | we could do it like we do with on call reviews | 19:32 |
| kiko | yes! | 19:32 |
| Rinchen | intellectronica, yeah, that's a similar vein to community help | 19:32 |
| Rinchen | https://launchpad.canonical.com/JoeyStanford/CommunityHelpRotation | 19:33 |
| intellectronica | ah ok, i'll need to catch up with that spec. joey thinks about everything | 19:33 |
| allenap | Rinchen: IIRC, there was some resistance to that... or is that new? | 19:34 |
| kiko | allenap, there was some resistance from stub, and I'm fine with him opting out. | 19:34 |
| allenap | :) | 19:34 |
| Rinchen | what kiko said | 19:34 |
| allenap | intellectronica had another good idea: an announcer on IRC. | 19:34 |
| Rinchen | it's still in draft which is why it's under my name | 19:34 |
| Rinchen | but it's been though through quite a bit | 19:34 |
| kiko | allenap, I think that technology alone won't fix this problem :) | 19:34 |
| allenap | kiko: I agree, but it can prevent the issue from being forgotten. | 19:35 |
| intellectronica | kiko: no, but it will raise awareness. people are more likely to fix the problem then | 19:35 |
| mpt | We used to have an announcer for bug reports | 19:35 |
| kiko | intellectronica, I disagree, because we already have users on #launchpad today that come in and ask questions which go unanswered. | 19:35 |
| kiko | so no, I don't think this is a problem that an announcer will fix. an announcer might make the on-call support person's task easier, though -- less polling. | 19:36 |
| allenap | kiko: But I don't get a *ping* when someone asks on IRC. | 19:36 |
| kiko | allenap, just make #launchpad always flash blue when a line with a question mark appears? :) | 19:36 |
| intellectronica | kiko: that's what i meant. announcing alone will not solve anything - there needs to be somewhere there waiting for the announcement eagerly | 19:36 |
| kiko | right | 19:36 |
| allenap | xchat could ping me when answer-bot sends a message. | 19:36 |
| kiko | aaaanyway. on-call support FTW. :) | 19:37 |
| allenap | +1 | 19:38 |
| intellectronica | cool. how do we go about setting that up? | 19:38 |
| Rinchen | I re-re-re-publish the spec.... | 19:38 |
| allenap | intellectronica: Do you mean the on-call or the announcer. I'd imagine that the on-call is still in Rinchen's court for now. | 19:38 |
| Rinchen | team leads discuss with teams | 19:38 |
| Rinchen | and I figure out a way to do scheduling | 19:39 |
| Rinchen | if we had one person take it per month... | 19:39 |
| Rinchen | everyone could choose the same day and seek coverage | 19:39 |
| Rinchen | We could also give this air time at the upcoming TL's meeting in August | 19:39 |
| intellectronica | Rinchen: i think it should be more along the lines of person per weekly shift, like reviews | 19:39 |
| intellectronica | anyway, i can respond to your spec, once i read it :) | 19:40 |
| kiko | intellectronica, it can be once a month for the whole team, actually -- we have a large team | 19:40 |
| kiko | Rinchen, I think we should JFDI | 19:40 |
| Rinchen | intellectronica, either way is fine. :-) Reply back. | 19:40 |
| Rinchen | another item back on my todo list :-) thanks allenap ;-) | 19:40 |
| sinzui | On-call reviews work, we should have on-call answers using the same kind of rotor | 19:40 |
| allenap | Rinchen: Apologies ;) | 19:40 |
| Rinchen | it's all good | 19:41 |
| flacoste | kiko: +1 on JFDI | 19:41 |
| intellectronica | sinzui: i also think so. we have a ready made process that works very well | 19:41 |
| Rinchen | we need to do this...which is why I have a spec for it :-) | 19:41 |
| sinzui | intellectronica: agreed | 19:41 |
| flacoste | Rinchen: place a schedule up on the wiki and let people place their name on it | 19:42 |
| Rinchen | [AGREED] JFDI on https://launchpad.canonical.com/JoeyStanford/CommunityHelpRotation | 19:42 |
| MootBot | AGREED received: JFDI on https://launchpad.canonical.com/JoeyStanford/CommunityHelpRotation | 19:42 |
| allenap | Does anyone know who created the bug announcer? | 19:42 |
| Rinchen | allenap, yes I do | 19:42 |
| Rinchen | allenap, there are 2 of them actually | 19:42 |
| intellectronica | allenap: wasn't it mneptok? | 19:42 |
| Rinchen | yes plus seveas | 19:42 |
| * Rinchen wants to move on | 19:42 | |
| allenap | Cool, thanks. | 19:43 |
| Rinchen | [TOPIC] A top user-affecting issue - matsubara | 19:43 |
| MootBot | New Topic: A top user-affecting issue - matsubara | 19:43 |
| matsubara | Some users reported permission issues while using Launchpad. More specifically a team ownership change reported by Hobbsee and a review request for a branch reported by Odd Bloke. I'll investigate those further and file bugs/contact the appropriate teams. | 19:43 |
| matsubara | that's all | 19:43 |
| matsubara | if anyone have any news regarding that, please let me know | 19:43 |
| kiko | I saw this problem myself | 19:43 |
| Rinchen | cool, we called this out on -code earlier as well | 19:44 |
| kiko | is this unrelated to the issue joey was telling me about, the team transitivity issue? | 19:44 |
| salgado | kiko, do you have a traceback? | 19:44 |
| abentley | matsubara: I asked Odd_Bloke for details but got no response. | 19:44 |
| matsubara | of all people, you shouldn't have any permission problems kiko :-) | 19:44 |
| kiko | salgado, nope, but I'm sure I can try and reproduce on staging | 19:44 |
| salgado | kiko, that'd be great -- I couldn't reproduce it | 19:45 |
| thumper | request review is being looked at | 19:45 |
| thumper | we know what the problem is | 19:45 |
| thumper | and jml has a branch with fix | 19:45 |
| salgado | thumper, which branch is that? | 19:45 |
| matsubara | cool. thanks thumper, abentley and jml | 19:45 |
| kiko | wooo | 19:45 |
| thumper | will request CP once finished and reviewed | 19:46 |
| Rinchen | Anything else before close the meeting? | 19:46 |
| matsubara | Rinchen: not from me. | 19:46 |
| thumper | salgado: to fix the "request review" fubar | 19:46 |
| thumper | salgado: probably still on his laptop right now | 19:46 |
| Rinchen | ok then! | 19:47 |
| Rinchen | Thank you all for attending this week's Launchpad Developer Meeting. See the channel topic for the location of the logs. | 19:47 |
| Rinchen | #endmeeting | 19:47 |
| MootBot | Meeting finished at 13:49. | 19:47 |
| salgado | thumper, ok, will chase him later | 19:47 |
| kiko | aha | 19:47 |
| Rinchen | ps the mootbot logs are not updating | 19:47 |
| barry | Rinchen: i know :( | 19:47 |
| kiko | ps this was a fun meeting after all! | 19:47 |
| Rinchen | I'll be pasting in an IRC log until the bot is kicked | 19:47 |
| intellectronica | thanks Rinchen | 19:47 |
| === salgado is now known as salgado-afk | ||
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!