=== thumper_laptop is now known as thumper === mrevell is now known as mrevell-lunch === salgado-afk is now known as salgado === mrevell-lunch is now known as mrevell === salgado is now known as salgado-brb === salgado-brb is now known as salgado === salgado is now known as salgado-lunch === salgado-lunch is now known as salgado === mrevell_ is now known as mrevell [18:08] hey gmb, leonardr, barry: I have a minor sound problem that I'm working to fix [18:09] mrevell: i have a question. is this going to be edited later? i'm expecting a package within the next hour [18:09] so i may need to take a short break [18:09] leonardr: Yeah, it'll be edited later. I think it'll only take ten to fifteen mins [18:10] cool [18:12] this is all on the assumption that I can get my audio problem sorted [18:12] mrevell: brb [18:13] mrevell: ready [18:14] sorry barry, I've had to find another laptop and am waiting for it to boot === vednis is now known as mars [18:49] matsubara, are you going to be the host? [18:49] Ursinha: yes [18:49] great [19:00] #startmeeting [19:00] Meeting started at 13:00. The chair is matsubara. [19:00] Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE] [19:00] [TOPIC] Roll Call [19:00] New Topic: Roll Call [19:00] meme [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:00] me [19:01] me [19:01] em [19:01] Releases is here [19:01] me [19:01] TLs please check if your team members are here [19:01] rockstar: ping [19:01] allenap and intellectornica are off today [19:01] are the TLs here, is the real question? ;) [19:01] thanks BjornT [19:01] rest of bugs team is here [19:01] me [19:01] me [19:01] me [19:01] Code is here [19:02] Foundations is missing leonardr and EdwinGrubbs [19:02] they are being printed on milk cartons as we speak [19:02] me [19:02] bigjools, jtv: soyuz, translations? [19:02] soyuz all present [19:03] matsubara: Translations almost complete [19:03] al-maisan is excused this week [19:03] me [19:03] all right then. let's move on [19:03] [TOPIC] Agenda [19:03] New Topic: Agenda [19:03] * Next meeting [19:03] * Actions from last meeting [19:03] * Oops report & Critical Bugs (matsubara/ursinha) [19:03] * Operations report (mthaddon/herb/spm) [19:03] * DBA report (stub) [19:03] * Sysadmin requests (Rinchen) [19:03] * New packages required (salgado) [19:03] me [19:04] so next meeting same time, same channel? [19:04] +1 [19:04] YES! [19:04] done [19:04] good idea [19:04] [TOPIC] Actions from last meeting [19:04] New Topic: Actions from last meeting [19:04] * salgado to test query that fixes oops in +participation on staging and after that run the query on production db. Query approved by stub [19:04] * Ursinha to ask danilo /jtv about bug 261507 [19:04] * Ursinha to ask Bjornt about bug 252674 [19:04] * Ursinha to ask mthaddon about bug 259947 [19:04] beuno will tell us that consistency is an absolutely desireable goal :) [19:04] Bug 261507 on http://launchpad.net/bugs/261507 is private [19:04] Bug 252674 on http://launchpad.net/bugs/252674 is private [19:05] Bug 259947 on http://launchpad.net/bugs/259947 is private [19:05] matsubara, done [19:05] thanks salgado [19:05] me [19:05] matsubara, bug 261507 was workarounded and then lowered to High, danilo said that they're w [19:05] orking on the fix [19:05] Bug 261507 on http://launchpad.net/bugs/261507 is private [19:05] bug 252674, it is now in progress, cool [19:05] Bug 252674 on http://launchpad.net/bugs/252674 is private [19:05] I hate private bugs [19:05] kiko: you have the power [19:05] are these security sensitive? [19:06] i haven't spoken with mthaddon about bug 259947 yet [19:06] Bug 259947 on http://launchpad.net/bugs/259947 is private [19:06] kiko, i'm not sure of that [19:06] kiko: 261507 isn't very security sensitive [19:06] Ursinha: I don't think any of those shipit OOPSes happened again. [19:07] since last week, I mean [19:07] matsubara, no, they stopped happening [19:07] I think if you're going to list them in a public channel they had better be public [19:07] I think [19:07] kiko, +1 [19:07] +1 [19:07] an the beautiful sound of consensus [19:07] please assignees disclose your bugs if you think they're ok to be public [19:08] [TOPIC] * Oops report & Critical Bugs (matsubara/ursinha) [19:08] New Topic: * Oops report & Critical Bugs (matsubara/ursinha) [19:08] bugs for today: 259440 (MailinglistApiView), 263672, 260206 (resolve_lp_path), 260140 (revisions.atom), 160236 and 174368 (last two pretty much the same) [19:08] bug 259440, it was CP but already causing a lot of oopses in production, barry? [19:08] Launchpad bug 259440 in launchpad-foundations "OOPS in MailingListAPIView" [Critical,Fix released] https://launchpad.net/bugs/259440 [19:09] Ursinha: no more than it was, but the oops reports are much smaller now [19:09] bug 260140 bounced pqm due to conflict, resolving as we speak and resubmitting [19:09] Bug 260140 on http://launchpad.net/bugs/260140 is private [19:09] [ACTION] matsubara to add a note in the MeetingAgenda page about disclosing private bugs that will be discussed during the meeting [19:09] ACTION received: matsubara to add a note in the MeetingAgenda page about disclosing private bugs that will be discussed during the meeting [19:09] i saw a lot [19:09] Ursinha: flacoste and i have discussed further refinements to (hopefully) eliminate the oopses [19:09] barry, so it still times out, but less often? [19:09] kiko: i think so [19:09] kiko, considering the oopses, yes [19:09] but there are a lot still [19:09] kiko: many fewer queries, but the ones it does still take a long time [19:10] the resolve_lp_path was being worked on by mwhudson, I'll chase the status [19:10] thanks thumper [19:10] barry, so you're working on it? [19:10] [ACTION] thumper to chase status of resolve_lp_path bug [19:10] ACTION received: thumper to chase status of resolve_lp_path bug [19:10] thanks thumper really [19:10] Ursinha: can you open a new bug and attach some of the latest oopses? [19:10] barry, sure [19:10] [ACTION] barry to work on more refinements for MailingListAPIView bug [19:10] ACTION received: barry to work on more refinements for MailingListAPIView bug [19:10] Ursinha: not at the moment, but it's on the list! [19:11] thanks [19:11] barry, ok... i'll file the bug and send you [19:11] ok, next [19:11] bug 263672, matsubara filed this one and asked salgado about it, it seems that it belongs to Bugs. Anyone from bugs to take care of it [19:11] Launchpad bug 263672 in launchpad-foundations "account merging triggering database constraint" [Undecided,New] https://launchpad.net/bugs/263672 [19:11] maybe BjornT [19:12] anyone? [19:12] * Ursinha pokes bugs team [19:12] oh how interesting [19:12] is that a bug in the merge code I wonder? [19:12] I normally fix them [19:12] stub, salgado: is this a case in which we can't automatically handle it? [19:12] kiko: I think so [19:12] It means we have a unique constraint to handle, or handle better. [19:13] * Ursinha pokes salgado [19:13] Ursinha, stub already explained [19:13] okay so [19:13] yeah [19:13] he knows that a lot better than myself [19:13] and I think stub's volunteering [19:13] Ok [19:14] so the last one [19:14] [ACTION] stub to fix bug on account merging raising db constraint [19:14] ACTION received: stub to fix bug on account merging raising db constraint [19:14] two actually [19:14] Other people are welcome to learn how it all works though ;) [19:14] MootBot is really handy [19:14] bug 160236 and 174368, similar oopses happened yesterday. Can anyone of foundations take care of it? [19:14] Bug 160236 on http://launchpad.net/bugs/160236 is private [19:14] matsubara, indeed [19:14] these bugs are about problem when searching for bugs [19:15] bug 174368 [19:15] Launchpad bug 174368 in launchpad-foundations "Search query triggering error in tsearch" [Undecided,Confirmed] https://launchpad.net/bugs/174368 [19:15] Ursinha: that's another one for stub perhaps? [19:15] So there is this really disgusting python method embedded as a string in fti.py.... it transforms the query string a human enters into tsearch2 syntax. [19:15] stub: feel like revamping the fti regexp? [19:15] I hate revamping that. [19:15] Its a pile of poo [19:16] time for redesign maybe? [19:16] I'd love someone who knows how to do tokenization properly to have a go, but I can patch it :) [19:16] hm, good [19:16] ok [19:16] this is all for now guys [19:16] thanks a lot [19:16] stub, does jtv know how to do that? [19:16] I know he is a genius at some sorts of things [19:17] kiko: I know nothing [19:17] jtv, brownie points-- [19:17] [ACTION] stub to patch our fti regexp [19:17] Its not magic - you just need to transform (foo AND bar OR (baz AND NOT boom) to foo & bar | (baz & ! boom) [19:17] ACTION received: stub to patch our fti regexp [19:17] stub: can we talk about this, oh, tomorrow? [19:17] And probably pull out the hyphenation crack [19:18] yer [19:18] ok. moving on then. thanks Ursinha. Thanks everyone. [19:18] [ACTION] stub and jtv to discuss a proper fix to our fti regexp (bug 174368) [19:18] ACTION received: stub and jtv to discuss a proper fix to our fti regexp (bug 174368) [19:18] Launchpad bug 174368 in launchpad-foundations "Search query triggering error in tsearch" [Undecided,Confirmed] https://launchpad.net/bugs/174368 [19:18] [TOPIC] * Operations report (mthaddon/herb/spm) [19:18] New Topic: * Operations report (mthaddon/herb/spm) [19:19] • CP to xmlrpc-internal that has reduced size of xmlrpc-internal oopses [19:19] • Have begun work on migrating to new version of psycopg2 [19:19] • App servers still dying, but as above may help [19:19] • Codebrowse still having issues, but not as many as immediately after the rollout [19:19] • In the process of migrating RF branches (where possible) to be hosted on LP itself [19:19] • Any comments on jamesh' suggestion that some branches can be removed from RF? [19:19] • IS sprint next week means we'll all be in London (i.e. on the same timezone) [19:19] • That's it from the LOSA team unless there are any questions [19:19] ooooh, utf-8 bullets [19:19] If the test suite passes without em, they aren't needed [19:19] mthaddon, is psycopg2 on staging? [19:19] ah, it's the same appservers [19:20] kiko, it is, yes [19:20] mthaddon, and crashes since? [19:20] those bullets come from tomboy, I presume [19:20] kiko, hasn't crashed since [19:20] matsubara, correct! [19:20] no way! [19:20] kiko, hasn't been on that long though [19:21] still...! [19:21] I guess, I can move on then. thanks mthaddon and LOSAs [19:21] [TOPIC] * DBA report (stub) [19:21] New Topic: * DBA report (stub) [19:21] thanks guys [19:21] DB patch reviews in my queue where discussed with Mark and all approved. I'll be sending out the reviews with any necessary tweaks tomorrow. At least one has come in after the cutoff (which I haven't looked at yet). I'll see if I can get approval for it to land this cycle, but it might have to wait until next. [19:21] The read-only-launchpad branch has finally landed, yay. getUtility(IZStorm).get('main') now blows up. I need to update the wiki pages when I find them. [19:21] Done. [19:22] stub, it landed today, so we should be on the lookout tomorrow, right? [19:22] i.e. staging and edge issues [19:22] Yup [19:22] There are config changes... [19:22] stub: any formal QA we can do on it? [19:22] stub, anything we need to be aware of? [19:22] I think I got them right :) [19:22] stub, such as chokecherry is now a production machine? :) [19:22] FLW [19:22] mthaddon: Nothing you can't work out ;) [19:23] mthaddon: The appservers still only talk to a single database, despite there being config for a master and a slave [19:23] mthaddon: Which is why the connection strings should be identical [19:23] ok, cool [19:24] stub: so, no QA needed for the read-only db yet? [19:24] well [19:24] keep an eye on production [19:25] It should still work tomorrow like it does today. [19:25] that's what he meant :) [19:25] ok. thanks stub. [19:25] [TOPIC] * Sysadmin requests (Rinchen) [19:25] New Topic: * Sysadmin requests (Rinchen) [19:26] if you have any outstanding RT, let me know and I'll forward those to Joey and/or IS [19:26] now that psycopg2 is delivered and I have salgado's list [19:26] I think I'm a happy camper! [19:26] salgado, you got that yesterday mid-stream? [19:26] kiko, I did. will write the SQL to delete the unused ones today [19:27] all right, moving on then [19:27] [TOPIC] * New packages required (salgado) [19:27] New Topic: * New packages required (salgado) [19:27] anything for me this week? [19:27] I didn't hear back whether or not we need to depend on the new psycopg2 package [19:27] does anybody know for sure? I'm pretty sure we do [19:27] salgado, let's wait to see how it handles production first [19:28] ok [19:28] ok. thanks salgado [19:28] We do, or we need to revert my branch for the test suite to pass [19:28] it's already deployed on PQM [19:28] so that shouldn't be a problem [19:28] but if it's okay by monday then I say yes [19:28] just to avoid the shell-shock of downgrading [19:29] Yer, but devs who haven't updated could trip over it. [19:29] I guess stub meant for the tests to pass locally [19:29] maybe I'm being too careful? [19:29] [TOPIC] Improving review kwality - bigjools [19:29] New Topic: Improving review kwality - bigjools [19:30] stub, so is the new psycopg2 going to be a dependency on edge from tomorrow? [19:30] ok [19:30] mthaddon, unless we don't roll out.. [19:30] are you done? :) [19:30] i.e. yes [19:30] I don't think so, no. Our test suite excercises the bug now purely by accident [19:30] ah, okay [19:30] ah [19:31] So, the issue of quality of reviews came up recently [19:31] I talked to Barry and Bjorn and we have some things to propose [19:31] quality of reviews or of branches submitted to review? [19:31] reviews [19:31] interesting! [19:31] damn, busted [19:32] the upshot is that reviewers need to: [19:32] 1. ask more questions and not take the dev's word for things [19:32] 2. the reviewer should try and call the dev if it's a non-trivial branch, so they can discuss it [19:33] 3. Team leads should allow time for their members OCR in planning [19:33] (I know Francis does this already) [19:33] and lastly, we should consider doing half or 3/4 day shifts to reduce OCR workload [19:34] any questions? [19:34] I don't understand the last point [19:34] taking into account that there /will/ be review follow ups [19:34] what he said [19:34] I am all for questions and calls fwiw [19:34] full day OCR is tiring [19:34] bigjools: I have mastered asking stupid questions, does that count? [19:34] sinzui: there's no such thing as a stupid question [19:34] bigjools: yes this is. [19:35] lol [19:35] * sinzui looks for his list [19:35] bigjools, well... yes, but so is other sorts of work [19:35] bigjools, and full day OCR AIUI doesn't actually mean 8h of reviews [19:35] indeed, we should aim for half or 3/4 of work days [19:35] kiko: there should be enough reviewers to spread the load a bit more evenly [19:35] though it may feel like 12h of them :) [19:35] since there /will/ be overtime :-) [19:35] I get the feeling that some of them do the lion's share [19:35] kiko: ask sinzui about that :) [19:36] *cough* Fridays *cough* :) [19:36] fridays are overrated [19:36] every day feels like friday to me [19:36] anyway that's it from me, I just wanted to raise awareness of this issue [19:36] [ACTION] update reviewers process to account for half or 3/4 of work days for on call reviewing [19:36] ACTION received: update reviewers process to account for half or 3/4 of work days for on call reviewing [19:37] bigjools, thanks for bringing it up, more seriously. I know this bothers us from time to time and we need to address a process for review feedback [19:37] indeed [19:37] kiko: +1 [19:37] thanks bigjools. moving on. [19:37] [TOPIC] matsubara - early pre release QA [19:37] New Topic: matsubara - early pre release QA [19:37] btw, anybody can ping me any time if they want to talk about reviews they're doing or reviews they're getting [19:37] awesome [19:37] so, how's the early pre release QA coming? What do you guys think about it? Is it helping? How can Ursinha and I help more there? [19:39] has anyone done any pre-release QA? [19:39] :) [19:39] kiko: yes! [19:39] my team has [19:39] kiko, foundations, i guess [19:39] :) [19:39] * thumper raises his hand [19:39] I did! [19:39] soyuz had [19:39] yes, soyuz did. [19:39] yes. [19:39] but there are still lots of items there in NEEDSTESTING [19:39] kiko: have you, that's the question? [19:40] I haven't fixed any bugs, I'm afraid [19:40] matsubara, who are the biggest offenders? [19:40] Please do contact me or Ursinha to help with testing. [19:40] yes, please [19:40] well [19:40] I'm asking to figure out if somebody doesn't know about PRQA yet [19:41] kiko: Translations knows [19:41] kiko, matsubara sent emails to the teams [19:41] I have had no answer from code and translations [19:41] the usual culprits! easternlings [19:41] jtv, thumper: so.. you guys not doing it? [19:41] jtv, thumper: the expectation is for the tests to be done 24h from the landing [19:41] * thumper has only just landed something [19:41] kiko: yes, we just learned about it though [19:41] I'll poke the team [19:42] great thumper [19:42] thumper, thanks, please help us get everybody on the same pageeee [19:42] thanks guys, and please, if you guys are too busy with coding, let us know and we can land a pair of hand for testing stuff, but you need to let us know! [19:42] and the final topic [19:43] [TOPIC] BCTL - kiko [19:43] New Topic: BCTL - kiko [19:43] okay [19:43] I don't want to remind people of this again [19:43] but tomorrow is the deadline for BCTL [19:43] if you are confused ask your team lead [19:43] it means a lot though [19:43] kthxbye! [19:44] * beuno wonders what BCTL is [19:44] well, that's it then. thanks everyone [19:44] Thank you all for attending this week's Launchpad Developer Meeting. See the channel topic for the location of the logs. [19:44] #endmeeting [19:44] Meeting finished at 13:44. [19:44] * abentley votes for Big Chees Taco Land. [19:44] nice work matsubara [19:44] right on time! cool [19:45] Badly Coordinated Transactional Lobsters [19:45] * thumper is confused with BCTL [19:45] perhaps it is just the early morning [19:45] Big chested... No, I shan't go on [19:45] thumper: Ask your team lead.... oh... [19:45] :) [19:45] /me emails the marketing director about it [19:46] Badly Coordinated Team Leads? [19:46] lol [19:46] thumper: i think that's the one === salgado is now known as salgado-afk