/srv/irclogs.ubuntu.com/2008/06/05/#launchpad-meeting.txt

=== Moot2 is now known as MootBot
=== mrevell is now known as mrevell-lunch
=== salgado-afk is now known as salgado
=== kiko-afk is now known as kiko
=== mrevell-lunch is now known as mrevell
=== kiko is now known as kiko-fud
=== salgado is now known as salgado-lunch
=== salgado-lunch is now known as salgado
=== salgado is now known as salgado-afk
=== mthaddon_ is now known as mthaddon
=== salgado-afk is now known as salgado
Rinchenhello MootBot!18:56
statikis mootbot back?18:57
Rinchenit is18:57
Rinchenit was working yesterday18:58
Rinchenso we shall see today18:58
statikvery cool18:58
Rinchenthe re-write from eggdrop to ubottu hasn't happened yet but it planned18:58
statikmwhudson_: I'm loving the new import system, I get email notifications as new revisions come in!18:58
kiko-fudmeee18:59
Rinchenyep, his ntp server is fixed18:59
* Rinchen crosses his fingers19:00
Rinchen#startmeeting19:00
MootBotMeeting started at 13:01. The chair is Rinchen.19:00
MootBotCommands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]19:00
Rinchenwoot!19:00
Rinchen[TOPIC] Roll Call19:00
MootBotNew Topic:  Roll Call19:00
Rinchenme19:00
gmbme19:00
schwukme19:00
abentleyme19:00
matsubarame19:00
herbme19:00
mptme19:00
barryme19:00
stubme19:00
statikme19:00
salgadome19:00
bacme19:00
adeuringme19:00
sinzuime19:00
intellectronicame19:00
allenapme19:00
jtvme19:00
danilosme19:00
Rinchenmrevell ?19:00
mrevellme19:00
cprovme19:00
vednisme19:00
EdwinGrubbsme19:00
Rinchenthumper?19:00
salgadoflacoste, leonardr?19:01
kiko-fudmeeee19:01
flacosteme19:01
=== vednis is now known as mars
leonardrme19:01
BjornTme19:01
marsme again19:01
kiko-fudme19:01
=== kiko-fud is now known as kiko
flacosteRinchen: foundations is complete19:01
kikoI'm the most me a me can be19:01
Rinchenthanks flacoste, releases is here too19:01
Rinchenallenap?19:01
allenapme19:02
statikRinchen: lpcomm is all here19:02
thumperme19:02
Rinchengreat thanks19:02
allenapabel is missing.19:02
BjornTno, he's not19:02
intellectronicano, he's adeuring, i think19:02
adeuringno, I'm here19:02
bigjoolsme19:02
allenapoh yeah, sorry :)19:02
Rinchenbigjools?19:02
Rinchenah gotcha19:02
Rinchenthanks19:02
Rinchenok.19:02
Rinchen[TOPIC] Agenda19:02
MootBotNew Topic:  Agenda19:02
rockstarme19:03
Rinchen * Next meeting19:03
Rinchen * Actions from last meeting19:03
Rinchen * Oops report (Matsubara)19:03
Rinchen * Critical Bugs (Rinchen)19:03
Rinchen * Bug tags19:03
Rinchen * Operations report (mthaddon/herb)19:03
Rinchen * DBA report (stub)19:03
Rinchen * Sysadmin requests (Rinchen)19:03
Rinchen * New packages required (salgado)19:03
Rinchen * A top user-affecting issue (mrevell)19:03
mthaddonme19:03
Rinchen * Doc Team report (mrevell)19:03
Rinchen[TOPIC] Next meeting19:03
MootBotNew Topic:  Next meeting19:03
Rinchenbtw apologies received from SteveA19:03
Rinchensame time same day next week?19:03
Rinchenanyone know they will not be able to attend?19:04
statikI won't be here for the meeting next week19:04
Rinchen[AGREED] same time next week. Apologies from statik19:04
MootBotAGREED received:  same time next week. Apologies from statik19:04
Rinchen[TOPIC]  Actions from last meeting19:04
MootBotNew Topic:   Actions from last meeting19:04
Rinchenone, and it was completed19:05
Rinchen[TOPIC] Oops report (Matsubara)19:05
MootBotNew Topic:  Oops report (Matsubara)19:05
matsubaraToday's oops report is about bugs 236425, 22830719:05
ubottumatsubara: Bug 236425 on http://launchpad.net/bugs/236425 is private19:05
matsubarasinzui, how's #236425 fix coming?19:05
matsubaraschwuk, any news about 228307?19:05
sinzuimatsubara: it is in PQM19:05
matsubaraflacost, I've seen a couple of CyclicalTeamMembershipError. isn't that one fixed?19:06
schwukmatsubara: not yet19:06
matsubaracool. thanks sinzui19:06
sinzuimatsubara: about 18 hours form landing :(19:06
schwukmatsubara: but the hwdb oops are continuing19:06
Rinchenit must be coming from New Zealand19:07
salgadomatsubara, CyclicalTeamMembershipError? where did you see them?19:07
matsubaraschwuk: yeah, I wonder if the UploadFailed errors are related19:07
matsubarasalgado: https://devpad.canonical.com/~matsubara/oops.cgi/2008-05-31/F125419:07
salgadooh, when reassigning?19:07
schwukmatsubara: most likely19:07
matsubaraschwuk: hmm I'll add those errors to the timeout report then. thanks19:08
salgadomatsubara, hadn't seen that one, but I was expecting them to show up19:08
matsubarasalgado: +editproposedmember, I'll follow up with you after the meeting then19:08
matsubaraRinchen: I'm done. Thanks19:09
salgadook19:09
matsubarathanks everyone19:09
Rinchenthanks matsubara19:09
Rinchen[TOPIC] Critical Bugs (Rinchen)19:09
MootBotNew Topic:  Critical Bugs (Rinchen)19:09
Rinchen[LINK] https://bugs.edge.launchpad.net/launchpad/+bug/23708619:09
RinchenStale PID - mars, how are you coming with this?19:09
MootBotLINK received:  https://bugs.edge.launchpad.net/launchpad/+bug/23708619:09
ubottuRinchen: Error: This bug is private19:09
ubottuMootBot: Error: This bug is private19:09
marsRinchen, the fix should be running right now19:09
Rinchenexcellente19:09
Rinchenthanks19:09
Rinchen[TOPIC] Bug tags19:09
MootBotNew Topic:  Bug tags19:09
Rinchenwe have no new requests19:10
Rinchen[TOPIC] Operations report (mthaddon/herb)19:10
MootBotNew Topic:  Operations report (mthaddon/herb)19:10
herbFriday (2008-05-30) we did the re-roll. Since then, we've had one CP for r6407 on Monday (2008-06-02). We have one CP, r6410, waiting for approval.19:10
herbA branch with configs for the restricted librarian is in the queue at the moment. The directory has been set up on the server. We're just waiting for the branch to land.19:10
herbWe've started work on the Debian import machine.19:10
herbWe had an issue occur Tuesday (2008-06-02). A spike in load on the production DB server caused performance problems with LP. The site became so slow it was virtually unresponsive. Seems similar to the bug filed back in April: Bug #224623.19:10
ubottuherb: Bug 224623 on http://launchpad.net/bugs/224623 is private19:10
Rinchen[LINK] http://launchpad.net/bugs/22462319:10
MootBotLINK received:  http://launchpad.net/bugs/22462319:10
ubottuRinchen: Error: This bug is private19:10
ubottuMootBot: Error: This bug is private19:11
herbthat's it from Tom and me unless there are questions.19:11
Rinchenherb, was there any more data from Tuesday that can be added to the bug report?19:12
Rinchenherb, without more definition I don't think stub can narrow it down19:12
herbRinchen: there are the debug logs that we typically get.  I can throw them in there.19:12
Rinchenherb, ok, please do. stub can evaluate if it need further detail after he views them19:13
herbI'm happy to try to collect more info if the problem occurs again.  Just would need some direction as to what would be helpful.19:13
Rinchenbtw, herb and mthaddon, I really like the format you use for your report.19:13
Rinchenstub, any words of wisdom here?19:13
stubNo - I haven't found where the debug logs are yet.19:13
Rinchenok.  thanks19:14
cprovherb: thanks for start working on the gina-machine.19:14
herbstub: I'll attach it to the bug above.19:14
mthaddonstub, on hackberry in ~postgres/logs19:14
RinchenAny questions for herb and mthaddon?19:14
herbcprov: thank mthaddon, he's been heading that up.19:14
Rinchenthanks herb19:14
cprovmthaddon: thanks ;)19:14
Rinchen[TOPIC] DBA report (stub)19:14
MootBotNew Topic:  DBA report (stub)19:14
cprovwhat about the restricted librarian ?19:14
mthaddoncprov, see above19:14
cprovmthaddon: duh, sorry, I missed that.19:15
mthaddon:)19:15
stubhttps://bugs.edge.launchpad.net/ubuntu/+source/slony1/+bug/236749 is blocking me testing a low downtime PG 8.3 upgrade procedure. If we can't get a package built, we either need to do a manual install (with the crappy workarounds for hardy mentioned in the bug report) or take the downtime hit.19:15
stubBoth Abel and Danilo are having similar Unicode issues at the moment, where the DB is running in the C locale so lower() doesn't always give correct results.19:15
ubottuLaunchpad bug 236749 in slony1 "No PostgreSQL 8.2 (or earlier) packages" [Undecided,New]19:15
Rinchen[LINK] https://bugs.edge.launchpad.net/ubuntu/+source/slony1/+bug/23674919:15
MootBotLINK received:  https://bugs.edge.launchpad.net/ubuntu/+source/slony1/+bug/23674919:15
stubI need to investigate if there are still functional index bugs in PostgreSQL that will stop us using them as the solution to their problems.19:16
kikostub, why don't we use slony on 8.3?19:16
stubBecause that doesn't help us migrating from 8.2 -> 8.3.19:16
kikostub, how much time is the upgrade going to take if we do it cold turkey?19:17
stubPG 8.2 needs stored procedures built and installed for it, and so does PG 8.3 to do the migration between versions19:17
stub3 or 4 hours19:17
stubBut we will have the same issue next major release too probably, and by then we will have high availability systems.19:17
kikostub, sure, but we /will/ have slony for 8.3 right?19:18
stubI suppose.19:19
kikostub, I will talk to pitti and doko and see if either of them can help. if not, we should just take the downtime.19:19
kikoit's no use waiting for too long on this.19:19
stubI'm thinking for the 8.3->8.4 migration. We need slony for two versions of PG installed to do the migration.19:19
kikosure19:19
kikoonce you have 8.3 running, you can install slony for it19:19
stubYes - it isn't blocking the migration. Just blocking being able to do it without much downtime.19:20
kikostub, if we do decide to upgrade postgresql without slony, why don't we do it at the same time mthaddon and herb schedule the upgrade of our systems to hardy?19:20
stubWe already have PG 8.3 with slony installed.19:20
kikocool19:20
mthaddonkiko, that's a lot of moving parts, but a possibility...19:20
kikomthaddon, herb: any news on the hardy updates, btw? that just rang a bell!19:20
stubThat timing would be fine. The main DB server is already running hardy.19:20
mthaddonkiko, we're working through the low impact ones, and once we're ready to move ahead with the others will get a schedule together19:20
kikomthaddon, well, yes, but moving parts that are pretty distinct -- i.e. no LP code will change, just the DB and the frontends19:21
mthaddontrue19:21
stubJust more to debug if it all falls in a heap ;)19:21
kikothat is true19:21
stubBut that would never happen19:21
Rinchenanything else for stub?19:21
kikomthaddon, so, any ETA at all for that downtime?19:21
kikostub, yes!19:21
kikoperson-auth-split, for 1.2.6, yes/no?19:21
mthaddonkiko, not yet - I'll try and get you something by the end of the week (a time scheduled, I mean)19:22
stubgone through review and ready to land. yes.19:22
kikostub, I'm asking you because I think you're not aware of our likely post-1.2.6-rollout process19:22
kikoneither is anyone else outside of people on yesterday's call of course19:22
stubIts only the first section though - the whole thing has huge scope. But the data model will all be in place.19:22
kikobut we're unlikely to do any DB patches for 1.2.719:22
kikothat's cool and what I was hoping for19:22
kikothanks stub19:22
Rinchenanything else for stub?19:23
kikomthaddon, thanks. it needs to be within the next 3 weekends I guess19:23
Rinchenpopular guy today19:23
kikomthaddon, or then only in august19:23
mthaddonkiko, yep19:23
kikonah19:23
kikotoda19:23
Rinchen[TOPIC] Sysadmin requests (Rinchen)19:23
RinchenIs anyone blocked on an RT or have any that are becoming urgent?19:23
MootBotNew Topic:  Sysadmin requests (Rinchen)19:23
kikoRinchen, I reminded RT of one to remove some old bazaar repos still public19:24
kikoit's an old one poolie asked for19:24
kikothumper, will we need any RTs for upgrading bzr?19:24
thumperkiko: I think it is just a normal rollout for LP, or are you referring to other machines?19:25
RinchenI saw the thread. If you get no reply to it soon I'll go make myself more visible to IS19:25
cprovboth soyuz-related requests are in-progress (restricted-librarian and gina), thank you.19:25
Rinchenwe have 1 RT for the bzr-beta already19:25
kikothumper, both19:25
thumperkiko: as Rinchen says, there is one for bzr-beta already, and I don't think we'll need one for LP19:26
kikookay, thanks.19:26
Rinchennifty.  Anything else for this topic?19:26
Rinchen[TOPIC] New packages required (salgado)19:26
MootBotNew Topic:  New packages required (salgado)19:26
salgadoanything to add this week?19:26
kikosalgado, maybe something to remove. do we currently depend on bzrtools?19:27
salgadoisn't shelf in bzrtools?19:27
Rinchenkiko, thumper submitted an rt to remove that19:27
Rincheniirc19:27
thumperI don't think we do depend on it19:27
thumperbut many have it installed19:27
salgadothere's no launchpad-d* packages which depend on it, btw19:27
Rinchen(remove from source that is)19:27
mptI have launchpad-developer-dependencies but not bzrtools19:28
kikosalgado, yes, it can be part of -developer-dependencies, but not of -dependencies, because it has a bug in the shelf test suite19:28
stubPG8.3 has been done now, which is good.19:28
kikookay, cool19:28
kikothumper, is there a bug filed for the bzrtools bug, btw? would be nice to get that fixed for intrepid..19:28
thumperkiko: abentley is aware, but not sure if there is a bug filed19:28
Rinchenanything else for salgado?19:29
abentleykiko: A fix has already been committed to trunk.19:29
statikabentley, like the rest of the bzr team, fixes things almost before we notice them!19:30
kikoheh19:30
kikoRinchen, no, thanks19:30
Rinchenok, I think it's time for us to kick off the Matt Revell show....staring... mrevell19:30
Rinchen[TOPIC] A top user-affecting issue (mrevell)19:30
MootBotNew Topic:  A top user-affecting issue (mrevell)19:30
mrevellheh :)19:30
mrevellOn Sunday, there was an issue with Bazaar branch hosting for branches using the knit format.19:30
mrevellThis led to a discussion about the best way to communicate service-affecting issues to people who use and rely on Launchpad.19:30
mrevellThe outcome is that we have set up a launchpad-announce list. This will be very low volume - service-affecting issues and release announcements only. All mail to the list is held for moderation and only appropriate messages will get through.19:30
mrevellI shall be announcing the, err, announcements list shortly.19:31
jtvlaunchpad-meta-announce?19:31
mrevellIf you have something that must be announced to our users please ping me or, in my absence, RInchen19:31
kikomrevell, we should make it so /everybody technical/ at canonical subscribes19:31
kikomrevell, I'll talk to mdz about this19:31
mrevellkiko: Okay, thanks.19:31
Rinchena bit taboo but we could subscribe the distro-team list :-)19:32
mrevellRinchen: You'd wanna get some flame-retardent gear on first :)19:32
kikoeww19:32
mrevellRinchen: Unless anybody has a comment on that, or the Bazaar hosting outage itself, that's that for me.19:32
Rinchenthanks mrevell19:32
Rinchen[TOPIC] Doc Team report (mrevell)19:32
MootBotNew Topic:  Doc Team report (mrevell)19:32
mrevellAnd the limelight calls again19:32
mrevellI'm pleased to say that community contributions to the doc team and growing slowly in number. We have a couple of community members who are now actively filing bugs for things they find in the help wiki and who are diving right in and making changes themselves.19:32
mrevells/and growing/are growing19:33
mrevellOther docs news: tour is progressing and I have another meeting with Mark and the designers next week. I have mailed team leads to ask for confirmation of the items I've selected for 1.2.6 what's new and release announcement. Thanks to those who've already responded.19:33
mrevellThanks Rinchen19:33
kikoawesome19:33
kikowoo!19:33
Rinchengood stuff, thanks mrevell19:33
mptWhen is the tour due to land?19:33
mrevellmpt: it might be easier to answer that after my meeting with SEM and Mark on Wednesday19:34
mptok19:34
Rinchenwe have a recent addition to the agenda....19:34
Rinchen[TOPIC] Storm Integration19:34
MootBotNew Topic:  Storm Integration19:34
Rinchenkiko!19:34
kikoheh19:34
kikofirst, I want to thank BjornT for knocking off 100 minutes from PQM test run times19:35
mpt(otherwise known as "the gathering storm")19:35
kiko(nothing to do with storm of course)19:35
* Rinchen cheers.19:35
kikoerr19:35
kikoextra zero there, and then some19:35
thumper100?19:35
kikobut YKWIM19:35
kikoa lot19:35
kikohttps://devpad.canonical.com/~mthaddon/pqm-durations.png19:35
kikoetc19:35
jtvHurray for BjornT!19:35
RinchenYeah, it now takes PQM -20 minutes to run.19:35
mthaddonnice drop off :)19:36
kikothumper, funny you speak up, because I wanted to ask you if you are getting rid of buildbot anytime soon -- it currently is tested against launchpad because it adds lib/ to its path19:36
thumperkiko: yes we are19:36
kikothumper, alternatively, do you know if we can avoid running buildbot tests when LP lands?19:36
flacosteBjornT: what happened, you turned off all bugs tests?19:36
flacosteoh19:37
flacostethe sourcecode dependancy...19:37
flacostethat took 20mins, amazing...19:37
Rinchen10 mins...19:37
Rinchenmy joke missed the audience19:37
thumperRinchen: I got it19:38
kikothumper, well, ok. when you remove that we'll knock a few minutes off, so that's great to hear.19:38
kikoflacoste didn't :)19:38
kikookay19:38
kikonow for the real storm topic19:38
kikothumper, flacoste, jtv, statik: did you guys ack that list I sent out?19:38
flacostekiko: seems sane to me19:38
jtvkiko: didn't ack it yet, will do when I wake up19:38
thumperalready knocked quite a few off19:38
kikoI haven't seen any email back on that topic so I want to make sure something  is happening19:38
kikothumper, you are the man19:38
stubThere where some pillarname ones I would have thought I would have, but if statik wants them he is welcome to them :)19:38
statikkiko: yep, edwin started looking at it already. funny, i get a lot more tests failing locally than in the report, but we're diggin ito it19:39
thumperthere is a test dependancy issue thought19:39
kikojtv, please have a call with jamesh when you get up to sort yours out, I'm unhappy you didn't start on that today19:39
statikstub: we might send you mail later :)19:39
thumpermany run fine by themselves19:39
kikostatik, very cool, thanks so much19:39
thumperbut fail when run with everything19:39
thumpersomething is stomping on the db configs19:39
kikothumper, yeah, need to isolate which one is fscking us over!19:39
* thumper looks at sinzui for some strange reason19:39
flacostehey, sinzui isn't responsible for all the config problems19:39
flacostejust the API19:39
sinzuithumper: et al. mutating the config is bad for testing19:39
kikothumper, the problem is tests that write to the configs don't reset them19:40
thumperyeah, I know19:40
stubWe have an API for config problems?19:40
kikoheh19:40
flacostewe have APIs for everything19:40
kikookay19:40
kikojtv, ack?19:40
sinzuiI think we need to switch to the push() and pop() form of the config and raise an error when someone tries to create a new attribute on the conifg.19:40
jtvkiko: sure19:40
stubpickle the config in the layer testSetUp, pickle it in the layer testTearDown and compare.19:40
kikothanks vm19:40
flacostesinzui: i think that's a little drastic change for our schedule19:41
flacostei say only plug the hole, not redo the whole plumbing19:41
* sinzui checks the weekend schedule.19:41
flacostelol19:41
kikowhat flacoste says, sinzui -- don't get carried away!! :)19:41
kikookay, that was all19:41
kikoRinchen, take over before it's too late!19:41
RinchenThank you all for attending this week's Launchpad Developer Meeting.19:41
flacostesinzui: did they open that crystal meth lab in you 'hood lately?19:42
Rinchen#endmeeting19:42
MootBotMeeting finished at 13:43.19:42
thumperthanks Rinchen19:42
kikothe crystal19:42
gmbthanks Rinchen19:42
abentleytx Rinchen19:42
Rinchenhehe19:42
sinzuiflacoste: It went up in smoke when the try knocked out the power lines on my street yeterday19:42
flacosteRinchen: thank for another one on time19:42
Rinchennow i Just need to find out where mootbot put the logs :-)19:42
sinzuiI am relying on an infant to keep me awake19:42
flacostesinzui, that's probably a little healthier19:43
=== mars is now known as vednis
=== vednis is now known as mars
mwhudson_statik: oh good :)21:32
=== kiko is now known as kiko-afk
=== thumper-office is now known as thumper
=== salgado is now known as salgado-afk
=== mwhudson_ is now known as mwhudson

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!