/srv/irclogs.ubuntu.com/2010/12/10/#launchpad-dev.txt

wgrantCan someone please throw https://code.launchpad.net/~wgrant/launchpad/bug-522800-getFileByName/+merge/43159 at EC2? Julian ran it overnight with one failure, which I've fixed.00:14
LPCIBotProject devel build (286): STILL FAILING in 3 hr 12 min: https://hudson.wedontsleep.org/job/devel/286/00:56
LPCIBotLaunchpad Patch Queue Manager: [bug=620458,00:56
LPCIBot629804] [r=gmb][ui=none][bug=629804] Back out hack to serve00:56
LPCIBotrestricted files directly from the internal restricted librarian port.00:56
=== Edwin-afk2 is now known as EdwinGrubbs
lifeless=== Top 10 Time Out Counts by Page ID ===02:12
lifeless    Hard / Soft  Page ID02:12
lifeless      68 / 4938  Archive:+index02:12
lifeless      44 /    0  Person:EntryResource:retractTeamMembership02:12
lifeless      42 /  190  BugTask:+index02:12
lifeless      37 /  307  Distribution:+bugs02:12
lifeless      24 /  263  POFile:+translate02:12
lifeless      14 /   18  DistroSeries:+queue02:12
lifeless      11 /  367  Distribution:+bugtarget-portlet-bugfilters-stats02:12
lifeless      11 /   39  Milestone:+index02:12
lifeless       9 /   79  ProjectGroupSet:CollectionResource:#project_groups02:12
lifeless       9 /   33  RootObject:+login02:12
wgrantlifeless: Hmm, that's very odd.02:30
pooliei hope that's a bot not really robert :)02:59
mwhudsonyou only think there's a difference03:01
poolie:)03:02
lifelessshould I feel complemented or insulted03:03
lifelesswgrant: whats odd abou tit03:03
wgrantlifeless: So few Archive:+index timeouts.03:03
lifelesswgrant: we've had the odd 'good' day03:04
lifelesswgrant: the soft timeouts are pretty consistent - many K03:04
wgrantlifeless: True.03:04
* wgrant still needs someone to EC2 that regression-fix branch.03:04
lifelessis it all gtg? commit message set etc etc etc03:10
pooliedoes "number of affected users" now total up across dupes?03:13
=== almaisan-away is now known as al-maisan
adeuringgood morning08:39
mrevellHola09:19
wgrant... and the award for the revision with the most reviewers goes to r10047.09:33
=== jkakar_ is now known as jkakar
=== al-maisan is now known as almaisan-away
bigjoolsjml: hi, I'll be ready for our call in 5 minutes11:29
jmlbigjools: np11:30
jmlbigjools: I'm on the strategerie on mumble11:30
bigjoolsjml: ok, I only just got back from my hospital appt.  I now need drugs and coffee.11:30
jmlbigjools: understood.11:30
=== Ursinha-afk is now known as Ursinha
deryckMorning, all.12:11
LPCIBotYippie, build fixed!12:16
LPCIBotProject devel build (287): FIXED in 3 hr 36 min: https://hudson.wedontsleep.org/job/devel/287/12:16
=== Ursinha is now known as Ursinha-afk
=== Ursinha-afk is now known as Ursinha
=== almaisan-away is now known as al-maisan
* beuno waves at deryck 14:15
beunoare but attachments on private bugs, private?14:15
beunoIIRC, there is such a thing as a private librarian14:15
=== mrevell_ is now known as mrevell
deryckhi beuno.  was on call, sorry.14:17
deryckbeuno, they are indeed truly private now.  but that's a source of great pain at the moment. ;) :)14:17
beunoderyck, pain for whom?  :)14:18
deryckbeuno, private attachments aren't available over the api at the moment.  accept for an exception made for apport and the retracers.14:18
deryckexcept, rather14:18
beunoderyck, ah, gotcha14:18
beunoI don't think we need to get them through the api14:19
deryckbeuno, btw, I'm very supportive of the cdn idea and getting a yui loader going. willing to help rockstar as he works on it.14:19
deryckbeuno, we need it desperately on lp14:19
beunoderyck, awesome, I'm going to push for something canoni-wide if it gets traction, otherwise build something for u1 and slowly push it out for other teams14:20
deryckbeuno, yeah, we'll definitely take it up.  the 1.3Mb js file is killing us now.14:21
beunoderyck, still carrying mochikit?14:21
=== matsubara is now known as matsubara-lunch
deryckbeuno, yes, we are.  but I don't think it adds much.  yui itself is 1Mb.  lazr-js is the other largest bit.14:23
beunoderyck, so, FWIW, I manually build a YUI combo file and brought it down to ~500kb14:23
beunoinstead of bringing in all of the -min files in YUI14:24
deryckbeuno, I had a little play at that and didn't have much luck.  but I could be including something we really don't need.14:24
deryckI'm working on this over the next several weeks, so I look at that again.14:24
beunoderyck, well, what I did, is use their online combo generator14:24
beunohttp://yui.yahooapis.com/combo?3.2.0/build/yui/yui-min.js&3.2.0/build/oop/oop-min.js&3.2.0/build/event-custom/event-custom-min.js&3.2.0/build/attribute/attribute-min.js&3.2.0/build/pluginhost/pluginhost-min.js&3.2.0/build/base/base-min.js&3.2.0/build/classnamemanager/classnamemanager-min.js&3.2.0/build/dom/dom-min.js&3.2.0/build/dom/dom-style-ie-min.js&3.2.0/build/event/event-min.js&3.2.0/build/node/node-min.js&3.2.0/build/widget/widget-min.j14:25
beunooooooops!14:25
beunosorry14:25
beunothat covered 95% of yui14:25
beuno476kb14:26
beunoso I use that as the YUI file, and tack on the rest of our js14:26
beunoI have *no* idea why it differs so much from compressing it from the tree14:26
beunoyou can play with it here: http://developer.yahoo.com/yui/3/configurator/14:28
rockstarderyck, could you pipe in on the list about the CDN as well then?14:30
beunorockstar, I was thinking we could also just proxy yui's cdn14:33
beunowith https14:33
rockstarbeuno, maybe, but then we can't get to lazr-js or our own deps.14:34
beunoright14:34
deryckrockstar, yeah, I was planning to.14:36
=== Ursinha is now known as Ursinha-lunch
EdwinGrubbsderyck: how do I attach a bug to a series as opposed to a milestone in the UI?14:43
deryckEdwinGrubbs, target to release link.14:43
sinzuihelp. I created a new error type and provides a useful message for users, but the page shows the errors docstring. the TALES is just "structure error"14:43
EdwinGrubbsthanks14:43
deryckEdwinGrubbs, np14:43
=== Ursinha-lunch is now known as Ursinha
jcsackettsalgado: ping.15:58
* deryck is getting excited about the BugJam next week16:00
Ursinhaabentley_, hi16:01
Ursinhaor abentley, hi16:01
abentleyUrsinha, hi.16:01
=== beuno is now known as beuno-lunch
sinzuijml, mumble?16:01
jmlsinzui: yes16:02
Ursinhaabentley, about bug 688092, do you have an example of how qa-tagger failed when you tried running that locally?16:02
_mup_Bug #688092: It's too hard to start hacking on qa-tagger <qa-tagger:New> <https://launchpad.net/bugs/688092>16:02
abentleyUrsinha, not offhand, but I can get one for you.16:03
Ursinhathanks abentley, that would be useful16:03
Ursinhawhen you create something it's hard to identify things you should explain to others16:03
abentleyUrsinha, sure.  I've been there.16:04
salgadohi jcsackett16:06
jcsacketthi salgado. i'm working on the distribution mirror prober, and it looks like you've been the busiest in it.16:06
jcsacketti'm wondering if you can help me figure out some issues i've introduced in trying to fix a bug.16:07
jcsackettbug 68103416:07
_mup_Bug #681034: UnknownURLScheme raised running distributionmirror-prober script <oops> <Launchpad Registry:In Progress by jcsackett> <https://launchpad.net/bugs/681034>16:07
salgadojcsackett, sure, I can try.  although I haven't touched it in a while.  can it be in 15'?16:07
jcsackettsalgado: fifteen works just fine. gives me time to get stuff together so i can ask better questions. :-)16:08
salgadocool. :)16:08
pcjc2hen running a local launchpad instance (for bug import testing), I want to wipe it and start again. make schema has wiped most things, but I can't run the bug import script a second time - it claims the bugs have already been imported16:21
pcjc2http://launchpad.dev:58080/93/sB5xaCAHZcRjyaqsZrDH2sV7pCj.txt (the bug has already been imported)16:21
salgadojcsackett, I'm ready16:23
jcsackettsalgado, awesome.16:23
jcsackettso, the problem in the bug is that on the machine being probed, there is a redirect, which we can't really do anything about. but it's causing an oops because unsupported url's trigger an exception.16:23
jcsacketti'm trying to change the prober to simply log the bad redirect so a human can look at it, and move on with triggering the oops.16:24
jcsackettsalgado: this was my naive attempt: https://pastebin.canonical.com/40796/16:24
jcsackettthe problem is that the prober system is more complex than i expected, and i can't seem to find a way to do this that escapes the redirect method without having a timeout across the tests for the prober. :-(16:24
jcsackettso: short question: do you have any ideas of how to tackle this? sinzui suggested refactoring the prober to test redirection before actually doing it. i tried that as well, and simply caused further timeouts.16:25
salgadojcsackett, can I see the diff as well?16:25
jcsackettah, yes, one sec salgado.16:25
jelmerderyck: ^16:26
deryckpcjc2, hey, there is a .pickle file somewhere in the tree you need to remove.  I think it's called bugmap.pickle.16:27
deryckjelmer, thanks! :-)16:27
pcjc2ok, cool16:27
pcjc2bug-map.pickle16:28
pcjc2thanks so much16:28
deryckbzr st should turn it up.16:28
deryckright, that's it16:28
jcsackettsalgado: https://pastebin.canonical.com/40800/16:28
pcjc2need to ask some questions at some point about the possibility of munging inline "bug 1423312" from the old SF bug reports to match new LP numbers16:28
pcjc2(Would require changes of code on the LP import scripts), or possibly just have the format converter pick up on "Bug 412312", and turn it into a string which won't get auto-linked to a random LP bug)16:29
_mup_Bug #412312: Implement Songbird support <daemon> <songbird> <Panflute:Fix Released by kuliniew> <https://launchpad.net/bugs/412312>16:29
jcsackettsalgado: my sense tells me the issue i'm running into is the callback stuff and the interaction between the prober and all the twisted machinery behind it. but that may just be suspicion born of ignorance.16:29
deryckpcjc2, you'll have to get any changes to the importer back upstream to us, since we'll actually run the import.  Or sed your export file to change the form of the old link.16:31
deryckor old text, rather16:31
pcjc2I understand16:31
pcjc2Any changes which require mapping to new LP bug numbers will have to be within the import scripts run on the LP production servers. I'm just playing locally here to tweak the SF -> LP conversion as best I can without creating too much work for the LP admins16:32
salgadojcsackett, I haven't touched this code in a while, but I suspect the timeout is because upon an UnknownURLScheme exception you don't do anything that cancels the delayed call that triggers the timeout (e.g. connect() or fail())16:34
salgadojcsackett, can you do a self._cancelTimeout(None) before your logger.error() call?16:35
jcsackettsalgado: i think i tried that, but let me give it another go.16:36
salgadoalso, self.redirection_count will always be greater than 0 there16:39
salgadoso you don't need the if/else16:39
jcsackettsalgado: good to know. the tests, however, still show a timeout error.16:41
salgadojcsackett, ok, have you pushed your changes?  that way I can merge and see what the failure looks like16:42
jcsackettsalgado: sure, i'll push it up now.16:42
jcsackettsalgado: https://code.launchpad.net/~jcsackett/launchpad/redirects-68103416:47
jcsackettsalgado: the test in question is the test in question is test_redirectawareprober_fail_on_unknown_scheme; right now that asserts that an unknown schema url exception is raised, and instead a timeout is raised. win condition is that fails because NO exception is raised. then i will figure out testing the logging.16:47
salgadojcsackett, I think I know what's going on16:49
jcsackettsalgado: lay it on me. do not spare my ego. :-P16:50
salgadounlike I previously thought, just cancelling the timeout is not enough16:50
salgadoyou have to callback() on the deferred (or errback())16:50
salgadoso you do have to fail(e) on UnknownURLScheme16:51
salgadoand on a layer above that you can catch the exception and not raise an OOPS16:51
jcsacketthm.16:51
salgadojcsackett, but we already have support for that.  see ArchiveMirrorProberCallbacks16:52
salgadoit does a failure.trap(*self.expected_failures)16:52
jcsackettsalgado: ah yes, i see.16:52
salgadoat first I thought you could add UnknownURLScheme to expected_failures16:53
salgadobut that's not a good idea16:53
jcsackettno, i would need to create a new excpetion.16:53
salgadobecause I think we want an OOPS raised when that exception is raised on the first connect() but not when it's raised in a redirect()16:53
salgadoso, yes, a new exception which you pass on to self.fail() on redirect()16:54
jcsackettsalgado: it doesn't look like ArchiveMirror uses the RedirectAware prober...the only thing using redirect is MirrorCDImageProberCallbacks16:54
jcsackettsalgado: that doesn't seem right to me, does it make sense to you?16:54
salgadothat is right16:55
salgado        # According to http://lists.debian.org/deity/2001/10/msg00046.html,16:55
salgado        # apt intentionally handles only '200 OK' responses, so we do the16:55
salgado        # same here.16:55
salgadoI think that has changed recently, but it was intentional that the archive prober doesn't use the redirect-aware factory16:56
salgados/that/apt16:56
jcsackettsalgado: ah. so then the assumption in the bug about it being redirect isn't necessarily accurate, because the RedirectAware prober wouldn't have been involved.16:57
salgadoit was not an archive mirror that caused the OOPS16:57
salgadohttps://server4.bremer-it.de/ubuntu///maverick/ubuntu-10.10-server-i386.iso16:57
salgadothat's a CD image mirror16:57
salgadoand the traceback shows it was on redirect()16:58
* jcsackett didn't understand what CD image mirror was about. i get it now.16:58
jcsackettsalgado: okay, so basically i can crib from ArchiveMirror to handle expected errors, and add that to CDImageMirror stuff.16:59
salgadooh, of course.  now I see how I mislead you16:59
salgadoyes, that's correct16:59
salgadoMirrorCDImageProberCallbacks is the one you want to change17:00
* jcsackett nods.17:00
jcsackettsalgado: thanks so much!17:00
salgadojcsackett, don't thank me before confirming it actually works. ;)17:01
jcsackettsalgado: fair. :-)17:01
jmlflacoste: ping17:01
flacostehi flacoste17:01
* flacoste talks to himself17:02
flacostejml: hi17:02
jmlflacoste: mumble!17:02
=== deryck is now known as deryck[lunch]
=== beuno-lunch is now known as beuno
=== salgado is now known as salgado-brb
EdwinGrubbsbenji: do you know if there is a way to override devmode without changing the launchpad.conf or creating a new config directory specified by the LPCONFIG env var?17:19
benjiEdwinGrubbs: hmm, let me see17:20
benjiEdwinGrubbs: I don't see a way.  We could fairly easily add command-line config overrides to bin/run if needed.17:33
EdwinGrubbsbenji: do you want me to open a bug for that?17:34
benjiEdwinGrubbs: if it's something you need, sure!17:35
=== benji is now known as benji-lunch
=== deryck[lunch] is now known as deryck
jmlg'bye all. See you again on the 20th.18:06
EdwinGrubbsderyck: ping18:08
deryckhi EdwinGrubbs18:11
EdwinGrubbsderyck: I'm working on the milestone +index page for distros, projects, and project groups. These pages list the bugs assigned to the milestone that do not have a conjoined master. For project groups, it's possible that a bug is on a milestone one of the projects and on the devfocus series for another project? Would this count as having a conjoined master? The old code did not count it, but my optimization started doing it as a18:15
EdwinGrubbsside effect.18:15
* deryck is reading, processing that....18:16
deryckEdwinGrubbs, I honestly don't know if that counts as a conjoined master.  It shouldn't as I understand conjoined bugtasks, but there may be a bug there.18:16
deryckEdwinGrubbs, or do you mean "is it okay if they're conjoined after this work?"18:17
EdwinGrubbsderyck: I really don't understand the workflow around this to know why we don't want bugs attached to the devfocus series to show up on the milestone page. yes, I mean, "is it ok?"18:18
=== salgado-brb is now known as salgado
salgadojcsackett, did it work?18:18
jcsackettsalgado: seems to. i'm refactoring some code to properly trap things and cleanup some other details, but this seems to be the right path.18:19
salgadocool!18:19
jcsackettsorry i didn't ping you earlier; got wrapped up in pursuit of the solution. :-)18:19
jcsackettthanks again!18:19
salgadonp; glad it worked18:20
deryckEdwinGrubbs, I don't know why we wouldn't want it either.  I think the bug should appear if a task has linked the milestone....18:20
deryckEdwinGrubbs, as to your issue, are the two projects on different tasks on the same bug?18:21
EdwinGrubbsderyck: yes, so the bug would show up on the milestone page for one of the projects but not for the other one.18:21
deryckEdwinGrubbs, ah, that's fine with me.18:22
EdwinGrubbsderyck: so, you don't think anyone will complain that milestone X on one of the projects has the bug, but milestone X on the project group doesn't because a differ project has it linked to the devfocus series?18:24
deryckEdwinGrubbs, ah, right.  yes, that would be wrong.  hard to get my head around it.18:25
EdwinGrubbsderyck: ok, that's fine.18:26
* deryck will brb, rebooting18:28
=== al-maisan is now known as almaisan-away
=== benji-lunch is now known as benji
=== abentley_ is now known as abentley
=== matsubara is now known as matsubara-brb
=== matsubara-brb is now known as matsubara
=== matsubara is now known as matsubara-afk
=== Ursinha is now known as Ursinha-afk
=== Ursinha-afk is now known as Ursinha
flacostembarnett: still around?23:26
=== Ursinha is now known as Ursinha-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!