/srv/irclogs.ubuntu.com/2010/12/02/#launchpad-dev.txt

mwhudsonjames_w: https://code.launchpad.net/~james-w/launchpad/export-specification-bug-links/+merge/42426 has conflicts00:02
LPCIBotYippie, build fixed!01:30
LPCIBotProject devel build (267): FIXED in 3 hr 9 min: https://hudson.wedontsleep.org/job/devel/267/01:30
LPCIBotLaunchpad Patch Queue Manager: [r=deryck][ui=none][bug=514190, 672576] Update lazr-js to 1.5DEV-r191.01:30
james_wmwhudson, so it does, thanks01:38
lifeless=== Top 10 Time Out Counts by Page ID ===04:08
lifeless    Hard / Soft  Page ID04:08
lifeless     387 / 6695  Archive:+index04:08
lifeless     155 /  482  BugTask:+index04:08
lifeless     126 /  226  Question:+index04:08
lifeless      49 /  104  RootObject:+login04:08
lifeless      39 /  247  Distribution:+bugs04:08
lifeless      37 /   50  DistributionSourcePackage:+index04:08
lifeless      33 /  283  POFile:+translate04:08
lifeless      27 /   39  Distribution:+questions04:08
lifeless      26 /  126  BranchSet:CollectionResource:#branches04:08
lifeless      26 /    0  https://api.launchpad.net04:08
lifelesswgrant: its spiking...04:08
=== lifeless_ is now known as lifeless
=== lifeless_ is now known as lifeless
poolielifeless: did you ever see05:47
poolie/usr/lib/python2.6/atexit.py:24: DeprecationWarning: Attempt to tearDown inactive fixture.05:47
poolie  func(*targs, **kargs)05:47
poolieat the end of an lp testn05:47
StevenKI keep seeing that with ec2 land and such like05:47
poolieor LayerIsolationError: Test left new live threads: [<_Timer(Thread-1, stopped 140604130006800)>]05:48
lifelessbasically05:51
lifelesszope.testing sucks05:52
lifelesslayers and reinvoking processes sucks05:52
lifelessand rather than have unclean code in the core, I'm building out a stack of clean05:52
lifelessthe downside is some things will warn05:52
poolieas long as it's not my fault :)05:53
lifelessprobably isn't05:53
lifelessthumper: was baxters keynote good ?06:06
spivlifeless: heh, trying to decide whether you'll go to SyPy tonight? :)06:06
lifelessspiv: exactly!06:06
lifelessspiv: having yak shaved the day on a modem issue + chatting with poolie.06:07
lifelessmeh, its hot, long walk isn't what I need.06:10
lifelessnot with a 4:40am - nzdst - start time.06:10
spivlifeless: I feel sleepy just thinking about that!06:11
lifelessyah06:12
thumperlifeless: yes08:06
=== almaisan-away is now known as al-maisan
adeuringgood morning08:53
mrevellMorgen08:58
adeuringmoin mrevell08:58
mrevell:)08:58
bigjoolshelleau08:59
=== matsubara-afk is now known as matsubara
salgadocan somebody running Maverick run a 'grep shared_buffers /etc/postgresql/8.4/*/postgresql.conf' for me?11:17
wgrantsalgado: shared_buffers = 28MB# min 128kB11:17
salgadowgrant, thanks.  care to also grep max_connections and tell me what you have in /proc/sys/kernel/shmmax ?11:18
wgrantsalgado: shmmax is 3355443211:18
wgrantmax_connections is 10011:19
salgadoif I have exactly that, postgres fails to start but tells me I have max_connections==103 rather than 10011:21
salgadowtf!?11:21
wgrantHah.11:22
wgrantHmm.11:22
wgrantI recall that it reserves connections for superusers.11:23
wgrantsalgado: Where are you getting the 103?11:23
salgadowgrant, the error message:11:24
salgado[2010-12-02 09:22:38 BRST] HINT:  This error usually means that PostgreSQL's request for a shared memory segment exceeded your kernel's SHMMAX parameter.  You can either reduce the request size or reconfigure the kernel with larger SHMMAX.  To reduce the request size (currently 33562624 bytes), reduce PostgreSQL's shared_buffers parameter (currently 3584) and/or its max_connections parameter (currently 103).11:24
salgadoand it's lying about shared_buffers; it's currently at 28M11:25
wgrantsalgado: #superuser_reserved_connections = 3# (change requires restart)11:25
wgrantLooks relevant.11:25
wgrantBut the docs say that should be included within max_connections.11:25
StevenK28MiB in bytes is 29360128, which is smaller than 33562624 ... Silly Postgres11:26
salgadowgrant, changing that doesn't have any effect; postgres still fails and reports 103 max_connections11:31
salgadohowever, changing max_connections causes it to start just fine11:32
salgadoreducing it from 100 to 99 is enough11:32
wgrantOdd.11:32
salgadoindeed11:32
wgrantWhich arch?11:32
salgadox86_6411:33
wgrantI'm plain i386 here.11:33
* salgado creates a fresh new cluster to see what it's going to look like11:34
salgadoby default it comes with 24MB for shared_buffers, so it starts up just fine11:36
salgadobut then if I change that to 28MB it fails11:36
salgadoand when it fails it reports the same 103 max_connections11:37
wgrantbigjools: Do we have a rebuild in our immediate future?12:06
deryckMorning, all.12:07
bigjoolswgrant: as soon as jelmer lands his fix for not leaving uploads in limbo, yes12:10
wgrantbigjools: Yay.12:10
* jelmer waves to wgrant12:11
wgrantMorning jelmer.12:12
bigjoolswgrant: something is odd with domination12:29
wgrantbigjools: Slow?12:33
wgrantFor those two tortoisehg PPAs?12:33
bigjoolswgrant: some PPA's publications don't seem to get scheduleddeletiondate set12:33
bigjoolsso they appear in the getPendingPublicationPPAs every time12:33
wgrantI haven't been near the condemnation stuff in a while.12:34
wgrantLet's see..12:34
wgrantbigjools: Do you have a specific example?12:35
bigjoolsyeah12:35
bigjoolsa few, hang on12:36
wgrantThe code looks reasonably sane.12:36
bigjoolsmirabilos/ppa is one12:36
wgrantWhich pub?12:36
bigjoolsworking it out, I mention it because it appears in the list of PPAs being processed every time12:37
bigjoolsand it's not seen any activity for ages12:37
wgrantHmm. We need to ban animated GIFs.12:37
wgrantbigjools: Do you have any idea what's going on with those two tortoisehg PPAs which take >70s to publish?12:41
bigjoolswgrant: no not yet, I suspect it's related to this issue12:42
wgrantThey only have ~850 source pubs in total...12:42
wgrantIt could be, but it seems too small.12:42
wgrantLet's see.12:42
wgrantbigjools: Are you sure that mirabilos doesn't just have some orphaned binaries?12:43
bigjoolsalso the ubuntu langpack PPA is taking 20 minutes12:43
wgrantIndices, or something else?12:43
bigjoolswill look later12:44
wgrantThe tortoisehg sources seem to all be condemned12:45
bigjoolswgrant: https://dogfood.launchpad.net/~mirabilos/+archive/ppa/+sourcepub/761302/+listing-archive-extra12:47
bigjoolshttp://pastebin.ubuntu.com/538967/12:47
bigjoolscreated and deleted without getting published12:48
wgrantProbably has orphaned binaries.12:48
wgrantThere is a bit of a race there.12:48
wgrantWe need something like NBS.12:48
wgrantYep. Binaries still published.12:50
bigjoolswhy are they still published?12:52
wgrantIt was deleted after the build uploaded, but before process-accepted ran.12:53
wgrantSo the upload was accepted, but the publications weren't there when the deletion happened.12:53
wgrantSo, in other words, custom uploads fuck the world over again :)12:53
bigjoolsawesome12:53
bigjoolscustom?12:53
wgrantCustom uploads are the only reason that the upload doesn't create the publishing records.12:54
wgrantLike it already does for sources.12:54
bigjoolsah right12:56
bigjoolsI wonder if we can do it12:56
wgrantWe do need to fix custom copies at some point, and it is the same fix...12:57
bigjoolsok so for ubuntu-langpack, we've got 2 seconds doing nothing but publishing empty Sources/Packages12:58
bigjoolsso that will be the same for all PPAs12:58
bigjoolswhat a waste12:58
wgrantAll pending PPAs.12:59
bigjoolsdomination is 2.5 minutes12:59
wgranton langpack?13:00
bigjoolsyes13:00
wgrantdomination, or judgmenet?13:00
bigjoolsboth13:00
bigjoolssuperseding processing is the long bit13:00
wgrantHmmm.13:00
wgrantA lot of that is probably the stupid cache invalidation.13:01
bigjoolshttp://pastebin.ubuntu.com/538970/13:01
bigjoolsummm13:01
bigjoolswtf13:01
bigjoolsoh ignore that13:02
wgrantIt just tried to start again?13:02
bigjoolsanyway Packages for non-existent arches take too long13:02
bigjoolsyeah it tries to start every 5 mins13:02
bigjoolsand given that we're taking 35-40m....13:02
wgrantNon-existent arches?13:02
bigjoolsyes, powerpc....????13:03
wgrantI think we need to move to using ArchiveArch even for non-virt PPAs.13:03
bigjoolswhich it then generates for each component13:03
bigjoolswhich is probably why the whole thing is like treacle13:04
wgrantRestricting that to main is trivial now.13:04
wgrant+ tests13:04
bigjoolsthat would be a *great* start13:04
wgrantI made sure to factor that out sanely in my last publisher refactor.13:04
bigjoolsjeez, 4 minutes on writing all those empty files!13:08
wgrantAre they really empty?13:08
wgrantlangpacks are arch-all.13:08
bigjoolsah maybe13:09
bigjoolsI assume too much13:09
bigjoolsrelease files, 4 seconds13:09
wgrantFor a single PPA?13:10
bigjoolsyes13:10
wgrantOuch.13:10
bigjoolscomponents ....13:10
wgrantTrue.13:10
bigjoolsif we remove non-main we'lll get a huge win13:10
bigjoolsI am going to fix this today13:11
wgrantArchive.getComponentsForSeries13:11
wgrantNot sure about tests.13:11
bigjoolswgrant: I'll send you a log snippet if you want to examine it more?13:11
bigjoolsfor a single run, with -v13:11
wgrantbigjools: I'm about to head off to bed, but I'd be glad to look tomorrow.13:12
bigjoolswgrant: yeah no rush, just thought you'd be interested :)13:12
bigjoolswgrant: so I reckon we should disallow package deletions where there's a build in progress13:21
wgrantbigjools: This situation can also arise in the normal NBS case, when a source no longer builds a binary.13:22
bigjoolswgrant: I suspect we have a bug for that13:23
bigjoolsanyway, errands and food13:23
=== matsubara is now known as matsubara-lunch
=== salgado is now known as salgado-lunch
james_wbenji, hi, could you give me some advice on the webservice?15:02
james_wbenji, we want to export the "bugs" attribute that IBugLinkTarget contributes to Specification. Currently ISpecification isn't related to IBugLinkTarget, Specification just implements(IBugLinkTarget).15:03
james_wbenji, exporting IBugLinkTarget and its bugs attribute and adding it to the webservice interfaces isn't enough, but if I then have ISpecification subclass IBugLinkTarget everything works. Is this the right thing to do, or should I use a different approach to achieve this?15:04
james_wbenji, https://code.launchpad.net/~james-w/launchpad/export-specification-bug-links/+merge/42426 for more context15:04
benjijames_w: taking a look at the MP15:06
james_wthanks15:06
benjijames_w: a digression: are you aware that the diff in that MP has conflict markers in it?15:12
james_wbenji, yup, just fixed them15:13
=== salgado-lunch is now known as salgado
=== matsubara-lunch is now known as matsubara
=== beuno is now known as beuno-lunch
benjijames_w: I haven't forgotten about you.  Sill looking.16:06
james_wthanks16:07
bigjoolsjml, leonardr: only series are derived, not distros, in the model we're doing16:22
bigjoolsthis implies a distro of course16:22
leonardrbigjools: does that mean that Natty is derived (from Ubuntu or from Maverick?), but Linaro is not? will that change anytime soon?16:24
bigjoolsleonardr: Linaro distros would be dervied from a series in Ubuntu.  Ubuntu is dervied from Debian unstable.16:26
bigjoolsleonardr: once a distro is derived it cannot be derived again, but you can keep syncing packages16:26
bigjoolswe'll track in each Ubuntu series which Debian series we sync from (it can change during LTS releases)16:27
leonardrbigjools: so, if you were to search for a bug in "ubuntu or its derivatives", you'd be searching across a lot of distribution *releases*, not distributions16:33
bigjoolsleonardr: well bugs are different in that regard because they are not targeted to distroseries16:33
bigjoolsI think for the case of bugs you can say Ubuntu or its derivatives but I've not really thought about it16:34
bigjools(and mean the whole distro, I mean)16:35
=== deryck is now known as deryck[lunch]
leonardra bug can be targeted to a distro source package, and that's associated with a distribution16:36
leonardrnot a distro series16:36
benjijames_w: I've resorted to building your branch; Do I assume correctly that test_representation_contains_bug_links fails with an attribute error?16:43
james_wbenji, my branch works for me, I'm just not sure that it's the right approach. You get the attribute error?16:44
bigjoolsleonardr: I think you'll be ok, I just wanted to ward off any incorrect assumptions in case it causes issues in the future after we finish the derived distro feature16:51
benjijames_w: nope, no error.  It sounds like all classes that implement ISpecification also implement IBugLinkTarget, if so, then your approach is fine.  If not, you should decompose IBugLinkTarget into two interfaces, one that ISpecification implementations can provide and one with the rest of the bits and IBugTarget would inherit from both of those but otherwise be empty16:56
james_wbenji, ok, thanks17:03
=== benji is now known as benji-lunch
=== al-maisan is now known as almaisan-away
sinzuiallenap, ping17:51
=== beuno-lunch is now known as beuno
=== benji-lunch is now known as benji
cody-somervillebigjools, Would it make sense to post something in topic/identica about publishing slow down? There seems to be a lot of questions about it.17:59
bigjoolscody-somerville: it's been slow for weeks17:59
cody-somervillebigjools, No disagreement here about that! :P18:00
bigjoolscody-somerville: :)  I thought it was just the high load - it is, but it's other problems too.18:00
* cody-somerville nods.18:00
bigjoolsanyway, I gotta dash18:00
cody-somervillebigjools, Cool. FYI, expect a trivial branch from me soon.18:00
bigjoolscody-somerville: great!  I'll check later.18:01
=== jcsackett is now known as jcsackett-lunch
=== jcsackett-lunch is now known as jcsackett
=== matsubara is now known as matsubara-afk
sinzuilifeless, I want to replace the launchpad.Append rules in lp.answers with launchpad.AnswerContact. The use of "Append" is ambiguous and when an object like a distros/project can have many ".Append" rules that conflict. I think .AnswerContact is clear, like Driver and BugSupervisor permissions20:21
deryckleonardr or benji, hi.  Could one of you look at bug 680339 to see if you can offer insight in what might be happening?20:24
_mup_Bug #680339: 'Entry' object has no attribute 'markAsDuplicate' <api> <Launchpad Bugs:Triaged> <https://launchpad.net/bugs/680339>20:24
benjideryck: sure20:25
deryckthanks benji!20:25
deryckthumper, hey. you want to do a call today?20:29
leonardrderyck: the thing you 'should' be doing is setting duplicate_of, but 1.0 should be allowing the old behavior for backwards compatibility20:34
leonardrone possibility is that the wrong wadl is generated for 1.020:36
leonardrif the trunk wadl is presented as the wadl for 1.0, then launchpadlib will think there is no such thing as markAsDuplicate20:36
deryckleonardr, what do you mean "old behavior?"  I'm not following what as changed, though I see what you mean about should be using duplicate_of based on the interface declarations now.20:37
lifelesssinzui: did you have a tab complete fail there?20:37
leonardrderyck: in later versions of the web service, methods like markAsDuplicate are no longer exposed as such20:38
sinzuilifeless, maybe20:38
leonardrinstead, you set duplicate_of the way you would set any other value, and it calls markAsDuplicate behind the scenes20:38
allenapsinzui: pong20:38
leonardrthe old behavior is that a mutator_for method also shows up as a named operation20:38
deryckleonardr, got you.  and this was a web service change, nothing that we on the bugs team changed?20:39
leonardrderyck: right, it is a totally general change affecting every mutator_for method20:39
sinzuiallenap, as I said in reply, our version of simplejson is too old. so I cannot HTML encode20:40
leonardri suspect you are getting the 'devel' version of the wadl when you should be getting the '1.0' version--that would tie it in to benji's recent hcnage20:40
deryckleonardr, ok.  I recall all this for the transitionToStatus, etc., but didn't make the connection here for markAsDuplicate.20:41
allenapsinzui: Ah, fair enough. It doesn't seem to be causing us bother so far so I'm not really worried.20:41
benjileonardr: I don't quite follow, will you explain that some more?20:41
allenapsinzui: Although I think I'll file a bug about it anyway.20:42
lifelesssinzui: I don't have an opinion about lp.appent/lp.answercontact until jan 4th20:42
sinzuilifeless, we have a regression. Ubuntu answer contacts cannot manage FAQs because the permission was changed from something removed to a permission that quietly conflicts with Ubuntu's rules for adding series20:43
lifelesssinzui: ok20:44
thumperderyck: hi, I'm on leave today :)20:45
thumperderyck: in fact I'm not working a Friday until Jan :)20:45
deryckwell ok then.  enjoy the leave, thumper :-)  We'll chat in Jan then ;)20:45
thumperderyck: so perhaps we could arrange a call earlier next week?/20:45
lifelesssinzui: do you need anything from me20:45
sinzuino. thanks lifeless20:45
deryckthumper, sure, let's try to find a time when next week is here.20:46
thumperderyck: ok20:46
deryckprobably easier now that our times overlap a bit more.20:46
thumperderyck: yeah, it will be20:46
leonardrderyck: can you look in your .launchpadlib/api.whatever.launchpad.net/cache/*1.0*wadl and see if the base of the wadl:resources tag really says "1.0"? a20:49
leonardr(you can make it easier to find the file by removing /cache and running your script again20:49
deryckleonardr, I can.  this was poolie who reported the bug though.20:49
lifelessleonardr: the online api doesn't show markAsDuplicate in 1.020:53
leonardrlifeless: since the apidoc is generated from the wadl, that means it's not in the wadl20:54
leonardrthere are a couple places where that could go wrong but i would look at the change benji made recently20:55
leonardrsince the other place i can think of involves a change nobody would reasonably make20:55
maxb*blink* wtf21:08
maxbI just typoed a PPA Upload and got an email whose subject referred to a totally random other PPA21:08
lifelessmaxb: \o/21:10
* maxb searches bugs for "ppa" and starts reading the resultant list to check for similar21:12
maxbbug 684450 filed. ftr21:48
_mup_Bug #684450: Totally unrelated PPA referenced in subject of upload rejection email <Soyuz:New> <https://launchpad.net/bugs/684450>21:48
gary_poster_sinzui: I added some notes from our conversation yesterday at the bottom of https://dev.launchpad.net/LEP/OpenIdRoadmap .  Your review, additions, and corrections would be appreciated.23:09
gary_poster_See everybody Monday!23:09
sinzuiokay23:09
mwhudsonmaxb: fun bug, it seems23:45
maxbit's a bit mad, isn't it :-)23:45
maxb(and scary)23:45
mwhudsonmaxb: i just commented23:45
wgrantmaxb: If we have a PPAish upload path that doesn't map to a PPA, we deliberately pick the first PPA we can find. Probably to get PPA-specific error messages.23:48
* wgrant checks the code.23:48
wgrant            # XXX cprov 20071212: using the first available PPA is not exactly23:50
wgrant            # fine because it can confuse the code that sends rejection23:50
wgrantYay.23:51
wgrant            # messages if it relies only on archive.purpose (which should be23:51
wgrant            # enough).23:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!