[00:11] <slangasek> joey: any luck?
[00:11] <joey> slangasek, narrowing in.  Appears to be a replication issue which manifests as a communication issue causing the access errors you see.
[00:12] <bdmurray> Did the staging database name change?
[00:13] <joey> bdmurray, it might have last week but I don't have the answer to that at the moment.
[00:14] <bdmurray> joey: who would and how could I get notice when or before it happens?
[00:15] <joey> bdmurray, we made a split to the source branches but I wasn't aware of any changes to the name itself, but I've been out of the loop on that.  Best thing to do is email stub.
[00:15] <joey> unless you need an answer now-ish for some reason
[00:17] <bdmurray> joey: I do have some reports that use the staging database
[00:19] <joey> bdmurray, the reason I ask is that the same people I need to ask are diagnosing the LP issues so I don't want to interrupt them.  I'll try to ask when they are done then.
[00:24] <joey> ==> We've located a method to resolve the immediate issue but we're still investigating the cause.
[00:27] <zachtib> i'm having trouble with a build in my PPA... I uploaded it a while ago and it hasn't started, even though other things have (all on i386)
[00:29] <joey> zachtib, the builders may be busy or,  unlikely, it might be related to the current performance problems we're working on
[00:30] <joey> slangasek, bdmurray, mifritscher, et al - we're going to restart the entire LP world
[00:30] <joey> now
[00:30] <zachtib> joey: right, but it's been showing up as in queue for "1 hour" and starting in "1 hour" the whole time, it's very odd
[00:31] <joey> ok I'm being a bit overly dramatic :-0
[00:31] <zachtib> and like I said, my other builds have started
[00:31] <joey> zachtib, ah, I've seen that before. You might file a question against launchpad about it. I think there might already be a bug.
[00:31] <joey> about it
[00:36] <joey> slangasek, bdmurray, mifritscher, et al - we think we have remedied the situation. Please report any timeouts
[00:37] <bdmurray> joey: thanks
[00:37] <joey> slangasek, bdmurray, mifritscher, et al - we have a few more nooks and crannies to check but we think we got it all.  We're doing a final sweep now looking for errors.
[00:39] <slangasek> ok, thanks
[00:47] <joey> bdmurray, have confirmation on the staging db name change
[00:47] <joey> getting more info now
[00:47] <bdmurray> awesome
[00:53] <mrooney> Have I copied a PPA package wrong? I tried to copy it from Jaunty -> Intrepid in my PPA and get "Error: Dependency is not satisfiable: python-central"
[00:54] <joey> removed timeout notice
[01:17] <maxb> Purely a question out of interest: What is actually happening when there are queued builds, but some buildds show as "Idle"?
[01:19] <maxb> Clearly "Idle" isn't telling the full story - are they "Waiting for next time to poll the queue"? "Finishing some sort of post-build cleanup"?
[01:21] <wgrant> I suspect they're waiting for the slave scanner to come by them again.
[01:21] <wgrant> 2.2.3 has some bug targetted about parallelising the slavescanner.
[01:27] <jml> wgrant: not only that, but people are actually working on it too :)
[01:40] <wgrant> jml: Oh, good. Lots of things get deferred...
[01:42] <cody-somerville> wgrant, this one won't
[01:43] <wgrant> cody-somerville: We can hope! Although I guess *you* can do more than hope.
[03:06] <ovnicraft> hi folks, there is an official pastebin?
[03:07] <ovnicraft> or what # lines are accepted here?
[03:08] <wgrant> ovnicraft: http://paste.ubuntu.com works.
[03:12] <ovnicraft> wgrant, how i can ignore files to push my project?
[03:12] <ovnicraft> so i dont want to push my .pydevproject :|
[03:12] <wgrant> ovnicraft: I don't understand what you mean. How are you pushing it?
[03:13] <ovnicraft> i push 3 files so i want to remove 1 from my branch
[03:13] <wgrant> So you've already added them to your branch, committed, pushed to Launchpad, and now want to remove them?
[03:14] <ovnicraft> only from launchpad branch
[03:15] <wgrant> bzr rm --keep .pydevproject
[03:15] <wgrant> That will remove it from the current revision.
[03:15] <wgrant> But you cannot remove it from history.
[03:15] <ovnicraft> wgrant, no prob with history
[03:37] <jml> ovnicraft:
[03:37] <ovnicraft> jml, ?
[03:37] <jml> ovnicraft: also, 'bzr ignore .pydevproject; bzr commit' will stop it from being added or committed again.
[03:38] <ovnicraft> jml, really i do both things and then push so... works ok :)
[03:38] <jml> ovnicraft: cool.
[03:39] <ovnicraft> so, i come from hg
[03:39] <jml> ovnicraft: 'bzr ignore' is great for project files and other things you don't want version controlled.
[03:39] <jml> oh ok
[03:39] <ovnicraft> but is great bzr
[03:40] <jml> ovnicraft: I like bzr a lot :)
[03:40] <jml> almost all the time
[03:41] <ovnicraft> merge is better what i read, so i 'll see ;), and i am waiting for launchpad release i in love python+launchpad
[06:09] <maco> why is launchpad taking > 1 minute to load each page?
[06:15] <dtchen> symptoms should be resolved now
[06:39] <stefanlsd> Is it me, or is LP really slow?
[06:40] <dtchen> it's fine for me now
[06:59] <stefanlsd> dtchen: im still having issues
[07:59] <DBO> is bzr not working?
[08:01] <wgrant> DBO: bzr has nothing to do with Launchpad.
[08:01] <wgrant> But perhaps you mean the lp: protocol in bzr.
[08:01] <DBO> bzr: ERROR: xmlrpc protocol error connecting to https://xmlrpc.edge.launchpad.net/bazaar/: 502 Bad Gateway
[08:02] <wgrant> I think LP is being crap, so the xmlrpc server is down.
[08:02] <wgrant> Right.
[08:02] <wgrant> Use a normal URL, since the lp: resolver isn't working.
[08:02] <DBO> ...man I dont know the normal url =P
[08:02] <wgrant> (bzr+ssh://username@bazaar.launchpad.net/~path/to/branch, rather than lp:~path/to/branch)
[08:04] <DBO> thank you, that kicked it in the butt
[08:05] <wgrant> It seems to be working again now, anyway.
[08:05] <DBO> w00t
[08:05] <DBO> i always have the best timing
[08:05] <wgrant> Hmmm.
[08:06] <wgrant> I think one of the edge appservers might be broken, actually, as only some of my requests fail.
[08:06]  * DBO loves how a build dep of gnome-do is banshee...
[08:06] <DBO> god we are such rank amatures
[08:10] <wgrant> Yes, the edge appservers aren't too happy...
[08:10] <wgrant> Maybe spm is lurking.
[08:14] <jml> I've escalated the issue, but it's an awkward time of day
[08:22] <stefanlsd> Were busy with the Ubuntu Bugjam and having really slow LP access. Does anyone else have this issue?
[08:24] <jml> stefanlsd: yeah. see the topic
[08:24] <stefanlsd> jml: aah ok. is there any work around atm?
[08:25] <jml> stefanlsd: drop the 'edge' bit from your URLs
[08:25] <jml> stefanlsd: our IS team have been notified and will be fixing the problem soon.
[08:35] <glade88> hmm.. edge servers are timing out. is bazaar down too?
[08:35] <glade88> I cant commit my work
[08:39] <jml> glade88: bazaar.lp.net?
[08:39] <jml> glade88: this is the first I heard of it.
[08:40]  * jml experiments
[08:40] <wgrant> jml: the edge xmlrpc server is used to resolve lp: URLs.
[08:40] <jml> wgrant: I know that. :)
[08:40] <wgrant> jml: That would explain it, wouldn't it?
[08:41] <jml> wgrant: it would. I just wanted to check first.
[08:42] <jml> glade88: so, as wgrant says, if you are using lp: urls then you won't be able to commit.
[08:43] <jml> glade88: to work-around, you can push your changes to bzr+ssh://bazaar.launchpad.net/~foo/bar/baz
[08:43] <jml> if you have a checkout, then, umm, I don't know the bzr command, but I can tell you which files to edit.
[08:44] <wgrant> bzr unbind; bzr bind bzr+ssh://....
[08:44] <jml> wgrant: thanks.
[08:44] <jml> wgrant: does that work on a lightweight checkout?
[08:45] <wgrant> jml: Good question. Let's see...
[08:48] <wgrant> jml: No.
[08:48] <wgrant> It gives a misleading error, and doesn't work.
[08:48] <jml> yeah.
[08:49] <jml> "echo -n 'bzr+ssh://...' > .bzr/branch/location" should do the trick
[08:49] <jml> if it's a lightweight checkout, never tried it with heavyweight ones.
[08:49]  * wgrant has never used a lightweight checkout.
[08:49] <jml> I've never used a heavyweight one :)
[08:49] <jml> anyway, I need a) food, b) to stop using my computer.
[08:50] <wgrant> Yes, food is good.
[08:50]  * wgrant wonders why bzr uses the xmlrpc.edge...
[08:50] <glade88> jml: wgrant: thanks, worksforme (tm) !
[08:51] <wgrant> glade88: Good, good.
[08:51] <jml> wgrant: there's a comment in the source code in bzr.
[08:51] <jml> wgrant: if you are really interested :)
[08:51] <jml> wgrant: I've forgotten the reason myself.
[08:51] <wgrant> jml: Will do.
[08:52] <wgrant> (I just tried to bzr co lp:bzr to check that... of course I could just look in the installed one)
[08:52] <jml> heh heh
[08:55] <jml> hmm. actually, setting the BZR_LP_XMLRPC_URL to the production endpoint would work too, I think.
[08:56] <wgrant> True.
[08:56]  * jml is off.
[08:56] <jml> g'night
[08:57] <wgrant> Night.
[09:44] <d-b> btw where is launchpad feeling the load worst ? -is it cpu or ?
[10:23] <stefanlsd> Im still getting timeout issues - Error ID: OOPS-1148A1110
[10:37] <stefanlsd> jml: any news about status of timeouts
[10:41] <wgrant> jml is hopefully asleep.
[10:42] <wgrant> It seems that the LOSAs are too, regrettably.
[10:42] <stefanlsd> wgrant: bug jam in progress and teams all reporting issues :|
[10:42] <wgrant> stefanlsd: Even non-edge?
[10:42] <wgrant> Hm, right, that OOPS is from prod...
[10:43] <stefanlsd> wgrant: yeah. jml said earlier that it was edge. i disabled edge and it worked for a bit. seems like prod is affected now also
[10:44] <wgrant> But the problem is different - edge wasn't OOPSing, some of the requests weren't completing at all.
[10:44] <stefanlsd> wgrant: trying query -  https://bugs.launchpad.net/ubuntu/+bugs?field.searchtext=&orderby=-datecreated&search=Search&field.status%3Alist=New&field.assignee=&field.owner=&field.omit_dupes=on&field.has_patch=&field.has_no_package=on
[10:44] <stefanlsd> which is a link from the bugjam easy tasks page...
[10:44] <wgrant> Is there nobody involved in the GBJ that can kick somebody?
[10:46] <stefanlsd> mm. not sure. i would kick dholbach, but he's not around :)
[10:48] <jamesh> if everyone else stops using Launchpad, the problem will go away
[10:49] <wgrant> jamesh: So they're timeouts caused by general overloading?
[10:49] <jamesh> no idea
[10:49] <jamesh> but it might make Launchpad work better for me.
[10:49] <wgrant> Heh.
[10:49] <jamesh> IANALH
[10:49] <wgrant> LH?
[10:50] <jamesh> launchpad hacker
[10:50] <wgrant> But you were.
[10:52] <jamesh> probably need the admins to have a look
[10:53] <jamesh> given that it doesn't seem to be one part of LP, I'd blame a background job holding a transaction open
[10:53] <wgrant> Yes, but it's a weekend and nobody has shown up for hours.
[10:56] <elmo> actually, I got called several hours ago, and I did kick edge
[10:56] <elmo> unfortunately right now there's nothing obviously specifically wrong that I can fix
[10:56] <elmo> the main problem appears to be excessive load on the RO DB
[10:56] <elmo> I can't tell if that's the bug jam or a regression in edge
[10:59] <wgrant> elmo: Lovely... Sorry I assumed that nobody had done anything!
[11:00] <wgrant> Will more relevant people appear some time during the weekend?
[11:02] <mads-hk> Do anyone know what causes the problem with timeouts?
[11:03] <wgrant> Apparently there's lots of load.
[11:03] <wgrant> elmo: Can you easily throw people off edge and see if that helps?
[11:03] <mads-hk> Oh great...
[11:04] <elmo> wgrant: relevant people> don't know, sorry
[11:04] <elmo> wgrant: I'm not sure if I can throw people off edge without it being relatively disruptive (e.g. dropping them all from the relevant group, would be  fairly, err, loud)
[11:05] <wgrant> elmo: Ah, I presumed the group would just be config option, rather than a celebrity...
[11:05] <jamesh> you could get everyone to use the main LP instance pretty easily
[11:05] <wgrant> I don't see how, apart from stopping edge.
[11:05] <jamesh> disable the lp -> edge.lp redirect, then use http redirects from edge.lp
[11:06] <jamesh> that would stop edge, yes.
[11:06] <wgrant> Right, elmo suggested that disabling the redirect would be difficult.
[11:06] <elmo> well, in the sense of I don't know how to do it
[11:06] <elmo> (and I'm actually doing some other work right now)
[11:07] <elmo> I was actually vaguely consider rolling edge back to production
[11:07] <wgrant> Or yesterday.
[11:07] <elmo> that could be as simple as some symlink changes on the app servers
[11:15] <mads-hk> what about changing the css file temp. to make the site less gui
[11:15] <stefanlsd> would be great if we could do something. Got people in a room here and cant really work.
[11:16] <stefanlsd> Will raise an issue about BugJams & GBJ working closer with LP team
[11:16] <jamesh> mads-hk: changing the CSS is not likely to have any effect.  The images and styles are served separately
[11:17] <jamesh> the service timing out is just serving the pages.
[11:17] <mads-hk> jamesh -> okay then..
[11:17] <mads-hk> jamesh what to you mean?
[11:19] <mads-hk> Just install Windows server 2000... that works!
[11:19] <mads-hk> just kidding
[11:20] <wgrant> mads-hk: The server giving the timeouts sees nothing of your requests for CSS or most images, basically.
[11:22] <mads-hk> Okay then... let's see if we can triage the launchpad-server bug :P
[11:49] <stefanlsd> LP it looking better now... anything change?
[12:04] <BrummyBugJam> :'(
[12:26] <mads-hk> any news?
[12:46] <mads-hk> Any news about the server?
[12:50] <BrummyBugJam> edge is getting an OOPS on any page.
[12:50] <BrummyBugJam> ooh, python traceback
[12:53] <mok0> I am trying to branch a copy off a repo I have on my server, but I get the message: bzr: ERROR: Not a branch:
[12:53] <mok0> Trying to get a branch on my laptop
[13:08] <mok0> Ah, using wrong path... problem solved
[13:43] <elmo> both edge and production should be better now; thanks to spm
[13:44] <dholbach> spm, elmo: YOU ROCK!
[15:02] <stefanlsd> Does anyone have any documentation regarding integrating a python application to use LP openid for authentication?
[15:08] <maxb> stefanlsd: You could check out the source code of REVU
[15:09] <stefanlsd> maxb: yeah. thanks. just doing that
[16:40] <MTecknology> Where's metcalfe!
[16:41]  * MTecknology wants a chat to square things away :P
[16:42] <MTecknology> any rubber duckies around?
[16:43] <MTecknology> cody-somerville: you're a rubber ducky, aren't you?
[16:44] <cody-somerville> Not on production
[16:44] <MTecknology> cody-somerville: know anyone around that is?
[16:45] <cody-somerville> Its the weekend
[16:45] <cody-somerville> Chances are no
[16:45] <MTecknology> I'm trying to sort out a giant mess :P
[16:45] <cody-somerville> Whats the giant mess?
[16:47] <MTecknology> cody-somerville: I want to drop one team, rename one team to that name, and then leave an alias behind
[16:49] <MTecknology> cody-somerville: we're trying to restructure things with our projects
[17:15] <cody-somerville> MTecknology, You'll want to file an answer against launchpad with your request.
[17:16] <cody-somerville> I dunno if launchpad supports team aliases though. :)
[17:16] <MTecknology> actually, we can't pick a name it should be
[17:16] <MTecknology> We have a project right now called LoCo-Drupal but we don't think the name sounds right since loco can mean anything... We think Ubuntu-LoCo-Drupal-Dev fits right, but that's a long name.....
[17:29] <mneptok> http://bazaar.launchpad.net/~sanja-byelkin/maria/2.0/files
[17:29] <mneptok> Sorry, there was a problem connecting to the Launchpad server.
[17:35] <MTecknology> mneptok: how's it going?
[17:38] <MTecknology> that's good
[18:13] <MTecknology> I'm surprised sabdfl doesn't have a proxy for irc
[19:07] <yml> hello
[19:07] <yml> I am trying to import python-calais from an external vcs (svn)
[19:09] <yml> It seems that the initial import is stuck somewhere so I am wondering if I miss something in the declaration
[19:09] <yml> or if such operation is subject to a manual approbation ?
[19:38] <maxb> yml: I think new vcs-imports are subject to approval
[20:58] <yml> maxb: I see thank you
[21:22] <madmartian> hi launchpad people
[21:23] <madmartian> I'm having trouble with my PPA, is this the right place to ask?
[21:27] <madmartian> \3
[21:29] <maxb> yes, it is
[21:30] <madmartian> great
[21:30] <madmartian> I uploaded a package fine
[21:31] <madmartian> then I realised there was a problem with my masterful packaging and tried to upload an update
[21:31] <madmartian> that won't appear in my ppa screen
[21:31] <madmartian> or when I try and install from the ppa
[21:32] <madmartian> i therefore hit "delete" on the old version, which has now gone from the ppa screen, but is still in the repo
[21:32] <madmartian> any ideas?
[21:32] <maxb> it will be purged eventually
[21:33] <madmartian> maxb: is it just a case of waiting then?
[21:34] <maxb> for things to disappear from pool/ once deleted in the ui? yes
[21:35] <madmartian> only thing is, it has disappeared from pool/ afaict
[21:35] <madmartian> when I go to http://ppa.launchpad.net/jshholland/ppa/ubuntu/ there is only a dist folder
[21:38] <maxb> so, what's the problem then?
[21:39] <madmartian> the new version isn't there and dput says it is
[21:40] <maxb> dput doesn't put to your ppa, it puts to an incoming processing area from which packages are picked up and processed into your ppa
[21:40] <maxb> So dput can't say that something is there
[21:42] <madmartian> http://pastebin.ubuntu.com/121205/
[21:43] <maxb> dput notices that there is a .upload log file locally matching the name of the .changes, and skips the upload if so
[21:44] <madmartian> how do I force the upload then?
[21:45] <maxb> dput -f I think. or delete the upload logfile from the previous attemp
[21:45] <maxb> +t
[21:46] <madmartian> great thanks
[22:56] <RainCT> Hi
[23:00] <RainCT> I have a bzr branch which originally included source files for images, which makes it huge (> 100MB), but this was later removed. So, now I'd like to create a new branch with like the 200 last commits (so that it doesn't include that mess and is faster to fetch the first time, but that 'bzr diff' and such can still be used being offline in most cases) and having it linked to the original branch in case it's necessary to look up earlier revisions. H
[23:00] <RainCT> (maybe I should better ask in #bzr?)
[23:14] <wgrant> RainCT: What you are probably looking for is a much discussed unimplemented feature going by the name of 'history horizons'.
[23:16] <wgrant> And yes, this is very much a #bzr topic.
[23:17] <wgrant> Although you could do it with stacked branches, I suppose.
[23:21] <penguin42> hi, I'm getting a 'please try again' repeatedly when trying to mark a malone bug as a dupe
[23:21] <penguin42> trying to mark malone 194930 as a dupe of 271909
[23:22] <wgrant> Oh dear.
[23:22] <wgrant> Somebody broke it again.
[23:22]  * penguin42 hands wgrant the sticky tape
[23:23] <wgrant> Is that on edge or production?
[23:23]  * wgrant guesses prod.
[23:23] <penguin42> https://bugs.launchpad.net/malone/+bug/194930/+duplicate
[23:24] <wgrant> Right.
[23:24] <wgrant> penguin42: It has been done now, but you might try edge.launchpad.net for now. It seems to be more reliable right now.
[23:25] <penguin42> is that another front end to the same data?
[23:25] <wgrant> Yes.
[23:25] <wgrant> It's running the latest development version of Launchpad, but on the same data.
[23:26] <penguin42> thanks
[23:38] <penguin42> wgrant: I'm not convinced edge is any more stable - if the malone bugs are in a separate database I'd suggest someone checks that it's OK
[23:40] <wgrant> penguin42: The problem is that it's a weekend, and it's really only us people with no useful connection with Launchpad around for most of the weekend. So nobody can do anything to fix it.
[23:41] <wgrant> Hmm, you're right, edge isn't wonderful either.
[23:41] <penguin42> it needs fixing with something heavy and blunt
[23:42] <penguin42> it is a bug jam day - it might be an idea to keep an eye on it!
[23:42] <wgrant> Oh yes.
[23:42] <wgrant> One would think so.