/srv/irclogs.ubuntu.com/2010/04/08/#launchpad.txt

=== Ursinha is now known as Ursinha-afk
=== mick is now known as Guest63862
micahgany LOSAs around?07:26
spmmicahg: yup; whats up?07:26
micahgI think a couple builders are stuck07:26
micahghttps://edge.launchpad.net/builders/lansones07:27
micahghttps://edge.launchpad.net/builders/radon07:27
spmI'm guessing  23 minutes for a build of those packages is considered long?07:28
micahgjust got a failure for one07:28
micahgit did seem long though07:29
wgrantI wonder if buildd-manager was asleep for a while.07:29
micahgand the other just finished07:29
micahgmaybe that was it07:29
wgrantNothing had been dispatched in > 20 minutes.07:29
spmI've been getting bunches of alerts all week from the buildd side - very transient tho. it looks like "something" is running MUCH slower vs actually breaking tho.07:32
wgrantThe logging should be much less unclear now.07:33
wgranteg. it will actually tell you what it's doing for most operations.07:33
StevenKspm: Looks like you forgot to feed the hamsters again07:34
spmStevenK: we stopped feeding them ages back; they'd just poop on the servers more; so we've setup some spare server fans we had lying around and attached tiny whips to 'em.07:34
spmalongh the principle of "the beatings will continue until morale improves"07:35
spmit seems to work more effectively07:35
StevenKspm: Just wait, the hamsters will rise up and form a union, and then you'll be doomed!07:35
spmthey wish. that's when we start substituting the hamsters on the pentagrams where previously we were using the Black Cockrel's in our secret damned sysadmin secret biznis.07:37
noodles775Are these hamsters related to bug 557391?07:38
ubottuLaunchpad bug 557391 in soyuz "buildd-queue-builder blocks buildd-manager for several minutes" [Undecided,New] https://launchpad.net/bugs/55739107:38
wgrantAh, that could be it.07:38
spmnoodles775: we have SO got to have another word about your use of facts in serious discussions.... ;-)07:38
noodles775;)07:39
wgrantI don't see how a lock file could block buildd-manager, though -- does it really take out and release a lock every cycle?07:39
* wgrant looks.07:39
noodles775I couldn't even see a shared lockfile (it uses the name of the script)... I didn't get a chance to look deeper.07:39
noodles775StevenK: did you get a chance to look at that bug?07:40
mwhudsoncould it block inside postgres </wild spectulation>07:40
mwhudson?07:40
wgrantmwhudson: I considered that... possibly.07:40
noodles775Yeah, a transaction lock was ...07:41
wgrantI forget how queuebuilder handles transactions.07:41
spmwouldn't be the first time we've had funky locks in the DB....07:41
wgrantEven though I've touched it a lot in the past couple of weeks.07:41
spmwgrant: so... it's your fault????07:41
wgrantspm: Well, the first bits of the refactoring landed a couple of hours ago, so hopefully not!07:41
spmheh. and I was just getting the sacrificial knives out and specially blunted. darn it.07:42
mwhudsonwhat'07:43
mwhudsons that think from the discworld?  an unhangover or something07:43
mwhudsonoh, hangunder07:43
wgrantOh, no, I did touch the relevant method in 10.03. But the transaction lifetimes should be identical.07:43
spmmwhudson: ha; no. for a change; I did originally type sharpening; but figured that blunt ones would hurt more so... >:)07:44
mwhudsonspm: i meant that wgrant's changes might me so incredible they're affecting things before they're deployed07:44
wgrantHow is queuebuilder being invoked?07:45
spmmwhudson: that really wouldn't surprise me....07:50
spmwgrant: cron. every 20 mins.07:50
spmoh wait. that's the rescore.07:50
wgrantDo we know which one is being contentious?07:51
wgrantThe --score-only, or the not --score-only?07:51
spm--score-only07:51
spmnoodles775: there's a question. how IS the queuebuilder invoked? via cesium/buildd manager?07:52
wgrantb-m doesn't know about it at all.07:53
wgrantIt needn't even be on cesium, but it probably is.07:53
noodles775spm: I was just hunting through the crontabs on dogfood to try to find it.07:53
spm:-)07:55
noodles775spm: I can't see it anywhere in the crontabs I have access to (and I don't have access to /var/spool/cron/crontabs)08:04
spmnoodles775: we DID used to run a queuebuilder on cesium every hour. but that was disabled for an 'indefinite' period in late 2008. so....08:05
noodles775spm: so how is it being determined that it's causing the lock? Can you see the process?08:05
noodles775Or maybe lamont was just guessing? I'll ask him later if he can fill in the bug with further details if he's got them.08:06
spmnoodles775: it seems to be a combo of things.08:06
spm2010-04-08 07:46:00+0100 [-] startBuild(http://americium.ppa:8221/, transmission, 1.92+r10460-0ubuntu0~lucid, Release)08:06
spm2010-04-08 08:04:25+0100 [-] americium (http://americium.ppa:8221/):08:06
wgrantOh.08:07
spmby way of example. is a rather long gap - that's triggering an alert08:07
wgrantThat's probably just a builder being stupid.08:07
wgrantAlthough the timeouts should catch most things, if a PPA builder reset trigger hangs then buildd-manager will.08:07
wgrantAnd that looks suspiciously like that.08:08
spmpossibly - all I know is I'm getting a lot of those this week :-(08:09
mwhudsonwgrant: are you working on making buildd-manager less bonkers?08:13
wgrantmwhudson: I've removed most of it.08:13
mdkeanyone around who is an "LOSA"?08:13
mwhudsonwgrant: impressive08:13
spmmdke: what's up?08:13
wgrantBut this particular issue is more related to the rapid partial asynchronisation of it a couple of years ago, which left us with lovely creatures like RecordingSlave.08:13
mwhudsonwgrant: that was the bonkersness i was thinking of08:14
mdkespm: I wonder if you could take a look at this question for me. I'm sorry to push for it, I'm sure you have plenty in the queue, but it's preventing me from uploading a branch - https://answers.edge.launchpad.net/launchpad-code/+question/10650908:14
noodles775wgrant: so the recording slave is receiving the msg to start a build, but then hangs? (why were the recording slaves introduced? wasn't it because the scan cycle was taking too long?)08:14
noodles775wgrant: also, can you update the above bug with anything you find? Thanks!08:15
spmmdke: done08:16
wgrantnoodles775: The RecordingSlave lets all the synchronous model code be asynchronous. It takes XML-RPC calls and returns a fake response, and buildd-manager later replays the calls asynchronously.08:16
mdkespm: fabulous, thanks a bunch08:16
wgrantSo while it prints startBuild there, the slave call may actually happen much later.08:17
* noodles775 tries to see why that would mean that the buildd-manager doesn't log anything after the startBuild (like "resetting builder...")08:18
wgrantnoodles775: That's true.08:19
wgrantI haven't had a good look just yet.08:19
* wgrant gets a 10.03-like branch.08:19
spmmdke: np08:19
wgrantspm: So those two americium lines are immediately adjacent?08:20
spmwgrant: yup. straight from the raw log08:20
spmwe have an alert for the log not benig updated in 5-10 minutes; hence why I've had a few of these.08:21
wgrantspm: if there are no private builds involved, can you pastebin a few of the subsequent log lines?08:23
spmwgrant: um. no. for exactly that reason. :-/08:25
wgrantBah.08:25
spmtypically - all the others I can easily find are also private. wonder if cuase/effect or just sheer coincidence.08:27
mdkespm: mwhudson: not sure if you're available to help, but after spm has done his thing, the import is failing (https://code.edge.launchpad.net/~vcs-imports/gnome-user-docs/master)08:28
wgrantThe builder varies?08:28
spmwgrant: I'm guessing you're after the text between the '***** RESULT ***** ;;;;******************' bits08:28
mwhudsonmdke: :(08:28
wgrantspm: I don't care about that at all.08:28
spmyeah. looking at one for nannyberry atm08:28
mdkemwhudson: yeah08:28
mwhudsonjelmer: ^^ can you look at mdke's failure?08:29
wgrantspm: So the hang is between the startBuild() and the ************MOREASTERISKS****** RESULT *****EVENMORE******?08:30
mwhudsonmdke: i guess the conversion could be done with bzr-git by hand08:30
spmwgrant: like this: http://paste.ubuntu.com/410900/08:31
mdkemwhudson: I don't know08:31
wgrantspm: Thanks.08:32
mwhudsonmdke: if i unhook the branch from being the dev focus, at least you'll be able to push your branch08:32
wgrantSo the problem isn't in the asynchronous part. This is good.08:32
mwhudsonmdke: or you could do that i guess08:33
mdkemwhudson: that's correct I think, the problem is the repository format between Launchpad and my local repo is not compatible08:33
mdkemwhudson: yes, I'll do that now08:34
* mwhudson really needs to get away from the computer08:35
mdkemwhudson: ok, thanks for your help. Have a nice evening08:36
wgrantAll I can think of is that BQ.markAsBuilding might be conflicting with queuebuilder's scoreCandidates. While I moved that method in 10.03, the transaction use there hasn't changed.08:42
wgrantThe other few dozen lines between the log messages look perfectly safe.08:42
=== henninge_ is now known as henninge
jelmermwhudson, mdke: looking09:46
rdbis there any documentation available on cscvs?09:55
wgrantFrom what I've seen, 'run away'.09:55
jelmermwhudson, mdke: no idea, works here locally :-(09:57
BUGabundomorning10:19
BUGabundoshould click images attached to LP open a new tab?10:19
BUGabundoor use the same?10:19
BUGabundousing chromium daily, fyi10:23
rdbwgrant, 'run away'? :-? It looks quite complicated10:30
bialixinteresting is it possible to bookmark a projects on LP? there is related projects to some user. what if I just want to track the progress of some project, but I'm not part of it?10:44
bialixsomething to quick access projects on LP from LP user home page10:45
sebi`when writing an announcement, is there a way to use text-markup?11:00
=== deryck changed the topic of #launchpad to: http://launchpad.net/ | Read https://help.launchpad.net/ for help | Help contact: deryck | Join https://launchpad.net/~launchpad-users | This channel is logged: http://irclogs.ubuntu.com/ | Launchpad is open source: https://dev.launchpad.net/
czajkowskialoha :)11:20
czajkowskijust wondering is it possible to create a bug and mark it just for one council to be able to view - I want to create Ubuntu Loco council bugs to track issues? and only the people on this team to access the bug ?11:21
bialixczajkowski: there is security issue checkbox11:28
BUGabundoderyck: should click images attached to LP open a new tab? or use the same?11:29
deryckczajkowski, yeah, what bialix said.  That's the only way to file a private bug and once the bug is reported, you can uncheck security but leave private enabled.11:30
deryckBUGabundo, click images?  What do you mean?11:30
BUGabundoderyck: an attached screenshot for example11:30
deryckBUGabundo, ah.  Should open in the same window.  We don't do anything to make them open new.11:30
BUGabundo:\\11:31
idnarI think you can have a project set to create private bugs by default11:31
BUGabundoI'll open a wishbug11:31
idnarI'm not sure if that's done for projects that don't pay for a commercial license, though11:31
BUGabundodon't like to lose previous page11:31
idnarBUGabundo: can't you control-click or middle-click them?11:31
BUGabundoyep11:31
idnarthat seems like a better solution than forcing a new window / tab on everyone11:32
BUGabundobut the behaviour I expect for clicking attached files is new tab with focus11:32
deryckidnar, private by default is only for commercial projects11:32
czajkowskibialix: deryck cheers11:32
BUGabundoother then see it replace the bug page11:32
czajkowskijust when I create community bugs, there seems to be half a dozen folks already assigned to bugs and I want to avoid that11:33
deryckBUGabundo, yeah, feel free to file a wishlist bug, but I don't think we would ever do that by default.11:33
BUGabundoshame :\11:33
deryckSorry, but I think more users would be upset by that than those that would like that. :-)11:33
BUGabundoreally?11:40
deryckBUGabundo, that's my assumption based on the fact that users *generally* don't want new windows and controlling whether it's a new window or new tab is a browser setting.11:41
czajkowskideryck: is there any reason why some folks are automatically assinged to community bugs? that aren't council members??11:41
deryckczajkowski, if someone has subscribed to all bugs for your project they will automatically be subscribed to new bugs.11:42
deryckBUGabundo, but really, there's no way to know for sure without asking users somehow.11:42
czajkowskideryck: oh how does one do that say for community bugs?11:43
deryckczajkowski, go to the bugs section for a project, look down the right side of the page where the X open bugs links are.  Just below that there is a "Subscribe to bug mail" link.11:47
czajkowskideryck: cheers11:49
czajkowskideryck: cheers, that answer my question then, if I want to create LoCo council bugs and have only the 6 of us get them that's not possible11:51
deryckczajkowski, not by default, that's right.  Launchpad assumes use is for open projects if you don't have a commercial subscription.11:52
czajkowskideryck: what I'm trying to do is log issues that are mailed to the 6 of us to keep track of and some are delicate11:53
deryckczajkowski, I understand.  Unfortunately, I don't think there's a way to support this with launchpad currently.  You can mark security as mentioned above when filing the bug, but that's it really.12:01
czajkowskideryck: ok thanks12:17
=== quentusrex_ is now known as quentusrex
=== Ursinha-afk is now known as Ursinha
=== BUGabundo is now known as BUGabundo_lunch
=== matsubara-afk is now known as matsubara
=== salgado-afk is now known as salgado
mdzshould Launchpad be emailing my own comments back to me when I reply to a merge proposal? it doesn't seem helpful13:21
deryckhi mdz.  Yeah, it normally does that.  and yeah, it's not really helpful.13:27
mdzderyck, should I just add a filtering rule to discard the messages, like I do for bugs, or is this likely to change?13:28
lifelessit also emails you when you edit a bug/merge proposal in the web ui13:28
lifelessalso not useful :)13:28
deryckso this will change from bugs very soon... mdz, not sure about the MPs.  Looking at bugs now...13:29
mdzderyck, oh, that's good news13:29
deryckmdz, lifeless -- we have a focus on better bug notifications coming next for us.  See:  https://dev.launchpad.net/LEP/BetterBugSubscriptionsAndNotifications13:30
deryckjml, do you know if the email noise from yourself for MPs is likely to change?13:30
jmlderyck: what noise?13:31
jml(I guess not)13:31
deryckjml, when you reply to an MP, you get a mail back for your own comment.  see mdz's comment above.  ^^13:31
jmloh right.13:32
jmlderyck: we ought to change it, I don't know of any plans to do so currently13:32
deryckmdz, so mail filter looks the best route then for MPs.13:33
jmlderyck: further, it's crappy that we have things set up in such a way so that it's easy for you to fix this problem for bugs but not for merge proposals13:33
deryckjml, *agreed*13:34
deryckthis is some of the worst pain of launchpad dev to me.13:34
jmlderyck: I'll ask thumper about it when I speak with him later today13:35
deryckcool13:36
jmlas for the more general problem of the respective notification systems being divergent, no concrete next actions spring to mind13:37
deryckjml, I wonder if as part of the better-notifications work we shouldn't spend some time unifying notifications across LP?  users don't see the distinction, I'm sure.13:38
deryckthat's huge, I know.13:38
jmlderyck: it's tempting.13:39
jmlderyck: want to think about it some more and then we can talk about it in our call tomorrow?13:39
* jml actually needs to think it through13:39
deryckjml, definitely we can talk about it then.  I think it takes it from a 1-2 month story currently to a 3-5 month story, though.  depending on how many engineers are on it.13:40
deryckmaybe I'm a pessimist about how quickly things can be done in lp though :-)13:40
deryckjml, did you see my cycle time email I sent?13:41
* jml looks13:42
deryckit's very long, sorry.  week old now.13:43
jmlderyck: yeah, it's tagged with @READ :)13:43
jmlderyck: so I will read it...13:44
deryckjml, yeah, understood. :-)  Basically, we do dev and review in 3-4 then spend average of 8 days beyond that in queuing and landing.13:44
deryckfor a 12 day cycle time on a bug or task.13:44
derycktoooooooo long.13:44
jmlderyck: yeah. In some projects, queueing and landing is a sub-minute operation :)13:45
deryckjml, exactly!13:45
hyperairdoes anyone know what happened to the BGO bug status trackers?13:51
=== hggdh_ is now known as hggdh
deryckhyperair, hi.  Sorry but I don't know what you mean by BGO.  Is that a project on LP?14:13
persiaderyck: Just from backscroll: one nice feature about LP sending you your own notes from bugs is that the local mailspool contains a complete record of the bug.  This may be less useful for merge proposals or similar.14:15
deryckpersia, interesting.  Assuming you replied on LP itself, right?  If you reply via mail, that should already be there, correct?14:16
persiaDepends on your client configuration: it may not be in the same threading view.14:16
persia(some clients auto-merge send and receipt, some don't)14:17
persiaMind you, the answer might be "go use a different mail client", or "set up your filters to do something useful" :)14:17
jmlderyck: BGO often means "bugzilla.gnome.org"14:22
deryckah14:23
deryckpersia, that's a nice perspective though, thanks.14:23
deryckhyperair, are you asking about updates to bugs linked to the gnome bugzilla?  if so, it's being worked on.  Very close but still not there yet.14:24
hyperairderyck: ah cool. thanks for the information.14:29
=== daniloff is now known as danilos
mok0w15:18
=== leonardr_ is now known as leonardr-afk
=== matsubara is now known as matsubara-lunch
qenseI've got a problem with the sprints section of Launchpad. At <https://edge.launchpad.net/sprints/uds-m> I -- Sense Hofstede -- am listed as attending, but I can still press the 'Register Yourself' button and http://summit.ubuntu.com/uds-m still thinks I'm not attending. I've marked myself as attending yesterday evening, so it can't be that I just have to wait another few minutes and refresh.16:50
=== deryck is now known as deryck[lunch]
deryck[lunch]qense, that seems an issue with the summit.ubuntu.com app, since you're listed in the launchpad sprints page.16:55
deryck[lunch]qense, I'm not sure who to ping about that, but I can check after I eat.16:55
qensederyck[lunch]: the strange thing is that the Launchpad page for the summit also still allows me to (+) Register my attentdance.16:56
qensederyck[lunch]: but have your lunch first :)16:56
persiaqense: OOh, cool.  I can replicate.  I'm not sure it's an LP issue though, as LP showed me as attending both before and after I played with summit and reregistered.16:59
qensepersia: But shouldn't the (+) button go away on Launchpad when you've registered yourself as attending?17:01
persiaI don't think so: I think it's an artifact of being able to edit one's attendance.  Yes, it's a bug, but just a minor UI bug (should be pencil rather than +)17:01
=== matsubara-lunch is now known as matsubara
=== chex is now known as Chex
qensethen it's just an Summit issue17:04
persiaI think so.17:04
persiaPlus the minor UI bug.17:04
qenseok17:06
qensepersia: There is going to land a new version of Summit real soon, iirc, so I'll wait for that to arrive.17:07
persiaNo idea.17:07
persiajcastro: Do you know who knows about summit, or in which channel we should ask questions, or how to file bugs?17:07
qenseiirc there is a 'summit' project on LP for that17:08
jcastropersia: lp.net/summit17:08
jcastropersia: Daviey is your man17:08
persiajcastro: Cool, thanks :)17:09
jcastropersia: I've assigned him some bugs already so get them in quick before scheduling starts!17:10
persiaqense: Are you handling this bug, or shall I file it?  If you are, please subscribe me.17:10
qensepersia: I'll file it and subscribe you.17:11
persiaqense: Thanks :)17:12
persiaI'll confirm it in a bit.17:13
qensepersia: thanks for that!17:13
qensepersia: You're subscribed!17:14
persiaConfirmed and me-too'd.17:15
qensegreat!17:15
=== salgado is now known as salgado-lunch
=== yofel_ is now known as yofel
=== deryck[lunch] is now known as deryck
=== beuno is now known as beuno-lunch
=== leonardr-afk is now known as leonardr
=== salgado-lunch is now known as salgado
cbx33hey guys got a question19:03
cbx33I see a packge ina  ppa, but when I try to apt-get install it, it's not there19:03
cbx33and it's not in the packages.gz file either19:04
cbx33any ideas?19:04
james_wcbx33: did it fail to build?19:06
cbx33I don't htink so19:06
cbx33it is the zfs-fuse package from brcha ppa19:07
james_wwhich series?19:08
james_wit's not available for karmic or lucid19:08
cbx33hmmm19:08
cbx33that's odd19:08
cbx33a page i saw had it add it for karmic19:08
cbx33the title of the post was zfs-fuse for 9.1019:09
=== Ursinha is now known as Ursinha-brb
=== beuno-lunch is now known as beuno
derycksinzui, does registry get sprint app bugs?19:38
sinzuino, They exist for the sake of blueprints19:39
sinzuideryck, I retargeted a sprint bug to blueprints a few hours ago19:41
derycksinzui, ah, ok.  Thanks.19:42
micahgis  that right, 16k jobs for the i386 PPAs?19:46
=== Ursinha-brb is now known as Ursinha
persiamicahg: Maybe an archive-rebuild-test?19:52
micahgpersia: maybe19:52
persiaThose are low-priority (below PPA) typically.19:52
sladenhttps://bugs.launchpad.net/malone/+bug/558642  <-- celebrity bug popularity fail19:57
ubottuLaunchpad bug 558642 in malone "comments=all dies when displaying >680 comments" [Undecided,New]19:57
kfogelsinzui: Do you know if there's any way for me to set an arbitrary user as an Answer Contact for Launchpad?20:01
kfogelsinzui: I click "Set answer contact" to get to https://answers.edge.launchpad.net/launchpad/+answer-contact, but my choices there are: myself, or one of a set list of teams.  I can't just type in a user's name.20:01
sladenkfogel: isn't on the basis of a user choosing to subscribe themself?20:05
sladenthemselve20:05
kfogelsladen: yeah, I'm going to ask the user if he can set himself (but suspect he can't).20:06
sinzuikfogel, you cannot make someone do a task20:06
sinzuikfogel, though it would be nice if I could subscribe a user to a question that concerns him20:06
kfogelsinzui: ok20:07
sinzuikfogel, a user can choose the be an answer contact for *any* project.20:07
kfogelsinzui: oh, great, I didn't realize that20:08
sinzuikfogel, Launchpad recognises that the support and translation communities are often autonomous from the core project. we let communities contribute by choice rather than by authority20:09
* sinzui may have the formation of his next blog post20:09
kfogelsinzui: :-)20:10
kfogelsinzui: this is all around that user who asked matsubara if he (the user) could be an answer contact for Launchpad.  After all this digging, it turns out he could have just set himself as a contact from the get-go.20:11
kfogelIt sounds like, anyway.20:11
sebi`does launchpad allow any sort of markup for, let's say, announcements, and kinds thereof?20:13
matsubarakfogel, you're right. I just tested on staging with my test account and by setting myself as the answer contact I was able to edit a question's assignee20:17
matsubarakfogel, so just telling the guy to set himself as an answer contact will solve the trick20:17
matsubaras/the trick/the problem/20:18
=== Ursinha is now known as Ursinha-lunch
cbx33sladen, hey long time dude20:29
mdkejelmer, mwhudson - what should I do to try and resolve this? File a bug? On what project?21:03
jelmermdke: I'm not sure where the problem is exactly; I can't reproduce the failure locally21:04
jelmerSo perhaps this can be resolved by updating the version of bzr-git on Launchpad21:04
mdkejelmer: so should I file a question / bug for that?21:05
jelmermdke: Good question21:06
jelmermwhudson: there?21:06
jelmermwhudson: I'll push a fix for the -0000 / +0000 patch in a bit, perhaps we could try that patch on staging?21:07
mwhudsonjelmer: yeah ok21:11
bodhi_zazenIs there a limit to how many admins can be on a project or team ?21:14
bodhi_zazenAnd can only the project owner add an admin, or can another admin add one ?21:14
persiabodhi_zazen: No, and yes21:15
bodhi_zazenTY21:15
=== salgado is now known as salgado-afk
=== matsubara is now known as matsubara-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!