/srv/irclogs.ubuntu.com/2011/07/18/#launchpad-dev.txt

lifelesspg upstream would probably do pg.bouncer if at all; namespace packages are a pita to package00:00
lifelesshmm00:55
lifelessprobably want to make the rabbit fixture port allocation logic reusable00:55
wgrantBah.02:10
wgrantThe critical deficit is resolved already.02:10
StevenKwgrant?02:13
wgrantWe were at 239 criticals two checks ago, 237 when I checked this morning, and now 239 :)02:13
thumperhi02:33
thumperwhat's the status of the magic diff updating?02:33
lifelessmagic?02:36
lifelessdb rebulid is good for the soul:  * 266 Time Outs02:46
lifelesswoo02:56
lifeless 16384 | test_db1 |    2801 |    16385 | user1   | select * from pg_stat_activity; | f       | 2011-07-18 02:55:50.531462+00 | 2011-07-18 02:55:50.531462+00 | 2011-07-18 02:55:31.384875+00 |             |          -102:56
lifelessmachine setup pgbouncer.02:56
lifelessnow we're bootstrapped, I can move onto more interesting tests.02:56
wgrantthumper: Waiting on Red Squad being free to fulfill lifeless' deployment requirements.02:58
* thumper nods03:04
wgrantMostly needs OOPS integration and metrics now, I think.;03:05
=== poolie1 is now known as poolie
michaelh1Hey, I just had a play with bzr-git for importing the GDB 7.3 release branch into Launchpad.03:15
michaelh1It works well, and can track more than one branch - you need to create a remote tracking branch first, but that's cheap03:16
pooliemichaelh1: rocking!03:18
pooliehopefully soon lp will be able to track multiple branches03:18
michaelh1yeah, so to my naive eyes it has the support that LP needs.03:18
poolie yes, it does03:19
huwshimiA simple review if someone wants it: https://code.launchpad.net/~huwshimi/launchpad/email-tag-order-645962/+merge/6820703:25
wgrantmichaelh1: A remote tracking branch?03:26
wgranthuwshimi: Ah, that has bugged me for ages!03:27
huwshimiwgrant: Yeah, I finally got sick of it this morning :)03:27
michaelh1wgrant: yeah, bzr-git converts any local branches to bzr branches in refs/branch-name.  It won't do remote branches, but you can set up a local branch that tracks the remote branch03:27
wgrantmichaelh1: Oh, doing an import like that, I see.03:28
wgrantThat's not how Launchpad does it.03:28
wgranthuwshimi: Excellent. Approved.03:28
huwshimiwgrant: Thanks mate!03:28
pooliei was wondering in the shower if lp ought to show 'recently frequently duplicated bugs' as suggestions in +filebug03:37
poolieand whether they would be better guesses, for some users, than matching on words in the suggestion03:37
poolieor in fact hot bugs would be close to the same thing03:37
=== almaisan-away is now known as al-maisan
lifelesswell, the dup search should factor that in perhaps03:40
lifelessOTOH many devs (me included) think offering dup detection is often misguided03:40
pooliebecause the person filing the bug is not in a good position to know if it's a dupe?03:44
lifelessyup03:45
lifelessand superficial things like the backtrace are often not indicative of dupe-or-not03:45
pooliei agree03:45
lifelesssometimes they are, one-size doesn't fit all03:45
poolieyep03:46
wgrantThat's not very Launchpad of you.03:46
lifelesswgrant: ok, so you didn't like pgbouncer as a module name03:48
wgrantlifeless: Correct.03:52
wgrantDo I have suggestions beyond terribleness like pgbouncerfixture? Nope.03:52
wgrantHmm.03:54
wgrantLet's play "make qastaging update faster".03:54
lifelesswgrant: so, in the absence of suggestions, I'm going with pgbouncer... we can do a rename dance later if needed03:56
wgrantPerhaps.03:56
pooliecould someone tell me briefly how lp's debian publication metadata importer works?03:56
wgrantPerhaps we should make namespace packages not suck.03:56
poolieor point me to a wiki page or code03:56
wgrantpoolie: grep around for gina03:56
wgrantpoolie: There's no wiki page that I know of.03:56
pooliehow does it get the data?03:56
wgrantpoolie: It is very unLaunchpaddy.03:56
poolieis that a good thing? :)03:56
wgrantpoolie: debmirror runs on iron to create a local mirror. gina then walks the indices and imports everything it sees.03:57
wgrantThis means it fails at tracking removals etc.03:57
poolie(for optional context, https://lists.ubuntu.com/archives/ubuntu-distributed-devel/2011-July/000872.html)03:58
wgrantpoolie: Sounds like our imports are badly timed.03:59
wgrantI believe we import at the same frequency, but perhaps too offset.04:00
lifelesswell04:00
pooliebetween the ubuntu imports and debian04:00
wgrant52 2,8,14,20 * * * sh /srv/debian-import.launchpad.net/scripts/mirror-update.sh >> /srv/debian-import.launchpad.net/production-logs/mirror-update.log 2>&104:00
lifelessfolk have been known to upload the same version to both04:00
wgrant05 3,9,15,21 * * * LPCONFIG=gina /srv/debian-import.launchpad.net/production/launchpad/scripts/gina.py lenny squeeze sid experimental wheezy >> /srv/debian- import.launchpad.net/production-logs/gina.log 2>&104:00
pooliethere seems to be a bug that codehosting oopses like https://lp-oops.canonical.com/oops.py/?oopsid=2021BZR207511 don't actually include a traceback04:01
poolieor is that just a one off?04:02
lifelessmany others do04:05
lifelessI don't know why that doesn't.04:05
poolieoh well, bug 81210604:05
_mup_Bug #812106: codehosting oops doesn't include traceback <codehosting> <oops-infrastructure> <Launchpad itself:Triaged> < https://launchpad.net/bugs/812106 >04:05
pooliecan fix or investigate it if it ever actually gets in the way04:06
lifelesspoolie: please use the code not the URL for oopses - otherwise they get gc'd04:07
pooliehuh04:07
pooliethey get gc'd when there's no open bug that mentions it?04:07
lifelessyes04:09
poolieok lunch04:09
lifelessok, EODing05:00
lifelesstill stub is around05:00
=== al-maisan is now known as almaisan-away
StevenKwgrant: qas is WADLing05:03
wgrantI sometimes wonder if the name was deliberate.05:03
StevenKHaha05:04
* StevenK kicks vocabs more05:06
wgrantStevenK: You don't happen to feel like qa/donotcareing bug #808680, do you?05:22
_mup_Bug #808680: The initializeddistroseries job fails with "permission denied for relation distributionjob" <derivation> <qa-needstesting> <Launchpad itself:Fix Committed by rvb> < https://launchpad.net/bugs/808680 >05:22
wgrantIt's all that's blocking a 48 revision deployment.05:22
StevenKqa-untestable05:22
wgrantIt only affects multiparent initialisation, so I'm tempted to donotcare it.05:23
StevenKSame05:23
StevenKDoit05:23
* wgrant doesit.05:23
* wgrant makes tea while qa-tagger updates.05:23
StevenKwgrant: Do you need a hand putting the deployment request together?05:23
StevenK48? qatagger says 3205:23
wgrant15 ready to deploy, one blocker, 32 behind it.05:24
StevenKThe deployment report should say that05:25
lifelesspatch it up05:25
lifelessits one of our codebases05:25
StevenKOh, sure. In the *oddles* of spare time I have :-P05:27
wgrantMaybe I will decide I've had enough lazr-js for the day and try to fix it.05:28
StevenKBesides, we can't. 1) We are not on maintaince. 2) Even if we were, criticals take priority.05:30
wgrantlifeless: Are you in lpqateam?05:31
wgrantYes.05:31
wgrantlifeless: Could you maybe change the crontab to regenerate lpqateam.canonical.com at 02,12,22,32,42,52, rather than a minute before qa-tagger?05:32
StevenKJust what I wanted. A 131 line traceback05:36
wgrantOh goddammit.05:39
wgrantThere is a third revision involved in the mess.05:40
wgrantI think it's just missing CSS, though.05:40
StevenKIf you say there is another rollback ...05:41
wgrantWith r13421 reverted, collapsibles created by activate_collapsibles (eg. "Extra options" on +filebug, "Configuration progress" on Product:+index) are no longer green.05:52
wgrantNot sure we care for a day or so.05:52
StevenKwgrant: File a critical/high, asign to Danilo, move on?05:53
lifelesshi stub06:13
lifelessstub: I have a present for you06:13
stubLike your cat has a present for you?06:14
lifelessbetter06:14
lifelesshttps://launchpad.net/python-pgbouncer06:15
lifelessstub: I wanted to simulate the 'cannot connect behaviour for the builddmaster06:20
lifelessstub: and realised I had no idea what that meant pgbouncer wise, nor any way of programmatically testing it06:21
stubI will have the answers to your questions today.06:21
lifelessstub: so the new module bring up pgbouncer and should (as stands, or with minor tweaks - e.g. a reload() method to run pgbouncer -R) let us drive it programattically06:22
stubThere are two possibilities to what will happen - the connection is accepted by pgbouncer and is blocked, or the connection gets rejected. Depends on how much control pgbouncer gives me.06:22
lifelessstub: FWICT dropping the user definitions (assuming we're using 'trusted') would block during connection06:23
lifelessstub: that seems to be the only knob I could find that doesn't talk to the backend06:23
stublifeless: http://pgbouncer.projects.postgresql.org/doc/usage.html , in particular PROCESS CONTROLLING COMMANDS06:26
stubI've tested PAUSE and it seems to do what we want, with inbound connections just blocking. I need to test SUSPEND in case we think it better to reject connections rather than queue them up for when things come back online.06:27
wgrantstub: Oh, suspend rejects connections? :/06:28
stubThis is easy and reliable for me to control, as I just open a database connection to the internal 'pgbouncer' database and issue commands with psycopg2 or psql - no need to edit or swap config files in place.06:28
stubwgrant: I don't know about suspend. if we don't want to reject, we use PAUSE.06:29
lifelessstub: I think it better to reject06:29
lifelessstub: unless we can guarantee < 5 second application times (because 5 seconds is the hard timeout for new pages)06:29
stubwgrant: Blocking until the system is back up isn't necessarily the best choice - eg. it might be preferable for appservers to display a 'down for maintenance' message rather than queuing up requests until HAProxy displays a 'down for maintenance' message06:30
wgrantRight.06:30
stublifeless: Yup. Anyway - I'm working on the script today on staging. I should also be able to reliably do 'sudo /etc/init.d/pgbouncer stop' or just kill the pgbouncer processes. That will also reject connections :-)06:31
lifelessstub: indeed :P06:31
wgrantI think this whole no-readonly thing is pretty hideous, but if we're going that direction then immediate notification is better than one based on a timeout.06:31
stublifeless: If you are playing now, just 'sudo pgctlcluster 8.4 main stop' and see what exception you get trying to connect to a database that is not there at all.06:31
lifelessstub: anyhow, we can make the pgbouncer python module support the same thing, so we can test how the appserver etc handle it06:31
lifelessstub: without pgbouncer its OperationalError: connection failure ...06:32
lifelessstub: I can now play with pgbouncer of course :>06:32
stubWhich will be a subclass of psycopg2.Exception (Error?) - probably best to just catch that on connection attempts.06:32
lifelessmmm perhaps; probably needs a code read if we want to be broad06:33
stubWell, we don't really care *why* the connection failed. Unless you want to get into socket exceptions for things like no-route-to-host vs. nothing listening, but there are so many choices there we won't do full coverage.06:34
lifelessindeed06:35
lifelessuhm06:35
stubesp. as they will be coloured by how the firewall rules are (mis)configured06:35
lifelessI don't know if we do don't.06:35
lifelesswill all depend on the most (fast-and-reliable) way to stop pgbouncer letting stuff through06:35
stubI think treating all connection failures the same, and monitoring when scripts don't run for extended periods of time, covers us.06:35
stubThe monitoring will catch the stuffups such as users not existing or dud firewall rules etc.06:36
lifelesssure06:36
lifelessI guess I have a small worry that we'll be down for 30 seconds or something with a maintenance page before anyone starts actually clicking to there being a problem when we didn't plan to go down06:37
=== henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: henninge | Critical bugs: 237 - 0:[######=_]:256
lifelessanyhow, this is minor and contingent on the actual implementation in pgbouncer anyhow06:45
jtvMorning folks.  Any objects to my running process-accepted on dogfood?06:47
wgrantjtv: None, but I think that bug is already QAed...06:47
jtvYou would know — but did you actually Q/A the new feature, or just test that it didn't affect the features we currently rely on?06:48
wgrant--derived seems to behave as specified.06:48
jtvThat's great — thanks!06:48
wgrant(I think it's probably dangerous, but we'll see)06:49
jtvgulp06:49
jtvCare to explain that?06:49
jtvIf it's dangerous, it may be good to be aware of it before we "see."06:50
wgrantGiven that the primary archive publisher is not meant to be bulletproof and unexploitable, automatically publishing every Ubuntu derivative on one machine seems... potentially unwise.06:50
wgrantWhat with the whole running arbitrary shell scripts and stuff thing.06:50
wgrantWith paths configurable in the web UI, albeit only by ~admins at this stage.06:50
jtvArbitrary?06:50
wgranteg. things like Baltix are derivatives of Ubuntu, but probably don't want to go near bilimbi.06:52
poolielifeless: re the postmortem: why not just pop back to the last safe version, rather than landing a reversion?06:56
poolieor rather than landing a reversion first06:56
lifelesspoolie: I'm talking about things we haven't deployed06:57
StevenKpoolie: If we do that then the deployment pipeline stalls for longer than 5 hours.06:57
poolie?06:57
poolieah, so it failed to deploy06:57
lifelessno06:58
lifelessfailed qa06:58
wgrantIt failed QA, was not the head rev so had to be reverted.06:58
wgrantWas fixed, deployed, broke production, rolled back, reverted. Another 5 hours.06:58
pooliewas it deployed or not?06:59
wgrantThe second time.06:59
wgrantIIRC it failed QA the first time.06:59
lifelesspoolie: when it does get through to prod, we do just switch to the previously deployed version, but we still also land a rollback (async from fixing prod)06:59
poolieok i see07:00
lifelessswitching prod versions takes an hour, and then we're blocked on all deploys till the rollback gets through on trunk *and* we're fully qaed.07:00
lifelessits a Real Big Deal, but fortunately fairly rare07:00
pooliethe rollback is to get trunk back to a state on which other changes can be landed07:00
wgrantlifeless: Rolling production back to a previous rev is quick.07:01
wgrantBut still a big pain.07:01
lifelesswgrant: takes a while to walk the server processes07:01
lifelesswgrant: we don't have to stage code, buts its still kinda slow07:02
pooliei guess splitting the test suite here could be good to07:02
poolieto say that changes to bzr probably don't need all the malone pagetests run07:02
pooliethough, doing that manually would probably be tedious07:02
poolieok07:02
wgrantpoolie: Why don't they?07:02
wgrantYou would be unpleasantly surprised :)07:03
pooliethere is a good cost:benefit to running them?07:03
poolieso is switching production versions "quick" or "an hour" or an hour is quick by lp deployment standards?07:04
lifelessits a bit less than an hour07:04
wgrantpoolie: It's quicker than an hour, but an hour is quick.07:04
lifelessbuts it not quick07:04
poolie:)07:04
poolieso the timeline was:07:06
pooliecommitted to devel; rolled out to qas; failed qa; attempted fix; fix rolled out to qas; passed qas(?); rolled out to lpnet; broke production; rolled back on production; reversion merged07:07
poolieis that correct?07:07
lifelessno07:07
lifelesscommitted to devel, rolled to qa, failed qa, rolled back, recommitted with fix to devel, rolled to qa, passed qa, deployed, broke, production switched to prior version and deploys frozen, rolled back on devel, recommitted with fix to devel, ...07:08
lifelessdeployed to qa, deployed to prod07:09
poolieok07:09
poolieso it seems like catching things on qastaging is only a little cheaper than catching them after that?07:13
poolieit's still a lot of work but at least there is no production outage?07:13
lifelessright07:15
lifelessand we can deploy up to the bad commit07:16
lifelesswhich (all too frequently) is useful - its a sign we're closing the queue too slowly07:16
pooliewhat was that python docs -> web service jml used?07:25
pooliertfm something07:25
nigelbreadthedocs?07:25
spivYeah07:26
poolieyep thanks07:26
nigelbpoolie: the shortform, rtfd is more entertaining :)07:26
nigelboh, that was built in 24 hours o.O07:27
adeuringgood morning07:55
jtvhi adeuring!07:59
adeuringhi jtv!07:59
bigjoolsmorning all08:02
mrevellMorning08:09
jtvhi bigjools, hi mrevell!08:09
lifelessallo allo ukians08:10
bigjoolsany ever seen lp.services.job.tests.test_runner.TestTwistedJobRunner.test_memory_hog_job fail in ec2?08:11
bigjoolsanyone*08:11
=== jam1 is now known as jam
bigjoolsI happened to have made changes to IJob in my branch but it passes locally08:11
jtvI remember seeing _some_ failures in that area… hang on, I'll search.08:12
=== almaisan-away is now known as al-maisan
StevenKpoolie: Are you still around?08:15
poolieoui08:15
StevenKpoolie: bazaar-experts has had its celebrityness removed in prod, do you think it's worthwhile to delete the team in a few days?08:16
pooliei do08:16
pooliethanks for cleaning that up08:16
jtvbigjools: not much luck so far, and I'm back more than a month.08:16
poolieyou might want to reply on the thread if it's not already clear08:16
bigjoolsjtv: oh well08:16
bigjoolscould be very spurious.  I'm re-landing.08:16
jtvdanilos: did you see bug 810309?08:20
_mup_Bug #810309: Translator credits appear duplicated <Launchpad itself:Triaged> < https://launchpad.net/bugs/810309 >08:20
jtvbigjools: I need to make some config settings for generate-contents-files; wgrant thankfully discovered something I had neglected to take care of.  Are dogfood and ftpmaster-publish the right, and complete, configs to edit?08:24
bigjoolsjtv: should be08:25
jtvOK, then up for review it goes.08:25
bigjoolswhat did he see?08:25
jtvI didn't set the content_archive_root setting, which points the new script to where the (now legacy) ubuntu-contents dir is.08:25
bigjoolsah that08:25
wgrantApart from that it all looks good and a tad less awful than the shell script :)08:26
jtvOnce we've started using the new script, we can retire that item again; I have a separate bug filed about that.08:26
jtvThanks. :)08:26
wgrantPlus it actually works.08:26
wgrantjtv: Any reason not to start using the script as soon as it's on cocoplum, given that the old one doesn't work any more?08:27
jtvFar as I know, only this one last point.08:27
jtv(Of course there's usually _another_ one last point after that, but we can hope :)08:28
wgrantheh.08:28
jtvI'm trying to take it all in stages and be meticulous about filing kanban cards; seriously scared about missing something.08:28
lifelessStevenK: remind me tomorrow and I'll nuke the team08:30
StevenKlifeless: I think tomorrow is too early, but if you can do it, excellent08:37
lifelessI own it now08:37
danilosjtv, I didn't so far08:42
danilosjtv, this used to be broken in the past but I believe we fixed it08:43
danilosjtv, perhaps we only did so for translator-credits messages, and not for KDE messages08:43
jtvI thought that difference was well-isolated though.08:44
jmlpoolie: rtfd.org08:44
pooliegot it thanks08:44
jtvdanilos: I wonder if the sharing has anything to do with it.  It sounds like somebody changed the message's sharing status.08:45
danilosjtv, well, it seems the "Shared" message is shown even if the message is read-only (there's a read-only icon), so there are a few problems there08:48
danilosjtv, without looking at the code, I can't really say much else :)08:48
jtvIt'd be nice if we could get a maintenance squad on it soon, but I couldn't bring myself to mark it Critical.08:50
wgrantI just closed like 9 criticals, so nobody will notice if you bump it :)08:50
jtvThat's quite a pace… the counter in the topic says 237; is that open ones or closed ones?08:51
=== al-maisan is now known as almaisan-away
wgrantI opted not to update the topic again today; it was back up to 239 before the deploy, but should be down to 230 now.08:52
wgrantWe'll see soon.08:52
wgrant231, sorry.08:52
wgrantSince I just filed a new one.08:52
jtvStill, probably best to resist the temptation to generate Criticals at a higher rate.  :)08:54
wgrant:(08:54
=== almaisan-away is now known as al-maisan
lifelessStevenK: whats the reason for waiting ?08:57
StevenKlifeless: That we can't revert to a pre-celebrity branch if we need to08:59
lifelesswell, could always recreate the team pretty quickly09:11
lifelessbut sure09:11
lifelesshappy to wait09:11
=== wgrant changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: henninge | Critical bugs: 233 - 0:[######=_]:256
jtvStevenK, wgrant: on mawson, I am now planning to (1) put ubuntu-contents back into /srv/launchpad.net, and (2) run generate-contents-files to see that it moves the directory back to where it is now.  Any objections?09:23
lifelessis IDS in use yet ?09:28
jtvInformix Dynamic Server?09:28
lifelessinitialise distro series09:29
jtvIt should be somewhere around the phase where it becomes accessible to colin only.09:30
jtv(AIUI this is all behind the feature flag for the derived distros UI, which is not being enabled for the general public yet)09:31
nigelbwgrant: 233/256, what is 256?09:32
nigelbIn progress or fix released?09:32
lifelesscountdown09:33
nigelbcountdown?09:33
lifelessto 009:33
nigelbdid the countdown reset from a particular date?09:34
=== al-maisan is now known as almaisan-away
nigelbEssentially, why has the numerator changed while the denominator doesn't seem to change09:35
lifelessits not a fraction09:35
StevenKlifeless: Yes, IDS is in use09:36
lifelessits a scalar and a meter09:36
nigelbargh, right.09:37
nigelbSorry.09:37
StevenKlifeless: Currently, it's only used for Ubuntu moving to the next release.09:37
wgrantjtv: Sorry, was eating. Sounds good.09:38
jtvI figured if nobody's responding, nobody's doing anything vital.  :)09:38
jtvIt's currently running.09:39
wgrantHeh09:40
wgrant/srv/launchpad.net/ubuntu-contents is gone, which can only be a good sign.09:40
* danilos tries to get expanders landed again...09:44
lifelessdanilos: the landing isn't the hard bit :)09:46
daniloslifeless, well, sometimes it is09:46
lifelessdanilos: sure, I mean in this case09:46
StevenKThe landing is easy. Having it *stay* landed is hard :-)09:47
daniloslifeless, well, the fix would have been landed sometime on Friday if there was not a test testing for the presence of the img tag09:47
daniloslifeless, and no reversion would have had to happen :)09:47
lifelessah true09:47
danilosof course, running lp.soyuz tests wasn't enough, so it was 5h of testing, and me being away from any computers over the weekend that made it impossible to go through :)09:48
danilosanyway, this code has gone through ec2/buildbot so many times that it has been well tested by now :)09:48
cjwatsonlifeless: do your comments on https://code.launchpad.net/~cjwatson/launchpad/multiarch-translations-schema/+merge/67992 amount to an approval?10:05
lifelesspreferable for stub to do so10:07
lifelessif he was on leave, they would.10:07
cjwatsonah10:07
cjwatsonhe did approve the version in https://code.launchpad.net/~cjwatson/launchpad/multiarch-translations/+merge/67640 (admittedly before I renamed the column)10:08
cjwatsonbut then I split out that change into a separate branch for the new schema changes process10:08
=== almaisan-away is now known as al-maisan
=== jtv is now known as jtv-eat
daniloshuwshimi, Hi, do you perhaps have a minute to discuss CSS sprites issue (bug 812044)?10:12
_mup_Bug #812044: Expanded suggestions on +filebug leak branch icon <regression> <ui> <Launchpad itself:Triaged> < https://launchpad.net/bugs/812044 >10:12
cjwatsonjtv-eat: if that Colin means me, I hope it'll actually be ~ubuntu-release rather than me personally10:14
cjwatsonotherwise opening p-series will be blocked on me, rather than in practice normally being done by me :-)10:14
huwshimidanilos: Hey, sure10:26
=== al-maisan is now known as almaisan-away
=== henninge is now known as henninge-lunch
=== henninge-lunch is now known as henninge
daniloshuwshimi, if you've got any ideas, please add them to the bug10:56
=== matsubara-afk is now known as matsubara
huwshimidanilos: Where can I see this bug in action?11:08
huwshimidanilos: Is it in someone's branch?11:08
daniloshuwshimi, local LP instance (fresh devel), go to bugs.launchpad.dev/firefox/+filebug search for "a"11:09
huwshimidanilos: Thanks11:11
=== jtv-eat is now known as jtv
jtvcjwatson: don't worry too much — the "we'll let Colin see it" situation was always meant as temporary, for testing.11:19
cjwatsonok11:23
LPCIBotProject devel build #895: FAILURE in 5 hr 57 min: https://lpci.wedontsleep.org/job/devel/895/11:26
=== henninge is now known as henninge-lunch
jtvCan anyone help me figure out my bzr config for lp-production-configs?11:31
jtvI'm getting this error from PQM: "Exception processing merge: unknown url type 'bzr+ssh://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable'"11:32
jtvNo idea where either the "launchpad" (as opposed to lp-production-configs) and the "stable" come from.11:32
jmljtv: use one of the debugging options on pqm-submit to figure out what email it's sending. (dry-run or verbose or something)11:34
jtvthanks11:34
jtvyup, it's --dry-run11:34
jtvstar-merge bzr+ssh://bazaar.launchpad.net/~jtv/lp-production-configs/config-810986 bzr+ssh://bazaar.launchpad.net/~launchpad-pqm/lp-production-configs/trunk11:35
jtvThat's what PQM produces.11:35
=== almaisan-away is now known as al-maisan
bigjoolsjtv: --submit-branch FTW11:52
jtvbigjools: but then why doesn't the submit_branch setting in my locations.conf do the same?11:53
bigjoolsjtv: is the branch in the location you think it is?12:00
jtvI was wondering whether that mattered, given the incorrect path in the error message.12:01
jtvI'm trying though.12:01
jtv"bzr info bzr+ssh://.../config-810986"12:01
jtvYup, that works.12:01
jtvNow trunk: that works as well (apart from some garbage output from bzr)12:02
=== benji changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: henninge, benji | Critical bugs: 233 - 0:[######=_]:256
=== henninge-lunch is now known as henninge
jtvAhh, worked this time.12:15
adeuringderyck: henninge: microphonde does not today... let try...13:30
deryckabentley, ping for standup13:32
=== gary-lunch is now known as gary_poster
adeuringcan't even open the audio assistent...13:33
adeuringno luck...13:33
deryckadeuring, we're moving to skype, so I'll call you there for the standup/.13:34
adeuringderyck: ok, just two minutes to strat another machine where skype is installed13:34
deryckadeuring, ah, ok.  np.13:35
deryckadeuring, we'll start and dial you in if we can.13:38
adeuringderyck: I'm online on sykpe13:38
deryckadeuring, you seem to drop immediately when abentley invites.13:39
abentleyadeuring: Skype says you're not online and it doesn't work when I invite you, either.13:39
adeuringlet me restart skype...13:39
adeuringdone13:39
deryckadeuring, not working, sorry.13:40
abentleyadeuring: still not working.13:40
deryckadeuring, we'll come back to you on IRC.13:40
adeuringok13:40
allenapbenji: Up for a short JavaScript review? https://code.launchpad.net/~allenap/launchpad/localpackagediffs-filter-by-package-set-bug-809786-refactor/+merge/6823314:03
benjiallenap: sure14:04
allenapThanks.14:04
benjiallenap: approved14:17
allenapbenji: Thanks :)14:17
benjiallenap: Invoking Y.use in a loop isn't something I've seen before.  (Not that it's bad, it just surprised me.)14:18
allenapbenji: I hope it works ;)14:18
abentleyhenninge: I've merged from stable, but lp:~abentley/launchpad/json-serialization still has failures: http://pastebin.ubuntu.com/646546/14:29
henningehm14:30
henningelet me look a little closer14:31
daniloshenninge, benji: anyone wants to pick up https://code.launchpad.net/~danilo/launchpad/bug-812044/+merge/68263 (60 lines of diff)14:53
=== henninge changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: benji | Critical bugs: 233 - 0:[######=_]:256
henningedanilos: I am not, sorry. ;)14:54
henningeabentley: look at this anonymously: https://answers.qastaging.launchpad.net/14:54
daniloshenninge, you bastard! :)14:54
danilosbenji, hi, a very short branch up for review if you can find the time to look at it14:55
henningedanilos, benji: nm me, I'll take it14:55
benjik14:56
abentleyhenninge: look at the mouseover text of why no "joe@example.com in question"14:56
henningeabentley: I know ...14:57
henningeabentley: I wonder why your test passes (or were you fixing that?)14:57
abentleyhenninge: What test do you mean?14:57
henningeabentley: the one from your paste14:58
abentleyhenninge: That test fails.14:58
abentleyhenninge: for me, anyhow.14:58
abentleyhenninge: You mean why does it pass on trunk?14:58
henningeabentley: oh, sorry, but other tests pass that should fail14:58
abentleyhenninge: I have ignored email obfuscation because I knew you were working on that.14:59
henningein question-obfuscation.txt14:59
henningedanilos: why did you not fix the jslint warnings?15:00
daniloshenninge, it's very old code, I just didn't bother, I can though15:01
daniloshenninge, I also wanted to avoid having to QA the file bug form extensively as well15:01
henningeI think you should, unless it somehow relies on =='s casting behavior15:01
daniloshenninge, sure, I can do it15:04
henningedanilos: thanks, otherwise it looks fine to me. r=me15:05
daniloshenninge, cool, thanks15:05
henningeabentley: the test passes in devel. What is different in your branch?15:21
* henninge pulls stable15:22
abentleyhenninge: In my branch, the anonymous user can see all cache objects, and the jsoncache rendering is done in LaunchpadView.getCacheJSON15:23
abentleyhenninge: my bad, the anonymous user is still restricted to just the context: https://pastebin.canonical.com/49879/15:26
nigelbmrevell: hi, you around?15:31
henningeabentley: I am glad that's figured out15:34
mrevellnigelb, I'm on the phone at the moment15:35
=== al-maisan is now known as almaisan-away
abentleyhenninge: nothing is figured out.  I still don't know why the email address is not being obfuscated.15:35
henningeabentley: oh15:35
henningemisread you15:35
abentleyhenninge: where did you do the obfuscation?15:36
henningeabentley: in the marshaller15:37
henningeabentley: maybe your code does not go through that?15:37
abentleyhenninge: Does the marshaller not provide ResourceJSONEncoder?15:38
henningeabentley: don't think so (I never heard of it)15:38
henningeabentley: the marshaller is for a specific field type15:39
abentleyhenninge: The ResourceJSonEncoder is provided by lazr.restful.tales.15:39
abentleyhenninge: Okay, so where is the marshaller and how is it used?15:49
henningeabentley: lib/lp/app/webservice/marshallers.py16:01
henningeabentley: zcml/override-includes/ws-marshaller-configure.zcml16:01
henningeabentley: I am sorry, I gotta run now.16:02
abentleyhenninge: okay.16:02
henningeabentley: the lazr-restful code does the apdapter lookup16:04
henningeabentley: adeuring should know all about that, too16:05
=== deryck is now known as deryck[lunch]
=== matsubara is now known as matsubara-lunch
=== beuno is now known as beuno-lunch
LPCIBotYippie, build fixed!17:02
LPCIBotProject devel build #896: FIXED in 5 hr 35 min: https://lpci.wedontsleep.org/job/devel/896/17:02
=== deryck[lunch] is now known as deryck
=== salgado is now known as salgado-lunch
=== beuno-lunch is now known as beuno
jcsackettsinzui: time to chat?17:46
jcsackettbenji: any time for a review? https://code.launchpad.net/~jcsackett/launchpad/form-macros-frighten-me/+merge/6827717:50
benjijcsackett: sure thing17:50
jcsackettthanks!17:50
benjijcsackett: I take it that there's some sort of quoting issue that neccesitated using \x22 for the double-quote character on line 42 of the diff.17:54
jcsackettbenji: i believe so. almost all that code is as it was written before, just moved out of the template and into a js file.17:55
benjiwe'll let sleeping escape sequences lie17:55
benjijcsackett: add done17:59
jcsackettthanks, benji.17:59
benjimy pleasure18:00
sinzuijcsackett, sorry, I did not see you message. I can chat now if you like18:10
jcsackettsinzui: sure. be on mumble in a moment.18:10
abentleygary_poster: For anonymous access to the web site, is request.principal None or does it provide IUnauthenicatedPrincipal?18:16
=== matsubara-lunch is now known as matsubara
=== salgado-lunch is now known as salgado
gary_posterabentley, should provide18:27
gary_posterabentley, sorry just saw this :-/18:27
abentleygary_poster: np.18:28
=== almaisan-away is now known as al-maisan
=== benji is now known as Guest43852
=== al-maisan is now known as almaisan-away
abentleygary_poster: in doctests such as lib/lp/answers/stories/question-obfuscation.txt, it appears request.user may be None.  Is that a bug?18:33
gary_posterabentley, I've seen that stuff in out doctests before.  I believe it is a bug in our test infrastructure, yes.18:34
gary_posterabentley, that, or the test is representing an incomplete state.18:34
gary_posterthat's doubtful to be intentional though18:35
abentleyShould (view.user is None) ==  IUnauthenticatedPrincipal.providedBy(request.principal) ?18:36
gary_postermm...18:37
gary_posterabentley, Zope itself does not have a contract for the view other than __call__.  It has a convention of 'request' and 'context' but they are not required from the perspective of the publishing or security machinery.  I'm not sure what in Launchpad sets up view.user; I expect LaunchpadView.  I'll look there for a moment18:38
gary_posterabentley, user in LaunchpadView is getUtility(ILaunchBag).user18:39
gary_posterI'll look there now18:40
gary_posterabentley, there are multiple implementations of the ILaunchBag, including at least three test stubs, one of them apparently intended to be general purpose (lib/canonical/launchpad/tests/test_helpers.py)18:41
gary_posterabentley, that one defaults to user=None18:42
gary_posterabentley, so that is at least one case in which tests would have a user of None.  I'll look at the "real" implementation now...18:43
gary_posterabentley, yes, it looks like the launchbag's user can be None, it the principal cannot be adapted to IPerson18:44
gary_posterand I expect we do not have an IPerson implementation for anonymous18:44
gary_posterabentley, I'm stopping looking now. :-)18:44
abentleygary_poster: I'm actually experiencing the case where request.user is None, so it doesn't provide IUnauthenicatedUser, which is causing it to be treated as an authenticated user.18:44
abentleygary_poster: thanks for having a dive into it.18:45
gary_posterabentley np.  As I said, I suspect that's a test infrastructure unpleasantness.  I'm pretty sure I could find the Zope code that stuffs an unauthenticated principal on the request if you said that would be helpful.18:46
abentleygary_poster: I'm not sure what the right way to proceed is.  Is IUnauthenticatedPrincipal.providedBy(request.principal) the best way to detect whether the user is authenticated?  I guess I could ask the LaunchBag instead...18:48
gary_posterabentley, within the context of Launchpad, and Launchpad tests, the LaunchBag would be the path of least resistance, I think, given what you've seen.18:49
gary_posterand not a horrible one--plenty or precedent18:49
gary_posterof18:49
abentleygary_poster: Okay, thanks very much.18:53
gary_posternp18:53
sinzuiflacoste, ping18:58
lifelessgood morning :)19:15
jkakarHiya lifeless. :)19:19
lifelesshi jkakar19:20
flacostehi sinzui19:26
sinzuiflacoste, do you have a few minutes to mumble about bug linking/dependencies?19:26
flacostesinzui: i'm on the phone already, will be a long one, i'll ping you afterward19:31
sinzuithank you19:31
=== matsubara is now known as matsubara-afk
=== Ursinha is now known as Ursinha-nom
lifelesssinzui: is that the call you wanted me on ?20:27
sinzuilifeless, no. I think I know you you and OEM think my team is doing dependencies. There are TWO bug linking features planned in the next 3 months. It is very confusing and they obviously overlap20:29
lifelesswin20:29
wgrantI guess I should revert that sendbranchmail thing.20:37
=== wgrant changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: benji | Critical bugs: 237 - 0:[######=_]:256
wgrantconflicts :(20:39
wgrantallenap: I guess we should not deploy anything between r13460 and r13464?20:49
flacostelifeless: skype?20:54
lifelessringing you20:55
lifeless(yes)20:55
flacostelifeless: yeah, skype crashed20:55
lifeless\o/20:55
=== salgado is now known as salgado-afk
flacostelifeless: can you try again?20:56
flacostesinzui: can i skype you in with lifeless?21:22
lifelesssinzui: is your skype working ?21:22
* sinzui thinks so21:23
=== statik` is now known as statik
mwhudsonwgrant: have you spent the week i've been on leaving reverting the same branch over and over again?21:56
=== benji changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | On call reviewer: - | Critical bugs: 237 - 0:[######=_]:256
wgrantmwhudson: No, several different ones :(22:03
wgrantI've never reverted any one more than three times, though.22:04
mwhudsonthere's a first time for everything i guess22:04
wgrantAnd they only sometimes get ontoproduction and break it in a different way each time :)22:04
mwhudsoni guess that's a bit less terrible than breaking production the same way each time22:05
wgrantThey do that sometimes too.22:05
LPCIBotProject db-devel build #730: FAILURE in 5 hr 37 min: https://lpci.wedontsleep.org/job/db-devel/730/22:24
=== Ursinha-nom is now known as Ursinha
LPCIBotProject devel build #897: FAILURE in 5 hr 37 min: https://lpci.wedontsleep.org/job/devel/897/22:40
sinzuiStevenK, mumble?23:01
pooliehullo sinzui23:13
sinzuiahoy oy poolie23:13
pooliewgrant: hi, following on from yesterday's question23:15
pooliedo you think it would be feasible to change lp so that it always exposes debian publications before it does the derived ubuntu packages?23:15
wgrantpoolie: No.23:16
wgrantIt's impossible to determine.23:16
wgrantAnd any approximation would just delay and anger people.23:17
poolie... because it will mostly end up delaying the ubuntu package record, and that's often not needed and annoying?23:18
wgrantYes.23:18
wgrantI'm not sure anybody would consider making Launchpad slower to be a feature.23:18
poolie:)23:18
poolieif we want to take the course of delaying the ubuntu package, we could do that only in udd where it's needed23:19
wgrantpoolie: We should do two things:23:19
wgrant - Get the Debian import to be more up to date.23:19
wgrant - Fix UDD.23:19
poolieso, more up to date means running it more often?23:20
wgrantOr perhaps merely at more appropriate times.23:20
wgrantBut more often is always good.23:20
wgrantNo reason not to.23:20
poolieit's not outrageously expensive or slow?23:20
wgrantdebmirror should be trivial if the indices haven't changed, and if they have changed then we want to reimport.23:20
poolieright23:20
wgrantAnd iron doesn't do anything useful.23:21
pooliedo you know how frequent it would be now, or should i ask a losa what's in the cron job23:21
wgrantI pasted the crontab lines yesterday.23:21
* wgrant finds.23:21
wgrant52 2,8,14,20 * * * sh /srv/debian-import.launchpad.net/scripts/mirror-update.sh >> /srv/debian-import.launchpad.net/production-logs/mirror-update.log 2>&123:21
wgrant05 3,9,15,21 * * * LPCONFIG=gina /srv/debian-import.launchpad.net/production/launchpad/scripts/gina.py lenny squeeze sid experimental wheezy >> /srv/debian-import.launchpad.net/production-logs/gina.log 2>&123:21
pooliewhere did you find them?23:22
StevenKlp-production-crontabs, I daresay23:23
wgrantYes.23:23
wgrantiron-launchpad in lp:lp-production-crontabs23:23
poolieperhaps eventually it would be good to have something that just runs continuously rather than from cron23:24
poolieor, continuously with a short pause in between23:24
wgrantGiven what it has to do, that's no better than a */1 cron job.23:25
pooliei guess so23:26
pooliebecause they all have lock files to prevent concurrent runs?23:26
wgrantNo, but they would if we bumped it to */1.23:26
wgrantThe two scripts would run as a single frequent job, with locking, and only executing gina if the mirror changed.23:27
poolieso if we set it to /1 at the moment they would get into trouble, but if we added a lock file they would cope?23:27
wgrantRight.23:27
lifelesspoolie: also because folk directly upload sometimes23:27
poolie?23:27
wgrantOccasionally.23:28
lifelesspoolie: ubuntu having a version before debian is a normal, if rare, situation23:28
poolieright23:28
lifelesschanging how we import debian won't avoid it23:28
pooliewell23:32
pooliereducing the latency will reduce the number of confusing situations23:32
poolieit can't totally avoid it23:32
poolieok bug 81259723:36
_mup_Bug #812597: gina imports from debian arrive too slowly <gina> <udd> <Launchpad itself:Triaged> < https://launchpad.net/bugs/812597 >23:36
wgrantpoolie: Are you sure that's the case?23:37
StevenKpoolie: The Debian archive is only published every six hours, whereas Ubuntu is published every hour.23:38
StevenK*And* we do the possibly of syncing from Debian incoming if we wish.23:39
StevenKs/do /do have /23:39
wgranthttp://webnumbr.com/launchpad-critical-bugs23:51
=== 64MAAWTQK is now known as wallyworld
=== lifeless changed the topic of #launchpad-dev to: Performance Tuesday | https://dev.launchpad.net/ | On call reviewer: - | Critical bugs: 237 - 0:[######=_]:256

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!