/srv/irclogs.ubuntu.com/2011/02/13/#launchpad-dev.txt

wgrantAh, the Soyuz OOPS report is a bit happier today.02:02
wgrantlifeless: :(02:27
wgrantArchive:+index's soft timeouts have gone away.02:27
wgrantOur exception counts are 20% lower than pre-release, soft timeouts down by more than 60%.02:28
wgrantYay.02:28
lifelesswgrant: cool02:45
lifeless     219 /  432  BugTask:+index02:46
lifeless      90 /  241  Distribution:+bugs02:46
lifelessnext up02:46
lifelessI think Monday is 'remove substring search' day02:46
wgrantHeh.02:56
wgrantHmm02:58
wgrantUnbreak checkwatches, or split it into its own report?02:58
wgrantThe former will take quite a while, I suspect.02:58
wgrantParticularly since it uses OOPSes somewhat differently to the rest of the world.02:58
lifelesswgrant: unbreak03:03
lifelesssplitting it into its own report makes the daily report analysis harder, while not making the checkwatches component easier.03:03
lifelessits a pessimism - just like having a soyuz specific report03:03
wgrantRight.03:05
wgrantBut checkwatches is designed to use OOPSes for warnings.03:05
lifelesswe should get an oops when we need to take an action03:06
lifelesscheckwatches seems to be in a little bit of a grey area03:06
wgrantHmm.05:05
wgrantWe seem to have a major performance issue with update-bugtask-targetnamecaches.05:05
wgrantIt is again taking >18 hours.05:05
wgrantI think I will delete it.05:06
wgrant:( things still use it.05:07
wgrantPerhaps selecting distinct targets and updating changed ones will be better and easy.05:07
wgrantWell, that looks like it should take about 10 seconds.05:11
wgrantYeah.05:12
LPCIBotProject devel build (436): FAILURE in 5 hr 37 min: https://hudson.wedontsleep.org/job/devel/436/06:20
lifelesswgrant: what uses it?08:51
wgrantlifeless: I guess search is the only thing that can't calculate it on-the-fly.09:00
wgrantBut tables and titles use it too.09:00
lifelessgrah09:03
lifelesswell, fix that.09:03
lifelessno good reason for it to be used; we load the related objects always anyway.09:03
wgrantFix what? The non-search uses?09:04
lifelessyes09:04
lifelessthe search use I'm going to put behind a FF tomorrow09:05
wgrantAha.09:05
wgrantThen turn it off and see if anyone notices?09:05
lifelesshey, why does the cache updater touch every bug? surely just 'bugs changed since the last run' is sufficient.09:05
wgrantproduct renames, I suspect.09:05
lifelesswgrant: well, turn it off for lp devs, test the improvement, then wider etc.09:06
wgrant:(09:06
lifelesswgrant: products have a datestamp09:06
wgrantA 'when my display name was last changed' datestamp?09:06
lifelesswgrant: doesn't matter09:06
lifelessactually no09:07
lifelessproduct doesn't have a mod date09:07
lifeless*fail*09:07
wgrantThat's what I thought.09:07
wgrantMost stuff doesn't.09:07
wgrantThe only mandatory fields are owner and datecreated.09:07
lifelessok, so product and sourcepackagename [blech - this is crazy to normalise such fields] - need a last_modified09:07
lifelessand distribution09:08
lifelessor09:08
lifelessjust ditch all use of it09:08
lifelessits really uninteresting09:08
lifelessI think we can remove all uses by friday, with care and caution09:08
wgrantYeah.09:08
wgrantWe could disable it until then.09:09
lifelessnew data is updated by hand, right ?09:09
lifelessI mean, new bugs have a valid cache value09:09
wgrantYes.09:09
wgrantI'm not sure if task moves are.09:09
wgrantBut I presume so.09:09
lifelesswoo 12365 hath landed09:10
wgrantYep.09:10
lifelesshmm09:10
lifelessDoes staging have the render time on it yet09:10
wgrantIt should...09:10
wgrantEven the FF should have propogated by now.09:11
lifelessnope09:11
lifelesshttps://staging.launchpad.net/+feature-rules09:11
lifelesswgrant: loggerhead really needs some time09:16
lifelesswgrant: jam has prepped patches to fix the biggest issues; they need review and landing09:17
wgrantAh, great. I'll have a look tomorrow.09:17
lifelessthat would be awesome09:17
=== almaisan-away is now known as al-maisan
=== al-maisan is now known as almaisan-away
LPCIBotProject db-devel build (362): FAILURE in 5 hr 18 min: https://hudson.wedontsleep.org/job/db-devel/362/15:43
LPCIBotLaunchpad Patch Queue Manager: [rs=buildbot-poller] automatic merge from stable. Revisions: 1236715:43
LPCIBotincluded.15:43
LPCIBotProject devel build (437): STILL FAILING in 14 min: https://hudson.wedontsleep.org/job/devel/437/16:01
thumpermorning20:15
thumpertethering with Rachel's phone is working20:15
thumperso I'm off to town to get a haircut :)20:16
lifelessmwhudson: what is 'mkdir -p /var/tmp/vostok-archive20:17
lifeless'20:17
lifelessfor20:17
mwhudsonlifeless: i think it's a DocumentRoot for apache20:20
mwhudsonthat stuff is all stillborn though :/20:20
lifelessmwhudson: also https://code.launchpad.net/~mwhudson/lp-production-configs/no-more-launchpad-loggerhead/+merge/2436620:21
lifelessmwhudson: land or delete IMO20:21
mwhudsonoh oops, that should be landed20:22
mwhudsonlifeless: do we still use the production-devel and production-stable branches?20:23
lifelessno20:24
lifelesswe deploy from stable20:25
mwhudsonlifeless: so the config-manager/production-{stable,devel} files can go?20:25
lifelesswe have a vestigial process to use production-stable if we have something that has to be embargoed all the way20:25
lifelesswe haven't used it in 6 months though20:25
mwhudsoni guess i don't need to care about those files referencing launchpad-loggerhead, anyway20:25
lifelessmwhudson: also, while you are around20:26
lifelesswhats the deal with the different theme in lp's loggerhead20:26
mwhudsonat the time the idea was just to make the launchpad loggerhead blend in with the lp colour scheme a bit more20:26
lifelessmwhudson: it seems to be a different colour scheme than lp itself has though ?20:27
mwhudsonit may have been less different once20:27
mwhudsonthe 'codehosting orange' matches up, at least20:28
lifelesscodehosting oragne?20:28
* mwhudson realizes that that probably wasn't useulf20:28
mwhudsonlifeless: the colour the h1 is in on https://code.launchpad.net/~mwhudson/lp-production-configs/no-more-launchpad-loggerhead20:29
mwhudsonis used in the lp loggerhead theme20:29
lifelessoh20:29
lifelessI'd always thought the h1's were arbitrary20:29
lifelessnice20:43
lifelessbest overall 99th percentile yet, I think20:44
lifeless2.63 - https://devpad.canonical.com/~lpqateam/ppr/lpnet/latest-daily-categories.html20:44
lifeless6M renders20:44
michaelh1Morning.  How can I register my application with login.lp.net so that I can get group membership information?21:00
* mwhudson listens carefully21:00
lifelesslosas do that21:12
michaelh1lifeless: sorry, I don't understand21:42
lifelessmichaelh1: you need to talk to a losa21:50
lifelessthe operators of login.ubuntu.com21:50
lifelessmichaelh1: login.lp.net is just a theme on l.u.c.21:50
* thumper is futzing around with lazr.restful again21:52
thumpertests failed on Friday21:52
thumperdue to the fix I did21:52
thumperthe tests need to be updated, as it is working now as designed21:52
lifelesswgrant: around?22:32
wgrantlifeless: Yup.22:33
wgrantmwhudson: Except that codehosting orange's reign ended yesterday.22:33
lifelesswgrant: I'm wondering if I could ask you to do the rollback for https://bugs.launchpad.net/launchpad/+bug/63284722:33
_mup_Bug #632847: Bug page OOPS when viewed in deactivated project context <404> <lp-bugs> <oops> <qa-needstesting> <Launchpad itself:Fix Committed by jcsackett> < https://launchpad.net/bugs/632847 >22:33
mwhudsonwgrant: hence 'at the time' :)22:34
wgrantWhat's broken?22:34
lifelesswgrant: correlated subquery on every bug search by a logged in user ?22:35
lifelesswgrant: back to product for disabled products - something like 5% selectivity.22:35
lifelesswgrant: its madness and will break performance22:35
wgrantAh, I hadn't actually looked at the diff yet.22:35
wgrantHave you tested the performance hit on qastaging?22:36
wgrantYes, it looks bad, but I'd like to have something more concrete before I roll something back.22:36
lifelessok22:41
lifelessI'm going to make you an admin of ~registry on qastaging22:41
lifelessand now I've removed ~launchpad from it22:42
lifelessOOPS-1870QS55)22:44
lifelesswgrant: I've added another comment22:45
wgrantThanks.22:45
wgrantmwhudson: What do you think about https://code.launchpad.net/~mwhudson/lp-production-configs/remove-production-max_workers_per_machine/+merge/19671?22:46
* thumper wipes brow22:55
thumperphew22:55
thumpericky tests fixed22:55
wgrantlifeless: Rolling it back.22:56
wgrantBut it'll be a couple of hours.22:56
wgrantSince the queue is up to three items.22:56
lifelesswgrant: thanks22:58
lifelesshmm22:58
lifelessI can't seem to login to qastaging with a slightly old lp lib22:59
lifelesslaunchpad.Launchpad.login_with('hello-world', 'https://qastaging.launchpad.net/')22:59
lifeless-> 40422:59
wgrantThat's no service root.22:59
wgrantapi.22:59
lifelessthanks23:03
thumperlifeless: 86 queries/external actions issued in 1.78 seconds23:17
thumperlifeless: this is just for devs yeah?23:17
thumperon the main page23:17
lifelessyes23:17
lifelessits controlled by a feature flag23:18
lifelessthumper: do you like it?23:18
thumperyep23:18
Ursinhamorning people23:21
huwshimiUrsinha: Hello23:22
Ursinha:)23:22
Ursinhahuwshimi, why aren't you on our team's channel? :)23:23
huwshimiUrsinha: Oh23:23
UrsinhaI understand, we all live in the past :P23:23
lifelessyou have a team channel?23:23
huwshimiUrsinha: yeah no-one is ever awake there :)23:24
Ursinhalifeless, yes sir23:24
wgrantlifeless: Hum, targetnamecache is used for sorting too.23:26
wgrantI wonder if anyone ever uses that.23:26
wgrantlifeless: Do you have a problem with removing targetnamecache from the UI, turning off the cron job (or maybe taking it weekly or something), and hoping that nobody notices that sort order doesn't update when they rename their products?23:45
lifelesswhen is it used for sorting23:45
wgrantWhen you order bug search results by location.23:46
lifelessis that used?23:47
wgrantOccasionally by Ubuntu.23:47
wgrantWhere targetnamecache never changes.23:47
wgrantIt could also be used in a project group context, I suppose.23:48
lifelesssure it can23:48
lifelessretarget source package23:48
lifelessbut you mean 'where the thing targeted changes value23:48
wgrantWell, yes.23:48
lifelesswgrant: so, I suggest a similar discussion to mine about search23:48
lifelessblog + launchpad-users + microblog links23:49
lifelessand/or23:49
lifelessweb log analysis23:49
lifelesswgrant: we can efficiently support this, if its useful23:49
wgrantRight.23:50
lifelessif its not useful we should drop the column23:50
lifelesswgrant: to answer your question23:50
lifelessa) happy to switch from the targetname cache in the UI to the raw data; that or actually transition to not loading the related things at all, but that seems improbable to me23:50
lifelessb) fixing the cron job is pretty straight forward, if tedious23:51
lifelesswgrant: I agree we need to fix the short term pain23:53
lifelesswgrant: its up to you to choose how, I think.23:53
wgrantI will remove it from the UI and rewrite the script to do a batch update. Requires no model changes, should be a lot quicker, and won't take long to do.23:54

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!