/srv/irclogs.ubuntu.com/2010/11/27/#launchpad-dev.txt

maxbCan anyone disclose acceptably public bits of OOPS-1792H33, pertaining to the current conversation in #launchpad ?00:29
wallyworld__maxb: what do you need to know?00:40
wallyworld__maxb: looks like it was having a problem rendering the comments associated with a mp00:41
wgrantjelmer: You say in bug #681974 that you flush, but you need to commit before any other process can see it.00:45
_mup_Bug #681974: build processed with uploadprocessor while it is still set to BUILDING <Soyuz:Triaged by jelmer> <https://launchpad.net/bugs/681974>00:45
maxbwallyworld__: Can you pastebin the traceback, unless you suspect there's private info there?00:51
wgrantlifeless: Ugh, that ec2 run might have hung.00:52
wallyworld__maxb: i'll have a look00:52
wgrantcanonical-config.txt in my local run exploded and hung, and the 600s timeout didn't operate.00:52
wgrantAlthough it passes fine on its own... sigh.00:52
wallyworld__maxb: https://pastebin.canonical.com/40201/00:54
=== nigelbabu is now known as nigelb
lifelesswgrant: no, it genuinely failed03:47
wgrantlifeless: Huh. Around canonical-config.txt?03:48
wgrantAh, got it.03:49
wgrantlifeless: It did hang.03:49
lifelesswgrant:  ok03:49
wgrantIt just also had some proper failures.03:49
lifelesswgrant: I didn't look :)03:49
lifelesswgrant: I meant 'I got mail'03:49
wgrantThanks.03:49
wgrantI'm rerunning it locally after fixing canonical-config.txt.03:50
lifelessbah, sqlalchemy mappers don't do what I want :(03:51
lifelessThese class attributes exist as Python descriptors, and define instrumentation for the mapped class. The functionality of this instrumentation is very rich and includes the ability to track modifications and automatically load new data from the database when needed.03:52
lifeless=== Top 10 Time Out Counts by Page ID ===03:58
lifeless    Hard / Soft  Page ID03:58
lifeless      99 / 4871  Archive:+index03:58
lifeless      75 /  256  BugTask:+index03:58
lifeless      13 /  302  Distribution:+bugs03:58
lifeless      10 /  347  Distribution:+bugtarget-portlet-bugfilters-stats03:58
lifeless       8 /  122  ProjectGroupSet:CollectionResource:#project_groups03:58
lifeless       7 /  156  POFile:+translate03:58
lifeless       5 /   96  Question:+index03:58
lifeless       5 /   14  DistroSeriesLanguage:+index03:58
lifeless       5 /    5  ProjectGroup:+milestones03:58
lifeless       5 /    0  DistributionSourcePackage:+filebug-show-similar03:58
lifelesswgrant: tell me when to pull :P04:08
lifelesswgrant: so, how did you go?05:01
wgrantlifeless: Rerunning the test suite, found a couple more failures.05:01
wgrantStill going.05:01
wgrantJust installed a VM in which to run the test suite, so I can develop in parallel.05:02
wgrantYay for now having lots of RAM.;05:02
lifelesswgrant: and with this, you can run tests in parallel ;)05:02
lifelesshow many GB of memory do yiou have?05:02
wgrantlifeless: Well, yes, that's why I'm now so interested in this stuff :P05:06
wgrant8GiB.05:06
lifelesscool05:06
wgrantlifeless: Quite a few test failures have shown up now that canonical-config.txt is fixed to not obliterate the config. :(05:20
wgrantMost seem to be script-related, though.05:21
lifelessthank you for pulling on tihs05:22
wgrantNo more testrunner explosions, so it looks like it was only canonical-config.txt that was being really bad.05:25
wgrantI guess once this is fixed, the librarian stuff should mostly fall into place.05:28
lifelesswgrant: well, I hope so :)05:28
lifelesswgrant: I'm not aware of any actual bugs in the librarian branch05:28
wgrantWell, all the scripts will be using the right config.05:28
lifelesswgrant: any luck?07:57
wgrantlifeless: Been doing other stuff, but looking at various isolation issues now.08:02
lifelessif you want to bounce them around feel free08:02
afuentesIs there a page in launchpad with stats about launchpad?09:08
afuenteslike more active projects?09:09
lifelessjml: lp.testing.monkey_patchs looks redundant with testtools patch to me17:35
lifelessjml: does it to you?17:35
=== Edwin is now known as Guest66935
=== _mup__ is now known as _mup_
=== nigelb is now known as Guest81825
=== elmo_ is now known as elmo
=== ]reed[ is now known as [reed]
jmllifeless_: maybe. will look into it soon.19:39
* jml gotta run19:39
=== lifeless_ is now known as lifeless
lifelesswallyworld: http://docs.jboss.org/hibernate/core/3.3/reference/en/html/queryhql.html - you've worked with this in detail, right ?20:01
=== wgrant_ is now known as wgrant
* wgrant stabs Windmill.20:50
lifelessgood morning to you too20:51
wgrantMorning.20:51
wgrantA few test runs later, I've fixed another couple of issues, seem to be down to fourish real failures. But Windmill hung overnight so I don't know for sure.20:51
wgrantAnd now the testrunner won't wake up.20:52
lifeless:(20:52
wgrantlifeless: What was your intention with BaseLayer.appserver_config? In some places it's used as a method, in others an attribute. In some it needs to contain a ConfigFixture, in others a CanonicalConfig.20:53
wgrantFor now I've moved the fixture to appserver_config_fixture, and things seem to work a bit better.20:54
lifelessmm20:54
lifelesswgrant: its meant ot be a fixture and never a CanonicalConfig20:56
lifelesswgrant: I think you're confused by LayerProcessController20:56
lifelessoh.. I see20:56
wgrantYes... the method creates a CanonicalConfig.20:57
wgrantAnd appserver_root_url assumes that it is.20:57
lifelessthis is a conflict with devel20:57
wgrantAhh.20:57
lifelessdevel added appserver_config incompatibly.20:57
lifelessI would move the appserver_config method out of the way20:57
lifelessor do config -> config_fixture20:58
lifelessas well as appserver_config -> appserver_config_fixture20:58
lifelessthey are paralleled20:58
wgrantRight, I failed to check the origin of the method. Probably should have.20:58
wgrantI've already renamed it to appserver_config_fixture, so I'll do it for config_fixture.20:58
wgrantThanks.20:58
lifelessnote the helper methods that set attributes20:59
wgrantI'm currently setting appserver_config_name whenever the fixture is set. Is that necessary, do you think?21:01
lifelesswgrant: thats what make_config does21:03
wgrantlifeless: It sets the fixture, not the name.21:04
lifelessoh right21:04
wgrantThe new method needs the name.21:04
lifelessseems reasonable offhand21:04
lifelessnote that the config_name may be set without a config fixture for the persistent test helper case21:05
wgrantRight.21:06
wgrantApart from occasioanl Windmill hangs, all the layers seem to start now.21:06
lifelesscool21:08
lifelessI'd love to remove the persistent helper case21:08
lifelessbut I think things are still a little slow for that21:08
wgrantlifeless: Why'd you remove the DB setup from _runAppServer (r11743)? That causes AppServerLayer to explode when the test before its starting committed, because the DB doesn't exist.21:34
wgranteg 'bin/test -1cvvvt blacklist_not_public -t TestBugScaling.test_messages_query_counts_constant'21:34
lifeless'before it' ?21:35
lifelessthe commit message makes sense to me21:35
wgrantlifeless: If a test commits, testTearDown drops the DB.21:35
wgrantlifeless: testSetUp will then set it up again.21:35
lifelessyes21:35
wgrantSo if the last test in a layer commits, and AppServerLayer is started immediately afterwards, AppServerLayer will start an appserver without a DB.21:36
lifelesswhat layer are you in21:36
lifelessAppserverLayer.testSetUp should cater for that21:36
wgrantAppServerLayer.setUp starts the appserver.t21:36
wgranttestSetUp hasn't been called at that point.21:36
lifelessso21:37
lifelessto be clear21:37
lifelessa test outside the layer causes the db to go21:37
lifelessbut the db layer is still 'live'21:37
wgrantExactly.21:37
lifelessthen the appserver layer is started21:37
lifelessbut the invariant of its higher layer being valid is false21:38
lifelesssounds like a bug in the db layer21:38
lifeless / in the layer design21:38
wgrantHow can it know that a child is being set up?21:38
lifelessthis can break any other layer where the layer setup wants to use the db21:39
wgrant(I've confirmed that calling testSetUp in the children's setUp fixes everything)21:39
lifelessthe invariant I'd look for is 'between tests, the db is available, so that child layers can build on it'21:40
wgrantSo perhaps testTearDown should recreate it. Hmm.21:40
wgrantOr testSetUp could be called on layer changes.21:41
lifelessso the reason I removed it is it was a layering violation21:43
wgrantRight.21:43
lifelessso21:45
lifelesstestSetup is slightly different21:46
lifelesshow about this21:46
lifelesshttp://pastebin.com/z6wZCc9M21:46
lifelessand then21:47
lifelesshttp://pastebin.com/y1daKate21:47
lifelessthats not quite right21:48
lifelessit will do setUp twice per test which we don't want21:50
wgrantWill it? How's it different from the case where it wasn't dropped in the first place?21:51
lifelessresetting sequences is non-zero time.21:51
wgrantAh,t rue.21:53
lifelessPushing this:21:54
lifelesshttp://pastebin.com/P2i1wbzc21:54
wgrantI've pushed a bit more to mine that you might want to merge.21:54
lifelessI haven't run the db layer tests yet. they may fail.21:54
wgrantk, will try.21:54
lifelesspushed lp:~lifeless/launchpad/databasefixture; whats your branch again ?21:56
wgrants/lifeless/wgrant/21:56
wgrantHeh, you committed a syntax errorl21:57
wgrantMissing colon on 697.21:57
lifelesswin21:57
lifelessuncommitting ;)21:57
wgrantpull my stuff and I'll get this working and commit.21:57
lifelesspushed22:02
wgrantWindmill tests are sloooooooooow.23:18
lifeless:(23:19
wgrantOTOH I think this run may be clean.23:19
lifelessis that 'page loads are slow' or 'it polls rather than events' or '...' ?23:19
wgrantBoth.23:19
wgrant lp.bugs.windmill.tests.test_bug_inline_subscriber.TestInlineSubscribing.test_inline_subscriberNo handlers could be found for logger "lazr.smtptest"23:20
wgrantThat can't be right.23:20
wgrant (166.994 s)23:20
lifelessone test ?23:22
wgrantIt seems so.23:22
lifelesswin23:22
wgrantThere's a disturbing number of wats.sleep(5000)s in that test.23:23
lifelessfrell23:24
lifelessLOL https://bugs.launchpad.net/launchpad-foundations/+bug/5814/comments/223:29
_mup_Bug #5814: want to know breakdown of test run time by area of development <build-infrastructure> <Launchpad Foundations:Triaged by flacoste> <https://launchpad.net/bugs/5814>23:29
wgrantAhahaha.23:29
lifelessyes, 9 minute test times being a problem.23:30
wgrantWell, that was only part of the suite.23:30
lifelessno23:30
lifelessit was everything - just not sourcecode/*23:30
wgrantOh.23:31
lifelesswgrant: still, good news about the branch23:47
wgrantlifeless: 3/4 through the run, four failures which I've fixed. And your fix for the DB thing worked.23:50
wgrantSo we may be good.23:50
lifelesswgrant: you're running everything ?23:50
wgrantlifeless: Yes.23:51
wgrantHrmph.23:56
wgranttest_db_naming_LP_TEST_INSTANCE_set fails.23:56
lifelessbwah23:57

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!