/srv/irclogs.ubuntu.com/2009/07/25/#launchpad-dev.txt

ardkHi, I'm trying to install launchpad on a new server (9,04). When I run "make schema" all stop. I don't have py. launchpad/lp-branches/devel/bin/py: not found.00:03
ardkIn the directory bin, I only have buildout. Thanks for any help00:03
BBHossmars or sinzui: could it possibly be a memory issue? http://pasternak.superalloy.nl/pastes/248700:05
marsardk, could you please paste the output of running 'make' in ~/launchpad/lp-branches/devel ?00:05
sinzuiBBHoss: maybe. I think so00:06
ardkutilities/shhh.py python2.4 bootstrap.py --ez_setup-source=ez_setup.py \00:06
ardk--download-base=download-cache/dist --eggs=eggs00:06
ardkutilities/shhh.py ./bin/buildout configuration:instance_name=development00:06
ardkutilities/shhh.py make -C sourcecode build PYTHON=python2.4 \00:06
ardk    PYTHON_VERSION=2.4 LPCONFIG=development00:06
ardkutilities/shhh.py LPCONFIG=development /home/ardk/launchpad/lp-branches/devel/bin/py -t buildmailman.py00:06
ardkmake: *** [compile] Error 12700:06
sinzuiBBHoss: launchpad requires about 2G to develop with.00:06
marsardk, could you please use http://paste.ubuntu.com ?00:06
BBHosssinzui: i just want to play around with it, can it not just use swap?00:06
marsardk, it keeps the channel traffic down00:07
sinzuiBBHoss: I do not now the details of downloading and memory with the python process. But BBHoss will barely run in 1G of memory00:07
marsBBHoss, I think you would have to ask a bzr guru if that is causing an error.  As for running a LP instance on 256MB of RAM00:07
BBHosshmm yeah00:09
BBHossi know it would be slow, just wanted to know what it would do00:09
ardkSorry, http://paste.ubuntu.com/231802/plain/00:09
sinzuiBBHoss: I did get Launchpad to run on 512 two years ago. I could run the test suite or all the services. I could browse and use bugs and answers.00:10
marssinzui, could run the test suite?  Doesn't that need a gig or so?00:11
sinzuimars no. I thought I was an idiot and could not setup Launchpad00:11
marsardk, rocketfuel-setup ran to completion, without errors?00:11
sinzuimars: Once I bought a new computer the next week00:11
ardkYes, no error with rocketfuel, and no error with ./utilities/launchpad-database-setup $USER00:12
sinzuimars: and the one nice affect of the GIL is that on a two core machine, you can still work while the test suite is running00:13
marsardk, try "$ bin/buildout" in launchpad/devel?00:13
marssinzui, FWIW, I'll try to finish off my CHR tomorrow00:15
sinzuimars: I'll do the projects...I usually do about 30 on the weekend so the person on Monday does not cry00:16
ardkmars: an error whith buildout http://paste.ubuntu.com/231823/plain/00:16
marssinzui, I'll see what I can do on the projects, too00:16
marsardk, ok, try 'rocketfuel-get' then.  It looks like your devel/sourcecode directory may be broken, or possibly devel/download-cache00:17
marsI should have suggested rocketfuel-get first00:17
marsthat is turning out to be the primary indicator of a working devel setup00:18
ardkmars: I'm trying rocketfuel-get thanks00:19
ardkmars: Exactly the same errors after rocketfuel-get00:20
marsardk, could you please paste the full output?00:21
ardkmars: the output of rockefuel-get http://paste.ubuntu.com/231841/plain/00:24
BBHossi dont see why bzr wouldn't be able to handle the small memory, wget seems to get it fine00:26
marsardk, ok, so ~/launchpad/lp-sourcedeps/sourcecode has links, and ~/launchpad/lp-branches/devel/sourcecode has links in it?00:27
marsardk, and ~/launchpad/lp-branches/devel/download-cache is full of .tar.gz files?00:27
ardkmars: yes , and in download-cache I have a subdir "dist" full of files .tar.gz00:28
marsok00:28
marsthat's as it should be00:28
marsardk, and there is an 'eggs/' directory?00:28
ardkmars: Yes, list of eggs http://paste.ubuntu.com/231862/plain/00:31
marsardk, ok, I have 118 .egg files in mine00:32
marsardk, I have to leave now, maybe try 'python bootstrap.py', see what happens.  Otherwise, hang around here, or ask on the dev list: launchpad-dev@lists.launchpad.net00:33
marsgood luck!00:34
ardkThanks00:34
marsardk, oops, typo, make sure that is 'python2.4 bootstrap.py'00:39
marsotherwise you'll have a mess on your hands, untangling the 2.5 files from the 2.4 ones.00:39
ardkmars: Yes I've corriged, and I have a problem with lazr.smtptest 1.100:39
maxbLaunchpad seems to contain both a monolithic zope tree and various zope modules - can anyone explain how that works?00:58
maxbI'm trying to investigate zope.proxy misbehaviour, but it's not clear which zope.proxy is actually in use00:58
wgrantmaxb: It seems to be the one in the monolithic Zope.01:22
wgrantWhich makes little sense.01:22
wgrantIn fact it looks like all of the eggs are shadowed.01:22
sidneiwgrant: are you referring to that zope.proxy issue? i think i missed the context of that01:28
wgrantsidnei: Ah, yes, you were away while he said it. maxb is unsure as to which zope.proxy is in use in Launchpad.01:29
wgrantThere is a 3.5 egg, and what I presume to be a 3.4 from the monolithic tarball.01:30
wgrantBut the monolithic zope 3.4 is in lib/, which is always earlier in sys.path AFAICT.01:30
sidneiwgrant: that's correct. we should use the 3.5 egg as soon as gary merges his branch01:31
wgrantsidnei: So those eggs are just sitting there doing nothing at the moment?01:31
sidneiwgrant: yes, at the moment. i also suggested patching the zope 3.4 from lib with the fix from the 3.5 egg01:32
sidneiin the meantime that is01:32
sidneiwgrant: i believe this is the branch gary is working on: https://code.edge.launchpad.net/~gary/launchpad/zbuildout01:33
sidneiwgrant: it's only pending some test failures afaict to be merged01:33
* wgrant mutters something about private branches.01:33
sidneiwgrant: oh, drats. let me see if i can toggle that bit01:37
wgrantsidnei: You probably can't.01:39
sidneii wonder if bzr does remote branching01:39
wgrantIt's unlikely a non-admin can now that the security policy is relaxed.01:39
* sidnei watches as something happens with https://code.edge.launchpad.net/~sidnei/launchpad/zbuildout01:42
wgrantsidnei: Aha, thanks.01:45
sidneistill pushing, but seems like it might be done soon01:46
jmlsinzui, actually, I added the rule to link lp:12345 to a bug as well. there ought to be no conflict due to [0-9] and [a-z] having no intersection.02:36
* wgrant discovers why /var/tmp/fatsam is called that.02:39
maxbWell, the interesting thing is that even applying the zope.proxy fix from upstream, I still seem to experience the bug08:20
wgrantmaxb: Is the bug causing any issues?08:24
maxbIt's causing MemoryErrors all over the place for me08:25
wgrantOh.08:25
wgrantOf course.08:25
wgrantStupid Python.08:25
wgrantThat's why Storm doesn't define it in the first place.08:25
maxbWell, really I can't blame it for having difficulty instantiating a 4 billion element list08:25
wgrantPerhaps.08:26
maxbThe annoying thing is that if I manually instantiate a zope.proxy.ProxyBase(object()), it seems happy to return correct results08:27
wgrantFrom 'make harness'?08:28
maxbI've not come across that one, I'm just working with "make run", or a standalone script in the style of utilities/make-lp-user08:29
wgrantAh.08:29
wgrantmake harness will get you an interactive Python with Zope configured and lots of useful objects.08:29
wgrantI believe there's also a make iharness, which is probably even more useful.08:30
maxbThe other somewhat perplexing thing is that I'm now managing to get a zope.security.interfaces.ForbiddenAttribute: ('__len__', <storm.store.ResultSet object at 0x611e090>)08:31
wgrantThat's good.08:31
wgrantThat's what the proxy is there for.08:31
maxbwhen the only change from code that didn't do that was to delete some operations frm my minimal test script08:31
wgrantHmm, actually.08:33
maxbGet a storm resultset, print len(rs) -> 2**32-1, transaction.commit() results in ForbiddenAttribute.08:34
maxbHowever, add "for i in rs: pass" before the commit, and no ForbiddenAttribute happens08:34
wgrantSpecial...08:35
maxbhehe, yes, "special"08:35
* wgrant looks with bemusement at build__datecreated__key08:37
wgrantThat makes no sense.08:37
cody-somervillewgrant, Are you pleased to finally have access to lp source code? :)08:38
wgrantcody-somerville: I am!08:39
maxbaha, the same 64bitness bug exists in zope.security.proxy as well as zope.proxy08:39
cody-somervillewgrant, I was told that I'm the only person outside of the launchpad team to contribute code to launchpad in a couple of years. Hopefully that'll change real quick now! :)08:40
wgrantcody-somerville: I've already two approved branches that will land once devel reopens on Monday.08:41
cody-somervillewgrant, awesomeness08:41
cody-somervillewgrant, I'm sure you'll help pave the way for all sorts of folks to be able to contribute effectively08:41
* wgrant hates gina's config system.08:41
cody-somervillezconfig or... ?08:42
wgrantlazr.config. But it's not a good fit.08:42
cody-somervilleYea08:42
cody-somervilleI examined lazr.config for one of my internal projects and I decided to go with a different solution08:43
wgrantlazr.config is good. Just not for this.08:43
maxbHmm, no vcs-import for zope.security08:47
wgrantIt would have been part of the main Zope 3 import until recently.08:48
maxbOK, woo, now I actually have a functioning webapp running on karmic :-)08:58
wgrantWhich Python?08:58
maxb2.508:58
wgrantAha.08:58
wgrantUsing all the default deps except zope.security?08:58
maxbI just grabbed and applied patches of the relevant revisions from zope.security and zope.proxy to the sourcecode/zope tree08:59
wgrantIs this the first time you've had the webapp running?09:00
maxbNo, but before now it tended to OOPS a lot09:01
wgrantI count that as a yes.09:01
maxbEven an OOPSing webapp was proof I was on the right track :-)09:01
wgrantIt's nice running a local Launchpad - it's so fast!09:02
maxbOn my good laptop, yes09:03
maxbNot so much on my netbook!09:03
wgrantProbably not.09:04
wgrantmaxb: Found anything yet that doesn't like 2.5?09:21
* wgrant needs an SSD09:42
maxbI suppose I should now figure out how to run the testsuite10:03
wgrantmaxb: make check10:05
wgrantMaking sure you have good cooling.10:05
wgrantAnd many, many hours.10:05
wgrantI should run the full test suite here at some point - I've so far only run the bugs tests in full, which took 50 minutes.10:06
maxbhmm. possibly a laptop sitting on a bed is not the best environment for long duration high CPU work10:08
wgrantA lot of it's high-disk, as the database has to be replaced after each test.10:15
wgrantI'm not sure if I was reading things properly, but the output of the lp.bugs tests suggested that 30 of the 50 minutes were spent doing DB setup.10:15
maxbDoes anyone know when the dev wiki is going to be opened for editing? I'd like to scribble some notes on my experiences of getting LP to work with Python 2.514:14
cprovgood morning, folks14:45
wgrantMorning cprov.14:48
=== cprov is now known as cprov-afk
sidneihey wgrant, pushing that branch finished at some point during the night: https://code.edge.launchpad.net/~sidnei/launchpad/zbuildout16:20
maxbsidnei: am I simply not driving bazaar properly, or is there litte interesting in that branch yet?18:59
=== carlos_ is now known as carlos
sidneimaxb: what do you mean?19:19
maxbUnless I'm failinf to use bzr properly, it seems to contain a group of changes not related to the buildsystem, and a one-line fixup19:23
maxbbzr log -n0 -r ancestor:../devel..19:24
sidneimaxb: that command doesn't show much indeed. use diff instead of log, you will see that there's a lot of changes19:28
sidneimaxb: it looks quite unpolished though, there's quite some code that has been commented out, presumably because it doesn't pass the tests yet19:29
sidneimaxb: i think using a patched sourcecode/zope3 is a better approach until gary makes more progress19:29
timuthi all21:29
timuti'm installing launchpad on hardy 8.04, anybody have a list of dependency or lib packages prerequisite before install?21:30
maxbare you following https://dev.launchpad.net/Getting ?21:56
maxbdependencies are dealt with as part of rocketfuel-setup21:57
timutmaxb: yups, but i have problem with bzr and python-pyrex22:03
timutSetting up python-pyrex (0.9.6.4-1ubuntu1) ...22:05
timutpycentral: pycentral pkginstall: not overwriting local files22:05
timutpycentral pkginstall: not overwriting local files22:05
timutdpkg: error processing python-pyrex (--configure):22:05
timut subprocess post-installation script returned error exit status 122:05
timutErrors were encountered while processing:22:05
timut python-pyrex22:05
timutE: Sub-process /usr/bin/dpkg returned an error code (1)22:06
maxbtimut: I would suggest temporarily moving aside anything including pyrex in its name from the /usr/lib/python2.4/site-packages/ directory and retrying the package setup with dpkg --configure -a22:17

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!