/srv/irclogs.ubuntu.com/2010/01/19/#launchpad-dev.txt

bdmurrayallenap: we said 7:30 yes?00:35
allenapbdmurray: Yep.00:35
* jml is back00:55
bdmurrayIs anyone running launchpad on lucid?01:20
bdmurrayI'm having an issue with make schema and tickcount not importing01:20
jmlbdmurray, maxb is, I think01:21
jmlI guess I ought to upgrade.01:21
jmlbdmurray, wgrant might be running on lucid too01:21
wgrantI'm running lucid.01:21
wgrantbdmurray: Make sure that you have the ~launchpad PPA for lucid activated.01:22
wgrantThat should work, although you might need to downgrade python-pkg-resources and python-setuptools to their karmic versions (if you get errors about 'distribute')01:22
bdmurraywgrant I do have the launchpad ppa01:23
wgrantbdmurray: Which version of python-tickcount do you have installed?01:23
bdmurray0.1-0ubuntu10launchpad101:24
wgrantHmmm.01:24
bdmurrayI think it has to do with the python path01:24
wgrantIt's more likely that your python-support hates 2.5.01:25
bdmurrayand tickcount being in /usr/lib/pyshared?01:25
* wgrant checks stuff.01:25
wgrantbdmurray: What if you remove and reinstall python-tickcount?01:26
wgrantpython-support should be happy :(01:27
bdmurraywgrant: I tried downgrading to the one in universe and installing the ppa one would that count?01:28
wgrantbdmurray: Probably, but maybe not.01:28
wgrantbdmurray: Which versions of python-defaults and python-support do you have?01:28
maxbHmm, that reminds me, I should merge my python-defaults change forward to lucid01:29
maxbNeed to reboot into lucid to test that properly, though :-/01:30
bdmurraywgrant: I've got to run but that didn't sort it either01:31
bdmurraywgrant: thanks though01:31
=== Ursinha_ is now known as Ursinha
stub11 hours is a little long for a test run....02:05
* stub wonders wtf his ec2 instance has been doing all night.02:05
jmlstub, wrt kfogel's master_affects patch, I think they were also going to use it to correctly calculate the number of users affected by a bug02:08
jmlstub, which isn't an offline task02:08
stubIt still isn't necessarily a performance issue02:08
stubIt is a use case for PG 8.4's hierarchical queries though...02:11
stubw00t. My ec2 instance looks crashed. ssh and http unresponsive, but still listed as running in elasticfox.02:11
stubjml: There is already the Bug.users_affected and Bug.users_unaffected cache columns, so affected counts don't need to be calculated on the fly.02:16
maxbCan someone hit retry on this for me, please? https://edge.launchpad.net/~launchpad/+archive/ppa/+build/145310503:04
spmmaxb: done03:17
wgrantI have a small branch from last week that makes some tests fail (inheriting from a new interface for security reasons, while the class still doesn't implement some of the attributes). Can I get that reviewed on its own now, and just land the subsequent branch which unbreaks things? Together they exceed the limit, and will be somewhat more difficult to review.03:17
stubwgrant: I think two separate merge proposals is encouraged, and the 'dependent branch' field when registering a merge proposal added to make things even easier.03:31
wgrantstub: Yep, I made a lot of use of that field last week...03:31
wgrantThanks.03:31
bdmurraywgrant: so a new python-support fixed it03:39
wgrantbdmurray: Great.03:40
stubBah. Too many devs infecting my timezone. PQM is backed up :-P07:04
stubGET OFF MY LAWN!07:04
al-maisan:)07:20
stub    ImportError: No module named builder.recipe08:49
* stub kicks db-devel, and wadl generation in general08:49
mrevellMorning08:49
stubAnyone else seen that? db-devel won't build locally for me.08:59
bigjoolsI'll try09:01
bigjoolswgrant: around?09:11
bigjoolsstub: fails for me too09:12
stubbigjools: No idea why it is working for buildbot.09:25
bigjoolsme neither09:27
bigjoolsstub: starting up dogfood gives me "database does not have a main_slave key."09:35
bigjoolsque?09:35
bigjoolsand "main_master"09:36
stubbigjools: Sounds like you need to update the config file, but I'm not sure how you would get that particular error - if those keys are not set, you should be pulling in the defaults from lib/canonical/config/schema-lazr.conf (which would attempt to connect you to the production database, and fail)09:37
bigjoolsso I guess someone added config items and forgot about DF09:37
bigjoolsI have a bad feeling about this week09:38
stubThis is old though...09:38
bigjoolsreally?09:38
stubYer - since we have had replication. Months and months.09:38
bigjoolsit only started happening after I just pulled db-devel into DF09:38
bigjoolsI last did that last Friday09:38
bigjoolsor maybe Thu09:39
stubsince it because a pain in the bum to restore the db dumps in fact, so I know those keys have been needed on df before.09:39
stubHmmm...09:39
stubThe losas might remember the magic command to dump the full config with all the inheritance exploded. That might show the issue?09:40
bigjoolslsconfig iirc09:40
mthaddon./utilities/lsconf.py09:41
stubDo you have a traceback and can confirm which widget it spitting out the error?09:42
bigjoolsawesome.  lsconf falls over with the same error09:42
bigjoolshttp://pastebin.ubuntu.com/358941/09:43
mthaddonI wonder if this is related to the work on rw_ and ro_ prefixes for those values09:44
* bigjools updates configs and tries again09:44
mthaddondunno what's landed yet09:44
mthaddonyep, looks like it's landed09:45
stubmthaddon: Perhaps. That landed...09:45
bigjoolswell, this is a rollout blocker, I can't test any of last week's extremely invasive changes :/09:45
mthaddonbigjools: I'm about to submit a branch that should fix lp-production-configs09:45
mthaddonhttps://code.edge.launchpad.net/~mthaddon/lp-production-configs/read-only-text-file/+merge/1758109:45
bigjoolsmthaddon: oh, you know the problem already?09:46
mthaddonyeah09:46
bigjoolsmthaddon: excellent09:46
* bigjools hacks the diff locally09:47
stubI'm off to pay my health insurance then09:47
bigjoolsrequired for working on LP? :)09:48
mthaddonbigjools: you can see what changes are needed?09:48
bigjoolsmthaddon: yes, I've changed the DF config on DF itself and it seems to be getting further now09:48
mthaddoncool09:48
stub:-) Or maybe tomorrow since they close in 10 mins09:48
bigjoolswhen it finishes generating the ****ing wadl I'll find out09:49
mthaddonwelcome to my world09:49
bigjools:)09:49
bigjoolsI also want to scream every time I see combine-css running09:50
bigjoolseven when doing "make stop"09:50
bigjoolsit really needs a Makefile predicate09:50
mthaddontry make initscript-stop instead09:51
bigjoolsargh09:52
bigjoolsthanks09:52
bigjoolsstub: db-devel is fine on dogfood, which adds to the confusion10:08
stubI'm suspecting a missing launchpad-dependency that happens to be installed on the production boxes.10:08
stubBut haven't looked closely.10:08
bigjoolsstub: the only one I remember us adding was python-debian10:09
bigjoolsbzr-builder was added to sourcedeps10:10
henningestub: something LP-related ;)10:20
henningestub: what is the best approach to updating many rows with different values each?10:20
henningestub: LIke, I have a list of select criterias that select an entry each and I want to set a value in each entry.10:21
henningea different value for each entry.10:22
henningeMy naiv approach would be an update request per row. Is there a better solution?10:22
stubUPDATE foo SET bar=sub.baz FROM (SELECT foo_id, bong FROM baz WHERE ....) AS baz WHERE foo.id = baz.foo_id;10:23
stubI could make a more comprehensible example with more explicit information10:24
henningestub: sorry ;)10:30
henningestub: I want to set priority on potemplate and have this list: http://people.canonical.com/~dpm/template-priorities/karmic-templates-priorities.csv.txt10:30
stubAs the source isn't in PG, better to just do one query per entry10:31
henningestub: ok, I can write a script for that.10:31
stubYou *could* load all the data into a temporary table and use that in the FROM clause of the UPDATE statement, but there isn't that much data...10:32
henninge1298 lines ...10:32
* stub shrugs10:32
* henninge expected that10:33
stubpfft. You have other scripts trashing *millions* of rows.10:33
henningeI know, I know.10:33
bigjoolsstub: utilities/update-sourcecode does the trick in db-devel10:33
stubSo rocketfuel-get is busticated?10:34
bigjoolsrf-get doesn't touch db-devel does it?10:34
bigjoolsonly trunk10:34
stubHmm... so sourcedeps.conf has been modified on db-devel and not devel? That is going to mess staging and production.10:36
stubOr is is just that devel changes haven't leaked through to db-devel yet?10:36
bigjoolsI think update-sourcecode doesn't get run on db-devel automatically, that's all10:36
bigjoolshmmm actually10:37
stubok10:37
bigjoolsyou're right10:37
bigjoolsdevel doesn't have the updated sourcedeps10:37
stubyer - I only have one sourcedeps. Everything else is symlinked.10:44
henningestub: can you tell me the id for karmic?10:45
henningestub: like "select id from distroseries where name = 'karmic'" ?10:45
stub(SELECT id FROM distroseries WHERE name='karmic') is better than hardcoding the id :)10:45
stubBut it is 97 if this is a one of script to only run against staging and production10:46
henningestub: yes, just once.10:46
henningethanks.10:46
henningestub: does that look ok? http://paste.ubuntu.com/358965/10:55
henningestub: or more like this http://paste.ubuntu.com/358966/10:57
stubyer10:58
stubUPDATE potemplate10:58
stubSET priority=10010:58
stubFROM sourcepackagename, distroseries10:58
stubWHERE10:58
stub    potemplate.sourcepackagename = sourcepackagename.id10:58
stub    AND sourcepackagename.name = 'moin'10:58
stub    AND potemplate.name = 'moinmoin'10:58
stub    AND potemplate.distroseries = distroseries.id10:58
stub    AND distroseries.name = 'karmic';10:58
henningeah!10:58
henningethanks!10:59
henningestub: This assumes that no other distribution in the db will have a 'karmic' series. I'll add the distribution.11:02
stubhenninge: Correct. Overkill at the moment, but correct :)11:02
=== matsubara-afk is now known as matsubara
henningedanilos: are you alive here? ;-)12:03
=== mrevell is now known as mrevell-lunch
bacbarry: ping13:08
barrybac: pong13:09
bacbarry: hi.  i was trying to use your stop() debugging tip but need to do so in a browser/test not a pagetest.  it's not in the doctest globs but i redefined it.  i find that *some* of the setup data is available when i hit launchpad.dev but not all -- mainly the stuff i want.  any ideas?  any reason it wouldn't work in that test env?13:10
barrybac: hmm.  the only thing i can think of is that the non-page tests don't always commit the transaction, whereas each request in the page test should commit the transaction.  try sprinkling "transaction.commit()" calls in the non-page tests and see if that helps13:12
bacbarry: ah, good idea.  i tried flushing the db but didn't commit.  duh.13:13
bacbarry: cool, that was it13:15
barry\o/13:15
barrybac: wow, and i haven't even had my coffee yet this morning :)13:15
bacbarry: but i have.  :(  well, tea.13:16
barryyeah, tea for me too :)13:16
bacbarry: any reason stop() can't be made available in systemdocs globs?13:27
barrybac: nope.  in fact it should13:31
=== mrevell-lunch is now known as mrevell
=== vednis is now known as mars
=== salgado is now known as salgado-lunch
kfogelgmb: https://code.edge.launchpad.net/~kfogel/launchpad/505845-affects-me-too-from-dups/+merge/1763315:19
gary_postermars or BjornT, did you have any thoughts on thumper's question to the list about the buildbot Windmill test failures in lp:~thumper/launchpad/js-play?  (subject of email is "OK, I'm stumped")15:30
leonardrflacoste, do you have a minute to talk about multi-version?15:35
flacosteleonardr: i do15:37
flacostegary_poster: BjornTwill be sleeping15:38
leonardrflacoste: i've run into a problem which i can push off for a little while but not indefinitely. let me paste you a diff15:39
gary_posterflacoste: ack, thanks.15:39
leonardrflacoste: http://pastebin.ubuntu.com/359066/15:41
leonardrthe problem is that the IWebServiceConfiguration utility is not available until after the web service has been built and the code has run15:42
leonardrbut that utility is what defines the versions in use15:42
leonardrfirst, do you see what i want to do? do you have questions about that specific code?15:43
marsgary_poster, I haven't looked at that branch specifically15:43
gary_postermars, fair enough.  Do you have any next-step analysis steps to suggest to thumper?15:44
marsgary_poster, alas, no.  But I can try the branch locally while I work on it.15:45
marswork on other things15:45
marsoh, wait15:45
gary_postermars: ok thank you.  ok, waiting. :-)15:45
marsah.  gary_poster, I will try that later, when I have my laptop... oh, wait.15:45
gary_posterlol, being asked to wait a lot ;-)15:46
marsso, my new desktop hard drive doesn't have lp-dev on it.  My laptop, which runs Jaunty, has a broken lp-dev on it.15:46
adiroibandanilos: hi.15:46
adiroibandanilos, henninge : one more question regarding. +edit page for potemplate. When changind domain name, the date_last_updated is also changed15:47
adiroibanshould I make it available for edit in +edit?15:47
EdwinGrubbsbarry: ping15:47
barryEdwinGrubbs: pong15:47
marsgary_poster, I'll see what I can do when I finish more of the pyslow reporting.  I don't want to switch to a system reinstall right now.15:48
henningeadiroiban: no, I think not. It should be updated automatically when the data changes, like it does now (I presume).15:48
adiroibanwell... not it is not updated on edit15:49
gary_postermars, agree.  Could you reply to thumper with a "I acknowledge your pain" message then, and say that you'll look into it if someone else doesn't beat you to it once you are able to sort out your LP issues?  Maybe that will ping Björn to help if he can.15:49
adiroibanhenninge: changing the description of a potemplate... will not touch the last_update_date15:49
henningeadiroiban: hm, it should definitely not be edited manually.15:49
adiroibanbut changing the domain_name will do15:49
henningeadiroiban: I see.15:50
henningeDon't know if that is a bug or if it's intentional.15:50
adiroibanso I should remove security proxy15:50
adiroiban?15:50
adiroibanjust for the edit page?15:50
adiroibanand for that field?15:50
adiroibannot sure how this can be solved15:51
adiroibans/be/should/15:51
henningeadiroiban: how does the field get updated at the moment?15:51
adiroibanhenninge: at the moment there is no translation domain in +edit page :)15:51
adiroibanmy branch will add the field15:51
flacosteleonardr: why do you need to push the earliest_version?15:52
leonardrflacoste: i have to push something so that the very first annotations will have a name. it doesn't have to be earliest_version15:52
flacosteleonardr: you could simply use a marker 'THIS_IS_THE_EARLIEST_VERSION'15:53
leonardrright, that's what i'm doing for now15:53
henningeadeuring: so when you said "When changind domain name, the date_last_updated is also changed" earlier, what were you referring to?15:53
leonardrbut soon i'm going to have to handle @webservice_version('1.0')15:53
flacosteleonardr: and then replace that marker with the correct name (if needed) in the generate_pass15:53
leonardrflacoste: ok, that's what i was looking for, i think15:53
flacostegenerate_pass: actually, that might be a proble15:53
flacostem15:53
leonardrwhen generate_* runs, the utility will be available?15:53
flacosteno15:53
flacostewell15:53
flacostemaybe15:54
flacostebut there is no garantee15:54
flacostethat code will need to run when the utility is registered15:54
flacostewe could add an event for that15:54
flacostebut you might want to see if you can get away with simply using a marker15:54
flacostemaybe you don't need to replace it15:54
flacostewith the proper name15:54
flacosteyou could do it the other way round15:55
henningeadiroiban: so when you said "When changind domain name, the date_last_updated is also changed" earlier, what were you referring to?15:55
flacosteleonardr: replace 'whatever_the_earliest_version_is' with THIS_IS_THE_EARLIEST_VERSION_MARKER when doing lookup15:55
flacosteleonardr: see how this evolves15:55
flacostegary_poster: might have other clever suggestions15:55
leonardrflacoste: i can get away with not mentioning what specifically the earliest version is. i'm concerned about specific versions named in the annotations15:56
* gary_poster looks around in attempt to find something to be clever about15:56
adiroibanhenninge: updating translation_domain from the +edit page, will automaticaly change date_last_updated15:56
leonardrat some time before i create and register the web service adapter classes, i'll need to check whether or not '1.0' is a valid version number15:57
henningeadiroiban: right and where does that happen?15:57
adiroibanhenninge: right now, there is only 'description' field, and changing it from +edit will not change date_last_updated15:57
adiroibanhenninge: this happens on my new branch for bug 34066215:57
mupBug #340662: "Change details" for POTemplate should allow maintainers some more freedom <qa-bad> <ui> <Launchpad Translations:Fix Committed by adiroiban> <https://launchpad.net/bugs/340662>15:57
adiroibanhenninge: this is the MP https://code.edge.launchpad.net/~adiroiban/launchpad/bug-340662-take-2/+merge/1759815:59
leonardrgary: i can walk you through it if that'll get you up to speed faster15:59
danilosadiroiban, henninge: we should probably not change last_updated_date on translation domain change16:00
adiroibanhenninge: or maybe we should change to code so that changing translation_domain will not change date_last_updated16:01
kfogelflacoste: https://pqm.launchpad.net/ seems crashed, just fyi16:01
flacostekfogel: nah, that's just the web interface16:01
danilosadiroiban, henninge: however, this is likely needed for langpack updates, so...16:01
danilosadiroiban, henninge: I'd just keep it in16:01
kfogelflacoste: that's what I was referring to, sorry if not clear16:02
kfogelnot "PQM" but "pqm.launchpad.net"16:02
adiroibandanilos: langpack updates are using Launchpad.Edit ?16:02
flacostekfogel: it will clear itself out at some point16:02
gary_posterleonardr, so, you are doing something (setting up the BleedThroughDict with version information) during zcml processing that wants the zcml to already be processed?  A standard-ish way to handle something like this is to (1) leverage the two-stage zcml processing and/or (2) make a requirement that a certain utility is registered in zcml before other things are called.16:02
kfogelflacoste: ah, ok16:02
danilosadiroiban, henninge: one would have to check language pack delta generation code to see if it's using potemplate.last_update_date16:02
flacostekfogel: it's usually because of a specific job which chokes the web ui16:02
leonardrgary: how would i do the latter?16:02
danilosadiroiban, ha, no, but "incremental updates" are using dates of export to figure out what needs exporting16:03
kfogelflacoste: that's... interesting :-).  But real-time PQM reporting is not a vital service, I guess.16:03
flacosteleonardr: well, you don't really need to care about the specific version either, unless for validation purpose16:03
flacosteleonardr: and that you can do later also16:03
gary_posterleonardr: simply fall over if it is not registered when you need it to be with a hopefully helpful error message.16:03
danilosadiroiban, if we don't update the date here, it might break and you won't be able to fix wrong translation domains in ubuntu without getting a full language pack export16:03
adiroibandanilos: ah. I see :)16:03
danilosanyway, off now16:03
gary_posterleonardr: in stage one of zcml processing, collect information16:03
danilosadiroiban, fwiw, that's just my guess, it would have to be confirmed through code16:03
flacostegary_poster: the code that he's showing happens before ZCML16:04
gary_posterleonardr: in stage two of zcml processing, require that the desired utility is already registered16:04
flacostegary_poster: this is interface declaration code16:04
flacostegary_poster: happens whenever the module is imported16:04
flacosteso he can't rely on any ZCML being registered at this point16:04
gary_posterflacoste, can he do the actual registrations in stage two of ZCML processing?16:04
adiroibandanilos, henninge: well, when changing translation_domain, I think we should update the last_update_date16:05
flacostegary_poster: there is no registration happening either, in that stage you should only collect the annotations16:05
flacostegary_poster: registration happens when the special ZCML directive is called16:05
adiroibaneven if langpack delta is not using the fields... maybe in the future we will need this16:05
leonardrflacoste: ok, you're saying that at some point i can just fall over and say 'you defined a really big web service with no problems, but its versions don't match up with the versions in the config utility, so aaaargh"16:06
gary_posterflacoste: oh ok.  So, can't we just demand that the desired utility be registered when the special ZCML directive is called, in stage 2, and do validation then?16:06
flacostegary_poster: yep, that would work16:06
leonardrgary: what's the syntax for demanding that?16:07
=== salgado-lunch is now known as salgado
gary_posterleonardr: um, try to get the utility (e.g. zope.component.getUtility or queryUtility)?  If it fails, fall over, maybe with a more helpful message than just "the component isn't registered," by raising an error16:09
gary_posterleonardr: am I missing something?16:09
leonardrgary: i'm missing something16:09
leonardri know how to fall over if the utility isn't there. in fact, right now it happens automatically16:09
leonardri don't know how to make the utility be there16:10
gary_posterleonardr: right16:10
gary_posterah16:10
gary_posterleonardr, so, (1) make sure that the zcml to register the desired utility comes before the zcml to do your registration and validation, when reading the zcml depth-first (that is, following zcml imports). (2) Make sure that your registration and validation happen in the second stage of ZCML processing (that is, not when the zcml directive is supposed to insert functions and discriminators, but within the function that it reg16:12
gary_posterthat is done correctly already.16:12
gary_posterleonardr: did that make sense?  if not, happy to try Skype16:13
leonardrgary: i understand in principle but i don't know how to make sure something happens in the second stage16:14
leonardri'm going to leave this part alone for now16:15
gary_posterleonardr: ok.  let me know when you want to tackle.16:15
leonardrknowing that if all else fails i can compare the versions when the utility is defined, and fall over if they don't match16:15
leonardrhm, i also see a problem with defining a single 'webservice_version' function that can annotate a field, a method, an entry, or an interface16:17
leonardri may just give them different names for now16:17
=== matsubara is now known as matsubara-lunch
henningeadiroiban: When I was asking about "where" I meant "where in the code". ;-)16:24
henningeadiroiban: so it's in POTemplateEditView.change_action, isn't it?16:25
adiroibanhenninge: yes16:26
henningeadiroiban: so there is no need to actually expose it in the form.16:26
henningeadiroiban: and that is what I understood when you said " should I make it available for edit in +edit?"16:28
adiroibanhenninge: no. But I don't know how we should solve the permission problem.16:28
henningeadiroiban: you only need to change permissions on the *object*. You do that in lp/translations/configure.zcml16:29
henningeadiroiban: or you could use removeSecurityProxy, too, like you suggested.16:29
henningeremoveSecurityProxy(context.date_last_updated) = datetime.datetime.now(UTC)16:30
adiroibanhenninge: what do you suggest? should I add date_last_updated to Launchpad.Edit for IPOTemplate, or just use removeSecurityProxy ?16:31
gary_posterleonardr: do you see wadl generation thread on launchpad-devel?  Could you jump in, please?16:31
henningeadiroiban: I am not sure, actually ... danilos, what do you think? ^^16:32
leonardrgary, sure16:32
gary_posterthanks16:32
adiroibanhenninge: I am not aware of posible side effects...16:32
henninge_adiroiban: did my last line come through?16:33
henninge_adiroiban: I am not sure, actually ... danilos, what do you think? ^^16:33
gary_posterleonardr, uh, wait a sec.  gmb, I think this means that someone updated (added) a dependency to sourcecode?  And didn't update ec2 images?  leonardr, I guess this doesn't have anything to do with wadl really, unless you tell me I'm wrong16:33
adiroibanhenninge_: i think Danilo is away16:34
henninge_adiroiban: but using removeSecurityProxy might be ok here. Do that and see what bac says about it ... ;-)16:34
gary_poster(other than it being the point of failure for what appears to be a problem somewhere else)16:34
henninge_adiroiban: so will I be very soon ;)16:34
adiroibanhenninge_: :)16:34
leonardrgary: my guess is that the error happens in wadl generation because that's the first time a new launchpad install is started up16:35
leonardrgary: because we need the wadl to generate the static html apidoc16:35
gmbgary_poster, leonardr: The builder.recipe thing? There's a thread about it on launchpad-dev.16:35
gmbIt's been tracked down to some buildout config weirdness, I think.16:35
gary_posterleonardr: right agree, sorry for bothering you, I don't this has anything to do with you16:35
leonardrnp16:35
henninge_adiroiban: my reasoningn for removeSecurityProxy would be that the owner should not really be able to set it, just in this specific context.16:35
gary_postergmb: well, the build, not buildout per se, but yes.  If I understand correctly, this is exactly the kind of situation that buildout fixes, and we don't get the win because these are branches in sourcecode16:37
gmbgary_poster: Ah, right. So this needs an ec2 image update for db-devel branches to be runnable there again?16:37
jamaltaif i need to reset my database, do i just run make schema again?16:37
gmbjamalta: Yes16:38
gary_postergmb: I think it is nastier than that.  IIUC, we would need an image for db-devel and an image for devel, given the current state.  ...I *think* the right/easy thing to do is to make devel's sourcedeps.conf have the same two lines that stub identified in db-devel16:39
gmbAh, right.16:39
jamaltagmb: alright, thanks16:40
gary_posterflacoste, have you followed along with the "db-devel wadl generation broken" thread?  My thought is that, for an easy solution, we should have a devel branch in which we add the two lines that are in db-devel that stuart identifies (for bzr-builder and bzr-hg)16:41
gary_posterThe other approach is to fix all of our scripts to handle this situation, but I think thta's a rabbit hole16:41
adiroibanhenninge_: can I use removeSecurityProxy for just an attribute?16:41
henninge_adiroiban: oh, sorry, no.16:42
henninge_removeSecurityProxy(context).date_last_updated = datetime.datetime.now(UTC)16:42
adiroibanhenninge_: hm... I did this16:42
adiroiban            date_last_updated = removeSecurityProxy(context.date_last_updated)16:42
adiroiban            date_last_updated = datetime.datetime.now(UTC)16:43
adiroibanand somehow the tests were ok16:43
henninge_adiroiban: maybe it does work ...16:43
henninge_adiroiban: zope never ceases to amaze me ... ;-)16:43
adiroibanhenninge_: it's just that you can not assign to a function call16:44
adiroibanhenninge_: I think this was the only reason why removeSecurityProxy(context.date_last_updated) = datetime.datetime.now(UTC) , is not working16:45
henninge_adiroiban: probably16:45
leonardrgary: given that you're busy with the db-devel problem, i've found another place where i'll need to do utility lookups to do multiversion, so i'd like to hear more about the two-pass proposal you mentioned earlier16:45
henninge_adiroiban: I'll be off now. See you tomorrow!16:45
adiroibanhenninge_: have a nice day. thanks for the help :)16:45
henninge_you, too16:46
gary_posterleonardr: ok.  I'm writing an email to the list about the db-devel thing, then will be available16:48
=== matsubara-lunch is now known as matsubara
gary_posterleonardr: ok, could you point me to the current lazr.restful code that processes the zcml?16:58
leonardrgary: sure, it's in src/lazr/restful/metazcml.py16:59
gary_posterok16:59
leonardrthe problematic zcml handler is 'register_webservice'16:59
leonardri actually have a plan and i want to see if it makes sense, but take a look at that code16:59
gary_posterok16:59
leonardrthe XXX in that method is where the problem is17:00
gary_posterleonardr: so, take a look at register_exception_view in that module17:01
leonardrgary: sure17:02
leonardris that kind of hook setting stuff up for the second pass?17:02
gary_posterleonardr: it is registering a discriminator, a callable, and args for the callable.  This means that ``register_exception_view`` is the first pass and, yeah, ``handler`` is the second pass17:02
leonardrok, then i think my plan will work and is similar to what you were saying i should do17:03
leonardrtake a look at that xxx17:03
leonardri want to specify a more appropriate interface method than IWebServiceClientRequest17:03
leonardrbut that requires looking up a named utility using version number as the name17:03
gary_posterah17:03
leonardrso what i plan to do is define a subclass of zope.component.handler17:04
flacostegary_poster: well, i'm not sure about that, there is no garantee that the tests will pass with these two updated deps17:04
flacostegary_poster: it's a more general problem of having different sourcode deps in different branches17:04
leonardrand call context.action with callable=my new handler17:04
gary_posterflacoste: are the updated or added?  I thought they were added?17:04
flacostegary_poster: devel and db-devel being the most common case17:04
leonardrand args=something like this17:04
flacostegary_poster: if they are added, it should be fine17:04
flacostegary_poster: but i think what might require is one sourcecode directory per root-branch17:05
flacostegary_poster: where root branch are devel, db-devel and production-devel17:05
flacosteand make sure that the scripts picks the one appropriate for the parent branch17:05
leonardr            args=('registerAdapterForVersion',17:05
leonardr                  factory, interface, '1.0', provides, '', context.info),17:05
leonardr            )17:05
gary_posterflacoste: I think it is added.  What you describe sounds good for a later change, particularly if we still don't think we're discarding sourcecode anytime soon17:06
leonardrcall that multiple times, matching each interface to the version *name*, and then have the custom handler 1) do the lookups, and 2) fall over if invalid versions are specified17:06
gary_posterflacoste: I'd like someone (which may mean me) to just add the deps for now though17:06
gary_poster(if they are added)17:06
flacostegary_poster: go ahead17:08
gary_posterleonardr: that sounds fine to me, though I hope that the ``callable`` really just has to be a callable--so, if it makes sense to subclass the handler, then sure, but otherwise you could just pass in your own function that does what you want and not try to be unnecessarily general17:08
leonardrgary: that sounds good17:09
leonardrok, i feel better about this now17:09
flacostegary_poster: discarding sourcecode: we are mostly down to the irreductible core: bzr plugins, c-i-p and shipit17:09
gary_posterleonardr: :-) ok cool17:09
flacostegary_poster: c-i-p will be gone in a month or two17:09
flacostegary_poster: shipit never really poses a problem which leaves the bzr plugins, not sure about those17:10
gary_posterflacoste: Martin Pool mentioned that they were interested in making the bzr plugins setuptools-friendly.  I don't know how doable that is either17:10
flacostegary_poster: ideally they should support eggs installation, but given lifeless stance on setuptools not sure what are the chance of this happening17:10
gary_posterHe wanted to talk it over with me when we were at the last team lead sprint17:10
flacostegary_poster: ah, that'd be great!17:10
jamaltai'm getting these pylint notices and just wanted to make sure that they are safe to ignore (they are not referencing anything i changed)17:11
jamaltahttp://paste.ubuntu.com/359102/17:11
gary_posterjamalta: definitely the lazr.*; less sure about the email.*17:11
jamaltagary_poster: let me get a diff of what i've done17:12
gary_posterk17:12
jamaltait's just two strings changed around :)17:12
gary_poster:-)17:12
jamaltahttp://bazaar.launchpad.net/~jamalta/launchpad/newtag-statement-redundancy/revision/1019517:12
jamaltagary_poster: ^17:12
gary_posterjamalta: yeah, I think you are off the hook :-)17:12
jamaltagary_poster: awesome, thanks :)17:12
gary_posternp17:12
jamaltagary_poster: mind if i throw your name in my proposal? just saying you confirmed that they are not issues caused by me17:14
jamaltaor i could instead just say it was confirmed in #launchpad-dev17:14
gary_posterjamalta: name is fine17:15
jamaltagary_poster: thanks so much17:15
=== beuno is now known as beuno-lunch
=== flacoste is now known as flacoste_lunch
=== matsubara is now known as matsubara-dr
=== beuno-lunch is now known as beuno
=== jamalta is now known as jamalta-lunch
mrevellnight all :)18:03
=== gary_poster is now known as gary-lunch
=== lifeless1 is now known as lifeless
=== jamalta-lunch is now known as jamalta
=== flacoste_lunch is now known as flacoste
wgrantDoes anybody know what bigjools wanted?18:55
wgrantAh, looks like he might be back later.18:56
wgrantAnd he emailed me. Even bette.r18:57
=== matsubara-dr is now known as matsubara
=== gary-lunch is now known as gary_poster
jamaltawell that's a bust, i guess i can't see the buildbot results if i'm not a canonical employee?19:27
maxbjamalta: Indeed :-(. They say they're working on it19:34
jamaltamaxb: Well, at least we have some hope :)19:35
jamaltaMaybe they should give buildbot access to people who have signed the contributors agreement?19:35
jamaltaWho knows what will be decided...19:35
maxbAnonymous read-only viewing of buildbot and pqm status would be a good start19:36
jamaltamaxb: +119:37
wgrantThat's difficult for a couple of reasons: 1) buildbot needs upgrading to remove XSS vulnerabilities and 2) PQM (and soon buildbot) manage production-devel, which needs to remain private for security fixes.19:39
thumpergary_poster: hi20:00
gary_posterthumper: hey20:01
thumpergary_poster: BjornT had a look with me before I sent off the email and had no idea either20:01
gary_posterthumper: ah :-( .  I think I saw someone else reply...20:01
thumpergary_poster: yeah, rockstar replied20:01
thumpergary_poster: if I run the windmill tests just using the test runner they all pass20:02
thumpergary_poster: if I run `make jscheck` they fail20:02
thumperno idea why20:02
thumpergot things like 'already disconnected error'20:02
rockstarthumper, I suspect timing issues, but I'm doing other things right now.20:02
rockstarthumper, I basically spent an 8 hour flight trying to figure out why they were failing, and it was all voodoo20:03
gary_posterthumper: right.  I don't know either, and rockstar, BjornT and mars all know more than I.  mars said he would look into it soon; he's my last best hope for now.20:03
gary_posterbut he has other items he needs to tie up20:03
thumperack20:03
rockstarI'm willing to bet that if I land this, it won't fail in buildbot...20:04
rockstarthumper, you should try first...  :) ^^^20:04
thumperno20:04
gary_posterthumper: the only other thing I know of is to try to rockstar's comment that the Windmill tests are not ready yet to block landings.  That would be something to take up with Björn, and maybe Maris.20:04
BjornTthumper: i would merging in latest devel, and try again. r10192 contains a possible fix20:06
thumper BjornT: ok20:06
salgadothumper, if you run 'make jscheck' on a devel branch, do they fail as well?20:07
thumpersalgado: haven't tried20:07
salgadothumper, that'd indicate something in your setup is not playing along nicely with windmill tests, but only worth trying if stub's change doesn't get rid of the failures you saw20:08
BjornTgary_poster, rockstar: as to whether to block landings. when/how do you propose we fix issues like these? if not now, then we'll probably never will be able to do it, since this is the first time i've seen it (and i've run quite a few tests). we have to go through some level of pain to make it stable. the other alternative would be to not have windmill tests at all, but i don't want us to go there yet20:09
rockstarBjornT, well Windmill tests have jumped leaps and bounds since we started on them.  That was inspired by pain.20:09
rockstarBjornT, however, I have a high priority bug that needs to land this cycle, and the tests are preventing it from landing.20:10
gary_posterBjornT: I'm not advocating, merely observing that this was thumper's other alternative approach.  I agree with your logic, and particularly that they deserve much more of a chance.20:10
BjornTrockstar: did you send a mail to the list about your problems, for others to look at?20:11
rockstarBjornT, thumper beat me to it, with the same issue.20:11
rockstarI detailed what I was seeing in my response.20:11
rockstarBjornT, the simple fact is that the tests are not reflecting real breakages.  All the functionality is still intact.20:12
=== salgado is now known as salgado-afk
BjornTrockstar: fwiw, we had much bigger problems when starting using buildbot. i think the main problem here is that no one knows how to debug it. it's difficult, since the errors seem to be in the app server, not in windmill.20:16
BjornTi might have some time to look at it today20:16
rockstarBjornT, that would be appreciated.  It's really frustrating, and I haven't had much time to look at it.20:18
wgrantbigjools: Does buildd-manager work even with that odd message?20:19
rockstarBjornT, when we had the problems with buildbot, they were more-or-less "stop the presses" kind of problems.  I don't think these are stop-the-presses issues, considering that most of Launchpad is non-js.20:21
BjornTrockstar: well, a lot of our js is stop-the-presses issues. for example, what if peple can't comment on bugs or mps? what if they can't change statuses? those are quite critical issues that we don't want our users to experience.20:25
rockstarBjornT, yeah, but in this case, the functionality isn't broken, just the tests.20:26
BjornTrockstar: yes, and it was the same thing with buildbot in the beginning. would you rather have us not spend time fixing those problems, and instead have gone back to using pqm to run the tests?20:27
rockstarBjornT, so maybe the issue is that we need to get a swat team together to kick down the door and clear the room when we have these problems, and they drop everything else for that.20:28
rockstarBjornT, I'd be willing to be on that team if thumper was agreeable.20:28
BjornTrockstar: yeah. there is the problem that i probably knows the most about theses issues, and i'm busy atm.20:29
BjornTi wonder if gary_poster could spare someone from his team to work on windmill issues?20:29
rockstarBjornT, yeah, I'm also trying to get some work in today so I can spend the rest of the week QAing.  It's likely I can spend tomorrow really looking into this.20:31
gary_posterBjornT: are you asking generally or now as an emergency?  generally, I think, on the Foundations team, mars already has the best handle on this part of the world.  salgado might be a good choice as well, in the future.  For this week, mars could have a bit of time at the end of this week maybe, and more next week; I'd rather not take salgado off his task ATM.  For today, right now, I don't have anybody.20:35
Ursinhahello people20:39
Ursinhawhat do I have to do to add stuff in lp.dev sample data? is there a procedure somewhere?20:40
rockstarUrsinha, my general answer to that is "don't."20:42
Ursinharockstar: right, why?20:42
rockstarUrsinha, it usually causes more problems for me than it fixes.20:42
rockstarUrsinha, I bet salgado has a better answer though.20:43
Ursinharockstar: right... I'll ask him when he's available, thanks20:44
Ursinharockstar: I'll try to go another way to test what I want20:44
rockstarUrsinha, I have a script that I made that creates sample data for my specific use cases when I'm using make run.20:45
Ursinharockstar: can I see that? :)20:46
rockstarUrsinha, do you know about make harness?20:47
Ursinharockstar: yes20:47
rockstarUrsinha, so you should have a factory in make harness.  Use that factory like you would in your tests.20:49
Ursinharockstar: right20:49
rockstarUrsinha, that's how I did it.  I can't seem to find that script right now.  I think it might be on my desktop computer.20:50
BjornTgary_poster: i guess both. mainly now for the emergency, but also for the future, in case it breaks again.20:51
Ursinharockstar: wait, doing that isn't the same as writing the tests?20:52
Ursinharockstar: my problem is that I need to test a change in a page, and I'd need one more series in the project I'm using for it to work20:52
Ursinharockstar: that's why I'm asking about the sample data20:53
rockstarUrsinha, oh, if you're needing test sample data, then the answer is really "don't"20:53
rockstarUrsinha, create the sample data you need in the test itself, using the factory.20:53
rockstarUrsinha, that would mean creating a project and a couple of serieses in your case.20:54
Ursinharockstar: yeah, I guess I found what to do here20:54
gary_posterBjornT: OK.  maybe you and mars can work together a bit next week to give him some more familiarity.  He might have some availability tomorrow.20:58
Ursinhathanks rockstar20:59
=== magcius_ is now known as magcius
bdmurrayI'm having an issue running tests with GoogleServiceLayer and a "Socket poll time exceeded."21:28
intellectronicagary_poster: do you maybe know anything about this? ^^^^^21:29
gary_posterintellectronica: not off hand, and on call21:29
rockstarbdmurray, does it happen repeatedly?21:33
bdmurrayrockstar: yes21:34
=== matsubara is now known as matsubara-afk
wgrantbdmurray: Interesting. I have recently had that occasionally when trying to run LaunchpadFunctionalLayer tests.21:40
wgrantI wonder if it's actually reproducible, and I just haven't noticed.21:40
=== jamalta is now known as jamalta-afk
=== jamalta-afk is now known as jamalta
bdmurrayit stopped happening now21:50
mwhudsonbdmurray: have a look for stuck python processes?21:51
=== abentley1 is now known as abentley
wgrantcanonical.testing.layers.LayerInvariantError: Both Zopefull and Zopeless CA environments setup22:40
wgrantHuh?22:40
mwhudsonfun22:41
elmoyou may be hopeful, but I think it's hopeless22:42
al-maisan^^ a candidate for the quotes page :P22:43
=== jamalta is now known as jamalta-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!