/srv/irclogs.ubuntu.com/2011/06/09/#ubuntu-ensemble.txt

hazmatSpamapS, i've got releases out on pypi for it (needs to be updated).. but else its legit01:50
_mup_ensemble/config-set r241 committed by bcsaller@gmail.com08:10
_mup_last review changes pending merge08:10
_mup_ensemble/config-set r242 committed by bcsaller@gmail.com08:11
_mup_merge trunk08:11
_mup_ensemble/trunk r248 committed by bcsaller@gmail.com08:14
_mup_Merge config-set [r=niemeyer] [f=778685]08:14
_mup_Provide an `ensemble set` command. 08:14
_mup_Allow formula to contain an options specification as a YAML file08:14
_mup_Validate user input relative to options configuration08:14
_mup_Extend formula state to include config options08:14
_mup_ensemble/config-example-changes r232 committed by bcsaller@gmail.com08:20
_mup_forward merge (trunk)08:20
kim0Morning everyone09:06
=== al-maisan is now known as almaisan-away
=== Daviey is now known as Da
=== Da is now known as Daviey
=== almaisan-away is now known as al-maisan
kim0Ensemble is written in python, uses twisted, txAWS and zookeeper12:27
kim0did I miss any core technology ensemble uses ?12:28
hazmatkim0, that's the run of it.. we also use yaml for config14:12
hazmatkim0, txaws/ec2 are part of a pluggable machine provider architecture14:12
hazmatthough till we support additional providers.. its a debateable if thats claimable14:12
kim0hazmat: cool thanks14:13
* niemeyer waves14:26
=== al-maisan is now known as almaisan-away
_mup_ensemble/bootstrap-shutdown-environment r249 committed by kapil.thangavelu@canonical.com16:13
_mup_shutdown operates and on only one environment, and prompts for confirmation.16:13
_mup_ensemble/trunk r249 committed by kapil.thangavelu@canonical.com16:28
_mup_merge update-install-docs [r=niemeyer][f=788950]16:28
_mup_Updated install docs referencing the PPA as the preferred installation method.16:28
kim0hazmat: shouldn't 792540 be fix released ? my branch was merged16:29
hazmatkim0, oh.. wasn't sure.. the review looked it was approved, it wasn't clear that it was merged.. if its merge, feel free to update the status16:31
hazmat^like16:31
kim0um16:31
kim0I might be the one imagining things16:31
hazmatkim0, hmm.. actually i might be.. odd 16:31
kim0hazmat: Merged into lp:ensemble at revision 24416:31
kim0that means it was really merged right ? :)16:32
hazmatkim0, on the merge proposal it notes that its merged, on the bug report it just says its approved16:32
hazmatodd indeed16:32
hazmatoh.. that's just me.. being odd its correct16:32
kim0okie dokie16:32
hazmatkim0, updated to fixed released16:32
kim0cool16:32
_mup_ensemble/expose-provision-service-hierarchy r277 committed by jim.baker@canonical.com16:41
_mup_Removed unnecessary workaround for agent restart scenario16:41
hazmatlp seems rather slow today16:46
_mup_ensemble/expose-provision-service-hierarchy r278 committed by jim.baker@canonical.com16:49
_mup_PEP816:49
_mup_ensemble/expose-provision-service-hierarchy r279 committed by jim.baker@canonical.com16:55
_mup_Observer cleanup16:55
hazmatlunch bbiab16:58
_mup_ensemble/expose-provision-service-hierarchy r280 committed by jim.baker@canonical.com17:04
_mup_Relaxed assertion on teardown cleanup (need to make watches more deterministic...)17:04
niemeyerhazmat: Initial review of sec-spec delivered.. nice stuff there17:07
* niemeyer => lunch too17:07
SpamapShazmat: sweet!17:19
SpamapShazmat: if you are going to be releating on pypi then I can add a watch file .. which would be nice.17:19
SpamapSreleasing even17:19
* SpamapS waits patiently for the caffeine to kick in17:20
_mup_ensemble/expose-watch-exposed-flag r244 committed by jim.baker@canonical.com17:21
_mup_Doc string for watch_exposed_flag, removed obsolete version of function17:21
_mup_ensemble/expose-provision-service-hierarchy r281 committed by jim.baker@canonical.com17:22
_mup_Merged upstream expose-watch-exposed-flag17:22
hazmatSpamapS, there's an old release on pypi atm, after i finish up the session event handling work, i'll push an updated release there18:09
hazmatSpamapS, there was some talk a few months back about sending the whole project upstream to zk contrib18:09
hazmati've got a little wary of that in the interim.. its just rather nice to be able to fix things as needed, than push to the upstream bug tracker and wait for a committer to respond on it18:10
SpamapShazmat: that would be cool, since thats where python-zookeeper lives too right?18:10
hazmatSpamapS, it does indeed18:11
SpamapSI think until its been stable and unchanged for some time.. you're right in keeping it18:11
SpamapSyesterday's license fix is an example of the kind of thing that makes me want you to keep it forever. ;)18:11
SpamapSthanks again btw. :)18:11
hazmat:-) np18:11
_mup_ensemble/expose-hook-commands r245 committed by jim.baker@canonical.com18:14
_mup_Added missing assertion on whether port is an integer in hook commands18:14
koolhead17hello all18:16
_mup_ensemble/expose-hook-commands r246 committed by jim.baker@canonical.com18:19
_mup_Merged trunk and resolved conflicts18:19
SpamapShazmat: FYI, I'm taking the man pages bug .. as its part of what I'm working on today (packaging ensemble for Ubuntu/Debian)18:29
jimbakerso what's up with the test failures in trunk - are there any dependency updates i should be aware of, or is that what's covered in the debug-hook-fixes branch?18:34
jimbakeri will hold my expose-hook-commands branch for the moment...18:36
hazmatSpamapS, cool18:45
hazmatjimbaker, what failures on trunk?18:45
jimbakerhazmat, one moment for a paste18:45
hazmathmmm.. those are odd, they weren't there yesterday18:46
jimbakerhttp://paste.ubuntu.com/622740/18:46
jimbakerhazmat, i just wonder if this is related to what bcsaller was talking about in standup18:48
hazmatbcsaller, afaics those errors where introduced by the config-set merge.. before that rev i can do full trunk test runs without error18:48
hazmatnow i get about 21 errors18:48
hazmatjimbaker, yeah.. probably.. i hadn't realized the problem was so widespread though18:49
bcsallerhazmat: I cannot, trunk did that for me before the merge 18:49
bcsallerrun in isolation different sets of those test will pass 18:49
hazmatbcsaller, ugh18:49
bcsallerthats what I was talking about 18:50
bcsallerthere is bleeding in some of the setup/teardown18:50
hazmatbcsaller, i updated to before the config-set merge, and was able to run all the tests on trunk... this much breakage on full test runs is a problem18:50
hazmatbcsaller, yeah... perhaps some environment / global stomping18:50
hazmatbcsaller, it looks like a good number of the failures are because the logging config is changed, and expected outputs dont match anymore18:51
bcsallerhazmat: hmm, I thought even some of those passed in isolation, have to check that again 18:52
jimbakerat this point to prevent bleeding, i'm always running tests w/ -u18:52
jimbakernot perfect, but catches some bad assumptions about teardown18:53
hazmatso this needs some better resolution and practice than merging a branch which breaks a bunch of tests18:53
* hazmat pokes at the diff18:53
bcsallerhazmat: again, I was seeing this in trunk as well 18:54
hazmatbcsaller, ok, but we need to escalate it then.. i think i asked what sort of failures you where seeing on the call yesterday18:55
hazmatbcsaller, the diff looks totally innocous 18:56
hazmatjimbaker, if you update to before config-set ( bzr up -r 247) and run trunk tests, do you see failures?18:57
hazmatugh.. i really need to be doing reviews as well19:01
jimbakerhazmat, i will check that too19:03
hazmatokay found a few review items, and the problem19:05
* hazmat does a full test run to confirm19:06
hazmatbcsaller, when you say you had the same problems on trunk... you mean you had the same failures on full test runs.. are you sure it wasn't that you tried to merge, did a test run, reverted the merge, and did another test run19:07
hazmatbcsaller, trial has the unfortunate habbit of not ignoring/removing stale bytecode19:07
jimbakerhazmat, r247 works just fine19:07
hazmatjimbaker, thanks for confirming.. i've got the fixes for trunk19:08
jimbakeri'm going to run it with -u now just to see how that works19:08
jimbakeractually running it now like that19:08
jimbakerhazmat, sure, once you have them i will certainly review19:08
hazmatjimbaker, i get occasionally a failure about subprocess when looping tests on trunk in one test i forgot which19:08
hazmatbcsaller, jimbaker, niemeyer standup?19:08
jimbakerhazmat, on the second run of -u for r247, i got ensemble.agents.tests.test_unit.UnitAgentResolvedTest.test_resolved_stopped19:09
jimbaker(failure in that)19:09
bcsallerwhen I hit problem after a merge from trunk in my branch I  ran it from trunk proper. When I saw issues there I was confident it wasn't in my code19:09
niemeyerhazmat: Yeah19:09
hazmatbcsaller, well that's the thing.. you have to clean out all the bytecode on trunk after reverting the merge19:09
jimbakerhazmat, sounds good about standup19:10
hazmatbcsaller, else you'll get stale bytecode... we have multiple confirmations now that b4 the merge this didn't exist19:10
bcsallerhazmat: I didn't revert a merge, I merged to branch, saw issues I wasn't having before and then ran it on trunk (w/o the merge)19:10
hazmatbcsaller, ah19:10
hazmatwierd19:10
bcsalleryeah19:10
bcsallerand its order dependent like I was saying, sometimes running the module alone doesn't produce an issue 19:11
jimbakereventually i do get an error on looping ensemble.hooks.tests.test_invoker, which looks like the log question we just talked about in standup19:33
jimbakerso this is the relevant paste: http://paste.ubuntu.com/622776/19:43
SpamapSoo.. learning about Go.. I like the defer statement19:44
niemeyerSpamapS: +119:55
jimbakerhowever, i did confirm that the save/reset logging can work successfully w/ -u (in looking specifically at test_invoker.PortCommandsTest)19:55
jimbakerdoesn't change the need to make this fix, it's still tech debt19:57
jimbakerSpamapS, definitely agreed about go19:57
niemeyerjimbaker: Not just the fix, but it'd be good to have in the ML an explanation about why it worked like that, and a suggested way for everyone to implement equivalent logic the proper way20:03
jimbakerniemeyer, sounds good20:06
hazmatjimbaker, the question i had is why is it needed at all.. is there something internal to the app code that manipulates logging channels on the fly?20:21
jimbakerhazmat, indeed, i will investigate that20:22
_mup_Bug #795233 was filed: Investigate use of save_logging, reset_logging and remove them from tests <Ensemble:New> < https://launchpad.net/bugs/795233 >20:35
jimbakerbiab, also my home internet connection is now down after last night's thunderstorm, need to look into it20:37
hazmatniemeyer, bcsaller can i get a +1 on this fix for the trunk tests... i leaked some pep8 cleanups and the fix to use a cli util function into it https://pastebin.canonical.com/48373/20:47
hazmatstill pretty small though20:48
niemeyerhazmat: Looks good20:53
niemeyerhazmat: +120:53
hazmatniemeyer, thanks20:54
_mup_ensemble/trunk r250 committed by kapil.thangavelu@canonical.com21:00
_mup_[trivial] fix for unit test failures due to spurious reset logging invocation [r=niemeyer]21:00
_mup_ensemble/set-transitions r232 committed by bcsaller@gmail.com21:12
_mup_adding service to missing hookcontext init and various pep8 cleanups21:12
niemeyerbcsaller, hazmat, jimbaker: Btw, now that we have the 2 reviews rule, the workflow is a little unclear. It seems like the _second_ reviewer should be careful to move the branch to "Work in progress" or "Approved"21:19
niemeyerI'm still a little wary of the additional delay the process will impose, but am keen on trying it out too21:19
=== almaisan-away is now known as al-maisan
_mup_txzookeeper/session-event-handling r43 committed by kapil.foss@gmail.com21:39
_mup_pull in the managed zk abstraction from ensemble21:39
* kirkland high fives niemeyer 21:40
niemeyerkirkland!21:42
niemeyerkirkland: Welcome!21:42
=== al-maisan is now known as almaisan-away
niemeyerhazmat: I've reserved a review re. the watch conversation for you21:51
niemeyerhazmat: On jim's branch, that is21:51
_mup_ensemble/expose-hook-commands r247 committed by jim.baker@canonical.com21:58
_mup_Merged trunk21:58
_mup_ensemble/set-transitions r233 committed by bcsaller@gmail.com22:04
_mup_merge trunk22:04
jimbakerhazmat, just to make certain i got the new process - expose-hook-commands is ready for release with one review; this along with silence-deprecation-warnings are the last branches that only require one review, from niemeyer22:08
niemeyerjimbaker: That sounds good, unless hazmat would like to have a look at it22:45
jimbakerniemeyer, sounds good. i need to take off now, hopefully internet service is resumed at home22:49
SpamapShey guys I don't know if I agree that the debug-log should show all relation-sets ..23:37
SpamapSre bug #76631723:37
_mup_Bug #766317: debug-log should show relation settings changes <Ensemble:New for jimbaker> < https://launchpad.net/bugs/766317 >23:37
SpamapSThat should be entirely optional to the formula author.23:37
SpamapSI'd concede showing which values were changed, but not the values themselves. At some point, you'll want to contain those information leaks to the members of the relation and zk/bootstrap.. debug-log is free for anybody.23:38
hazmathmm23:39
hazmatSpamapS, its a question of debug utility vs. white noise and security?23:39
hazmatSpamapS, from a security perspective .. its not  a free for all23:40
hazmatSpamapS, any admin using the ensemble cli.. atm is considered a root.23:40
hazmathmm23:40
SpamapSdebug-hooks should remain unrestricted... but debug-log actually sticks it in a log file on disk on the sender..23:40
SpamapSYeah *that* may also be a bad idea.23:40
hazmatniemeyer, i totally skipped multiple ensemble users and stack delegation in the security doc23:40
SpamapSthink about LOSA's ... they're not root but they can enact change.23:40
hazmatSpamapS, yeah.23:41
SpamapShazmat: I think its totally fine to say that for now.. and add it to the "TODO" list. :)23:41
SpamapShazmat: but putting all that info in the log is my only concern23:41
hazmatSpamapS, if your interested i put together a security overview.. and some of ensemble's next steps on security23:41
* hazmat digs up a link23:41
SpamapSThis may be a bit of sysadmin dogma seeping through, so I think a good logical analysis is in order, not an outright rejection of the idea.23:41
SpamapSYes very interested23:42
SpamapSI imagine we'll get lots of questions at bofs and such23:42
hazmatSpamapS, at the bottom of this https://code.launchpad.net/~hazmat/ensemble/security-specification/+merge/6392123:42
hazmatits pretty high level23:42
SpamapSbcsaller: I forget, are you talking at devops days or doing a velocity bof?23:42
SpamapShigh level is all we need for answering questions23:42
bcsallerSpamapS: I am talking at Structure, I sent in a proposal at devop days but they didn't get back to me23:43
hazmatits more vulnerability assessment that adaptation to multi-user or org workflows23:43
hazmats/that/than23:43
SpamapSbcsaller: ah ok23:43
SpamapSbcsaller: when is structure?23:43
hazmatmy plumbers talk bit the dust as well23:43
* hazmat wanders off into the night23:44
bcsaller22nd/23rd23:44
niemeyerhazmat: That's fine.. we're not considering the multi-user scenario at this point23:52
niemeyerhazmat: I mean.. there's no security separation between different users23:52
niemeyerhazmat: So the implications for a single user and for multiple users are the same23:53
jimbakerhazmat, are ok with my releasing expose-hook-commands, or do you want to review it too23:55

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!