| kwmonroe | yeah bdx, i need to think about it a bit. one the one hand, you *could* just have the datanode storage dir set to a specific place. but we do put other stuff in there, like namenode bits, cache, checkpoint data, etc. so maybe it makes more sense to have a single storage option for "/var/lib/hadoop-hdfs" that lives in the bigtop base layer, rather than "/var/lib/hadoop-hdfs/cache/$user/dfs/data" that would live in the | 00:03 |
|---|---|---|
| kwmonroe | datanode layer. | 00:03 |
| bdx | bundles don't support storage do they? | 00:28 |
| bdx | kwmonroe: I think all you need is https://github.com/jamesbeedy/layer-hadoop-datanode/blob/add_hdfs_storage/reactive/datanode.py#L14,L16 and https://github.com/jamesbeedy/layer-hadoop-datanode/blob/add_hdfs_storage/reactive/datanode.py#L64,L69 | 00:30 |
| bdx | ^ may get it real close, going to find a way to test this | 00:30 |
| kwmonroe | sweeeet bdx! i like how simple that is versus exposing the hdfs-site.xml config. | 00:36 |
| kwmonroe | i also like how i didn't have to write anything ;) | 00:37 |
| kwmonroe | $40 coming to you at the next summit | 00:37 |
| bdx | well, I mean | 00:38 |
| bdx | write me a bundle that uses storage | 00:38 |
| bdx | ahah | 00:38 |
| bdx | :) | 00:38 |
| bdx | I've never seen storage in a bundle I don't think | 00:39 |
| bdx | possibly ill just deploy the bigdata bundle with my built charm inplace of the hadoop-slave that coems with the bundle | 00:40 |
| bdx | then just add the storage following the bundle deploy | 00:40 |
| kwmonroe | bdx: looks like the storage key is valid in a bundle: https://github.com/juju/charm/blob/v6/bundledata_test.go#L41 | 00:46 |
| kwmonroe | but i haven't personally seen bundles with storage either | 00:46 |
| bdx | oh, thats what I was looking for | 00:47 |
| bdx | so for what I'm doing it would be | 00:48 |
| bdx | storage: | 00:48 |
| bdx | hdfs: ebs,10G | 00:48 |
| bdx | ill try it out | 00:48 |
| bdx | applications: | 00:53 |
| bdx | postgresql: | 00:53 |
| bdx | charm: cs:postgresql-171 | 00:53 |
| bdx | num_units: 1 | 00:53 |
| bdx | series: xenial | 00:53 |
| bdx | storage: | 00:53 |
| bdx | pgdata: ebs,10G | 00:53 |
| bdx | boom | 00:53 |
| kwmonroe | nice | 01:14 |
| kwmonroe | bdx: i need to head out, but thanks a lot for making my dreams come true. have a good weekend!! | 01:14 |
| bdx | kwmonroe: backatcha | 01:15 |
| bdx | http://paste.ubuntu.com/p/D5KtMbDGnP/ | 01:15 |
| bdx | working bundle^ | 01:15 |
| bdx | ill pr that in a few | 01:15 |
| bdx | thanks again | 01:15 |
| === `Calvin is now known as Calvin` | ||
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!