/srv/irclogs.ubuntu.com/2016/07/18/#juju.txt

jobothello, is it possible for a charm to know that it is related a mysql db vs a postgresql db, or is that something that would need to be in the configuration?00:08
=== spammy is now known as Guest81296
marcoceppimagicaltrout: which meeting was that?03:07
PrabakaranCould somebody help me juju 2.0 uninstallation steps on ubuntu?06:52
magicaltroutuninstallation?07:24
magicaltroutapt remove --purge juju-2.0 (ish)07:24
magicaltroutthen rm -rf ~/.local/share/juju if anything is left there07:25
=== jamespag` is now known as jamespage
MonsieurBonHi all08:12
MonsieurBonI have bootstrapped the bootstrap node and am now trying to access the juju gui. I can reach the login page, but nothing ever happens when clicking the login button. Does anyone know, what could be the problem?08:13
MonsieurBonI have checked with the developer tools in firefox and I can't see any activity08:15
MonsieurBonMainly I'm using Firefox, but I have the same effect with Chrome08:16
babbageclunkBonjour MonsieurBon! Hmm. Can you see anything interesting in the logs? Try "juju debug-log" while visiting the login page?08:17
MonsieurBonNo, nothing. Should I execute juju debug-log on the host, where juju was installed initially or on the bootstrap node?08:19
MonsieurBonThe dev tools don't show any activity at all. No logs, no network activity, nothing. I also can't see any errors there.08:20
babbageclunkOn the host - whereer08:20
babbageclunkOopd08:20
babbageclunkgah08:20
babbageclunkWherever you are running juju status.08:20
MonsieurBonok, I did that. It doesn't show anything08:21
babbageclunkSo you don't even see a request back to the server when you click login?08:21
MonsieurBonNope, nothing at all08:21
magicaltrouti've not been keeping up with the gui compatability. is there a gui <> beta offset currently or should it work?08:21
MonsieurBonIt does call /api when loading the page, but that just returns a 101 response. And no XHR calls after that08:22
MonsieurBonjust to let you know, I did not install the juju-gui charm manually, but am accessing the automatically deployed gui on the bootstrap node.08:23
babbageclunkmagicaltrout: good point - there was that breaking api change.08:23
babbageclunkMonsieurBon: What version of juju are you running?08:23
MonsieurBon2.0-beta7-xenial-amd6408:24
MonsieurBonThe bootstrap node is running trusty though. Might this be a problem?08:24
babbageclunkI don't think so. That's a pretty old beta though - 12 is just out. There have definitely been some bugs with the GUI, so it would be worth upgrading and rebootstrapping.08:25
MonsieurBonthis is just a test setup, so I can switch the juju node to trusty any time08:25
MonsieurBonapt-get upgrade does not show me any updates!08:27
magicaltroutits probably in a ppa MonsieurBon08:27
MonsieurBonI'm using the ppa08:28
magicaltrout2.0 beta1208:28
MonsieurBondeb http://ppa.launchpad.net/juju/stable/ubuntu xenial main08:29
magicaltroutnope08:29
magicaltroutdevel ppa08:29
MonsieurBonI'll give that a try08:29
MonsieurBonwhy is stable installing beta packages anyway?08:30
babbageclunkYeah, that does seem weird.08:30
magicaltroutwell08:30
magicaltroutyou don't need to install 2.0 you can still install 1.2508:31
MonsieurBonwell this is just testing, so i'll give 2.0 beta 12 a go and will reinstall with 1.25 if it doesn't work08:32
MonsieurBonHow do I "rebootstrap"? destroy and recreate?08:33
magicaltrouterm08:33
magicaltroutyeah juju kill-controller08:33
babbageclunkYes, unfortunately these betas aren't upgradable yet.08:33
magicaltroutor something08:33
magicaltroutthe names keep changing:)08:33
babbageclunkjuju destroy-controller is the currently blessed command.08:34
babbageclunkI mean, that's always been the command! ;)08:34
MonsieurBonI'll give destroy-controller a chance before killing it :)08:34
* magicaltrout clearly just gets bored and goes hardcore08:34
magicaltroutdidn't know remove-controller existed :)08:35
babbageclunkYeah, we're trying to get people not to use kill-controller - if destroy-controller isn't working for something that's a bug.08:35
magicaltroutpfft08:35
babbageclunk:)08:35
magicaltroutkill kill kill!08:35
MonsieurBonWell it's nice to at least ask politely first :)08:36
babbageclunkApparently it's too easy for kill-controller to leave some instances running in the cloud and people getting billed without realising!08:36
babbageclunkOoh, I finally see how you can use chrome dev tools to spy on websocket traffic - that might come in handy if you're still having a problem after bootstrapping on beta12, MonsieurBon.08:38
MonsieurBonof course now destroy-controller does not seem to do anything... :)08:39
babbageclunkUh oh.08:40
babbageclunkSo what's happening?08:40
MonsieurBonnothing08:40
MonsieurBonkill did the job :)08:41
babbageclunkAh well.08:41
magicaltroutKILL!08:41
babbageclunkWere you bootstrapping to lxd?08:41
MonsieurBonUnable to open API: open connection timed out08:41
MonsieurBonnope, an old laptop :)08:41
babbageclunkBut what cloud?08:42
MonsieurBonit's kind of a weird test setup08:42
babbageclunkUsing maas? Or manual provider?08:42
MonsieurBonjuju and maas are running on vm's08:42
MonsieurBonmaas yes08:42
MonsieurBonand there are two laptops commisioned through maas I'm playing around with08:43
babbageclunkRight - it's worth making sure that all the nodes are released in the maas ui.08:43
MonsieurBonyes sure08:43
MonsieurBonthey were08:43
babbageclunkCool cool]08:43
MonsieurBonand it works!09:14
MonsieurBonthx for your help09:14
magicaltroutMonsieurBon: the later beta?09:14
magicaltroutor 1.25?09:15
MonsieurBonbeta 1209:15
magicaltroutcool09:15
MonsieurBonI'll make sure to use the stable once we're deploying maas/juju for production :)09:15
magicaltroutthis is what happens when the hackers keep changing API ! :P09:15
babbageclunk\o/09:15
MonsieurBonand it is blazingly fast!09:16
magicaltroutif you're interested in local testing as well MonsieurBon09:17
magicaltroutmake sure you check out the lxd provider09:17
babbageclunk+109:17
MonsieurBonwell I was wondering, can I bootstrap the controller for maas into an lxd container?09:18
MonsieurBonOr will I always "lose" one node to bootstrapping whatever cloud I'm using?09:19
babbageclunkWell, if you're using lxd you don't actually need maas - you can just deploy to lxd directly.09:22
babbageclunkOr you can deploy to lxd containers on maas nodes.09:22
MonsieurBonyes, but I would still like to use physical machines to deploy to09:25
babbageclunkI don't think you can deploy to a container on the node, sorry.09:33
babbageclunkYou can deploy things to the controller machine though, if you want to.09:34
babbageclunkSorry, should have said the controller model.09:35
babbageclunkjuju deploy -m controller <application> --to lxd:009:35
babbageclunkThe only problem with that is that you can't make relations between applicatons in the default model and others in the controller model.09:36
RajithHi I tried uninstalling and re-installing juju , but I am getting version 2.0-beta7 , I need latest 2.0-beta12 to install.  for installation I am following https://jujucharms.com/docs/devel/getting-started09:38
magicaltroutRajith: you need the devel ppa09:40
Rajithlet me know the steps for getting devel ppa09:41
magicaltrouthttp://lmgtfy.com/?q=juju+devel+ppa :)09:43
babbageclunkRajith: sudo apt-add-repository ppa:juju/devel09:43
babbageclunkthen: sudo apt update; sudo apt install juju-2.009:43
magicaltroutlazy question: anyone have a one liner to shutdown all lxd containers?09:44
Odd_Bloke$ sudo halt  # ;)09:45
babbageclunkI feel like this is a trick, but isn't it `sudo lxd shutdown`09:45
babbageclunk?09:45
magicaltroutsorry09:45
magicaltrouts/shutdown/delete09:46
babbageclunkHuh, no - they come back up again.09:46
magicaltrouti have a bunch of stale juju lxd images and I can't be bothered deleting them all one by one09:46
magicaltroutdocker you can pipe a list in09:46
magicaltroutI was hoping there was a similar lxc trick09:46
babbageclunklxc delete can take multiple containers - you can pipe the list into xargs lxc delete, I think.09:47
magicaltroutyeah I  can't figure out how to get just a list of container names09:48
magicaltroutlxc list gives you all the extra crud09:48
=== anita is now known as Guest60423
Odd_Blokemagicaltrout: `lxc list --format json | jq -r '.[] | .name'` looks like it will do it.09:54
magicaltroutah Odd_Bloke cool! I was playing around trying to find an output that I could manipulate09:56
magicaltroutyou beat me to it09:56
Odd_Bloke:)09:56
* magicaltrout will blog it for posterity09:56
babbageclunkOdd_Bloke: nice - I normally just use grep and cut, but it's a bit fiddly.10:02
Odd_BlokeYeah, I was using jq for something else last week, so it was fresh in my mind as a possibility.10:03
RajithTrying to uninstall juju getting error:  cannot destroy 'lxd-pool': pool is busy10:14
magicaltroutkwmonroe: cory_fu FYI I deployed the hadoop processing bundle on LXD earlier and it failed miserably waiting for Java10:24
=== Guest81296 is now known as spammy
MonsieurBonhi guys12:08
magicaltroutuh oh12:08
MonsieurBonI know now why juju 2.0 beta4 was installed even though I had the stable ppa added12:08
MonsieurBonbecause that's the version in the ubuntu repositories!12:08
MonsieurBonfor xenial at least12:09
MonsieurBonsame for maas: beta2 (or so...)12:09
MonsieurBonI think it's a bit weird to supply beta versions in an LTS server operating system!12:09
MonsieurBonHow can I make sure, only the stable version will be installed for juju?12:11
magicaltrouterm12:11
magicaltroutyou're on Xenial?12:11
MonsieurBonyes12:12
magicaltroutapt install juju-1.2512:12
MonsieurBonsame applies to maas I guess?12:12
magicaltroutdunno never used maas12:13
magicaltroutprobably12:13
MonsieurBonhum, there's no maas-version package...12:13
magicaltroutthere is a stable PPA12:14
magicaltroutoh12:14
magicaltroutno xenial build12:14
magicaltroutdunno, you require the support of a canonical person :)12:15
MonsieurBonor from the #maas channel! :)12:15
magicaltroutbabbageclunk: --^12:15
magicaltroutthe us folk will start appearing shortly MonsieurBon12:15
MonsieurBonhehe12:15
magicaltroutthe traffic will pick up with brainy folk12:15
magicaltroutrick_h_ will know someone who knows12:16
* rick_h_ knows nothing!12:16
MonsieurBonis there a problem with juju 1.25 talking to maas 2.0?12:16
* magicaltrout shrugs 12:16
magicaltrout:)12:16
rick_h_1.25 doesn't talk maas 2.012:16
magicaltroutrick_h_ will know someone who knows ;)12:16
rick_h_only juju 2.012:16
MonsieurBonYou know nothing, rick_h_12:16
MonsieurBon:)12:17
magicaltroutrick_h_ knows.....12:17
rick_h_and yes, juju 2.0 is in xenial as juju, and a new beta is coming  today12:17
rick_h_beta1212:17
MonsieurBonI feel like beta12 is still giving me troubles.12:17
MonsieurBonlets see how to install maas < 2.0 then...12:17
MonsieurBonmight have the added benefit of wake-on-lan! :D12:17
magicaltroutkjackal: you available?12:19
MonsieurBonapparently I need to use 14.0412:24
rick_h_MonsieurBon: what with beta12 is giving you trouble?12:25
rick_h_MonsieurBon: yes, to run maas 1.9 but you can run 16.04 on top of that maas 1.9 ok. So the one machine maas runs on needs to be 14.04 if you're using maas 1.912:25
MonsieurBondon't know. mysql charm seems to deploy to lxd on machine x but state always shows as unknown12:26
rick_h_MonsieurBon: the machine state or the application status?12:27
MonsieurBonthe application state12:27
MonsieurBonmachine boots fine12:27
rick_h_may just be the charm isn't setting anything awesome or useful in there I guess12:27
MonsieurBonnothing else runs on that machine (yet) so no relations. Just the mysql charm12:27
magicaltroutMonsieurBon: try the mariadb charm as well12:29
magicaltroutif the mysql is giving you problems12:29
MonsieurBonis that completely interchangeable?12:30
MonsieurBoni.e. it'll talk to the likes of nova-compute?12:30
magicaltroutah you doing openstack stuff12:30
magicaltroutno in that case :)12:31
MonsieurBonok, I'll try a downgrad then. According to the maas channel I shouldn't use 16.04 until the point 1 release :)12:31
magicaltroutwimps12:31
magicaltroutthey need to man up12:31
MonsieurBonhehe12:32
magicaltroutcory_fu: as kjackal isn't talking to me, ping me when you have 2 mins, just got a quick Hadoop Q12:33
magicaltrout(please)12:33
kjackalmagicaltrout: hey13:03
kjackallet me read what's up13:03
magicaltroutnot the backlog13:03
magicaltrouti've not asked my question yet13:03
kjackalgo on13:04
magicaltroutkjackal: i just wondered, I'm finishing up this PDI charm, and the Hadoop configuration is optional but obviously I'd like it in place for interaction with your bigtop stuff13:05
magicaltroutif I told it to use the hadoop-client layer stuff, I could get access to the *-site.xml config files it needs I guess, but would that make it a mandatory relation with Hadoop?13:05
magicaltrouti'm trying to avoid having a hadoop charm and a non hadoop charm version13:06
kjackalmagicaltrout: cool! making a relation mandatory or not has to do with the logic you put on the reactive part of your charm13:07
kjackalyou can completely ignore a relation by not having any hook acting on joining and/or departing13:08
kjackalthere are a couple of techniques that you may find interesting in case of optional relations13:09
kjackalfirst you can test for a state13:09
kjackaland then you can build the interface from any existing relation13:10
kjackalmagicaltrout: give me a moment to find an example13:10
=== gnuoy` is now known as gnuoy
magicaltroutwell i want to act on  the relation, but I don't want the charm to be subordinate to hadoop being available13:11
magicaltroutbasically13:11
magicaltroutwhich maybe just  how it is, i've not yet tested it13:11
magicaltrouti'm just making sure PDI can talk to hadoop  then i'll dump it all in the charm logic13:12
kjackalok, let me understand what you have right now13:13
kjackalright now you have PDI that does not relate to hadoop, right?13:13
magicaltroutit doesn't13:14
kjackalawesome13:14
magicaltroutbut to do so all i need to do is copy in the hadoop configs13:14
magicaltroutand set a couple of parameters13:14
kjackalok, cool! So you need to build on this layer:  'layer:hadoop-client'13:16
magicaltroutokay cool13:17
kjackalyou would better set an option silent: True so that the hadoop client does not report "ready"13:17
magicaltrouti'm  sure i can manage that13:17
kjackalhave a look at what spark is doing: https://github.com/juju-solutions/bigtop/blob/spark/bigtop-packages/src/charm/spark/layer-spark/layer.yaml13:17
kjackalspark will deploy as standalone and if you relate it to a hadoop-plugin it will be able to use hadoop and hdfs13:18
magicaltroutah13:18
magicaltroutmarvelous13:18
magicaltroutjust what i need13:18
kjackalso you add the hadoop-client layer13:18
kjackalthen you react to whatever might change your configuration: https://github.com/juju-solutions/bigtop/blob/spark/bigtop-packages/src/charm/spark/layer-spark/reactive/spark.py#L10413:19
kjackalmagicaltrout: the fact that hdfs is available is spotted by https://github.com/juju-solutions/bigtop/blob/spark/bigtop-packages/src/charm/spark/layer-spark/reactive/spark.py#L12313:21
kjackalmagicaltrout: there is also the option to create an interface object from a state: https://github.com/juju-solutions/bigtop/blob/zookeeper/bigtop-packages/src/charm/zookeeper/layer-zookeeper/lib/charms/layer/zookeeper.py#L8113:23
PrabakaranHi marcoceppi: do have any updated on this issue https://github.com/marcoceppi/charm-mysql/issues/414:46
PrabakaranHello Team, Could someone help me with Juju 2.0 Uninstallation steps?14:53
MonsieurBonjuju deploy juju-gui returns cannot retrieve charm network is unreachable15:00
MonsieurBonBut I can telnet to the displayed IP address / port15:00
MonsieurBonwhat might be wrong?15:00
magicaltroutrouting, dns,  something else?15:00
MonsieurBonI can resolve api.jujucharms.com15:01
magicaltroutfrom the controller?15:01
MonsieurBonthis is juju 1.25 now :)15:02
MonsieurBonnot from the bootstrap node15:02
MonsieurBonshould I try this from the node I'm deploying juju-gui to?15:03
MonsieurBoni.e. the bootstrap node?15:03
magicaltroutyeah15:03
MonsieurBonhow do I connect to the node?15:04
MonsieurBonwhat ssh user?15:04
MonsieurBonoh, found juju ssh15:05
MonsieurBonnope, no connectivity on that host. I'll go and check the FW15:06
=== zz_CyberJacob is now known as CyberJacob
MonsieurBonmagicaltrout, stupid me: missing default GW in maas interface configuration!15:40
magicaltrout\o/15:40
MonsieurBonI should have noticed this before, as bootstrapping had some troubles already!15:42
lazyPowerMonsieurBon really glad you got it figured out though :)15:42
magicaltrouthe's no MonsieurBon, dont believe  a  word lazyPower says!15:43
lazyPowerO_o15:43
MonsieurBonlazyPower, me too :)15:43
lazyPowermagicaltrout - who gave you access to the peanut gallery today?15:43
* lazyPower throws peanuts @ magicaltrout 15:43
magicaltrouthehe15:43
MonsieurBonmagicaltrout, no I believe it. Because if I hadn't he would have to try to support me. So I'll bet he's glad :)15:43
magicaltrouti'm allowed, I've been trying to finish my pdi charm all afternoon15:43
magicaltrouti believe that buys me peanut credits15:43
lazyPowermagicaltrout - http://traefik.dasapp.co -- i've managed to figure out proper reverse proxying and networking in our k8s bundle(s)15:44
lazyPowerand you bet, I'll give you 36 hours of peanut gallery access for hte mention of completion of the current iteration of the pdi charm(s)15:44
lazyPowerin other words, i have no idea what i am talking about15:44
magicaltrouthehe15:44
lazyPowermagicaltrout - how have you been addressing networking in mesos?15:45
magicaltrouti've not (yet)15:45
lazyPowerdoes marathon/dcos bring with it, its own flavor of SDN business?15:45
lazyPowerah ok15:45
lazyPowerthis wasn't nearly as painful as I was expecting.15:45
magicaltroutthe problem is, you dump stuff into the cluster, and locally it will spin up the stuff I need and create endpoints15:46
lazyPowergranted its not fully spaces aware so its completely possible to model yourself into a corner as it stands today15:46
magicaltroutbut there is the conundrum of the juju managed firewall15:46
lazyPowerexactly15:46
lazyPowerjuju run --service foobar "open-port 3600"15:46
lazyPowerthats schenanigans15:46
lazyPoweri have spoken with marcoceppi about spiking on a daemon that runs to handle that on behalf of hte user. Enable it via config/etc.15:46
magicaltroutyeah, but its not nice and doesn't close if you undeployed a serive15:46
magicaltroutservice15:46
lazyPowerwell the idea is the daemon listens on the service level and opens whats defined ther15:47
magicaltroutthat said, dc/os has a command line util I believe you can use to deploy stuff, so if you didn't use the dashboard and instead used a juju action and cli15:47
magicaltroutthat could manipulation the fw#15:47
lazyPoweror closes respectively15:47
lazyPowerlike every minute, scrape the api, and determine if an action is required15:47
magicaltroutyeah15:47
magicaltroutthat would be good15:48
lazyPowerok i'll draft that up to the mailing list so we can get more feedback on this.15:48
magicaltroutcool15:48
lazyPowerthanks for riffing :D15:48
magicaltroutno worries, i'm working on cleaning stuff up this week when i'm not being annoyed by NASA bods15:48
magicaltroutso I'm gonna try and get PDI & DC/OS Master scalaing done15:48
magicaltroutonce the master scaling is done, the rest of the basic stuff is pretty straightforward15:49
magicaltroutjust need a few actions to sort out logins and automate the cli installation15:49
magicaltroutI'm  sat in the Snappy Sprint roundup and there is a guy with a far too sculpted beard for a developer15:51
magicaltroutI'm not sure whats going on in the world any more ..... ;'(15:51
magicaltroutMonsieurBon do you sport a beard?15:52
MonsieurBonmagicaltrout, sort of. you?15:54
magicaltroutonly when I've woken up too late to shave.15:54
MonsieurBonwhy are you asking?15:54
magicaltroutbeards are acceptable, but if you have time to sculpt your beard you're clearly not overworked enough ;)15:54
MonsieurBonhehe :)15:55
MonsieurBonbut wouldn't being shaved hint into the same direction?15:55
mskalkamagicaltrout, I think you're onto something there. Beard-groomedness could be a positive indication of employee health15:55
magicaltroutlol15:56
magicaltroutmaybe15:56
mskalkafollowing the same logic, all developers should grow beards15:56
MonsieurBonmskalka, or that it's time for some downsizing :)15:56
mskalkadownsize the beards or the employees?15:57
MonsieurBonwhen there's too much beard downsizing then there's not enough employee downsizing, I'd say!15:57
magicaltrouti can see a gap in the silicon value market15:58
magicaltroutsod onsite nurseries and basketball courts15:58
magicaltroutget a beard groomer on the google campus and I'm there!15:58
mskalkaall I'm getting out of this is to let me beard run wild. That way my employer thinks I'm overworked and thus productive, and I get to keep my beard and my job15:58
Odd_BlokeI'm not sure Silicon Valley needs any more ways of signalling to women that they aren't welcome.:p15:59
magicaltroutwomen can sport beards if they so choose.....15:59
mskalkawomen are welcome to sport beards as well15:59
MonsieurBonwell you could always include the beard groomer in some general wellness facility that would supply other hairy services16:00
lazyPower... this went in the weeds pretty quickly16:00
magicaltroutlol16:00
mskalkawe're on the cutting edge of HR here lazyPower16:00
* lazyPower silently closes the window and resumes hacking on a blog post16:01
* lazyPower shakes head16:01
magicaltroutlazyPower is jealous16:01
magicaltroutbecause he doesn't have a groomed beard16:01
MonsieurBonand I still don't know why exactly magicaltrout asked the initial question :)16:01
lazyPowerconsidering how disshelved i look all the time, i think i'm qualified to no-op on this one.16:01
magicaltroutcause i'm sat in a sprint roundup and someone with a groomed beard stood up16:01
lazyPowerthats probably stokachu16:02
stokachuo/16:02
magicaltroutstokachu: got a beard?16:02
lazyPowerwell, he did anyway :)16:04
lazyPowernot sure if thats still the case16:04
MonsieurBonI have to say, all the stable version work much better, than the beta ones! :)16:11
stokachuhaha16:13
MonsieurBonthank guys for all you help today16:19
MonsieurBoncu later16:19
magicaltroutno problem16:19
magicaltrouthappy grooming!16:19
MonsieurBonyes, same to you!16:19
PrabakaranHi marcoceppi: do have any updated on this issue https://github.com/marcoceppi/charm-mysql/issues/416:40
marcoceppiPrabakaran: no. When I do I will reply to that thread.16:41
Prabakaranthanks marcoceppi :) i am struct on this point ... please confirm to me once u r done making these changes at your ealiest convenience17:32
magicaltrout*chuckle*17:40
x58Are there any charm helpers that grab all network interface names, and their assigned IP's?17:56
x58Or any charm helpers that parse /etc/network/interfaces17:58
mskalkawhat language are you working in?17:58
x58Python17:59
x58mskalka: ^17:59
mskalkax58: https://pythonhosted.org/charmhelpers/api/charmhelpers.contrib.network.html might lead you somewhere18:01
x58Perfect.18:01
mskalkaI ran into the same issue developing a charm in Rust, not super familiar with the python charm libraries18:01
x58mskalka: Looks like it has part of what I need. Will just go steal some code :P18:06
mskalkax58, glad to help. Might also want to look into python's sh package18:07
magicaltroutkjackal: I think we've had this convo beforee18:19
magicaltroutdoes hadoop bundle stuff run ZK or not?18:19
magicaltrouti vagely remeber some HA thing18:19
cory_fumagicaltrout: kjackal is EOD, but the answer to your question depends on which Hadoop bundle you mean.  The Bigtop one (https://jujucharms.com/hadoop-processing/) doesn't currently include ZK because it doesn't currently include HA, but kjackal is currently working on adding that back in.  The slightly older vanilla Apache bundle (https://jujucharms.com/apache-processing-mapreduce/) does include HA and thus does include ZK18:32
magicaltroutcory_fu no worries just filling in the blanks in the PDI  charm, thanks18:33
=== wolverin_ is now known as wolverineav
bdxwhats up all?18:39
bdxhas anyone used https://jujucharms.com/u/stub/storage with aws successfully?18:39
bdxI'm trying to use the storage charm to get my elasticsearch datadir mounted on an ebs vol ...18:40
bdxit seems the storage charm should be capible of this, but I can't seem to get it to attach a pre-existing vol, or to create and attach a new vol18:40
bdxanyone use this yet, at all?18:41
bdxcapable*18:41
bdxcan spell18:41
bdxstub: ping18:43
cory_fubdx: Unfortunately, it's almost 2am stub's time, so you likely won't get a response from him for a few hours.18:44
cory_fuAlso unfortunately, I haven't used that charm, so I can't really offer any advice.18:44
cory_fulazyPower: I don't suppose you've used it before?18:44
magicaltrouttimezones are for wimps18:44
* lazyPower reads backscroll18:44
lazyPowerbdx ah - yeah18:45
lazyPowerbdx - you need to pair that charm with the block-storage-broker charm18:45
lazyPowerhowever, that stack is quite old, and is deprecated in favor of modeled storage with juju18:45
bdxooooh18:45
lazyPowerit was based on the euca2tools python lib, which targets a very old inmplementation of the AWS API18:45
bdxi see18:45
lazyPowerits rife with mismatches that may potentially cause headachs, i'm not certain if we're using that anymore. I should really mail the list about it18:46
cory_fulazyPower: But does Juju storage support connecting to an existing EBS volume?18:46
lazyPowercory_fu - only ebs volumes it has provisioned18:46
* lazyPower will craft a quick post to see if anyone is still using it, and what the status/feedback is18:46
bdxcory_fu, lazyPower: how are you guys dealing with elasticsearch datadir mounts then?18:47
cory_fubdx: Re-reading your ask, I'm not clear if you're trying to connect to a pre-existing, non-Juju provisioned EBS volume or just want it stored on EBS instead of transient storage18:47
lazyPowerbdx - at the moment, the charm doesn't support storage. So its per-instance. it would be a good idea to patch the charm to work with storage however.18:47
bdxcory_fu: in all reality, I just need my datadir on a separate vol18:47
lazyPowerbdx - add to matadata the storage bits, and give it a storage-attached hook to format and mount the volume accordingly18:48
cory_fulazyPower: If Juju provisions the storage mount, and you need to reconnect it for some reason, is that possible?18:48
lazyPowercory_fu - i'm pretty sure that is TODO. you can attach it manually18:48
lazyPowerbut the storage feature itself needs modifications to support that18:48
bdxI've provisioned all my es instance data dirs manually so far ... I'm going to be spinning a bunch of these up and down ... I stumbled across the storage charm and respective hooks in the es charm over the weekend18:49
cory_fulazyPower: That charm was updated by stub not too long ago, so it seems he's still maintaining it.  Perhaps it has features that Juju storage don't yet support?18:50
bdxI was super pumped to spin up my next few elastic clusters using it ... bah18:50
bdxyeah - it seems fairly recent18:50
lazyPowerwell thats promising18:50
magicaltroutyeah the storage stuff is pretty cool, we've been doing a bunch of stuff at JPL in docker which I'd like to port to juju18:50
* lazyPower stops composing mail18:50
magicaltroutmakes sense to keep persistent storage though18:50
bdxmagicaltrout: what do you do for your es data dirs?18:51
x58Does config.changed in the reactive always fire after the service is installed?18:51
bdxmagicaltrout: manual prov?18:51
magicaltroutyeah bdx hacked up mounts18:51
bdxshnacks18:51
bdxhttps://jujucharms.com/u/stub/storage18:51
bdxlooks so promising18:51
bdxlol18:51
bdxgreat idea18:52
magicaltroutwell the native storage stuff in juju makes sense18:52
magicaltroutdepends on charms supporting it though18:52
bdxmagicaltrout: ya - what do you spec your elasticsearch instances at?18:53
cory_fux58: It will fire at least once, yes, but it will probably happen during the very first hook invocation and then go away.  If your service blocks installation for any reason (e.g., waiting on a relation, or storage) it might miss the initial config.changed state.18:53
cory_fubdx, lazyPower: I'd really like to know from stub what advantage that charm has over the built-in storage support in Juju18:54
cory_fubdx: You should consider the built-in storage support.  It may well do everything you need18:54
lazyPowercory_fu - i know when we were talking about deprecating the storage charm before... ther was some talk of production deployments that needed the bsb and storage charm18:54
lazyPowerand thats why it hung around18:54
cory_fubdx: https://jujucharms.com/docs/devel/developer-storage18:54
magicaltroutwe have an ES cluster for genomics stuff, I know its 15 nodes, not entirely sure of the spec, I tink they are m4.4xlarge but i'm not entirely sure18:55
lazyPowerit may be time to re-visit that conversation and start talking about how the start the migration of people using bsb over to the storage feature. and as we've covered, there's mismatch there so who knows18:55
cory_fulazyPower: But then why update it with xenial support?18:55
x58cory_fu: Better question, do I need to have a service.installed state that gets set if I don't have any installations?18:55
x58cory_fu: I only care about config, that then renders config, and adds/removes some network state. But there is no installation step.18:56
cory_fux58: No, you don't need to set any states unless they're relevant to your charm, or part of the API of a layer your charm is using18:56
x58I am using the basic layer.18:56
cory_fuYeah, there aren't any states required by that18:57
cory_fuSo you should be able to just watch for config.changed and handle that, and it will get triggered at least once18:57
x58Awesome.18:57
x58Thanks!18:57
bdxcory_fu: when I try to deploy es with the '--storage' it fails with18:58
bdxERROR cannot add application "elasticsearch": charm "elasticsearch" has no store called "data"18:58
bdxthe command I ran: `juju deploy elasticsearch --storage data=ebs,30G`18:59
cory_fubdx: You have to define what storage your charm supports in metadata.yaml18:59
bdxcory_fu: ahh ... so I see https://api.jujucharms.com/charmstore/v5/trusty/elasticsearch-16/archive/metadata.yaml19:00
bdxhas a block-storage interface defined19:00
bdxooooh, it should be under 'requires' eh?19:00
cory_fuNo, it should not be under requires19:01
bdxoh, well then19:01
cory_fubdx: Let me find you an example.  That one is not good for built-in storage19:01
bdxok, thx19:01
bdxcory_fu: got it19:03
bdxcory_fu: juju deploy elasticsearch elasticsearch2 --storage elasticsearch:data=ebs,30G19:03
bdxcory_fu: whhoops,  `juju deploy elasticsearch --storage elasticsearch:data=ebs,30G`19:04
cory_fubdx: Odd.  I don't see a storage stanza in https://api.jujucharms.com/charmstore/v5/elasticsearch/archive/metadata.yaml19:04
bdxcory_fu: is it not the 'data' interface?19:05
bdxor, 'data' provider, 'block-storge' interface19:05
cory_fubdx: No, it's a specific storage section, separate from relations, as described on https://api.jujucharms.com/charmstore/v5/elasticsearch/archive/metadata.yaml19:05
bdxoooh19:06
bdxyea, es deployed, but no storage was created or attached19:06
cory_fulazyPower: Where is the version of elasticsearch that support storage hosted at?19:06
bdxgotcha19:07
cory_fubdx: The kubernetes charm has a storage block: https://api.jujucharms.com/charmstore/v5/kubernetes/archive/metadata.yaml19:09
cory_fuSo that would be `juju deploy kubernetes --storage kubernetes:disk-pool:ebs,30G`19:09
cory_fuI think19:10
bdxahh, very nice19:12
bdxcory_fu: thank you19:12
magicaltroutwhats with all the ec2 bdx.. i thought you were just mr openstack19:12
bdxmagicaltrout: I got swooped on by a new employer19:13
bdx:-) :-)19:13
magicaltroutooooh19:13
magicaltroutnice19:13
bdxnow I'm in aws land  ...19:14
magicaltroutat least you got to keep with the juju stuff, for better or worse ;)19:16
bdxI am making a strong push for openstack in my new company though ... our aws bill is enormous ..... lets just say I could stand up a new ha openstack every month for what we pay aws ... kindo redic19:17
magicaltroutyeah, its the easy option though isn't it19:17
bdxyea, sadly19:18
bdxsome customers require content hosting via not aws though  ....  openstack will have its day here yet19:20
bdx:-)19:20
magicaltroutjesus h christ19:23
magicaltroutmy hadoop hacks to my pdi charm worked first time19:23
* magicaltrout needs to save that moment and dine off it for years19:24
cory_fumagicaltrout: Whoa.  Nice19:24
magicaltroutnever happens cory_fu19:24
magicaltrouti must have missed something19:24
cory_fumagicaltrout: https://cdn.meme.am/instances/66241182.jpg19:25
magicaltroutthanks cory_fu :P19:26
magicaltroutyou're like my project manager, he has an amimated gif for everything19:27
magicaltroutinfact the sys admins quite often miss my posts in slack because he follows up my requests with rediculous gifs19:27
magicaltrouti'll also get to test our merlijns claim of fixed resources shortly when i try and push 700mb upstream19:28
hatchwith the latest Juju tip has how you define a default series changed when bootstrapping? ERROR unknown config field "--default-series"19:35
magicaltroutyeah hatch19:35
magicaltrout--bootstrap-series19:36
magicaltrouti think you're after19:36
hatchjuju bootstrap aws aws --upload-tools --config --bootstrap-series=trusty19:36
hatchlike so?19:36
magicaltroutthat be the one19:36
magicaltroutdunno what --config does, i'll take your word on that one19:36
hatchthanks, I'll give that a go once this bootstrap completes19:36
hatchlol19:37
hatchmaybe it's also no longer required :)19:37
magicaltrouti do19:37
magicaltroutjuju bootstrap jujudev aws/eu-west-1 --bootstrap-series=trusty19:37
hatchahh ok ok so that's changed I guess19:38
hatchany idea why the name change to bootstrap-series?19:38
magicaltroutprobably because you use it to bootstrap and not any other time :P19:39
hatchhaha, reasonable :D19:40
magicaltrouti think they went through a big vocab clean up19:40
magicaltroutI guess that got swept up in it19:40
hatchappears to have worked, thanks magicaltrout19:41
magicaltroutno probs19:41
magicaltrouti should sit around and not do  much most days.... i answer many more questions on IRC19:41
hatchlol19:52
magicaltrouthttps://www.kickstarter.com/projects/328582971/bakblade-20-the-ultimate-diy-back-and-body-shaver/?20:01
magicaltroutjust when you thought you had everything.....20:02
magicaltroutdon't tell me i don't bring useful information to this channel!20:02
arosalesmagicaltrout: a constant wealth of info :-)20:10
magicaltroutexactly arosales !20:11
magicaltroutI knew you'd find that kickstarter useful20:11
magicaltrouti bet your mrs  is sick of shaving your back!20:11
arosalesmagicaltrout: and you can read minds too, amazing20:12
magicaltroutlol20:13
magicaltrouti wont lie... its been a slow day ;)20:13
arosalesmagicaltrout: but you discovered the bakblade20:14
arosalesso seems like a productive day20:14
magicaltrouti'm trying to do anything but finish off this charm20:15
magicaltroutfocus has been lacking today20:16
arosalesmagicaltrout: which charm?20:16
magicaltroutpentaho data integration arosales , hooked it up to Hadoop so it can do HDFS put/get, and run MapR jobs20:17
magicaltroutgonna add a few DB hooks as well so it can register database details20:17
arosalesmagicaltrout: ah nice20:17
magicaltroutbut I needed to get it done as Bluefin is hosting the next pentaho user group in London and I have a demo at the european community meetup in antwerp in nov20:18
magicaltroutso for that I'm sorting out this PDI charm and charming their BI server which is easy20:18
magicaltroutmaking sure PDI registers and scales properly was more of an issue20:18
arosaleswhen is the bludfin pentaho meetup?20:19
magicaltroutI was saying earlier, I wan't to get DC/OS master scaling fixed this week as w ell20:19
magicaltroutSept 1st20:20
arosalesya, I also need to follow up with SaMnCo's email on the DC/OS charming20:20
magicaltrouti spoke with the mesosphere chap sam introduced me to20:20
magicaltrouthe was interested in juju for MAAS deployments20:21
magicaltroutI'll fix up my charms and get them production ready, but I could do with some tie in with Mesosphere  to make some of the build process easier20:21
arosalesya I chatted with some of the DC/OS folks at MesosCon and they seemed interested in the charm20:21
magicaltrouti have a talk proposed for mesoscon europe20:22
magicaltroutdunno if it'll get accepted, i'm supposed to find out today20:22
arosalesmagicaltrout: I haven't had any technical conversatons with Mesosphere, but I had planned to. When I do I'll be sure to make you aware of those efforts20:22
magicaltroutta20:22
arosalescool to hear re mesoscon, juju related?20:23
magicaltroutyeah20:23
arosalesright on20:23
magicaltrouti pitched to mesoscon and linuxcon20:24
magicaltroutalong with bigdata spain20:25
arosalesI think Canonical will be at ContainerCon and Apache BigData Europe20:25
magicaltroutand I'll submit to apachecon europe as well20:25
arosalescool20:25
magicaltroutand then hopefully back out in pasadena with you guys. dumped 2 proposals into the charmer summit i think20:26
magicaltroutand a few uk user groups20:26
magicaltroutoh here's the mesoscon talk title: Flexibility across the cloud - Managing and scaling your High Availability DC/OS cluster using Juju20:26
magicaltrouthopefully it gets accepted20:26
arosalesmagicaltrout: you may have a busy travel season between sept - nov20:28
magicaltrouthehe, arosales, working from home, travelling keeps me sane20:30
magicaltroutat least i get to interact with people :P20:30
arosalesmagicaltrout: I hear you on that one20:31
magicaltrouti'm sat in Hidelberg currently having my ear bent on how many products I can bring to Snappy :P20:31
arosalesha20:31
magicaltroutbe good though, i was thinking about a bunch of stuff like databases at the ASF which are a pain in the ass to package20:32
magicaltroutso most distros don't bother20:32
magicaltroutbe great if we could snap them and have juju deploy that stuff somehow20:32
arosalesmagicaltrout: I was thinking of caffe as a snap20:34
arosaleshttp://caffe.berkeleyvision.org/20:35
magicaltroutah yeah caffe, we tinkered with some of that earlier in the year20:36
magicaltroutyeah that would be cool20:36
arosaleson the to do list which keeps getting longer :-) which I am sure you can relate to20:37
arosaleslots of good stuff to do20:37
arosaleslittle time20:37
magicaltrouti deal mostly in java apps, generally speaking they should be cross platform enough, but the C/C++ type stuff at the ASF would be great for snaps20:37
magicaltroutsave on build  and deployment effort if 1 build runs everywhere20:37
arosalesthat is what I was thinking20:37
arosalesand now pkgs yet for caffee20:37
arosales*caffe20:38
magicaltroutyeah20:39
magicaltroutmakes perfect sense20:39
magicaltroutjust pinged my JPL boss arosales about caffe asked him if he'd used it20:42
magicaltroutsaid  he had, but they use Tensor Flow more20:43
magicaltroutso there's another one for your list ;)20:43
josehello, who can I talk about the revq not updating?20:46
magicaltroutmarcoceppi:20:46
joseI believe he's away20:46
magicaltroutthe master  of the review queue20:46
marcoceppijose: one second20:46
magicaltrouthe's like the grand wizard20:46
joseoooh, magicaltrout is in fact magic!20:46
magicaltroutindeed20:47
magicaltroutdon't doubt a fish20:47
cory_fubcsaller: Thanks for your review on https://github.com/juju/charm-tools/pull/235  I added a reply to explain my reasoning for the admittedly more invasive than strictly necessary refactor.  Let me know what you think?20:47
arosalesmagicaltrout: ah yes tensor, that should be pretty easy to integrate into the spark charm20:50
magicaltrouti never thought the live text commentary from a republican convention would keep me entertained on a monday night.. but it is20:52
magicaltroutarosales: yeah there is work underway to integrate it into apache tika as well20:53
magicaltroutI should charm the tika webapp one day that would take about 10 minutes20:53
arosalesInteresting re Tika20:53
magicaltroutyeah there's a bunch of stuff their...20:54
magicaltrouti WILL finish my backlog first! :P20:55
magicaltroutwhen it gets delivered, i'm building a poormans orange box as well arosales21:02
magicaltrouthttps://www.kickstarter.com/projects/udoo/udoo-x86-the-most-powerful-maker-board-ever/ bought a bunch of these21:02
arosalesOhhh poor man OB21:03
magicaltrouthehe21:03
magicaltroutwell i can't afford a rich mans orange box.. but it looked like a fun project21:04
magicaltroutbuild a few x86 boards and tie them together to prototype juju/maas stuff21:04
arosalesYa I looked at a Maas pi21:04
arosalesBut it had its limits21:04
arosalesThis looks much more useful21:05
magicaltroutyeah this has a bit more horsepower21:05
arosalesAnd x8621:05
magicaltroutbut would certainly be cool for usergroup meetings etc21:05
magicaltroutjust like the OB21:05
arosalesFor sure21:05
arosalesExperimenting with MAAS as well21:06
magicaltroutyeah its not something i've had the chance to do yet21:06
magicaltroutall these people swinging by talking about maas and openstack21:07
magicaltrouti feel left out ;)21:07
arosalesHa21:07
arosalesYou can do openstack on LXD21:07
arosalesLess maas21:08
magicaltroutdoes that work these days?21:08
arosalesBut Maas is pretty cool to transform a rack into a cloud endpoint21:08
magicaltrouti came back from ghent wanting to test that and jamespage said he had to hack some script so I left it21:08
arosalesIt does :-)21:08
magicaltroutcool21:08
magicaltroutyet another thing to add to the list *sob*21:08
arosalesYou still need to update the LXD profile but works other than that21:09
arosales magicaltrout https://github.com/openstack-charmers/openstack-on-lxd21:10
arosalesRef from http://docs.openstack.org/developer/charm-guide/getting-started.html21:10
magicaltroutaww rubbish21:10
magicaltroutnow i'm going to bed at like 4am or something21:10
arosalesIt will use some resources21:11
arosalesJust an fyi21:11
arosalesJust tack it on the to-do list :-)21:11
magicaltroutif jamespage can run it on his laptop i'm pretty sure my dev server with 64gb of ram will cope21:11
magicaltroutof course that means i'll then feel complled to throw as  much at is as possible21:12
magicaltroutis/it21:12
arosalesOh your server for sure can handle ir21:12
arosalesIt21:12
magicaltroutmy host has disused server auctions21:13
magicaltroutI got this 16 core 64gb ram box for £15/month21:13
magicaltroutI could build the worlds most cost efficient MAAS cloud service if i had the bandwidth ;)21:14
magicaltroutarghhh the docs template changed21:18
* magicaltrout wonders how long it will take to get over it21:18
magicaltroutgoogle is failing me21:19
magicaltroutwhere is some sample code for resources in python21:19
magicaltroutcory_fu knows this stuff21:19
cory_fumagicaltrout: 2.0 resources?  I'm not sure, TBH.  mbruzek might know, though21:20
magicaltroutyou don't know cory_fu21:20
magicaltroutwhat going on with this world?21:21
magicaltroutanyone code a snippet of python doc for getting a file from a resource?21:21
mbruzekI got you magicaltrout21:21
magicaltroutthanks beardy21:21
marcoceppimagicaltrout: this charm makes simple use of them https://github.com/marcoceppi/layer-charmsvg21:22
mbruzekhttps://github.com/juju-solutions/layer-etcd/blob/master/reactive/etcd.py#L17921:22
magicaltroutthere we go, i knew there was a sample21:22
magicaltroutthanks chaps, blame merlijn and his claim resources work now21:23
mbruzekmagicaltrout: Our use of it is a little more advanced, but we do it in a try/except to gracefully fail on older juju versions21:23
magicaltroutyeah thats helpful mbruzek i was wondering about that stuff21:24
mbruzekmagicaltrout: 1.25 is dead to me.21:24
magicaltrouti used 1.25 about 6 months ago21:24
mbruzekbut some others still use it21:24
magicaltroutbut some people seem to use it21:24
mbruzekjinx21:24
magicaltrouton that note regarding terms, if I add terms to the saiku analytics charm does that  mean it just explodes on 1.25?21:25
josewhat does test status 'retry' mean on the revq?21:25
josemarcoceppi: is something going on with juju-ci?21:27
mattraehi, i'm trying to enable-ha with juju 2.0 beta and running into this bug.. is there a workaround for enabling ha, or will ha not be working to 2.1? https://bugs.launchpad.net/juju-core/+bug/156370521:31
mupBug #1563705: cmd/juju: "juju enable-ha" fails if you're not operating on the admin model <bitesize> <juju-release-support> <papercut> <juju-core:Triaged> <https://launchpad.net/bugs/1563705>21:31
rick_h_mattrae: it might get updated but for the moment you need to juju switch controller21:31
rick_h_mattrae: and then the command will succeed21:31
mattraerick_h_: great thanks!21:32
rick_h_mattrae: updated the bug with the workaround, thanks for pointing out that it wasn't helpful there.21:34
mattraerick_h_: great thanks, i was just about to do the same thing :D21:35
cholcombethedac, thanks for the mojo video :)21:51
thedacno problem21:51
magicaltroutnooooo21:51
magicaltroutresource upload fail21:51
lazyPowerrepost from way back, because i had no idea my bouncer had tanked22:32
lazyPower[15:28:08] lazyPower:cory_fu - ah, there is no elasticsearch with storage support yet. I was proposing to make the modification and contribute it back22:32
x58I'm attempting to test my charm, however when it fails and I try to do juju charm-upgrade my updates never seem to make it to the test machine...22:46
magicaltroutx58: is it in a running state prior to teh upgrade?22:53
magicaltroutthe22:53
x58magicaltrout: Yeah, failed due to a missing import.22:59
x58So I emptied out my .py, then all "hooks" succeed, and then it would download the updated version install it and run it.23:00
x58Kind of a shame I can't force upgrade when it has failed.23:00
magicaltroutx58: right so if its not in a running state23:02
magicaltroutyou can resolve the failed hooks23:02
magicaltroutand then run the upgrade23:02
magicaltrouti suspect  the post by marcoceppi still holds true as well http://marcoceppi.com/2015/01/force-upgrade-best-juju-secret/23:04
x58I tried resolving the failed hook23:04
x58with juju resolved -r23:04
magicaltroutdunno what -r does23:05
magicaltroutbut yeah23:05
magicaltroutjuju resolved service/unit23:05
magicaltroutyou might have to run it a few times as it runs through a bunch of failed hooks23:05
magicaltroutresolve failed hook one, resolve failed hook 2 etc23:06
x58ah23:06
x58I am using the charmhelpers.contrib.network.ip and when it tries to import netifaces it fails, it installs it, but once installed the import still fails.23:19
x58I am using layered charms, do I need to specify netifaces in my wheelhouse?23:19
x58or as a package?23:19
x58charmhelper installs python-netifaces instead of python3-netifaces, and all charms are run with Python 3.23:39
x58So that's a problem.23:39

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!