/srv/irclogs.ubuntu.com/2016/07/13/#juju.txt

=== rogpeppe2 is now known as rogpeppe
=== ant_ is now known as Guest47305
=== admcleod_ is now known as admcleod
kjackalhey admcleod I am getting this: http://pastebin.ubuntu.com/19259834/10:06
kjackalthis is on zeppelin and everything in on apache-* charms10:06
kjackalany thorughts?10:06
admcleodkjackal: interesting, so lzo is an issue. can you also pastebin your juju status?10:07
kjackalhttp://pastebin.ubuntu.com/19260221/ admcleod10:08
admcleodkjackal: in /usr/lib/hadoop can you run this: bin/hadoop jar share/hadoop/common/hadoop-common-2.7.1-tests.jar org.apache.hadoop.io.TestSequenceFile -seed 0 -count 1000 -compressType RECORD xxx -codec org.apache.hadoop.io.compress.LzoCodec -check10:09
admcleodkjackal: on the spark unit, and on the slave10:09
kjackaladmcleod: on the spark node: http://pastebin.ubuntu.com/19260497/10:13
kjackaladmcleod: and here is running it on the slave: http://pastebin.ubuntu.com/19260637/10:16
admcleodkjackal: ok so its possible that spark doesnt know where the hadoop libs are. (also, does the log that you're trying to create the spark context with actually exist?)10:17
kjackaladmcleod: the error is the same regardless the file I am tryin to access10:18
admcleodkjackal: https://gist.github.com/andrewdmcleod/e32e8982c0b8f8083442 < check these files to see if they have the appropriate paths.. if not, add, restart the pyspark interpreter10:18
admcleodkjackal: the classpath including the specific lzo jar should already be in one of those files10:19
admcleodkjackal: can you also try to run 'spark-submit' at the cli on the spark unit and pastebin if there is an error?10:22
kjackalspark-submit gives no errors and sparkpu.sh runs ok10:23
admcleodkjackal: are those paths in the files (re the gist)?10:24
kjackalso. no!10:24
admcleodkjackal: thats interesting. im pretty sure kwmonroe put those in somewhere.10:25
kjackalsome of the files in the gist are not there (compute-classpath) and none of the rest contain the lines the gist wants to inject10:25
admcleodkjackal: it may be possible he (someone) put them in different files10:25
admcleodkjackal: are you trying to add them manually to see what happens?10:30
kjackaladmcleod: yeap waiting for the job to finish10:30
kjackalnope-same error....10:31
kjackalit is as if pyspark does not load the classpath from the expected routes.10:32
kjackaladmcleod: ^10:32
admcleodkjackal: and you restarted pyspark interpreter, try restarting zeppelin copletely?10:32
admcleod+m10:32
=== CyberJacob is now known as zz_CyberJacob
=== zz_CyberJacob is now known as CyberJacob
admcleodkjackal: any luck?13:38
kjackaladmcleod: not realy... just documented the problem we have in a card and going to look at this in more depth now13:39
kjackaldo you have the commit where we add lzo to our classpath?13:40
admcleodkjackal: no, sorry13:40
admcleodkjackal: i looked and couldnt find anything13:40
lazyPowerping magicaltrout16:03
magicaltroutyo lazyPower16:04
lazyPowermagicaltrout - i need to introduce you to some people. You've taken point on the dcos/mesos work right?16:05
magicaltroutit does appear i'm that man16:05
lazyPowerawesome, i'll hit you with an email introduction then.16:05
magicaltroutcool16:05
lazyPowermagicaltrout - are you still tom at analytical thingy dot whatever?16:11
magicaltroutyeah lazyPower16:11
lazyPowerta16:11
magicaltroutanything you have is current16:11
SuergallySaw this post : http://www.pasteall.org/pic/105055 Would this be the OpenStack Charms Meeting, or not ? (also attending #ubuntu-meeting) Sorry If I am Late.16:50
lazyPowerSuergally that appears to be correct17:04
lazyPowerddellav ^ can you confirm?17:04
ddellavlazyPower Suergally yea, looks like it. gnuoy can confirm17:05
SuergallylazyPower: ddellav Not sure about the details .. but I was in the 'meeting' for half an hour with no correspondance.17:06
lazyPowerah good point, i see 5pm - i wonder if that calendar is UTC...17:07
SuergallyI was there from 5.30 pm so UTC or not - it is UTC irrelevant.17:08
Suergallyddellav: gone are the days when we should have mis-billed calendar events - so can you confirm the iCal entry is correct or not, and possibly post something to correct that, cheers.17:13
Prabakaran<Prabakaran> Hello Team, My sample charm and it is pending for long time on unknown state with the log  http://paste.ubuntu.com/19194830/ and code files are under this branch https://code.launchpad.net/~prabacha/charms/trusty/sampledatabase/devel  As per this reactive code i am not able to set the state as 'mysql-config.done'. Could some one help me on this issue?17:17
kwmonroehi Prabakaran, i'll take a look..i just deployed your layered charm and will dig into the mysql state issue.  it'll take me a while though.17:18
kwmonroehey cory_fu, remember that "config.x" states get removed sometimes?  suchvenu figured it out.. when leader-elected runs, it seems to clobber the config.x.17:19
kwmonroeit's pretty easy to repro: http://paste.ubuntu.com/19289554/17:21
Suergallyddellav: Did you get that or do you need more+ time ?17:28
ddellavSuergally i do not have control over that calendar. perhaps gnuoy or lazyPower can make those changes17:29
SuergallylazyPower: Did you get that message I gave some 15 minutes ago ?17:30
=== mup_ is now known as mup
lazyPowerSuergally - Yes. I'm speaking with openstack charmers. You're continued patience is appreciated :)17:30
SuergallylazyPower: What channel are they attending ? Cheers.17:31
lazyPowerSuergally - the meeting has moved both channel location and time/date. I don't have any further details at this time17:32
cory_fukwmonroe: Is the charm looking for config.changed or config.default/set ?  Because config.changed is documented to go away and the end of the hook, even if it's not handled due to other conditions.17:32
* Suergally kinda -doesn't know- who everyone is 'talking to' :(17:33
kwmonroecory_fu: http://bazaar.launchpad.net/~ibmcharmers/charms/trusty/layer-ibm-db2/trunk/view/head:/reactive/ibm-db2.sh#L52817:33
kwmonroeconfig.set.X17:33
beisnerhi Suergally - apologies for the stale calendar entry.  that just changed as we became an official openstack project yesterday.  next meeting will be:  Monday July 24 at 17:00 UTC in #openstack-meeting17:34
Suergallybeisner: terrificco ! Can I have an I'Cal entry to add to my calendar off me google calendar thingy, then , please ?17:35
cory_fukwmonroe: I am quite surprised that the config.set state would drop off, but I would recommend removing lines 157 and 158 from layer:basic: https://github.com/juju-solutions/layer-basic/blob/master/lib/charms/layer/basic.py#L15717:36
cory_fuSee if that fixes it, by chance.17:36
kwmonroewill do cory_fu17:36
beisnerSuergally, indeed we will update that, but it may not be updated yet today.17:37
Suergallybeisner: So I dont have to add anything ? I'm lost (?)17:37
beisnerSuergally, correction.  new channel location is set for #openstack-meeting-417:37
beisnerSuergally, Monday July 24 at 17:00 UTC17:38
beisnerSuergally, but i can't update the ical yet so please take note of the time/place.17:38
Suergallybeisner: Can this be brought to the attention of the mailing-list, then ?#17:39
beisnerwow i'm winning with date calcs here.   Monday July *25* at 17:00 UTC17:39
Suergallybeisner: That's the same time as this meeting (security) http://www.pasteall.org/pic/105070 Or is that DoDo too ?17:43
SuergallyBRBack (coffee needed ;-)17:43
beisnerSuergally, it may very well be.   typically different audience and community.   the openstack project meeting schedules are the scheduling confines that openstack-charm meetings now follow.17:44
Suergallybeisner: That's a shame that they cross-match. Surely it's easier to have it an hour either side (?) 'just sayin17:50
kwmonroecory_fu: that worked17:52
cory_fuThat's very strange17:52
cory_fukwmonroe: Is there any chance that the leadership-elected hook in that particular charm is overriding the hook implementation from the base layer?17:53
Suergallybeisner: And 2ndly - that's not mentioned here yet : https://wiki.ubuntu.com/ServerTeam/OpenStackCharmsMeeting \or anywhere I can trace !17:54
kwmonroedoesn't look like it cory_fu http://paste.ubuntu.com/19292199/17:54
beisnerSuergally, apologies there.   our challenge is to coordinate among 148 (as of now) other openstack recurring meetings.17:54
cory_fukwmonroe: I'm fine with removing those two lines, as they aren't ideal anyway, but maybe you could step through the leader-elected hook (specifically though init_config_states) to figure out why they weren't getting re-added?17:55
beisnerSuergally, rest assured, we are working on updating things following yesterday's change.17:55
Suergallybeisner: I think most of your users only follow the 'fridge' calendar :) In terms of wikis, google calendars and #channel-links to the aforementioned meetings.17:56
cory_fukwmonroe: I'm a bit concerned that they should have been re-added at the start of the leader-elected hook and if that happens to run before config-changed (can happen), then the states will get missed17:56
cory_fuIOW, I'm concerned that there's some other bug that removing those lines is masking17:57
kwmonroeack cory_fu17:59
Suergallybeisner: How can I help or a/improve ?17:59
arosalesand I think the openstack charm dev/community docs are still a work in progress so feedback pull requests could be welcome there18:00
arosalescargonza: do you have a link to the latest?18:01
kwmonroeoh hold up cory_fu18:06
kwmonroethis isn't right http://paste.ubuntu.com/19292199/ <-- that's not the leader elected from layer-basic18:06
kwmonroe(there is no basic.init_config_states)18:06
beisnerSuergally, we've got folks on the necessary content updates.  it will not update today, but all areas will accurately point to the right place very soon.  thanks again for bringing it to our attention.18:07
cory_fukwmonroe: Right you are, my good man.  Some other layer must be overriding it18:07
kwmonroeeven money on the leadership layer18:07
kwmonroestuuuuuuuubbbb18:07
cory_fukwmonroe: That'd be my guess, too18:07
Suergallybeisner: No problem .. just thought you could point me to a mailing-list so we can talk about it (?)18:08
cory_fukwmonroe: Yep: https://git.launchpad.net/layer-leadership/tree/hooks/leader-elected18:08
kwmonroecory_fu: so is the best way forward for stub to remove those hooks and let the basic layer provide them, or sync those hooks with what's in layer basic?18:08
cargonzaarosales, which doc are you looking for?18:09
kwmonroei vote the former.. i don't see anything in there that's not covered by basic's leader-x hooks.18:09
cory_fukwmonroe: Yes.  Those files were put in the leadership layer before charm-tools created that hook, so they now need to be removed18:09
kwmonroeroger that18:10
arosalescargonza: the openstack charm dev doc18:10
cargonzaupstream doc: http://charm-guide.readthedocs.io/en/latest/18:11
beisnercargonza, ah yes.  the issue here is we have two other locations with stale content pointing to the old meeting location and meeting time:   http://fridge.ubuntu.com/calendars & https://wiki.ubuntu.com/ServerTeam/OpenStackCharmsMeeting18:13
cargonzaok have addressed both... I think. We'll get the cal updated asap.18:14
lazyPowerooo  you guys grabbed some prime url real-estate with that one18:20
Suergallycargonza: The details are to be pointed at the #openstack-meeting-4 #channels I presume ? Perhaps look-out for what else can be averted/binned.18:21
cargonzaack, thx Suergally. we'll fix it asap18:23
SuergallyCheers, where the juju mailing list ?18:23
Suergally**where's the ....18:24
kwmonroestub: i learned lp git!  MP for your eyeballs at your convenience: https://code.launchpad.net/~kwmonroe/layer-leadership/+git/layer-leadership/+merge/29998618:25
bdxhey whats up guys? Few questions concerning aws cloud network spaces19:35
bdxis there anyway to make juju aware of pre-existing spaces ?19:36
bdxor ehh19:36
bdxpre-existing aws networks19:36
bdxor can juju only create new spaces?19:36
kwmonroecory_fu: look ok? https://github.com/juju-solutions/interface-mysql-root/pull/1  prabakaran's deploy is g2g with this change19:38
cory_fukwmonroe: Apparently it's fine19:38
cory_fuBut yes, it also looks good to me19:39
cory_fuThanks, marcoceppi :19:39
cory_fu:p19:39
kwmonroeyowzer marcoceppi.. thanks!19:39
marcoceppisorry, I was going through my email, saw it, merged it20:02
lazyPower#noragrets20:25
bdxS.O.S. -> http://imghub.org/image/EyHX20:42
bdxcan someone take a look at what I'm doing wrong when adding my subnets ? I'm in the middle of a time crysis, and got stumped on this .... I just need to know the way!!!!20:43
marcoceppibdx: what are you doing currently? could you map out what you have for VPCs?20:45
marcoceppirick_h_ alexisb_ ^^ can we get some help from the networking side?20:45
alexisb_marcoceppi, unfortunately most of our networking folks are out for the day, email may be best at this point20:46
alexisb_but we can try20:46
alexisb_thumper, you around?20:46
thumperaye20:47
bdxI have a feeling I'm not creating the spaces first ...20:47
alexisb_can you take a look at bdx's sos and see if there is anything you can help with20:47
* thumper looks20:47
bdxthumper: can I screen share w/you real quick?20:47
thumperI'm not sure how helpful I'll be, but sure20:48
thumperbdx: which version of juju?20:49
bdxdevel20:49
bdx2.0-beta11-trusty-amd6420:49
thumperand aws?20:49
thumpertrying to use an existing vpc?20:49
bdxya20:49
* thumper takes a quick look at the code20:49
bdxthumper: I see "juju add-subnet" and "juju add-space" to be the commands I need to get the vpc added as a space righ?20:50
thumperI think when you bootstrap the aws controller, you need to specify the existing vpc there20:51
bdxooooh20:51
bdx:-)20:51
bdxgo on ...20:52
thumpervpc-id20:52
thumperDescription: "Use a specific AWS VPC ID (optional). When not specified, Juju requires a default VPC or EC2-Classic features to be available for the account/region.",20:52
bdxYes! where did you find that>??20:53
thumperum... in the code20:53
bdxshoot ...20:53
thumperI wonder where it is documented for real users20:53
thumperit is in the config docs for the ec2 provider20:53
magicaltrouti've read that somewhere before20:53
magicaltroutand i don't read the code :)20:53
thumperI'm sure it is somewhere20:53
thumperbdx: I *think* for aws, you can specify the subnets but it won't create them for you20:55
thumperyou still need to do that manually20:55
thumpernot sure on what level of discovery the ec2 provider has20:55
thumperwhen dealing with existing vpcs20:55
thumperbdx: when bootstrapping, the provider will check to see if the vpc is sufficient for juju's needs20:55
thumperit does have a force option, but TBH not sure why one would want to force it to use a VPC it doesn't think is god20:56
thumpergood20:56
bdxthumper: nice, ok  ... so the deal is, I need to provision some instances in a pre-existing vpc .... do I then need to bootstrap with that vpc-id?20:56
thumperyes20:57
thumperI believe so20:57
bdxahhh, I see20:57
bdxtrying now20:57
thumperbdx: I do recall that there was a bug somewhere with beta 11 and aws20:59
thumpersomething like us firewalling off the controller by mistake :)20:59
thumperbut only in particular circumstances20:59
thumperyou may or may not hit it :)20:59
bdxthumper, bootstrap is underway21:00
=== natefinch is now known as natefinch-afk
bdxin my vpc21:00
bdxthank you, thank you, thank you21:00
thumperno worries21:00
bdxthumper: thanks for the heads up on ^^ too21:01
bdxthanks team for the support!21:07
josebeisner: if you ask the news team to update the fridge, I'm sure they'll be happy to (it's #ubuntu-news ;) )21:32
bdxsos follow up -> http://imghub.org/image/W1EU :-)22:47
=== urulama is now known as urulama|___

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!