/srv/irclogs.ubuntu.com/2013/12/04/#juju.txt

blackboxswhi folks, anyone know why a config-get cmdline call from inside a debug-hooks would not match the values returned from an external call to "juju get haproxy"?00:01
blackboxswI'm finding all "type: int"   values are being replaced with an empty unicode string for the haproxy charm when I'm inside a debug-hooks config-changed00:02
marcoceppiblackboxsw: that's odd, what version of juju?00:03
blackboxswmarcoceppi, 1.15.0-saucy-amd6400:03
blackboxswused --upload-tools on my bootstrap00:03
blackboxswdeploying to cloud currently, will try lxc and see if I can reproduce the problem.00:04
blackboxswstring type variables seem to be intact.00:04
blackboxswyeah will have to play in lxc land for a bit to see if the error is reproducible thx marcoceppi00:15
=== freeflying_away is now known as freeflying
blackboxswmarcoceppi, also, I was working off of juju trunk, heading back to the ppa00:18
blackboxswmarcoceppi, yep problem solved... was versionitis of an old trunk juju updating to the PPA in saucy fixed it: 1.16.3-saucy-amd6400:37
=== CyberJacob is now known as CyberJacob|Away
lazypowerIs it safe to assume we will always be using ubuntu in a charm? or should I decidedly do sanity checks on environment for custom configurations?00:44
lazypowerTo scope this question specifically, rsyslog has been default fo ra while now. Should I assume that's the default or should I build in detection for other systems like legacy syslog, syslog-ng?00:45
sarnoldlazypower: well, there's charms published to the juju charmstore and then there's the charms that other groups might write; I could imagine a sles, rhel, or centos user liking what juju has to offer but wanting to build upon their existing tools, and choosing to write charms that use e.g. systemd journal as their logging service of choice00:48
lazypowerOk thats insightful. So to promote adoption I should do sanity checks for additional daemons and provide those utilities as well - this just changed scope. Thank you sarnold.00:52
sarnoldlazypower: well, that's up to you to define the scope of what you'll support with your charms.01:20
sarnoldlazypower: some shops might be all-fedora and want to embrace the systemd way of life; other shops might be heterogenous and want to deploy charms on top of anything. They'll have more work than shops with tighter goals..01:21
lazypowerI'm in fairly constant contact with upstream about the charm I'm working on. They support everything under the sun - and if the guys on the other side of the fence want to help report bugs, I'll help them maintain it - to an extent. I dont want to try to make one charm ot rule them all, I'm currently running that mentality at my 9-5 and its exhausting.01:22
lazypowerbut I see no reason to pigeon hole anyone because I'm lazy and dont want to read a configuration guide.01:22
sarnoldsounds like you'll have happy users :)01:23
lazypowerLets hope, here's to keeping my promises01:23
sarnold:)01:23
lazypowerIs there a good place for offtopic juju chat or have the IRC channels boiled down to business over pleasure?01:28
=== mhall119|afk is now known as mhall119
lazypowerlooks like the hooks documentation just turned into chunky salsa after an edit or deployment - https://juju.ubuntu.com/docs/authors-hook-kinds.html02:01
=== gary_poster is now known as gary_poster|away
=== Beret- is now known as Beret
=== jcsackett_ is now known as jcsackett
lazypowerSo, i've been tasked with finding an alternative to the remote_syslog rubygem. I found nxlog as a viable alternative but the repositories don't exactly provide it for 12.04 LTS. What would an acceptable alternative be for the charm? Is maintaining a PPA a viable alternative or is PPA use frowned upon in charming?05:37
sarnoldhey lazypower :) I'd again say this is up to you as a charmer to decide the scope. I'd say it is probably fine to use a PPA if the software is clearly not in the archive or your PPA version provides significant functionality beyond the version in the archive; it'd be best to document in the README which PPA is used and perhaps make archive/ppa/compile-from-source options -- or allow specifying which ppa to use...05:40
lazypower... choices... i dont know what to do with myself.05:41
sarnoldit's tough; if you make too many choices available to the end user they might wonder what benefit you provide compared to doing it all themselves. There are definitely times when it helps to be opinionated -- I love reading advice from opinionated people, even if I don't follow the advice. :)05:42
lazypowerWell played sir.05:46
=== CyberJacob|Away is now known as CyberJacob
=== jam1 is now known as jam
=== CyberJacob is now known as CyberJacob|Away
=== gary_poster|away is now known as gary_poster
=== ociuhandu_ is now known as ociuhandu
X-warriorI destroyed a service but it keeps on juju status list marked as 'life: diying' but never goes away. How to proceed/13:31
X-warriorhttp://pastebin.com/z3Mbi8HJ13:41
marcoceppiX-warrior: are any of the elasticsearch units in an error state?13:45
X-warriornope, "agent-state: started"13:46
X-warriormarcoceppi: nope, there is no machine/service on error state as far as I can see13:49
X-warriormarcoceppi: did you say something my internet dropped14:18
evFollowing https://bugs.launchpad.net/juju-core/+bug/1257705 would someone mind kicking off a new upload of juju to brew?14:35
marcoceppiX-warrior: nope. Can you show the full juju status output?14:38
marcoceppiev: as soon as a new juju is out? sinzui did we have another release?14:39
sinzuimarcoceppi, juju 1.16.4 in a few hours14:39
X-warriorhttp://pastebin.com/B11PkKZt14:40
X-warriormarcoceppi:14:40
marcoceppisinzui: excellent! thanks14:40
evcool, thanks14:40
marcoceppiev: homebrew will be updated in a few hours14:40
evwhoop14:40
=== xnox_ is now known as xnox
X-warriormarcoceppi: did you find anything wrong?14:58
marcoceppiX-warrior: nothing immediate, can you juju ssh elasticsearch/0 and run ps -aef | grep juju14:58
marcoceppiwonder if there's a long running hook or something14:59
X-warriormarcoceppi: I dont think so. http://pastebin.com/UU63aFqK15:00
marcoceppiX-warrior: correct. What happens if you run juju destroy-service again?15:01
X-warriorit just runs normally15:01
marcoceppiX-warrior: actually, what machine was logstash-indexer on?15:02
X-warrior1115:02
marcoceppiX-warrior: juju ssh 11; ps -aef | grep juju15:02
X-warriorok15:02
X-warriormarcoceppi:  http://pastebin.com/ifZGMSt615:03
* X-warrior tired15:29
iri-I tried to `juju set-environment access-key=ASDF secret-key=GHJK` and I get `ERROR The AWS Access Key Id you provided does not exist in our records.`. Ping @rogpeppe15:38
X-warriormarcoceppi: so any idea about this?15:39
iri-(I did also change it in the environment.yaml first, which may have been a mistake)15:39
rogpeppeiri-: changing it in environments.yaml first *shouldn't* have made a difference15:41
rogpeppeiri-: where do you see the error being printed?15:41
iri-rogpeppe: in the terminal where I ran juju set-environment15:41
rogpeppeiri-: do you have a go dev environment on your local machine?15:42
iri-rogpeppe: yes15:42
rogpeppeiri-: perhaps you could try this:15:43
rogpeppeiri-: go get code.google.com/p/rog-go/cmd/ec215:43
rogpeppe(that fetches a little utility i wrote for dealing with ec2 stuff)15:43
rogpeppeiri-: then:15:43
rogpeppeiri-: export AWS_ACCESS_KEY_ID=ASDF15:44
rogpeppeiri-: export AWS_SECRET_ACCESS_KEY=GHJK15:44
rogpeppeiri-: ec2 instances15:44
rogpeppeiri-: if your key is ok, that should print your current set of running instance ids15:44
iri-rogpeppe: indeed it does.15:45
rogpeppeiri-: hmm15:45
rogpeppeiri-: what output do you get if you run juju status?15:46
rogpeppeiri-: actually, that was probably a bad suggestion, as status takes ages15:48
rogpeppeiri-: what do you see if you add --debug to the set-environment flags?15:49
iri-rogpeppe: nothing out of the ordinary15:49
iri-INFO juju.provider.ec2 ec2.go:193 opening environment "ec2" and the usual line containing a giant json object15:50
rogpeppeiri-: so it didn't fail then?15:53
iri-it said "ERROR" (as in the first line I said to the channel) and then didn't seem to update the environment15:53
rogpeppeiri-: no other info on the ERROR line?15:54
iri-rogpeppe: nope, it's as I showed15:54
=== natefinch is now known as natefinch-dentis
=== natefinch-dentis is now known as natefnch-dentist
rogpeppeiri-: have you deprecated the old keys already?16:04
iri-I made them inactive, yes16:05
iri-(@ rogpeppe)16:05
rogpeppeiri-: could you try reactivating them and then doing the set-environment again?16:06
rogpeppeiri-: unfortunately we can't tell *which* access key id doesn't exist in their records16:07
iri-rogpeppe: that worked! Damn good job I didn't delete the old credentials..16:07
iri-rogpeppe: I wouldn't have expected to need the old one to work in order to revoke it..16:07
rogpeppeiri-: indeed16:07
rogpeppeiri-: i'm not quite sure why it does (the latest version of juju definitely does not)16:08
rogpeppeiri-: i've managed to duplicate your error anyway16:09
iri-rogpeppe: great.16:09
rogpeppeiri-: does this file exist for you: ~/.juju/environments/ec2.jenv ?16:10
iri-yes16:10
rogpeppeiri-: ah, ok (i thought you were using an earlier juju version)16:10
rogpeppeiri-: in that case, *that* is the place that's consulted for current environment keys by the client16:11
iri-rogpeppe: so.. I should have edited that file? I'm not following..16:11
rogpeppeiri-: it has an entry "bootstrap-config" containing all the keys that the environment was bootstrapped with16:11
rogpeppeiri-: it shouldn't be necessary, but yes, editing that file would have fixed the problem16:12
rogpeppeiri-: i'm just looking to find out why it failed the way it did16:12
=== eagles0513875_ is now known as eagles0513875
rogpeppeiri-: ah, i understand now16:18
rogpeppeiri-: it does need the provider credentials to read the s3 bucket that contains the details of how to find the bootstrap instance16:18
rogpeppeiri-: in the future we will be caching that instance's address locally, but in general there's no easy way around it16:18
=== teknico_ is now known as teknico
yolandajamespage, i updated heat charm with different auth key generation, and adding more tests, coverage is now 85%17:05
jamespageyolanda, better!17:21
* jamespage looks17:21
=== CyberJacob|Away is now known as CyberJacob
ashipikahi all..  any idea why mongo would fail to start on bootstrap?19:59
ashipikaStarting MongoDB server (juju-db)20:02
ashipikaConnection to 10.0.0.1 closed20:02
ashipikaERROR juju.environs.manual bootstrap.go:105 bootstrapping failed, removing state file: exit status 120:02
lazypowerashipika: is there any other relevant information in the unit log?20:19
lazypowerI've eperienced this behavior a few times when I've hastily tried to add shards to the cluster before the master node is spun up, but i attribute that to user error.20:20
ashipikalooking at it.. it's on a livecd.. so might be it ran out of disk space..20:20
ashipikabut i doubt it..20:20
lazypowerI wont be able to help much aside from pointing you in places to look, in about 3 hours i'll be at home and can try to reproduce what you're seeing if that helps.20:21
ashipikaok.. i'll try to pastebin the mongodb log20:22
ashipikaif that helps20:22
lazypowercertainly. I'd be happy to look over the output20:23
ashipikaany other logs that might help?20:23
lazypowerCan you include the juju controller log for completeness? I'd like to see the communication between the nodes20:25
ashipikahttp://paste.ubuntu.com/6521644/20:25
ashipikahmm.. i'm doing all this on the same machine20:26
ashipikasame VM that is.. and there are no juju logs... strange20:26
lazypowerLXC?20:27
ashipikajust /var/log/juju/all-machines.log, which is  empty..20:27
ashipikavmware player20:27
lazypowerok, well looking at your mongodb log - this line itself http://paste.ubuntu.com/6521644/20:27
lazypowerthere's something going on in one of the hooks that is restarting the daemon possibly?20:27
ashipikathis: got kill or ctrl c or hup signal 15 (Terminated), will terminate after current cmd ends ?20:28
lazypowerhow about any logs in $HOME/.juju/local/logs?20:28
lazypowerCorrect. That line says the deamon proces received an interrupt20:28
ashipikano such logs :(20:28
lazypowerhmm. What environment are you running JUJU in?20:28
ashipikajuju version: 1.17.0-precise-amd6420:29
ashipikaprecise livecd20:29
ashipikanull environment20:29
lazypowerah ok. I have not startd experimenting with the null environment20:29
lazypowerthe behavior changes a bit when using the null provider20:29
ashipikai know.. experimental :)20:29
ashipikathat's what i'm doing.. experimenting..20:30
ashipikatrying to create a custom livecd that would boot a bootstrapped juju host20:30
lazypowernice20:30
ashipikacrazy :)20:30
lazypowerit can be both :D20:30
ashipikaseems so, yes :)20:30
ashipikahmm mongo version 2.0.420:31
ashipikalatest stable mongo version should be 2.4.820:31
ashipikabut that should not be an issue20:31
ashipikalazypower: do you know, perhaps, who is working on null environment?20:32
dpb1Is local provider not working currently on 1.16.3 and .4?   My machines stay in pending.20:46
dpb1I get this in the cloud-init.log: http://paste.ubuntu.com/6521479/20:47
dpb1It also seems like the instances don't get addresses assigned, and the console spins and waits for the network to come up.20:47
marcoceppiashipika: are you using mongodb from the cloud-tools archive?20:51
ashipikasorry.. had to grab a bite.. i ran: juju bootstrapp --upload-tools.. so whatever is used there21:03
=== waigani_ is now known as waigani
=== gary_poster is now known as gary_poster|away
=== CyberJacob is now known as CyberJacob|Away
hazinhelldpb1, you need the cloud-init-output.log to see what's actually happening22:48
hazinhelldpb1, lxc seeds cloud-init with a direct file inject for userdata22:50
dpb1hazinhell: I found the answer: http://curtis.hovey.name/2013/11/16/restoring-network-to-lxc-and-juju-local-provider/23:03
dpb1basically, an old dhcp package23:03
dpb1removing the cached images fixed it23:03
hazinhellah.. 12.0.4.2 in lxc cache23:04
hazinhellyeah.. that's bit me before23:04
hazinhellthere really isn't a good way to tell what the heck version that is the cache because its a totally generic name23:04
dpb1it was from February!23:04
dpb1ya.23:04
dpb1I think maybe juju should ship with a maintenance job for it or something, but there are concerns with that approach too. :)23:05
hazinhellreally it should be lxc's responsibility..23:05
dpb1ya, you are probably right23:06
hazinhellits the one keeping the cache, it should be responsible for sanely updating it23:06
dpb1true.  agreed.23:06

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!