[09:30] <gnuoy> Hi, I've use the openstack charms to deploy swift and joined swift-proxy to keystone and as the admin user I can post objects etc without a problem. But as any other user I'm getting a 403. I can't see any likely looking roles that need granting. As far as I can see keystone returns a valid token but the swift proxy rejects it with a 403
[10:14] <gnuoy> nm, I didn't appreciate the admin role was a prereq for creating objects
[10:16] <stub> gnuoy: Do you know what I'm doing wrong with https://bugs.launchpad.net/charms/+source/swift-proxy/+bug/1238660 ?
[10:16] <_mup_> Bug #1238660: Default installation fails <swift-proxy (Juju Charms Collection):New> <https://launchpad.net/bugs/1238660>
[10:17] <stub> Hmm... no keystone...
[10:17] <gnuoy> stub, it looks like you're not explicitly setting any config for swift-storage, is that right /
[10:17] <gnuoy> ?
[10:19] <gnuoy> If you're using a single swift storage node I think you'll want replicas to be 1
[10:19] <stub> gnuoy: yeah, was going to use defaults
[10:19] <stub> You are saying things that sound like I need to read some Swift documentation.
[10:20] <gnuoy> stub, defaults assume 3 swift storage nodes each with region set differently. Unless you use zone-assignment=auto but even then the number of replicas needs to be intune with the number of storage nodes
[10:21] <gnuoy> stub, the README in the swift-proxy charm is good
[10:23] <stub> charm store has really low google juice :-(
[10:51] <gnuoy> jamespage, is there a workaround for Bug #1241674  ?
[10:51] <_mup_> Bug #1241674: juju-core broken with OpenStack Havana for tenants with multiple networks <cts-cloud-review> <openstack> <juju-core:Triaged> <https://launchpad.net/bugs/1241674>
[11:25] <stub> # losetup --find /etc/swift/storagedev1.img
[11:25] <stub> losetup: Could not find any loop device. Maybe this kernel does not know
[11:25] <stub>        about the loop device? (If so, recompile or `modprobe loop'.)
[11:26] <stub> # modprobe loop
[11:26] <stub> FATAL: Could not load /lib/modules/3.11.0-13-generic/modules.dep: No such file or directory
[11:30] <stub> Is this just going to fail with lxc?
[11:34] <freeflying> is it possible to force rerun hooks
[11:46] <stub> yer, looks like you need custom lxc templates to get loop mounts (required for swift)
[11:46] <stub> freeflying: 'juju resolved --retry' can rerun failed hooks. Apart from that, no.
[11:47] <freeflying> stub, we have a node in error, retried times, but can't resolve it
[11:48] <freeflying> and now it even reuse to retry :)
[11:49] <freeflying> refuse
[11:50] <stub> You will need to be more specific, maybe a pastebin of juju status output. Someone here might be able to identify the problem.
[12:42] <X-warrior> Hey guys, I just bootstrapped a machine on amazon, then I tried to deploy a postgresql to the same machine as bootstrap (already did this in the past and it worked), but now it stays as pending forever, and if I check the logs inside the machine there is a log of "/bin/sh: 1: exec: /var/lib/juju/tools/unit-postgresql-0/jujud: not found" messages
[13:04] <X-warrior> Ideas? :S
[13:33] <marcoceppi> X-warrior: oh, that's interesting
[13:36] <marcoceppi> X-warrior: if you try to deploy to a machine other than bootstrap, does it work?
[13:36] <marcoceppi> can you also install and run tree on /var/lib/juju/tools and pastebin it?
[13:38] <X-warrior> marcoceppi: let me run this tests
[13:38] <X-warrior> just a sec
[13:49] <X-warrior> marcoceppi: you want me to run tree on bootstrap + postgresql machine right?
[13:49] <marcoceppi> X-warrior: yeah
[13:50] <marcoceppi> just run tree /var/lib/juju/tools and pastebinit
[14:09] <X-warrior> marcoceppi: sorry, I'm recreating it x)
[14:34] <X-warrior> marcoceppi: http://pastebin.com/prp1ttWj
[14:39] <marcoceppi> X-warrior: okay, so something is failing during install
[14:39] <marcoceppi> X-warrior: do you have a unit-postgresql-0.log in /var/log/juju ?
[14:39] <X-warrior> yes
[14:40] <X-warrior> http://pastebin.com/ZQYFCxQi
[14:43] <marcoceppi> awesome, X-warrior, what does machine-0.log show?
[14:43]  * marcoceppi notes that this is def a bug
[14:44] <X-warrior> http://pastebin.com/BFuhLuX3
[14:45] <X-warrior> Could it be a problem because I'm using juju 1.12 on my localhost? I'm thinking that maybe, when I do a bootstrap it download latest juju version, which could not be compatible with mine.
[15:07] <X-warrior> marcoceppi: thoughts?
[15:09] <marcoceppi> X-warrior: it's quite possible that is the issue
[15:09] <marcoceppi> especially when using the --to flag
[15:11] <X-warrior> marcoceppi, well that doesn't seem very nice imo... I have a production environment that was deploy with juju 1.12, if I update my local version, maybe I could have problems with the production environment. Maybe, when bootstrapping, juju should send local version to server, and it downloads the same that I'm using, to guarantee compatibility?
[15:11] <marcoceppi> X-warrior: well, it's supposed to do that
[15:11] <X-warrior> how could I check the bootstrap version?
[15:11] <marcoceppi> it should, to some extent perform version matches for tools
[15:12] <marcoceppi> X-warrior: it's 1.16.3
[15:12] <X-warrior> so it is not working
[15:12] <marcoceppi> if you destroy, then run juju bootstrap --show-log --debug
[15:12] <X-warrior> since my local version says I'm using 1.12
[15:12] <marcoceppi> you should see the tool matching logic
[15:14] <X-warrior> does the output of this new bootstrap could help you guys find out what is going on?
[15:14] <marcoceppi> X-warrior: potentially
[15:14] <marcoceppi> sinzui: juju should match minor versions of tools to client?
[15:14] <X-warrior> let me rerun it
[15:14] <marcoceppi> X-warrior: I actually think this is a bug in 1.12 now that I think about it
[15:14] <sinzui> marcoceppi, damn right
[15:14] <marcoceppi> which was fixed in later versions of the juju client
[15:15] <sinzui> marcoceppi, but I think you also mean it must match patch aswell
[15:15] <sinzui> marcoceppi, 1.16.0 must not select 1.16.3
[15:15] <marcoceppi> sinzui: right, has that always been in core? X-warrior is seeing different results
[15:17] <sinzui> marcoceppi, no. juju-core has always selected the latest. a recent change made it match minor to avoid pyjuju fiascos. juju-qa reported a bug that our testing tools don't like getting 1.16.3 when we are testing 1.16.2
[15:18] <X-warrior> uhmm
[15:19] <sinzui> X-warrior, Bug #1247232 is the issue we reported
[15:19] <_mup_> Bug #1247232: Juju client deploys agent newer than itself <ci> <deploy> <juju-core:Triaged> <https://launchpad.net/bugs/1247232>
[15:19] <marcoceppi> sinzui: that's uncomfortable story for people with production deployments using older Juju versions
[15:20] <sinzui> yep
[15:20] <marcoceppi> any suggestions? Ultimately my mind jumps to "spin up lxc to manage multiple juju-cores"
[15:20] <marcoceppi> I remember, back when pyjuju was fun and still installed, you could install versions of juju and use update-alternatives, but I don't think that exists anymore
[15:21] <sinzui> X-warrior, marcoceppi. an even more uncomfortable/unintuitive work around is to use "juju upgrade-juju --version=1.16.2" to force a downgrade immediately after bootstrap
[15:21] <marcoceppi> sinzui: that sounds scary and awesome
[15:22] <sinzui> marcoceppi, it does exist, and I am working on the devel packaging fix to ensure 1.17.0 doesn't have a regression
[15:23] <marcoceppi> sinzui: Oh, okay, so you could theoretically install 1.16.3, maybe compile it somewhere, then use update-alternatives to switch back and forth?
[15:24]  * marcoceppi considers a blog post for this
[15:24] <sinzui> marcoceppi, update-alternatives is provided by the package, not juju-core
[15:25] <marcoceppi> sinzui: right, so you've installed juju-core 1.12, but also want 1.16.3, you'd need to compile 1.16.3 since the apt package would just remove 1.12 from the system
[15:25] <marcoceppi> unless there's some debian way to not have juju-core package remove the previous version
[15:26] <sinzui> marcoceppi, oh that is right
[15:26] <sinzui> marcoceppi, but there is another way
[15:26]  * marcoceppi is excite
[15:26]  * X-warrior still around here
[15:26] <sinzui> you can download the new package and install it in another root
[15:26]  * sinzui searches for the option
[15:27] <marcoceppi> sinzui: ahh, this sounds way better than compiling
[15:27] <X-warrior> Is the 'juju upgrade' for a production environment too risky?
[15:27] <marcoceppi> X-warrior: yes! sorry, have not forgotten you, want to make sure we can switch back and forth
[15:27] <marcoceppi> X-warrior: I've seen a few people do it, 90% positive working, with a 10% failure rate
[15:28] <X-warrior> because I think it is better to update now from 1.12 to 1.16 then later from 1.12 to 2.xx for example
[15:28] <X-warrior> or maybe 1.50
[15:28] <sinzui> marcoceppi, X-warrior dpkg  --instdir=/opt for exampe will change the root dir
[15:29] <marcoceppi> sinzui: X-warrior awesome, I'll give that a go and create a blog post on how to manage multiple juju installs on a machine
[15:29] <X-warrior> anyway it is a little scary to try to update from 1.12 and maybe screw everything :X
[15:29] <X-warrior> that is awesome
[15:31] <sinzui> marcoceppi, X-warrior for the last two month I have use lxc to maintain a container that has all the stable tools. My own computer is on trusty and bleeds. since I mount my home dir in the container, both stable and devel have the same juju-configs. I test upgrades and compatibility that way
[15:33] <X-warrior> so in my case if I would like to update my juju version should I upgrade my local version from 1.12 to latest, and then run juju upgrade-juju to update the tools on my aws?
[15:33] <marcoceppi> X-warrior: the upgrade is a bit hairy, I'll try to find a 1.12 deployment and see if it upgrades OK
[15:34] <marcoceppi> though, sinzui might be able to speak to it better than me
[15:37] <sinzui> marcoceppi, I wasn't testing back then. X-warrior your concerns about upgrade are legitimate. We only promise upgrades from stable to stable 1.12.x to 1.14.x. Going to 1.16.x find the tools, but no one has tested we can leap that far
[15:38] <sinzui> s/16.x find/16.x will find/
[15:39] <X-warrior> so the best approach for future project is keep it update on every stable version? I mean, if I had upgraded it from 1.12 to 1.14 later I could update from 1.14 to 1.16...
[15:40] <sinzui> That is right
[15:46] <X-warrior> sinzui: so what about using 'juju upgrade-juju --version=1.14' to upgrade from 1.12 to 1.14 and then 'juju upgrade-juju' to get latest stable release from 1.16?
[15:47] <sinzui> X-warrior, that will work
[15:47] <X-warrior> oh, nice.
[15:48] <X-warrior> but when using upgrade-juju it will just update the environment tools not my local ones right? So if I would like to do that, I must update my local juju to 1.14 then run upgrade-juju and then update my local to 1.16 and use the upgrade-juju again?
[15:49] <X-warrior> I'm not really sure about how local juju installation is related to remote/upgrade-juju
[15:58] <context> how can i add the 'juju-core' lp to my apt sources. cloud-tools only has 1.16.0
[16:06] <marcoceppi> context: let me check, cloud-tools should have 1.16.3
[16:07] <marcoceppi> X-warrior: it's only the remove juju
[16:07] <marcoceppi> X-warrior: apt-get is for upgrading the client
[16:08] <X-warrior> marcoceppi: my client is 1.12 version, can I use 'upgrade-juju --version=1.14'? Or do I need to update my client to 1.14 first for example?
[16:08] <marcoceppi> context: you're right, it only has 1.16.0 sinzui who's responsible for updating the cloud-tools archive? jamespage ?
[16:09] <marcoceppi> X-warrior: you should be able to do that from 1.12 without issue, since it's like juju deploy, it's just telling the bootstrap node what to do. I'm not sure if there are incompatiblities between  1.12 and 1.14
[16:10] <marcoceppi> context: if you can, ppa:juju/stable has the latest juju-core; sudo add-apt-repository ppa:juju/stable; however, if you're using the cloud-tools archive you're probably doing so for a reason
[16:10] <context> marcoceppi: i did that 'status error on juju status' ticket, which might have in fact been an issue regarding dns.  i get an unsupported protocol 'sftp' now.
[16:11] <context> trying again to get it running :) i replaced /usr/bin/jujud with the 1.16.2 its trying to use but still tries to fetch it. is it trying to install it somewhere else?
[16:12] <marcoceppi> context: the tools on the server aren't installed from the cloud archive
[16:12] <marcoceppi> they're pulled from a public bucket
[16:13] <context> yeah, do you know where juju bootstrap tries to install it ?
[16:13] <marcoceppi> one of the places is the juju-dist bucket on s3
[16:13] <marcoceppi> context: what cloud are you using?
[16:13] <context> func SharedToolsDir(dataDir string, vers version.Binary) string { return path.Join(dataDir, "tools", vers.String())
[16:14] <context> marcoceppi: manual (yeah i know, highly unstable)
[16:14] <marcoceppi> context: then it's probably coming from the juju-dist bucket
[16:14] <context> yeah, but where is it trying to install the jujud
[16:15] <marcoceppi> context: it will try to pull down the latest tools tgz, extrac, and install it to /var/lib/juju/agents
[16:17] <marcoceppi> context: http://juju-dist.s3.amazonaws.com/
[16:17] <context> yeah thats where it pulled from
[16:17] <context> but when it tries to install its trying to do sftp://
[16:17] <context> so im trying to install it 'manually' so bootstrap can skip over that
[16:18] <context> or even just some how 'bootstrap' manually on the server so then i can do the rest of the juju stuff locally
[16:18] <context> marcoceppi: i want to fix whats already known broken manually, so i can move forward and see what else is broken :)
[16:19] <marcoceppi> context: whatever you're up to sounds crazy ;)
[16:19] <context> im new to Go but not programming, just hard to read through the juju code sometimes :x
[16:20] <context> marcoceppi: where would i look for what exactly it wants in /var/lib/juju/agents i made it /var/lib/juju/agents/jujud but it still tries to install
[16:20] <context> marcoceppi: sorry if my being a bother, you can feel free to ignore me ;)
[16:20] <marcoceppi> context: nope, it's versioned
[16:20] <marcoceppi> context: it's okay, I've got 40 mins before the conference opens up
[16:21] <context> versioned as in /var/lib/juju/agents/1.16.2 or :x
[16:21]  * context opens the juju-local vm he has
[16:22] <marcoceppi> context: /me checks
[16:22] <marcoceppi> there's a few symlinks too
[16:24] <jamespage> marcoceppi, thats correct - but it has to go through Ubuntu SRU for saucy first
[16:24] <jamespage> and I've not had time todo taht
[16:24] <marcoceppi> jamespage: gotchya, good to know
[16:24] <jamespage> its in the stable ppa if you really need it
[16:25] <marcoceppi> context: this is a slightly older machine, but /var/lib/juju tools like this:
[16:25] <marcoceppi> context: you just need to update the tools directory, not the agents dir
[16:25] <marcoceppi> http://paste.ubuntu.com/6411417/
[16:30] <context> kk
[16:30]  * context plays around
[16:33] <context> grr !@# still dont work :-/ i guess ill leave it be for now :(
[16:33] <context> oh oops
[16:42] <context> cant even juju bootstrap manual provision with bootstrap-host: localhost
[16:43] <marcoceppi> context: that's a really bad idea
[16:43] <marcoceppi> as it will clobber your local host
[16:43] <context> oh thats fine
[16:44] <context> but nothing happens cause you still get screwed on unknown protocol sftp
[16:44]  * context adds ppa
[16:45] <context> yeah i guess im just stuck
[16:46] <context> it confuses me more cause i got passed this point once.  i actually got bootstrap to succeed
[16:48] <marcoceppi> ¯\_(ツ)_/¯
[16:49] <context> yeah. thnx for the help, again
[16:49] <context> looks like fix is committed but not released yet
[16:50] <marcoceppi> context: ah, 1.17.0 will probably bring a lot of good to this story
[16:50] <context> yeah
[16:50] <context> ive been keeping an eye on the milestone
[16:50] <context> wish i knew Go more to be able to help out
[16:50] <context> or the juju codebase for that matter. its a pretty big beast
[16:51] <marcoceppi> context: it's quite a large project
[16:51] <marcoceppi> one of the largest open source golang projects iirc
[16:54] <context> i am so confused
[16:54] <context> jujud-machine-0 start/running, process 17240
[16:54] <context> grrrr !@#
[16:54] <context> all i did was rm -rf /var/lib/juju
[16:55] <context> AND juju status works
[17:04] <context> now attempting to add-machine
[17:05] <context> W00t W00t
[17:17] <X-warrior> marcoceppi: just to let you know, I installed the 1.16 version on a vm, and deployed the bootstrap and postgresql to the same machine, that error didn't happen
[17:17] <marcoceppi> X-warrior: interesting
[17:18] <X-warrior> I mean deployed from vm to aws both of then on machine 0.
[17:19] <X-warrior> and the status of postgresql is running and logs doesn't have any similar message to that one
[17:20] <context> trying to deploy juju-gui i get this error:
[17:20] <context> 2013-11-13 17:15:42 INFO juju.worker.uniter context.go:255 HOOK ImportError: No module named yaml
[17:20] <context> trying to run the install hook
[17:25] <frankban> context: did you use any non-default charm option?
[17:25] <context> how do i 'redploy' a charm
[17:25] <context> frankban: nope. just did a manual apt-get install python-yaml to hopefully fix it
[17:27] <context> things dont like to die it seems :-/
[17:27] <frankban> context: can you paste the whole log somewhere? anyway, you can try "juju resolved --retry juju-gui/0
[17:28] <context> i did destroy-service and it just sits at life: dying
[17:28] <frankban> context: try now "juju resolved juju-gui/0"
[17:29] <frankban> context: but the whole log would really help investigating the isuue
[17:29] <context> yeah trying to get a clean slate :x
[17:29] <frankban> context: cool thanks
[17:29] <context> doesnt seem to be any 'forcively destroy-service'
[17:31] <context> so now the service just sits at 'dying' and no way to get rid of it
[17:31] <context> oh nm gone now
[17:32] <context> frankban: http://pastie.org/8478000
[17:35] <frankban> context: looking
[17:35] <context> w00p w00p !
[17:35] <context> frankban: manually install python-yaml fixed it
[17:35] <frankban> context: what provider are you using?
[17:36] <context> frankban: manual
[17:36] <context> :D
[17:37] <frankban> context: ok thanks for the feedback, we will release a new version of the charm soon, with a fix included
[17:50] <context> starting to like juju more and more
[18:08] <X-warrior> marcoceppi, sinzui, I'm leaving now, thanks for all the help, have a good one :D
[18:08] <sinzui> thank you X-warrior
[19:19] <context> hmm, i deploy mysql and it says success but mysql is not running
[19:25] <context> damn, some charms are really touchy
[19:29] <rick_h_> jcastro: boo for not bundles beta in your juju updates :P
[19:29] <jcastro> it's not available for people yet
[19:29] <jcastro> random devel PPA doesn't count!
[19:29] <rick_h_> jcastro: sure it is, it's in the charm you go get right now if you juju deploy juju-gui
[19:29] <rick_h_> it's just 'in beta'
[19:30] <rick_h_> and an update coming later today
[19:30] <rick_h_> with jujucharms.com getting updated tomorrow hopefully
[19:30] <jcastro> ok so next week's update
[19:30] <rick_h_> gotcha
[19:30] <rick_h_> side note, thanks for the emails. try to keep up
[19:30] <rick_h_> that is, I use them to try to keep up
[19:33] <jcastro> ok so update me
[19:33] <jcastro> when can people deploy the cloudfoundry bundle?
[19:33] <jcastro> all the stuff should land tomorrow with the jujucharms.com update?
[19:33]  * rick_h_ goes to dbl check the quickstart ppa
[19:33] <rick_h_> jcastro: yes, everything should be up to date tomorrow me thinks
[19:34] <jcastro> any word on better URLs in general?
[19:34] <jcastro> I am trying to explain to kirkland how to deploy the bundle and he wants to punch himself in the face
[19:35] <rick_h_> bundle: is supported in the ppa release today or tomorrow
[19:35] <rick_h_> will need a follow up to update the url in the deploy tab
[19:35] <jcastro> so bundle:~jorge/cloudfoundry ?
[19:35] <rick_h_> bundle:~jorge/cloudfoundry/3/cloudfoundry
[19:35] <jcastro> ugh
[19:35] <jcastro> dude, you are killing me
[19:35] <rick_h_> unfortunately you can have multiple bundles in there
[19:35] <rick_h_> we can't make it shorter than that and have them work like they do man
[19:36] <rick_h_> go back and talk to the original people that designed the deployer files and such
[19:36] <jcastro> hazmat, surely there's something we can do here
[19:42] <rick_h_> jcastro: k, well fyi updated the quickstart and juju quickstart bundle:~jorge/cloudfoundry/3/cloudfoundry  works
[19:42] <rick_h_> at least it's running the install on cf-release right now
[20:13] <hazmat> jcastro, yeah.. there's several sane things we can do.. like omit the deployment name within the bundle when its the only one.. omit the version and get the current one..
[20:14] <hazmat> would minimize nicely to bundle:~jorge/cloudfoundry
[20:14] <jcastro> yeah it just needs to be something rememberable by the user
[20:18] <jcastro> rick_h_, confirm, the bundle works fine here
[20:18] <rick_h_> jcastro: woot
[20:19] <jcastro> this bundle/charm is deceptive though
[20:19] <jcastro> since it's doing so much if you don't debug-log there's no way to know what it's doing
[20:19] <rick_h_> jcastro: yea, definitely
[20:20] <jcastro> I wonder if there's a way to echo "Go have a smoke, it's going to be a while." somewhere
[20:20] <jcastro> like a louder version of juju-log
[20:20] <rick_h_> heh, in the gui we do that with all bundles. I guess it'd be something to note in the charm readme
[20:20] <rick_h_> or summary/etc that's somewhere visible
[20:20] <jcastro> yeah
[20:20] <rick_h_> since it's really the charm that's the long-runner
[20:20] <jcastro> right
[21:44] <HereticLocke> Hi
[22:40] <jcsackett> jcastro: just thought you would like to know, askubuntu q's are *finally* in the review queue.