/srv/irclogs.ubuntu.com/2011/10/16/#juju.txt

=== koolhead17 is now known as koolhead17|zzZZZ
enmand_Is there a default charm repository installed with Juju on Oneiric?02:35
enmand_Or does it rely on store.juju.ubuntu.com? (Which doesn't seem to exists?)02:36
hazmatenmand_, there are local repos06:37
hazmatin oneiric ootb06:37
SpamapShazmat: backportpackage can fix that btw06:40
SpamapShazmat: I actually just finished backporting the oneiric txaws to ppa:clint-fewbar/fixes06:41
SpamapShazmat: the whole dh_python2 mess does make things hard to backport tho06:46
eagles0513875hey guys07:26
eagles0513875where can i see what charms are available in the juju repo07:26
* eagles0513875 waves to fwereade in here :)08:10
enmand_hazmat, where are the local repos in Oneiric? Are they in a package besides juju?13:16
m_3hazmat: try logging out of the labs webpage and log back in16:16
m_3Ryan_Lane: euca-run-instances -k wmflabs-mmm-20111016 -t c1.medium ami-0000000416:18
Ryan_Lanehazmat: what error are you getting when trying to log into canonical-bridge?16:22
SpamapSenmand_: there's a package in ppa:juju/pkgs called 'charm-tools' that will include a command, 'charm getall'16:23
SpamapSenmand_: it uses bzr to checkout all of the charms from https://launchpad.net/charm16:23
enmand_Ah, OK16:26
enmand_So, there is no default charm set for Oneiric?16:26
m_3SpamapS: morning16:27
m_3SpamapS: is it easy to enable lp review features for lp:charm?16:33
Ryan_Laneheh. I figured it out16:36
Ryan_Lanebad config16:36
Ryan_LaneI'm working on fixing it16:36
Ryan_Laneif puppet will ever actually run :(16:42
Ryan_Lanem_3: it's working now16:46
SpamapSm_3: enable them? err.. they're built in to it.16:48
SpamapSm_3: what features are you looking for?16:50
m_3SpamapS: just a +1 from anyone in charmers before promulgation16:52
m_3I guess the lp review stuff comes automatically with merge proposals16:53
m_3SpamapS: but we don't have such things for charms atm16:53
m_3SpamapS: (features like submit for review, pending review state, pending review queue for charmers, etc)16:55
m_3Ryan_Lane: testing now...16:56
SpamapSm_3: well if we were more careful and didn't just push to lp:charm/foo then we could use reviews16:56
SpamapScharm-tools still uses bound branches.. which it probably shouldn't.. :-P16:57
SpamapSm_3: the review stuff is easily enforcable by policy16:57
Ryan_Laneand I confirmed, if you log out and log in, it changes your access and secret key16:57
Ryan_Laneworking on fixing that now16:57
m_3SpamapS: gotcha... can we do this alongside "charmstore" landing?16:58
m_3Ryan_Lane: gotcha16:58
m_3Ryan_Lane: s/euca-run-instances/euca-ran-instances/ !16:59
SpamapSm_3: the charm store stuff I don't know about.. but if bzr branches are in use, the review stuff is built in17:00
Ryan_Lanesweet17:00
m_3SpamapS: cool17:00
m_3total "Dude, where's my car?" moment :)17:01
SpamapSm_3: I believe the charm store bits will always push to a personal branch... but I really don't know17:02
SpamapSNO WHAT DOES IT *SAY*17:02
SpamapS;)17:02
hazmatthe use of bzr in the charm store will be transparent17:08
hazmatRyan_Lane, for some reason i get .. Permission denied (publickey).17:09
hazmaton ssh attempts17:09
Ryan_Lanehmm17:10
hazmatRyan_Lane, i had a look from m_3's login shell it all looks normal17:11
Ryan_Lanelemme look at logs17:11
Ryan_LaneInvalid user kapil from 12.70.135.2 ;)17:11
hazmatRoAkSoAx, never mind17:11
hazmatRyan_Lane, yeah.. just saw that17:11
hazmatdoh17:11
hazmatuser fail ;-)17:11
Ryan_Lane:D17:11
Ryan_Laneyour novarc is likely broken too17:12
Ryan_Lanelemme fix the problem I'm having, and fix that for you17:12
hazmatRyan_Lane, oh? yeah.. i'm unable to connect to the swift storage it seems17:12
Ryan_Laneswift storage?17:12
Ryan_Lanewe don't have swift storage17:12
Ryan_Lanebut your access and secret keys are bad17:13
hazmatRyan_Lane, oh.. is there a s3server (from nova) running?17:14
Ryan_Laneah17:14
Ryan_Laneonly if that's the object store17:14
Ryan_Laneand that would be glance17:14
Ryan_Laneerr17:14
Ryan_Lanewait. no17:14
Ryan_Laneglance is just for service images17:14
hazmatglance is the image store, it layers ontop of the object store17:14
Ryan_Lanewe have no object store17:14
Ryan_Laneno volume support right now either17:15
Ryan_Lanedid you guys need volume support for this?17:15
hazmatRyan_Lane, that's problematic for juju, we use the objectstore to distribute charms to the instances.. nova include a very simple s3server that just stores things in a directory17:15
hazmatRyan_Lane, we don't need the volume support17:15
hazmatits nice to have, but not required, the object store is17:16
Ryan_Lanethey got rid of the objectstore in cactus, I believe17:16
Ryan_Laneah. wait17:16
Ryan_Lanethere's a nova-objectstore package still around17:16
Ryan_Lanegimme a sec17:16
hazmatRyan_Lane, its in the source tree at nova/objectstore/s3server.py17:17
Ryan_Laneyep17:17
* hazmat updates his branch17:17
Ryan_LaneI didn't have the package installed17:17
Ryan_Laneit's now on virt117:17
hazmatRyan_Lane, cool.. currently the generated novarc are referencing a dead s3 server url .. do you know what the correct one is/will be?17:18
Ryan_Laneit's correct now17:18
Ryan_LaneI just brought the service up17:19
hazmatRyan_Lane, awesome thanks17:19
Ryan_Laneyw17:19
Ryan_Lanelemme know if it has any issues17:19
Ryan_LaneI need to fix your credentials, likely17:19
hazmatRyan_Lane, yeah.. that seems to be the remaining issue17:20
SpamapShazmat: btw, I tried txaws against ceph's RADOS .. worked well except creating buckets.. but I think that may have been a lighttpd fail, not RADOS17:20
hazmatSpamapS, nice17:21
hazmatSpamapS, is there a charm for that?17:21
hazmatceph that is17:21
SpamapShazmat: yes, the ceph charm17:21
SpamapSbut its kind of.. in flux. ;)17:21
* hazmat checks charm world17:21
SpamapSShould work for a single node, or 3 node cluster. The difficulty is elasticity.. ceph is just growing things to make that easy17:22
Ryan_Lanehazmat: I need to fix the code that keeps changing your credentials, then I'll fix your credentials. heh17:22
hazmatRyan_Lane, sounds good17:22
hazmatSpamapS, fair enough.. i'd prefer gluster for most distributed fs usages now.. i still think of ceph as more on the experimental side17:23
hazmatie. only widely deployed by its creating org17:23
SpamapShazmat: the CEPH guys would agree for the mounted FS case. But their objectstore is apparently already seeing extremely heavy use.17:24
hazmatSpamapS, outside of dreamhost?17:24
SpamapShazmat: no17:24
SpamapS:)17:24
hazmatwhich has a team of 40 devs to support it ;-)17:24
SpamapSer, I think its closer to 417:24
hazmatoh.. gustavo mentioned they where hiring like crazy for it17:24
SpamapShiring and having are two different things. :)17:25
SpamapSThey've only just recently starting treating CEPH as more than an experiment17:25
SpamapSHonestly, with storage, I'm not sure super automatic elasticity is all that awesome of an idea.17:26
SpamapSif your CPU bound thing has a problem coming up or down, oh noes, it goes slower17:26
SpamapSif your I/O bound thing loses data... you are screwed17:27
SpamapSSo I may just make the ceph charm deploy ceph and build the config file, but let admins do the work of adding/removing nodes17:27
hazmatah.. charm world doesn't pick it up because its not a trunk branch17:31
hazmatwe'd have to introduce an extra namespace layer to allow for deploying charm branches17:32
SpamapSno don't do that ;)17:33
SpamapSI forgot I haven't promulgated it yet17:33
SpamapSBecause its changing a lot17:33
m_3SpamapS: do you have an environments.yaml entry from openstack?  i.e., wanna see the s3-uri for the nova objectstore17:34
SpamapSs3-uri: http://x.x.x.x:333317:35
hazmatm_3, the one in my home dir should be fine17:35
m_3SpamapS: does it require additional path like /services/Eucalyptus does?17:35
hazmaton the gateway17:35
SpamapSno path specified at all in mine17:35
m_3gotcha... cool... just checking we're trying to call the right thing17:35
m_3it17:35
hazmatm_3, its a credential problem17:36
m_3hazmat: right17:36
SpamapSmo credentials, mo problems17:39
SpamapSman, I need a giant RAM disk to do local deploys on17:42
m_3SpamapS: dude, local deploys rock!17:43
SpamapSYeah, but now that I don't have to wait for amazon..17:43
m_3but yeah, dualcore/8G on the laptop doesn't cut it17:43
SpamapSI have to wait for my local disk17:43
m_3I know17:44
m_3it's always something17:44
SpamapSIf I had 8G I could make 4G for deploys :)17:44
m_3wanna replace my cd-rom with SSD17:44
SpamapSI've been shopping for SSD's for that very reason.17:44
m_3there's a kit for that in the mbp17:44
SpamapSMaybe I should enable write caching on my laptop disk17:45
SpamapSthat actually helps quite a bit. :)17:46
SpamapSjust have to remember to turn it off after deploy ;)17:47
m_3http://virt1.wikimedia.org:3333/17:48
m_3shows that we can create the bucket at least17:48
hazmatSpamapS, it doesn't take that long for local deploys.. its mostly just the package install, ssd make it rock... i'm still waiting for a native 7mm ssd to come on the market17:49
SpamapShazmat: but then you're shortening your SSD's life17:49
hazmatSpamapS, not concerned, i got it to use it ;-)17:50
m_3http://pastebin.com/EUaafbPA17:50
SpamapSHrm.. I dunno. at $500 for a big one.. I want to use it for more than a year. :-P17:51
m_3grabbing food for a sec17:51
* SpamapS is now wondering if his assumptions of endurance are false tho17:51
hazmatSpamapS, the wear level is pretty good on the devices, and the sandforce controllers are pretty awesome about dedup17:51
SpamapSok, so most can sustain 20GB/day for 5 years17:53
* SpamapS is ordering now.. F'it17:54
hazmatSpamapS, just make sure your compatible size wise with your laptop17:57
SpamapSta17:57
Ryan_Lanehmm. the only thing that I see so far that'll deliver a 403 is if the object already exists17:58
SpamapShazmat: yeah I've been looking into it17:59
Ryan_Laneyeah. it'll only give a 403 if the file or directory exists17:59
Ryan_Lanedid you guys do a test write into the file you need to create with juju?17:59
Ryan_Laneerr. object17:59
Ryan_Laneodd. it's giving a 405...18:00
Ryan_LaneI don't even see that in the code18:00
hazmatRyan_Lane, i'm still getting errors on auth.. 405 might be coming from pylons18:01
SpamapShazmat: btw, ceph is now the second time where I have 'relation-set' the base64 of a file on disk.. I wonder if we can't get a 'relation-file /etc/hosts' to make sharing files easier18:04
Ryan_Lanehazmat: errors on auth where?18:06
Ryan_Laneto nova?18:06
hazmatRyan_Lane, to s3server18:06
Ryan_Laneah. right18:06
Ryan_Laneyeah18:06
* hazmat checks if novarc has changed18:06
Ryan_Laneoh. wait18:07
Ryan_Lanelet me fix your secret and access keys18:07
* m_3 looks for variation of s3cmd that'll work with nova object-store18:08
hazmatRyan_Lane, cool thanks18:08
SpamapSm_3: it works fine but you have to skip verifying your settings and manually edit the config18:08
SpamapSm_3: ~/.s3cfg .. its obvious where to change the hostnames18:09
m_3SpamapS: thanks18:09
SpamapSm_3: note that txaws comes with some handy commands for using S318:09
Ryan_Lanehazmat: heh. seems your keys are fine18:10
Ryan_Lanepylons giving back 405?18:10
hazmathmm18:10
Ryan_LaneI dunno what that is18:10
hazmathttp://pastebin.com/8PrAvyCf18:12
* hazmat tries with s3cmd18:13
hazmatm_3, its a hidden option only in the config file of s3cmd18:13
hazmatRyan_Lane, it seems to be fine manually... i'll dig into debugging it18:15
hazmatoh18:15
hazmatthat's the problem18:15
Ryan_Lane?18:15
hazmatme and m_3 are probably using the same bucket ;-)18:15
m_3oh no way18:16
hazmathmm18:16
hazmatnope that's not it18:16
* hazmat goes back to drawing board18:16
Ryan_Laneit's possible this is missing function calls you need18:18
Ryan_Lanethis is the super simple, kind of shitty object store18:18
SpamapSwe're using that one in canonistack18:18
Ryan_Laneit seems it doesn't even have authentication18:18
SpamapSIts shittiness is worked around in txaws and juju quite a bit ;)18:19
Ryan_Laneheh18:19
SpamapSit should have auth18:19
SpamapSits used for image uploads18:19
Ryan_Laneglance is used for image uploads18:19
Ryan_Laneand glance doesn't have auth either ;)18:19
SpamapSHmmmmm.. right.. I thought somebody told me that this was used to facilitate those image uploads18:20
Ryan_Lanewe are using cactus18:20
SpamapSOh18:20
SpamapSsnap18:20
SpamapSand anything works?18:20
SpamapSyou know Diablo's out.. ;)18:20
Ryan_Lanecactus is perfectly stable for us ;)18:20
SpamapSWe had to fix quite a few diablo bugs for juju to work18:20
Ryan_LaneI wasn't comfortable upgrading a few days before the hackathon ;)18:20
SpamapSYeah18:20
SpamapSits non-trivial18:20
SpamapSBig component of the essex design summit was how to do upgrades18:21
m_3vast understatement?18:21
Ryan_Lanethe objectstore hasn't changed at all I believe18:22
Ryan_Laneit is deprecated18:22
hazmatah.. its cactus18:23
SpamapShazmat: I wonder if the nova bugs with groups were all introduced during diablo18:24
m_3swift on an instance and we can just use that s3-uri?18:24
SpamapSif they were in cactus too..  there will be problems. :p18:24
Ryan_Lanebugs with groups?18:25
SpamapSYeah nova couldn't handle the group management that juju does for firewall management18:25
Ryan_Laneah18:25
Ryan_Lanesecurity groups you mean?18:25
SpamapSinstances would fail to start because of at least 1 bug18:26
SpamapSyeah18:26
Ryan_Laneah18:26
Ryan_LaneI haven't seen any security group issues yet18:26
Ryan_Lanethey may have been introduced in diablo18:27
hazmatRyan_Lane, juju create's a security group that allows intra group traffic, it broke diablo for a while18:27
hazmatRyan_Lane, there are a couple of bugs fixed wrt to juju usage in the diablo release18:27
Ryan_Laneah. ok18:28
hazmati'm going to see how far i get with it18:28
* Ryan_Lane nods18:28
_mup_Bug #875903 was filed: Zookeeper errors in local provider cause strange status view and possibly broken topology <juju:New> < https://launchpad.net/bugs/875903 >18:42
hazmatso the 401 unauthorized is actually from trying to describe the security groups18:44
hazmatSpamapS, re that bug, did you hibernate?18:45
hazmatSpamapS, the session expiration is fatal atm, and a hibernate will trigger it, since there isn't any heartbeat and then the clock advances18:46
hazmatstatus should be verifying against the agent presence nodes18:47
SpamapShazmat: no, just been fiddling with it for 1 or 2 hours straight18:48
hazmatelse its just reporting against recorded state18:48
SpamapShazmat: I saw this one before too18:48
SpamapShazmat: I bootstrapped quite recently18:48
SpamapSanyway, time for weekend stuff18:49
hazmatSpamapS, cheers18:49
m_3SpamapS: later man... thanks!18:52
m_3hazmat: euca-describe-groups is authorized from the cli18:53
hazmatm_3, yeah.. saw that18:53
m_3could also euca-authorize -P tcp -p 22 -s 0.0.0.0/0 junk-group18:56
=== Ryan_Lane1 is now known as Ryan_lane
=== Ryan_lane is now known as Ryan_Lane
backburnerwill juju work with openstack ?20:39
m_3backburner: yes, it's been tested with diablo I think20:47
enmand_There are nova-cloud-controller and nova-compute charms, I believe21:11
enmand_I haven21:11
enmand_I haven't been able to find information or documentation on deplying Ubuntu Cloud Infrastructure and OpenStack yet though21:11
enmand_In Oneiric, I mean21:11
m_3enmand_: juju can deploy openstack using those charms... it can also deploy services _on_ openstack21:26
enmand_m_3, yeah, I found the openstack charms and all, and I read some of the deploying on OpenStack stuff23:19

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!