/srv/irclogs.ubuntu.com/2012/01/30/#juju.txt

=== flaviamissi_ is now known as flaviamissi
=== fenris is now known as Guest45833
=== Guest45833 is now known as ejat
=== fenris is now known as Guest67783
niemeyerHello!12:05
niemeyerHow's everybody on that fine Monday morning?12:05
hspencermornin niemeyer12:18
hspencerbarely wakin up12:18
hspencerlol12:18
niemeyerhspencer: Hehe, that's how Mondays are12:19
niemeyer:)12:19
hspencerlol12:19
hspenceryea12:19
* nijaba welcomes dxd82812:41
koolhead11hia ll12:45
nijabaHello koolhead1112:46
koolhead11hey nijaba . how are you?12:46
nijabakoolhead11: doing good, thanks.  you?12:47
koolhead11am good too. time to update owncloud charm from 2 to version 312:47
koolhead11reading and testing it12:47
nijabanice12:48
heylukecarrierHi, I'm trying to set up Juju with the local environment type and am getting errors from libvirt during the bootstrap phase (virsh net-start default needs to be run as root, but Juju's bootstrap command doesn't run it so). Should I run juju bootstrap as root? I'm guessing this would cause permissions issues?13:46
fwereade_heylukecarrier, that's funny, I thought it would ask you for your password at the point it actually needed root access, would you pastebin a transcript please?13:48
heylukecarrierfwereade_, here's a paste of the bootstrap run: http://pastebin.com/NvXZvTyZ13:50
heylukecarrierwhen I ran it as root (with sudo), it complained about missing keys, but worked perfectly after destroying the environment, generating the key and running the command again13:51
fwereade_heylukecarrier, this suggests that you may need to reboot, after installing the dependencies, before it will work13:54
fwereade_http://askubuntu.com/questions/65359/how-do-i-configure-juju-for-local-usage13:54
fwereade_heylukecarrier, have you tried that?13:54
heylukecarrierfwereade_, I've just followed those instructions and have the same problem at the same point. When I ran juju bootstrap as root, I could carry on13:58
koolhead11hazmat: around?13:58
koolhead11heylukecarrier: pastebin your enviornment.yaml13:58
koolhead11are you creating the yaml inside root user by any chance :P13:59
heylukecarrierfwereade_, http://pastebin.com/hpjw0FtQ14:15
heylukecarrierkoolhead11, I'm not entirely insane :314:15
heylukecarriersince I've only just installed virsh, would a reboot be in order?14:15
koolhead11heylukecarrier: :D14:15
fwereade_heylukecarrier, sorry, that was what I suggested, I think I was unclear14:16
fwereade_heylukecarrier, apparently you sometimes need it after installing the dependencies14:16
heylukecarrierOkay, rebooted, trying again now14:16
heylukecarrierWow, so simple, it works fine. I think this should be emphasised in the documentation somewhere, though :)14:18
fwereade_heylukecarrier, good point, thanks :)14:19
heylukecarrierAnother stupid question; is there any way to increase the verbosity of the debug log?14:23
_mup_Bug #923746 was filed: local provider docs should mention needing to reboot <juju:New> < https://launchpad.net/bugs/923746 >14:23
hazmatg'morning14:23
fwereade_heylukecarrier, --level DEBUG may help14:24
hazmatheylukecarrier, your host is oneiric and your using the oneiric juju package?14:25
fwereade_heylukecarrier, no wait, that's the default already14:25
fwereade_heylukecarrier, I think that's as verbose as it gets -- what do you need more visibility into?14:26
hazmatheylukecarrier, juju will ask for sudo as needed14:26
hazmatheylukecarrier, what's the locale on your system?14:26
heylukecarrierhazmat, correct. There are long periods of time where there is absolutely no output, and even using the --rewind switch doesn't reveal anything. I'm just interested in knowing what it's doing14:26
fwereade_hazmat, morning :)14:26
heylukecarrierhazmat, it's en_GB.UTF-8. There is some output, just very little for debug mode14:27
hazmatheylukecarrier, after bootstrap, during the first deploy its creating an lxc container via lxc's lxc-ubuntu template which runs deboostrap on a directory to setup a minimal environment in a directory, juju then uses lxc-clone to copy that container over for other containers. the initial debootstrap can take a few minutes14:27
hazmatduring bootstrap on local, juju starts a zookeeper instance (running as regular user), starts a machine agent (running as root, this creates the lxc contianers), ensures that the default libvirt network is up and running, and setups a web server (on the libvirt network) for distributing files to the containers14:28
heylukecarrierhazmat, the bootstrap was failing initially because virsh can't configure the network stack without a reboot after the initial install14:29
hazmatfwereade_, g'morning :-)14:29
heylukecarrieronce I rebooted, lxc finished successfully and the install worked. Thanks for the explanation though; I guess lxc was running14:30
jcastroSpamapS: I saw a bunch of charm- bug activity after I EODed on Friday, anything new get promulgated?14:33
koolhead11hazmat: in case you will have time today, i can get the doc updated :)14:35
koolhead11hola jcastro14:36
hazmatheylukecarrier, you have to login/logout for the libvirt install to fully take effect, it wants the user to be a member of the libvirt group14:42
fwereade_hazmat, oh, that's the reason? good to know14:43
fwereade_hazmat, could we just `newgrp libvirtd` for the same effect?14:46
koolhead11heylukecarrier: After installing it, you may have to reboot (I had to else libvirt couldn't create the network bridge indicating it was already in use). i think that askubuntu page had the info14:47
hazmatfwereade_, that looks promising14:47
fwereade_koolhead11, it's really very non-obvious there ;)14:48
* koolhead11 is confused.14:48
koolhead11monday blues14:48
heylukecarrierfwereade_, koolhead11: thanks both; very helpful!15:11
fwereade_heylukecarrier, a pleasure :)15:11
koolhead11heylukecarrier: welcome!! :)15:12
gary_posterHi.  Can two juju instances in the same cluster talk to one another over a given port without exposing the port?  I would have expected so, from past-but-maybe-forgotten-non-juju ec2 experience, but at least with a lxc-based juju cluster it seems like we might have to expose the port.  Can anyone verify expectations in this regard?15:48
* gary_poster will go look for docs about that; I think others have, but I haven't tried yet.15:48
gary_posterOK, seems like the port is actually connecting fine.  go telnet.  some other problem15:53
SpamapSgary_poster: expose only controls access in and out of the cloud provider.16:03
SpamapSgary_poster: also LXC has no ability to control the firewall as of yet, so expose/unexpose are noops on the local provider.16:05
gary_posterSpamapS, expose: thanks, right, that's what I figured/hoped.  We should expect no firewalls within the provider itself, was my basic assertion/question-in-the-form-of-a-statement.16:05
gary_posterlxc expose noop: heh, ok16:05
SpamapSjcastro: re bug activity on Friday.. no promulgation yet.. but very close. :)16:13
jcastroSpamapS: good, just wanted to make sure I didn't miss a new person to ship swag to!16:14
_mup_Bug #923821 was filed: juju installs lxc/libvirt on all machines <juju:New> < https://launchpad.net/bugs/923821 >16:37
grapzHi. Is it possible to to overrule the default instance type when launching a new unit?18:27
m_3grapz: yes, but it's an all-or-nothing setting for an environment... add an entry to the environment in ~/.juju/environments.yaml that looks like 'default-instance-type: m1.large'18:32
m_3grapz: there's also 'default-image-id: ami-5b94ca1e'18:32
m_3grapz: there's a feature request for per-unit overrides18:34
grapzm_3, ahh, just what I was about to reply with, that there should be a per-unit override :)18:34
smoserfwereade_, could you please open a bug against libvirt-bin or lxc for bug 92374618:34
_mup_Bug #923746: local provider docs should mention needing to reboot <juju:Fix Released by fwereade> < https://launchpad.net/bugs/923746 >18:34
m_3really it's going to look like constraints per service unit iirc18:34
smoser  can fail with "error: internal...." is not really acceptable18:35
m_3"try to provide >=2cpus, 1G <= RAM <= 15G, etc18:35
grapzm_3, that sounds great18:36
arosalesjcastro: the Juju events page is nice, thanks for setting that up.18:41
jcastroarosales: heh, now to find someone in europe!18:42
fwereade_smoser, sure, I think it's actually just a matter of `newgrp libvirtd` once it's installed18:59
SpamapSfwereade_: I just realized you sent me a branch to test out last week, and I haven't even looked at it yet. Is that still relevant?19:00
fwereade_SpamapS, it should be: I think hazmat has been poking at the unit-relation-status-not-showing business (hm I should have a word about that)19:01
fwereade_SpamapS, but yes: giving it a kick around would be very much appreciated19:01
koolhead17hi all19:01
hazmatfwereade_, i never reproduced that19:07
hazmatfwereade_, on local provider, killing unit agents at will, i did trigger some issues killing off a machine agent19:07
hazmatbut unrelated to status problems with units19:07
fwereade_hazmat, hmm, funny -- sorry, I noticed you saying that just as I was falling asleep and forgot about it19:10
fwereade_hazmat, what went wrong with the machine agent?19:11
hazmatfwereade_, an error around a node existant which the code expected to create, i didn't digg much further into it, its easy to reproduce though19:12
fwereade_hazmat, so once you bounced a unit agent with relations up subsequent statuses would still have (say) relations: db: up, rather than relations: {} ?19:12
hazmatfwereade_, yup19:12
fwereade_hazmat, interesting, I'll try to take a quick look at the machine agent tonight (contrary to appearances, I'm not really on atm)19:13
fwereade_hazmat, but, hmm, I'm confused by the status stuff19:13
hazmatfwereade_, was there a particular sequence to reproduce, and i assume you have juju-origin pointing at your branch?19:14
fwereade_hazmat, yeah, I had juju-origin pointing at my branch and I never needed to do anything more than kill a unit agent19:14
fwereade_hazmat, I'll try again and note exactly what I'm doing19:15
fwereade_hazmat, btw, I'm getting a tiny bit fretful about fix-charm-upgrade... is there something horribly wrong with it? ;)19:16
hazmatfwereade_, i'm a bit concerned about the complexity of whats introducing19:22
hazmatfwereade_, do you have a moment to chat about it?19:22
hazmatfwereade_, if we assume for the moment a WAL transition log, what about it is it re-entrant in the previous cut of this branch, the additional states and transitions are contributing what value?19:22
hazmater.. what about it isn't re-entrant19:23
hazmatright now its a separation of upgrade into three distinct step, while managing cross-step coordination of the executor. if we take download, extract, and execute as a single transition, with accompanying error transition that effectively retries the operation, what do we lack that needs the additional states and transitions, the WAL transition log, would  encapsulate the marker on the started state workflow variables marking the transition..19:26
SpamapSWAL seems like overkill, shouldn't there just be twoo things.. intended_charm_version and agent_reported_charm_version .. the first is updated by admins, the second by agents after they complete an upgrade.19:27
hazmatSpamapS, if something dies mid transition, we have to record some state so that on recovery we proceed with the in-flight operation19:27
SpamapS"recovery" ?19:27
SpamapSjust do it all again19:27
SpamapScall stop, extract new charm, call upgrade-charm, call start19:28
hazmatSpamapS, exactly, but we need to know what we should do again in some cases, though your right it should be apparent19:28
hazmatif we clear charm-upgrade post success19:28
SpamapStrying to pinpoint where in flight to start seems like folly19:28
SpamapSoddly enough, dpkg handles this quite nicely.. and we should just copy it19:29
SpamapSbut a single upgrade-charm hook won't suffice if we copy dpkg19:30
hazmatthe wal is generally helpful across any transition (the action boundry is transient)19:30
SpamapShas to be prerm, postrm , preinst, and postinst :P19:30
hazmatSpamapS, its even simpler than that, we just need to record transitions on disk, else its transient memory19:30
SpamapSI really dislike using disk for this19:30
SpamapSzookeeper is the system of truth19:30
hazmatfair enough19:31
SpamapSThe thing I've always liked about juju is that the agents just try and make zookeeper's intentions true, or report an error19:31
SpamapSanyway I'm not deep enough in this problem to have a strong opinion19:31
SpamapSjust asking pointed questions.. I'm sure you guys have a handle on it. :)19:31
* SpamapS goes outside to experience a rare day of fresh air in LA for lunchtime. :)19:32
hazmatits more that zookeeper currently encodes users and environment intentions but doesn't capture all of the unit agent's state19:32
hazmatSpamapS, good questions, enjoy ;-)19:33
hazmatSpamapS, i hear they got oxygen bars out there, air o'clock ;-)19:33
grapzhow is it with system requirements for the zookeeper node? should it be ok to run it on a t1.micro if you only have a couple of machines?19:44
lifelesssure19:45
lifelesszookeeper doesn't need all that much19:45
grapzgreat19:51
SpamapSWe should probably try and do some tests to see at what point ZK exhausts all the memory on each of the instance types.. I would bet that its 1000's of units/relations/etc.20:38
* SpamapS rings the bell, BONG! BONG! BONG BONG BONG BONG! promulgation!21:03
SpamapSoops-tools has been promulgated. :)21:04
SpamapShazmat: how long does the charm browser take to notice that?21:05
lifelessSpamapS: with an amqp relation ?21:08
SpamapSlifeless: not yet, just pgsql21:09
lifelesshow do you inject an external pgsql server21:10
SpamapSlifeless: you don't. subordinate charms will be how thats done..21:10
* SpamapS says that about everything21:10
lifelessSpamapS: uhm, really?21:11
lifelessSpamapS: there's no way to say 'I have a machine twice as large as any instance and it runs pgsql for my cloud'21:12
SpamapSlifeless: yeah, you'd have a little charm that just contains the configs for your external pgsql server and feeds them in21:12
SpamapSlifeless: right now to do that you'd eat up a machine just to run the hooks to say that21:12
SpamapSlifeless: subordinates are the main "must have" for 12.04, and bcsaller is hard at work implementing it.. I think. :)21:13
bcsalleryes :)21:14
* SpamapS ^5's bcsaller21:14
SpamapSbcsaller: stop reading IRC and get back to work21:14
bcsallerha21:14
* SpamapS lashes bcsaller with the whip21:14
SpamapS;-)21:14
* SpamapS lashes and ^5's with love, of course21:15
hazmatSpamapS, 5m21:54
* m_3 wants to bash bash21:59
m_3grrrrr21:59
hazmatlifeless, the resource constraint stuff is aimed to allow you to target service deployment to appropriate resources22:02
SpamapSm_3: 'I've had bigger chunks 'o korn in mah csh' -- Fat Bastard to Dash22:02
hazmatlifeless, if your curious this is the spec.. https://code.launchpad.net/~fwereade/juju/placement-spec/+merge/8444322:02
gary_posterhi.  If you have relatively lightweight data that you care about persistently (like a database or perhaps just history/log files) what is the intended juju story?  Are we supposed to use a hook to go stash this information somewhere, or is this considered to be "not juju's problem"? (we should configure backups separately if we have any need like that)22:06
SpamapSgary_poster: right now juju does nothing except it will require you to explicitly terminate a machine so you don't lose your data.22:07
gary_posterSpamapS, so the intent is that you write a terminate hook to stash what you want?22:07
SpamapSgary_poster: no, the intent is you backup your data some how.. we haven't defined how that happens.22:08
gary_posterSpamapS, got it, thanks22:09
SpamapSgary_poster: subordinate charms will allow some interesting innovation there.. you could make 'bacula-agent' a subordinate charm to a service, and then relate it to the 'bacula-director' service which would be able to do regular backups.22:09
gary_posterhm, yeah.  Being able to know "we're about to go down so you better do a last minute stash" might still be valuable in that scenario22:10
lifelesshazmat: well the thing is inside canonical DC we have existing things that are really not cloud ready22:11
lifelesshazmat: 500GB databases, not suitable for S3 or even EBS style deploys22:12
lifelesshazmat: so gluing those into juju as external endpoints would allow us to start using juju early, while the rest of the bits come up to what we need22:12
_mup_juju/refactor-machine-agent r449 committed by jim.baker@canonical.com22:14
_mup_Initial commit22:14
hazmatlifeless, fair enough, at the cost of an additional instance, you could wire up the external service with a charm... else your just talking about hard-wiring in the external service into say the app charm.22:19
hazmatwe don't have a better story for modeling external system services integration atm22:20
hazmatm_3, is that jenkins charm test using ec2 nodes with local?22:24
hazmator are they serially executing on the jenkins server?22:24
m_3hazmat: ec2 w/local22:28
SpamapSlifeless: to add to what hazmat is saying.. for stuff that is not cloud-ready .. you just write a subordinate charm like 'prod-database-client' that does what the regular postgresql charm would do, except on a remote system instead of locally.22:42
SpamapSlifeless: when subordinate charms are "deployed" they don't actually go anywhere until they are related to a non-subordinate charm, then the two get deployed together.22:45
lifelessSpamapS: hazmat: thanks23:00
grapzWhen I create new EC2 environments now, I just keep getting 'Invalid SSH key' when doing any operations against it. It worked perfectly earlier today. Can't really find what I've might have screwed up.23:04
SpamapSgrapz: can you pastebin the exact error?23:09
grapzSpamapS, http://pastebin.com/FzMRd9GR23:11
SpamapSgrapz: btw, if you use 'pastebinit' it will use paste.ubuntu.com and we won't have to be inundated with ads. ;)23:14
grapzoh, didn't know that, thanks for the tip :)23:15
SpamapSgrapz: can you ssh to that machine directly with just ssh -l ubuntu ec2-79-125-72-14.eu-west-1.compute.amazonaws.com  ?23:15
grapzSpamapS, no23:16
grapzPermission denied (publikkey)23:16
=== koolhead17 is now known as koolhead17|zzZZ
SpamapSgrapz: ok, your key didn't get onto your new instances then. Perhaps they have errors on their console?23:40
SpamapSgrapz: euca-get-console-output would show that23:40
hazmatgrapz, are you running on the same machine/account that was bootstrap from.. if not then the ssh private key used to connect to the environment may not be available to ssh.. juju will by default used one found in ~/.ssh when executing the bootstrap command23:43
grapzhazmat, yes, I'm on the same user/machine, so that shouldn't be the issue23:43
grapzSpamapS, I see some stuff about saving keys to /etc/ssh and then it lists the SSH fingerprints23:44
SpamapSgrapz: thats the host keys, different keys23:50
grapzok23:56
grapzi'll continue looking at this tomorrow - need to get some sleep now23:56
SpamapSgrapz: cheers!23:58

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!