/srv/irclogs.ubuntu.com/2012/04/23/#juju.txt

imbrandonzomg , jcastro you round ?02:51
* imbrandon just figured out a nginx loadbal config that allows the site to do 600+ concurrent req/s AND stay under 50ms ( yes 50 not 500 ) response time02:53
* imbrandon does a lil dance02:53
imbrandon( oh, off a m1.small still )02:54
=== flepied_ is now known as flepied
SpamapSso quiet in here all weekend06:29
SpamapSimbrandon: clearly you have been drinking :)06:29
imbrandonnah06:29
imbrandonlol06:29
imbrandonwhy is that tho ?06:29
SpamapSfigured maybe you were a quiet drunk06:30
imbrandon:)06:32
flepiedany help needed with charms ?06:33
imbrandonSpamapS: check this hottness out06:33
imbrandonhttp://paste.ubuntu.com/942087/06:33
imbrandonput that bad boy in the /etc/nginx/loadbalancer config and boom , sweetness enchews06:34
imbrandoneven works with admin logins :)06:34
imbrandonwell chang the IP's to something other than my internal ones but yes06:35
imbrandonnext trick is gonna see what the limit on the cache size is, so i can throw /mnt/nginx on a ramdisk06:36
imbrandonsafely06:36
imbrandonand no, i am a quiet coder, loud thinker, been coding alot this weekend ( php ) , more than normal06:38
imbrandonSpamapS: think we could try to psudo implment that new way of storage at UDS ? i'm keen on getting it done but i havent grasp the juju codebase yet, mostly due to me still not clear on a few of the basics and trying to run before i walk but I'm sure 10 min of facetime with marcoceppi, you, or someone else will clear that right up at uds ( just how i initially learn things i guess )06:42
imbrandonoh and Go rocks, not as much like php as i first thought, but still rocks06:42
* imbrandon goes back to his php code for the moment :)06:44
imbrandonSpamapS: oh and my non scientific test do show that for some strange reason unix:/some/php.sock is indeed slower ( well not slower but fails faster with 503's ) than 127.0.0.1:9000 , no idea WHY yet, like if its open file descriptors or what is the issue because that just _seems_ wrong in my gut, but yea06:47
SpamapSwhy would you do a ramdisk? can't nginx just cache in RAM?06:47
imbrandonummm not certain, probably not without a sep module like the memcache module06:47
imbrandonit does most everything filebased by default and most things are modules06:48
SpamapSmemcache as in, memcached, or it has another cache module for RAM cache?06:48
imbrandonthat said there likely is noe06:48
imbrandonone*06:48
imbrandonmemcached06:48
imbrandononly used as a example cuz its a sep module in nginx06:48
SpamapSthat would be silly06:49
imbrandonwhat would ?06:49
imbrandonthat it can only do file based in core ?06:49
imbrandonnginx tries to be very very slim in code and make all extras modules, even some of the stuff we use like proxy is technicaly a module and not in core proper06:50
imbrandonits like php and all its blah.so extensions06:50
SpamapSimbrandon: well if its one big file like varnish does, that would make sense... you can just use VFS then06:50
imbrandonbut they are done at compile time only iirc06:50
imbrandonnah its tons of small files06:50
* SpamapS notes that his laptop has but 10 minutes of battery left06:50
SpamapSimbrandon: thats a huge fail06:51
SpamapSIMO06:51
SpamapSclosing a file == syncing a file06:51
imbrandonlike /mnt/nginx/[1-9]/[a=f]06:51
imbrandona-f06:51
SpamapSyeah, so thats nice for simpler coding, but you dn't get to take much advantage of vfs06:51
imbrandonwell yea i'm sure there are better ways , but thats just how i set it up to begin with , see how its specified on line ....06:52
imbrandonproxy_cache_path /mnt/nginx levels=1:2 keys_zone=microcache:5m max_size=1000m;06:52
imbrandonso i'm sure there is optinos to that line where we could make it even more uber06:52
imbrandonbut even like that it did 625 concurrent users and 0 errors or time outs from blitz.io06:53
imbrandonand stayed under 100ms , mostly 50ms06:53
imbrandonresponse time from clai , and the server was in vegas06:53
imbrandons/was/is06:53
imbrandoncali*06:53
SpamapSimbrandon: nice.06:54
imbrandonbut yea , that was just the "refrence" line from the wiki, i'm sure we can tweak it lots more06:54
imbrandonand research a little etc06:54
SpamapSok, battery is about to go dead even with powertop showing 8.0W of power usage06:54
imbrandonheh ok, gnight06:55
SpamapSimbrandon: should just thieve varnish's mmap method06:55
imbrandonstill in san fran ?06:55
imbrandonkk06:55
SpamapSnooo06:55
imbrandonlol06:55
SpamapSI was only there from the morning to evening06:55
imbrandonahh06:55
SpamapSkids.. wife.. all get in the way of fun stuff like conferences ;)06:56
imbrandoncool cool, i got some stuff to do early in the morning, but i've already woken for the day so just ping me later and i'll show yta the whole config set06:56
imbrandonthat i'm working on06:56
imbrandonhahaha yea06:56
imbrandonbtu yea that was a great start i thought, and its a dropin for our current LB config on omg06:57
imbrandonbut*06:57
SpamapSneed to start thinking in more generic terms06:58
imbrandonso really anything like apache or rails could sit on the other side of that upstream in this config too06:58
SpamapSI want to get omg's specific stuff into a subordinate06:58
SpamapSanyway06:58
imbrandonyea i have been, i've been making sure all the stuff is sep06:58
SpamapSbattery.. dead.. later06:58
imbrandoninfact even the web and lp i want sep06:58
imbrandonlater06:58
imbrandonlb*06:58
imbrandonhrm , yea infact i'm going to make this into a sub charm right now06:59
imbrandonits in a perfect state to do so06:59
imbrandonas a nginx loadbal microcache proxy07:00
* imbrandon looks for that charm init command07:00
=== amithkk is now known as Andrew__
=== Andrew__ is now known as AndrewStrong
=== AndrewStrong is now known as ubuntu__
=== ubuntu__ is now known as xubuntu
=== xubuntu is now known as a
=== a is now known as b_
=== b_ is now known as amithkk
marcoceppiimbrandon: I hope that's in the omg-wp repo11:09
imbrandoni'm actually commiting it now11:09
imbrandonor trying to .11:09
imbrandonhad some conflicts11:09
imbrandonbut yea11:09
imbrandonit is or will be in less than 5 min11:09
imbrandonmarcoceppi: good weekend ?11:09
marcoceppiimbrandon: excellent11:09
marcoceppiyes, lots of little wordpress tweaks, but if this does what it needs to we'll be golden11:10
imbrandonmarcoceppi: yea i got lots of impovements i've tested over the weekend while it was quite, bad part is i'm not QUITE ready like inches away though, but i got somewhere to be this morning till like lunch11:10
marcoceppiThat's fine, we can wait to deploy later this afternoon11:11
imbrandonnice, and i was lookign too its best if we do use totalcache to use apc backend not file, then nginx dont have to be touched as far as total cache, its just a normal setup + our other tweaks at that point11:11
* imbrandon heads to the other room11:12
jcastro_m_3: jamespage when we make the juu blueprints, it needs to be "servercloud-juju-blah-blah"13:05
jcastro_m_3: I have 3 charm growth blueprints I will file too.13:06
=== jcastro_ is now known as jcastro
jamespagejcastro, servercloud-q-juju-blah-blah please :-)14:07
jcastrojamespage: you don't need the q, but whatever14:14
jamespagejcastro: hmm - has that changed?14:15
jcastrolp tracks the UDS series, it's just people always put in the letter anyway14:16
jcastroyou don't need it, but if you want to do it that way that's fine too14:16
jamespagerobbiew specifically asked us todo it that way for the servercloud track14:16
jcastrooh ok then, do what he tells you14:17
jamespagejcastro, BTW can you change the message for this channel - might be a little out-of-date 'Charm content ends monday!...'14:18
=== jcastro changed the topic of #juju to: Charms at http://jujucharms.com || Want to write a charm? http://juju.ubuntu.com/Charms
jamespagejcastro, ta!14:32
jcastrojamespage: you were correct on the animal letter btw, mail sent to -devel again14:33
jamespagejcastro, glad to be of nit-picking service!14:34
jcastrorobbiew: hey, can we put juju backports in the shiny new cloud repository?15:32
jcastrothat would be cool I think15:32
robbiewjcastro: No, I'd prefer folks use the PPAs and/or Backports for juju15:35
jcastrook15:35
robbiewI would have pushed openstack the same way15:35
robbiewbut there will be times when folks want to freeze on a certain version15:35
robbiewI guess the same could be said about juju15:36
robbiewjcastro: tbh, there's really no difference between the cloud archive and a ppa15:37
robbiewjust naming15:37
robbiewbut people get worried when you ask them to add a ppa :P15:38
jcastrook, I was just wondering if delivering juju with that at the same time would be a good idea like milestone wise, etc.15:38
jcastro"you not only get the backend, you get the front piece too!"15:38
robbiewjuju needs a cadenced release first ;)15:39
jcastrowell I was hoping that would make us do that, heh15:39
SpamapSrobbiew: won't the cloud archive also use the regualar ubuntu signing key?16:27
SpamapSjcastro: juju is going to have something similar, but it should not be coupled to openstack.16:28
robbiewSpamapS: I guess...it's just a PPA mirrored off archive.ubuntu.com ;)16:29
SpamapSrobbiew: so they'll still have to add an apt key16:31
SpamapSwhich, IMO, would freak people out *more* than a PPA16:31
robbiewSpamapS: your opinion in the minority ;)16:32
robbiewit's not about the tech...it's about the "name"16:33
robbiewPersonal Package Archive scares people16:33
robbiewI admit it might not be logical...but neither are people :P16:33
jcastrohttps://bugs.launchpad.net/charms/+bug/96648416:34
_mup_Bug #966484: New Charm: Kusaba X <new-charm> <Juju Charms Collection:Fix Committed> < https://launchpad.net/bugs/966484 >16:34
jcastrohttps://bugs.launchpad.net/charms/+bug/96493616:34
_mup_Bug #964936: Drupal Charm: superchared Drupal charm with nginx,, apc, php-fpm, all setup to scale to the moon and be Best Practices. <new-charm> <Juju Charms Collection:Fix Committed by imbrandon> < https://launchpad.net/bugs/964936 >16:34
jcastro2 in the queue16:34
jcastroSpamapS: we can get these in by thursday right? For some sort of cycle-ending WOO?16:34
SpamapSrobbiew: I suppose the one win is that you'll get it as part of the mirroring of the archive and won't have to poke a hole in a firewall to get to ppa's16:41
robbiewexxxxxactly ;)16:42
SpamapSjcastro: need to be available to do 0-day SRU reviews but I'll try to squeeze these in16:46
=== carif_ is now known as carif
_mup_juju/retry-client-for-cli r532 committed by kapil.thangavelu@canonical.com18:57
_mup_use retry client for cli18:57
SpamapSnegronjl_: hey, how would you feel about moving your REST api into juju-jitsu?18:57
avoinenegronjl: great works by the way (jrapi)19:24
=== hspencer is now known as hspencer[afk]
flepiedis there any plan to support dynamic creation of vm in juju based on load or other metrics ?19:55
SpamapSflepied: you can do that now. stick the client on a thing that knows what the load is, and when load goes up, 'juju add-unit X'19:58
flepiedSpamapS, any example of this ?19:59
SpamapSflepied: none I've seen, but its such a simple concept.. you can do it with icinga/nagios20:00
flepiedSpamapS, seems easy, I'll try20:03
flepiedanother question is there any plan to use chef/puppet with juju ?20:03
SpamapSflepied: I created puppet charms last week...20:04
SpamapSflepied: and some people have toyed with using puppet to assert the system state they want from install/etc.20:04
SpamapSflepied: juju really doesn't want to define that.. it executes stuff ... you choose what it executes :)20:04
flepiedSpamapS, yes I got that. Just wanted to see if this was going to be the way to write charm in the future or not...20:06
SpamapSflepied: If we define a single way, we will be losing all the existing goodness that people have for their services.20:12
SpamapSflepied: the main advantage of juju is that we can connect these unrelated stacks to form a new, bigger stack20:13
flepiedSpamapS, ok makes sense but you also need to ease the integration of charms together so having standard ways to do thing could help20:15
SpamapSflepied: right, we've been doing a lot of shell scripts so they're easy to read for that reason.20:16
flepiedSpamapS, is there any way I can help ? I have some spare time...20:18
SpamapSflepied: are you an expert on any service that might be useful in the cloud?20:25
SpamapSflepied: if so, write a charm... using puppet or chef would be a bonus so people can see how that works20:25
SpamapSflepied: one method I think that will work is to use the facter custom facts plugin to have a charm's hooks store relation/config settings data, and then just keep running the puppet ruleset using those facts.20:26
flepiedSpamapS, ok I'll look at that20:28
SpamapSflepied: Also the charms we have now are all kind of untested.. we need people to put them through the paces and apply real world scaling/configurability to them20:29
SpamapSflepied: oh, and if nobody said this to you yet.. WELCOME! :)20:31
flepiedSpamapS, thx :)20:31
flepiedSpamapS, I'll try to see how to test charms. I saw there is a ftest service running20:33
SpamapSflepied: yeah that just bootstraps and runs a few of the basic charms20:37
flepieddo you have a jenkins server testing the charms ?20:37
=== lamont` is now known as lamont
flepiedSpamapS, from this table http://jujucharms.com/interfaces, it seems monitoring (nagios) and ngnix (gunicorn) cannot work as they require something that is not provided anywhere...20:46
SpamapSflepied: actually we just landed a feature which will enable that20:47
SpamapSflepied: its called 'subordinate charms' and we need to work on the documentation a bit :)20:47
SpamapSflepied: re charms in jenkins, 'http://charmtests.markmims.com' .. but there is one running precise charms now too20:48
SpamapSm_3: ^^ I can has precise, preeeaassseeee20:48
flepiedSpamapS, yes I experimented it the other day and it's working fine20:48
SpamapSflepied: also nagios I think can be modified to be able to relate to anything since there is now a 'juju-info' relation for every service20:50
flepiedSpamapS, yes that's the trick to avoid having explicit relations20:52
SpamapSflepied: though I think there should be a general 'monitoring' interface which can feed back basic instructions on what to monitor...20:53
SpamapSflepied: like, mysql can tell nagios to monitor it, and if the nagios charm has mysql specific monitors, it will use them20:53
flepiedSpamapS, yes that'd cool20:54
SpamapSflepied: make it generic enough and we can sub in newer, more scalable monitoring stuff :)20:55
* SpamapS pushes support for subordinates into charm-tools20:55
SpamapSm_3: why didn't I think of this. the charmtester should run 'charm proof' against all charms as well20:56
SpamapSbac: hrm, I feel like we left something undone with charm helpers and your buildbot stuff22:03
bacSpamapS: gmb and i have a couple of proposed branches and there was the packaging issue.22:04
bacSpamapS: it is on our radar but we haven't bugged you about it assuming you were swamped ATM22:05
SpamapSbac: I seem to recall that we wanted to get python-shelltoolbox packaged on its own22:06
bacSpamapS: yes, and portable to lucid22:07
bacas needed by our buildbot slaves inside the containers22:08
xmltokwhen using juju, are people using chef/puppet to do the base system configuration? I understand writing charms to do an application, but when configuring the system (ldap, accounts, mounts, etc), it seems like chef/puppet make more sense then a bunch of charms. I'd think that there should be a charm to deploy/configure/run chef/puppet, right?22:09
SpamapSxmltok: There's a new way to deploy puppet/chef/??? along side your charms to do things like system policy.22:10
SpamapSxmltok: http://jujucharms.com/search?search_text=puppet22:10
SpamapSxmltok: I'm clint-fewbar btw ;)22:10
xmltokaha! perfect22:11
SpamapShttp://jujucharms.com/~clint-fewbar/precise/puppet22:11
SpamapSxmltok: its still just a proof of concept though.22:11
xmltokexactly what i was thinking22:11
xmltokoh hey cool, mod_spdy charm. nice22:12
SpamapSxmltok: yeah that needs some work too.. it just assumes 127.0.0.1:80 will have a service to forward to :)22:12
=== hspencer[afk] is now known as hspencer[mtg]

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!