/srv/irclogs.ubuntu.com/2012/06/24/#juju.txt

hazmatchecking01:03
hazmatimbrandon, jujucharms.com is in ec2 fwiw01:03
hazmatimbrandon, i can hit omg as well01:04
imbrandonkk ty, kk ty02:13
imbrandonyea i could hit omg the whole time, but i cant use juju02:13
imbrandonfor status or anything02:13
imbrandonbut external monitors show fine, and i can hit the website as well , but i cant hit the bootstrap node with juju , wonder but because of dns errors not02:14
imbrandonnet ones, well least not on the surface02:15
imbrandoni'll track it tomarrow if its still happening02:15
imbrandondont feel like messin with it tonight and its not an emrngncy blah blah02:15
imbrandonty for checking tho hazmat02:16
hazmatimbrandon, ping02:54
hazmatimbrandon, fair enough.. not tonight02:54
hazmatimbrandon, i'll be around a bit in the am tomorrow, then off on a plane, but i'd be happy to help debug02:55
imbrandonsounds good, yea my brain is about fried as far as anything productive03:42
imbrandonfor the evening :)03:42
imbrandoni've been in my OSX boot playing in photoshop the last hour heh, bought the new cs6 version today03:43
imbrandonthey drasticly droped the price on the creative suite , so it was a no brainer03:44
imbrandonits like a $30 a month subscription now ( optional ) instead of $1200 up front03:44
imbrandonand includes ALL the CS on and offline apps03:44
imbrandonsmart move imho03:45
imbrandonif they would just port at leaste the online versions to linux ( the online apps are 98% as powerfull as the offline ones )03:46
imbrandoni would be set03:46
arandI'm getting juju FTBFS on current quantal, due to a bunch of failed test cases, is that something anyone would be able to confirm? https://bugs.launchpad.net/ubuntu/+source/juju/+bug/101711310:54
_mup_Bug #1017113: FTBFS: Sveral tests fails <ftbfs> <quantal> <juju (Ubuntu):New> < https://launchpad.net/bugs/1017113 >10:54
imbrandonerrr11:50
imbrandonbholtsclaw@ares:~/Projects/local/charms/precise/nginx$ bzr push lp:~imbrandon/charms/nginx/trunk11:50
imbrandonbzr: ERROR: Permission denied: "~imbrandon/charms/nginx/trunk/": : Cannot create branch at '/~imbrandon/charms/nginx/trunk'11:50
imbrandon:(11:50
SpamapSimbrandon: you need a series12:36
imbrandonahh crap12:36
imbrandonty12:36
imbrandonreal fast tho, yea of nothing else at all lets steal that version showing trick, kinda slick AND solves the problem of parsing it possibly later12:45
imbrandonk , i'm out for a bit ... SpamapS ^^12:45
* imbrandon just put the place holder site/design up on behalf of the php-fig group 14:23
* imbrandon does a little dance , sings a little song 14:23
imbrandonheh14:23
imbrandonhttp://www.php-fig.org :) they are the group that made/makes like PSR-0 etc14:24
imbrandone.g. the peps in python14:24
SpamapSoh14:30
SpamapScool14:30
SpamapSwait, PEP?14:30
SpamapSI thought PHP had RFC's14:30
imbrandonlike pep-814:30
imbrandonrfc's and PSR's now there is only PSR-0 and -1 so far14:31
imbrandonthus me getting the chance to do the initial web :)14:31
imbrandonits a young group but has some heavy heavy weight behind it like drupal, wordpress zend zf2 symphony welll helll just about any php group or company has a voting member14:32
imbrandonfig is "framework interop group" and psr's are php standard resolutions or something, but makes sure all frameworks work togather and do shit the same way14:33
imbrandonand even if there is 5 ways to do something there is now a "right" way , or will be :)_14:33
imbrandonheh14:33
SpamapSOk, so PSR's are just about php code14:34
imbrandonyea14:34
SpamapSwhere as the PHP RFC's are about php dev14:34
SpamapScool14:34
imbrandonLIKE pep :)14:34
imbrandonwell14:34
imbrandonits about interop14:34
imbrandonlike psr-0 says how autoloaders need to work14:34
imbrandonand bare minimum they have to supoort etc14:34
imbrandonso i can use bits form zf framework with symphony now, like for real14:35
imbrandonand it autolaods14:35
imbrandonan extreem case of this will be when i can use a wordpress plugin on drupal14:35
imbrandonthats a goal, far far out but that level of crap from the ground up14:35
imbrandonand -1 talks about tabs and spances14:36
imbrandonand 2 spaces versus 4 etc14:36
imbrandonso its a mix14:36
imbrandoni think -3 thats in the works is covering Cacheing and standarinzing some Cache interfaces14:37
imbrandoni *think*14:37
imbrandonbut yea in like less than 6 months its got evey major player behind it and like 300+ members14:38
SpamapSthats great14:47
SpamapSPHP is growing up14:47
SpamapSdespite all the past predictions that it would eat itself14:47
SpamapS(I never subscribed to those predictions btw ;)14:47
_mup_Bug #1017113 was filed: Juju test suite fails sporadically due to low timeouts <ftbfs> <quantal> <juju:Confirmed> <juju (Ubuntu):Triaged> < https://launchpad.net/bugs/1017113 >14:59
imbrandonFRAK15:00
imbrandoni just did this whole function in JS15:01
* imbrandon is working in a php file15:01
imbrandonbah, i need a cigarette and a mt dew, heads not right :)15:01
imbrandonSpamapS: there we go15:03
imbrandonhttp://cl.ly/HcuA15:03
imbrandonfully filled out with temp data and everything15:03
SpamapSso .. much.. white(black)space15:04
imbrandontill they decide what content they want heh :) or they dont like the look of it15:04
imbrandonthats a screenshot15:04
imbrandonthe black is the website holding the screenshot15:04
SpamapSl15:04
SpamapSo15:04
SpamapSl15:04
SpamapSgot it15:04
imbrandonand on your smaller monitor their wont be so much white15:04
SpamapSI'm also just having my first coffee even tho I've been up since 5am15:04
imbrandoni'm on a 24inch :)15:04
imbrandonheh15:05
SpamapSI'm on the 11"15:05
imbrandonheh15:05
SpamapSthats what s...15:05
imbrandons ?15:06
imbrandonres ?15:06
imbrandon1920x1080 x 315:06
imbrandonno retna for me yet :)15:07
imbrandonokies, back in a bit, skipped the shower for breakfast instead this morning, not gonna put it off too long or i'll be all icky ... ewww yea, ok back in a bit15:09
hazmatSpamapS, about 3m40s on an x220 with ssd (samsung 830) with fsync off on zk16:00
SpamapShazmat: yeah I'm about the same using eatmydata16:16
SpamapShazmat: on the MBA16:17
SpamapSwith "whatever the heck they use for SSD"16:17
SpamapShazmat: hey, 'make check' doesn't seem to work for me16:17
SpamapSI have JUJU_TRUNK set...16:18
SpamapSmake: *** [check] Error 116:18
hazmatSpamapS, apple uses samsung and toshiba, pretty slow till this year afaik16:39
hazmatSpamapS, make check needs modified files committed16:40
hazmathmm.. actually not committed16:40
hazmatmake review checks committed changes on a branch16:41
hazmatmost of those are ben's additions, i normally just use make coverage16:41
imbrandonyea the ssd's untill this last bactch from apple sucked16:42
imbrandonthey are samsung mostly16:42
imbrandonbut not they got some intel ones16:42
imbrandonbut yea before these toy want to buy third party ram/ssd16:42
imbrandonram is that damn hynix16:42
imbrandonbleh16:42
hazmatimbrandon, their still using samsung  from what i've read, but its the new 830 series controller, which is pretty fast (also what i use for my thinkpad)16:43
hazmatit doesn't do the write deamplification like the sandforce ones, and its not quite as good as the intels as background cleanup, but with trim OS support it works fairly well for me16:45
hazmatimbrandon, did your ec2 issues get resolved?16:47
imbrandonyea , well kinda16:50
imbrandonits a bug but i figured it out16:50
imbrandonnow i forgot what it was but i made a note cuz i wanted to report it and let you know16:50
imbrandonahh, the only 2 i've owned have been intels so far16:51
imbrandoni used 2 others but quickly took them back for write errors in the first week16:51
imbrandonohh i know what it was now, the nodes got a new juju16:52
imbrandonbut i had old local16:52
imbrandonand it kept looking like a dns error16:52
imbrandonbut as sonon as i updated my local juju it was all good16:53
hazmatcool16:54
hazmattime to pack up and head to velocity then16:54
imbrandoncool cool, dont have too much fun, i plan to fix the docs this afternoon16:54
imbrandonso they should be all new and ready for yall16:54
imbrandoni wanted ot get my nginx pushed first tho ( i did get the first round pushed, so its atleast on LP now heh )16:55
imbrandonbut still is missing a few hooks i need to complete16:55
imbrandonSpamapS: and the majority of it is in PHP heh :)16:56
imbrandonnext one i think i'm gonna use ruby on but not chef/puppet, just ruby16:56
imbrandonjust to kinda feel out the diffs16:57
imbrandonhttp://bazaar.launchpad.net/~imbrandon/charms/precise/nginx/trunk/view/head:/hooks/install16:59
imbrandonLP/logger head makes it all pink :(17:01
imbrandonyou know what i realized just now, and now i see it i cant beleave no one else has17:04
imbrandonwhy do we do all these config-get's and put them into varables in every hook17:04
imbrandonwhy does juju not just put them in the env when the hook fires17:05
imbrandonits pretty much garenteed config-get will be called once, if not many times in a row when either they could config-get once at the top and split the json out17:05
imbrandonor none at all and juju could do it for us, repetitive boilerplate is not good, i started to make a "common.php" and was like wtf, why dont juju do this17:06
imbrandonSpamapS: ^^^ ( and m_3 / hazmat if yall arent on the road yet )17:07
hazmatits a little implicit17:10
imbrandonwell env vars' it happens all the time for websites17:10
hazmatsay you get a variable mismatch17:10
imbrandonthe db conn info in the server env17:10
hazmatwhere's the error line17:10
imbrandonwell i'm not saying that the config-get should die, just that it should prepoulate17:11
imbrandonthe env17:11
imbrandonit almost has to anyhow i'm sure it loads it prior to the config-get call17:11
imbrandonlike whne the hook fires17:11
imbrandonanyhow17:11
hazmatimbrandon, worth filing a bug/feature request for17:12
imbrandonanyhow, not saying its well thought out either, it just stuck me a few minutes ago :)17:12
imbrandonyea, i'll see where it goes ;)17:12
imbrandononly takes 5 min to fill out a LP page17:12
imbrandonits worth that17:13
imbrandonZOMG !!! the new photoshop cs6 went gimp :( frak17:16
imbrandonits all multi windowd, man i knew i should have fired it up fist17:16
imbrandondamn the artwork, window chrome , icons , etc alll look gtk3/gimp17:17
imbrandonSpamapS: check this out, this is default like 5 seconds after it finsihed installing ( e.g. not a custom theme or something )17:23
imbrandonhttp://cl.ly/HbID17:23
imbrandonwatch out tho, there might be alot of black round that one too hahaha j/k17:23
imbrandonbut tell me that dont look gtk/gimpified17:24
imbrandonps has always done its own unique UI , well untill now i guess17:24
lifelessis there bug open for getting secret key etc from the environment (e.g. AWS_ACCESS_KEY_ID) ?19:28
imbrandonlifeless not that i'm aware, but i havent had prblems with that19:37
lifelessjust thinking it would make 'get up and go' easier.19:37
imbrandonlike you set it and then it cant get it ?19:37
lifelesssophisticated installs need partitioned credentials19:37
imbrandonohh19:37
imbrandonok i see what ya mean19:37
imbrandoni was thinking something diffrent19:37
imbrandonyea, that would make sese and would fall into line with the config-get i was talking about19:38
lifelessall the euca and aws tools, for intsance, read from the environment. (The actual environment, not environments.yaml)19:38
imbrandonyea19:38
lifelessI'll check for a bug19:38
imbrandonyea a couple two of my charms export those just for that19:38
lifelessso, looks like openstack just does noddy dns names19:38
lifelessrather than the mass assigned reverse-ip-prefix that ec2 does.19:39
lifelesswhich is why juju + internal openstack is so tedious, I suspect.19:39
imbrandonreally ? i've been meaning to get the openstack a try on hpcloud the last few days just not made it that far yet19:39
lifelessproduction instances probably have some workaround19:39
lifelessbut the code I'm reading so far depends on e.g. ldap DNS server integration19:40
imbrandonkinda was hoping to give it a go and then talk omgubuntu into moving maybe if it was solid19:40
lifelesswhich is way more complex19:40
imbrandonahh19:40
imbrandoni run open directory local on my lan anyhow ( i have a osx box that acts as a pdc and uses open directory )19:40
lifelesssee ./nova/network/ldapdns.py for instance19:41
imbrandonfunny tho, no windows clients so really i could just use nis or whatevr but bah. i followed the gui setup when i set it up a few months ago19:41
imbrandonwasent really intended to be a "real server" when i set it up, was just testing osx server 10.8 and then i came to rely on it more and more, now i got to get a migration plan done at some point19:42
imbrandonheh19:42
imbrandonthats sad for my home network19:43
imbrandonlol19:43
imbrandonpretty sure i have it doing primary logins, home directories , perms control on the other 2 linux servers19:43
imbrandonand some other minor osx specifc stuff like time machine and iphoto/itunes shares19:44
imbrandonall on something that wasent intended to be used in "production" at all19:44
imbrandonlol19:44
lifelessah, they are supported I think19:45
imbrandonis kinda neat how much ubuntu picks up on the osx services now tho, used to be a pain, but now banshie/rhythmbox see the itunes , all of them use mdns native19:45
imbrandonetc19:45
lifelessI didn't realise that the openstack default is to use different environment variables *for the same values*.19:45
* lifeless headdesks19:45
imbrandonheh19:46
imbrandonyea i think it looks in the cli then env, then config home and confg server19:46
imbrandonerr scratch that last one thats the aws tools19:46
lifelessyup, they are supported.19:47
imbrandoncool19:47
lifelessopenstack's scripts set EC2_ACCESS_KEY, not AWS_ACCESS_KEY_ID, for instance.19:47
lifelessI'll file a bug on txaws for supporting the openstack variables19:47
imbrandonhrm, maybe i'll take a break from the nginx charm a minute and get a os env rolling, then i can use it to finish testing the nginx charm up19:48
imbrandonand work some kinks out19:48
imbrandonnice, yea i'm sure hazmat will toss it in, seen him do a few patchs quickly on it the last week or so19:48
imbrandonbut he is in route to a conf today iirc19:48
imbrandonand there most of the week next week i *think*19:49
imbrandonvelocity, not sure its a week long tho19:49
imbrandonfew day at least i'd imagine19:49
imbrandonoh btw, i did get my credentials working on the juju wiki, just needed to log out like ya said19:50
lifelessthere we go: https://bugs.launchpad.net/txaws/+bug/101723919:50
_mup_Bug #1017239: openstack ec2 credentials not picked up from environment <txAWS:Triaged> < https://launchpad.net/bugs/1017239 >19:50
imbrandon( that was you that handled the ticket right ? heh sorry if not )19:50
imbrandonmy thing with all these cli tools is they all want the same keys but diff env names19:52
imbrandonirks me19:52
lifelessmmm, no, I ididn't19:57
lifelessI get cc'd on some rt stuff, part of my job to be looking for trends and issues19:57
imbrandonwhoop sorry then , mixed the name up, i had just glanced at it19:57
imbrandonyea you might have been cc'd i just glanced at the name that handled it but it was so late friday when i got it working i put it off emailing back19:58
imbrandonheh19:58
imbrandonor it might have just been a similar name :)19:58
* imbrandon is curious now, goes to look19:59
imbrandonahh yea, you were just cc'd on it for some reason :)20:00
imbrandonchris stratford did it, not sure who that is on irc if i even know them /me replies so they will see it monday and close it hopefully , /me should not be so terrible about the responses20:01
lifelessimbrandon: this is what <dnsName>ec2-75-101-245-65.compute-1.amazonaws.com</dnsName> - ec2 returns, vs <dnsName>server-2</dnsName> in my local openstack install20:04
lifelessyou can see the former is trivially bulk-provisionable20:04
lifelessor even just dynamically answerable by a hacked dns server20:04
imbrandonhrm20:05
imbrandonyea thats nasty20:05
lifelesshowever, these days we get ip addresses straight back20:06
lifelessso we can use that20:06
imbrandonright20:06
lifelessneeds a txaws patch tho20:06
imbrandonyea dns is a tricky thing to even for experinced programmers / devops / ops , one little variance and can toss a whole range of things out of wak20:07
imbrandonso that dont help20:07
lifelesshttps://bugs.launchpad.net/txaws/+bug/101724520:09
_mup_Bug #1017245: ipAddress and privateIpAddress are missing from describeInstances <txAWS:Triaged> < https://launchpad.net/bugs/1017245 >20:09
* lifeless is on a yak shaving mission20:09
imbrandonhaha20:09
lifelessargh20:10
lifelessnow20:10
lifeless2012-06-25 08:10:14,921 ERROR Invalid SSH key20:10
lifeless^ $curses20:10
imbrandonhaha20:10
imbrandonbad env.y most of the time20:10
imbrandonwhen i get that20:10
lifelesspasted you my env for this20:12
lifelessAm I using the ssh option wrong or something ?20:12
lifelessdoes it upload it via cloud-init ?20:12
lifelessdoes the key need to be registered with the cloud20:15
lifelessor is cloud-init used to insert it ?20:15
imbrandonyea20:16
imbrandonit gets passed as user-data20:16
imbrandonto cloud init20:16
imbrandonalong with some pkgs to be installed like bzr20:17
imbrandonand juju zk20:17
lifelessyah20:17
lifelesslog shows zk etc installing ok20:17
imbrandonand then it also passes a 64base encoded shell script that makes like var/lib/juju20:17
imbrandoncan you "curl -iS http://instance.data/latest/user-data20:18
imbrandonoin maas ?20:18
imbrandonEC2 API has it, and i know rackspace and hp both do but not sure if its the compatability layer or OS that also does it20:19
imbrandonbut that should show you the whole cloud init user-data script including keys20:19
imbrandonif they were passed20:19
imbrandonor "curl http://169.254.169.254/1.0/user-data" may work too20:21
lifelesswell, I can't ssh into the machine20:21
imbrandonthe other is just an alias on the local nets that implment it20:21
imbrandonoh frack20:21
lifelessbecause the ssh key is whats failing :>20:21
imbrandonthats right20:21
imbrandonhrm20:22
lifelessotherwise, I'd be like 'woo yeah. lets see'20:22
imbrandonthis is MAAs right ?20:22
lifelessno20:22
lifelessopenstack20:22
imbrandonor jusy OS20:22
lifelessseen EC2 error when attempting to delete group juju-devstack-0: Error Message: An unknown error has occurred. Please try your request again.20:22
imbrandonok there is a way you should be able to get at the user data from the outside20:22
imbrandonand change it if needed, i just cant rember right off20:22
* imbrandon things20:22
lifelessSo, I want to figure out whats wrong20:23
lifelessI have root on the openstack server20:23
lifelessso I'll fiddle around there20:23
imbrandonohh ok locla too20:23
imbrandonyea look in /var/lib/cloud20:23
imbrandonit will have where it dumped the keys20:23
imbrandonbefore it added them or should have20:24
imbrandonas well as logs20:24
imbrandonthat juju might not have20:24
lifelesswhere are the juju logs ?20:24
imbrandon/var/lib/juju/charm/somewhere20:24
imbrandonif your on the box run ps ax20:25
imbrandonit will show where the log is getting piped20:25
_mup_Bug #1017248 was filed: EC2 error when attempting to delete group juju-devstack-0 <juju:New> < https://launchpad.net/bugs/1017248 >20:25
lifelessnot the charm stuff; the error coming back from ssh20:25
imbrandonyea20:25
imbrandonthere should be a more general zk log too20:26
lifelessok, this is weird20:26
imbrandonin there20:26
lifeless*I* can ssh to the instance20:26
lifelessjuju can't20:26
imbrandonahjh20:26
lifelessfrom the same shell20:26
imbrandonthat def means the env.y syntaz it fubar then20:26
lifelessssh ubuntu@10.0.03 works20:26
imbrandonsyntax*20:26
imbrandonit wont try other keys20:26
lifelessok, so lets see that url20:26
imbrandoncurl http://169.254.169.254/1.0/user-data20:26
imbrandonlet me pastbin you my working one privately20:27
lifeless    ', /sbin/start juju-provision-agent]20:27
lifelessssh_authorized_keys: [ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA728T0gI08lJFqZQo8lDUgKiE860aWTQz+QSeYAFg2T5TrYbGHKt2GHZy+OHYkAhUiSCjZXogFyh1+TRkQIYCcZTNQdOoMtLVesOk9/jRh6ZIcrQvTzbK2KpLXBMhNX9J+HZ5MiAYTZRX9uJSmvDAxrsof2qcVyYBs67hPdE3s5I0Zg5uNm93M9/ciEr+UWTWiIxounHhiEbdW1LIszBlAtvLpsw9bgtB6rRjygiSvoiXMTt00YhWip9PpxBBa6OqtETF/Qu+Uf+guujTnwO9Ue77kNDoocMrZfDsBxlSG6gsByGO/ue7YlRI1w96W68xaGLFl5cgt60SUK1BIVJW9w==20:27
imbrandonso you can compare20:27
lifeless    /home/robertc/.ssh/id_rsa]20:27
lifelessthats three lines20:27
lifelessbut it looks quoted20:27
imbrandonthat looks right20:27
imbrandonhrm20:27
imbrandonwow20:27
lifelessI mean, it worked right? I can ssh in...20:28
imbrandonok one sec, let me still get mine, i bet its that damned authorized-keys vs authorized-key-path i came accross the other day20:28
imbrandonsome things use one and some the other i am willing to bet20:28
lifelessimbrandon: I don't understand though: how does this affect 'juju status' - the ssh environment is *working*20:29
lifelessI just did 'ssh ubuntu@10.0.0.3' and et voila20:29
imbrandonright, that was their issue too, liek two days ago, i just unfortunately did not pay enought attn20:29
lifelesshmm, status -v20:30
lifeless-> its connecting to 10.0.0.2. *bong*20:30
imbrandonnice20:30
lifelessfixed, I think20:30
lifelesslets try that again20:30
lifeless\o/20:30
lifelessok.20:30
lifelesstime to do patches, bugs, writeup and then I can do what I actually wanted to be testing.20:31
lifelessbut first, a quick break20:31
imbrandonhttp://paste.ubuntu.com/1058118/20:31
imbrandonthats how my keys are layed out fwiw, just for ref later20:32
imbrandonif you add more20:32
imbrandonobviously thats only the middle of the file, but you get the context20:32
imbrandoni *think* you can have it read a file as well like authorized-key-path: ~/.ssh/authorized_keys20:34
imbrandonbut i have not actually tried that yet20:34
imbrandonbtw for anyone arround , or that reads this in the backlog, i started a full mirror on a box at hpcloud i set aside just for that reason, apt-mirror should be done here in less than an hour and i'll have it sync very very regularly ( like every hour or so if not more ) as a "local mirror" on the hp cloud20:37
imbrandonfigured i needed to play upstream and dust off apt-mirror for a little workout and fix some of the miror bugs in bts anyhow and that gives me a good excuse20:38
imbrandonpoint is i'll post the priv IP for it etc etc somewhere we can all refrence it like the mailing list20:39
imbrandonto use, and should no problem with trust as i'll put a real ssl cert on it ( got one i'm not useing ) and the keys are all canonicals etc cuz i'm not repackin stuff, real mirror20:40
imbrandoni'll make sure it runs at minimum the 3 months HP gave us, if its not too much i may keep it past then too20:40
imbrandonor see if they will just sponsor that one node etc if i put the ops time in keeeping it up20:41
imbrandonwe'll hit that bridge when we need to but for now should greatly speed up apt-get and such20:41
imbrandonhrm, and actually it just hit me that apt-mirror would make an excelent charm too20:42
imbrandonjuju deploy apt-mirror; wait 2 hours and you have a private mirror :)20:43
imbrandoncould even make it smart and use ec2 on aws and such :)20:43
imbrandonerr s320:43
lifelesswell20:43
lifelessotoh yes, otoh we have canonical run mirrors on the major clouds, in each reach,that have free traffic for instances...20:44
lifelessok, it was fixed in txaws rev 13420:58
lifelesswhich we're not running yet20:58
lifelessSpamapS: what do you think the chances of updating txaws in precise are? to get ip address support in Instances (rev 134)21:01
imbrandonif we could isolate it to fixes only i'm sure we could make a case and get it tested good enough21:04
imbrandoni would think21:04
imbrandonajmitch: ping pong :) here is good too21:04
imbrandon:)21:04
imbrandonnot sure if i'm even in uwire right now21:04
imbrandonlol21:05
ajmitchso what are you having issues with? it's good timing as I had the fabric script open in front of me right now21:05
imbrandonlike was having problems groking even a working file at all21:06
lifelessimbrandon: this is what I need: http://bazaar.launchpad.net/~txaws-dev/txaws/trunk/revision/13421:06
* ajmitch uses it in a really basic way, checking out the branches21:06
imbrandonlike hellp world stuff, i'm only ever done capfiles like that21:06
imbrandonyea thats what i have the charm doing now21:06
imbrandonits checking out the git repo21:06
imbrandonand then dumping a config21:06
imbrandoninto place21:06
imbrandonand as well as a cron than looks for git updates to the prod branch21:07
imbrandonbut i wanna change that to a web post hook on next iteration21:07
imbrandonno need to be looking 24/7 running crons like that every 10 min21:07
imbrandonwebhook that takes a postrecieve from a git hook commit or bitbucket or github webhook etc etc21:08
imbrandonand pulls and swaps dir21:08
ajmitchok, what do you have so far? dump in a pastebin or something21:09
imbrandonbut yea, i like dident even get hello world functioning ,i'm guessing because i was trying to do it liek a cam file and use config/deploy etc21:09
imbrandonyea , let me find which branch i was on21:09
imbrandongive me like 2 min21:09
imbrandonlifeless: yea i'm thinking that LOOKS like it could be sane enough to land in an -update but i often over look other parts so SpamapS could give ya a MUCH better idea21:10
imbrandonbut we already had juju its self in -updates21:11
imbrandonso the team isnt shy of it21:11
ajmitchfabric is really quite simplistic, it's just "run this stuff on these hosts"21:11
ajmitchdoesn't do any of the provisioning magic of juju :)21:11
imbrandonyea i was hopign it was a python version of capistrano21:11
imbrandonsince all thse damn hooks are in python it will make since to use fab, and the ones i write in ruby or php i'll use cap :)21:12
imbrandonor say screw it and convince them to build it into juju :)21:12
* imbrandon looks for the code21:12
ajmitchyou can probably do similar things with it21:13
imbrandonyea cap is very deploy centric, not like chef/puppet config mgmt21:13
imbrandonit CAN but thats whole nother store21:13
imbrandonmuch better suited for the install and update hooks21:14
imbrandonand custom elsewhere21:14
* ajmitch will have to head off in a few minutes probably21:14
imbrandonok not found my branch yet, you would die at my ~Projects folder21:15
imbrandonbut i did find where i was cop;y/pasting from21:15
imbrandonhttp://www.saintsjd.com/2011/01/continuous-deployment-for-wordpress-using-git-and-fabric/21:15
imbrandon^^my history file still had it21:15
imbrandonheh21:15
imbrandoni got all the way down to "writing the deploy scripts"21:16
imbrandonand like nothing seemed to work at all21:16
imbrandoni had all kinds of problems but it was also trying to do alot more than i just wanted it to grab the proper git branch and then symlink atomic update the deploy putting a config into place if it was the first run and not there yet21:17
imbrandonseemed simple but yea21:17
imbrandonlike -0- examples of that i could find21:18
imbrandonor close21:18
imbrandoni mean i have the charm doing all this alreay but its kinda to be able to use python with python hooks when the charm uses those ( like the old wordpress )21:19
imbrandonand ruby when it uses those ( i know how to use capfiles )21:19
imbrandonetc21:19
imbrandonseems like passing vars and such might get some novel use if it can do stuff natively21:20
* ajmitch will have to talk to you about this later21:20
imbrandonkk21:20
imbrandonnp21:20
imbrandoni know your working :)21:20
* ajmitch is at work, has meeting soonish21:20
imbrandonyup yup totally understood, jsut next day or two as you have time toss me a bone :)21:21
imbrandonohhh lifeless your turn ( promis its easy q, lol) is the scripts/jobs that build the OSX dmg/pkgs for bzr on LP publicly that you know of ?21:22
imbrandonjust curious if you knew before i started digging, i'm hoping i can gleen some of them for use wiht osx juju, stand on the shoulders of giants and all that21:23
imbrandonsicne it has dmg installer and python i'm hoping there is a good chance :) heh21:23
lifelessimbrandon: I don't know.21:30
lifelessimbrandon: it should be linked from the macosx stuff on the bzr wiki21:31
lifelessbazaar.canonical.com21:31
lifelesshow does one run the test suite ?21:36
imbrandonwell21:36
imbrandonthe packages are but i ment the build part21:37
lifelessimbrandon: yes, there should be docs on building it on the wiki21:37
lifelessits changed hands a few times21:37
imbrandonahh cool21:38
imbrandonokies,i'll poke at it here in afew, getting aws alerts again about the EU stuff21:38
imbrandonneeding to check it, afkish21:38
SpamapSimbrandon: I have *never* used photoshop, so I can't judge that screenshot. To me, photoshop is the one that feels wrong. ;)22:07
imbrandonyea but look how GTK/GIMP that looks now22:08
lifelessSpamapS: oh hi22:08
imbrandondef not OSXish22:08
SpamapSlifeless: you do know that the credentials are only ever used for bootstrap and destroy-environment, right? (reading backscroll)22:09
imbrandonoh man its like half the ram of CS5 too and very fast, i wonder if they dident just rip gimp off :) hahah , not only that they did the one thing that will keep adobe around for a very long time, subscptions, they did what apple did to the music industry with this release and no one realizes it yet, no one will pirate this when they can have all 16 offfline apps and 6 online apps for 30bux a month except script kiddies, but they dont matter, young pros it will22:10
imbrandonever*22:10
SpamapSlifeless: bootstrap shoves them into ZK and the provisioning agent uses them henceforth. :p22:10
imbrandonwhatever they did to the UI , its very very snappy now, and much much less ram ( all the CS apps so far i installed from the pack are )22:11
SpamapSlifeless: reading r134 now22:11
imbrandonSpamapS: yea dident wanna put words into the teams mouth there but it is a bug bug22:12
lifelesshahaha22:14
lifelessso juju doesn't like running its tests in parallel :)22:14
lifelessSpamapS: yes, but friction is friction22:14
SpamapSargh22:14
SpamapSwhy isn't txaws tagging their trunk? :-(22:14
lifelessENOIDEA22:14
SpamapSargh, nor are they using launchpad releases22:16
SpamapSso its pretty hard to see if/when that fix is already released22:16
SpamapSother than the bug being Fix Released22:16
SpamapSas somebody who has been a committer on txaws for a while, it feels like a ship w/o a rudder. :-/22:17
imbrandonbtw SpamapS the feel i can genuinely get past , i know alot of ppl get hung up on it,but its cuz thats all they really use and like to whine , but really i tend to miss all the "little things" that arent really PS at all but part of the CS like one button ( even a mouse macro ) to move the current image between PS and illistrator ( inkskape ) without closing / opening an app or save/open a file, it just does it and your editing the vector aspects of the proje22:17
SpamapSI think we'd have been better off with boto at this point. :-P22:17
* imbrandon si done on that subject :)22:17
lifelessSpamapS: erm, no ;). boto inside twisted is just awful. Please pleaseplease no.22:19
SpamapSlifeless: looks like a workaround for OpenStack not making it easy enough to setup DNS... hrm22:19
imbrandonlol lifeless22:19
lifelessSpamapS: not really.22:19
SpamapSlifeless: libcloud then.. ;)22:20
lifelessSpamapS: SpamapS or rather, if you want to call it that, but - openstack doesn't have a batteries included mass-provision dns22:20
lifelessSpamapS: also not twisted.22:20
lifelessSpamapS: AFAIK.22:20
imbrandonSpamapS: i thought it looked like a real bug of it returning the wrong value ona correct but uncommon setup22:20
lifelessSpamapS: synchronous network code within twisted is generally a disaster waiting to happen.22:21
SpamapSlifeless: I've been told a few times that deferToThread works fine for I/O bound code.22:21
lifelessSpamapS: if you set your thread pool to the needed concurrency.22:21
lifelessSpamapS: and if the other library is concurrency safe.22:22
SpamapSWhih, IMO, is about 5. :-P22:22
lifelessSpamapS: everyone forgets the first point (which for juju would need to be, oh, 10K or something)22:22
SpamapSI am not convinced juju needs the concurrency that twisted affords. :P22:22
* imbrandon saus screw twisted AND go, wrap it all in JS functions that are talking to a rails apps onto of redis cache and mongodb with puts its json api out useing handlebars and backpone templates22:22
* imbrandon runs22:22
SpamapSThus far, everything except the provisioning agent is single threaded in nature.22:23
SpamapSimbrandon: that sounds webscale22:23
imbrandonlol22:23
lifelessSpamapS: status isn't single threaded22:24
SpamapSlifeless: one can argue that anything missing from txaws's implementation of the EC2 API's is a serious bug.. so I could at least present a case for it in an SRU.22:24
lifelessSpamapS: also there is a modelling issue: everything can be *made* single threaded, the question is whether it will perform well enough as such.22:24
imbrandoni am wondering why we are the only ( not counting aws hodge podge of community apps ) that dosent use NODE cli &/or server side for service orchstration22:25
SpamapSlifeless: status just polls the crap out of a *single* zookeeper node.22:25
imbrandonof the ones poping up22:25
imbrandoni mean are they ALL doing it because its new and hot, or did we miss something fundamental22:25
SpamapSlifeless: which is dumb anyway, there should be a daemon keeping a materialized view of status and feeding it back to the clients.22:25
imbrandonSpamapS: there isnt ? i ahvent olooked into what zk does actuially22:26
SpamapSimbrandon: um, because node is crazy crack and we're interested in things that developers exist for now. ;)22:26
* imbrandon is being serious about the zk thing22:26
imbrandonSpamapS: well azure , vmware cf, jitsu, appfog, and a few others in production now all use node apps. i was half ass joking but there is a bit of truth to it somehere just not sure where yet22:27
imbrandoni'm guessing they are all just hipster cept MS, and MS just accidently picked wrong anyhow22:28
imbrandon:)22:28
SpamapSI wouldn't call node a wrong choice at this point..22:28
SpamapSjust that its getting more play than it should because it is the new concurrency shiny22:28
imbrandonhahah yea, that was purely ment funny :)22:28
SpamapSApparently we prefer the slightly less popular and less new concurrency shiny of Go :)22:29
imbrandonyou know, i have been slow and skeptical too beleave it or not on node, but i'm thinking that theere is not only alot of truith to it but there will be alot of crap code like php 3 years ago cuz everyene writes js and its not showen yet, but really its the # 2 of 3 next to nginx magic22:30
imbrandonsure apache can preform the same as nginx on pure http when both are tuned but you know22:30
SpamapSlifeless: anyway, re the txaws thing missing ipAddress.. my answer is yes, I think we can SRU that.22:30
SpamapShad I known such a nice little change had made it into trunk before 12.04's release, I'd have made an effort to update it22:31
imbrandonthat apchache cant do what nginx can at the same speed just out of design, tuned or not, http purely, yea likely22:31
SpamapSimbrandon: the concept of a language w/ 1st class concurrency that also directly serves its network requests is fantastic. JS is widely "known".. but the way to write good client side javascript is vastly different than the way to write good server side code.22:33
imbrandonnow what i'm still tring to figure out is if its REDIS persistant keystore or MONGO thats the #3 in the trifecta of the next tech age ( you knoe, about 2.5 years )22:33
lifelessSpamapS: status talks to all the zk nodes22:33
imbrandonbut nginx and node are 2 of 3, and i'm thinking its gonna be redis but its just not show its self yet22:33
lifelessSpamapS: I know there is only one today, but check the code.22:33
imbrandonSpamapS: i whole heartly agree with you22:34
imbrandonthere22:34
SpamapSlifeless: I understand its micro-optimized for that, but at what cost when we could actually have a perfectly up to date single materialized view and never poll zk?22:35
imbrandoninfact very very much so and you actually just proved my point tho, look at python and php, same thing python is the better lang by far, php powers 77% of the internet because its what ppl know tho22:35
lifeless-lol-22:35
lifelessRan 3459 tests in 1113.097s22:35
lifelessFAILED (id=0, failures=1377, skips=20)22:35
imbrandonouch22:35
imbrandonvery leet tho22:35
imbrandonerr nah, lett22:35
imbrandonheh22:35
lifelessI ran the tests parallelised, through testrepository. Wham-bang.22:35
SpamapSlifeless: NICE22:36
lifelessSpamapS: looks like they don't use a randomised zk instance, but instead all use a common one.22:36
imbrandonSpamapS: i was actually thinking that the API would silently solve that by it doing just that , as long as it can be kept out of the go core then it could22:37
lifelessSo, you can't run two copies of the test suite at once either.22:37
imbrandonand site keeping a view materialized just lazyloading data22:37
imbrandonsit*22:37
lifelessSpamapS: I'm not sure where the overheads are in status, so I won't comment :). I will say, being able to answer and slice and dice quickly is important in large environments22:37
lifelessSpamapS: and if we can't, we should be able to.22:37
SpamapSimbrandon: yeah, status should only be done via the REST API, and the REST API daemon should keep a constant materialized view of status.22:38
lifelessSpamapS: are you a reviewer ?22:38
lifelessSpamapS: of juju itself?22:38
imbrandonone is ssh spinup / connection, imho it should be one .1ms https call22:38
SpamapSlifeless: I am, of both juju and txaws actually. :)22:38
SpamapSlifeless: tho one needs two +1's for juju22:38
imbrandonSpamapS: exactly :)22:38
lifelessSpamapS: https://code.launchpad.net/~lifeless/juju/trivial/+merge/11175222:39
lifelessSpamapS: do you need anything from me to get such an SRU of txaws done?22:39
imbrandonSpamapS: then we dont care wtf they scred up in the design, trust me a few years with drupal you learn how to manuver around things but not break the rules so upgrades and all thet is still pure :)22:39
imbrandonplays well into this too22:39
SpamapSlifeless: and I agree that concurrency will at some point be necessary for pieces of juju. Twisted just makes it so damn hard to read sometimes, I get irrational about it. ;)22:39
lifelessSpamapS: I'm working on the juju tests for using it now.22:39
lifelessSpamapS: I agree that twisted can be awkward, I actually think inlinecallbacks makes it worse.22:40
SpamapSlifeless: nah I'll open up the bug tasks appropriate22:40
lifelessSpamapS: https://bugs.launchpad.net/juju/+bug/945505 is the bug that triggers the need, tho its not about the change itself.22:40
_mup_Bug #945505: Use ipAddress instead of dnsName now that txaws supports it <juju:New> < https://launchpad.net/bugs/945505 >22:40
lifelessright, thats more like it:22:41
lifelessRan 1979 (-1480) tests in 333.841s (-781.528s)22:41
lifelessFAILED (id=1, failures=27 (-1350), skips=12)22:41
lifeless27 failures ;)22:41
SpamapSlifeless: agreed, inlineCallbacks takes it from a foreign accent to a whole new dialect hundreds of years removed.. like Afrikaans vs. Dutch22:41
imbrandonSpamapS: as it makes sense and dont hold ppl / process up  , ping me for some of the more core-ish stuff i can help with from the outside without stirring too much feathers or the like, i wouldent think so just getting it into the open, anyhow i would like to start dusting off those skills again and put them to use a little and jujuish things seem like the best polace to drum up tasks as its the other part of what i'm doing lately :)22:42
_mup_Bug #1017273 was filed: running the test suite in parallel fails <juju:New> < https://launchpad.net/bugs/1017273 >22:43
SpamapSlifeless: probably easier to just track under bug #94517622:43
_mup_Bug #945176: Support privateIpAddress and ipAddress <txAWS:Fix Released by rye> < https://launchpad.net/bugs/945176 >22:43
lifelessSpamapS: think adding a .testr.conf would be acceptable?22:43
* imbrandon loves having inlinecallbacks and lamdas and closure funcs etc in php now, finally after 100 years we close the gap with JS for parity22:43
SpamapSlifeless: I don't know what .testr.conf is22:44
lifelessSpamapS: oh, I haven't shown you testrepository ?22:44
SpamapSno22:44
* imbrandon looks up22:44
lifelessSpamapS: doh!22:44
imbrandonpublicish where i could learn abit too ?22:44
lifelessSpamapS: ok, uhm, probably want the ppa version - apt-add-repository ppa:testing-cabal22:44
imbrandonor on that side of the IS wall ?22:45
lifelessin a juju source tree, add a .testr.conf like in this bug: https://bugs.launchpad.net/juju/+bug/101727322:45
_mup_Bug #1017273: running the test suite in parallel fails <juju:New> < https://launchpad.net/bugs/1017273 >22:45
lifelessapt-get install testrepository22:45
lifelessthen run22:45
lifelesstestr init; testr run22:45
lifelessthat will seed your repository22:45
SpamapSlifeless: btw, running w/ eatmydata, and on an SSD, its far closer to 2 minutes than 522:45
lifelessfrom there you can do useful things like:22:45
lifelesstestr failing22:45
lifelesstestr slowest22:45
lifelesstestr last22:46
lifelesstestr run --failing22:46
lifeless:!testr slowest22:46
lifelessTest id                                                                                      Runtime (s)22:46
SpamapSits not even really CPU bound half the time, just waiting on ZK22:46
lifeless-------------------------------------------------------------------------------------------  -----------22:46
lifelessjuju.control.tests.test_status.StatusTest.test_subordinate_status_output_no_container        4.90122:46
lifelessjuju.control.tests.test_status.StatusTest.test_subordinate_status_output                     4.84122:46
lifelessjuju.control.tests.test_status.StatusTest.test_collect_filtering                             4.37022:46
lifelessfor instance22:46
lifelessSpamapS: I'm on an SSD :>22:46
lifelesshaven't got eatmydata configured22:46
SpamapSit tends to take about 200s or so for me22:46
SpamapSthere is no "configured" for eatmydata22:47
SpamapS'eatmydata ./test'22:47
SpamapSdisables fsync22:47
SpamapSso ZK no longer blocks on I/O22:47
SpamapSstill it probably won't get much below 3-4 minutes so parallel is a great plan22:47
lifelessSpamapS: yes, thats configuring it; need to remember to do it etc etc.22:47
lifelessand then I can do things like this:22:50
lifelesstestr run --failing22:50
lifeless...22:50
lifelessRan 27 (-1952) tests in 0.949s (-334.093s)22:50
lifelessFAILED (id=2, failures=12 (-15))22:50
imbrandonwhats the ppa ? its missing the ohther bit22:50
lifelessoh, archive or whatever the default is22:50
imbrandonkk22:50
lifelesshttps://code.launchpad.net/~testing-cabal/+archive/archive22:50
* SpamapS tries poor man's parallization by running ./text for each dir in juju/*22:51
lifelesstestrepository builds on subunit22:51
imbrandoncool cool22:51
imbrandonheh22:51
lifelessso anything that can talk subunit (like twisted trial, testtools, zope.testing,... sambas testrunner) can run under it.22:51
imbrandonlazr22:52
imbrandonheh22:52
imbrandoni'm poke at this a bit more, i'm terrible about not knowing the testing proceesure for most langs/frameworks with the exception of phpunit and others i use in php daily and jsunit ( not done much js functional test specificly , mosly covered whith selenium is testing the front end php css html stuff )22:54
SpamapSlifeless: I've marked bug #945176 for SRU to precise ... I'll look at preparing it tomorrow or later tonight (4pm Sunday here for me)22:55
_mup_Bug #945176: Support privateIpAddress and ipAddress <txAWS:Fix Released by rye> <txaws (Ubuntu):Fix Released> <txaws (Ubuntu Precise):New for clint-fewbar> < https://launchpad.net/bugs/945176 >22:55
imbrandoni really should at least get the beasics down for other areas i touch22:55
* SpamapS goes afk to do some real life stuff22:55
imbrandonttyl22:55
imbrandonlook at my nginx hooks when you get pack ( if at all tonight )22:56
imbrandoni'd love a pre-review early opinion as i'm finishing and can easily make changes :)22:56
imbrandonlike a 5 min job, and i'll add a nother beer to the tab i owe ya :)22:56
lifelessSpamapS: hazmat: and this - https://code.launchpad.net/~lifeless/juju/bug-945505/+merge/111754 - addresses my issue with openstack I was whinging about the other day.23:08
lifelessI wonder, what does the openstack + maas combo do for dns integration23:12
lifelessdo we run ldapdns, or point folks laptopdns at the dnsmasq instance for maas ?23:13
lifelesshttp://rbtcollins.wordpress.com/2012/06/25/running-juju-against-a-private-openstack-instance/ for posterity23:25
lifelessand https://code.launchpad.net/~lifeless/juju/testrsupport/+merge/111755, and with that, I'm context switching23:42

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!