/srv/irclogs.ubuntu.com/2014/01/14/#juju-dev.txt

=== thumper-gym is now known as thumper
mbruzekwaigani on a scale of 1 to 10 how hard was Ubuntu to install on a Mac?02:18
waiganihmmm, not too bad actually. I'd give it a 702:20
waiganithe trackpad sucks though02:20
waiganiselecting, dragging and dropping - I have not sworn sworn so much in a long time!02:21
waiganiI found this very helpful for the install https://help.ubuntu.com/community/MacBookPro11-1/Saucy02:23
dimiternjam, ping07:58
dimiternjam, if you haven't yet started working on bug 1268471 i'd like to pick it up07:59
_mup_Bug #1268471: cache bootstrap address <bootstrap> <juju-core:Triaged by dimitern> <https://launchpad.net/bugs/1268471>07:59
* dimitern is away for 1h08:00
rogpeppeanyone have an idea why my /boot partition might have filled up recently?08:56
axwrogpeppe: usually for me that's because of kernel upgrades, and the old ones being kept around09:01
rogpeppeaxw: yeah, i'd just figured that out, thanks09:01
axware there lots of vmlinuz files?09:01
axwok09:02
jamdimitern: I haven't started it yet09:02
rogpeppeaxw: i've just removed some old vmlinuz and initrd.img files09:02
rogpeppeaxw: hopefully no crucial ones09:02
rogpeppeaxw: i'm assuming that old versions will never be used again09:02
axwrogpeppe: you should probably apt-get remove the packages09:02
rogpeppeaxw: ah09:02
axwremoving the packages updates grub too09:03
axwrogpeppe: linux-image-<version>-generic09:03
axwremove them for whichever ones you deleted :)09:03
rogpeppeaxw: how can i list all the packages i've got installed?09:05
rogpeppeaxw: i'd like to do <list all packages> | grep linux-image, just to make sure i'm doing the right thing09:06
axwrogpeppe: dpkg --get-selections09:06
rogpeppeaxw: ha ha09:06
rogpeppeaxw: you can't do it with apt-get?09:07
rogpeppeaxw: fair enough09:07
axwnot sure actually09:07
rogpeppeaxw: much better! /boot down from 100% to 30%09:10
axw:)09:10
rogpeppeaxw: one might think that the usual upgrade procedure would garbage collect every now and again09:11
rogpeppeaxw: thanks a lot BTW09:12
axwrogpeppe: yeah, though you wouldn't want to upgrade and lose your old kernel if the new one is busted09:12
axwrogpeppe: nps09:12
rogpeppeaxw: yeah, but keeping around 8 versions is probably slightly overkill...09:14
axwI won't argue with that :)09:14
=== vds` is now known as vds
jamaxw: did something change with the test suite that it is trying to read /home/ubuntu/.ssh/authorized_keys ?09:59
jamaxw: https://code.launchpad.net/~rogpeppe/juju-core/479-desired-peer-group/+merge/201245 for the traceback10:00
jamit happens that the machine has an ubuntu user10:00
jambut the test suite is run as "tarmac"10:00
jamso doesn't have rights10:00
axwjam: that'd be the authenticationworker I think10:00
jamand *IMO* shouldn't need them10:00
dimiternjam, rogpeppe, wallyworld_, any idea how to work around this error while bootstrapping? bootstrap failed: cannot find bootstrap tools: XML syntax error on line 9: element <hr> closed by </body>10:00
jamdimitern: wallyworld_ has a patch up for it, but also just "juju bootstrap --upload-tools" which I think you need anyway ?10:01
dimiternjam, oh, silly me, ofc10:01
dimiternthanks10:01
axwjam: so, I'm pretty sure the error there is not due to the lack of access10:01
axwit is very spammy though10:02
jamaxw: [LOG] 31.15149 ERROR juju.worker.authenticationworker reading ssh authorized keys for "machine-0": reading ssh authorised keys file: open /home/ubuntu/.ssh/authorized_keys: permission denied10:02
jamthat may not be why the test suite failed, true10:02
jambut it does look like something is broken in our test infrastructure10:02
jamwhich hides realstuff10:02
axwjam: I don't suppose I can do multiple prereqs on a proposal, can I?10:10
jamaxw: just one10:10
axwrats10:10
jamyou could merge them into another branch and use that as the prereq10:10
axwdoesn't matter, I'll just wait for the others to be approved10:11
axwanyway: hooray, Windows can now bootstrap again (in my sandbox)10:11
rogpeppejam: i just saw that10:42
rogpeppejam: i suspect that something's not setting up things for the fake home correctly10:42
jamrogpeppe: well the tests are run as Tarmac, so it should be reading a different home dir10:43
rogpeppejam: nothing should be trying to read from /home/ubuntu10:43
jamI have the feeling authentication worker has hard-coded "ubuntu" user's .ssh/authorized-keys10:43
rogpeppejam: yeah10:43
axwjam: it could be changed, but I wonder if it should be run at all in tests. I don't think it's a good idea for the test user's authorized_keys to be updated...10:44
rogpeppejam: it doesn't seem to hard code /home/ubuntu actually10:46
rogpeppejam: but even so, it shouldn't be looking at the real home directory10:46
axwthat's a good point10:47
jamstandup10:48
jamfwereade: ^^10:48
mattywfwereade, hi there - the id meeting - I could move it one hour earlier - would that be better?11:26
mgzwallyworld: lp:~gz/juju-core/1.16_ssl_verification_bootstrap_state_1268913 as an idea. would really like to write a test for it, but have few ideas.11:32
natefinchjam, rogpeppe: this might be the problem: 6.8G./test-mgo17294826711:32
rogpeppenatefinch: probably11:32
rogpeppenatefinch: but why is it so big?11:32
wallyworld_mgz: let's see if it works first :-)11:32
natefinchrogpeppe: I don't know. I'm going to try passing --oplog-size and see if I can trim it down. The help says the oplog defaults to 5% of disk space11:33
jamrogpeppe, natefinch: note that I cleaned all of /tmp before we restarted the tarmac bot a couple of hours ago, so that is a 'new' run11:33
jamnatefinch: did you submit that one yourself11:33
jam?11:33
rogpeppenatefinch: oh wow11:33
natefinchjam: that's on my local machine11:33
rogpeppenatefinch: perhaps we could make it zero...11:33
jamrogpeppe: natefinch: mongo defaults are very much about "this will be a mongo machine"11:33
jamwhich is very much against a test suite :)11:33
jamnatefinch: ah, good. I just checked the bot and I swapped the "used" and "available". The bot currently has6.9GBfree11:34
natefinchjam: there's no reason why that can't be plenty.  I'll do some tests locally to see if the op log thing helps.11:35
natefinchjam, rogpeppe: that did it.  oplogSize 100   (100MB) gets the directories down to 387M on my machine11:38
rogpeppenatefinch: cool11:39
jamnatefinch: even 100 is rather large for the test suite. I don't know what we want in practice11:39
rogpeppenatefinch: even 10 would seem like plenty11:39
jammy understanding is you can't resize it11:39
natefinchI'll try 10 and see if anything blows up11:39
jam"The oplog exists internally as a capped collection, so you cannot modify its size in the course of normal operations. "11:40
jamhttp://docs.mongodb.org/manual/tutorial/change-oplog-size/11:40
jamso you can restart mongo to change the size (with some real hacks from what I can see)11:40
jambut you can't just a11:40
jamadjust it on the fly11:40
jamanyway, 10MB should work, but will mean we have to do full syncs more often if a slave gets out of date11:41
jam(more entries in the oplog than it can keep up with)11:41
natefinchthis is just for the tests.... and it seems to run fine with 1011:41
natefinchI feel somewhat morbid with all these error messages about waiting for sockets to die12:03
mgznatefinch: the poor sockets... :)12:06
nate_finchoh USB ethernet adapter.... why do you hate me so?12:18
=== nate_finch is now known as natefinch
frankbanhi juju-core devs, trying to bootstrap an azure env i get this: http://pastebin.ubuntu.com/6750245/ . It might be related to bug 125000712:44
_mup_Bug #1250007: Bootstrapping azure causes memory to fill <amd64> <apport-bug> <saucy> <juju-core:Incomplete> <juju-core (Ubuntu):New> <https://launchpad.net/bugs/1250007>12:44
mgzfrankban: looks like it could be, a recursive error or something12:55
mgzfrankban: you have the stack there, so add some printing and de-incomplete the bug12:56
mgzhm, actually writing config, not printing an error12:56
frankbanmgz: an encoding error writing the jenv?12:57
mgzfrankban: add some debug stuff on top of a local 1.16.5 and find out12:57
natefinchmgz: wonder if azure is bootstrapping a machine that's too small?  512mb RAM or something?13:18
mgznatefinch: the OOM is on the local machine, no?13:22
natefinchmgz: duh.  yeah.  That's weird13:22
mgzas frankban can reproduce it, should be pretty trivial for him to narrow down the issue13:24
frankbanmgz: it seems to affect trunk too: data, err := goyaml.Marshal(info) in configstore/disk/Write seems to never return13:26
dimiternfwereade, ping13:26
mgzfrankban: good, being a branch-only issue would be more annoying13:27
dimiternfwereade, sorry, never mind13:31
frankbanmgz: it seems a failure marshalling  the azure management-certificate14:00
dimitern rogpeppe, jam, fwereade: a quick review? https://codereview.appspot.com/52050043 fixes bug 126847114:01
_mup_Bug #1268471: cache bootstrap address <bootstrap> <juju-core:In Progress by dimitern> <https://launchpad.net/bugs/1268471>14:01
rogpeppedimitern: will look in a mo14:01
dimiternrogpeppe, ta14:01
frankbanmzg, so maybe the bug is in the documentation: https://juju.ubuntu.com/docs/config-azure.html : the management-certificate-path is the pem file, not the cer one.14:12
frankbanmgz: the bootstrap node has been successfully created, but status fails: 2014-01-14 14:10:30 DEBUG juju.state open.go:88 connection failed, will retry: dial tcp 137.117.132.43:37017: connection refused14:12
frankbanmgz: and now it works... it has taken several minutes. thanks for your help mgz14:13
mgzfrankban: presumably because the client OOMed before actually finishing up everything14:13
mgzor... okay, what did you change?14:14
frankbanmgz: nothing, it just takes a lot more time than I was used to with ec2. anyway, the problem I see here are two:1) the documentation is ambiguous and 2) juju explodes very badly if you set up your azure environment with the wrong certificate file14:16
mgzokay, so what did you actually change? the management-certificate setting?14:17
mgzhaving any value that OOMs on serialisation just needs fixing14:17
frankbanmgz: the management-certificate-path setting14:18
mgzfrankban: can you record that in the bug?14:18
frankbanmgz: sure14:18
sinzuihi natefinch. I have some go+win questions that you might help me answer14:19
natefinchsinzui: sure14:22
rogpeppedimitern: argh, i've just discovered that this CL, which should have gone in a month ago, never made it in: https://codereview.appspot.com/37650048/14:22
sinzuinatefinch, I have setup a windows instance to build juju and the installer. There is a arch mismatch though14:23
dimiternrogpeppe, looking14:23
dimiternrogpeppe, ah yes14:23
rogpeppedimitern: i'm sorry, it probably means that the logic in your branch will need looking at again, but i'd like to get it in, if that's ok14:23
sinzuinatefinch, do we need 386? If so can I choose go 1.2 or go 1.1rc3?14:23
smoserhey. is streams.canonical.com supposed to have some data ?14:24
sinzuismoser, not yet14:24
dimiternrogpeppe, get it in, I'll merge the changes and fix mine14:24
rogpeppedimitern: thanks.14:24
sinzuismoser, http://streams.canonical.com/juju will have something soon though14:24
rogpeppedimitern: i was looking at the code and thinking "i'm sure i made this a bit simpler"..14:24
natefinchsinzui: we build 386 for go because it's compatible with both x86 and x64  but the OS bitness doesn't matter14:24
dimiternrogpeppe,  :)14:24
natefinchsinzui: 1.2 should be fine14:25
sinzuifab, thank you natefinch.14:25
smoserk. thanks, sinzui . jamespage ^.14:25
natefinchsinzui: np14:25
smoserjamespage noticeds that it was being hit from his juju.14:25
jamespagesinzui, yeah - I was trying to deploy a saucy charm under the local provider (running on trusty)14:26
jamespage#fail14:26
sinzuijamespage, 1.6.x always checks streams, then fails over to aws. But also note that many charms wont deploy on saucy because they rely on a package from a ppa that doesn't exist.14:27
jamespagesinzui, thats 1.1714:27
jamespagesinzui, this charm should work on saucy14:27
frankbanmgz: commented on bug 125000714:27
_mup_Bug #1250007: Bootstrapping azure causes memory to fill <amd64> <apport-bug> <saucy> <juju-core:Incomplete> <juju-core (Ubuntu):New> <https://launchpad.net/bugs/1250007>14:27
sinzuijamespage, you can always set the tools-metadata-url to the location you expect tools to be found14:28
sinzuijamespage, which cloud? your own?14:28
jamespagesinzui, local provider so yes14:28
dimiternrogpeppe, but you can review mine anyway, at least as it is now maybe?14:29
rogpeppedimitern: yeah, i will14:29
rogpeppedimitern: i am still looking at your CL BTW, and trying to work out how to avoid apiConfigConnect calling prepareAPIInfo. i'm thinking that it's perhaps not quite right that prepareAPIInfo calls Environ.StateInfo, but i haven't quite worked out what it *should* do15:24
dimiternrogpeppe, why avoid calling it?15:27
rogpeppedimitern: firstly, because it's really slow15:27
rogpeppedimitern: secondly, because if we've got an API connection, we can get the most up to date API server addresses by asking the API15:28
dimiternrogpeppe, well, apiConfigConnect calls NewAPIConn, which does the same15:28
rogpeppedimitern: your code is invoking Environ.StateInfo twice, AFAICS15:29
dimiternrogpeppe, yes15:30
dimiternrogpeppe, but it's not really slow if we have the cache15:30
dimiternrogpeppe, it's slow only once initially15:30
rogpeppedimitern: isn't this happening when we *don't* have the cache?15:30
dimiternrogpeppe, I was thinking how to avoid calling it twice but couldn't find a way15:30
rogpeppedimitern: i don't see why apiConfigConnect needs to call NewAPIConn at all15:31
rogpeppedimitern: can't it just call apiOpen directly?15:31
rogpeppedimitern: we're discarding the APIConn type anyway15:32
dimiternrogpeppe, ah, that's a good point15:33
rogpeppedimitern: that old branch of mine has landed, BTW15:35
dimiternrogpeppe, ok, will merge mine15:36
dimiternanother small review anyone? https://codereview.appspot.com/52130043/ - fixes bug 125992515:40
_mup_Bug #1259925: juju destroy-environment does not delete the local charm cache <destroy-environment> <local-provider> <juju-core:In Progress by dimitern> <https://launchpad.net/bugs/1259925>15:40
mgzdimitern: do you need the prereq reviewed first?15:43
dimiternmgz, they're not really related15:43
dimiternmgz, just in the same pipeline, and rogpeppe is already reviewing the prereq15:43
mgzk15:43
mgzI shall assume sanity then15:43
dimitern:) ta15:44
mgzdimitern: revie15:48
mgz-wed15:48
dimiternmgz, cheers!15:48
rogpeppedimitern: reviewed15:49
dimiternrogpeppe, thanks15:49
natefinchrogpeppe: are there tests besides the ones involving git that *always* fail on trusty?15:51
rogpeppenatefinch: i don't *think* so, but i'll just check again.15:52
natefinchrogpeppe: FYI, QA just ran the test suite on trusty and it passed, so you don't have to bend over backwards trying to figure out if it's possible to pass on trusty16:13
rogpeppenatefinch: i'm running the test suite continuously now. so far i've had 2/2 failures16:25
natefinchrogpeppe: that's about the ratio I get on saucy :/16:26
rogpeppenatefinch: one with the juju package failing with "Waiting for sockets to die", the other with that and minunits tests failing with "no reachable servers"16:26
natefinchrogpeppe: yeah, I get those fairly often16:27
marcoceppiHey guys, maas question, where does juju sync-tools put the files on the maas master?16:48
mgzmarcoceppi: in the filestorage thing, which I think boils down to postgres blobs16:49
marcoceppimgz: ack, thanks!16:50
mgzyou can get at them using the maas cli thing... I think the bug with that got fixed16:50
rogpeppenatefinch: 6/6 test failures so far17:16
rogpeppenatefinch: test run times varying between 9 and 20 minutes17:16
natefinchrogpeppe:  yeesh17:17
TheMueTschakka, it passes. *phew* Some more details tomorrow morning and I can push it again. *happy*17:19
rogpeppenatefinch: the juju package fails every time. other packages i've seen fail: worker/minunitsworker state/apiserver/upgraderworker/provisioner17:19
argeshi. Are there simple instructions for 'seeding' a juju maas provider with juju tools? I'm imaginging first i need to mirror the tools directory, then 'juju sync-tools --source <path to tools>'. is there a better way to do this? and how do I mirror the tools easily?17:30
natefinch juju bootstrap --upload-tools should work: http://maas.ubuntu.com/docs/juju-quick-start.html17:32
natefincharges: ^17:32
argesnatefinch: well what i'm asking is, imagine i'm using juju from a machine that has s3 access blocked. how would i get tools on that machine so I can use juju17:33
argesand its a maas enviornment17:33
mgzargs, no there should be simple instructions, but that sort of thing with sync-tools is the right idea17:34
mgz*arges17:35
mgz**kwarges17:35
argesheh17:35
natefinchlol17:35
argesmgz: now the question is. how do I easily mirror juju tools17:35
argeswget -m on the s3 url doesn't work. and I can download specific files, but i don't want to miss anything17:36
argesi also thought of 'juju sync-tools -e lxc' and downloading tools locally, then syncing that to maas (which seems like a hack)17:36
mgzarges: I think --local-dir, then rsync or whatever that to somewhere with maas access, then --source from there should work... but the streams.canonical.com being broken bug prevents me from actually testing that17:39
argesmgz: --local-dir is an argument to which command?17:39
mgzboth to sync-tools17:39
argesoh ok17:39
argesmgz: i think --local-dir is in newer version of juju17:40
argesits not in 1.16.517:41
mgzarges: that seems likely then...17:41
=== andrewsmedina_ is now known as andrewsmedina
mgzyour trick with the local provider seems worth trying, or just getting the tar bits you need from the ec2 bucket and generating the metadata files, which then requires several more commands and is also not well documented, and probably only nice and usable on trunk...17:44
mgzthis stuff has been semi-broken for too long17:44
argesmgz: yea the local provider trick works for now. I'll check out trunk when I have time17:44
rogpeppenatefinch: 10/10 failures so far18:20
natefinchrogpeppe: dang.  I'm 100% fail as well..... trying to figure out what's going on.  Given that a lot of it seems to have to do with the test mongo server, I wonder if I managed to break it in some odd way18:27
natefinchrogpeppe: seems like it's probably one specific problem that is cascading across tests18:30
rogpeppenatefinch: yeah, i think so18:31
rogpeppenatefinch: i suspect some kind of race in mgo, but i dunno really18:31
rogpeppenatefinch: i need to muster up the energy to dive in again, now that i can repro it on my machine for the first time reliably18:31
rogpeppei'm done for the day though18:42
rogpeppeg'night all!18:42
natefinchheh, running go test -race somehow froze my computer18:47
natefinch....twice18:49
natefinchmaybe I'll stop doing that18:49
sinzuiha ha. The windows client for 1.17.1 gives up on the public address and attempts to connect on the private address18:57
natefinchgood luck with that18:59
sinzuiI think this is another day to hit the sauce19:03
natefinchhot sauce?19:03
sinzuinatefinch, beer19:03
sinzuiBefore developing in Windows, I drank 1 beer a month19:03
sinzuiExcept for yesterday's hacking via python and ssh, I drink to numb the pain19:04
natefinchsinzui: yeah, windows is pretty terrible.19:04
natefinchSo, I went to upgrade to trusty, and it runs through the whole huge thing.  At the end it says:19:05
natefinchUpgrade complete19:05
natefinchThe upgrade has completed but there were errors during the upgrade19:05
natefinchprocess.19:05
sinzuinatefinch, The good news is that CI can build the windows installer along with the release tarball. Running the client tests looks like an exercise in adapting bash and *ix=isms19:06
sinzuinatefinch, don't remove any packages19:06
natefinch..... so... am I on trusty?  did it work?  Were the errors fatal?  Do I need to do somtehign to fix them?19:06
sinzuinatefinch, I have found that re-enabling the disabled archives (most still using saucy), then updating again fixes the issues19:07
natefinchsinzui: cool, I'll give that a try.  Still don't get why they think it's ok to just disable a bunch of my archives :/19:07
sinzuinatefinch, yeah, that is a pain. They do it to ensure only the tested/compatible are installed, but as developers, we are crippled. I one let upgrade remove the packages that came from other archives and that caused a chain of breakages.19:09
* sinzui wont do that again19:09
natefinchbrb rebooting19:11
marcoceppidid you guys change the default behavior of destroy-environment from using the -e flag to a list of environments as parameters? Or has that how it's been?19:12
natefinchwell great, now I can't open "software & updates" :/19:13
_thumper_morning19:51
=== _thumper_ is now known as thumper
* thumper sighs19:53
thumperbig email backlog...19:53
natefinchsinzui: lsb_release -a says trusty, but the "About This Computer" window still says 13.04.... is that normal for being on the release branch, or did my mucked up upgrade screw things up?20:25
natefinchsinzui: s/release branch/development branch/20:25
sinzuinatefinch, yes20:25
natefinchsinzui: ok, phew20:26
thumpernatefinch: the about computer package gets updated later20:27
thumpersometimes the login screen will show old version number too20:28
thumperuntil that is updated20:28
natefinchthumper: yeah, it does.  boo.20:28
thumpernatefinch: tests passing?20:28
natefinch.....and that answers the question of whether go test -race still crashes my laptop20:29
thumperhaha20:32
sinzuinatefinch, do you have any incites into this error. I can run the script from powershell over  rdp, but ssh errors on bootstrap command (but not the version command) http://pastebin.ubuntu.com/6752700/21:29
natefinchsinzui: looks like it's looking for the juju home directory, which doesn't exist for some reason21:34
sinzuiJUJU_HOME is defined (at least is in powershell)21:35
* sinzui looks in ssh env21:35
natefinchC:\Users\Administrator\AppData\Roaming\Juju  would be the default21:35
sinzuinatefinch, thank for the clue. It isn't defined when I execute the script via ssh21:37
natefinchsinzui: welcome21:37
natefinchthumper, wallyworld_:  This test consistently fails for me: TestStartInstanceWithDefaultSecurityGroup  (in provider/openstack/live_test.go)21:48
thumpernatefinch: is this run normally with make check?21:57
thumpernatefinch: if so, just passed for m,e21:57
natefinchthumper: not sure what you mean about make check, I just did go test in that directory (also fails when running the full test suite)21:58
thumperok, works for me then21:59
natefinchthumper: weird.  Fails for me every single time22:03
natefinchlive_test.go:248:22:03
natefinch    c.Assert(defaultGroupFound, gc.Equals, useDefault)22:03
natefinch... obtained bool = false22:03
natefinch... expected bool = true22:03
natefinchgotta go22:04
davecheneysinzui: hold on, imma coming22:58

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!