/srv/irclogs.ubuntu.com/2015/03/05/#juju-dev.txt

alexisbanastasiamac, wallyworld is holding me up ;)00:01
alexisbI will be there soon00:01
anastasiamacalexisb: np - gives me more time to get ready00:01
katcothumper: wow, i am never visiting NZ. bleck: http://www.buzzfeed.com/nicholaswray/nz-sux#.lweRbQN7Zl00:09
thumperkatco: yeah, it is terrible here00:18
sinzuifwereade, et al, the run-unit-test script will now retry tagging ec2 instances so that you will see fewer failures setting up in git-merge-juju00:20
thumperfwereade: the bot hates you00:21
fwereadethumper, doesn't it just00:22
thumperfwereade: wanna chat?00:22
fwereadethumper, although I love it, because one time it was doing its job and preventing me from checking in shite00:22
fwereadethumper, just a quick one, don't want to distract myself too much ;)00:22
alexisbthumper, you beat me too it00:31
alexisbfwereade, I think you need to send the bot some flowers and chocolates00:31
alexisbor maybe some scotch??00:32
fwereadealexisb, for sure :)00:32
alexisbalrighty all, I am off to pick-up kiddo will be back tonight00:32
thumperfwereade: I see it merged00:59
fwereadethumper, one of them :)01:02
wallyworldaxw: one thing i forgot to mention in standup - tests on windows are broken because of various reasons, one of which is the loop stuff02:23
axwwallyworld: ah, doh :(02:23
axwI have no Windows machine ...02:23
wallyworldi thought about it ages ago and then forgot02:23
wallyworldyeah, i'll add a build directive02:23
wallyworldaxw: actually, looking at the code again, i recall we abstracted out all the *nix specific stuff in tests behind stubs/mocks, i think it's just filepath stuff that breaks things02:31
axwwallyworld: is there a windows build job whose output I can look at?02:31
wallyworldyeah, that's where i'm heading now, i believe there is02:31
mupBug #1428430 was filed: AllWatcher does not remove last closed port for a unit, last removed service config <api> <juju-core:Triaged> <https://launchpad.net/bugs/1428430>02:35
ericsnow_menn0: would you mind taking another look at http://reviews.vapour.ws/r/1060/02:50
menn0ericsnow_: looking02:52
=== ericsnow_ is now known as ericsnow
ericsnowmenn0: thanks!02:53
wallyworldaxw: only 2 failing tests :-) trivial http://pastebin.ubuntu.com/10534173/02:56
axwwallyworld: cool02:56
wallyworldi'll fix (without windows machine but should be ok :-)02:57
alexisbwallyworld, there is detailed instructions on the cloudbase site for testing windows workloads with juju02:58
alexisblet me get the link02:58
alexisbhttp://wiki.cloudbase.it/juju-testing02:59
alexisbcmars, jam leads call?03:01
menn0ericsnow: looking good to me. have you done some manual tests against actual systems with different init systems to make sure this all works?03:06
ericsnowmenn0: my local system (upstart) and a vm running systemd03:06
menn0ericsnow: ok cool. then ship it.03:06
menn0ericsnow: there's just one thing I raised (more an idea than an issue)03:07
ericsnowmenn0: I had considered it (reusing identifyExecutable), but wasn't convinced it would always be the same03:08
mupBug #1428439 was filed: retry-provisioning launches instances for containers; cannot retry containers at all <juju-core:Triaged> <https://launchpad.net/bugs/1428439>03:08
menn0ericsnow: yeah, that's why I suggested it with some uncertaintity03:09
menn0ericsnow: just leave it03:09
ericsnowmenn0: k03:09
ericsnowmenn0: thanks for the reviews03:10
menn0ericsnow: np03:11
anastasiamacaxw: wallyworld: https://github.com/go-amz/amz/pull/3404:20
axwanastasiamac: looking04:23
dimiternnow that's much better - from 58 PRs down to 3804:30
* thumper is done04:31
thumperlaters04:31
anastasiamacaxw: wallyworld: tyvm for review :D all updated but I do not have merge rights on goamz...04:42
wallyworldnp, i can do it04:43
wallyworldanastasiamac: merged04:43
wallyworldone more branch to go04:43
wallyworldaxw: did you have anything to say wrt that maas doc the other day?04:44
axwwallyworld: I added comments already04:45
wallyworldah, ty. i need to learn how to use refreah i think04:45
axwwallyworld: essentially, LGTM.04:45
wallyworldgreat04:45
anastasiamacwallyworld:  when u say "1 more branch",  which one u have in mind? ec2 pricing?04:46
wallyworldanastasiamac: updating the current juju core branch to add instance types, depes, and pricing yeah04:46
anastasiamacwallyworld: k :D04:46
=== kadams54 is now known as kadams54-away
anastasiamacaxw: wallyworld: pricing branch http://reviews.vapour.ws/r/1073/05:13
wallyworldalready looking05:13
anastasiamacwallyworld: i *think* i've fixed bad formatting ...05:13
anastasiamacwallyworld: tabs vs spaces, etc...05:13
wallyworldyep, looks much beter05:14
wallyworldanastasiamac: and there's no cost info for chinese regions?05:16
anastasiamacwallyworld: i could not find any chines prices... maybe they r on chinese site but I do not read chines :(05:17
anastasiamacwallyworld: i have looked at chines site in english but nothing...05:17
anastasiamacchinese*05:18
wallyworldhmmm, i can't see how juju would work in china then as instance selection is broken without cost info from what i can see05:18
anastasiamacdo we have any means of testing ?..05:18
wallyworldnot easily05:19
anastasiamacwallyworld: unless we put 0 for everything?...05:19
wallyworldit's mor ethan just cost, it's also knowing what instance types are available05:19
anastasiamacwallyworld: would it be a separate bug tho? so this PR added frankfurt for bug 1428117 and c4+others for bug 142784005:21
mupBug #1428117: EC2 eu-central-1 region not in provider <juju-core:In Progress by anastasia-macmood> <https://launchpad.net/bugs/1428117>05:21
mupBug #1427840: ec2 provider unaware of c3 types in sa-east-1 <juju-core:In Progress by anastasia-macmood> <https://launchpad.net/bugs/1427840>05:21
wallyworldyeah05:21
wallyworldanastasiamac: fix axw's issue and then ship05:22
wallyworldanastasiamac: chinese instance types http://www.amazonaws.cn/en/ec2/details/05:25
wallyworldso we can add those before shipping05:25
wallyworldset all costs to 0 or something if no cost info can be found05:26
anastasiamacwallyworld: k but what shall i add for price? 0...?05:26
anastasiamacwallyworld: k05:26
wallyworldanastasiamac: school pickup time back later, andrew can check the final branch before landing05:35
anastasiamacwallyworld: school pickup but will try to repropose for axw :D05:35
anastasiamacaxw:wallyworld: btw, i'll try to do the same with USGov region as with  China - just add instance types with 0 cost05:37
=== Murali_ is now known as Murali
jw4per special request by marcoceppi for 1.23 - juju action status now returns multiple matches or all if no prefix is given: OCR PTAL http://reviews.vapour.ws/r/1085/05:49
axwjw4: added some comments06:49
axwwallyworld: responded to your comments on my branch, would appreciate another look when you've got time06:59
anastasiamacaxw: wallyworld is delayed - car broke down :(07:26
axwdoh07:26
anastasiamacaxw: yep :( dunno what's with the car but it's realllly hot here today07:27
mupBug #1425788 changed: multiple definition of http.HandlerFunc <ci> <gccgo> <regression> <test-failure> <juju-core:Fix Released by dimitern> <https://launchpad.net/bugs/1425788>07:42
mupBug #1292536 changed: maas provider apt-get install bridge-utils should  be better <maas-provider> <network> <tech-debt> <juju-core:Fix Released> <https://launchpad.net/bugs/1292536>08:21
mupBug #1377262 changed: please expose network-bridge to manual provider also <cts> <cts-cloud-review> <maas-provider> <network> <juju-core:Won't Fix> <https://launchpad.net/bugs/1377262>08:21
mupBug #1314442 changed: MAAS non-deterministic private-address with non-ethN interfaces <addressability> <canonical-is> <maas-provider> <network> <production> <juju-core:Fix Released> <https://launchpad.net/bugs/1314442>08:51
wallyworldaxw: sorry about delay, car broke, heavy traffic, waited ages for tow truck09:17
axwwallyworld: no worries. that sucks :(09:18
wallyworldyeah, clutch cylinder i think09:18
axwwallyworld: doh, I think anastasiamac may have forgotten to upload her changes before merging09:26
axwother things weren't updated either09:27
wallyworldaxw: yeah, i figured that after seeing another issue that was unresolved09:36
axwanastasiamac: I'm definitely looking at the latest diff on RB09:49
axwI'll check GitHub09:49
anastasiamacwallyworld: axw: my bad - did not push :D09:49
anastasiamacfixing it noww...09:49
anastasiamacaxw: wallyworld: probably cleaner as separate pr?.. :D http://reviews.vapour.ws/r/1087/09:58
axwanastasiamac: LGTM09:59
anastasiamacaxw: :P09:59
anastasiamacaxw: brain-numbing experience over :D tyvm for urs and wallyworld attention to detail!!10:00
axwanastasiamac: :)10:00
axwjam: team meeting, if you want to join10:05
dimiternTheMue, dooferlad_, guys let's do our standup now?10:23
dooferlad_dimitern: sure10:23
=== dooferlad_ is now known as dooferlad
TheMuedimitern: omw10:23
dimiternI'm in the hangout10:24
=== frankban__ is now known as frankban
axwkatco: I'd appreciate another look over my branch in your day, I've responded to your comments - thanks12:29
jw4axw: I assume you're off now, but thanks for the review14:21
jw4TheMue: thanks for your review - do you want to give it one last pass before merging? http://reviews.vapour.ws/r/108514:23
TheMuejw4: sure14:24
TheMuejw4: looks good now14:32
jw4TheMue, ta14:32
TheMuejw4: yw14:32
marcoceppiis the environment UUID per .jenv file or is it per bootstrap?15:02
marcoceppiif i create an environment, bootstrap, destroy, bootstrap again does it have the same UUID?15:02
perrito666natefinch: standup?15:04
natefinchperrito666: oops, lost track of time, thanks15:06
=== ChanServ changed the topic of #juju-dev to: https://juju.ubuntu.com | On-call reviewer: see calendar | Open critical bugs: 1428692
sinzuinatefinch, dimitern (and ericsnow) I reported bug 1428692 about a vivid regression15:39
mupBug #1428692: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:39
ericsnowsinzui: yep, saw that :(15:40
ericsnowsinzui: BTW, sounds like the systemd cutover is scheduled for today15:40
sinzuiericsnow, I did a dist-upgrade on the machine and cleared containers hoping the issue was a stale machine15:40
ericsnowsinzui: so that test would be failing either way15:40
sinzuiericsnow, the test now runs with --debug to get more info too15:41
ericsnowsinzui: unfortunately the logs for the failed job aren't too informative15:41
ericsnowsinzui: --debug will help15:41
ericsnowsinzui: so thanks15:41
perrito666ericsnow: wallyworld natefinch http://ftp.osuosl.org/pub/fosdem//2015/devroom-go/15:45
ericsnowperrito666: cool15:45
perrito666word of advice, your wife will scold you if you try to watch those on the big tv during dinner15:47
sinzuidimitern, you made bug 1428345 high. Which milestone does it go to? 1.23-beta1 or 1.24?15:51
mupBug #1428345: unit-get private-address returns ipv6 address <addressability> <ipv6> <manual-provider> <network> <juju-core:Triaged> <https://launchpad.net/bugs/1428345>15:51
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:51
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:52
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:52
jw4mup, bad boy15:52
mupjw4: Roses are red, violets are blue, and I don't understand what you just said.15:52
dimiternsinzui, hey, yes I did, but it's still getting investigated - so 1.24 I guess15:52
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:52
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:52
sinzuithank you dimitern15:52
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:52
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:53
dimiternmup is heading for an excessive flood quit message15:53
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:53
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:53
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:53
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:54
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:54
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:54
mupBug #1428692 changed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:55
mupBug #1428692 was filed: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:55
perrito666dimitern: mup is heading for a kick in the head15:55
perrito666I am not sure what is triggering those, when I see the bug there seems to be no changes15:55
dimiternmup, shut up15:58
mupdimitern: I really wish I understood what you're trying to do.15:58
dimiternperrito666, it's seeing somebody (itself) mentioning bug # and goes15:59
dimiternbug 142869215:59
mupBug #1428692: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>15:59
ericsnowmup is taunting me15:59
dimiternlol15:59
ericsnowmup, sit15:59
mupericsnow: Unknown commands are unknown.15:59
ericsnowmup, stay15:59
mupericsnow: In-com-pre-hen-si-ble-ness.15:59
perrito666dimitern: most bots have a feat not to listen to themselves16:00
dimiternperrito666, yeah, but this one is written in erlang ;)16:02
perrito666dimitern: I thought this thing was written in go16:03
perrito666or I missed a joke there16:03
dimiternperrito666, https://launchpad.net/mup16:03
dimitern:) no joke - it's a dead serious language lol16:04
* TheMue reads Erlang?16:05
TheMuedidn't know that it's written in a cool language16:06
perrito666dimitern: https://github.com/go-mup/mup16:06
perrito666TheMue: erlang is a fine language, if you are an ericsson telephone central16:07
katcomup used to be written in erlang, niemeyer ported it to go16:07
TheMueperrito666: or a couchdb or rabbitmq or ejabberd develoepr (and many more)16:07
Spadsno, couchdb developers did not really know erlang16:07
dimitern:D16:08
TheMuemaybe, never looked into the couch details16:09
perrito666TheMue: I agree there are many things written in erlang, yet its not cool in all contexts :p16:12
TheMueperrito666: would write a mobile game app with it, yes16:12
TheMueperrito666: but for something like juju it would be fine16:13
niemeyerperrito666, dimitern, TheMue, katco, ericsnow: Sorry for the trouble.. Launchpad seems to be giving inconsistent results, likely as a side effect of caching+balancing16:13
niemeyerIt's not listening to itself, though.. note the filed/changed/filed/changed/etc16:14
TheMueniemeyer: mup simply has been lonely and wanted to talk to us16:14
perrito666niemeyer: you took the trouble to write the thing, no need to apologize, we are just curious on what was the cause16:14
dimiternniemeyer, ah, I thought something more sinister was happening :)16:14
katcoTheMue: i like that explanation :)16:14
niemeyerI will increase the delay between updates, to give time for Launchpad to update its internal cache16:15
perrito666I see you are hitting the same change in different caches each time, that is  an odd thing for launchpad to do16:16
=== urulama is now known as urulama__
dimiternsinzui, is it possible to change http://bazaar.launchpad.net/~juju-qa/juju-ci-tools/trunk/view/head:/jujupy.py#L284 so it calls subprocess.check_output(args, env=env) instead of check_call ?16:55
sinzuidimitern, no because we already have get_juju_output() whcih does that. what callsite needs to look at the output?16:57
dimiternsinzui, well, looking at that vivid failure it's hard to understand whether "Operation failed: No such file or directory" comes from juju bootstrap's output or something else16:58
dimiternsinzui, for example, it could be coming from dump_env_logs in the except BaseException as e: block below17:00
dimiternsinzui, no, actually not that block, but the previous try that ends with a raise17:01
sinzuidimitern, I don't think your going to see more information by switching which method we call. We are seeing the stdout and stderr in the console log already. The output captured would be the same as we are seeing now17:06
dimiternsinzui, I guess so17:08
sinzuidimitern, I am going to run this my hand on the machine to see if I get something more17:08
dimiternsinzui, thanks!17:09
dimiternsinzui, while you're there can you check if it runs out of disk space (or mongo runs out of the prealloc block)?17:10
dimiternsinzui, it just *smells* like a mongo issue - i've just noticed juju-mongodb in vivid is /usr/lib/juju/bin/mongod --version: "db version v2.4.10\nThu Mar  5 15:00:16.736 git version: nogitversion\n"17:15
dimiternsinzui, while in the cloud-tools, in trusty and pretty much everywhere we run and test with officially it's 2.4.9-0ubuntu317:16
aisraelsinzui: FYI, this bug doesn't seem to be fixed: https://bugs.launchpad.net/juju-core/+bug/142406917:17
mupBug #1424069: juju resolve doesn't recognize error state <resolved> <juju-core:Fix Released> <https://launchpad.net/bugs/1424069>17:17
sinzuidimitern, sorry this is taking longer. I just verified other juju do work on the machine. Mongo doesn't seem to be a factor with 1.21 and 1.2217:24
dimiternsinzui, is it the same version?17:28
sinzuidimitern, yes, there is only one mongod on the host17:28
dimiternsinzui, and where is that one ("gitnorevision"?) coming from17:29
sinzuidimitern, I don't know.17:29
sinzuidimitern, we are testing a package we built else where on the vivid machine. the machine was dist-upgraded to get the current packages, of which juju-db will be selected17:30
dimiternsinzui, ok, so this is the first time we're actually testing with that version of mongo?17:32
sinzuidimitern, I think so. I see juju-mongodb at 2.4.10-0ubuntu117:34
sinzuidimitern, this is the log from the manual run https://bugs.launchpad.net/juju-core/+bug/1428692/+attachment/4335369/+files/vivid-bootstrap.log17:38
mupBug #1428692: cannot boostrap vivid: Operation failed: No such file or directory <ci> <local-provider> <regression> <vivid> <juju-core:Triaged> <https://launchpad.net/bugs/1428692>17:38
dimiternsinzui, ok, looking - thanks!17:38
sinzuidimitern, though the bootstrap failed, the mongod is still up. Is there anything you want me to do to interrogate it?17:40
dimiternsinzui, I'd appreciate you can paste cloud-init-output.log and /var/log/syslog where mongo logs a lot17:40
=== kadams54 is now known as kadams54-away
dimiternsinzui, or if there's nothing mongo related in syslog, then /var/log/mongodb/mongod.log if it exists17:42
sinzuidimitern, this is the cloud-init-output.log https://pastebin.canonical.com/127005/17:44
dimiternok, thanks again17:44
dimiternsinzui, that's how it ends? well, we'll need to look at /var/log/cloud-init.log then just in case - it should say "cloud-init ver finished" etc.17:45
sinzuidimitern, I don't see that. remember that this is a localhost17:46
dimiternsinzui, ah, right17:46
dimiternsinzui, so then it's not strange17:47
dimiternsinzui, and you can confirm the machine is not out of disk space, right?17:48
=== kadams54-away is now known as kadams54
sinzuidimitern, 26G free17:49
dimiternsinzui, ok, good17:49
sinzuidimitern, there are no logs for the mongo in the juju home dir or in /var/log17:52
dimiternsinzui, and you said it's still running?17:53
dimiternsinzui, is it listening on 37017?17:53
sinzuidimitern, I see the pid17:54
sinzuidimitern, I think this is just a zombie left behind from a failed destroy. Juju removed itself from the system, but left the juju-db behind17:59
dimiternsinzui, and there's nothing you say in /var/log/syslog or /var/log/* about mongo?18:00
sinzuidimitern, There are lines in the syslog. I am collecting them18:04
dimiternsinzui, good18:06
sinzuidimitern, this is from my run bootstrapped https://pastebin.canonical.com/127008/18:06
cmarsanyone see map ordering-type failure in firewallerSuite.TestWatchOpenedPorts ?18:07
cmarsgo1.4 here18:07
sinzuiaisrael, okay, I will reopen the bug18:09
mupBug #1424069 was filed: juju resolve doesn't recognize error state <resolved> <juju-core:Triaged> <https://launchpad.net/bugs/1424069>18:10
mupBug #1424069 changed: juju resolve doesn't recognize error state <resolved> <juju-core:Triaged> <https://launchpad.net/bugs/1424069>18:10
mupBug #1424069 was filed: juju resolve doesn't recognize error state <resolved> <juju-core:Triaged> <https://launchpad.net/bugs/1424069>18:11
mupBug #1424069 changed: juju resolve doesn't recognize error state <resolved> <juju-core:Triaged> <https://launchpad.net/bugs/1424069>18:11
mupBug #1424069 was filed: juju resolve doesn't recognize error state <resolved> <juju-core:Triaged> <https://launchpad.net/bugs/1424069>18:11
sinzuicmars, that test doesn't fail on vivid which is using go1.318:11
dimiternsinzui, looking18:13
dimiterncmars, haven't checked recently with 1.418:13
dimiternsinzui, ok so now that's some error in there18:21
dimiternsinzui, did you stop mongod manually?18:25
cmarsdimitern, sinzui should i open a bug? http://paste.ubuntu.com/10541924/18:27
cmarssinzui, here it is: https://bugs.launchpad.net/juju-core/+bug/142878818:30
mupBug #1428788: Probabilistic test failure in firewallerSuite.TestWatchOpenedPorts <juju-core:New> <https://launchpad.net/bugs/1428788>18:30
mupBug #1428788 was filed: Probabilistic test failure in firewallerSuite.TestWatchOpenedPorts <juju-core:New> <https://launchpad.net/bugs/1428788>18:30
dimiterncmars, I seem to recall a bug about this or similarly named test - can you check if there is one already?18:31
cmarsdimitern, looking18:31
cmarsdimitern, i see no obvious matches18:32
sinzuicmars, you can at medium tagged intermittent-failure. CI only saw 1 failure with that test a few days ago on ppc64el gccgo. It was a panic, not an assert failure18:32
cmarssinzui, idk if that's the same thing. does gccgo even scramble map ordering? I forget..18:33
sinzuicmars, it does. it behaves like go1.3's spec18:33
sinzuicmars, but vivid is go 1.3 and we haven't seen tht failure18:33
cmarssinzui, not yet :)18:34
perrito666sinzui: well its a non deterministic failure, I presume that if you constraint enough the memory you will see it18:34
dimiternsinzui, so were there 2 mongod running on that machine? one from juju and another one?18:41
sinzuidimitern, I didn't see one. I only terminated the single pid18:42
sinzuidimitern, remember that we run other jujus that they don't fail18:43
sinzuidimitern, The machine is very idle right now I can run the job again18:44
sinzuidimitern, only one job can use the machine at a time. so it is unlikely for another to be up. if one was, the call to destroy-environment --force would remove it. That is what I called to ensure the mongo was removed18:45
* sinzui rebuilds and inspects which procs are left behind18:48
dimiternsinzui, ok, seems all in order then18:48
dimiternsinzui, I mean it's not mongo most likely, but I was really suspicious due to the version and some bug reports for 2.4.10 I've read :)18:49
sinzuidimitern, we got the expected failure and I can see a mongo was left behind18:49
dimiternsinzui, was that mongo there before the bootstrap?18:51
sinzuino18:52
sinzuii dimitern it was just created and left behind by the juju. it claims to have destroyed the env, but it did not18:52
sinzuidimitern, all tests start with destroy-environment --force to be sure the env is clean18:53
sinzuidimitern, I am setting up an upgrade test on the machine that will show you that other jujus are happy18:53
dimiternsinzui, ok, sounds good18:59
niemeyerperrito666, dimitern, TheMue, katco, ericsnow: The delay was updated.. please let me know if you see any other issues19:05
ericsnowniemeyer: k, thanks19:06
katconiemeyer: ty!19:06
perrito666niemeyer: thanks a lot, sorry for the complaining19:06
niemeyerperrito666: No worries, and totally justified19:06
TheMueniemeyer: thanks for update, and never has been meant as complain19:13
ericsnowanyone PTAL (revert vivid-breaking merge): http://reviews.vapour.ws/r/1090/19:14
sinzuidimitern, good news of sorts. http://juju-ci.vapour.ws:8080/job/local-upgrade-vivid-amd64/3/ shows other juju bootstrap, but we cannot upgrade. Since we had a server running. we got logs19:18
natefinchericsnow: ship it19:23
ericsnownatefinch: thanks19:23
natefinchericsnow: I just skimmed it... it 's just a revert, so I trust that there shouldn't be much to go wrong.  .... which makes me wish there was a tool that could just look at this and say "yep, this is just a revert of that other change".19:24
dimiternsinzui, great!19:24
dimiternsinzui, I'll have a look tomorrow though - it was a rather long day19:24
sinzuithank you for your time dimitern19:24
dimiternnot at all :)19:25
perrito666natefinch: it would be nice if we could get the bot to trigger reverts from github19:25
perrito666with a $$unmerge$$ or smth like that19:26
natefinchperrito666: that's brilliant19:26
natefinchBtw, for those interested, Brian Kernighan (the K in K&R's C Programming) is writing a book on Go: http://www.amazon.com/Programming-Language-Addison-Wesley-Professional-Computing/dp/0134190440/19:27
mgzperrito666: revert isn't an entirely automatic process, the merge can need manual resolution19:28
perrito666dunno K&D does not soound as cool as K&R :p19:28
mgz(could be done in the common case though)19:29
perrito666mgz: I believe that github only offers it after doing the same analisys that it does for merge19:29
perrito666man, processAgent is an elussive piece of code19:41
ericsnowsinzui: I've landed a revert of what I believe is the merge that broke the vivid test19:45
sinzuithank you ericsnow19:46
ericsnowsinzui: I expect that it will also clear up the issue of the zombie mongod19:46
jw4natefinch, per davecheney command I've pre-ordered the book20:12
perrito666jw4: wow he has such commands? how does it work? is it something like davecheney order book?20:14
=== urulama__ is now known as urulama
jw4perrito666, hahah20:18
natefinchjw4: it'll be good.  K&R's C influenced a generation of programmers.20:23
perrito666natefinch: you do need to bear in mind that is that generation that coded the pieces of code we hate the most :p20:24
=== kadams54 is now known as kadams54-away
=== kadams54-away is now known as kadams54
=== kadams54 is now known as kadams54-away
=== kadams54-away is now known as kadams54
=== kadams54 is now known as kadams54-away
natefinchericsnow: you around?20:47
ericsnownatefinch: yep20:47
natefinch"there was an error displaying this diff": http://reviews.vapour.ws/r/861/diff/#20:47
natefinchIt says to please try again... does that mean like rbt post or something?20:48
* natefinch forgets how to do this stuff manually20:48
* TheMue has to refresh his Go book, it's already 4 years old20:49
natefinchTheMue: there aren't many good choices right now.  There's this upcoming Kernighan one, plus some of the Gophercon people are working on one20:50
jw4TheMue, that's the problem with being an early adopter - all the investment into books when the technology is really young20:50
jw4natefinch, agree about K&$20:51
jw4K&R too20:51
perrito666I wonder if it comes for kindle20:51
natefinchThe Gophercon guys are writing this one: http://www.manning.com/ketelsen/20:51
TheMuejw4: funnily Go hasn't changed a lot since then, only details. but more experience about common patterns20:52
TheMuejw4: and surely the packages20:52
ericsnownatefinch: I've been seeing that more frequently of late20:52
jw4TheMue, yeah20:52
TheMuejw4: and mine is sadly only available in German20:53
ericsnownatefinch: it may be that unicode characters are starting to leak into commits (I've seen RB struggle with unicode)20:53
ericsnownatefinch: but it's probably not that20:53
ericsnownatefinch: did you do a rebase in there somewhere?  that can confuse RB20:53
natefinchericsnow: yes. :/20:53
* natefinch loves teh rebase20:54
ericsnownatefinch: I expect that's it20:54
natefinchI didn't realize reviewboard didn't like it20:54
ericsnownatefinch: it's hit and miss20:54
ericsnownatefinch: I haven't looked into it too hard20:54
jw4I use rebase all the time and haven't had an issue yet...:(20:54
jw4I wonder what the secret ingredient is that triggers RB20:55
ericsnownatefinch: try using rbt -u to update the review request20:55
natefinchericsnow: rbt is asking for authorization... remind me how to do that?20:55
ericsnowI think it's when you rebase and have a conflict that you have to resolve (so history changes)20:55
ericsnownatefinch: it's in docs/contributing/reviewboard...20:56
ericsnownatefinch: I'll look it up20:56
ericsnownatefinch: "username: <github username> password: oauth:<github username>@github"20:57
natefinchericsnow: ok, thanks... I could have looked it up, just forgot where itwas20:57
ericsnownatefinch: no worries20:57
natefinchericsnow: that did it, thanks20:58
ericsnownatefinch: cool, thanks20:58
ericsnownatefinch: I think RB stores the base revision when you first create the request (or the hook does for you)20:59
ericsnownatefinch: I probably just need to fix the hook to be cognizant of changes to the base revision20:59
jw4ericsnow, ah, that sounds like a plausible root cause for the display conflicts after rebasing when the base revision changes significantly21:00
natefinchconflicts?  Son of a....21:00
ericsnowyeah, he said conflicts :)21:01
jw4haha21:01
ericsnowjw4: if it gets to be much of a problem I'll look into fixing the hook21:01
jw4ericsnow, you've done a lot of work to give us nice review tools, thanks21:02
natefinchno no.. sorry, my branch has conflicts with master... in that file that was having problems. That may have been what caused RBT to puke21:02
natefinchericsnow, jw4: +121:02
ericsnownatefinch: ah hah21:02
perrito666go test github.com/juju/juju/cmd/juju/... takes too long21:04
ericsnowperrito666: right up there with replicaset21:05
natefinchman yaml is terrible21:18
perrito666anyone knows where the filtering happens for juju status comand?21:23
perrito666I think I found it21:24
perrito666there is a LOT of unhappy poorly documented unclear code in the filtering21:42
ericsnowsinzui, natefinch: Monday is D-Day: https://lists.ubuntu.com/archives/ubuntu-devel-announce/2015-March/001130.html21:54
sinzuithank you eric21:55
sinzuils  /var/lib/mongodb/22:08
sinzuils  /var/log/mongodb/22:08
sinzuils /etc/default/mongodb22:08
jw4sinzui, wrong window?22:09
sinzuijw4, yes, thank you22:09
jw4lol :)22:09
jw4I thought a ping might help22:09
thumperperrito666: filtering of what?22:11
perrito666thumper: nevermind, tx, I was trying to make sure I had all the right pieces added to BuildPredicate and surounding code22:14
perrito666I did22:14
perrito666that could really benefit from a couple of comments22:14
perrito666ok EOD22:15
perrito666cheers22:15
jw4cheers perrito66622:17
ericsnowcmars: any reason why you have 2 review requests up for mongo logs?22:34
cmarsericsnow, rbt freaked out on me. deleted the first one22:34
ericsnowcmars: I've reviewed your mongod log patch22:59
cmarsericsnow, thanks22:59
ericsnowcmars: np :)22:59
cmarsericsnow, i'm thinking of adding --quiet as well. you could always turn that on with the mongo setParameter command if you needed the replication info23:00
cmarscurrently bootstrapping with that option enabled23:00
ericsnowcmars: or a feature flag <wink>23:00
cmarsericsnow, ooh good point23:00
ericsnowcmars: it could also key of juju's debug level23:01
cmarsericsnow, interesting.. how would I read that?23:02
ericsnowcmars: no clue :)23:02
=== kadams54-away is now known as kadams54
* ericsnow takes off on an errand for a bit23:04
=== ericsnow is now known as ericsnow_on_an_e
=== ericsnow_on_an_e is now known as ericsnow_afk
=== kadams54 is now known as kadams54-away
mupBug #1428893 was opened: agent-state-info: no matching tools available <oil> <juju-core:New> <https://launchpad.net/bugs/1428893>23:44
=== ericsnow_afk is now known as ericsnow
cmarsericsnow, updated 109323:50
ericsnowcmars: LGTM (but I'm not a senior reviewer)23:53
cmarsericsnow, thanks!23:53

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!