/srv/irclogs.ubuntu.com/2016/05/11/#juju-dev.txt

a123yesterday cherylj help me fix a hung jujud process. I'm wonder how to go about debugging that if it happens again. Is there any info that can be extracted by attaching gdb to the pid?00:12
mupBug #1579059 changed: MainSuite.TestFirstRun2xFrom1x fails on windows <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Fix Released by natefinch> <https://launchpad.net/bugs/1579059>00:16
mupBug #1579173 changed: wily configSuite.TestNewModelConfig test failure lxd <blocker> <ci> <lxd> <regression> <test-failure> <unit-tests> <wily> <juju-core:Fix Released by reedobrien> <https://launchpad.net/bugs/1579173>00:16
davecheneya123: https://github.com/juju/juju/wiki/pprof-facility00:22
a123davecheney: great. thanks00:23
davecheneythumper: https://bugs.launchpad.net/juju-core/+bug/158039100:51
mupBug #1580391: juju/errors tests do not pass with go 1.6 <juju-core:New> <https://launchpad.net/bugs/1580391>00:51
davecheneylooks like this never worked00:51
davecheneymaybe I should delete the feature00:51
=== natefinch-afk is now known as natefinch
mupBug #1580391 opened: juju/errors tests do not pass with go 1.6 <juju-core:New> <https://launchpad.net/bugs/1580391>01:01
mupBug #1580391 changed: juju/errors tests do not pass with go 1.6 <juju-core:New> <https://launchpad.net/bugs/1580391>01:11
mupBug #1580391 opened: juju/errors tests do not pass with go 1.6 <juju-core:New> <https://launchpad.net/bugs/1580391>01:17
redir_easy review http://reviews.vapour.ws/r/4800/01:19
davecheneyhttps://bugs.launchpad.net/juju-core/+bug/158040001:21
mupBug #1580400: cmd/juju/charmcmd is untested <juju-core:New> <https://launchpad.net/bugs/1580400>01:21
thumperdavecheney: I can look at errors if you like01:31
mupBug #1580400 opened: cmd/juju/charmcmd is untested <juju-core:New> <https://launchpad.net/bugs/1580400>01:32
mupBug #1580400 changed: cmd/juju/charmcmd is untested <juju-core:New> <https://launchpad.net/bugs/1580400>01:44
mupBug #1580400 opened: cmd/juju/charmcmd is untested <juju-core:New> <https://launchpad.net/bugs/1580400>01:47
thumperdavecheney: it did work...02:21
thumperdavecheney: however, I think I'd rather remove it...02:22
thumperdavecheney: it is a bit bollocks IMO02:22
davecheneythumper: it probably did work02:26
davecheneybut it stopped working a looooooooooooooooong time ago02:26
davecheneyand nobody noticed02:26
thumperwell... 1.202:27
davecheneyyup, so when I said "loooong time ago" and "nobody noticed", those statements are still correct :)02:29
anastasiamacdavecheney: o/02:32
davecheneyanastasiamac: hello!02:33
natefinchdavecheney: what, 1.2 has only been out of date for 23 months02:35
anastasiamac_davecheney: r u coming?02:35
davecheneyanastasiamac_: where ?02:36
natefinchdavecheney: it's not like we can just build a binary that'll work without the right version of go installed02:36
davecheneyanastasiamac_: coming02:36
anastasiamac_davecheney: the meeting u've acepted :D sent u a link into pm02:37
davecheneyanastasiamac_: i'm in the hangout02:37
davecheneynobodyu is talking02:37
mupBug #1580417 opened: Allow a different VPC ID to be used for hosted models <juju-core:Triaged> <https://launchpad.net/bugs/1580417>02:50
mwhudsoni don't *think* i want to put go 1.2 in my ~gophers ppa :)03:00
davecheneymwhudson: that'll be a paddling03:08
axwwallyworld: we need yet another endpoint in clouds.yaml: https://bugs.launchpad.net/juju-core/+bug/158042303:13
mupBug #1580423: provider/azure: add identity endpoint to clouds.yaml <juju-core:Triaged> <https://launchpad.net/bugs/1580423>03:13
mupBug #1580423 opened: provider/azure: add identity endpoint to clouds.yaml <juju-core:Triaged> <https://launchpad.net/bugs/1580423>03:20
=== rodlogic is now known as Guest70790
wallyworldaxw: osrry, missed ping, yeah saw bug05:29
mupBug #1580418 opened: Cached local charms should be deleted when their service is removed <juju-core:In Progress by wallyworld> <juju-core 1.25:In Progress by wallyworld> <https://launchpad.net/bugs/1580418>05:30
davecheneythumper https://github.com/juju/errors/pull/2505:49
menn0davecheney, wallyworld or axw: easy fix for one of the blockers: http://reviews.vapour.ws/r/4804/diff/05:57
menn0took me ages to get my windows VM working again to be able to repro it though05:57
menn0and quite a while to confirm the problem05:57
wallyworldlgtm05:57
wallyworldthanks :-)05:57
menn0wallyworld, axw: that was fast. thanks :)05:58
axwnp05:58
=== rodlogic is now known as Guest52700
=== frankban|afk is now known as frankban
axwmenn0 fwereade_: tech board08:01
voidspacehmmmm... when I install XChat-Gnome it still has the config from the lost XChat08:10
voidspacealthough under Xenial XChat-Gnome looks even worse than XChat did08:10
frobwarejam: ping08:11
jamfrobware: pong08:12
frobwarejam: want to sync after standup?08:12
jamfrobware: sure08:12
* frobware notes that swap days do lead to a huge accumulation of unread email...08:14
mupBug #1580485 opened: juju/tools/lxdclient: TestUsingTCP and TestUsingRemoteTCP not isolated from the host and failing <lxd> <test-failure> <unit-tests> <juju-core:New> <https://launchpad.net/bugs/1580485>08:24
thumpervoidspace: ping08:29
dimiternthumper: o/08:30
dimiternthumper: is this even implemented: `juju add-user --share model username` ?08:31
dimiternerror: flag provided but not defined: --share08:31
dimiternhmm apparently not08:32
voidspacethumper: pong08:37
thumperdimitern: something like that should work08:41
mupBug #1580497 opened: juju2 on maas permanent " connection is shut down" msg and loss of connection <juju-core:New> <https://launchpad.net/bugs/1580497>08:54
mupBug #1580501 opened: cloudimg-base-url parameters not in Juju2 anymore <juju-core:New> <https://launchpad.net/bugs/1580501>08:54
=== rodlogic is now known as Guest73940
voidspacedimitern: babbageclunk: frobware: last of the test changes for AllocateContainerAddresses08:56
voidspacehttp://reviews.vapour.ws/r/4805/08:56
voidspacea nice easy one to review :-)08:56
dimiternthumper: I figured it out - first `juju add-user --models admin --acl read bob Bob` then running the suggested `juju register ...`08:58
dimiternvoidspace: looking08:58
hoenir:w09:01
voidspacedimitern: standup?09:02
dimiternthe plot thickens: ERROR storing charm for URL "cs:ubuntu-0": delegatable macaroon is not obtainable using admin credentials09:02
dimiternvoidspace: omw, sorry09:02
axwjam thumper fwereade_ menn0: just stumbled across http://opentracing.io/09:04
axwlooks interesting, I'll dig a bit09:04
menn0axw: that does look interesting09:05
dimiternvoidspace: reviewed09:12
voidspacedimitern: thanks09:12
frobwarejam: standup running over09:34
jamfrobware: k09:35
jamnot unexpected :)09:35
TheMuemorning09:41
jamaxw: interesting. though looking at it only 3 actual implementations and 2 of those are private09:53
jamaxw: appdash has direct support, and zipking has private support, lightstep has a private beta09:53
=== akhavr1 is now known as akhavr
frobwarejam: I can see you on the hangout, not sure if you can hear me though.10:31
=== akhavr1 is now known as akhavr
* dimitern is loving the $JUJU_HOME/aliases support!10:42
dimiternjuju bootstrap dimitern aws/us-east-1 --upload-tools -> juju bud aws/us-east-110:43
babbageclunkfrobware: I meant to ask, now you're back - any idea why I get -ve times from strace -cf?10:51
babbageclunkfrobware: http://pastebin.ubuntu.com/16357965/10:51
=== akhavr1 is now known as akhavr
=== rodlogic is now known as Guest74633
babbageclunkdooferlad: ha, running the tests with tmpfs is heaps faster, unsurprisingly - the expensive bits in mongo 3.2 (index creation and DB teardown) are only 10x as slow then.11:30
dooferladbabbageclunk: :-)11:31
hoenircould anyone review my pr ? http://reviews.vapour.ws/r/4809/11:46
=== rodlogic is now known as Guest32358
=== akhavr1 is now known as akhavr
alexisbjam, fwereade__, frobware, cherylj ping12:31
jamalexisb: omw12:32
=== akhavr1 is now known as akhavr
babbageclunkhoenir: hi - I'm looking at it12:48
=== rodlogic is now known as Guest63806
mupBug #1276444 changed: juju switch -l should look at jenv files to add to available environments <switch> <juju-core:Invalid> <juju-core 1.25:Triaged> <https://launchpad.net/bugs/1276444>13:25
mupBug #1282217 changed: Specifying bootstrap-host requires editing environments.yaml <bootstrap> <ci> <manual-provider> <juju-core:Fix Released> <https://launchpad.net/bugs/1282217>13:25
mupBug #1276444 opened: juju switch -l should look at jenv files to add to available environments <switch> <juju-core:Invalid> <juju-core 1.25:Triaged> <https://launchpad.net/bugs/1276444>13:34
mupBug #1282217 opened: Specifying bootstrap-host requires editing environments.yaml <bootstrap> <ci> <manual-provider> <juju-core:Fix Released> <https://launchpad.net/bugs/1282217>13:34
mupBug # changed: 1276444, 1282217, 1564511, 158031413:37
babbageclunkhoenir: reviewed13:38
mupBug #1564511 opened: cmd/jujud/reboot tests fail with lxd container running <blocker> <ci> <regression> <s390x> <tech-debt> <test-failure> <unit-tests> <xenial> <juju-core:Fix Released by cox-katherine-e> <https://launchpad.net/bugs/1564511>13:40
mupBug #1580314 opened: MainSuite.TestFirstRun2xFrom1xOnUbuntu Exec function not called on windows <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Fix Released by menno.smits> <https://launchpad.net/bugs/1580314>13:40
hoenirbabbageclunk, thanks, found a bug , need to work on it more13:45
mupBug #1564511 changed: cmd/jujud/reboot tests fail with lxd container running <blocker> <ci> <regression> <s390x> <tech-debt> <test-failure> <unit-tests> <xenial> <juju-core:Fix Released by cox-katherine-e> <https://launchpad.net/bugs/1564511>13:55
mupBug #1580314 changed: MainSuite.TestFirstRun2xFrom1xOnUbuntu Exec function not called on windows <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Fix Released by menno.smits> <https://launchpad.net/bugs/1580314>13:55
alexisbkatco, morning13:57
katcoalexisb: morning13:57
alexisbkatco, I need someone to pickup this bug today: https://bugs.launchpad.net/juju-core/+bug/158018413:58
mupBug #1580184: Timeout in github.com/juju/juju/apiserver/service on windows <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1580184>13:58
katcoalexisb: ack. we'll see who's doing what and get it done13:58
alexisbkatco, thank you13:58
katcoalexisb: np13:58
=== rodlogic is now known as Guest68017
natefinchfwereade__: interesting thought.... is there a way to list all machines from all models on a controller?14:25
natefinchfwereade__: just got an AWS alert for high usage, and wanted to see how many machines I was using from my aws controller14:26
=== akhavr1 is now known as akhavr
mupBug #1580626 opened: provider/openstack: Don't use a hard-coded clock.WallClock in deleteSecurityGroup <tech-debt> <testing> <juju-core:Triaged> <https://launchpad.net/bugs/1580626>14:43
alexisbperrito666, ping15:14
perrito666alexisb: pong15:14
alexisbheya perrito666 I am available early for our 1x1 if you are also available15:15
perrito666I am15:15
perrito666usual channel?15:15
alexisbyep15:16
perrito666already there15:16
redir_natefinch: any pointers on how to reproduce races?15:31
natefinchredir_: go test -race ? :)15:32
natefinchredir_: link me to the bug?15:32
redir_natefinch: https://bugs.launchpad.net/juju-core/+bug/158018615:35
mupBug #1580186: Race in github.com/juju/juju/worker/instancepoller/aggregate_test.go <blocker> <ci> <intermittent-failure> <race-condition> <regression> <unit-tests> <juju-core:In Progress by reedobrien> <https://launchpad.net/bugs/1580186>15:35
redir_natefinch: they seem to hit it on every CI run, but I can't make it happen here.15:36
redir_bbiab15:36
natefinchredir_: k15:36
=== akhavr1 is now known as akhavr
katcofwereade__: hey sorry, i have to move on from that PR and pick up another blocker. i'll circle back when/if i get some free time15:50
alexisbnatefinch, just fyi, for the blocker bug you picked up... if you need a repo case sinzui would be happy to provide access to the machine where the test is failing consistently15:53
natefinchalexisb: consistent repros are my favorite thing in the world15:53
alexisb:)15:54
=== akhavr1 is now known as akhavr
katcoericsnow: hey i'm ocr today. what was the impetus for http://reviews.vapour.ws/r/4812/ ?16:12
katcoericsnow: looks like maybe so we can stop consuming the loggo package just for a testing utility?16:13
ericsnowkatco: it's a precursor I had kicking around for a follow-up cleanup patch (itself to be followed by a patch that may be useful for the syslog work)16:14
katcoericsnow: ahh16:14
katcoericsnow: well looks like you have a shipit at any rate16:14
perrito666bbl16:14
ericsnowkatco: trying to avoid moving code around in the same patch where I change stuff :)16:14
katcoericsnow: excellent idea :)16:14
natefinchkatco: would like a review on http://reviews.vapour.ws/r/4801/ if you get a chance16:24
katconatefinch: tal16:24
=== frankban is now known as frankban|afk
katcoericsnow: errr... not even sure my comment to you went through, but if so, it looks like it was a connection issue on my end17:04
ericsnowkatco: apparently it didn't go through as I don't know what you're talking about :)17:05
katcoericsnow: ha. i was complaining that review board was acting up again17:05
ericsnowkatco: great :(17:05
katcoericsnow: then my irc bouncer kicked me from all the channels at once and i wised up :)17:05
katcoericsnow: no, like i said i'm pretty sure it was just a connection problem on my end17:06
ericsnowkatco: oh, phew :)17:06
katconatefinch: you have a review. mostly just some questions17:11
natefinchkatco: cool, thanks17:11
mupBug #1580714 opened: ubuntu user not in 'lxd' group on xenial instances <juju-core:Triaged> <https://launchpad.net/bugs/1580714>17:53
mupBug #1580717 opened: Juju agent stuck in pending if charm storage's minimum-size exceeds available disk space on machine <juju-core:New> <https://launchpad.net/bugs/1580717>18:23
natefinchoh boy, interesting.... package launchpad.net/tomb: cannot download, http://bazaar.launchpad.net/~niemeyer/tomb/trunk/ uses insecure protocol19:27
katconatefinch: i think he moved tomb over to github didn't he?19:35
katconatefinch: https://gopkg.in/tomb.v219:36
natefinchkatco: we still seem to use launchpad.net/tomb somewhere in juju though19:36
katconatefinch: time to standardize :)19:36
natefinchkatco: actually, we don't use the gopkg.in version at all19:37
perrito666we could standardize oooor, we could make a script that uses launchpad, github or gopkg randomly19:39
perrito666super fun to debug19:39
natefinchonly 3 deps in juju on launchpad, and 1 already exists in github....19:39
natefinchniemeyer3: do you know if there's a launchpad-side fix possible for the "package foo: cannot download, uses insecure protocol" error?  Is there something the project owner can do to enable https?19:40
katconatefinch: i believe he is on a plane19:41
natefinchkatco: ahh boo19:41
perrito666katco: well if he can tweet a picture in flight he might very well have irc :p19:42
natefinchlol true19:42
katcoperrito666: that's an excellent point. where are his priorities! ;p19:42
natefinchheh: C:\Users\Administrator\src\github.com\juju\juju\apiserver\service>go test19:44
natefinch2016-05-11 22:44:03 WARNING juju.testing mgo.go:186 failed to start mongo: exec: "/usr/local/bin/mongod": file does not exist19:44
perrito666ahhh how fun19:45
perrito666natefinch: beware, that might be a red herring19:45
perrito666I recall an error somewhere having the path hardcoded even though it was looking in the right place19:45
perrito666but I am pretty sure I fixed all of those19:45
natefinchperrito666: the windows tests require mongo?19:46
perrito666natefinch: some of them19:46
natefinchperrito666: we don't support windows as a controller19:46
perrito666and if you are using the instructions provided by cloudbase you should have it installed19:46
natefinchperrito666: I thought I was, but their instructions either have changed or I was looking at the wrong page19:46
perrito666natefinch: well no, but our unit tests are little unit-ish and need a mongo to try the most elemental things19:47
natefinchperrito666: it really boggles my mind that we don't actually support running mongo on windows or controller code running on windows... but the tests assume it works ok19:47
perrito666natefinch: the tests run a fake controller19:48
perrito666that sort of works19:48
perrito666http://wiki.cloudbase.it/juju-testing19:48
perrito666http://wiki.cloudbase.it/juju-testing#getting_a_ssl_enabled_version_of_mongodexe19:48
natefinch(╯°□°)╯︵ ┻━┻19:48
perrito666to be accurate19:48
natefinchyeah, I was there... I guess I just didn't scroll down all the way before19:48
natefinchman, I can't get any of their powershell to run on this machine... I don't know what I'm doing wrong, if it's a different version of powershell or what19:49
natefinchoops, well, that one was a typo19:50
mupBug #1564577 changed: Add MAAS 2.0 support in Juju 2.0 <juju-core:Fix Released by thumper> <juju-core 1.25:Invalid> <https://launchpad.net/bugs/1564577>20:03
babbageclunkperrito666: ping?20:03
perrito666babbageclunk: sorry was having afternoon tea20:05
perrito666how can I help you?20:05
babbageclunkalexisb said that you knew about Mongo - I'm looking at bug 157329420:06
mupBug #1573294: state tests run 100x slower with mongodb3.2 <juju-release-support> <mongo3> <mongodb> <juju-core:Triaged> <https://launchpad.net/bugs/1573294>20:06
babbageclunkperrito666: just wanted to ask if you had any advice or suggestions.20:06
babbageclunkperrito666: Basically digging into it it seems like everything is slower in Mongo3.2.20:07
perrito666babbageclunk: you have to be kidding me20:08
perrito666what could have changed since early versions of 3 :(20:08
perrito666babbageclunk: that is very sad news, 2.x is EOL20:09
babbageclunkperrito666: Well, from rereading the bug it sounds like it's really the wiredtiger storage engine that's the problem20:10
perrito666babbageclunk: it is, but mmapv1 is also EOL20:11
babbageclunkperrito666: Ah, that was what I was about to ask.20:11
perrito666babbageclunk: it sounds almost as if mongo sucked :p20:11
babbageclunkperrito666: Maybe it's because the tests are essentially sequential, while WT is more tuned for concurrent writes?20:14
perrito666I reached a similar conclusion that the one in the bug, michael was nice enough to put data behind that20:15
bdxis it possible to have multiple lxd hypervisor as resources under one juju lxd controller?20:15
perrito666babbageclunk: that is an interesting theory, I also suggested that the fixed cost of bootstraping stuff in WT was high and since our tests seem to do that a lot that causes the pain20:17
perrito666babbageclunk: I wonder if we can design a few cheap benchmarks to see how can we better use wt?20:18
babbageclunkperrito666: I've hacked out the index creation in the tests, and while that cuts out some of the cost they're still much slower under 3.2.20:18
perrito666mwhudson suggests that he did a deep trace of the db run, do we have numbers of there are the other 10X?20:19
babbageclunkperrito666: I was running it under strace, but that was giving nonsense numbers (negative call times in the child processes).20:22
babbageclunkperrito666: I've hacked up something that can get the same numbers from perf trace, and it lets me split out the syscals in mongo from the ones in our test code.20:22
babbageclunkperrito666: Actually, would you be able to run the strace command for me to see if you get the same weird numbers?20:23
perrito666certainly20:23
perrito666lets go priv20:23
niemeyer3natefinch: Hey20:28
niemeyer3natefinch: Sorry, what's the question again?20:28
natefinchniemeyer3: go get as of 1.5?  definitely 1.6 will refuse to download from launchpad without the -insecure flag, because it goes over http, not https20:29
natefinchniemeyer3: sorry, gotta run, but will read responses.  No rush, just wondering if there was a way for a package author on launchpad to enable https to avoid that problem20:30
mupBug #1564577 opened: Add MAAS 2.0 support in Juju 2.0 <juju-core:Fix Committed by thumper> <juju-core 1.25:Invalid> <https://launchpad.net/bugs/1564577>20:33
niemeyer3natefinch3: ECONTEXT, feel free to reach out when you have time.. o/20:33
redir_katco: http://reviews.vapour.ws/r/4813/21:03
redir_pls21:03
katcoredir_:21:06
katcoredir_: sec21:06
redir_katco: np21:06
redir_easy one too21:06
=== rodlogic is now known as Guest93911
katcoredir_: running into meetings, but i want to give this one more time. something looks fishy here21:24
=== rodlogic is now known as Guest14174
alexisbwallyworld, ping22:01
mupBug #1580184 changed: Timeout in github.com/juju/juju/apiserver/service on windows <blocker> <ci> <regression> <test-failure> <unit-tests> <windows> <juju-core:Fix Released by natefinch> <https://launchpad.net/bugs/1580184>22:18
mupBug #1580802 opened: NoContextWithLock fails on windows because of another process <blocker> <ci> <intermittent-failure> <regression> <unit-tests> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1580802>22:48
axwjam: (bit delayed) yeah, and I tried appdash and its UI is a little underwhelming. I modified jujud to create spans for each API connection, and subspans for each API call that comes in. easy enough, tho it's just a hack. it would be nice to be able to drill into timings for provider API calls too, so we'd probably end up exposing the tracing API to provisioners, firewaller, etc.23:02
=== rodlogic is now known as Guest67947
wallyworldaxw: anastasiamac_: redir_: perrito666: dtuck in meeting, will be a few minutes late23:14
perrito666wallyworld: tis ok, we love you anyway23:15
anastasiamac_wallyworld: ping when u r ready23:15
anastasiamac_so melodramatic perrito666 :-P23:15
wallyworldaxw: anastasiamac_: there now23:20
mwhudsonnatefinch: heh i just ran into https://github.com/coreos/go-systemd/issues/156 (again)23:55

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!