/srv/irclogs.ubuntu.com/2016/09/27/#juju-dev.txt

veebersthumper: this is a quick brain dump re: the version bug I was talking about yesterday: http://pastebin.ubuntu.com/23235882/ note we have 2.0-rc2 available in the steams but starts upgrading to 2.0-rc2.1.00:10
veebersthumper: rats, I realise i'm running late for a thing in town, I'll chase up when I get back :-) sorry to ping and run00:11
thumperwhy is rc2 in streams?00:11
thumperOMG status on beta7 looks terrible compared to now00:11
veebersthumper: I think it's in testing streams, right? http://juju-dist.s3.amazonaws.com/parallel-testing/agents/...00:12
menn0perrito666: figure anything out?00:32
perrito666yes, that today is ... I guess I would translate to clerks day?00:33
perrito666and therefore only open businesses are those tended by their owners00:33
perrito666annyway, deploying to a container as we speak00:33
perrito666also juju deploy cs:mysql --to lxd/0 didnt have the effect I was hoping00:34
veebersthumper: You have a moment to consider the version bug with the details I linked?01:12
veebers(I'm back from lunch now :-) )]01:12
thumperI'm expecting a visitor any minute01:12
thumperbut she isn't staying, just picking soemthing up01:12
thumperI do need to take broken coffee things down to hardly normal01:13
thumperand get another coffee01:13
veebersthumper: ack01:13
thumperhow about a little later in the afternoon?01:13
veebersthumper: hopefully they can repair it quickly. They do have some nice Rockets at southern hospitality that aren't stupidly expensive (for some value of stupid)01:13
veebersthumper: sounds good01:13
thumperrockets are too manual for me01:14
thumperI prefer the push button01:14
thumperbut I do like grinding my own beans01:14
thumperso not too push button01:14
veebersheh :-)01:15
thumperalexisb: changes to the state package since beta 7:  232 files changed, 25849 insertions(+), 13540 deletions(-)01:16
perrito666k ppl, EOD01:17
alexisbthumper, yep02:17
veebersaxw: do you have a couple of moments to spare while I wait for thumper? :-) I'm waiting to further this bug here https://bugs.launchpad.net/juju/+bug/1626784 (which I spoke with you about a couple days back)02:44
mupBug #1626784: upgrade-juju --version increments supplied patch version <juju:Incomplete> <https://launchpad.net/bugs/1626784>02:44
axwveebers: looking02:45
veebersaxw: cheers, this is some follow up thoughts: http://pastebin.ubuntu.com/23235882/ (as mentioned above)02:46
axwveebers: are you using *agent-metadata-url*? tools-metadata-url was renamed to agent-metadata-url. I don't think we handle the old name in juju 2.002:53
* veebers double checks02:54
veebersaxw: ah yes, we're using agent-metadata-url, the log output is out of date, but the command/config used is correct02:55
* veebers updates the logging call02:55
axwveebers: seems to me that you're doing all the right things. I'll try and repro locally02:59
veebersaxw: awesome, thanks. Please take into consideration the details in that pastebin as it was pointed out to me that there was some missing details in the bug report itself03:01
axwveebers: yup03:01
veebers(I will update the bug with those details shortly)03:01
thumperveebers: I'm around for about 10 minutes, then I have to go and collect a child03:07
axwveebers: well, I can repro03:09
axwneed to finish something off then I can come back and have a deeper look03:09
veebersthumper: I bugged axw about it as well. Seems he's able to repro03:17
veebersaxw awesome thanks03:18
* thumper needs to collect kiddo03:21
veebersaxw: please let me know if there is anything I can help with that bug, it's blocking the upgrade tests which we'll need for between rc to rc and onwards03:59
axwveebers: ok, I will look again in a little while and let you know. I think we can take it from here though04:00
veeberssweet04:01
=== rmcall_ is now known as rmcall
axwwow, weather just went from zero to torrential04:51
veebersaxw: just noticed the bug status changed on that, I'm champing at the bit to see what you come up with ;-)05:23
axwveebers: I was just about to comment :)05:23
axwveebers: I'm not sure if I did exactly the same as you, but in my case, after bootstrap it's at version 2.0rc1.1, not 2.0rc105:24
axwveebers: the reason being that the agent stream doesn't include 2.0rc1 agents05:24
veebersaxw: does that .1 carry over to the rc2? (The upgrade attempt is to 2.0-rc2)05:25
axwthen because the controller is custom, it seems to not want to upgrade to a streams version05:25
axwveebers: ^^ haven't gotten to the bottom of that bit yet, but the fact that the server is an unreleased build seems to force uploads05:26
veebersaxw: oh, sorry you're still investigating :-)05:27
axwveebers: https://github.com/juju/juju/pull/632706:11
veebersaxw: sweet, cheers for sorting that :-)06:25
=== frankban|afk is now known as frankban
anastasiamacredir: this si the "main" unreachbale server bug :D https://bugs.launchpad.net/juju/+bug/160576707:41
mupBug #1605767: MachineSuite.TearDownTest no reachable servers <ci> <intermittent-failure> <regression> <unit-tests> <juju:Triaged> <https://launchpad.net/bugs/1605767>07:41
anastasiamac"main" = one of many \o/07:41
macgreagoirdimitern: https://github.com/juju/juju/pull/632807:43
dimiternmacgreagoir: http://paste.ubuntu.com/23239901/07:43
redirmainy07:47
redirfrobware: babbageclunk: https://github.com/juju/juju/pull/6330 PTAL08:26
dimiternfrobware: here's what I have so far: https://github.com/juju/juju/compare/master...dimitern:maas-bridge-some?expand=110:55
rogpeppe1here's some cleanup in the apiserver cert changing code - a little simplification and a test: https://github.com/juju/juju/pull/633111:20
rogpeppe1dimitern: fancy a review?11:20
dimiternrogpeppe1: I'll put it on my list, sure11:21
rogpeppe1dimitern: ta11:21
dimiternrogpeppe1: might take an hour though, as I'm in crit-bug-fix-mode atm :)11:21
rogpeppe1dimitern: np11:21
marcoceppi_o/ just wanted to drop by and share some love. rc1 has been awesome from the UX fixes in juju status throughout11:24
=== marcoceppi_ is now known as marcoceppi
frobwaredimitern: https://github.com/frobware/juju/tree/master-lp162703711:30
frobwaredimitern: unit tests are broken but it now supports '--interfaces-to-bridge' which is space delimited11:31
dimitern`frobware: perfect!11:31
redirbabbageclunk: PTAL https://github.com/juju/juju/pull/633211:36
=== dimitern` is now known as dimitern
dimiternrogpeppe1: you've got a review with 1 comment11:57
macgreagoirdimitern: No rush, just another group https://github.com/juju/juju/pull/633312:00
rogpeppe1dimitern: ta!12:27
=== rogpeppe1 is now known as rogpeppe
redirmgz: yt?12:41
mgzredir: yo?12:44
redirhey mgz are patches in juju/pathces applied only at test time or also at build time for releases?12:53
mgzthey are applied as part of building the tarball12:54
mgzwhich happens as the first stage of the revision test process12:55
mgzand before any unit test runs12:55
mgzand as part of the release12:55
mgzonly time it won't happen is on a dev's machine unless they specifically include it12:56
redirmgz: thanks13:23
redirjam: per our discussion. easy peasy https://github.com/juju/testing/pull/112 PTAL13:23
babbageclunkalexisb: do we need to talk today? I don't think I have anything to talk about.13:51
alexisbbabbageclunk, have you heard back from jhobbs?13:53
rick_h_voidspace: mgz natefinch ping for standup14:00
voidspacerick_h_: crap, sorry - omw14:10
frobwarerick_h_: status update; we are getting closer to a patch we can use / build a binary from but have just run into an issue with aliases.14:32
rick_h_frobware: ok, thanks for the heads up. What's the aliases issue?14:32
frobwarerick_h_: two things; all the bridge script idempotent transformations fail14:33
frobwarerick_h_: second is that the stuff that dimiter has done on the maas side doesn't consider aliases.14:34
frobwarerick_h_: we could dispense with the second (unit test) transformation but would rather not...14:35
frobwarerick_h_: so this issue is new-right-now. thinking about we do about it. bbiab.14:35
babbageclunkalexisb: Only what was on that email - there was something wrong with the test setup, he's rerunning now.14:37
alexisbbabbageclunk, ok, can you send me a mail to your current PR/branch?14:38
babbageclunkalexisb: Sure - sent!14:38
alexisbthanks14:39
babbageclunkalexisb: actually I hadn't sent it then but I have now.14:41
kwmonroehiya, when i bootstrap aws with rc1, i get a machine with 3.5G RAM, when i bootstrap azure with rc1, i get a machine with 1.7G.  is that normal?15:04
kwmonroei ask because once i get up to 10ish machines in a mode, azure slows waaaay down (or rather, juju commands like 'status' and 'models' slow waaay down).15:05
anastasiamacjam: PTAL https://github.com/juju/juju/pull/633415:06
rick_h_kwmonroe: so the instances we get up are based on cpu constraints I think.15:06
rick_h_kwmonroe: we're looking at tweaking them for 2.0 final but not sure yet on the final bit. I'd be surprised if 10 machines though slow down the status/etc.15:07
rick_h_kwmonroe: I'd be curious if it's network lag or something? I mean does it really time slower after reach machine?15:07
natefinchdefinitely 10 machines should be perfectly fine with 1.7G of RAM.  I think, honestly, it's just that the azure machine in general is a much slower machine than what you get from AWS15:11
natefinchazure machines in general are pretty slow, and the AWS machine we get is one of their newer sets.15:11
kwmonroerick_h_: natefinch: mongo (1.2G) + jujud (150M) eat up just about all the rams: http://paste.ubuntu.com/23242577/  and kswapd0 is using 50% of my cpu trying to find swap space (which doesn't exist):15:12
kwmonroeyeah rick_h_, it does time slower after reaching double digit machines...15:13
kwmonroe$ time juju status15:13
kwmonroe...15:13
kwmonroereal15m31.609s15:13
kwmonroeuser0m0.090s15:13
kwmonroesys0m0.050s15:13
rick_h_15 minutes?15:13
natefinchthat's crazy15:14
natefinchbut mongo using that much is pretty unusual too15:14
kwmonroenatefinch: rick_h_:  is there anything i can pull off this controller to make a useful bug report (like why mongo is using so much ram)?  if not, i'm gonna try adding swap space to see if it's slow because it's out of ram, or slow because kswapd0 is eating so much cpu.15:20
rick_h_kwmonroe: not that I'm aware of but if you can replicate it pretty consistently it'd be good to  know what region, deployment, etc you've got going that is causing mongo to chew up like that15:21
kwmonroeack rick_h_, i'll keep an eye out15:21
rick_h_dooferlad: also assigned the other related card your way as I think the two bugs are related and might be useful to keep both in mind.15:27
dooferladrick_h_: thanks15:27
natefinchrick_h_, kwmonroe: we should file a bug, so we can track it.15:30
natefinchno one ever said "man, I wish I hadn't filed that bug" ;)15:31
kwmonroeon it natefinch, i'll spin up a cuople different regions to see how consistent it is15:31
natefinchkwmonroe: awesome, thanks :)15:31
mupBug #1628155 opened: cmd/juju: juju deploy "see also" refers to non-existent command <helptext> <juju-core:New> <https://launchpad.net/bugs/1628155>15:33
=== daniel1 is now known as Odd_Bloke
anastasiamacredir: babbageclunk: do u think that this failure will be improved with ur work? https://bugs.launchpad.net/juju/+bug/162576815:50
mupBug #1625768: github.com/juju/juju/state go test timeout <ci> <intermittent-failure> <regression> <unit-tests> <juju:In Progress by thumper> <https://launchpad.net/bugs/1625768>15:50
babbageclunkanastasiamac: potentially...15:52
rediranastasiamac: PTAL https://github.com/juju/juju/pull/633515:56
frobwarerick_h_: now live testing https://github.com/frobware/juju/tree/master-lp162703715:57
rick_h_frobware: <315:59
anastasiamacredir: lgtm16:07
voidspacedimitern: ping16:13
dimiternvoidspace: pon16:13
dimiterng16:14
voidspace:-)16:14
voidspacedimitern: it's alright, I'm going to think a bit more and maybe come back to you16:14
dimiternvoidspace: sure :)16:14
voidspacedimitern: you still there?16:26
* rick_h_ goes for lunchables16:30
=== hml_ is now known as hml
=== xnox_ is now known as xnox
=== wwitzel3_ is now known as wwitzel3
=== beisner- is now known as beisner
rick_h_dimitern: frobware ping please17:04
frobwarerick_h_: pong17:04
rick_h_frobware: dimitern can you please join https://hangouts.google.com/hangouts/_/canonical.com/rick?authuser=117:05
frobwarerick_h_: omw17:05
=== akhavr1 is now known as akhavr
=== stokachu_ is now known as stokachu
=== wwitzel3_ is now known as wwitzel3
=== aluria` is now known as aluria
=== kragniz1 is now known as kragniz
natefinchrick_h_: I think so?  I'll hack the code to pretend we get this from the service and see what happens.17:23
rick_h_natefinch: k17:23
=== Spads_ is now known as Spads
=== wwitzel3_ is now known as wwitzel3
kwmonroeanyone know much about azure that could hop on a hangout real quick?17:36
kwmonroei see a failed deployment in the azure portal, but juju isn't catching it17:37
=== tvansteenburgh1 is now known as tvansteenburgh
rick_h_kwmonroe: what's up?17:43
kwmonroerick_h_: might be easier to show you.. can you join tvansteenburgh and i?  https://hangouts.google.com/hangouts/_/canonical.com/eco-wx17:43
rick_h_kwmonroe: omw17:44
alexisb__rick_h_, do you want me to join, given asure is on our court atm17:47
rick_h_alexisb__: you can, getting folks to file a pair of bugs17:47
=== frankban is now known as frankban|afk
natefinchuh, do we not have a way to enable trace logging on the client?18:10
natefinchlogging-config only affects the server and --debug only makes us output debug18:10
kwmonroealexisb__:  rick_h_: tvansteenburgh:  if there's anything else you might find helpful to debug the "pending" vs "error" machine in azure, lmk.  we've still got the env for https://bugs.launchpad.net/juju/+bug/162824618:52
mupBug #1628246: juju not detecting azure provisioning failure <juju:New> <https://launchpad.net/bugs/1628246>18:52
tvansteenburghkwmonroe: thanks for filing that18:53
rick_h_kwmonroe: ty18:53
rick_h_kwmonroe: leave it up a few hours in case axw thinks of anything that he'd find particularly useful18:53
kwmonroeack18:53
=== beisner- is now known as beisner
perrito666we need a sprint on mars19:44
natefinchperrito666: +1 for mars20:01
natefinchman simplestreams is a giant PITA20:10
=== wwitzel3_ is now known as wwitzel3
=== JoseeAntonioR is now known as jose
=== wwitzel3_ is now known as wwitzel3
* katco` just realized she has been glancing at a disconnected #juju-dev screen all day21:40
menn0axw: ping21:46
perrito666menn0: too early21:49
perrito666katco`: emacs :p21:49
menn0perrito666: yeah I figured. just trying my luck :)21:49
menn0doesn't matter, I put my question on the review instead21:49
katco`perrito666: i know you're joking, but something's going on with my bouncer. the katco here is connected, but my bouncer won't let me connect to that session =|21:50
perrito666menn0: the standup time is pretty much the earliest youll find andrew, that s why its that time21:50
perrito666katco`: interesting, bouncer spitting any logs?21:50
katco`perrito666: yeah, but nothing that was interesting in 5m of looking21:50
perrito666katco`: just kill it, it happened to me a couple of times when using bip21:51
katco`perrito666: i rebooted my headless this morning; i think the disk might be going out (don't know if that's related)21:51
katco`was getting segfaults running any command; inodes corrupt, etc.21:52
katco`watched fsck run; seemed to clean some things up (shrugs)21:52
perrito666katco`: ouch, that depends too much on your bouncer implementation but make sense that it would need some sort of access to logs/cache to let you in21:52
katco`well the reboot seems to have cleared that up, that's why i'm not sure if it's related21:53
katco`plus... the session is connected21:53
katco`really no clue yet. i'll probably have to look at it tonight21:53
perrito666katco`: well if the files are corrupt you might have that issue even if fsck attempted to repair the disk21:53
katco`i don't know why it would still connect the session though...21:54
=== hatch_ is now known as hatch
menn0katco`: what's the story with PRs against develop? as OCR should I ignore them for now?22:20
katco`menn0: yeah, working on a PR that encompasses that22:21
katco`menn0: ta for asking22:21
menn0katco`: I take it we will all soon be landing into develop instead of master?22:23
rick_h_menn0: hooefully22:24
katco`menn0: i think that's the idea. right now the goal was to begin double-pushing to develop to test out the automated testing, but seems that's happening on master already22:24
katco`menn0: i imagine that when we switch we'll just rebase develop against a fresher master22:24
rick_h_katco`: yea figure just delete/recreate develop/staging and block landing on master22:26
katco`rick_h_: cool22:27
alexisbthumper, ping22:40
thumperveebers: standup?23:17
veebersthumper: I'm just about to head out the door, see ping to alexisb in #juju :-)23:17

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!