/srv/irclogs.ubuntu.com/2015/03/20/#juju-dev.txt

* perrito666 is waiting to land changes01:03
axwwwitzel3: worker.ErrRebootMachine01:20
anastasiamacericsnow: thnx for review! it's amazing what ppl with fresh eyes can see! I really appreciate ur patience with such a huge PR too :D01:27
wallyworldperrito666: looks like trunk will be blocked for a while sadly01:27
perrito666wallyworld: t's ok, I dont need sleep01:27
* perrito666 wants to be like dimitern 01:28
ericsnowanastasiamac: glad to do it; I try to be thorough and honest :)01:28
ericsnowanastasiamac: and I like to learn a thing or two in the process :)01:28
wallyworldperrito666: it won't be fixed till your SOD tomorrow because a fix landed but the tests are failing on CI even though they pass locally and there's no build artifacts01:28
wallyworldso we need QA team input01:28
ericsnowwallyworld: I made some broad changes on http://reviews.vapour.ws/r/1164/01:28
ericsnowwallyworld: when you have a few minutes could you take a look?01:29
wallyworldok01:29
ericsnowwallyworld: ta01:29
wallyworldericsnow: btw, pool config attributes may be string, int, bool, whatever01:29
ericsnowwallyworld: FYI, I'm manually testing while doing other stuff01:29
wallyworldok01:30
ericsnowwallyworld: I was confused because at the CI the attrs are always strings01:30
wallyworldwell of course!01:30
ericsnow:)01:30
perrito666wallyworld: well one of the things I wanted to land is for 1.23 :p01:30
perrito666so I might still be in luck01:30
wallyworldericsnow:  they have to be parsed into the right type - we don't use a schema yet though01:31
wallyworldperrito666: yeah, 1.23 is open01:31
ericsnowwallyworld: np, just trying to make sense of a bunch of new-to-me code :)01:31
perrito666now I just need a review01:31
* perrito666 looks at ericsnow :)01:31
ericsnowwallyworld: to be honest, very little was hard to grok01:32
ericsnowwallyworld: that's certainly to anastasiamac's credit01:32
perrito666one of my favorite code lines --> // TODO(fwereade) GAAAAAAAAAAAAAAAAAH this is LUDICROUS.01:32
wallyworldericsnow: indeed, i feel the same looking at other work myself01:32
wallyworldperrito666: that's hilarious01:33
* wallyworld checks to see if it is his code01:33
ericsnowperrito666: I probably won't be able to give you a review on the until tomorrow, sorry01:33
anastasiamacericsnow: i appreciate ur consideration :D01:33
perrito666wallyworld: its a test that compiles jujud01:33
wallyworldyeah, not me. whew :-)01:34
perrito666wallyworld: lol01:34
perrito666:p lol it is the person that first taught me how to code in juju01:35
wallyworldericsnow: that's done01:45
ericsnowwallyworld: thanks :)01:45
wallyworldbut trunk is blocked anyway :-(01:45
perrito666natefinch: kids asleep driven development?02:05
natefinchperrito666: yep02:05
natefinchwwitzel3: you around?02:40
=== kadams54 is now known as kadams54-away
natefinchwhelp, when things start randomly breaking that were working for the last two weeks, it's time for bed.03:14
anastasiamacaxw: wallyworld: cleared PR \o/ PTAL http://reviews.vapour.ws/r/1213/03:25
wallyworldok03:26
anastasiamacericsnow: I was not just dropping issues... I just was not publishing all comments in hope to minimise volumes of email. plz let me know if there r still some issues that i have not addressed or answered03:30
ericsnowanastasiamac: will do, thanks for taking the time to work through all that :)03:30
anastasiamacericsnow: thnx for review - really appreciated ur time and input03:31
anastasiamacwallyworld: so with respect to your last comment about "called".... r u happy with my amendments - i.e. removing the "called" from places where I *know* my implementation was called using other checks?...03:52
wallyworldanastasiamac: yes, so long as there are other side effects to ensure the code was called03:53
anastasiamacwallyworld: tyvm :D there are other means!03:53
wallyworldin the past, people have had blocks of code with c.Assert() that we not called03:53
anastasiamacwallyworld: good to know :) will keep in mind...03:55
axwwallyworld: rootfs attachment via storageprovisioner: http://paste.ubuntu.com/10631966/04:19
axwwallyworld: hooks firing: http://paste.ubuntu.com/10631970/04:21
davecheneyoh gawd -- autotools!04:24
axwdavecheney: ?04:26
* axw enjoys not thinking about build configuration anymore04:26
davecheney../gcc/trunk/configure --prefix=/opt/gccgo --enable-languages=c,c++,go04:27
axwfun times04:28
davecheneyfor increasingly small values of fun04:34
davecheneyprotip, building gcc requires more than 7gb of disk space04:57
axwdavecheney: my LLVM/Clang/llgo build dir is 15GB :\    that is with full debug and all targets, but still...05:05
wallyworldaxw: awesome on the storage provisioning :-)05:19
axwwallyworld: just reworking the tmpfs provider now, then I'll write some tests and propose05:19
axwwallyworld: I think I'll remove the FilesystemParams.Attachment field while I'm at it05:20
axwbut leave volume alone for now05:20
wallyworldsgtm05:20
=== kadams54 is now known as kadams54-away
=== urulama__ is now known as urulama
axwwallyworld: are you around?07:41
wallyworldyeah07:41
axwwallyworld: hey, I'm just thinkg about how rootfs should work...07:41
axwwallyworld: I think it should be using "mount --bind" to put things in place properly07:42
axwbut that won't work on LXC07:42
axwOOTB07:42
wallyworldwe can create an lxc.conf that will allow that though07:42
wallyworldand it's a use use we want too right - bind mount a host dir07:43
axwwallyworld: yeah, but not by default. it'd be nice if we could at least get rootfs to work OOTB07:43
wallyworldhmmm, yeah07:43
axwwallyworld: so, the alternative is we symlink on LXC07:44
wallyworldi wonder if we can do it different just for lxc, sounds messy07:44
axwwallyworld: which would fail if the path already exists... but it's an option07:44
wallyworldwhat is the likeihood of the path existing - on boot, not very high07:44
wallyworldon storage add, we can just error07:44
axwwallyworld: the charm can specify any path, so it depends on what the charm specifies07:45
axwwallyworld: i.e. a charm could say mount the filesystem at "/var/lib/foo", and it *should* work even if that directory exists07:45
wallyworldtrue07:46
wallyworldwould be easier if users just let juju decide and inform via the attached hook07:46
axwwallyworld: so I could have it try to "mount --bind", and if that fails then try to symlink if the dir doesn't exist07:46
axwindeed07:46
wallyworldand if that fails, then what's the fallback07:46
axwno fallback, can't do anything else07:46
wallyworldi *think* that's reasonable, maybe if the dir is empty we remove it07:47
axwwallyworld: actually, if the dir exists *and* it's on the same filesystem as /, then we could just carry on07:47
wallyworldand only fail if dir contains data07:47
wallyworlds/remove/use07:48
wallyworldyes, just carry on07:48
axwhrm, I feel a bit nervous about removing existing things07:48
axweven if they're empty07:48
wallyworldsorry, i mistyped07:48
wallyworldif the dir is empty, we just carry on07:48
wallyworldas to the charm it's the same thing07:48
axwyep07:49
wallyworldbut fail if there's data there07:49
wallyworldfor safety07:49
axwok, that sounds good07:49
wallyworldgreat07:49
dimiternmorning o/08:09
mupBug #1434437 was opened: juju restore failed with "error: cannot update machines: machine update failed: ssh command failed: " <juju-core:New> <https://launchpad.net/bugs/1434437>08:33
dimiternfwereade, hey, are you around?08:56
dimiternfwereade, also jam if here - please have a look at this http://reviews.vapour.ws/r/1118/09:00
fwereadedimitern, heyhey09:02
dimiternfwereade, hey, that's the PR which will hopefully fix some flaky filter tests09:02
fwereadedimitern, did we have intermittent failures in all the ones you touched?09:08
dimiternfwereade, yes, esp. depending on the stress the machine running them is under09:09
fwereadedimitern, the thing is I'm a bit worried about the AssertReceiveBetween stuff09:09
dimiternfwereade, yeah?09:10
fwereadedimitern, particularly the (0, 2) case -- won't that pass *every time* whatever the behaviour is?09:10
dimiternfwereade, it's unavoidable to allow for some flexibility09:10
fwereadedimitern, yeah, but... the flexibility is the problem09:10
dimiternfwereade, in the normal case it passes with the lower bound09:10
fwereadedimitern, right, but we have no way of knowing that09:10
dimiternfwereade, I've verified it by looking at the logs, but I guess it's not obvious09:11
fwereadedimitern, yeah, I believe it works, I just don't think it gives us protection going forward09:12
fwereadedimitern, I suspect the mocked-out-api approach is the one we need to take to actually fix this09:12
dimiternfwereade, the right way going forward is to make all the watchers in the filter mockable09:12
dimitern:) yeah09:13
fwereadedimitern, yeah, exactly09:13
dimiternfwereade, so you'd rather leave the tests flaky for now and not land my "fix" until a proper one can be done?09:15
fwereadedimitern, I think that false positives are worse than false negatives, yes09:18
fwereadedimitern, if you consider a test failure to be a positive, that is09:18
fwereade;p09:18
fwereadeer wait I think I have that the wrong way round09:19
fwereadedimitern, a test suite that sometimes fails for code that works is inconvenient; a test suite that always passes for code that doesn't work is deadly09:20
dimiternfwereade, I agree :)09:20
dimiternfwereade, ok, I'd ask you to comment on it at least, before I close it then09:21
fwereadedimitern, will do09:21
dimiternfwereade, cheers09:21
natefinchwwitzel3: are/were you up early, or late? :)09:42
* natefinch notes the email wayne sent him an hour and a half go... at 4am09:45
perrito666natefinch: morning10:05
natefinchperrito666: morning10:06
voidspacenatefinch: are you using nvidia-prime?10:27
voidspacenatefinch: or are you using the intel graphics, or using something else to enable optimus?10:27
natefinchvoidspace: I twiddled with it for a while to try to get nvidia to work, I think I'm just using intel graphics, but honestly don't remember where I ended up with that.  Linux + graphics = pain10:28
voidspacenatefinch: ok, thanks10:28
natefinchsorry :)10:28
voidspacenatefinch: I have an issue with a kvm image not booting (black screen) and I wonder if it's a graphics driver issue10:29
voidspacenatefinch: it went through the install fine and then black screen on reboot10:29
voidspacenatefinch: I'm trying again with installing trusty into kvm instead of utopic to see if that makes a difference10:29
voidspacenatefinch: it *shouldn't*10:29
natefinchI know vivid containers on non-vivid hosts was having problems, but haven't heard of utopic being a problem10:33
voidspaceutopic is the host, so really shouldn't be an issue10:33
voidspaceI couldn't find anyone else with the same issue either - which is what makes me suspect driver issues10:33
voidspaceanyway, trying trusty10:33
voidspacenatefinch: these instructions make it seem simple to enable nvidia...10:36
voidspacenatefinch: http://www.webupd8.org/2013/08/using-nvidia-graphics-drivers-with.html10:36
voidspacenatefinch: for 14.04 but should be the same for utopic I guess...10:36
natefinch"Multiple monitors don't work out of the box"10:37
voidspacewell, you can't have *everything*10:38
natefinch...... see.. multiple monitors works for me now, no way am I going to risk spending 4 hours fiddling with it if I accidentally break that10:38
voidspace:-)10:38
voidspacecoffee10:38
natefinchwget https://raw.githubusercontent.com/kovidgoyal/calibre/master/setup/linux-installer.py | sudo python   .....sure, why not! :/10:40
voidspacenatefinch: dimitern: trusty install works10:41
natefinchvoidspace: weird... well, good enough for now I guess10:41
voidspacenatefinch: dimitern: so either a problem with utopic or just a problem with that particular install I did10:41
dimiternvoidspace, awesome!10:41
voidspacenatefinch: dimitern: yep, trusty fine for this10:41
voidspacehah, seems like the virsh network I configured isn't working though10:42
voidspaceI'll look at it later10:43
dimiternvoidspace, cool10:50
voidspacedimitern: as far as I can tell in workers the standard way to get an environ is to use WatchForEnvironConfigChanges12:06
voidspacedimitern: does that sound right?12:06
voidspacedimitern: it's what the provisioner and firewaller do12:07
dimiternvoidspace, in general - yeah, but you should have it simpler as you have access to stare directly, like the cleaner, right?12:07
voidspacedimitern: I didn't see the cleaner using envron12:07
voidspacecleaner  worker does next to nothing - it calls state.Cleanups12:08
voidspacest.Cleanup12:08
dimiternvoidspace, yeah, but my point was - it takes a *state.State in its ctor12:09
voidspacedimitern: right, we have a state.State12:09
dimiternvoidspace, from st, you could always construct and environ12:09
voidspacedimitern: so should I get the config from state and open a new environment12:09
voidspaceright12:09
dimiternvoidspace, get the EnvironConfig and use config.New12:09
voidspaceyep12:09
dimiternvoidspace, you'll be running on the state servers only, so it's ok12:10
dimiternvoidspace, the difference for other (normal) workers running on other machines, is they need to use the api12:11
voidspaceright12:11
voidspaceunderstood12:11
dimiternvoidspace, hence that WatchForEnvironConfigChanges (which is not even needed just to get the config for some time now IIRC)12:12
dimiternvoidspace, ok :) cheers12:12
voidspacedimitern: worker is again "done", so back to testing13:01
voidspacedimitern: using an interface for the environ (a "releaser") for testing - and getting a NetworkingEnviron from the state13:02
dimiternvoidspace, great! have you pushed anything?13:02
voidspaceand properly releasing13:02
voidspacedimitern: https://github.com/juju/juju/compare/master...voidspace:address-life-worker13:02
dimiternvoidspace, looking13:02
voidspacedimitern: addressWorker.removeIPAddresses is essentially the code copied from the provisioner api - with added logic to get the instance ID from the machine ID13:03
=== kadams54 is now known as kadams54-away
sinzuisorrry perrito666 : your HA branch broke Windows and OS X builds bug 143454413:03
mupBug #1434544: backups broke non-linux builds <ci> <osx> <regression> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1434544>13:03
perrito666sinzui: WHAT?13:04
perrito666sinzui: hold, I have that change in my local machine :| wtf did happen there, sending a fix right away, apologies13:04
voidspacedimitern: damn, some calls to errors.Annotatef that should be logging instead13:04
voidspacedimitern: friend arrived, so breaking for lunch13:05
sinzuiperrito666, I think a function signature changed13:05
dimiternvoidspace, ok, I have some comments - ping me when back please13:05
perrito666sinzui: It did, I just stashed that change instead of committing it13:06
mupBug #1434544 was opened: backups broke non-linux builds <ci> <osx> <regression> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1434544>13:06
perrito666yes, yes mup I know13:06
sinzuiperrito666, we've all done that13:08
perrito666I should stopworking at two branches at once13:08
perrito666can I get an amen? http://reviews.vapour.ws/r/1217/13:10
dimiternperrito666, ship it!13:10
perrito666merging13:11
perrito666btw sinzui we need to discuss new CI testing for new restore13:11
perrito666I am pretty sure that the next spot in your agenda is somewhere around 2018 :p so save it for me plz13:12
sinzui:)13:12
perrito666this patch, besides breaking windows and osx, fixes the issue we had when we first tried to deprecate old restore but somehow changes a bit the behavior of ha restore and also now we support systemd13:13
mupBug #1434544 changed: backups broke non-linux builds <ci> <osx> <regression> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1434544>13:18
mupBug #1434544 was opened: backups broke non-linux builds <ci> <osx> <regression> <windows> <juju-core:Triaged> <https://launchpad.net/bugs/1434544>13:24
* perrito666 looks at the pr to see if it merges faster13:31
perrito666wee, merged13:31
mupBug #1434555 was opened: ppc64el unit test timeout <blocks-release> <ci> <ppc64el> <regression> <juju-core:Triaged> <juju-core 1.23:Triaged> <https://launchpad.net/bugs/1434555>13:54
* fwereade out laura's school again, bbl14:03
ericsnowperrito666, wwitzel3: standup?14:03
perrito666ericsnow: going14:03
voidspacedimitern: back14:05
dimiternvoidspace, hey, so a few comments for the worker implementation14:06
voidspacedimitern: shot14:07
voidspace*shoot14:07
dimiternvoidspace, 1) you could do it much simpler if you implement it as a StringsWorker - no need to do most of the things for a full worker, e.g. implement the loop14:07
voidspacedimitern: ah, ok14:08
dimiternvoidspace, e.g. return NewStringsWorker in the ctor and just do the SetUp and Handle implementation14:09
voidspacedimitern: yeah, I see - looking at StringsWorker now14:10
voidspacenice, thanks14:10
dimiternvoidspace, another thing - it needs to be a singular worker as well14:10
voidspacedimitern: right - I thought that was done in the way we start it14:11
voidspacedimitern: don't we wrap singular workers?14:11
dimiternvoidspace, hmm let me check14:12
dimiternvoidspace, awesome - you're correct - the state worker is already a singular14:13
dimiternvoidspace, and a final thing - I'd rather define an interface with all state methods you need and take that in the ctor14:14
dimiternvoidspace, this way it's much easier to mock and test later14:14
voidspacedimitern: ao an interface for state.State14:14
voidspacedimitern: ok, I was just following the other workers14:14
voidspaceeasy to do though, we don't use many methods14:15
voidspacedimitern: so no problem14:15
dimiternvoidspace, yeah, only a subset of it - the methods you need14:15
dimiternvoidspace, great, thanks!14:15
voidspacedimitern: thank you14:15
=== kadams54-away is now known as kadams54
voidspacedimitern: so in my worker I want to kick off a goroutine to remove the initial dead addresses14:32
voidspacedimitern: and the way that's done currently is in a loop watching to see if the worker has died14:33
voidspacedimitern: selecting on the dying channel14:33
voidspacedimitern: which is really tomb.Dying()14:33
dimiternvoidspace, yeah, that sounds correct14:33
voidspacedimitern: if I use a StringsWorker I don't have access to that14:33
voidspacedimitern: as tomb is private to the StringsWorker14:34
voidspacejust looking to see if there's anything else14:34
voidspacein a handler I would do it in SetUp14:34
voidspacedimitern: not that I can see14:35
voidspacedimitern: we don't necessarily need to worry about the worker dying14:35
voidspacedimitern: if the *state* dies then a call will error out and we'll bail immediately14:35
voidspacedimitern: ditto on the connection to the environ14:35
dimiternvoidspace, right, well you do have TearDown()14:36
dimiternvoidspace, which could be used to stop that goroutine14:36
voidspacedimitern: so write to a channel in TearDown and select on that?14:36
voidspacecool, that'll do14:36
voidspacedimitern: thanks :-)14:37
dimiternvoidspace, np, hope it looks nicer this way :)14:37
voidspacewell I deleted a bunch of code which is always good14:37
dimiternvoidspace, indeed!14:38
voidspacedimitern: hmm... except StringsWorker is designed to work with api watchers14:44
voidspacedimitern: SetUp must return an api watcher14:44
voidspaceand we're using EnvironObserver14:44
voidspacewell14:45
voidspaceI'm not sure that we even need that14:45
voidspaceand we are using a watcher14:45
voidspacelet me look into it14:45
dimiternvoidspace, hmm that's true - but api.StringsWatcher is just an interface14:46
dimiternvoidspace, and there's the equivalent state.StringsWatcher interface which is the same14:47
dimiternvoidspace, except the api one does not have Wait and Kill, only Stop14:48
dimiternvoidspace, but Stop is calling Wait(Kill(nil)) internally, so that's fine14:49
voidspacedimitern: so I can call and use WatchIPAddresses14:50
voidspacedimitern: which is the point I guess...14:50
dimiternvoidspace, yeah14:50
voidspace:-)14:50
dimiternvoidspace, btw why did you need EnvironObserver?14:50
voidspacedimitern: pretty sure now that we didn't14:50
voidspacedimitern: it was code I "borrowed" and didn't trim correctly...14:50
voidspaceit's gone14:50
dimiternvoidspace, sweet :)14:53
voidspacedimitern: so I now have a dying channel that my goroutine is selecting on15:00
voidspacedimitern: in TearDown shall I just write something arbitrary to the channel?15:00
voidspacein the tomb package I can't see the dying channel ever written to (probably I just haven't found it)15:01
voidspacein Kill it is just closed15:01
dimiternvoidspace, I think it's better to just close that channel in TearDown - no need to send (any potentially block)15:01
voidspacedimitern: but if we close it, does that trigger the select listening on it?15:02
dimiternvoidspace, yes it does15:02
voidspaceah, that'll be how the code works then15:02
voidspaceI tried googling but didnt' find that particular fact15:02
voidspacethanks15:02
dimiternvoidspace, e.g. case _, ok := <-someChan: if !ok { closed .. }15:02
voidspacedimitern: right, our particular select is just  case <-a.dying:15:03
voidspacedimitern: that won't be enough, we'll need the ok15:03
dimiternvoidspace, giving a chan to a goroutine and closing it to signal something to it is pretty common :)15:03
dimiternvoidspace, I'm not even sure you'll need to check for !ok if that's the only reason for the select case15:04
dimiternvoidspace, try it out :)15:04
voidspacedimitern: yeah, I'll try it in the playground15:04
voidspacedimitern: yep, close triggers it without needing ok15:06
voidspacedimitern: http://play.golang.org/p/x8O2HdTgOm15:06
dimiternvoidspace, nice :)15:09
alexisbwwitzel3, ericsnow ping15:43
ericsnowalexisb: hi15:43
alexisband happy friday!15:43
alexisbheya ericsnow15:43
alexisbcan you work with sinzui and xwwt to get release notes together for gce provider?15:43
ericsnowalexisb: I started to add an entry the other day and wasn't sure what more to say than "GCE is now supported as a provider" :)15:44
ericsnowalexisb: so what else should be there?15:44
alexisbI am sure that evilnickveitch and sinzui can give you better details then I15:45
sinzuiericsnow, I am editing https://docs.google.com/a/canonical.com/document/d/1V6AU2mEbTOXQygsn-9eZg-DHjxcVpMylyq017KS78mU/edit and writing everything based on what I think is needed reading juju ini --show15:45
alexisbhowever at minimum we should have details on what is supported and how it is used15:45
ericsnowsinzui, alexisb: got it15:46
ericsnowalexisb, sinzui: I'll add that15:46
alexisbericsnow, thanks15:47
perrito666sinzui: did my fix unlock 1.23?15:55
sinzuiperrito666, CI is still testing the previous revision15:58
* perrito666 headbutts the desk15:58
jw4perrito666: you've been learning from thumper15:58
perrito666jw4: I think he headbutts other people's hands15:59
jw4perrito666: it's okay - you'll get there too15:59
alexisbkatco, ping16:03
katcoalexisb: hi hi16:04
alexisbhey there katco are you in full force today?  or our you out?16:04
alexisbs/our/are16:05
katcoalexisb: i took today off to celebrate the equinox (plus i happen to be sick :( ) you caught me checking email though. what can i do for you?16:05
alexisbnothing, you are off, go!16:05
katcoalexisb: had i not been sick we would be at the butterfly house with our daughter =/16:05
alexisb:(16:06
ericsnownatefinch: ping16:06
alexisbok ericsnow given you are already in the release notes and my internete sucks and google docs hates me I am volunteering you :)16:06
alexisbI need someone to add leader elections to the 1.23 release notes, noting that it is behide a feature flag16:07
alexisbwilliam, jam and I can add details later16:07
ericsnowalexisb: yikes16:07
ericsnowalexisb: FWIW, I know nearly nothing about it16:07
alexisbjust need a placeholder16:08
ericsnowalexisb: I'm glad to give it a go though16:08
ericsnowalexisb: k16:08
alexisbericsnow, please dont send anytime on the details16:08
ericsnowalexisb: got it16:08
dimiternvoidspace, dooferlad, as OCRs can you have a look at this huge, but mostly mechanical refactoring branch? http://reviews.vapour.ws/r/1219/16:08
dooferladdimitern: on it16:15
dimiterndooferlad, ta16:15
mattywnatefinch, ping?16:24
perrito666mattyw: he is most likely OoO16:25
mattywperrito666, ok thanks16:26
natefinchback everyone16:42
natefinchwwitzel3: you around?16:44
sinzuinatefinch, dimitern do you have a minute to review http://reviews.vapour.ws/r/1220/16:57
dimiternsinzui, looking16:57
=== ericsnow is now known as ericsnow_afk
dimiternsinzui, ship it!16:58
sinzuithank you dimitern16:59
mupBug #1431918 changed: gce minDiskSize incorrect <tech-debt> <juju-core:Fix Released by wwitzel3> <juju-core 1.23:Fix Released by wwitzel3> <https://launchpad.net/bugs/1431918>17:19
=== kadams54 is now known as kadams54-away
mupBug #1431918 was opened: gce minDiskSize incorrect <tech-debt> <juju-core:Fix Released by wwitzel3> <juju-core 1.23:Fix Released by wwitzel3> <https://launchpad.net/bugs/1431918>17:22
=== kadams54-away is now known as kadams54
mupBug #1431918 changed: gce minDiskSize incorrect <tech-debt> <juju-core:Fix Released by wwitzel3> <juju-core 1.23:Fix Released by wwitzel3> <https://launchpad.net/bugs/1431918>17:25
natefinchwhat's the metadata to turn off apt-get upgrade, anyone remember?17:38
=== kadams54 is now known as kadams54-away
hazmatos-update: false?17:57
hazmatnatefinch: per the latest cloud init docs package_upgrade: false17:58
hazmathttp://cloudinit.readthedocs.org/en/latest/topics/examples.html#run-apt-or-yum-upgrade17:58
hazmatoh.. you mean the juju syntax17:58
natefinchhazmat: heh, yeah, I think it's apt_upgrade: false  ... at least that seems to be what the code is saying, if I'm in the right place17:58
hazmatnatefinch: enable-os-upgrade: false17:59
hazmathttps://github.com/juju/docs/blob/master/src/en/config-general.md17:59
natefinchhazmat: wow, I didn't know we had all that documented, that's awesome.  Thanks for the pointer18:00
=== kadams54-away is now known as kadams54
perrito666it is amazing how noticeable is the fact that mosquito repellent effect has passed18:42
natefinchhaha18:42
perrito666it seems to work as an interruptor, from one moment to the other, everything itches18:43
natefinchyuup18:43
* natefinch contemplates ignoring all this "return a special error to get jujud to restart" and just calling os.Exit(1)18:44
perrito666natefinch: It took me 6 months to get approval on a patch that does that same thing and has a very good excuse :p hope you have patience18:45
natefinchperrito666: I don't need patience, I have internal customers that need this in 1.2318:46
natefinchperrito666: the annoying thing is, there's a few different things that LOOK like they should do the right thing.... and don't.18:46
perrito666well as fwereade would certainly say, "have you read the doc about that?"18:47
=== ericsnow_afk is now known as ericsnow
perrito666and, me too, was just 10 mins looking at an error that arose from plural vs singular19:16
natefinchug19:23
natefinchgah... now jujud isn't restarting at all. Sonofa19:23
natefinchlike, it stays dead19:23
natefinchthanks a lot, upstar19:24
natefincht19:24
perrito666natefinch: what did you do?19:24
natefinchos.Exit(1)19:24
perrito666oh, that is odd, upstart should restart you on 119:24
natefinchand somehow the logging statements right before that aren't being flushed to disk.  Thanks a lot, loggo.19:25
perrito666natefinch: well you are exiting :)19:26
perrito666which most likely prevents all other routines to finish whatever they where doing19:26
natefinchperrito666: it should be flushing the log messages.. what if I log something important right before a crash?19:26
jw4OCR PTAL : http://reviews.vapour.ws/r/1221/ <--- reviewed previously and merged to 1.23 - this is to forward port it to master19:26
natefinchit's in the same goroutine, too19:27
perrito666can you not force loggo to flush?19:27
natefinchperrito666: I don't immediately see a way to... the problem is that it just takes writers19:28
natefinchso there's no flush, even if the underlying thing can flush19:28
perrito666you are having a classic friday problem19:29
natefinchbeen having friday problems for two weeks19:31
sinzuihi natefinch bug 1434680 is super critical19:46
mupBug #1434680: 1.22.0 cannot upgrade to 1.23-beta1 or 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Triaged> <https://launchpad.net/bugs/1434680>19:47
sinzuinatefinch, We are in the middle of a release of 1.23-beta1. we have a choice of aborting or continuing with the caveate that upgrades from 1.22.0 are broken19:47
mupBug #1434070 changed: upgrades are broken in master 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Fix Released by thumper> <https://launchpad.net/bugs/1434070>19:49
mupBug #1434680 was opened: 1.22.0 cannot upgrade to 1.23-beta1 or 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Triaged> <https://launchpad.net/bugs/1434680>19:49
jw4sinzui, natefinch I don't have access to the upgrade logs for those bugs - can you verify whether they are related to the uniter stopped state upgrades I just merged into 1.23 ?19:51
perrito666I can see this happening a lot machine-0: 2015-03-20 15:19:51 ERROR juju.rpc server.go:554 error writing response: EOF19:55
perrito666that was from allmachines19:57
perrito666machine 0 is full of19:57
perrito6662015-03-20 15:43:16 DEBUG juju.mongo open.go:122 TLS handshake failed: x509: certificate is valid for localhost, juju-apiserver, not juju-mongodb19:57
sinzui natefinch has access to everything20:06
jw4thanks sinzui - I'll eagerly ^H^H^H^H anxiously await natefinch 's verdict20:06
* natefinch crackles with power.20:07
jw4hehe20:07
jw4is that kragle?20:07
natefinchoh wait, no, I was just sitting on a bag of chips20:07
jw4haha20:07
* jw4 assumes *everyone* has watched the LEGO movie20:08
natefinchI have not.... we got it, but it was too intense for our 3 year old20:09
natefinchsomeday I should throw it in after they go to bed20:09
jw4yeah; 3 is a bit young for it - my 9 year old liked it though20:09
sinzuinatefinch, as a canonical employee you can see every log at http://reports.vapour.ws/releases/246620:10
jw4although it RUINED watching The Hobbit with him - he kept associating Gandalf with the 'Gandalf' in LEGO movie20:10
natefinchsinzui: ima lookin20:10
natefinchjw4: haha... always watch the old movies first20:10
sinzuinatefinch, and maybe jw4, as project members of juju-core, you must have permission to see hidden comments in Lp...otherwise there is a regression20:10
jw4kk20:11
natefinchsinzui: is there a trick to seeing the hidden ones?20:11
sinzuithey should just be dark grey20:12
* sinzui reviews project20:12
natefinchsinzui: btw, the comments are hidden, but I still see the attachments in the lower right20:12
sinzuiha ha. Launchpad really sucks20:13
natefinchlol20:13
sinzuinatefinch, I need to review them now :(20:13
jw4perrito666: oh - you were talking about the upgrade regression when you mentioned the TLS handshake failures20:14
sinzuinatefinch, I deleted the attachments because Juju still puts certs in DEBUG when juju is not run a sDEBUG20:14
natefinchsinzui: sorry about that.... juju sucks, too20:15
jw4I'm seeing those too in my local upgrade test20:15
sinzuinatefinch, you are an admin of ~juju. as the project maintainer you should be seeing every hidden message on the juju-core project? Are you logged in?20:16
perrito666jw4: I was, I thought that since natefinch was not answering I could throw you a line20:16
natefinchsinzui: it says i'm logged in20:16
jw4perrito666: thank you! :)  I was trying to figure out you were referring to your previous conversation with natefinch20:17
sinzuinatefinch, jw4, I uploaded redacted logs to https://bugs.launchpad.net/juju-core/+bug/143468020:21
mupBug #1434680: 1.22.0 cannot upgrade to 1.23-beta1 or 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Triaged> <https://launchpad.net/bugs/1434680>20:21
jw4sinzui: thank you!!20:21
jw4okay, those seem to be the same errors I'm getting that perrito666 reported20:23
jw4it's like somehow the state server started presenting the wrong TLS certificate?20:23
natefinchsinzui: I can get to the logs on the vapour link20:23
jw4or more like the client is trying to connect using the wrong server name?20:24
sinzuijw4, Those might also be what dimitern reported on https://bugs.launchpad.net/juju-core/+bug/143407020:25
mupBug #1434070: upgrades are broken in master 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Fix Released by thumper> <https://launchpad.net/bugs/1434070>20:25
jw4hmm; looks likely20:26
ericsnowsinzui: could it be a network issue?20:28
ericsnowsinzui: not the network but juju networking20:28
sinzuiericsnow, for every substrate?20:28
jw4hmm I take it back - the logs reported by dimitern don't include the TLS handshake error20:29
perrito666jw4: sure they do20:29
ericsnowsinzui: is there a machine-0.log somewhere from a successful run that we could compare?20:29
perrito666https://bugs.launchpad.net/juju-core/+bug/1434070/comments/820:29
mupBug #1434070: upgrades are broken in master 1.24-alpha1 <ci> <regression> <upgrade-juju> <juju-core:Fix Released by thumper> <https://launchpad.net/bugs/1434070>20:29
sinzuiericsnow, no upgrade passed so no20:29
sinzuiericsnow, I think a downgrade to 1.21.3, is required. that is what was stable until yesterday20:31
jw4perrito666: ah I see - the initial attachements didn't include machine-020:31
jw4maybe this is normal, but when I try to do 'juju status' with my borked upgrade it looks like 'juju status' is starting a new mongod process under my uid ?20:33
natefinchjw4: that doesn't sound normal to me20:36
jw4its running using my UID and the PPID is 120:36
jw4 /usr/lib/juju/bin/mongod20:36
natefinch0.o20:36
perrito666well it is local provider20:37
perrito666and your machine IS machine-020:37
perrito666jw4: care to pastebin you ps faxu?20:38
jw4perrito666: sure20:38
jw4http://paste.ubuntu.com/10637523/20:39
jw4pid 33016 is the mongod that appears when I use 'juju status'20:40
perrito666so20:41
perrito666weldon   33016  0.5  0.5 250800 57240 pts/3    Sl   12:43   0:17 /usr/lib/juju/bin/mongod --dbpath /tmp/test-mgo229055436 --port 59450 --nssize 1 --noprealloc --smallfiles --nohttpinterface --oplogSize 10 --ipv6 --nounixsocket --nojournal --sslOnNormalPorts --sslPEMKeyFile /tmp/test-mgo229055436/server.pem --sslPEMKeyPassword xxxxxxx20:41
perrito666that is part of a testrun20:41
jw4gah!20:41
perrito666that is why it has your uid20:41
jw4 sudo redact-last-20-lines20:42
jw4:)20:42
perrito666look into your /tmp you might also have some garbage from old tests20:42
perrito666brb20:42
jw4tx perrito66620:42
natefinchdumb test mongo sticking around20:43
jw4yeah, sorry for the noise20:44
natefinchit's happened to all of us20:44
perrito666jw4: local provider happens20:46
jw4hehe20:46
mupBug #1313016 changed: allow annotations to be set on charms <api> <charms> <improvement> <juju-core:Fix Released by anastasia-macmood> <https://launchpad.net/bugs/1313016>20:49
mupBug #1389326 changed: juju-backup is not a valid plugin <backup-restore> <plugins> <juju-core:Fix Released by marcoceppi> <https://launchpad.net/bugs/1389326>20:49
mupBug #1403955 changed: DHCP's "Option interface-mtu 9000" is being ignored on bridge interface br0 <cts> <kvm> <lxc> <network> <juju-core:Fix Released> <isc-dhcp (Ubuntu):Confirmed> <https://launchpad.net/bugs/1403955>20:49
mupBug #1409639 changed: juju needs to support systemd for >= vivid <hs-arm64> <systemd-boot> <juju-core:Fix Released by ericsnowcurrently> <juju-core (Ubuntu):Triaged> <juju-core (Ubuntu Vivid):Triaged> <https://launchpad.net/bugs/1409639>20:49
mupBug #1415671 changed: Joyent provider uploads user's private ssh key by default <joyent-provider> <juju-core:Fix Released by natefinch> <https://launchpad.net/bugs/1415671>20:49
mupBug #1415693 changed: Unable to bootstrap on cn-north-1 <bootstrap> <ec2-provider> <online-services> <juju-core:Fix Released by cox-katherine-e> <https://launchpad.net/bugs/1415693>20:49
mupBug #1421237 changed: DEBUG messages show when only INFO was asked for <ci> <security> <juju-core:Fix Released by thumper> <https://launchpad.net/bugs/1421237>20:49
mupBug #1423454 changed: cloud-image-utils needs to be installed <tech-debt> <juju-core:Fix Released by wallyworld> <https://launchpad.net/bugs/1423454>20:49
mupBug #1424069 changed: juju resolve doesn't recognize error state <regression> <resolved> <juju-core:Fix Released by wallyworld> <https://launchpad.net/bugs/1424069>20:49
mupBug #1424590 changed: juju status --format=tabular <juju-core:Fix Released by anastasia-macmood> <https://launchpad.net/bugs/1424590>20:50
mupBug #1427840 changed: ec2 provider unaware of c3 types in sa-east-1 <juju-core:Fix Released by anastasia-macmood> <https://launchpad.net/bugs/1427840>20:50
mupBug #1428117 changed: EC2 eu-central-1 region not in provider <juju-core:Fix Released by anastasia-macmood> <https://launchpad.net/bugs/1428117>20:50
mupBug #1428119 changed: EC2 provider does not include C4 instance family <juju-core:Fix Released by anastasia-macmood> <https://launchpad.net/bugs/1428119>20:50
mupBug #1428430 changed: AllWatcher does not remove last closed port for a unit, last removed service config <api> <juju-core:Fix Released by themue> <https://launchpad.net/bugs/1428430>20:50
mupBug #1431130 changed: make kvm containers addressable (esp. on MAAS) <addressability> <kvm> <maas-provider> <network> <juju-core:Fix Released by dooferlad> <https://launchpad.net/bugs/1431130>20:50
mupBug #1431134 changed: fix container addressability issues with cloud-init, precise, when lxc-clone is true <addressability> <cloud-init> <ec2-provider> <lxc> <maas-provider> <network> <precise> <usability> <juju-core:Fix Released by dimitern> <https://launchpad.net/bugs/1431134>20:50
perrito666daf...20:50
perrito666sinzui: that is you or mup went bonkers again?20:51
sinzuiperrito666, some subscribed mup useless bug information20:51
jw4perrito666: well I just got 15 emails too so I suspect it's not mups fault20:52
perrito666jw4: i did not, or I have those filtered20:52
sinzuiTeam ~juju should be getting emails about bugs, but I don't think anyone cares about closing except the reporter20:52
jw4yeah, it was just the Fix Released notification20:53
natefinchperrito666: probably filtered.  Mine are...20:55
natefinchsinzui: I gotta run, have company and they're expecting me to get dinner.    Afraid I've not been much use anyway (other than pointing out limitations in Launchpad)20:58
sinzuinatefinch, okay, I wasn't really expecting a fix today20:58
=== kadams54 is now known as kadams54-away
=== kadams54-away is now known as kadams54
ericsnowsinzui:  I just bootstrapped local provider with a fresh-built 1.22 (tip), and then did the same upgrade command from the CI logs21:09
ericsnowsinzui: and it worked fine21:10
ericsnowsinzui: maybe21:10
ericsnowsinzui: the command finished successfully but it looks like it didn't do much, so I'm not sure I have much to add yet21:11
sinzuiericsnow, I bootstrapped with 1.22.0 locally, then upgraded to 1.23-beta1 and lost control21:13
ericsnowsinzui: which revision is 1.22.0?21:15
sinzuiericsnow, 1.22.0 the package we ask users to use21:15
sinzuiericsnow, per https://docs.google.com/a/canonical.com/document/d/1ILRWMChkqZ7YeXNCNsmaF89ewqAL_j0qVeF3E9BMwys/edit#heading=h.dp1wyrj1wujg, It was commit 44caaac21:16
ericsnowsinzui: if I build from that revision it also works21:21
ericsnow(I'm on trusty)21:21
sinzuiericsnow, I suspect you are tainted. We one more machines in more environments without developer tools installed.21:24
sinzuiericsnow, 14 tests means 14 substrates, machines, archs, and series. it isn't a single dirty machine21:24
ericsnowsinzui: sure21:24
* sinzui is boostrapping again21:24
perrito666sinzui: which might be the reason why no one broke this in its own machine21:24
sinzuiericsnow, I think I got a volunteer to test vivid with 1.23-beta1 on monday. maybe he can explain the lxc breakage21:25
ericsnowsinzui: sweet21:27
ericsnowsinzui: also I don't think the unit tests failures on vivid are me :)21:27
sinzuiericsnow, no, I don't think so either. the something is very odd about two of them because I only see ping failures in when running tests in lxc21:28
sinzuiericsnow, I cannot upgrade21:32
sinzuiI will attach my personal log21:33
ericsnowoh how I wish local provider ran entirely in VMs21:34
sinzuiericsnow, I think we all do.21:36
ericsnowsinzui: I put it on the agenda for Nuremberg (and thumper agreed to own it)21:37
perrito666you migth have the most attended session of all21:38
perrito666beware21:38
sinzuiericsnow, indeed thump has ideas to make it work right21:38
ericsnowsinzui: we've had the ideas for a while, just not the resources21:39
sinzuiyeah. I know the pain.21:39
ericsnowsinzui: speaking of vivid, how do I re-run local-deploy-vivid-amd64 with --DEBUG?21:42
sinzuiericsnow, we can add --debug to the command line arg of the test. then rerun the test with the current packages. CI only retests current packages21:43
ericsnowsinzui: that's fine, I just want DEBUG logging21:44
sinzuiericsnow, bugger --debug was lost this week in an upgrade...I will have it back in a few minutes21:46
ericsnowsinzui: no worries21:47
=== kadams54 is now known as kadams54-away
jw4in the TestPrune* dblogpruner tests I keep getting an error : "failed to retrieve log counts: no such cmd: scale"23:02
jw4running 'scale' has ubuntu advising me to install csound-utils which doesnt' seem right23:02
jw4hmm interesting "scale" seems to refer to a key in a bson.M{} struct23:04
jw4holy moly it's a bug23:10
jw4:)23:10
jw4OCR PTAL : Fix for bug 1434741 http://reviews.vapour.ws/r/1222/23:26
mupBug #1434741: PruneLogs suffers from an indeterminate map iteration order bug <juju-core:New> <https://launchpad.net/bugs/1434741>23:26
mupBug #1434741 was opened: PruneLogs suffers from an indeterminate map iteration order bug <juju-core:New> <https://launchpad.net/bugs/1434741>23:32
=== ponyo is now known as Fuzai

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!