/srv/irclogs.ubuntu.com/2015/04/30/#juju-dev.txt

sinzuiwaigani, oh, I understand. Yes i think so. I can confirm though that the "upgrade-charm --force" hack is a permanent fix, so envs/users can resolve the problem in minutes if they need too00:00
sinzuiwaigani, We cannot an an upgrade step to 1.22, since we cannot distribute that version any more.00:01
sinzuiwaigani, We need 1.23 to do the fix an 1.24 to do the fix.00:02
waiganisinzui: right, got it. perrito666 ^00:02
sinzuiwaigani, one complicate is that our early adopters still believe odd numbered jujus are dangerous, so they only upgrade to even numbers00:03
waiganiwallyworld: I bootstrapped on aws without issue: http://pastebin.ubuntu.com/10946635/. As I understand it: PrepareForCreateEnvironment is checking UnknownAttrs for control-bucket. configFields, which already had control-bucket, is used to determine what attrs are unknown, thus control-bucket will not be in the unknown attrs, it will be nil. The configDefault is only used to check Coercion of the value types of the attributes:00:26
waiganienvirons/config/config.go:138400:26
waiganiwallyworld: this is the same for openstack00:29
waiganiwallyworld: though if that is correct, and control-bucket will never be an unknownAttr, it begs the question - why check if it's set at all?00:30
wallyworldwaigani: you are misunderstanding what UnknownAttrs are00:52
wallyworldthey are attrs specific to different environment types00:52
wallyworldcontrol bucket will always be there00:53
wallyworldthere are other areas in the codebase that will fail if control bucket defaults to ""00:53
wallyworldare you sure you didn't have a value set in your env yaml for that bootstrap?00:53
waiganiwallyworld: ah, sorry that makes sense. Let me check...00:54
waiganiwallyworld: nothing set in environments.yaml let me read the code again and have another crack at understanding what's going on00:55
wallyworldwaigani: also, if bucket name is "", bootstrap will not fail but errors will be logged (i haven't seen the code before but just checked then)00:58
wallyworldso the tl;dr; is we must not allow bucket name to be ""00:58
waiganiwallyworld: no errors all-machines.log on machine 001:03
wallyworldwaigani: does the jenv file have a control bucket attr?01:13
waiganiwallyworld: not in .jenv I just bootstrapped again and dumped out the attrs - only access-key and secret-key are set, contol-bucket is not passed through. It is later set by the prepare func. It looks as though empty attrs are being removed.01:24
mupBug #1450265 was opened: juju depends on google.golang.org/cloud/compute/metadata but is not included in dependencies.tsv <juju-core:New> <https://launchpad.net/bugs/1450265>01:28
waiganiwallyworld: actually no. I still think configFields and configDefaults are used to validate the unknownAttributes - to make sure they are expected attrs for the provider and not typos and the values are of the right type. They are not being passed through as default values to prepare. The config values are being read from environments.yaml01:32
wallyworldwaigani: when control bucket is generated, it should end up in jenv, if it's not there, that means there's an issue01:34
waiganiwallyworld: after bootstrap it's there, before it's not.01:36
wallyworldcorrect, it will not be there until after01:37
waiganiwallyworld: yep, that's whats happening01:37
waiganiI bootstrapped again to double check that01:38
wallyworldhmm, i can't see how it's being generated then if it's in the map (but "")01:38
wallyworldnot without the extra != "" check01:38
mupBug #1450265 changed: juju depends on google.golang.org/cloud/compute/metadata but is not included in dependencies.tsv <juju-core:Invalid> <https://launchpad.net/bugs/1450265>02:28
axwwallyworld: can you please review https://github.com/juju/charm/pull/125 ?02:44
wallyworldsyre02:44
axwta02:47
wallyworldaxw: you may have seen, 1.24 and master now have no storage ff and also have upgrade step for block devices02:47
axwwallyworld: I have, thank you02:47
axwhad minor merge conflicts02:47
wallyworldjust minor, that's good02:48
natefinchdavecheney: constabulary is a terrible name for a github org02:50
natefinchanyone used the canonical VPN?  I can't understand their directions... seems like they're missing a step02:52
axwnatefinch: yes, what bit are you stuck on?02:53
natefinchaxw: thanks.   So, I installed  network-manager-openvpn-gnome, restarted network manager, then the instructions say:02:55
natefinchSelect network manager -> VPN Connections -> Configure VPN...02:55
natefinch....select network manager from where?02:55
natefinch....I think I just fdigured it out02:55
natefinchthey mean the network icon in the top right there02:55
axwyep02:55
natefinch.. I had no idea that was called the network manager :/02:55
natefinchaxw: ok, another dumb question - how do I get the select file dialog to show dot files?  it says to pick the file from the ~/.sesame directory, but the file picker isn't showing hidden directories.02:58
menn0ericsnow: can you confirm that the fix for bug 1447446 made it into the 1.24 branch and master? (and update the ticket accordingly)02:58
mupBug #1447446: 1.23.1: bootstrap failure, vivid, local provider <bootstrap> <landscape> <juju-core:Fix Committed by ericsnowcurrently> <juju-core 1.23:Fix Released by ericsnowcurrently> <juju-core 1.24:New> <https://launchpad.net/bugs/1447446>02:58
axwnatefinch: you can use Ctrl+L to enter the location02:59
axwnot sure if there's a better way, that's what I do02:59
menn0ericsnow: it was one the tickets that was incorrectly targetted02:59
axwah, right click has "show hidden files"02:59
natefinchOMG... why doesn't that show all the time :/02:59
natefinchahh yeah, I didn't think to right click there... much better03:00
ericsnowmenn0: done03:02
menn0ericsnow: cheers03:02
mupBug #1447446 changed: 1.23.1: bootstrap failure, vivid, local provider <bootstrap> <landscape> <juju-core:Fix Committed by ericsnowcurrently> <juju-core 1.23:Fix Released by ericsnowcurrently> <juju-core 1.24:New> <https://launchpad.net/bugs/1447446>03:04
natefinchaxw: Thanks for the help, got it working.  .03:11
natefinchsinzui: you around?03:11
axwnatefinch: cool03:11
natefinchaxw, menn0: do you guys know how to make the JFDI thing on github work?  I swear I got the syntax right, but it's not going through (still says "doesn't match fixes-blah")03:38
axwnatefinch: $$__JFDI__$$03:38
natefinch:/ did that03:38
menn0natefinch: that's what I would have said03:39
natefinchwonder if the functionality got broken at somepoint (or maybe it just doesn't like me)03:39
natefinchhahaha ... or maybe I mispelled jfdi... :/03:39
axwnatefinch: hum, not sure what's up with that. I've been doing that today, so it's not broken in general03:39
natefinchJDFI is not gonna work03:40
axwheh03:40
axwthat'll do it :)03:40
menn0natefinch: maybe check one of axw's uses of it today?03:40
jw4menn0: I'm pretty sure that change went in before 1.24 was cut... I'll verify04:08
menn0jw4: thanks! i'm not saying it make it I just wanted to be sure. the ticket wasn't targetted correctly so it could have been missed. just update the ticket once you've checked.04:09
jw4menn0: will do04:09
mupBug #1450299 was opened: api/client: test fails on ppc64le <ppc64el> <juju-core:In Progress by dave-cheney> <https://launchpad.net/bugs/1450299>04:10
waiganiwallyworld: the bucket val is being set because it's not in the map. the validation (which would set the default) happens later.04:14
waiganiwallyworld: I've sent an email with the details04:14
wallyworldok, ty, will look04:15
wallyworldwaigani: thanks for explanation. i just wanted to be 100% sure that setting the default to "" wouldn't accidentally fail to generate a control bucket if one were not specified, and that config stuff is a bit of a mess which we've managed to break before :-(04:21
waiganiwallyworld: no, I appreciate it. I now understand what's going on much more, so thanks :)04:22
wallyworldwaigani: i did too 2 years back but have since only vaugue recollections (nightmares?) about config04:23
waiganihaha04:23
wallyworldthe schema default vs omit stuff is really hard to get right04:23
wallyworldand it really is a convoluted web04:23
wallyworldand we have relased juju which broke set ups in the wild04:24
waiganiyeah, it would be good to see if there is a better design pattern that could be used to clear things up a bit04:25
waiganiuntil then, comments are really important!04:25
waiganiwallyworld: so is that a shipit? (not that we can land anything)04:28
wallyworldwaigani: yeah, but if it's a bug fix for 1.24, feel free to jfdi at this point04:28
waiganiwallyworld: thanks04:29
wallyworldaxw: this fixes the critical blocker http://reviews.vapour.ws/r/1532/07:26
wallyworldhopefully07:26
TheMuemorning o/07:49
TheMuehmm, got a fix for 1.24 but CI doesn't accept it *sigh*07:50
axwwallyworld: reviewed08:00
wallyworldty08:00
mgzTheMue: if the bug you're fixing is actually urgent, you have discretion - but it seems that issue doesn't actually break our bundle test on maas (it probably should)08:06
TheMuemgz: it's a port that of a critical bug in 1.23 to 1.24, where it is only high. don't know why.08:07
TheMuemgz: the bug is #144506308:08
mupBug #1445063: addressable containers cannot resolve non-FQDN in maas <addressability> <cloud-installer> <kvm> <landscape> <lxc> <maas-provider> <network> <oil>08:08
mup<openstack> <uosci> <juju-core:Triaged> <juju-core 1.23:Fix Released by dimitern> <juju-core 1.24:In Progress by themue> <https://launchpad.net/bugs/1445063>08:08
mgzTheMue: that actually makes some sense - we couldn't release a 1.23 with it, but we have time before we're putting out 1.24 so a08:08
mgzand it's not actually stopping any of *us* doing work08:08
TheMueic08:09
mgzwhereas the deployer stuff being borked prevents us improving our tests to catch issues like lxc networking problems :)08:09
TheMuemgz: just saw that dimiter commented is with JFDI08:09
mgzyeah, it's fine08:09
mgzwe don't gain anything from doing it but it's not really harmful08:10
TheMuethat's great, thx08:11
wallyworldaxw: updated, i also added an index, i think it may help with the sorts08:13
axwwallyworld: you didn't explain the change from updated to created though. is it for performance?08:15
wallyworldaxw: oh, i see what you're asking, sorry missed the point08:15
wallyworldupdated is only to the nearest second08:16
wallyworldwe need much finer grained to get the order right08:16
wallyworldmost timestamps we store in mongo for juju are to the nearest second08:16
axwwallyworld: so why not store a number somewhere and just increment it each time you need to create an entry? using time is fragile, whatever the resolution08:18
wallyworldcould do, but creating a sequence seems overhead for what is being done here, it's just charm status entries, hardly expected to change even a few times per second08:19
wallyworldand the sort is done after filtering for the unit08:20
axwwallyworld: if you're confident with that, okay. I would just like to point out that it's trivial to do, and you could drop the additional index. you could just use State.sequence(), and use the result as the _id field08:22
axwanyway08:22
* axw takes a final look08:22
wallyworldok, i'll do that08:22
mgzwallyworld: if you get a mo, can I have a stamp on <http://reviews.vapour.ws/r/1473/>08:26
mgz(thanks for the status info)08:26
wallyworldsure give me a sec08:26
mgzit is sadly much larger now, but the commit history should make sense to you08:28
wallyworldaxw: sequence number used08:44
axwwallyworld: thanks08:45
axwshipit08:45
wallyworldnp, thanks for pointing it out08:45
wallyworldmgz: i need dinner, i'll look at branch after08:46
mgzwallyworld: no probs, won't be landing till this evening I guess08:55
perrito666Wallyworld: nice catch on the legacy status09:37
wallyworldperrito666: yeah. also found issues with history, incl tests not wired up :-)09:37
perrito666The test for legacy was long due (which test was not wired I just briefly went trough the diff and didn't notice them)09:42
wallyworldperrito666: status_test.go - the status history tests09:42
wallyworldso they were never run nd hence missed picking up bugs09:43
perrito666Duh, just saw it dang09:48
perrito666Btw09:48
perrito666+c.Assert(len(history), gc.Equals, 100)  c.Assert(history, gc.HasLen, 100)09:48
perrito666You are checking twice the same09:48
wallyworldoh i added that to make the failures easier to debug09:48
wallyworldi'll remove thanks09:48
perrito666Sorry for that not being a comment I am in the phone09:49
wallyworldnp :-)09:49
perrito666And getoldesttimetokeep no longer gets time so it might need a name change and comment correction :)09:50
wallyworldperrito666: yeah true, same sentiment though :-)09:51
natefinchmgz: you around?09:51
mgznatefinch: I am here09:53
natefinchmgz: I;m trying to connect to stilson-7, but even connected to the VPN, I can't even ping the server, and ssh never connects... any ideas?09:57
natefinchmgz: also, does it matter if I use the US or UK VPN?09:57
mgznatefinch: shouldn't10:03
mgznatefinch: I can get in via our ssh bouncer10:06
mgzif the vpn isn't playing ball for you10:07
mgznatefinch: also ssh -vv is useful for general debugging10:08
natefinchmgz: that might be a good option.  I don't know what's up with the VPN... but if all I'm supposed to need to do is connect to it, and then ssh... yeah, it's not working.10:08
natefinchmgz: yeah, it just gets stuck at connecting to the IP..... verifying, stilson-07 is 10.245.67.135 ?10:08
mgznatefinch: yup - you should see that ip via either the vpn or the bouncer10:19
mgzlunching now10:32
TheMuelunch, afk10:56
=== liam_ is now known as Guest24325
mupBug #1450437 was opened: Juju bootstrap fails with sub error code 1 <juju-core:New> <https://launchpad.net/bugs/1450437>11:38
perrito666sinzui: ping me when you are around please13:00
sinzuiperrito666, I have just arrived, though a little low on caffeine13:00
perrito666I sadly have been awake for too much already13:01
perrito666so, I have a fix for https://bugs.launchpad.net/juju-core/+bug/1447853 that should go into 1.22, 1.23 and 1.24 and master :p can I do that? I mean push a fix to 1.2213:02
mupBug #1447853: Local charms are not added to storage on upgrade to 1.22.x <charms> <regression> <storage> <upgrade-juju> <juju-core:Triaged> <juju-core 1.24:In Progress by hduran-8> <https://launchpad.net/bugs/1447853>13:02
sinzuimgz, r=me for joyent, but you conflict with my changes in check_blockers13:13
sinzuikatco, can you ask someone to read the new comment on bug 1437266. Do we need this fixed in 1.24 or 1.25?13:21
mupBug #1437266: Bootstrap node occasionally panicing with "not a valid unit name" <deploy> <destroy-machine> <destroy-service> <juju-core:Triaged> <https://launchpad.net/bugs/1437266>13:21
sinzuinatefinch, Are bug 1340749 and bug 1450437 the same as bug 1412621. Can I make them dupes?13:30
mupBug #1340749: Replicaset initiation failure reports wrong error <mongodb> <juju-core:Triaged> <https://launchpad.net/bugs/1340749>13:30
mupBug #1450437: Juju bootstrap fails with sub error code 1 <juju-core:New> <https://launchpad.net/bugs/1450437>13:30
mupBug #1412621: replica set EMPTYCONFIG MAAS bootstrap <bootstrap> <maas-provider> <mongodb> <juju-core:Triaged> <juju-core 1.24:Triaged> <https://launchpad.net/bugs/1412621>13:30
voidspacedooferlad: TheMue: alexisb: I'm off to the dentist13:32
voidspacebbiab13:32
dooferladvoidspace: enjoy!13:32
TheMuevoidspace: just a check or more? have to do that the next days too ;)13:33
TheMuevoidspace: yes, enjoy13:33
voidspacea check, but for all the family...13:33
perrito666sinzui: dont forget my question now that you are caffeinated :p13:34
sinzuiperrito666, 1.22 is superseded in our PPAs by 1.23. and the packaging rules know it is an error to try to release a lower version13:35
perrito666soo, 1.23, 1.24, master?13:36
sinzuiperrito666, alexisb, mramm, and xwwt to agree to purge our ppa and rush a 1.22 fix out...which means 1.23 will be released next week, not today13:38
sinzuiperrito666, yes. I will add the 1.23 task to the bug13:43
mupBug #1450437 changed: Juju bootstrap fails with sub error code 1 <juju-core:New> <https://launchpad.net/bugs/1450437>13:57
katcosinzui: i don't know whether or not bug 1437266 need be fixed in 1.24 or 1.25. it looks like it only affects a few people, so probably 1.25? we should discuss in the release call14:00
mupBug #1437266: Bootstrap node occasionally panicing with "not a valid unit name" <deploy> <destroy-machine> <destroy-service> <juju-core:Triaged> <https://launchpad.net/bugs/1437266>14:00
katcoericsnow: stand up14:02
natefinchericsnow: stup?14:03
natefinchsinzui: I'll take a look at those bugs in a few minutes14:04
=== kadams54 is now known as kadams54-away
perrito666question about upgrades, when upgrading to a minor, are the steps for that whole mayor rerun?14:48
natefinchperrito666: not sure.  I would hope not.14:53
perrito666natefinch: they are supposed to be idempotent14:53
natefinchperrito666: then why do you care? :)14:54
perrito666natefinch: I need them to14:56
fwereadeperrito666, we *should* run any steps that haven't already been run, but I'm pretty we shouldn't rerun them (ok, if we do by accident they should be idempotent... but still)14:58
fwereadeperrito666, why do you need them?14:58
=== kadams54-away is now known as kadams54
perrito666can anyone stamp this oneliner? http://reviews.vapour.ws/r/1536/15:42
perrito666natefinch:15:43
perrito666katco: ericsnow ?15:44
* ericsnow takes a look15:44
natefinchperrito666: looking... are there no tests for this stuff?15:44
ericsnowperrito666: nice 6 line oneliner :)15:45
natefinchright?15:45
perrito666natefinch: there are but the migration step was already there in the wrong version15:45
perrito666ericsnow: I meant another work but since I dont know it in english my brain replaced with oneliner15:45
perrito666sorry15:45
perrito666word*15:45
ericsnowperrito666: no worries :)15:45
perrito666natefinch: or you mean tests for the contents of the step?15:45
natefinchperrito666: I mean... this code was wrong before, and obviously no test was failing  because of it.  It would be nice if there were a test that would fail if your addition was not there.15:46
ericsnownatefinch: I expect the testing is already there in state/upgrades_test.go15:46
ericsnownatefinch, perrito666: ah, there should be a test that checks that the step was run15:46
perrito666ericsnow: yes, I should have committed it :p15:47
perrito666sorry I had all these changes in patches that a testing script applied after checkout15:48
ericsnowperrito666: looks like the test is missing in steps122_test.go15:49
ericsnow(or the step, rather)15:49
ericsnowperrito666: so TestStateStepsFor122 should be failing15:49
* perrito666 looks why his unstaged changes checker did not fail15:50
perrito666fixed15:52
perrito666ericsnow: can I consider you a holy reviewer or do I need a signature on that stamp?15:52
ericsnowperrito666: I wasn't going to bring it up <wink>15:52
katcoperrito666: i trust ericsnow's judgement15:53
katcoperrito666: go with it15:53
natefinchperrito666: me too15:54
perrito666so do I it is the burocratic weight of the stamp what I was looking for, but this is heavy enough for me to let it pass15:54
natefinchperrito666: I rubber stamped it15:55
perrito666natefinch: I already hit merge anyway :p15:55
perrito666I am hurried enough15:55
natefinchwow, those are some... ummm.... high level tests15:57
perrito666natefinch: ??15:57
perrito666there is a separate test for the function being run :) if that is what worries you15:58
natefinchsorry, high level isn't the right word..... what's the opposite of comprehensive?15:58
natefinchperrito666: ahh, ok15:58
natefinchperrito666: just with the changes, it looks like all we're testing is that the upgrade step has the right description15:58
perrito666natefinch: but again, htat was already there, only in the wrong version, the merge of the patch got delayed until 1.22 so the steps where added in a place where they would never run15:59
perrito666natefinch: well there is no way to test that the upgrade function does what it says15:59
perrito666we check that the steps are the right ones based on their description, we know that at least that is what we want to run16:00
natefinchperrito666: I'm sure there's a way to test that the upgrade function at least calls AddEnvUUIDToCharms....16:18
natefinchmgz, sinzui: I'm trying to connect to stilson, but can't seem to make the connection no matter how I do it.  pure VPN doesn't work for me, I just never can get a response from the IP address.  Martin told me about the CI bouncer, and I can connect to it, but I think I must be messing up the proxy command, because it never hops to stilson from the bouncer.16:25
sinzuinatefinch, I will get you a ssh config stanza16:30
natefinchsinzui: thank you.  I'll be afk for an hour-ish, so no rush16:31
=== natefinch is now known as natefinch-afk
katcoericsnow: nttac meeting16:34
katconttca16:34
katcoericsnow: hey can you join the nttca meeting again?17:32
=== natefinch-afk is now known as natefinch
mupBug #1450573 was opened: HA and backup recovery tests failed <backup-restore> <blocker> <ci> <ec2-provider> <ensure-availability> <regression> <juju-core:Triaged> <https://launchpad.net/bugs/1450573>17:45
TheMueanyone willing for a review of a forward port of a fix from 1.23 and 1.24 to now master? see http://reviews.vapour.ws/r/1538/. thx17:49
natefinchTheMue: you should reference the original PR so that it's easy to check that the port is the same as the original17:51
katconatefinch: running a little behind, may be slightly late17:55
natefinchkatco: no worries.  I know how it is.17:55
TheMuenatefinch: will add it17:56
TheMuenatefinch: done18:00
=== cmars` is now known as cmars
natefinchTheMue: ship it!18:02
TheMuenatefinch: thx18:02
natefinchTheMue: seems like we should be able to have an automated check that a forward port is identical to an existing PR on another branch and skip the second review.   obviously, if changes needed to be made to the PR for the forward port, then it needs human eyes, but for ones like this where it's identical... would be nice to skip that.18:07
TheMuenatefinch: sounds like a good idea. but now also the fix doesn't match the listed fixes, so I've got to use JNDI18:08
TheMuehmm, my CI output shows "Extant directories unknown: gopkg.in/juju/charm.v6-unstable". any idea what this means?19:05
TheMuenatefinch: any idea here ^^19:11
natefinchTheMue: no idea.  sinzui? ^19:11
sinzuinatefinch, are you using the make-release-tarball script?19:13
sinzuinatefinch, That error looks like the checks that ensure every package in the tarball is documented.19:13
TheMuesinzui: it's me, and I'm only trying to merge a PR into master.19:14
TheMuesinzui: only 5 files changes, dependencies are unchanged19:14
sinzuiTheMue, I think one of things you are trying to merge is injecting charm.v6-unstable. either we document that it is needed, or fix the code to not get it19:16
TheMuesinzui: strange, I only ported a fix, a few code lines19:19
perrito666TheMue:  if you brought charm v6 definitely its a bigger change, we where using v5 yesterday19:20
TheMueperrito666: no, I haven't. no change of imports. and I just scanned the code here, no where found19:21
sinzuiabentley, jog, something in CI is very wrong. it is trying to upgrade from 1.23.2 to 1.22.2. I think the upgrade-jenkins script was run a few hours too early19:24
* sinzui looks for downgrade options19:24
abentleysinzui: on the bright side, upgrade-jenkins-branches ran to completion without errors :-/19:25
sinzuiyep Ci is on the new 1.23.2, but we weren't ready for it19:25
sinzuiabentley, I will take this opportunity to downgrade to 1.21.1 to watch the upgrade19:26
sinzuiI just got a tax bill for $326,000 for the sale of my home 2 years. ago. I think I am going to pieces right now19:28
abentleysinzui: Wow.  Ugh.19:29
abentleysinzui: Yeah, you might want to take some time out.19:29
TheMueok, I'll retry then tomorrow19:29
sinzuiabentley, I think I need an account to explain to the IRS that I did pay tax, on the sale of my house, not the sale of a business under different tax lass19:30
sinzuilaw19:30
=== kadams54 is now known as kadams54-away
sinzuiperrito666, We had a misfire with the release of the new juju. all the CI machines got upgraded during the test. So it tried an impossible upgrade of 1.23.2 to 1.22.3 :(19:51
sinzuiperrito666, But CI has a cache of all the old jujus. I installed 1.21.3, then reset all the upgrade tests. All is well! The logs show after upgrade we could set new charms configs with and juju did the right thing \o/19:52
sinzuiI will update CI to the real stable when we are finished testing 1.22.319:53
sinzuiwow, and we just got a bless19:53
katcoericsnow: running just a little late brt20:00
ericsnowkatco: k20:00
perrito666Sinzui cool can i fwport  now?20:02
sinzuiperrito666, yep.20:03
perrito666Sweet20:04
sinzuiperrito666, should I make CI wait for your 1.23 merge? if it will be several hours, I would test 1.2420:09
perrito666I am at the dentist currently so it should be 1.5h from now :p20:12
perrito666There is a limit to the things you can do with a phone20:16
sinzuinatefinch, thank you!20:23
sinzuinatefinch, maybe I should also grab the old broken package and run in there too20:24
natefinchsinzui: certainly seems like a good idea.  I wish I knew more of how the packaging process worked, I might be of more help.  But I'm glad I was able to at least do this much.20:24
sinzuinatefinch, the container doesn't have our build deps ppa attached, so it is pure trusty, but I don't see anything in the ppa that could uncouple: https://launchpad.net/~juju/+archive/ubuntu/golang/+packages20:28
sinzuiregardless, natefinch you have given me something I can work with20:28
natefinchsinzui: I am really glad it's useful.20:31
sinzuiTheMue, CI s broken as you described in your own branch. I think an upstream change to a repo has broken all builds20:36
sinzuiTheMue, mgz discovered some months ago that Go will always get all the deps in the git master branch even when they will not be used. It pollutes the tree. mgz's fix was to fix the upstream repo.20:37
=== \b is now known as benonsoftware
menn0davecheney: morning21:06
sinzuikatco, wallyworld: we need to form an angry mob and address bug 1450631.21:09
mupBug #1450631: Something is injecting gopkg.in/juju/charm.v6-unstable into the tree <blocker> <ci> <packaging> <juju-core:Triaged> <juju-release-tools:Triaged> <https://launchpad.net/bugs/1450631>21:09
sinzuiI will send an email to the list since it break all merges and CI testing21:09
katcosinzui: sorry i was in a meeting... TAL now21:19
mupBug #1450631 was opened: Something is injecting gopkg.in/juju/charm.v6-unstable into the tree <blocker> <ci> <packaging> <juju-core:Triaged> <juju-release-tools:Triaged> <https://launchpad.net/bugs/1450631>21:22
jw4sinzui: it looks like it may be the github.com/juju/jujusvg repo that has a reference to gopkg.in/juju/charm.v6-unstable21:24
katcojw4: ty21:25
jw4sinzui, katco: I wonder if referring to jujusvg through gopkg.in would resolve this?21:25
sinzuijw4, uhg, we didn't change our dep of github.com/juju/jujusvg to get it though.21:25
sinzuijw4, maybe21:25
sinzuips jw4, did you get credentials to see test results?21:26
jw4sinzui: not yet21:26
jw4sinzui: alexisb is still working on that :)21:26
sinzuiokay, I will see If I can get that to you tommorow jw421:26
jw4sinzui: very likely the trigger: https://github.com/juju/jujusvg/pull/2821:28
jw4sinzui: we could ask jujusvg folks to tag our revision 28683402583926ce903491c14a07cdc5cb371adb as v1 maybe21:29
jw4sinzui: then we might be able to use gopkg.in21:29
jw4s/our revision/their revision/21:29
sinzuijw4, katco: while changing our dep to jujusvg in every branch might work around this issue, we cannot go back and change branches we aren't developing. Since we did an unplanned build of 1.22.3 today, I worry that we will not be able to respond to emergencys in older jujus21:30
jw4sinzui: jujusvg is not in dependencies.tsv for 1.2221:31
sinzuioh, I see what you are saying jw4. I think you are right. and this means that older branches are probably not affected21:31
sinzuijw4, jobs that make the tree will always reject when a package is not documented appears in the tree.21:32
jw4sinzui: yeah... I'm hoping that using gopkg.in it will pull in only the tagged versions and not the master revisions21:33
jw4sinzui: I haven't verified that yet though21:33
katcojw4: i think you are correct21:33
jw4sinzui: but we can't use gopkg.in on jujusvg until it's tagged21:33
jw4(otherwise we just get the default v0 which is master)21:34
sinzuiMakyo, ^ maybe you can help tag jujusvg so that we can build juju again21:35
jw4Makyo: if we could tag revision21:35
jw428683402583926ce903491c14a07cdc5cb371adb as v121:35
jw4in jujusvg that might help us with this CI issue21:36
sinzuiMakyo, or someone you know. We are getting gopkg.in/juju/charm.v6-unstable pulled into the juju tree. since it is not documented, the merge and build jobs break21:36
jw4Makyo: it might even be better if v1 was a branch vs. a tag21:36
sinzuijw4, I might have permission to tag it!21:38
jw4sinzui: woot!21:38
sinzuiwell yes I can tag, lets see if I can push tags21:38
sinzuijw4, is this what you expect for the tag command?21:42
sinzuigit tag -a v1 -m "Version 1 for gopkg.in." 28683402583926ce903491c14a07cdc5cb371adb21:42
sinzuijust "v1"21:42
katcowhat branch is this being triggered on? 1.24?21:42
sinzuikatco, every branch!21:42
jw4katco: 1.24 and master21:42
katcogodeps -u dependencies.tsv && cat dependencies.tsv |awk '{print $1}' |xargs -I % grep -r "charm.v6" $GOPATH/src/%21:42
katcothis is not giving me anything useful21:42
sinzui1.23 1.24 and all the feature branches21:42
jw4katco: it's a transitive dependency21:42
sinzuikatco, hence we know something happened outside of juju21:43
jw4katco: github.com/juju/jujusvg master refers to charm.v621:43
katcojw4: right, so i am searching all of juju-core dependencies for charm.v621:43
katcoand i'm not finding anything?21:43
jw4katco: exactly21:43
jw4katco: that's why CI is complaining21:43
sinzuikatco, that is the error, you will not find it because it is not supposed to be there..21:43
jw4CI compares what go get builds against dependencies.tsv21:43
katcojw4: no as in, none of juju-core's dependencies are referencing charm.v6-unstable21:44
jw4katco: that's the problem jujusvg does21:44
sinzuikatco, and all merging branches, not just ci21:44
jw4but not in the version that's pinned21:44
sinzuijw4, is the tag just "v1"21:44
jw4sinzui: yeah I think so21:44
katcojw4: but if not in the version that's pinned, why is it causing problems? effectively juju is not utilizing a version of jujusvg that is referencing charm.v6?21:45
jw4katco: so "go get" pulls down jujusvg master which refers to charm.v6, causing charm.v6 to be pulled down21:45
Makyosinzui, jw4 Will gladly tag, but I'm a little curious, why is jujusvg showing up in core?21:45
katcojw4: so the ci server is doing a go get, and not a godeps?21:46
jw4katco: even go deps does a go get first before syncing to the right revision21:46
jw4Makyo: good question21:47
sinzuikatco, merge might be, but the rules to make the tar ball don't besides, I think godeps is still calling git to do something which is still the problem21:47
katcojw4: so the issue is that charm.v6 exists at all on the CI server?21:47
Makyojw4, jujusvg's only consumer should be charmstore21:47
katcojw4: not that juju-core uses it?21:47
jw4katco: exactly21:47
katcojw4: thx for walking me around the block on that21:47
jw4katco: because CI checks that all dependencies downloaded are accounted for21:47
sinzuikatco, not at all21:47
jw4Makyo: it's in our dependencies.tsv, but it's not actually referred to in code... I think it's a transitive dependency21:48
jw4Makyo: gimme a sec to figure out the third level up :)21:48
sinzuikatco, anyone who tries to get juju using go get or godeps is getting a tree witn unised deps because Go's use of git is to always checkout master.21:48
Makyojw4, ack, thanks.  I'll work on tagging.21:49
jw4Makyo: it's charmstore.v4 that's using it21:49
sinzuikatco, There are jobs owned by Core to do merging, and jobs owned by QA to make release tarballs for testing. Both jobs fail because the tree contains a package that us not Used. Ubuntu requires us to abort. We cannot accept a unused an undocumented dep21:49
jw4Makyo: so it's a legitimate transitive dependency21:49
katcosinzui: i understand now. ty21:50
sinzuiI might be a minute from fixing this if someone can config the tag is just "v1"21:50
Makyojw4, alright, thanks21:50
jw4sinzui: Makyo will tag for us... (thanks Makyo)21:50
katcowell it sounds like you guys have this under control, and i'm well past eod and need to get dinner going21:51
katcoi'll see you all around21:51
jw4katco: control is an illusion21:51
jw4katco: ttyl21:51
katcojw4: later morpheus ;021:51
katco;)21:52
jw4haha21:52
sinzuiI think my main dislike of Christmas is lack of control. I don't like surprises, even if they are gift wrapped.21:53
jw4sinzui: I'm so there... I hate surprises :)21:53
Makyojw4, sinzui gopkg.in/juju/jujusvg.v1 should now work.  I went with 890de36 because that's the commit before charm.v6 was added, but after the NewFromBundle() api solidified.21:57
Makyojw4, sinzui if need be, I can roll it back.  I went with a branch for v121:57
jw4Makyo: actually I preferred a branch21:57
jw4Makyo: that should be fine21:58
jw4Makyo: thanks@!21:58
Makyojw4, np, ping if anything else comes up around that.21:58
jw4sinzui: now for the test21:58
jw4Makyo: will do21:58
sinzuijw4, shall I just ask CI to start again?21:58
jw4sinzui: we have to update dependencies.tsv... but I just realized... charmstore will have to use the gopkg version21:59
sinzui:?21:59
sinzuiWell this is a pickle21:59
jw4sinzui: because it's charmstore that actually causes the transitive download of jujusvg21:59
jw4sinzui: a veritable dilly of a pickle22:00
* sinzui ponders a hack to just purge undocumented deps22:01
jw4sinzui: the good news is, it looks like the gopkg.in version works without pulling in charm.v622:01
sinzui:)22:02
jw4sinzui: so now we just need to get a PR in to charmstore...22:02
wallyworldsinzui: i'm back now, catching up on irc croll back22:03
Makyojw4, sinzui will +1 it22:04
MakyoI will, that is.  Vague.22:04
jw4Makyo: hehe22:04
sinzuiwallyworld, jw4: My family insists we celebrate the mixed news my son got into advanced academics and the IRS sent me a $326,000 bill. When  I might hack the scripts to ignore the bad package so that we can test what we have. We are not planning to releasing any of th development branches this week22:11
jw4sinzui: that's crazy - congrats on one of those bits of news22:11
sinzui:)22:12
jw4sinzui: okay - it looks like I'll need at least 2 PR's to convert to gopkg.in anyway22:12
wallyworldsinzui: oh wow22:14
wallyworldgo have fun and drown your sorrows22:14
wallyworldsurely that bill is a mistake22:14
jw4Makyo: I think we're going to need the v1 branch to start right at 28683402583926ce903491c14a07cdc5cb371adb, and then I'll do a PR to update internal references to github.com/juju/jujusvg to use gopkg.in/juju/jujusvg.v122:37
jw4Makyo: the problem is the head of the v1 branch has some breaking API changes (IconFetcher interface) that would cascade out22:38
Makyojw4, ack, sounds good.22:39
Makyojw4, otp, will do after22:39
jw4Makyo: thanks...22:39
jw4Makyo: I'll be in and out the next few hours, but appreciate it whenever you get that change in22:39
Makyojw4, np, will do22:39
Makyojw4, git's amazing and now that's done, I think.22:41
jw4suh-weet!22:41
jw4Makyo: thanks again22:41

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!