[00:27]  * bigjools waves at roaksoax
[01:15] <roaksoax> bigjools: here
[01:16] <bigjools> roaksoax: howdy
[01:16] <roaksoax> bigjools: howdy!
[01:16] <bigjools> just seeing where we're at with that filtering bug on imports?
[01:16] <roaksoax> bigjools: huh?
[01:16] <bigjools> https://launchpad.net/bugs/1240215
[01:16] <ubot5> Ubuntu bug 1240215 in MAAS "changing the default arches in import_pxe_files prevents maas-import-ephemerals from running" [Critical,Confirmed]
[01:17] <bigjools> I wasn't sure if it needed more work or if the simplstreams library fix helped
[01:17] <roaksoax> bigjools: well I was thinking it might be easy to fix provided that we split('/')
[01:17] <roaksoax> bigjools: no I don't think it is the simplestreams stuff
[01:17] <roaksoax> smoser: ^^
[01:17] <bigjools> ok
[01:18] <bigjools> we're all deep fixing the multi-environ thing at the moment
[01:19] <roaksoax> bigjools: ok i'll see what i can do with the ephemerals stuff
[01:31] <roaksoax> bigjools: this fixes it: http://paste.ubuntu.com/6243363/
[01:36] <bigjools> roaksoax: nice.  Add a test and I'll approve it.
[02:01] <smoser> roaksoax, i replied to that MP
[02:01] <smoser> but you also have to consider '/highbank' might be in there.
[02:01] <smoser> you might as well do somethign like:
[02:02] <roaksoax> smoser: there's something further down for highbank
[02:02] <smoser> i dont thinkt hat covers it
[02:03] <smoser> ' '.join([f.split("/")[0] for f in legacy_config.get('ARCHES', '').split()])
[02:03] <smoser> something like that maybe
[02:09] <roaksoax> smoser: yeah that works! thakns!
[02:18] <roaksoax> bigjools: https://code.launchpad.net/~andreserl/maas/fix_lp1240215/+merge/191327
[02:18] <roaksoax> smoser: ^^
[02:19] <roaksoax> bigjools: all yours. Im gonna patch the mpackage and upload
[02:19] <bigjools> roaksoax: looks ok I'll approve
[02:19] <bigjools> roaksoax: there's another fix landed recently to support multi-environs
[02:19] <bigjools> can you take that too?
[02:19] <roaksoax> bigjools: what's the rev?
[02:19] <bigjools> fixes
[02:19] <roaksoax> bigjools: rev's and bug number please :)
[02:20] <bigjools> roaksoax: see branches attached to https://bugs.launchpad.net/maas/+bug/1239488
[02:20] <ubot5> Ubuntu bug 1239488 in MAAS "Juju api client cannot distinguish between environments" [Critical,In progress]
[02:21] <bigjools> r1708, 1709, 1710 basically
[02:21] <roaksoax> bigjools: are all of those the actual fixes?
[02:21] <roaksoax> bigjools: i mean
[02:21] <roaksoax> final fixes?
[02:22] <roaksoax> no more fixes for that bug?
[02:22] <bigjools> roaksoax: I think so - the rest of the fixes are in juju
[02:22] <roaksoax> ok cool
[02:22] <bigjools> roaksoax: also see 1707, bug 1228085
[02:22] <ubot5> bug 1228085 in MAAS "The commissioning script 00-maas-03-install-lldpd outputs to stderr." [Critical,Triaged] https://launchpad.net/bugs/1228085
[02:23] <bigjools> possibly bug 1190986
[02:23] <ubot5> bug 1190986 in MAAS "ERROR Nonce already used" [High,Fix committed] https://launchpad.net/bugs/1190986
[02:23] <bigjools> not *critical* though
[02:23] <roaksoax> bigjools: yeah.. that's the thing...
[02:23] <bigjools> bug 1238376
[02:23] <ubot5> bug 1238376 in maas (Ubuntu) "maas-import-ephemerals no longer inherits config from maas-import-pxe-files" [Critical,Confirmed] https://launchpad.net/bugs/1238376
[02:24] <bigjools> you got that one I think
[02:24] <roaksoax> bigjools: yeah so only the critical bugs will get in
[02:24] <roaksoax> there's 4 fixes, already
[02:24] <roaksoax> and the multienvironment
[02:24] <roaksoax> is 3 patches
[02:24] <bigjools> yep
[02:24] <roaksoax> not sure that the release team will be happy about that
[02:24] <roaksoax> smoser: ^^
[02:24] <bigjools> you can merge three into one
[02:24] <bigjools> they're consecutive
[02:25] <roaksoax> bigjools: yeah
[02:25] <bigjools> I can't see why they would be unhappy to take critical fixes
[02:25] <bigjools> I'd be fucking ecstatic
[02:26] <roaksoax> bigjools: one day before release... whgen the ISO isprobably read already?
[02:26] <roaksoax> bigjools: which would cause an ISO re-spin
[02:26] <roaksoax> i don't think they'll be happy
[02:26] <bigjools> it's not on the iso though is it?
[02:26] <bigjools> oh server iso
[02:26] <bigjools> ok
[02:26] <bigjools> 0-day fix it is :)
[02:27] <roaksoax> bigjools: yeah, so the ephemeral stuff is important for the ISO
[02:27] <bigjools> ok
[02:27] <bigjools> well apparently the cloud-installer would take much longer without this fix
[02:27] <roaksoax> bigjools: this is what I have so far: http://paste.ubuntu.com/6243516/
[02:28] <bigjools> roaksoax: and you need the multi-env one
[02:28] <roaksoax> yep
[02:28] <bigjools> ~400 lines though :/
[02:29] <roaksoax> bigjools: ahh
[02:29] <roaksoax> bigjools: then release team *wont* be happy
[02:29] <bigjools> dunno why they would get unhappy about the size, it is either critical or it isn't
[02:30] <roaksoax> bigjools: yeah i think i know how to approach taht one
[02:30] <roaksoax> bigjools: let me know when you approve the ephemeral fix plz
[02:30] <bigjools> done
[02:34] <roaksoax> bigjools: the fixes for juju don't look so bad.. since I only take the actual patch and not the changes in the test
[02:35] <bigjools> roaksoax: yeah I have one more fix coming for juju
[02:35] <bigjools> working on it right now
[02:35] <roaksoax> bigjools: ok
[02:35] <roaksoax> alright
[02:35] <roaksoax> i'll be back later then
[02:35] <bigjools> thanks roaksoax
[02:35] <bigjools> remind me to buy you a beer next week :)
[02:36] <roaksoax> lol will do
[02:36] <roaksoax> bigjools: remind me to make you drink lots of pisco :P
[02:36] <bigjools> roaksoax: I can't drink at the moment :(
[02:36] <roaksoax> boomer
[03:33] <roaksoax> bigjools: how's the fix looking?
[03:33] <bigjools> roaksoax: slow .... this is Go after all
[03:33] <roaksoax> heh
[03:33] <bigjools> nearly there
[03:33] <bigjools> well,  nearly ish
[03:33] <roaksoax> bigjools: i might have to get that package uploaded tomorrow then
[03:33] <roaksoax> cause I'm about to die
[03:34] <roaksoax> unless we do sru
[03:34] <bigjools> roaksoax: yeah it won't get done in the next hour :/
[03:35] <roaksoax> bigjools: so my take is this, I can upload a new maas package with the fixes, and tomorrow, i make another upload which willk most likely be as a 0day sru
[03:35] <roaksoax> unless they can process it
[03:36] <bigjools> roaksoax: ok
[03:36] <bigjools> that's the best we can hope for then
[03:37] <roaksoax> bigjools: yeah cause eitherway I don't think they will process the upload today
[03:37] <roaksoax> bigjools: but at least I ensure that the fixes up until now are uplaoded
[03:38] <roaksoax> and easier to negotiate on getting them released
[03:38] <bigjools> roaksoax: great
=== freeflying is now known as freeflying_away
=== freeflying_away is now known as freeflying
=== CyberJacob|Away is now known as CyberJacob
[06:32] <bigjools> roaksoax: my juju change landed on trunk
[07:51] <gnuoy> I'm doing a fresh deployment with juju on a MaaS cluster. I can bootstrap the juju env fine using a tag to specify the bootstrap node but when I try and deploy a charm I don;t see any physical servers getting allocated in the maas UI and after a minute os so juju reports "error: cannot run instances: gomaasapi: got error back from
[07:51] <gnuoy>       server: 409 CONFLICT" as the agent state info for the new machine
[07:53] <gnuoy> I have 16 servers in the Ready state using juju-core  1.16 and maas 1.2+bzr1373+dfsg-0ubuntu1~12.04.2
[07:54] <gnuoy> Not sure if this is relevant but all the machine have a manual tag and I'm not specifying a tag constraint  to juju at the moment
[07:56] <gnuoy> I'll try removing a tag and trying again
[07:57] <bigjools> gnuoy: I think the tag for bootstrapping gets applied by default in juju
[08:00] <gnuoy> hi bigjools, looking in the maas.log I see "NodesNotAvailable: No matching node is available". So if all machines have a tag and you try to deploy a charm without specifying tag is refusing to allocate a machine the desired behaviour ? I'm trying to think if that makes sense
[08:01] <gnuoy> By not specifying a tag constraint with juju are you saying "This can go anywhere I don't care" or are you saying "This can only go to machines which haven't been preallocated with a tag"
[08:03] <bigjools> gnuoy: it uses the constraints from the bootstrap node IIRC
[08:03] <bigjools> so if you put a tag on it then it expects all machines to have that tag
[08:03] <bigjools> did you say all the machines have that tag?
[08:04] <bigjools> sorry I have to run - try asking in the juju-dev channel
[08:04] <bigjools> back later
[08:04] <gnuoy> bigjools, ok, thanks.
[10:10] <jamespage> bigjools, still around? I need to understand which MAAS bugs are still outstanding for Saucy
[10:10] <jamespage> and which ones we must land pre-release (i.e. it matters if they are on the ISO)
[10:11] <jamespage> allenap, maybe you can help with that if bigjools is eod?
[10:11] <bigjools> jamespage: I am EOD but I can help
[10:11] <jamespage> bigjools, marvellous!
[10:11] <bigjools> I did give a list to roaksoax earlier
[10:12] <jamespage> yeah - I was just looking through those
[10:12] <bigjools> bug 122805
[10:12] <ubot5> bug 8422 in tsclient (Ubuntu) "duplicate for #122805 Error message on ending VNC session" [Medium,Won't fix] https://launchpad.net/bugs/8422
[10:12] <bigjools> ummm
[10:12] <bigjools> bug 1228085
[10:12] <ubot5> bug 1228085 in MAAS "The commissioning script 00-maas-03-install-lldpd outputs to stderr." [Critical,Triaged] https://launchpad.net/bugs/1228085
[10:13] <bigjools> bug 1238376
[10:13] <ubot5> bug 1238376 in MAAS "maas-import-ephemerals no longer inherits config from maas-import-pxe-files" [Critical,Fix committed] https://launchpad.net/bugs/1238376
[10:13] <bigjools> bug 1239488
[10:13] <ubot5> bug 1239488 in maas (Ubuntu Saucy) "Juju api client cannot distinguish between environments" [High,Triaged] https://launchpad.net/bugs/1239488
[10:13] <bigjools> bug 1240215
[10:13] <ubot5> bug 1240215 in MAAS "changing the default arches in import_pxe_files prevents maas-import-ephemerals from running" [Critical,Fix committed] https://launchpad.net/bugs/1240215
[10:14] <jamespage> bigjools, ok so bug 1238376 got patched in
[10:14] <ubot5> bug 1238376 in MAAS "maas-import-ephemerals no longer inherits config from maas-import-pxe-files" [Critical,Fix committed] https://launchpad.net/bugs/1238376
[10:14] <bigjools> cool
[10:15] <jamespage> ditto bug 1240215
[10:15] <ubot5> bug 1240215 in MAAS "changing the default arches in import_pxe_files prevents maas-import-ephemerals from running" [Critical,Fix committed] https://launchpad.net/bugs/1240215
[10:15] <bigjools> I saw roaksoax made a patch for everything except 1239488
[10:15] <bigjools> that's a big one
[10:15] <jamespage> I think bug 1239488 and bug 1228085 are still outstanding
[10:15] <ubot5> bug 1239488 in maas (Ubuntu Saucy) "Juju api client cannot distinguish between environments" [High,Triaged] https://launchpad.net/bugs/1239488
[10:15] <ubot5> bug 1228085 in MAAS "The commissioning script 00-maas-03-install-lldpd outputs to stderr." [Critical,Triaged] https://launchpad.net/bugs/1228085
[10:16] <jamespage> bigjools, i guess this is related to bug 1229275
[10:16] <ubot5> bug 1229275 in juju-core "[maas] juju destroy-environment also destroys nodes that are not controlled by juju" [Critical,In progress] https://launchpad.net/bugs/1229275
[10:16] <bigjools> rvba: is https://bugs.launchpad.net/maas/+bug/1228085 fixed?
[10:17] <rvba> bigjools: yes
[10:17] <bigjools> jamespage: that one is all done actually I marked the maas task as fixed
[10:17] <bigjools> rvba: uh why does it say triaged?
[10:17] <rvba> bigjools: someone forgot to flip the switch.
[10:17] <bigjools> jamespage: sorry to be clear, bug 1239488 is all done
[10:17] <ubot5> bug 1239488 in maas (Ubuntu Saucy) "Juju api client cannot distinguish between environments" [High,Triaged] https://launchpad.net/bugs/1239488
[10:18] <jamespage> bigjools, landed in maas but not yet in distro right?
[10:18] <bigjools> jamespage: right
[10:18] <jamespage> bigjools, and there is an associated juju-core fix I need to pull for that as well I think
[10:19] <bigjools> jamespage: correct- but that ones a little complicated because after Gavin and I landed branches, they wanted to change something again
[10:19] <bigjools> so talk to roger peppe
[10:19] <jamespage> I am
[10:19] <bigjools> tip top
[10:19]  * bigjools has the Norfolk lingo down pat
[10:21] <bigjools> jamespage: ok anything else?
[10:24] <jamespage> bigjools, I thinks thats OK for now - thanks for the help
[10:24] <jamespage> (I was being asked in #ubuntu-release)
=== freeflying is now known as freeflying_away
=== freeflying_away is now known as freeflying
[14:37] <jpds> How does one find out which tests failed for a machine in MAAS?
[15:32] <jpds> roaksoax: Would you know? ↑
[15:35] <roaksoax> jpds: the webui should show which failed
[15:36] <jpds> I see a 02-maas-virtuality.
[15:37] <roaksoax> jpds: 2 out of 5?
[15:38] <jpds> roaksoax: Yes.
[15:44] <roaksoax> jpds: so that's probably the one that failed
[15:44] <roaksoax> jpds: you can get into the image and debug
[15:44] <roaksoax> jpds: https://lists.launchpad.net/maas-devel/msg00808.html
[15:45] <jpds> roaksoax: Is there anything in the docs about debugging?
[15:45] <roaksoax> jpds: yes
[17:02] <jpds> roaksoax: And got it to work, helps if I give them a proxy so they can get to the internet.
[17:07] <roaksoax> jpds:  yep :)
[19:25] <allenap> smoser: Ought there to be a lock around critical parts of maas-import-pxe-files too?
[19:27] <smoser> allenap, i suppose probably. i have not really thought about that.
[19:28] <allenap> smoser: I'll look into doing it. Do you think this is a critical bug?
[19:29] <smoser> allenap, well i'm not sure how matsubara hit it
[19:29] <smoser> its trivial to lock such things
[19:29] <smoser> i pointed at the apparently "correct" way to do it in celery
[19:29] <smoser> but you could just do it below celery with 'run-one' in ubuntu (although that is in universe).
[19:31] <allenap> smoser: That's a good solution, but unfortunately it means pulling in django on the clusters, which I'd rather avoid.
[19:31] <matsubara> smoser, allenap: I tried maas-import-pxe-files with run-one but it didn't work: http://10.189.74.2:8080/view/MAAS/job/saucy-adt-maas-manual/ARCH=amd64,label=lenovo-RD230-01/113/console, I guess you meant running import_ephemerals.py with run-one then?
[19:31] <matsubara> allenap, and the qa-lab-tests found that bug. sometimes the tests pass but more often than not it hits the checksum error
[19:31] <allenap> run-one also uses the whole command line when considering locks, iirc, but we want to restrict anything in the datadir.
[19:32] <allenap> matsubara: It's great they hit it. Did it take a lot of work from there to figuring it out?
[19:32] <matsubara> yes
[19:32] <smoser> allenap, oh. i didn't know.
[19:33] <matsubara> allenap, annoyingly yes, specially because I thought initially the problem was with the proxy, so wasted a lot of time checking that squid was doing what it was supposed to be doing
[19:33] <smoser> allenap, i dont know *why* they hit it ghouth.
[19:33] <matsubara> allenap, and the qa-lab-tests had horrible debug output when maas-import-pxe-files fails (which is now fixed by a another branch of mine)
[19:34] <matsubara> so it was painful but I think it'll turn out to improve the quality of the tests at least
[19:49] <matsubara> allenap, if you have a fix, I can help test it in the qa lab
[19:50] <allenap> matsubara: I'm looking at that now.
[19:50] <matsubara> allenap, thank you
[20:14] <adam_g> after updating MAAS to 1.4+bzr1693+dfsg-0ubuntu2~ctools,  'juju status' giving me: ERROR TLS handshake failed: x509: certificate signed by unknown authority 1.
[20:14] <adam_g> any ideas?
[20:52] <roaksoax> adam_g: nope, but the updates do not mess with juju sections at all.... unless related to the bson issue... but that';s weird either way
[20:52] <roaksoax> bigjools: ^^
[21:59] <adam_g> roaksoax, hmm must have been something unrelated. cleared ~/.juju/environments and its working again.. but now it seems IPMI stopped :|
[22:02] <adam_g> roaksoax, hmm. nvm. looked like celery wasn't connected properly
[22:05] <roaksoax> adam_g: hehe ok :)
[22:53] <bigjools> roaksoax: did a newer version get uploaded with the patch for multi-envs?
[22:53] <roaksoax> bigjools: nope
[22:53] <bigjools> roaksoax: SRU then?
[22:53] <roaksoax> bigjools: we determined that's not release critical
[22:54] <roaksoax> bigjools: yep
[22:54] <roaksoax> bigjools: i'll upload tomorrow and bug for it to get in tomorro
[22:54] <bigjools> it's release day here!
[22:55] <bigjools> sadly, my desktop is riddled with problems :(
[22:56] <roaksoax> bigjools: he,... mine running smoothly
[22:56] <bigjools> I currently have an awful unstoppable noise coming from the speaker... brb, rebooting
[22:57] <bigjools> ah better
[23:38] <bigjools> roaksoax: fyi http://maas.ubuntu.com/docs/changelog.html
[23:38] <bigjools> argh
[23:38] <bigjools> https://bugs.launchpad.net/bugs/1240570
[23:38] <ubot5> Ubuntu bug 1240570 in MAAS "please add exynos5 support to ephemerals" [Undecided,New]
=== CyberJacob is now known as CyberJacob|Away