/srv/irclogs.ubuntu.com/2013/10/09/#maas.txt

smoserstokachu, still there00:03
smoser?00:03
smoserhttp://paste.ubuntu.com/6211669/00:03
smoserso that "works for me". and I tested by following doc/devel/README.txt00:05
smoserand my 'launch' command00:05
smoser./tools/launch $BOOTIMG --publish $ROOTTGZ --add config -- curtin -v install --config config/my-network.conf "PUBURL/${ROOTTGZ##*/}"00:05
=== CyberJacob is now known as CyberJacob|Away
roaksoaxbigjools: if you can review the moonshot stuff would be greatlt appreciated02:09
bigjoolsroaksoax: I am overloaded with stuff at the moment, I will ask jtv to look02:09
jtvWhat needs reviewing?02:10
roaksoaxthanks02:10
roaksoaxlp:~andreserl/maas/moonshot_enablement02:10
jtvOK02:10
roaksoaxjtv btw is maas-import-ephemerals done?02:10
jtvJust about.  We need to back up the old pserv.yaml before overwriting it, the "arches" setting needs to be in a place where it can be shared between the import scripts, and some settings can do with clearer names.  But that's all easy stuff.02:14
jtvWith those changes in place, we can land the switchover branch that is already pending.02:14
roaksoaxawesome02:15
roaksoaxjtv: thanks for the hardwork02:15
jtvAll in a good cause!02:16
jtvOh, I see Raphaël has the back-up-pserv.yaml branch up for review already.02:16
jtvExcuse me while I do reviews...02:16
jtvArgh.  Nope.  That looks buggy.  OK, so back to plan A.  :)02:18
jtvNope, nope, it works.  Go Raphers!02:19
jtvroaksoax: that mechanism for including scripts in the userdata is really paying off, isn't it?02:22
roaksoaxjtv: yeah i love it...02:22
roaksoaxwanna put maas_enlist there when i rewrote it to pythin02:22
bigjoolscan we bring maas-signal back there too?02:23
roaksoaxbigjools: xan you subscribe maas-maintainers to djorm-ext-pgarray .. kinda critical02:25
roaksoaxbigjools: and maas signal has always been in maas the reason why we ship itnwith maas-enlist is for end user usage on remote nodes02:25
bigjoolsyes I was getting mixed up02:26
bigjoolsroaksoax: what do you need the subscription for?02:27
roaksoaxbigjools: it is already.. to be able to promote the package to main02:27
roaksoaxit needs bug subscriber02:27
bigjoolsroaksoax: I don't understand what you want02:28
roaksoaxbigjools: nevermind it is done already02:29
roaksoaxbigjools: but add maas-maintainers as a subscriber for launchpad.net/ubuntu/+source/curtin02:30
bigjoolsroaksoax: bug subscriber you mean?02:30
bigjoolsI will not add teams as subscribers to things as that's pretty obnoxious, people should subscribe themselves02:31
* jtv comes up from email, gasps for breath, goes under again02:32
roaksoaxbigjools: well maas-maintaoners maintain those packages02:37
roaksoaxnot just me02:37
roaksoaxthats why it is subscribes02:37
bigjoolsthat's fine but team subscriptions suck02:37
roaksoaxthats a maas dependenxy that *we* maintain02:37
bigjoolsI subscribed myself, feel free to ask the red guys02:37
roaksoaxas it is in ubuntu only for maas02:37
bigjoolsnow, which sprint track is maas in at SF ...02:40
jtvroaksoax: bigjools also wrote some script to detect whether the host is physical or virtual...  He checked for qemu initially, but I think he found a more general way.02:42
bigjoolsjtv: I didn't :)02:42
jtvOh blast.  Maybe it was allenap then.02:42
bigjoolsthere's a package called imvirt that we should use02:42
bigjoolsjtv: well I wrote a commissioning script02:43
bigjoolsbut we need to generalise02:43
jtvFound it.  roaksoax, have a look at src/metadataserver/models/commissioningscript.py and search for "notvirtual"02:43
jtvI see now that it does mention qemu...02:44
jtvStill, may be useful to compare, to see if we get consistent answers.02:44
stokachusmoser: nice testing that now03:31
smoserstokachu, oh. in-target wont work in your version03:38
smoser:-(03:38
smoserbut this should03:38
smoserhttp://paste.ubuntu.com/6212161/03:40
smoserand i'm off to bed now.03:40
stokachusmoser: thanks will test some more03:47
stokachuinteresting the web-ui doesn't update the nodes start/stop status if commissioning/starting nodes through maas-cli04:59
stokachuand of course just after i type that it shows up05:00
* stokachu is tired apparently05:00
=== CyberJacob|Away is now known as CyberJacob
bigjoolsjtv: we need to fix the Makefile so "make doc" does not try to rebuild the database.  Very annoying :/06:52
jtvUrgent?06:54
rvbajtv: did you merge lp:~rvb/maas/backup-config ?06:54
jtvNo...  I assumed you had.06:54
jtvBecause it's landed.06:54
rvbaWeird, I didn't06:55
rvbajtv: is everything okay for me to land the branch that makes the switch to the new script?06:55
jtvNot _quite_.  I need two simple reviews!06:55
rvbaOkay, I'll review them now.06:56
rvbaI really want us to do the switch so that I can do another round of testing.06:56
jtvThanks.  I'll be back by call time.06:57
jtvYes, quite.06:57
rvbajtv: all reviewed, let's land!07:27
bigjoolsrvba, jtv: apparently juju-core now supports maas-tags as constraints07:29
rvbajtv: should I land the switch now?07:50
jtvrvba: let me just check if my last branch landed — previous attempt failed because of the prerequisite.07:50
rvbak07:51
jtvAh yes, that's landed.07:51
jtvSo go ahead!07:51
* rvba lands07:51
rvbabigjools, jtv, allenap: All of the migration-related branches have landed… and the branch that switches to the new script has landed as well… a package is being built in the daily ppa… test away!08:14
=== freeflying_away is now known as freeflying
allenapjtv: Thanks for looking at that PostgreSQL thing. I suspect we just take the hit first time around.08:15
jtvallenap: I don't know much about the situation, but it seems reasonable...  Or maybe there's some heuristic that will get most of the rows you want to delete.08:18
rvbabigjools, allenap, jtv: the package is ready.  fresh outta the oven.08:28
jtvDoes it work?08:28
allenaprvba: What jtv said.08:28
rvbaWell, we all need to test it!08:28
jtvAnd is this in the daily PPA?08:30
rvbajtv: yes08:30
=== CyberJacob is now known as CyberJacob|Away
bigjoolsallenap: have you got a quick example of how to use the LLDP constraints?08:59
rvbabigjools: do you have time to have a look at: https://code.launchpad.net/~rvb/maas/fpi-button/+merge/19004909:00
bigjoolssure09:00
rvba?09:00
rvbaTa09:00
bigjoolsrvba: s/curtin/fast installer/ on the buttons09:01
rvbabigjools: well, I thought you were okay with both… I choose curtin because it is shorter.09:02
bigjoolsrvba: it's too jargon-y for the UI09:02
allenapbigjools: From Juju, no; Dan said he was going to talk to mramm about getting someone to sort that out on their side.09:02
bigjoolsallenap: they said it was working I hear09:02
rvbabigjools: then we need to re-work the wordings entirely, otherwise it won't fit09:02
allenapbigjools: With regards to a tag, yes, I'll find something...09:02
bigjoolsallenap: cheers09:02
bigjoolsrvba: how many characters do we have?09:03
rvbabigjools: let's say that what we have now fits.09:03
bigjoolsok but new people are going to say "wtf is curtin?"09:03
rvbaAnd we don't have much more space.09:04
bigjoolsdude!09:04
bigjoolsdisplay = "Use the default installer"09:04
bigjoolsis longer :)09:04
rvbabigjools: the critical piece is display_bulk.09:04
bigjoolsdisplay_bulk = "Mark the selected nodes as using the default installer"09:05
bigjoolss/default/fast/ in the other button09:05
rvbaI'm testing that right now.09:05
bigjoolsok09:05
rvbabigjools: s/default/fast/ in the other button?09:05
rvbad-i is not fast :)09:06
bigjoolsthe UseCurtin one09:06
bigjoolsyou already have something *longer* for the d-i button09:06
rvba"Use the fast path installer" does not fit on the node's page.09:06
bigjoolss/path// then09:07
rvba"Use the default installer" fits09:07
bigjoolsso two options:09:07
bigjools"Use the fast installer"09:07
bigjoolsand09:07
bigjools"Use the default instaler"09:07
bigjoolsok?09:07
rvbaYeah, that's the best option.09:07
bigjoolsgreat09:07
rvbaMark the selected nodes as using the fast installer/Mark the selected nodes as using the default installer09:07
rvbaThat fits.  It's a bit tight but okay.09:08
bigjoolsFWIW I got caught out the other week when I assumed should_use_fastpath_installer was a property :(09:08
allenapbigjools: //lldp:chassis/lldp:id[@type="mac"]/text() = "20:4e:7f:94:2e:10"09:09
allenapwould select a machine that's connected to the router with that MAC.09:10
* bigjools blinks09:10
bigjoolsremind me which API field...09:10
allenapbigjools: Tag definition.09:10
bigjoolsok09:10
allenapbigjools: routers are a special case for acquire(); it now accepts connected_to and not_connected_to arguments, which are MACs.09:11
allenapOr multiple MACs.09:11
bigjoolsallenap: nice09:12
allenapbigjools: rvba did that bit.09:12
bigjoolsallenap: this sounds like it needs its own doc09:12
bigjoolstoo much for release notes09:12
allenapbigjools: Yep.09:12
bigjoolsOk when I land the release notes, someone can add a :ref: to the new doc09:13
rvbabigjools: I pushed the change to my fpi-button branch.09:14
bigjoolsrvba: should I be concerned that the ordering changed in test_views_nodes.py?09:15
bigjoolsoh you changed the code being tested.   sorry09:16
rvbabigjools: the ordering?  AFAIK I only changed the error messages.09:16
bigjoolsyeah my bad09:16
bigjoolsapproved¬09:16
bigjoolsapproved!09:17
rvbaTa09:17
rvba¡Ta!09:17
bigjools¡Olé!09:21
rvbaallenap: I'll rebuild the package soon, if you want to land your lldp to be part of the build you can do so now (unless you want to tweak the UI some more before landing).09:23
bigjoolshttps://code.launchpad.net/~julian-edwards/maas/release-notes-13.10/+merge/19006109:25
bigjoolshello gmb09:25
gmbHi bigjools.09:25
gmbbigjools: My account on Kanban appears to have been deactivated… I'm assuming that wash;'t you and am contacting their help desk, but just to check… ;)09:26
allenaprvba: I probably won't be ready in time.09:26
bigjoolsgmb: oh didn't anyone tell you yet?09:26
* bigjools joking09:26
gmbLaugh? Nearly shat.09:26
bigjoolsallenap: can you check my release notes branch please?09:27
allenapbigjools: Sure.09:27
bigjoolsgracias09:27
bigjoolsor ¡gracias!09:27
rvbaallenap: okay, no worries.  We can build a package quickly with https://code.launchpad.net/~julian-edwards/+recipe/maas-daily-saucy so just build a package when you land you branch and then we'll test it.09:28
rvbayour* branch09:28
bigjoolsgmb: you're still marked as a board user for the maas board so that's all very odd09:28
gmbbigjools: Hmm… sounds like some kind of password / authentication snafu. ISTR this happening earlier this year to awd and domas on the green squad board, actually.09:29
bigjools¿yay?09:30
gmbbigjools: If there were a phrase to accurately confer "We are about the only corporate users of that particular half-maintained web app," then I would use that. ¿yay? will have to do.09:33
bigjoolsI thought there were many users09:34
bigjoolsanyway time to put kids to bed, back in a bit09:34
jtvrvba: the new ephemerals script doesn't care.10:16
jtvIt'll just take releases that are in the stream, and optionally filter those.10:16
jtvWhile maas-import-pxe-files won't care anymore because it  skips failing downloads.10:17
rvbajtv: okay, makes sense.10:18
allenaprvba: Do you think you'll have time to review https://code.launchpad.net/~allenap/maas/lldp-commissioning-results-in-ui/+merge/189663 again today?10:25
rvbaallenap: sure… is it much different from the branch Jeroen reviewed?10:26
allenaprvba: Yes, it's almost all new.10:27
rvbaallenap: okay, I'll have a look… could you provide a screenshot of the page?10:28
rvbajtv: allenap: could any of you take care of fixing ./etc/maas/import_pxe_files please?10:30
jtvrvba: by removing the RELEASES setting?10:31
rvbajtv: that or adding Saucy.10:31
jtvOK10:31
jtvTesting is going to be hard though.  :(10:32
jtvI have a large instance, but it's not large enough.10:32
rvbaYou need to symblink to /mnt/10:32
rvbasymlink*10:32
rvbaPlenty of space there right?10:32
jtvOh, that worked for a "large"!?10:32
rvbaYeah.10:32
jtvGreat.10:33
jtvOh dear10:34
jtvI think our config conversion is broken...10:34
rvba:/10:35
jtvNeed a different way to get the variables.10:35
rvbaallenap: I'm a bit confused by merge_details_cleanly/merge_details.  Does the usage of merge_details_cleanly() mean the change in backward incompatible?10:36
rvbais*10:37
allenaprvba: http://people.canonical.com/~gavin/ui/lldp-commissioning-results-in-ui/ for screenshots.10:39
rvbaThanks.10:39
allenaprvba: merge_details_cleanly() generates the XML without using the lshw details as the document root (so that they're in there once without a namespace, and once in the 'lshw' namespace).10:40
allenaprvba: When tagging you get both, so that old expressions work.10:41
allenaprvba: But we want to encourage people to use only the namespaced XML from here on.10:41
rvbaallenap: okay, thanks; makes sense.10:41
allenaprvba: Do you think I should add highlighting support to the XML? It's very easy with highlight.js, and looks good.10:58
rvbaallenap: look like a nice addition, but probably not critical for today :)10:58
rvbaallenap: I can use a little help with the testing ;)10:58
allenaprvba: Okeydoke :)10:58
rvbaallenap: jtv seems to be busy with the migration stuff, if you could fix (and, most importantly test) ./etc/maas/import_pxe_files, that would be one thing off the list.11:02
jtvallenap, rvba — either of you willing to review a simple branch?  https://code.launchpad.net/~jtv/maas/use-unexported-config-vars/+merge/19008911:02
jtvYeah, this is distracting me from the /etc/maas/import_pxe_files change I'm afraid.11:03
jtvI've got another thing to fix here.11:03
rvbajtv: I'll take it.11:03
jtvMerci beaucoup.11:03
allenapjtv: I have one small suggestion for the env branch, hang on...11:07
* jtv hangs on11:07
allenapjtv: Done, on the mp itself.11:10
jtvOK11:10
jtvThanks11:10
allenaprvba: Can I hit the build button again?11:16
rvbaallenap: go! :)11:16
jtvallenap: I added the quoting, and will sleep better because of it.  But not the "&&," because AFAICT the script never ran with "-e" in the first place.11:17
allenapjtv: Okay, cool.11:18
* allenap wonders why bash scripts don't default to -eu ...11:18
jtvBecause dried grapes are hilarious.11:19
allenapjtv: Que?11:20
jtvWait... what was that other word for dried grapes?11:21
allenapjtv: raisins... reasons...?11:21
jtvAnd I don't mean hilarious...  I mean that other word that's sometimes used instead.11:21
allenapjtv: depressing?11:22
jtvNormally means something like insane, loudly irrational...11:22
jtvAh yes.  Hysterical.11:22
jtvRaisins are hysterical.11:22
* allenap goes to have lunch because that's normal.11:23
jtvIn Unix shell tradition, bash is an interactive shell.  You don't want it to exit on the first mistake.11:23
jtvHad it been developed purely as a batch shell, things might have been different...11:23
jtvdash is more like that.11:23
jtvIn that it's not very accommodating to humans.11:24
allenapbash accommodates all human error.11:25
jtvExactly.11:25
jtvBecause it's meant to support interactive use.11:25
jtvTry running your terminals with "bash -e"...11:25
jtvActually, that might be a good way to train novices.11:26
jtvDirect, merciless, effective.11:26
jtvDrop and give me 50!11:26
rvbaroaksoax: we landed the branch that switches from the old script to the new script.  Testing is in progress but it's looking okay so far… could you test upgrading the package from older versions?  Something weird happened, I upgraded (using our daily ppa) from a package built one hour ago to a package built 10 minutes ago (the difference was only 2 revisions) and after the upgrade the 'maas-cluster-celery'11:29
rvbaservice was down.11:29
=== teknico1 is now known as teknico
jtvallenap, rvba: another small branch needs reviewing...  If you'd be so kind: https://code.launchpad.net/~jtv/maas/load-immutable-config/+merge/19009511:44
jtvThis is the other fix for the config conversion.11:44
jtvroaksoax: is maas-cluster-controller really supposed to depend on maas-dhcp?11:54
jtvIsn't that a Recommends?11:54
rvbajtv: I'll review your branch11:55
jtvThanks.11:55
jtvHaving a bit of trouble with the latest packaging branch though: can't install maas-cluster-controller without also installing the DHCP server!11:55
rvbaI think roaksoax told me they wanted to make maas-dns and maas-dhcp mandatory and not optional.11:56
rvbaroaksoax will confirm this.11:56
jtvIsn't that going to wreak havoc on people just trying it out in small networks?11:56
rvbaNo really, if you don't configure an interface to be "managed" the dhcp server won't be started.11:57
rvbaNot* really11:57
jtvPhew.11:57
jtvThanks allenap & rvba for your reviews.  With this landed, the config conversion works.12:04
allenaprvba: The package looks like it's used revno 1676, which is from yesterday. What am I missing?12:10
rvba1.4+bzr1676+dfsg-0+1689+209~ppa0~ubuntu13.10.112:10
rvba"1.4+bzr1676+dfsg-0" comes from the packaging.12:11
rvba1689 is the upstream revision used.12:11
rvba209 is the packaging revision.12:11
allenaprvba: No one would believe me if I said packaging is arcane :)12:11
rvbaallenap: look at the recipe: it uses a funky pattern to create the package name.12:12
rvbaallenap: {debupstream}-0+{revno}+{revno:packaging}~ppa012:12
allenaprvba: And {debupstream} is where the weird bit comes from.12:12
rvbaallenap: yeah, that comes from the packaging's first line of debian/changelog.12:13
allenapsmoser: You're logged into the garage maas. Are you using it?12:15
jtvallenap, rvba: I'm done as of r1689.  Unless there's anything urgent that either of you need help with.12:18
stokachusmoser: filed bug 123721512:18
ubot5bug 1237215 in curtin "late_commands in maas provision node fails" [Undecided,New] https://launchpad.net/bugs/123721512:18
smoserallenap, i have a node in use, why?12:21
allenapsmoser: I want to test the latest daily package.12:22
smoserallenap, garage maas really isn't the place to do that.12:22
allenapjtv: Nope, I'm good :)12:22
allenapsmoser: Why not?12:22
smoserbecause people expect for it to work.12:23
rvbajtv: I'm good too :).12:23
smosercts people are expecting to be using that this week.12:23
allenapsmoser: I thought the deal was: you put your name in the calendar, then it's yours, and you leave it in the state you found it (or working, if it wasn't).12:24
allenapsmoser: My name's in the calendar :)12:24
smoserallenap, i don't really think "go crazy and put it back" is a sustainable plan on a shared resource.12:25
allenapsmoser: What's it there for then?12:25
smoseruse of maas.12:27
smosernot development of maas.12:27
smoserhow will you put it back to the state which you got it ?12:27
smoserdo you know the state that its in?12:27
smoserdo the packages correctly downgrade?12:27
smoserhow can you reasonably expect to "put it back the way you got it"12:28
smoserhonest question.12:28
matsubaraallenap, you can use the QA lab to do this sort of testing. it's supposed to be used like that, you use and throw away, next person  (or automated test) will re-build the whole thing anyway)12:29
allenapsmoser: I've not used the garage MAAS in anger before, so I would expect someone to have documented this by now. I know I've seen it broken more times than I've seen it working, but that's perhaps because I get asked to look with it is broken.12:30
allenaps/with/when/12:30
smoseryou've seen it broken because of what i'm saying above.12:30
smoserso my solution is not to let people break it.12:31
rvbamatsubara: I'm currently testing things in the lab, the idea was to parallelize the testing.12:31
matsubararvba, I see. ok then. I'll let you guys fight for the resource then :-)12:31
smoseri'm perfectly fine if we can come up with a "put it back into known state" button.12:31
smoserbut we dont have that now12:31
smoserand others will expect to be able to use that shared resource.12:31
smoseri'd love a "redeploy garage maas" button.12:32
caribou_Has the functionality in 1.2 to add archives for newly provisioned machines been dropped in Maas 1.4 ?12:32
smoserrvba, https://bugs.launchpad.net/curtin/+bug/123721512:33
ubot5Ubuntu bug 1237215 in curtin "late_commands in maas provision node fails" [Undecided,New]12:33
stokachucaribou_: boot images you mean?12:34
smoserhm..12:34
caribou_stokachu: nope, there is a button in the config section to add entries to the sources.list; it's no longer there  in 1.412:34
stokachuah12:35
=== caribou_ is now known as caribou
rvbasmoser: is the curtin installer supposed to work on ARM nodes?12:53
smoserno.12:53
rvbaOkay. Thanks.12:53
smoserit has no way of setting up bootloading on arm nodes (unimplemented).12:54
smoserrbasak, could add that.12:54
allenaprvba: MAAS supports one Juju environment per *user*, is that right, not per API key?13:10
rvbaallenap: that's how it's supposed to work indeed.  But there is that bug we talked about recently in juju-core that makes the maas provider take down *all* the instances it can get his hands on when bootstrapping an env.13:11
allenaprvba: I'm thinking about the user preferences page, where it says "You'll need a separate MAAS key for each Juju environment".13:12
allenaprvba: That's not just misleading, that's wrong :-/13:13
rvbaallenap: it's both indeed.13:13
allenaprvba: I shall file a bug for it.13:13
smoserallenap, i think that the real blocker is if you're admin its a global space13:17
smoserregular users can be separated, but if an admin tries to use juju, he'll wipe out all nodes13:18
danwesthi all, know today is going to be tough but I was curious if anyone has tested juju-core, maas tag constraints yet?13:19
allenapsmoser: I still thought that an admin would only destroy those nodes allocated to him/her. The problem is that Juju destroys nodes that have been allocated independently of Juju.13:19
allenapdanwest: Not yet.13:20
danwestmy understanding is that for hostname placement you need to create a tag with the hostname in it13:20
allenapdanwest: Speaking for me.13:20
danwestwhich just seems wrong13:20
allenapdanwest: Eugh, I hope not.13:20
danwestallenap: going to ping juju folks to check if they know13:20
smoserallenap, well, i thought the bug was that if you juju bootstraped then juju would release all nodes that it could release.13:21
smoserand as admin that is "all nodes"13:21
allenapsmoser: I'll check.13:21
danwestallenap: confirmed with juju-core folks that new maas constraints would indeed require a hostname tag to use hostname as a constraint13:27
danwestallenap: which means to make it 'just work' we would need to auto-gen a hostname tag but concerned that is unmaintainable13:29
allenapsmoser: You're right. That's fairly awful.13:29
allenapdanwest: It should be fixed in juju-core.13:30
danwestallenap: agreed but I fear there are arguments against it, at a minimum we need to document this behavior/requirement in maas release notes13:31
allenaprvba: In juju-core, maasEnviron.AllInstances (and therefore maasEnviron.instances) should not return all instances when handed an empty slice, it should return only allocated instances. Does that sound correct?13:31
allenapdanwest: Yeah, there's nothing we can do to fix that in time for release, other than documenting it.13:32
danwestagreed, thx13:32
allenapdanwest: Do you know who's looking after the release notes for MAAS?13:32
danwestallenap: thought it was bigjools, no?13:32
allenapdanwest: Of course, yes. I'll email him.13:32
danwestroaksoax: ^^?13:33
smoserthe key release note there is "do not be admin"13:33
rvbaallenap: yes, but instances *allocated to this environment*.13:33
smoserone thing that sucks about "do not be admin" is that there is no way that i'm aware of to create a user that is non-admin13:33
smoserother than the GUI (which i dont consider useful)13:33
allenaprvba: One step at a time :) Firstly we just want to only select instances allocated to the calling user, not just all instances.13:34
rvbaallenap: That's correct.13:35
allenaprvba: Cool. I might see about fixing that then.13:35
roaksoaxdanwest: bigjools is13:35
danwestroaksoax: thx13:35
roaksoaxrvba: so ... did you guys land anything that would affect commissioning? i tested it yesterday with saucy on amd64 with no issues whatsoever13:37
rvbaroaksoax: we didn't change anything in this area.13:38
roaksoaxrvba: then maybe something with the image you used?13:38
rvbaroaksoax: I don't know, I tested using a fresh instance and AFAIK, we check the md5sum of the images we download.13:39
rvbaroaksoax: but I'm happy to test again.13:39
roaksoaxrvba: sure! ill also test but did yesterday with my moonshot enablement and worked just fine13:41
rvbaroaksoax: I just tested again, same result: "Failed tests,"13:43
roaksoaxk13:44
roaksoaxrvba: is there console output of the commissioning?13:45
rvbaroaksoax: no13:45
roaksoaxrvba: well i think it would be a good idea to obtain it13:46
rvbaroaksoax: no sure how to do that in the lab13:46
rvbanot*13:46
roaksoaxrvba: maybe the new import ephemerals has something to do with it13:49
rvbaroaksoax: possibly… let's see if you see the same problem…13:49
stokachusmoser: http://paste.ubuntu.com/6213826/ everything works except for the network_commands, i was hoping to just append to the existing /etc/network/interfaces but im assuming it doesn't work like that?13:50
smoserstokachu, well, theres not a lot of value in appending i dont think13:50
smoserbut if you want, just don't override builtin13:51
smoserand make your entry run after builtin13:51
smoseri think you will run before builtin as it is, and it would overwrite yours.13:51
stokachuso would putting it in late_commands solve this?13:51
smoserhave to look. i wish i'd have made 'builtin' '00builtin'13:52
smoserbut i think if you just chainge '102_add_vlans' to 'c102_add_vlans' it'll be fine.13:53
smoseroh, and remove your overwriting of builtin13:53
stokachuok ill try both ways and see what happens13:53
smoserstokachu, you can definitely do it in late_commands.13:55
smoserthat paste bin doens't look right hough13:56
smoseryou dont have a clsing ] on 'maas:'13:56
stokachusmoser: yea it chopped it off when copying from vi13:57
stokachui verified its there13:57
rvbaroaksoax: btw, we need to re-add "saucy" in etc/maas/import_pxe_files.14:05
roaksoaxyup14:05
stokachusmoser: here is what is currently working http://paste.ubuntu.com/6213897/14:08
stokachuit adds the vlan information into /etc/network/interfaces now14:08
smoseri wish i had done a archive format for config.14:10
smosersuch that you could put your config changes separate from maas's stuff.14:10
smoserso you didn't have to modify maas's late_command14:10
smoserbut could just add your own14:10
smoseryou can do that with multiple configs, but you only have one  config here.14:11
stokachuyea so far just one14:11
smoserwhat i should have done (and will do in the future) is support an archive format for config.14:18
smoserie, 'cloud-config-archive' format.14:18
smoserso that woudl be:14:18
smoser#curtin-config-archive14:18
smoser- |14:18
smoser  maas stuff here14:18
smoser- |14:18
smoser  stokachu's stuff here14:18
stokachuthat would be sweet14:18
smoserjamespage, are you around ?14:20
AskUbuntuMaaS dhcp cannot be detected at node installation | http://askubuntu.com/q/35584714:38
smoserroaksoax, let me know if there is anything i can do to help you14:46
roaksoaxsmoser: will do once I give this a test :)14:47
roaksoaxrvba: ok, so i'm building a package I;'ll use to test the moonshot stuff + the commissioning stuff14:47
roaksoaxrvba: other than that, how many more branches are we expecting to land?14:47
roaksoaxrvba: ok this is definitely something new and weird14:49
roaksoaxin my test cluster from yesterday i had machines commissioned14:49
roaksoaxall fine14:49
roaksoaxnow I look at show "failed tests"14:49
roaksoaxsmoser: "ci-info: no authorized ssh keys fingerprints found for user ubuntu.ec2:" ??14:58
smoserprobably not a big deal.14:58
smoserthats ephenmeral boot?14:58
smoseror install14:58
roaksoaxsmoser: yeah, commissioning.. and commissioning fails14:59
smoserwell thats unrelated to commissionoing failure14:59
smoserits just telling you that the user it configured did not have ssh keys14:59
smoserie, you cant get in here :)14:59
roaksoaxwell then that's probably why14:59
roaksoaxit is failing14:59
roaksoaxso something must have changed...?14:59
rvbaroaksoax: the only thing we need to fix is /etc/maas/import_pxe_files.15:05
roaksoaxrvba: ok15:05
rvbaroaksoax: the cleanest way to do it is probably to remove the RELEASE variable entirely.  This way, we will download all the supported releases (the script now copes with missing images).15:05
roaksoaxrvba: if the scripts do that then it would be fine, but keep in mind it might not work on precise (since precise maybe doesn't know that saucy is a relese yet but rather development)15:06
roaksoaxsmoser: ok15:06
roaksoaxsmoser: so I see this issue again15:07
roaksoaxci-info: no authorized ssh keys fingerprints found for user ubuntu.ec2:15:07
roaksoaxthe machine failed to enlist15:07
smoserthat is unrelated15:07
rvbaroaksoax: you're talking about the backport right?15:07
smoseri dont know why you're not enlisting. but it has nothing to do with the fact that the user has no keys.15:07
roaksoaxsmoser: that's what I'll check in a bit15:08
roaksoaxrvba: yup15:09
rvbaroaksoax: good point, I'll just add "saucy" to the list then.15:09
rvbaroaksoax: on second thoughts, aren't we support to SRU distro-info everytime a series is released?15:17
rvbaroaksoax: I mean distro-info --supported on precise currently returns l/p/q/r/s15:17
roaksoaxrvba: we do15:17
roaksoaxbut what if it is not therE?15:17
roaksoaxwouldn't be the first time15:18
roaksoax:)15:18
roaksoaxso I think we should go through the safe path15:18
roaksoaxeither way i don't mind15:18
rvbaWhat do you mean "it is not there"?15:18
roaksoaxjust dont remove RELEASES15:18
roaksoaxjust comment it out15:18
rvbaIf the image is not there?15:18
roaksoaxrvba: yeah if the image is not there it will fail15:18
rvbaroaksoax: no, the script deals gracefully with that now15:19
roaksoaxok15:19
rvbaI'll test it, just for safety, and propose a fix.15:19
roaksoaxrvba: ok, so is enlisting also failing for you?15:20
roaksoaxrvba: i haven't even upgraded to the latest maas15:20
roaksoaxand enlist fails15:20
rvbaroaksoax: I haven't tested enlisting using saucy15:21
roaksoaxrvba: could you also try and see if it fails15:22
rvbaroaksoax: ok15:22
rvbaroaksoax: I just got 4 nodes enlisted using Saucy's (commissioning) image.15:30
roaksoaxrvba: ok, try to commission them15:31
rvbaroaksoax: that is the part that will fail…15:31
roaksoaxstill failing?15:32
rvba…still commissioning…15:33
roaksoaxi can't even enlist a node... this is completely weird15:33
rvbaroaksoax: 4 "failed tests"15:34
rvbaroaksoax: https://code.launchpad.net/~rvb/maas/re-enable-saucy/+merge/19015915:36
roaksoaxrvba: ok maas-import-ephemerals doesn't seem to be working either15:40
rvbaroaksoax: !15:40
roaksoaxrvba: i run maas-import-pxe-files15:42
roaksoaxand only downloads the pxe images15:42
roaksoaxand that's it15:42
rvbaroaksoax: I'm running it in a canonistack instance right now and I'm seeing it installing the ephemeral images…15:43
rvbaroaksoax: I'm using the daily package from our ppa15:43
roaksoaxhdl@vm18-2:~/roaksoax/backdoor-image$ sudo maas-import-ephemerals15:43
roaksoaxhdl@vm18-2:~/roaksoax/backdoor-image$15:43
roaksoaxrvba: and I upgraded15:44
roaksoaxyours might be a clean install?15:44
rvbaroaksoax: yes, clean install15:44
roaksoaxok so there's something there that needs to be fixed for an upgrade maybe15:45
roaksoaxrvba: ok, you will need to connect to the image using ssh15:47
roaksoaxrvba: but you will need to enable the user/pass for it15:47
roaksoaxkinda following https://lists.launchpad.net/maas-devel/msg00808.html15:47
roaksoax\but since I don't know where the images are stored now15:48
roaksoaxyou'll need to figure it out15:48
roaksoaxrvba: and is this only in saucy? other releases works fine?15:48
rvbaroaksoax: yes15:48
roaksoaxrvba: ok, so just try to connect to the image15:52
roaksoaxand block is power off15:52
roaksoaxand we can look from there15:52
roaksoaxbecause here i can't even15:52
roaksoaxobtain the ephemerals15:52
roaksoaxrvba: is there no output when i run maas-import-ephemerals?15:57
roaksoaxrvba: if I ctrl+c the import15:57
roaksoaxi think it wont try to run it again15:57
rvbaroaksoax: there is usually plenty of output15:57
roaksoaxrvba: not for me i guess15:57
roaksoaxi don't see anything15:57
roaksoaxrvba: and these are upgrades15:57
roaksoaxso there's something messed up real bad15:57
roaksoaxi thought we had agreed that ephemerals config file would be *separated* from pserv.yaml?15:58
rvbaroaksoax: I think Julian decided otherwise15:58
roaksoaxbigjools: ^^15:59
roaksoaxrvba: show me a pserv.yaml with various releases enabled16:02
roaksoaxi really don't like this16:03
roaksoax-_-'16:03
rvbaroaksoax: I don't have one handy (because I always install from fresh) but it should contain something like: http://paste.ubuntu.com/6214348/16:05
allenaproaksoax: I'm working on a bson encoding problem that's preventing tags from being evaluated. I have to feed my kids now, but I'll be back to work on it soon. When has this got to be done by?17:09
roaksoaxallenap: tonight :)17:11
allenaproaksoax: Cool :)17:11
adam_groaksoax, http://people.canonical.com/~agandelman/failed_metadata.png any iea?17:35
adam_gthis is during comissioning17:35
roaksoaxadam_g: we are looking at commissioning issues right now...17:35
roaksoaxadam_g: did you upgrade or just magically started happening?17:36
roaksoaxsmoser: ^^17:36
adam_groaksoax, upgraded on monday and added two new declared nodes, those are not comissioning17:37
smoserwhat OS booted for commissioning?17:38
roaksoaxadam_g: ok so i had nodes commissioning/enlistment working yesterday and today they magically stopped working, so might be related. I was using saucy for enlistment/commissioning though17:38
adam_ghttp://paste.ubuntu.com/6214708/ is from apache log17:38
adam_g(err thats maas log)17:39
adam_gsmoser, trying to figure out what booted, by logs17:40
adam_groaksoax, hmm. the node appeared to be commissioned okay even with those errors. appears ready in MAAS17:46
roaksoaxadam_g: uhmm is ipmi discovered? are the cpu's/ram/etc being displayed?17:48
adam_groaksoax, yup17:52
roaksoaxadam_g: then i guess it works just fine then :/17:52
AskUbuntuhow to stop entire openstack so that i can run maas server on my localhost | http://askubuntu.com/q/35591417:58
=== CyberJacob|Away is now known as CyberJacob
smoseradam_g, thats your clock is broken18:15
smoserand cloud-init was adjusting its timestamps to fix oauth failed18:15
jamespagesmoser, I am now - sorry - no internet access all day18:16
smoser:)18:17
AskUbuntuhow to run openstack and maas server on localhost together | http://askubuntu.com/q/35593118:34
roaksoaxrvba: let me know when around18:50
roaksoax[    0.000000] Command line: nomodeset iscsi_target_name=iqn.2004-05.com.ubuntu:maas:maas-precise-12.04-amd64-ephemeral-20121008 iscsi_target_ip=10.18.1.9 iscsi_target_port=3260 iscsi_initiator=maas-enlist ip=:::18:51
roaksoax:maas-enlist:BOOTIF ro root=/dev/disk/by-path/ip-10.18.1.9:3260-iscsi-iqn.2004-05.com.ubuntu:maas:maas-precise-12.04-amd64-ephemeral-20121008-lun-1 overlayroot=tmpfs cloud-config-url=http://10.18.1.9/MAAS/metadat18:51
roaksoaxa/latest/enlist-preseed/?op=get_enlist_preseed log_host=10.18.1.9 log_port=514 console=ttyS0,9600 initrd=amd64/generic/precise/commissioning/initrd.gz BOOT_IMAGE=amd64/generic/precise/commissioning/linux BOOTIF=018:51
roaksoax1-38-ea-a7-0f-6e-ba18:51
roaksoaxerr18:51
roaksoaxsorry18:51
roaksoaxrvba: ok so i think we are in big trouble...19:08
roaksoaxallenap: ^^19:08
roaksoaxrvba: so basically, I selected saucy to be the release for commissioning, first it PXE booted into precise.., and when I noticed that I rebooted the machine, and it then pxe booted into saucy.19:09
allenaproaksoax: So... what are we talking about?19:09
roaksoaxrvba: once enlisted, i told it to commission... however, it PXE booted into precise again (when it should have been saucy, and obviously commissinnig failed) so I told it to PXE boot again and it now did on saucy19:10
roaksoaxrvba: and commissioned in saucy, but with failed tests19:10
roaksoaxallenap: simple enlistment/commissioning19:11
allenaproaksoax: Is the problem that the commissioning series keeps changing?19:12
roaksoaxallenap: yes, but apart from that commissioning finishes "successfully" but shows Failed Tests on the maas webui19:13
roaksoaxwhich is what rvba reported in the morning19:13
roaksoaxallenap: so if I tell maas to enlist/commission with saucy, in the first attempt uses precise and obviously fails to do it19:16
roaksoaxallenap: so I reboot the node, and the second attempt does use saucy19:16
roaksoaxwhich works and enlists/commissions19:16
allenaproaksoax: How do you tell it to commission with saucy? Via the global option?19:16
roaksoaxallenap: yeah, on the webui settings "Default distro series used for commissioning"19:17
roaksoaxallenap: which is what i always have used19:17
roaksoaxallenap: and never had problems with19:17
roaksoaxallenap: so this is something recent... from yesterday to today19:17
allenaproaksoax: Very odd :-/19:18
allenaproaksoax: I'll look soon; right now I'm this >< close to figuring out a weird bson issue.19:18
roaksoaxprobably related to maas-import-ephemerals, which is also being problematic19:18
allenaproaksoax: Is it going to be a problem to prevent python-bson-ext from being installed at the same time as maas?19:20
allenapIt's a C module that behaves weirdly in Apache+WSGI.19:21
roaksoaxallenap: maybe, we cannot control ordering of installation19:28
allenaproaksoax: See https://bugs.launchpad.net/maas/+bug/1237615 for the problem. Right, I'll look at this commissioning issue now.19:40
ubot5Ubuntu bug 1237615 in MAAS "python-bson-ext does not encode binary in Apache with mod_wsgi" [Critical,Triaged]19:40
roaksoaxallenap: ok, I;ll have a look in a bit20:06
allenaproaksoax: Thanks.20:06
stokachuoo we should do a responsive layout so people can manage their servers from their phone/tablet!20:19
allenaproaksoax: I think you've set the wrong target branch on https://code.launchpad.net/~andreserl/maas/maas_saucy_fix_commissioning/+merge/190239... I'm not reviewing 107234 lines :)20:49
roaksoaxallenap: lol let me see20:51
roaksoaxallenap: https://code.launchpad.net/~andreserl/maas/maas_saucy_fix_commissioning/+merge/19024420:54
roaksoaxdone20:54
roaksoaxthat should fix the failed trsts stuff20:54
roaksoaxbut not the pxe booting intonprecise when it shpuld be saucy20:54
allenaproaksoax: Yeah, I don't understand that bit at all.20:58
roaksoaxallenap: ill look at it20:59
roaksoaxthanks though!20:59
allenaproaksoax: Credit to you. I'm off now, I'm going to use my last energy to get upstairs to bed.21:00
roaksoaxlol goodnight21:02
=== CyberJacob is now known as CyberJacob|Away
rvbaroaksoax: I tested your fix for the commissioning issue and it worked!  Congratulations for fixing this!21:46
bigjoolsmorning22:28
roaksoaxbigjools: howdy!! regression day fixing today :)23:10
roaksoaxbigjools: do you know anything about the bson issue allenap ? i don't seem to understand fully23:23
roaksoaxsince it seems we don't even depend on bson23:23
bigjoolsroaksoax: I have no idea and I'm still catching up on email so don't know if I was told about it23:24
roaksoaxbigjools: do you know when python-bson was introduced as a dependency to maas and why the packaging was never updated to depend on it?23:25
bigjoolsroaksoax: not entirely sure, I think it was in the last few weeks23:26
roaksoaxuhmmm23:27
bigjoolsroaksoax: oh looks like allenap added it recently for the lldp work23:27
bigjoolssorry I am going to be a bit slow today, not feeling well23:28
roaksoaxbigjools: np.. he did leave this bug #1237615 before he left23:30
ubot5bug 1237615 in MAAS "python-bson-ext does not encode binary in Apache with mod_wsgi" [Critical,Triaged] https://launchpad.net/bugs/123761523:30
roaksoaxbut I don't fully understand it23:30
bigjoolslookng23:30
stokachushould we break up http://maas.ubuntu.com/docs/development/preseeds.html into sub-headings for Debian Installer and Curtin installer?23:32
stokachuthe documentation there now doesn't apply to curtin at all since preseed_xinstall doesnt exist23:33
stokachuor maybe even do a new page dedicated to curtin23:35
stokachuhmm, even have a heading in the TOC as like 'Node Enlistment, Commission, and Install'23:37
bigjoolsstokachu: yeah it needs updating23:37
stokachubigjools: im just putting my thoughts out here as im going to take a stab at updating that part of the doc23:37
bigjoolsthank you, that would be great23:38
stokachubigjools: if i make some doc changes within the TOC will that upset anyone or would it be open for discussion in an MP?23:38
bigjoolsroaksoax: it looks like wsgi is possibly compiled differently to python23:39
bigjoolsor some mismatch somewhere at least23:39
bigjoolsstokachu: please agree on changes with us before starting23:39
bigjoolsie suggest something and we'll review before you commit to something23:39
stokachubigjools: do you want that in a bug or just here on irc23:40
bigjoolsstokachu: bug would be ideal, tag it with "doc"23:40
stokachubigjools: sounds good ill do that23:40
bigjoolsgreat, thanks very much23:40
stokachunp23:40
bigjoolsroaksoax: http://emptysqua.re/blog/python-c-extensions-and-mod-wsgi/23:42
bigjoolsthat might fix it23:42
roaksoaxbigjools: right, so we would need to test that23:43
roaksoaxtoo late now I think to take care of that23:43
bigjoolsroaksoax: has the upload deadline passed?23:43
roaksoaxbigjools: kinda... but I'm uploading now23:44
bigjoolsheh23:44
bigjoolssadly allenap did not give us a direct way to re-create the problem in the bug so I don't know what triggers it23:44
roaksoaxbigjools: exactly :)23:45
roaksoaxbigjools: but I just noticed that python-bson wasn't even a depends for maas23:45
roaksoaxpackage23:45
roaksoaxso I just added it23:45
bigjools:(23:45
roaksoaxso we will see if an install of that causes any issues23:45
roaksoaxbigjools: my concern now is that if I add the depends on python-bson it might trigger the issue23:48
bigjoolsroaksoax: probably23:52
bigjoolsroaksoax: the bug talks about python-bson-ext though23:53

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!