/srv/irclogs.ubuntu.com/2012/08/30/#maas.txt

roaksoaxbigjools: o/01:36
bigjoolshi roaksoax01:36
bigjoolsjust starting to look at your branch01:36
bigjoolsroaksoax: did you mix up two branches?01:38
bigjoolsI see the test fixes with the chmod changes01:38
roaksoaxbigjools: yeah I commited the chmod changes on top of the test fixes which is another merge01:39
bigjoolsroaksoax: your chmod changes aren't enough I think01:39
roaksoaxbigjools: just I just thought if you accept the test fixes first, that should not cause any problems with the chmod changes01:39
bigjoolsbecause it was a directory permission problem01:39
roaksoaxbigjools: I tested both with successfuly results01:40
bigjoolshuh reallyu01:40
roaksoaxbigjools: so the chmod in src/provisioningserver/pxe/install_image.py  takes care of the directory01:41
bigjoolsroaksoax: I would have expected a fix in make_destination()01:41
bigjoolsbecause it was the commissioning/ dir that was 60001:41
roaksoaxbigjools: right, but that happens on the rename, so we might as well do that after renaming01:42
bigjoolsroaksoax: I don't understand how renaming fixes the directory permission - it clearly works if you tested it ok, but I am missing something01:43
roaksoaxbigjools: renaming doesn't fix it01:45
roaksoaxbigjools: when it renames is when the permissions get screwed01:46
bigjoolsyep01:46
roaksoaxbigjools: so that's why I thought the chmod should go right after the rename01:46
bigjoolsbut I thought it renamed the file, not the dir01:46
roaksoaxbigjools: a right, but that critical section seems to be the part of directory creation01:48
bigjoolsseems so.... humph01:48
bigjoolsI am getting test failures, can't tell if it's your changes or not, give me a few minutes01:49
roaksoaxk01:49
roaksoaxbigjools: right, there maas-import-pxe-files errors01:51
* roaksoax brbr01:51
bigjoolsroaksoax: will leave you to fix that then :)01:55
bigjoolsshout if you need help01:56
jtv1Test suite still completely broken.  :(02:02
jtv1bigjools, roaksoax: this is not a good time to land changes -- we're not passing tests.  It's what kept me from fixing the permissions problem yesterday.02:04
bigjoolshi jtv102:04
bigjoolsI didn;t know things were broken still02:04
jtv1Eleven failures, one error.02:05
bigjoolsI am running a make check on trunk now02:05
jtv1Here's the MP that broke it: https://code.launchpad.net/~andreserl/maas/maas_tftppath_lp1042877/+merge/12167602:05
bigjoolsoh that - roaksoax's branch is trying to fix it02:06
bigjoolsroaksoax: need tests: https://code.launchpad.net/~andreserl/maas/maas_set_correct_file_permissions/+merge/12197402:07
jtv1Why is the /maas prefix incorrect in the first place?  AFAICT it's correct, but optional.02:07
bigjoolsnothing would boot02:07
bigjoolsthe paths were inconsistent compared to the actual location of pxelinux.002:08
bigjoolsalso02:08
bigjoolsit was a problem for upgrading from previous installations02:08
bigjools(using Cobbler)02:09
bigjoolssince /maas didn't exist02:09
bigjoolsand we can't rely on being able to change the dhcp config02:09
jtv1The latter I know -- I was the one who made it optional.  But didn't Gavin move the location of pxelinux.0 to maas/ ?02:11
jtv1By the way, small mistake in that branch.  I commented on the MP.02:11
jtv1At least I think it's a mistake!02:12
bigjoolsthe critical section is merely a comment so it doesn't matter as such02:13
bigjoolsjtv1: he's fixed a load of the errors but not all02:13
bigjools(in the other branch)02:13
jtv1"The critical section is merely a comment"!?02:13
jtv1Like that.02:13
jtv1The critical section ends when the new directory is in place *and readable*.02:14
bigjoolsno02:14
bigjoolswhen it's in place02:14
jtv1If that directory is not readable, it's no use to anyone.02:14
bigjoolsthat doesn't make it part of the critical section02:15
bigjoolssince only one user is *changing* it02:15
jtv1The critical section is effectively the time between the moment we can no longer use the old directory, and the time we can start using the new one instead.  This approach postpones that, for no reason whatsoever.02:16
bigjoolstrue, it would be better on the original dir02:17
jtv1Right.02:17
jtv1There's just no reason to do it the wrong way -- except the name is easier to spell, which can be solved with a variable.02:17
bigjoolsjtv1: can I leave you to help roaksoax please, I've got a million other things to sort out02:18
bigjoolshis branch still has failures02:18
jtv1I do have a doctor to see.  :/02:18
=== jtv1 is now known as jtv
=== jam1 is now known as jam
jtvallenap, bigjools, Daviey, rbasak: here's a new suggestion for prefix-less PXE layout on TFTP.  Saves us the bootloader downloads, resolves the compatibility problem, removes the prefix, usurps /var/lib/tftpboot/pxelinux.cfg for our own use.  http://paste.ubuntu.com/1175480/09:27
jtvOh, and: moves us towards a solution for the amd64/i386 problem, I think.09:27
bigjoolsjtv: jfdi!09:31
allenapjtv: Why are the arch specific bits inside pxelinux.cfg/?09:31
allenapjtv: Also, the i386/amd64 problem should be fixed already, pending QA, unless this is something else.09:31
allenapjtv: Want to talk about it?09:34
jtvallenap: Yes please.09:35
allenapjtv: https://plus.google.com/hangouts/_/0d5426deed76294d0b13f6d467e9d286b7a1d52a?authuser=0&hl=en-GB09:35
allenaprbasak: Can we delay by 20 minutes?09:53
rbasaksure09:53
jtvDaviey: just wanted to make absolutely sure...  if we PXE-boot /pxelinux.0, using a config from /pxelinux.cfg, we can still load kernel/initrd from /maas, right?  We're not forced to load from within /pxelinux.cfg, right?10:18
Davieyyeah..10:43
Davieyjtv: i don't see why you couldn't?  Which makes me concerned i'm missunderstanding the question10:44
jtvNo, just checking up on the details of the problem where once you're booting from a directory, PXE can't seem to reference TFTP files from outside that directory.10:44
jtvThis was a big issue some time ago.10:45
Davieyjtv: I think the issue was more, the -secure option.. which did better chrooting.. and enforiced ownership.. no?11:17
jtvNo, not related to that.11:17
jtvDaviey: But we were told at one point that we couldn't just pass absolute paths to the tftp server; it had to be relative to either (and I'm trying to verify which it was) the directory with pxelinux.0 in it, or the pxelinux.cfg directory.11:18
Davieyjtv: I'm not aware of such a limitation, i'm sure i've used full paths (from tftproot) all the time.11:23
jtv!11:24
jtvEven for kernel & initrd?11:24
jtvNow I'm just completely confused.11:24
Davieyjtv: it might be better to JFDI and prove me wrong :)11:25
Davieyrbasak: Do you have thoughts ^^?11:25
jtvWe spent so much time on questions like "once you're in an i386 config file, how do you get the amd64 kernel/initrd if they're in a different directory?"11:25
Davieyjtv: why would you be in the i386 file?11:25
jtvDaviey: it'd be hard for me to prove myself wrong.  Which I need to be able to do to make sensible decisions.11:25
jtvYou'd be in an i386 config file if you were a netbooting PXE client.11:26
Davieythen why would you jump to amd64?11:26
jtvBecause you might actually be amd64.11:26
DavieyI think i am being dumb.11:26
jtvWell think about enlistment.11:26
jtvServer doesn't know who or what you are.11:26
jtvYou request a boot config; the server gives you i386.11:27
Davieyjtv: i thought we were using Ifcpu.c32 / Ifcpu64.c32 now?11:27
jtvAh no, enlistment is OK.11:27
jtvYes, we are using that now.11:27
jtvBut like I said, we spent a lot of time arriving at that.11:27
Davieyah11:27
jtvThe real problem came when you had to install the right architecture despite perhaps having been served the wrong architecture for PXE.11:28
jtvAnyway, we had to do that, and some other acrobatics, because we had been told that once you load pxelinux.0/pxelinux.cfg, you're stuck in the location you got those, TFTP-wise.11:28
jtvFor the rest of that boot, obviously.11:29
jtvNot forever.11:29
rbasakDaviey, jtv: I'd like to verify this by looking at the U-Boot source and also checking behaviour in U-Boot. The behaviour in U-Boot may well be different than pxelinux itself here.11:43
jtvAhh that could be the missing piece of the puzzle.11:43
jtvWould be most grateful if you could check!11:43
* rbasak looks11:44
Davieyahh, yes.. could be11:49
rbasakDaviey, jtv: right. I've looked at the logic11:52
rbasakIt will be relative unless the path supplied starts with /11:53
jtv(God, the staggering incompetence of some people... adding a "North" arrow to a map that duly points up... but actually orienting the map in some radically different way.  Leaving the "Public Company Limited" suffix in the name of a landmark office building, when there's not enough room to write it.  Transliterating street names incorrectly.  Is this company testing my motivation to come see them?)11:53
jtvrbasak: so then there's no way at all in which we're stuck in a directory and we could have used absolute paths all the time!?11:53
rbasakIf it starts with /, then the name is left as-is and requested from the tftp server11:53
Davieyjtv: where did you hear about this limitation ?11:54
rbasakIf it doesn't start with a /, then the name pxelinux.0 was fetched from is truncated to its last / and the name appended11:54
rbasakI don't think that tftp has a notion of directories at all. Everything is just a name11:54
Davieyright, that is the same as x86.11:54
rbasakSo how the leading / is interpreted is up to the tftp server in use11:54
jtv(The one we use, in the upstream version, just chokes I think)11:55
rbasakSo it is still a bit limited. If you serve "maas/pxelinux.0" for example, I don't think it's possible to get U-Boot to fetch "kernel". It'd have to be "/kernel" or "maas/kernel".11:55
rbasakI am basing this from the current linaro U-Boot source and current highbank behaviour only11:56
rbasakIf the behaviour was different in the past, I won't see it11:56
jtvSo maybe this limitation does exist, in a way -- a tftp server doesn't necessarily support absolute paths.  We had trouble with that.11:56
* rbasak goes looking for the VCS tree11:56
rbasakjtv: agreed. I would be very careful in the assumptions made here, since TFTP itself doesn't define anything.11:57
rbasak(I don't think)11:57
jtvNow, if we have some sort of equivalent of "current directory" set, we do know that it's going to be the same directory we found pxelinux.0 in then?11:57
rbasakYes. This is how U-Boot was engineered from the start. I think this is based on pxelinux.0's behaviour.11:58
rbasakLook for robher on here. He's not online now but sometimes is. He wrote it.11:59
jtvSo if we start out with pxelinux.0 as the boot-loader filename, in /, and read config from pxelinux.cfg/* in root, then we can continue using our normal filenames.11:59
rbasakIf I understand you correctly then yes, I think so. Can you just show me the structure again?12:00
jtvGah.  Keyboard layout switching is completely demented with this USB keyboard attached.  :(12:01
rbasakAh it wasn't robher, it was Jason Hobbs who wrote it (also Calxeda)12:01
jtvWell "the" structure is the question.12:02
jtvWhat I'm currently implementing is:12:02
rbasakAnd the original code has the same special case leading '/' handling12:02
rbasakAt least the original code that went into linaro trunk. So I think we're ok relying on that.12:02
jtv /pxelinux.012:02
jtv /pxelinux.cfg/default12:02
jtv /i386/generic/precise/commissioning/initrd.gz12:02
jtvetc.12:02
jtv(I'm spelling out the leading slashes here for illustration; we don't actually use them.)12:03
rbasakIf the pxelinux.cfg files then use "kernel i386/generic/precise/..." etc, then I think that'll work12:06
rbasak(I'd keep those paths relative to avoid any issues)12:06
jtvAhhhh figured out my map.  The key was the road that crossed the water, with the arrow to the bridge pointing _away_ from the water.  The big wobbly curvy waterway it shows is not in fact the river.  It's a canal, and according to Google, nicely straight.12:06
rbasakAlso probably best to keep the dhcpd.conf filename "pxelinux.0" relative (to nothing) too.12:06
jtvYes, it should all set up like that at the moment.12:07
jtvJust wanted to be sure that the naming after loading would still be relative to the root in our case, and not to pxelinux.cfg.12:07
rbasakYes, that's right. It's relative to the location of pxelinux.0, not of pxelinux.cfg.12:08
jtvThanks for the help!  It's frightening to work in the dark sometimes.12:08
rbasak(pxelinux.cfg needs to be in the same location as where pxelinux.0 is)12:08
rbasakNo problem. I hope I've been accurate!12:08
jtvCertainly more so than whoever made this map.12:09
jtvallenap: any chance I could get you to review a few branches for me?  They're wildly disparate -- one is near-trivial and the other is huge.12:12
jtvThe trivial one is: https://code.launchpad.net/~jtv/maas/use-maasserver-testcase/+merge/12200212:12
jtvThe huge one is: https://code.launchpad.net/~jtv/maas/bug-1042877/+merge/12204912:20
ubot5Ubuntu bug 111956 in Launchpad itself "duplicate for #122049 Cannot search for identifier containing underscores" [Low,Triaged]12:20
allenapjtv: Sure, no worries.12:23
jtvThanks12:23
bjfi'm currently using orchestra to provision bare metal systems as well as VMs (using koan). am i able to replace orchestra with maas for all that?15:26
=== matsubara is now known as matsubara-lunch
=== frankban_ is now known as frankban
=== matsubara-lunch is now known as matsubara
smoserroaksoax, how can i create a maas super user without typing a password ?17:26
roaksoaxsmoser: no diea17:27
smoseranyone ?17:27
smoserhey roaksoax17:33
smoseri boot a node. and enlist it17:34
smoserthen say "commission"17:34
smoserall well and good17:34
smoserthen i turn it on again17:34
smoserwhat is it supposed to do?17:34
bjfi'm currently using orchestra to provision bare metal systems as well as VMs (using koan). am i able to replace orchestra with maas for all that?17:38
smoserbjf, yeah, thats the goal.17:40
bjfsmoser: how close are we today? can i provision both bare-metal as well as VMs today?17:40
smoseri would say yes to both.17:41
smoseryou'll have to manage your virtual machines yourself17:41
smoserand a machine is basically identified by its "eth0 MAC address"17:41
smoserso you have to keep that consistent17:41
bjfsmoser: i'm doing kernel testing with jenkins jobs and orchestra + koan right now. that's a lot of VMs being dynamically created and destroyed17:42
smoserwell, mi could be wrong here.17:43
smoserbut baically, maas is going to identify each new vm as a new system.17:43
smoserand that system will have to go through enlistment and commissioning17:44
smoserits possible that you could use the api to populate images and absically pass it through ocmmissioning before nhand.17:44
roaksoaxsmoser: hold on, you enlist and then you "Accept and Commission"17:44
smoserand then also to delete it when youre done17:44
roaksoaxsmoser: it enlists and turns off17:44
smoserroaksoax, yes, and then i commission17:44
smoserthat is all well and good17:44
smoserbut what happens if i turn it on after that17:44
roaksoaxsmoser: it fails to PXE17:44
smoserthtas not my experience in precise17:44
bjfok, can i do enlistment and commissioning from the command line? do you have a cli or do i need to write a tool myself?17:45
roaksoaxsmoser: really? I saw soemthing that was trying to PXE boot from a poweroff like profile or something likethat but it failed due to not being found17:45
smoseryou'd have to write a maas api client for that.17:45
smoserbjf,17:45
roaksoaxsmoser: i just spotted that yesterday so didn't really investigate it yet17:45
bjfsmoser: and can i write that in python?17:45
smoserbjf, i dont know how good you are with python :)17:46
smoserbut yes, you could do it in python17:47
bjfsmoser: heh17:47
bjfsmoser: i should have asked if python is a supported language for such work :-)17:47
smoserbjf, well its a web service api17:47
smoserand you'd have to write the client (no easily available library for you at the moment)17:47
smosernow...17:48
bjfsmoser: one that you have documented?17:48
smoserif you *wanted* to write a maas cli that would make people happy.17:48
bjflol17:48
smoserbjf, i dont document anything, ever.17:48
smoserand honestly i dont think the maas api is terribly well documented (but i could be wrong) but there are examples of using it.17:48
smoserjuju uses it, and i had started a client17:48
bjfsmoser: ok, some examples would be good enough17:49
smoserwhich i can point you at.17:49
bjfcool17:49
bjfok, that's all for now .. i'll be back17:49
smoserhttps://code.launchpad.net/~smoser/maas/maas-cli/+merge/10144017:49
smoserroaksoax, its confusing17:54
smoseri think its actually doing an install17:54
smoseracutally pretty certain it is17:54
roaksoaxsmoser: ok, I'll have a look17:55
roaksoaxmaybe so17:55
smoserit says "Installing the base system"17:55
smoser:)17:55
roaksoaxsmoser: what MAAS are you using?17:55
smoserprecise at the moment.17:55
roaksoaxsmoser: from PPA?17:55
smoserhttp://pad.daviey.com/maas-ephemeral-image-test17:58
smoserno. from precise updates or whatever is there.17:58
smoserthis was in an effort to validate the dialy ephemeral image that i built yesterday.17:58
smoserand see that link, thats how i did it.17:59
roaksoaxok18:05
smoserroaksoax, i'm gonna walk the same thing on quantal now.18:12
smoserits kind of a shortcut on the vdenv18:12
roaksoaxsmoser: note that we should be uploading cobblerless maas very soon though18:13
smosersure. and osme of that stuff is cobbler specific. but much is not.18:14
smoserroaksoax, on quantal right now i do maas-import-isos18:23
smoseri see18:23
smoserUnknown command: 'install_pxe_image'18:23
smoseram i not supposed to run that ocmmand?18:23
roaksoaxsmoser: yeah that's find18:29
roaksoaxfine18:29
roaksoaxsmoser: it is and old maas version18:29
smoserroaksoax, wait a minute.18:55
smoseri'm booting the installer18:55
smoserin enlistment18:55
smoseron quantal18:56
smoserwhy?18:56
roaksoaxsmoser: becuase cobblerless maas is not yet in quantal18:57
roaksoaxsmoser: there18:57
roaksoaxsmoser: there's was a few issues that needed to be addresses before I can upload it otherwise we would have had a broken MAAS18:57
roaksoaxi'm hoping to have an upload by tomorrow18:57
smoserbut i changed the cobbler path18:58
smoserto use ephemeral enlistment18:59
smoserand the other path18:59
smoserroaksoax, oh. i see. quantal is still as of July 1719:01
smoserwow19:01
smoserthats old19:02
smoserroaksoax, could you tell me what you were doing yesterday that caused you to know about my ephemeral image mishap?19:03
roaksoaxsmoser: trying to enlist19:18
roaksoaxwith the new maas of course19:19
roaksoaxppa:maas-maintainers/testing19:19
roaksoaxprecise19:19
smoserroaksoax, i'm getting a debconf change prompt19:21
smoseron upgrade in quantal from quantal to daily ppa19:22
roaksoaxsmoser: what's it about?19:22
smoserhttp://paste.ubuntu.com/1176499/19:22
smoserjust did the install on quantal, then added daily ppa19:22
smoserand upgraded19:23
smoseralso now pserv i prompting me19:23
roaksoaxsmoser: yeah19:23
roaksoaxsmoser: do that19:23
smoserwell, of course yes.19:23
roaksoaxand it will re=generate passwords and stiff19:23
smoseri'm just saying its a bug19:23
smoserit should not prompt me. i did not change that file.19:23
roaksoaxsmoser: no you didn't, but upstream did19:23
smoserand all users would hit that.19:23
roaksoaxsmoser: and the package did19:23
smoserroaksoax, no19:24
smoserthe error is because its a confffile19:24
smoserand you (postinst) edited it19:24
smoserand then upstream changed it.19:24
roaksoaxsmoser: yep19:24
roaksoaxsmoser: i'm awayre19:24
smoserand dpkg is saying "this is changed from what it was before"19:24
smoserso you need to handel that.19:24
roaksoaxI have not yet thought on a fix for it19:24
roaksoaxsmoser: yeah I'm aware of that19:24
roaksoaxsmoser: i have been giving priority to other stuff19:24
smoserand on the other quantal instance that i installed stright to the ppa19:25
roaksoaxsmoser: but basically i will just replace the file and not prompt that, and simply send a message saying that if custom settings have been made, they will have to bemerged19:25
smoseri'm getting a stack trace19:25
smoseron during install19:25
roaksoaxsmoser: that's probably an older package of quantal19:25
roaksoaxsmoser: as the newer ones are precise19:25
roaksoaxsince sabdfl wanted to test precise19:25
roaksoaxso dind't upload quantal19:25
roaksoaxsmoser: again, I will test quantal again tonight to see if the issues i found were fixed upstream, if so I will release to archive19:26
roaksoaxsmoser: brb, need to change locations19:26
smoserroaksoax, the stack trace i'm seeing is on the daily ppa19:26
roaksoaxsmoser i think i know why that is19:48
smoserroaksoax, hm.. i dont know what i did to cause the stack trace. but i didn't reproduce it with this19:56
smosersudo sh -c '19:56
smoser  apt-add-repository ppa:maas-maintainers/dailybuilds -y &&19:56
smoser  apt-get update &&19:56
smoser  DEBIAN_FRONTEND=noninteractive apt-get --assume-yes install maas' </dev/null19:56
smoserroaksoax, what is the dhcp server?19:57
roaksoaxsmoser isc-dhcp19:57
roaksoaxsmoser its an issue when regenerating passwords it is not doing it right because a configfile was changed without updating packagaing19:59
smoserroaksoax, so after the above...20:00
smoseri should have maas-dhcp running20:00
smoserright?20:00
smoserroaksoax, ping when you get a chance.20:11
roaksoaxsmoser: sorry about that, internet sucks at the moment20:28
smoserok.20:29
smoseryou ahve a minute now?20:29
roaksoaxsmoser: yes20:29
smoserk.20:30
smoserso. after i installed maas from the ppa20:30
smoseri dont have any isc-dhcp running20:30
smosershould I ?20:30
roaksoaxsmoser: not really unless you have it enabled on MAAS webiui20:31
roaksoaxas it is the one that controls the start/stop of the daemon20:31
smoserhow can i enable it?20:31
roaksoaxsmoser: Settings on the WebUI20:31
roaksoaxsmoser: note that you will find yourself with the bug that it is unablke to write /etc/dhcp/dhcpd.conf20:31
smoserno other way to enable?20:32
roaksoaxsmoser: nope20:32
smoserso it asks me about what settings i want for the dhcp server20:33
smoserbut not whether or not to run it20:33
smosernice.20:33
roaksoaxsmoser: that's upstream issue20:34
roaksoaxsmoser: the package simply sets up the master dhcp pool20:34
roaksoaxsmoser: the only way to enable the dhcp server is by doing it from the webui20:34
roaksoaxsmoser: i thnk that they were gonna change the default sto have the dhcp server enabled by default20:36
roaksoaxsmoser: brb20:40
roaksoaxsmoser: did you get it working?21:29

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!