/srv/irclogs.ubuntu.com/2012/08/22/#maas.txt

m4fiyaHey is there anyone that could help me with setting up MAAS on virtual box im having a major issue07:31
bigjoolsI can't think why it would suddenly stop working - can you paste a screen shot of the failure?07:32
bigjoolswhat path is it using to TFTP the boot image?07:34
m4fiyabigjools, is that directed at me?07:35
bigjoolsm4fiya: ^07:35
m4fiyaoh okay, i didn't think i had to setup the path specfically, shouldn't it do this automatically?07:35
bigjoolsit does, but if it can't find an image then either the image is missing or the TFTP path went wrong07:36
bigjoolsI've not encountered either of these types of failure before07:36
bigjoolsare you using the 12.04 package?07:36
m4fiyayes I am07:36
bigjoolsusually when booting the console will say what path it's using to try and download a boot image07:37
bigjoolssee if you can find that under /var/lib/tftpboot07:37
m4fiyahmm, I'm guessing thats not something Virtual Box does07:37
bigjoolsdamn07:37
m4fiyawould VMware do this?07:38
bigjoolsno idea, sorry.07:38
bigjoolsI've mostly been testing with real hardware lately07:38
m4fiyaWe can't all be that lucky ;)07:38
bigjoolsheh07:38
bigjoolsI do want to make sure the VM stuff works though07:38
bigjoolsit's definitely trying to PXE boot?07:39
m4fiyaI have turned every other type of boot off but the hard disk07:39
bigjoolsthat's your problem then07:39
bigjoolsboot order should always be PXE07:40
m4fiyaI mean other then Hard disk and PXE07:40
bigjoolsPXE first - in fact that's all you need07:40
bigjoolssince the server uses chain.c32 to make it local boot when necessary07:40
m4fiyaAlso is there specific DHCP setting I need to make on my router?07:41
bigjoolsit should be fine if you already enlisted a node07:41
bigjoolsthe "next-server" setting tells clients where to TFTP images from07:41
m4fiyaim going to try and use VMware and see if it works07:42
m4fiyaI have tried on multiple machines, one running Ubuntu as the Host and one running Windows as the Host07:43
m4fiyaNow it seems like DHCP is failing07:43
bigjoolsthat won't help07:44
bigjoolscan you delete the node and re-enlist it?07:44
bigjoolsto see if anything changed in your environment07:44
m4fiyaWell i just tried to install a new node, and it seems like the DHCP service is failing, does the MAAS management server need to be the DHCP?07:45
bigjoolsno, it can be remote07:46
m4fiyadoes this need to be specified, or does it auto DHCP07:46
bigjoolsbut as I said the next-server needs to be configured, or nothing will be able to PXE boot07:46
m4fiyawhat is the next-server?07:46
bigjoolsit tells the client where to TFTP a boot image07:46
bigjoolsit is the MAAS server07:46
m4fiyaoh okay, well i have the MAAS server up and running07:47
bigjoolsdoes your DHCP server have this setting?07:47
bigjoolsif it's in your router it might be called something else07:47
m4fiyait doesn't seem like it does have a setting like that07:48
m4fiyaby default does the MAAS server try to act as the DHCP?07:49
bigjoolsit can do if you want07:50
bigjoolsI can't remember if that's default or not07:50
bigjoolsif you look in /etc/cobbler/settings there's a manage_dhcp setting07:52
bigjoolsI have to run out for 30 minutes, will help later if you're stiull stuck07:53
jtvallenap: here's a first attempt to “make run” and then ctrl-C.  It didn't get very far (looks like rabbit doesn't run by default on my system, for whatever reason) but the problem occurs.  This is on a freshly booted system: http://paste.ubuntu.com/1160493/09:37
jtvThe first ctrl-C gave me “--> Stop `celeryd`”09:37
jtvAnd then a second one got me back to the command prompt.09:38
jtvIf I don't do that, things seem to hang indefinitely.09:38
jtvI'll reboot now to clean up, and try to give you a less noisy run with rabbit started.09:38
jtvallenap: “make distclean” also hangs while killing celery.09:44
jtvallenap: better log here, after starting rabbit manually — http://paste.ubuntu.com/1160508/09:46
* allenap is looking now09:52
jtvallenap: killing the “supervise” process for celery gets the shutdown going again, but doesn't remove those /run/lock/maas.dev.* files.10:00
jtvHmm... nor does it kill all celery processes.10:01
allenapjtv: I'm looking at signal handling in celery at the moment, to see if it responds to the correct signals.10:01
jtvThanks.10:01
allenapjtv: Signal handling is fine, it's attempting a "warm" shutdown, but it's stuck on accept(...) from /tmp/pymp-m1mA71/listener-_H1dxR (on my machine). The "pymp" bit there suggests it's a multiprocessing socket. All the child processes are defunct, so it hasn't collected them yet. Something's funky.10:08
jtvIt should come out of the accept() with EINTR, no?10:09
allenapjtv: I guess so, but perhaps it's doing something "clever".10:11
jtvYeah.  Might even be the sort of thing that newer interpreter versions helpfully hide.10:12
jtvallenap: interesting news on my front is that the bulk of datagram-received messages comes from bootstrap.py.  Almost as if some work is being done over and over again that should be delegated just once.10:14
allenapjtv: Yes, there is some element of that iirc.10:19
jtvGetting the feeling that the “session” was supposed to take over after bootstrapping, but instead, the bootstrapping packet-handling code remained in front of the session's for convenience.10:23
jtvMaybe because the concrete bootstrapping class keeps checking if this packet is the initial one.  If that could be moved into the base class, maybe the division of labour could be more effective.10:25
allenapErm, python-celery appears to still be in universe.10:41
jtvallenap: that sounds a bit like a complication10:43
allenapIndeed, a fairly big one :)10:48
rbasaksmoser: when you get in, I need ephemeral images published for armhf+highbank. What's involved for this?11:14
allenapGah, now the webapp won't stop... because it's hanging on an accept().11:15
rbasakYeah I got that11:15
allenapAgain, related to multiprocessing.11:15
rbasakStandard process seems to be to pkill -9 celeryd, find the webapp and kill that, then rm /run/lock/maas*11:16
rbasakpython is very bad at doing the right thing by default with signals when its using threads11:16
allenaphttp://paste.ubuntu.com/1160627/ fixes the webapp problem (though it also stops the cache from working).11:18
allenaphttp://paste.ubuntu.com/1160632/ fixes the celeryd shutdown problem.11:22
allenapjtv: ^11:22
jtvallenap: where “the” cache is which?11:23
jtvAhhh, it's the Manager that's holding things up then?11:23
jtvDamn.  I liked the shared-memory solution — not sure why we ended up with the Manager in the first place.11:24
allenapjtv: Only in the webapp, where it's not needed. That change didn't help getting celeryd to stop.11:24
jtvMaybe it should have been a property, so that at least it doesn't get created until used.11:25
allenapRight, lunch time here.11:25
allenapYeah.11:25
jtvThanks for figuring this out.  I'll see if that change happens to be low-hanging fruit.11:26
jtvOh bugger no it isn't.11:29
roaksoaxhowdy11:57
roaksoaxallenap: http://paste.ubuntu.com/1160673/ --> so that's maas-provision11:57
roaksoaxallenap: where from will it export the MAAS_PROVISION_SETTINGS11:57
guimalufif I put a 'in-target wget http/.../' inside my preseed file, the node can't get my file. what should I do to make my files avaible to nodes?12:13
allenaproaksoax: I have to go out now. I'll be back in ~4h, and I'll try to sort out the MAAS_PROVISIONING_SETTINGS problem then. Would you be able to document how we can build the packaging recipe locally, ourselves?12:14
roaksoaxallenap: bzr bd ?12:14
roaksoax:)12:14
roaksoaxallenap: it failed to build because I forgot to commit a patch12:14
allenaproaksoax: Is that it? I know almost nothing about packaging, so baby steps please :)12:15
* allenap goes.12:15
roaksoaxallenap: let me know when you are around again15:31
allenaproaksoax: I'm back.16:12
roaksoaxallenap: https://code.launchpad.net/~andreserl/maas/maas_lp1040047/+merge/12076916:13
roaksoaxplease :)16:13
allenaproaksoax: On it :)16:13
roaksoaxallenap: thanks! :)16:30
allenaproaksoax: Btw, I realised earlier that python-celery is in universe. MAAS depends on it now. Do we have any plans around that?16:36
roaksoaxallenap: python-celery is in main afaik16:36
roaksoaxallenap: apt-cache show python-celery | grep main16:37
roaksoaxFilename: pool/main/c/celery/python-celery_2.5.3-1ubuntu1_all.deb16:37
allenaproaksoax: I wonder why I'm not seeing that. I've got 2.4.6-1 in universe here. Are you looking at Precise?16:38
roaksoaxallenap: in precise is in universe16:38
allenapAh.16:39
roaksoaxallenap: and since we are not SRU'ing maas, there's no need to deal with it now :)16:39
roaksoaxallenap: in quantal is in main16:39
allenaproaksoax: I thought we *were* SRU'ing it.16:39
allenapThat's what we've been pushing towards this week.16:39
roaksoaxallenap: not for 12.04.116:40
allenaproaksoax: No, we've missed that :-/ But can we get python-celery into main now?16:41
roaksoaxallenap: well that's a whooooooooole different problem16:42
roaksoaxallenap: technically we can't16:42
roaksoaxbut its been done before afail16:42
roaksoaxafaik16:42
roaksoaxallenap: that's something Daviey or smoser will have to take care of though16:42
allenapI shall await comment from them :)16:47
roaksoaxallenap: btw.. as soon as the patch above lands ai can rol packages16:50
roaksoaxi'm off to lunch now though16:50
allenaproaksoax: Cool. I'll be having dinner soon, but I'll be back once the kids are in bed.17:00
roaksoaxallrnpa the fix above we discussed the same with rvba and smoser17:07
roaksoaxcant recall but i think wr agreed not to do tjat17:08
smoserclearly bigjools missed the "not going to SRU"  memo.17:15
smoseri dont know if daviey agreed to that or not, and i definitely understand pressure to get new maas into 12.04.17:16
smoserhowever, it clearly does not follow the "stable release update" path.17:16
allenapsmoser: I think we all - Red and flacoste - missed that memo :)17:18
* allenap will be back in ~2h17:18
smoserwell, we clearly missed 12.04.117:20
smoserand it clearly does not really fit SRU https://wiki.ubuntu.com/StableReleaseUpdates17:20
smoserpersonally, i feel the best way to service 12.04.1 maas with current maas trunk is via ppa.17:21
smoserbut i suspect that is not popular.17:21
roaksoax  /me is eating mexican food for smosers amusement17:21
smoserand i'm sure that rules could be bent to accomodate the main dependency. i just dont know about the value of bending the rules.17:21
guimalufif I put a 'in-target wget http/.../' inside my preseed file, the node can't get my file. what should I do to make my files avaible to nodes?17:54
smoserguimaluf, what is wrong with the wget? is dns failiing? you can try wget outside and then copy in17:55
guimalufsmoser, proxy issue17:56
guimalufit cant hit the file17:56
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: --2012-08-20 14:28:42--  http://150.164.3.236/cblr/aux/postscript.sh17:57
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: Connecting to 150.164.3.236:8000...17:57
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: connected.17:57
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: Proxy request sent, awaiting response...17:57
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: 403 Forbidden17:57
guimalufAug 20 17:28:42 node-782bcb77e1d4 in-target: 2012-08-20 14:28:42 ERROR 403: Forbidden.17:57
roaksoaxallenap: so I just saw your diff and seems reasonable. However, will that add /usr/sbin to the path to everything else that is run, or just for that command in particular?18:07
smoserguimaluf, is it just that url?18:07
guimalufsmoser, yep18:08
guimalufsmoser, anyway my maas server can't deploy the ssh-pubkey and I cant download files in that manner18:09
smoserguimaluf, is your system clock on the target reasonably set?18:13
guimalufyes18:13
guimalufthe clock was my first big issue setting up maas.18:13
guimalufI fixed in many ways. the ephemeral disk.img has the pre-start ntpdate script.18:14
guimalufbut maybe isnt enough18:14
allenaproaksoax: Just for that command.19:04
allenaproaksoax: Btw, we often +1 merge proposals with comments that need to be acted on. If we were being strict we'd mark them as Needs Fixing, but we approve them so that we don't block each other as the world turns.19:09
roaksoaxallenap: ok, since you alread proposed an alternate fix, could you propose a branch?19:15
allenaproaksoax: Okay, I'll do that. Can you email the list instructions on how to build the package?20:25
allenaplocally.20:25
roaksoaxallenap: will do by EOD20:29
allenaproaksoax: Thanks.20:29
roaksoaxallenap: btw.. are you committing the env change today?20:30
allenaproaksoax: I can, if you need it?20:31
roaksoaxallenap:no not really20:31
roaksoaxallenap: i do need you to approve something before yo leave20:31
roaksoaxallenap: https://code.launchpad.net/~andreserl/maas/packaging_bzr911/+merge/12086520:31
* allenap looks20:32
allenaproaksoax: Approved. If someone isn't around I'd say it's safe to self-approve those and keep moving.20:36
roaksoaxallenap: thanks20:36
roaksoaxallenap: i thought self approving didn't work :)20:36
allenaproaksoax: I do it from time to time.20:36
roaksoaxallenap: good to know. cause i thought the lander didn't process those self approved MP's20:37
allenaproaksoax: Could you look at https://code.launchpad.net/~allenap/maas/alt-fix-for-maas_lp1040047/+merge/120866? I am doing it after all, before I forget.20:43
roaksoaxallenap: looks good to me, has it been tested?20:44
=== dpb_ is now known as Guest92976
allenaproaksoax: Yes.20:51
allenaproaksoax: Ah, you mean, is there a test for it. No, not specifically.20:51
allenapThe code is exercised, but that specific behaviour is not checked.20:52
allenaproaksoax: I'm signing off now. Have a good evening!20:55
roaksoaxallenap: you do aswell21:04

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!