| bigjools | and other packaging bits | 00:00 |
|---|---|---|
| bigjools | I'll try again | 00:00 |
| smoser | what upstart file? | 00:01 |
| smoser | http://paste.ubuntu.com/1228509/ | 00:01 |
| smoser | you're talking about that change? | 00:01 |
| smoser | the file is not being written at all | 00:02 |
| smoser | that change there would have no affect on it being written. | 00:02 |
| bigjools | please wait | 00:02 |
| smoser | (and just random bit of information, | 00:02 |
| smoser | sh -c 'echo -n foo > /tmp/bar; read a < /tmp/bar; echo $?;' | 00:02 |
| smoser | ) | 00:02 |
| smoser | that does return '1'. | 00:03 |
| smoser | if you dont have a trailing new line | 00:03 |
| smoser | its annoying. | 00:03 |
| bigjools | that would explain a lot | 00:03 |
| bigjools | sigh, it's now impossible to use mouse select on konsole when byobu is running | 00:04 |
| smoser | its dirty magic, that | 00:04 |
| smoser | somehow tmux actually has "mouse support" | 00:04 |
| smoser | i was confused by this once too. | 00:04 |
| smoser | its doing something magic with your mouse | 00:05 |
| bigjools | it seems to be when the clock ticks over each second | 00:05 |
| bigjools | the selection is reset | 00:05 |
| smoser | ah. | 00:05 |
| smoser | well, byobu-config | 00:05 |
| smoser | and you can turn the clock off | 00:05 |
| bigjools | yeah | 00:05 |
| smoser | or highlight faster | 00:05 |
| bigjools | I need more bandwidth | 00:06 |
| smoser | interesting. | 00:06 |
| smoser | (use canonistack) | 00:06 |
| smoser | interesting... | 00:06 |
| bigjools | can't do that with my test hardware here | 00:06 |
| smoser | i'm seeing the "No boot images have beeen registered yet" error on maas again. | 00:06 |
| bigjools | I suspect because the celery stuff is not working | 00:06 |
| smoser | (although i successfully booted off of said unregistered image and enlisted | 00:07 |
| smoser | ) | 00:07 |
| bigjools | there were some major routing changes | 00:07 |
| bigjools | and there was fallot | 00:07 |
| bigjools | fallout | 00:07 |
| smoser | bigjools, i suppose you're lamenting the ephemeral images | 00:08 |
| smoser | when you mention bandwidth | 00:08 |
| smoser | right? | 00:08 |
| bigjools | no, quantal updates | 00:08 |
| smoser | ah. | 00:08 |
| smoser | well, can't really hep you there. | 00:08 |
| bigjools | I already run a caching proxy | 00:08 |
| smoser | but i was just thinking i should write mirro utility | 00:08 |
| bigjools | which doesn't help on the first run :) | 00:08 |
| smoser | (the maas.ubuntu.com/ only comes over https, so squid sucks) | 00:09 |
| bigjools | urgh | 00:09 |
| bigjools | and.... pulseaudio... ffs | 00:09 |
| smoser | but it'd be pretty easy to right a mirror of it. | 00:09 |
| smoser | well, you probably can't report a bug on it because glib updated yesterday and your out of date. | 00:09 |
| smoser | :) | 00:10 |
| bigjools | ok I am going to spin up a canonistack and install from scratch | 00:11 |
| smoser | bigjools, just as another variable to play with, there are now daily images of both quantal and precise that "should work" (they've tested as working for me). | 00:11 |
| smoser | i'm sure you've seen that script i use | 00:11 |
| smoser | i dont run it as a script | 00:11 |
| smoser | but i just copy and paste bits together | 00:11 |
| smoser | hey, i'm just laying. | 00:12 |
| smoser | i just registered a node | 00:12 |
| smoser | commissioned it | 00:12 |
| smoser | now on its node page i see "start node" grayed out | 00:12 |
| smoser | ah. needed to add a key. | 00:13 |
| bigjools | which quantal image is best? | 00:13 |
| bigjools | just use latest I guess | 00:14 |
| roaksoax | bigjools: Do you happen to know what else is needed to save a setting? http://paste.ubuntu.com/1229537/ | 00:14 |
| smoser | is there 2? | 00:14 |
| smoser | daily is what i meant. | 00:14 |
| bigjools | roaksoax: I think that should work | 00:15 |
| roaksoax | bigjools: it doesn't :( | 00:15 |
| bigjools | your label should say series not release :) | 00:15 |
| smoser | alright. i'm out for the night. | 00:15 |
| bigjools | cheers smoser | 00:15 |
| bigjools | roaksoax: ummm | 00:16 |
| bigjools | roaksoax: I'm not sure, sorry. Django is full of traps and I hate it. I'd need to ask rvb | 00:27 |
| roaksoax | bigjools: yeah i was planning to ask him | 00:29 |
| bigjools | gah byobu | 00:30 |
| bigjools | can't mouse select even with its clock off | 00:30 |
| bigjools | roaksoax: I can't install maas on a clean canonistack instance, it's blowing up at the db config stage saying there's no pg clusters | 00:31 |
| bigjools | and when the debconf message appears it goes over the whole screen obscuring the error underneath >:( | 00:32 |
| roaksoax | bigjools: pastebin? | 00:35 |
| bigjools | roaksoax: any ideas? http://paste.ubuntu.com/1229558 | 00:35 |
| roaksoax | bigjools: is postgresql installed and running? | 00:36 |
| smoser | bigjools, i told you. its magic with your mouse. | 00:36 |
| bigjools | roaksoax: installed but not running | 00:36 |
| === matsubara is now known as matsubara-afk | ||
| bigjools | smoser: it is :/ | 00:36 |
| smoser | http://awhan.wordpress.com/2012/04/18/tmux-copy-paste-with-mouse/ | 00:36 |
| smoser | the solution is to use the shift key. | 00:36 |
| bigjools | thanks | 00:36 |
| smoser | (note, i wasn't just holding out, i didn't remember. i think i asked kirkland once) | 00:37 |
| bigjools | smoser: not working doing that either | 00:37 |
| smoser | hm.. | 00:37 |
| bigjools | roaksoax: so installing postgresql on its own doesn't set up a cluster and it's not running afterwards | 00:44 |
| roaksoax | bigjools: to me it looks that postgresql is not running | 00:51 |
| bigjools | roaksoax: it's not - I had to manually create a cluster | 00:51 |
| bigjools | then everything works | 00:51 |
| roaksoax | bigjools: ah! so maybe there's an issue with postgrsql package? | 00:52 |
| bigjools | possibly | 00:52 |
| bigjools | easy to re-create | 00:52 |
| * bigjools debugs non-working dhcp | 00:52 | |
| roaksoax | bigjools: it doesn't look like postgresql actually. The last package was uploaded long time ago: https://launchpad.net/ubuntu/+source/postgresql-9.1/9.1.5-2 | 00:53 |
| roaksoax | dbconfig-common hasn't been updated either | 00:54 |
| bigjools | something odd is going in | 00:54 |
| bigjools | on | 00:54 |
| roaksoax | so there's some other reason | 00:54 |
| roaksoax | maybe fire up another instance, update, upgrade | 00:54 |
| roaksoax | and try again? | 00:54 |
| bigjools | I just started a new quantal instance, sudo apt-get install maas | 00:54 |
| bigjools | and it does it | 00:54 |
| bigjools | roaksoax: there's another bug in that installing maas-dhcp doesn't terminate the existing dhcp | 00:55 |
| bigjools | or prevent it running at all | 00:55 |
| roaksoax | bigjools: yeah I saw the report but haven't been able to take care of any packaging related activities today | 00:56 |
| roaksoax | bigjools: btw.. we need a way to disbale dhcp from the command line, i/e maas-provision disbale-dhcp | 00:56 |
| bigjools | roaksoax: ok | 00:57 |
| roaksoax | so that when maas-dhcp is recmoved, or reconfigured to not have it enabled, it does not stay up and running | 00:57 |
| bigjools | roaksoax: we're going to change it so the maas-dhcp package doesn't configure dhcp at all, just installs packages | 00:57 |
| bigjools | it's really screwing up things with the way we want to configure dhcp otherwise | 00:57 |
| roaksoax | bigjools: that's fine too | 00:58 |
| roaksoax | it would makes things simpler | 00:58 |
| bigjools | completely | 00:58 |
| roaksoax | bigjools: i also saw that issue once | 03:13 |
| roaksoax | didn't see it again though | 03:13 |
| bigjools | roaksoax: the rabbit one? | 03:13 |
| roaksoax | bigjools: yeah | 03:13 |
| bigjools | hi jam | 03:17 |
| bigjools | hi jtv I mean | 03:17 |
| jtv | Hi bigjools | 03:17 |
| jtv | Being greeted is so much better as a way to start your day than a corrupted filesystem. | 03:17 |
| jtv | What a shame the corrupted filesystem was here first! | 03:17 |
| bigjools | bugger | 03:17 |
| jtv | Well, it's fixed now. But I used to get this as a recurring problem, so it doesn't bode well. | 03:18 |
| jtv | Problem with the nvidia driver we suspect. | 03:21 |
| bigjools | roaksoax: still there? | 03:24 |
| bigjools | jtv: damn | 03:24 |
| bigjools | all ok now? | 03:24 |
| jtv | For now, yes. | 03:24 |
| bigjools | roaksoax: in my maas-cluster-controller.postinst I am doing a db_get to get hold of the url to maas but only on configure/reconfig at the moment, but this means that in normal install/upgrade circumstances it doesn't ask for it and breaks the end config | 03:26 |
| * roaksoax is her unfortunately | 03:26 | |
| bigjools | I am hoping that I can ask for it in installation as well without violating any rules | 03:26 |
| bigjools | roaksoax: :) | 03:26 |
| roaksoax | bigjools: uhmmmm | 03:27 |
| bigjools | jeeepers, Australia has bug butterflies | 03:27 |
| bigjools | big* | 03:27 |
| * roaksoax is doing homework again :) | 03:27 | |
| roaksoax | let me see | 03:28 |
| roaksoax | bigjools: right, so there's something wrong there | 03:29 |
| bigjools | roaksoax: what are the rules on using db_get? | 03:29 |
| roaksoax | bigjools: let me look for an example | 03:30 |
| bigjools | can't ask during upgrades IIRC | 03:30 |
| roaksoax | bigjools: remember, it is not an upgrade | 03:30 |
| roaksoax | bigjools: it is a new install | 03:30 |
| roaksoax | bigjools: so it *will* have to ask | 03:30 |
| bigjools | roaksoax: that's not true | 03:30 |
| bigjools | the new maas pulls it in | 03:30 |
| bigjools | seed cloud case | 03:31 |
| roaksoax | bigjools: so if it pulls it in, what are you trying to achieve with a db_get ? | 03:31 |
| bigjools | roaksoax: in other circumstances it is a stand-alone app running somewhere else | 03:31 |
| bigjools | it has to ask | 03:31 |
| bigjools | but in the seed-cloud case I am wondering if we can just pull the URL out of maas's dbconfig | 03:32 |
| roaksoax | bigjools: hold on hold on | 03:32 |
| * bigjools holds | 03:32 | |
| roaksoax | bigjools: so 1. i install maas-cluster-controller and I should receibe a question asking me to input the maas-url ? (this maas-url is the region controller?) | 03:33 |
| bigjools | roaksoax: yes | 03:33 |
| bigjools | and yes | 03:33 |
| roaksoax | bigjools: ok, so what's seed cloud again? | 03:33 |
| bigjools | roaksoax: the original 12.04 package | 03:33 |
| bigjools | maas becomes a virtual package and pulls in region & cluster | 03:34 |
| roaksoax | bigjools: right, so the workflow is that every time maas-cluster-controller is installed for the first time, it should request the admin the URL right? | 03:34 |
| bigjools | roaksoax: yup | 03:34 |
| bigjools | roaksoax: also | 03:35 |
| roaksoax | bigjools: ok so an upgrade from previous maas is the same case | 03:35 |
| bigjools | it needs to ascertain it on upgrade from old maas | 03:35 |
| roaksoax | bigjools: right, so we can grab that from celeryconfig | 03:36 |
| bigjools | which is maas/default-maas-url | 03:36 |
| roaksoax | bigjools: rigth, so hold on | 03:36 |
| * bigjools holds on | 03:36 | |
| roaksoax | bigjools: normally.... eveyr time maas-cluster-controller is installed for the first time it should ask for the URL | 03:36 |
| bigjools | every time except when upgrading from the 12.04 maas :) | 03:36 |
| roaksoax | it doesn't matter if we are upgrading from 'maas' to maas-{region,cluster}-controller | 03:37 |
| bigjools | oh? | 03:37 |
| roaksoax | the package is installed for the first time | 03:37 |
| roaksoax | so it *should* ask for it, don't you think? | 03:38 |
| bigjools | so when someone with maas installed on 12.04 upgrades to 12.10, I thought it was bad to ask questions | 03:38 |
| roaksoax | i don't know to what extend it is bad... but TBH.. we are not free from not asking them | 03:38 |
| bigjools | I think we are though, because it will be in maas/default-maas-url | 03:39 |
| roaksoax | bigjools: i mean... I recall having had to answer questions of this sort before | 03:39 |
| roaksoax | bigjools you could ask debconf db for the value, sure | 03:39 |
| bigjools | so if I can work out that we're upgrading from old maas... | 03:39 |
| bigjools | I don;t know how to work that out | 03:39 |
| roaksoax | bigjools: we could, I don't know whether is a sane thing to do though | 03:39 |
| roaksoax | in the way of policy compliant | 03:40 |
| roaksoax | as in quering debconf db for another's package db | 03:40 |
| bigjools | ok | 03:40 |
| bigjools | perhaps grep celeryconfig then | 03:40 |
| roaksoax | bigjools: that's not all | 03:40 |
| roaksoax | bigjools: consider that if we still all-in-one MAAS server from the CD installer, we should not ask that question | 03:41 |
| * bigjools 's head explodes | 03:41 | |
| roaksoax | bigjools: so looking at celery might be agood idea, but what happens if cluster-controller gets installed *before* region-controller | 03:42 |
| bigjools | if celeryconfig is not there, we're not upgrading so we have to ask | 03:42 |
| roaksoax | bigjools: right, but what if we don't know it? | 03:42 |
| roaksoax | bigjools: as in the administrator doens't know it | 03:43 |
| bigjools | there's the $64m question | 03:43 |
| roaksoax | bigjools: i'll have to think about that though | 03:43 |
| roaksoax | bigjools: but anyways, the db_get and stuff | 03:44 |
| roaksoax | bigjools: see at maas-dhcp.config that will show you how the question is asked | 03:44 |
| roaksoax | bigjools: basically, the .config should ask the questions | 03:44 |
| roaksoax | db_input high maas-dhcp/maas-dhcp-range || true db_go | 03:44 |
| roaksoax | db_input high maas-dhcp/maas-dhcp-range || true db_go | 03:44 |
| roaksoax | err | 03:44 |
| roaksoax | db_input etc etc | 03:44 |
| roaksoax | db_go | 03:44 |
| roaksoax | and in .postinst | 03:45 |
| roaksoax | db_get should be used to obtain the value | 03:45 |
| bigjools | I already do this | 03:45 |
| bigjools | but only on configure | 03:45 |
| bigjools | or reconfigure | 03:45 |
| bigjools | it doesn't seem to get called on install | 03:45 |
| bigjools | oh | 03:46 |
| roaksoax | bigjools: so look at region-controller.postinst for what I do in reconfigure | 03:46 |
| bigjools | I am missing a .config! | 03:46 |
| roaksoax | to set the new value | 03:46 |
| bigjools | yeah | 03:47 |
| bigjools | roaksoax: I still think this is a problem | 03:48 |
| bigjools | for dist upgrades | 03:49 |
| roaksoax | indeed | 03:49 |
| roaksoax | we'll have to get them tested very well | 03:49 |
| roaksoax | we not only have to consider dist-upgrade,s but also CD installs | 03:49 |
| bigjools | in maas.config it avoids asking questions on install | 03:49 |
| roaksoax | bigjools: that's a hack for dbconfig-common | 03:50 |
| bigjools | I don't know how to detect all these conditions | 03:50 |
| roaksoax | bigjools: bigjools and to not ask for default-maas-url, becuase we were "attempting" to determine it automatically | 03:50 |
| roaksoax | so maas.postinst was a special case because they didn't want dbconfig-common questions being shown on install | 03:51 |
| roaksoax | nor ask for the IP MAAS used | 03:51 |
| roaksoax | so we made a first attempt to determine it | 03:51 |
| roaksoax | that is why often times | 03:51 |
| roaksoax | we have to run a reconfigure | 03:51 |
| bigjools | ok | 03:51 |
| roaksoax | to set the IP of the internal network or network that is connected to the clients | 03:51 |
| roaksoax | bigjools: we cannot just do that on cluster-controller because is a completely different case | 03:52 |
| bigjools | indeed | 03:52 |
| roaksoax | unfortunately :( | 03:52 |
| bigjools | look, I'll set it up now so it asks questions so I am unblocked, we can fix it later | 03:52 |
| bigjools | It's almost in a usable state nw | 03:53 |
| bigjools | now | 03:53 |
| roaksoax | awesome! | 03:53 |
| roaksoax | i'll play with it tomorrow | 03:53 |
| bigjools | well it installed | 03:53 |
| bigjools | that's a start :) | 03:53 |
| bigjools | I just have this config proboem | 03:53 |
| roaksoax | bigjools: hehe, well you got the easy part | 03:53 |
| roaksoax | :) | 03:53 |
| bigjools | :) | 03:53 |
| roaksoax | separating is much easier than packaging from scratch :) | 03:53 |
| bigjools | I've never made a package before | 03:53 |
| roaksoax | i suffered hard when i first packaged maas :) | 03:54 |
| bigjools | yeah well I cobbled up the first revision of packaging too, because I just used a tool to do it :) | 03:54 |
| roaksoax | heheh | 03:54 |
| roaksoax | well that's how you learn | 03:54 |
| bigjools | whose name I forget | 03:54 |
| roaksoax | hands on experience | 03:54 |
| bigjools | totally | 03:54 |
| roaksoax | anyways | 03:54 |
| roaksoax | i'm off | 03:54 |
| bigjools | good night, and thanks roaksoax | 03:55 |
| roaksoax | have a good rest of the day | 03:55 |
| bigjools | yeah, lunchtime is here | 03:55 |
| hazmat | what does maas do if an api user asks for a non precise/quantal series? | 04:34 |
| jam | jtv: why is the nvidia driver corrupting your filesystem ? | 04:38 |
| jtv | jam: I don't know if it is. But the last time I had regular filesystem corruption on this system, William had the same problem at the same time using the same driver. Plus we know the problems with nvidia... | 04:40 |
| hazmat | roaksoax, fwiw merged the branch, and fixed the broken test | 04:41 |
| lifeless | jtv: do you suffer machine lockups ? | 04:43 |
| jam | huwshimi: I'd like to chat with you quickly about the UI changes for hardware constraints. We've done most of the backend stuff, but I'm not 100% sure where to put the frontend changes. | 04:43 |
| huwshimi | jam: Sure | 04:44 |
| jtv | lifeless: no, no lockups. I suspect memory corruption just hitting the filesystem because the filesystem keeps so much data in memory. | 04:45 |
| jtv | Lots of crashes, of course, and no unity. | 04:45 |
| jtv | But that may be normal unrelated beta fare. | 04:45 |
| lifeless | machine crashes ? | 04:45 |
| lifeless | spontaneous reboots/OOPSes ? | 04:45 |
| huwshimi | jam: Hangout/irc? | 04:47 |
| jam | huwshimi: well, IRC is fine for me, but we could do hangout, too. | 04:48 |
| huwshimi | jam: IRC is fine. | 04:48 |
| jam | huwshimi: so I think the basic idea is to expose: cpu_count/mem/arch/tags to the Node page itself | 04:49 |
| jam | at least as a first step | 04:49 |
| huwshimi | jam: Yup. | 04:50 |
| jam | huwshimi: so what do I actually edit on my end to make sure that stuff gets exposed for you. | 04:50 |
| jam | is it updating the 'views' or the 'forms' or the HTML template code? (All of the above?) | 04:51 |
| roaksoax | hazmat cool thanks | 04:52 |
| roaksoax | allenap: around already¿ | 04:52 |
| huwshimi | jam: You'll need to expose the hardware info in NodeView (src/maasserver/views/nodes.py) | 04:52 |
| huwshimi | (I think that's the right place) | 04:53 |
| huwshimi | jam: I can then expose them on the html side | 04:53 |
| jam | huwshimi: k | 04:54 |
| huwshimi | jam: I'm not sure about the specific implementation, but it will be something along the lines of adding the data to the context for rendering (I'm not sure how familiar you are with Django). | 04:55 |
| jam | huwshimi: not very, but I'm pretty good at 'google: django XXX' :) | 04:56 |
| huwshimi | hehe | 04:56 |
| huwshimi | jam: You can test it by outputting the same variable names somewhere in the template (with {{ var_name }}) | 04:56 |
| bigjools | roaksoax: allenap only went to bed an hour ago :) | 04:57 |
| roaksoax | heh :) | 04:58 |
| bigjools | roaksoax: got the dbconf working for now | 04:58 |
| huwshimi | jam: Also, somewhere there will be a place to test the view is returning the correct data. | 04:58 |
| bigjools | needs fixing for upgrade + CD install cases but it's a starty | 04:58 |
| roaksoax | awesome | 04:58 |
| roaksoax | indeed | 04:58 |
| roaksoax | alright illntest tomorrow | 04:58 |
| bigjools | typos R us today | 04:58 |
| huwshimi | jam: Ah, src/maasserver/tests/test_views_nodes.py and you can test the client response contains the vars | 04:59 |
| jam | huwshimi: thanks | 05:00 |
| jtv | lifeless: not experiencing reboots, no. Individual programs crash. | 05:01 |
| lifeless | jtv: ah, how annoying | 05:03 |
| lifeless | jtv: anything in dmesg ? | 05:03 |
| jtv | What sort of thing are you thinking of? | 05:03 |
| jtv | (I also had to switch to KDE for the duration, so a poor comparison base) | 05:04 |
| lifeless | you sometimes get warnings on bad memory reads | 05:04 |
| jtv | Oh | 05:04 |
| lifeless | or crashes in kernel threads | 05:04 |
| jtv | The last time I had the FS corruption problem I did a full memory check. Showed no problems. | 05:04 |
| jtv | Nothing in dmesg that jumps out at me. | 05:05 |
| jtv | I'll have a closer look on my next few crashes. | 05:06 |
| jtv | bigjools: how about I remove the uuid option from start-cluster-controller but add the uuid generation/loading in a separate branch? | 05:10 |
| bigjools | jtv: sounds good | 05:10 |
| jtv | ok | 05:10 |
| bigjools | sorry I missed your reply to the MP, I'm not checking email religiously ATM | 05:12 |
| bigjools | jtv: python-netifaces!!!! | 05:13 |
| jtv | Yeah | 05:13 |
| bigjools | jtv: we should check with rbasak that it works on arm | 05:14 |
| jam | bigjools: mgz and I won't make it to the standup today. He is on a train going to London, and I have to go pick up my son from school (it is an early-out day). | 05:53 |
| bigjools | ok thanks for letting me know | 05:53 |
| jam | We are essentially polishing the Tag api a bit, I'm looking to expose the new fields for the HTML, and working up a list of things for Diogo to test. | 05:54 |
| jam | I'm also personally running into 'make run' doesn't work on my Quantal VM | 05:54 |
| bigjools | Diogo is going to be a busy man | 05:54 |
| bigjools | what's happening? | 05:54 |
| jam | Well, a lot of our testing can be automated, I think. Which is meant to be done as part of the Jenkins w/ packages, right? | 05:54 |
| jam | bigjools: well, something starts up, but then I get proxy errors if I try to connect to the web ui. | 05:55 |
| jam | I'm also wondering if it is related to my other rabbit failures. | 05:55 |
| jam | I can connect to port 5240, but 5243 (?) is failing to respond | 05:55 |
| bigjools | I've had this before | 05:56 |
| jam | 'bin/test.maas' is failing a Rabbit test, and hanging on another one. | 05:56 |
| jam | and 'make run' doesn't seem to be bringing up a service, but it is hard to sort through the chatter to figure out what is actually wrong. | 05:57 |
| jtv | jam: manually starting the regular rabbit service didn't work? | 05:57 |
| jam | jtv: it is already running | 05:57 |
| jam | restarting it didn't help | 05:57 |
| jtv | :( | 05:57 |
| jam | Just now I did uninstall and re-install the rabbitmq-server, but it still failed in the test suite. | 05:58 |
| jtv | jam: did you try ctrl-C'ing the test to see the traceback? | 05:58 |
| jam | jtv: I can get that, (which is how I know it is a rabbit test) | 05:59 |
| jam | I can paste it for you. | 05:59 |
| jam | In 'ps' I do see a beam.smp process running as a child of the test runner. | 05:59 |
| jam | jtv: http://paste.ubuntu.com/1229812/ | 06:00 |
| bigjools | 5243 is longpoll isn;t it? | 06:02 |
| jam | jtv, bigjools: It looks like I'm getting a 'logs/webapp/current' message which is lockfile.LockTimeout | 06:03 |
| jam | So maybe there is a stale lockfile somewhere? | 06:03 |
| jam | where would that be? | 06:03 |
| bigjools | in /run | 06:03 |
| jtv | Oh, the /run/maas.* | 06:03 |
| jam | jtv: no files named ./run/maas | 06:03 |
| jam | only named exists there | 06:03 |
| bigjools | no . | 06:04 |
| bigjools | / | 06:04 |
| jtv | /run/maas.* | 06:04 |
| jtv | They have a tendency to stick around, don't they? | 06:04 |
| bigjools | database one sometimes does for me | 06:04 |
| jam | bigjools: /run is owned by root, and there is no '/run/maas' directory | 06:04 |
| jam | are we supposed to be doing 'sudo make run' ? | 06:04 |
| bigjools | no | 06:04 |
| bigjools | hmm | 06:05 |
| bigjools | what's going on | 06:05 |
| jtv | Not /run/maas/, as I recall, but /run/maas.* | 06:05 |
| jam | jtv: ls /run/ma* no such file or directory | 06:06 |
| jtv | /run/lock maybe? | 06:06 |
| jtv | That's a directory. | 06:06 |
| jam | jtv: lots of /run/lock/maas* files | 06:06 |
| jam | just nuke those? | 06:06 |
| bigjools | ah that's it :) | 06:06 |
| jtv | Better make sure their associated processes are dead. | 06:06 |
| jam | jtv: no python processes running that are 'maas' related. | 06:07 |
| jtv | Doesn't have to be python IIRC. | 06:08 |
| jtv | The files contain pids, don't they? | 06:08 |
| jam | however, I still get 'Service Temporarily Unavailable' on localhost 5240 | 06:08 |
| bigjools | jtv: have we got a quick way of seeing if a string matches an enum value? | 06:08 |
| jtv | bigjools: map_enum | 06:08 |
| jam | jtv: well those files don't exist anymore now... :) | 06:08 |
| jtv | You turn the enum into a dict, then see if the string is in there. | 06:08 |
| jam | jtv: and looking at it now that they exist again, they are all 0 length files. | 06:08 |
| jam | no pids | 06:08 |
| jtv | Erm. Haven't had these problems for a while so don't recall which processes they were. :( | 06:08 |
| jtv | Try ps -ef | grep maas | 06:09 |
| jtv | (The "maas" is often in surprising places IIRC, such as the path for the executable; you're not looking for executables called maas) | 06:09 |
| jam | jtv: only postgres and my editor | 06:10 |
| jtv | See any named running? | 06:11 |
| jam | jtv: no, because the install recommended disabling named as part of installing bind | 06:11 |
| jam | (I can run it in my vm, though) | 06:12 |
| jtv | Just checking -- it's one of those processes I found myself killing a lot when I had lock-file problems. | 06:14 |
| jam | jtv: now I have named running, startup still seems to be not working properly: http://paste.ubuntu.com/1229823/ | 06:14 |
| jam | Note that the lock file that seems to be going stale is "maasserver.start_up.lock' | 06:15 |
| jam | I see that there *is* such a process | 06:15 |
| jtv | Maybe it's not stale, just blocked... What were we supposed to be running on 5423? | 06:15 |
| jam | (because that file has the same inode as link-vm.MainThread-29249) | 06:16 |
| jam | which is an existing pid | 06:16 |
| jtv | Hmm... the API I guess. I thought that'd be on 5240. | 06:17 |
| jtv | jam: I guess apache could be implicated then. | 06:18 |
| jam | jtv: ./logs/webapp/current still has a timeout trying to grab the FileLock. However, I see that the file exists on disk, and if I delete it, I still get a failure. | 06:19 |
| jtv | Sounds as if the lingering lock is a symptom, not the cause. | 06:20 |
| jtv | In other words, maybe it's not stale, just blocked on something. | 06:20 |
| jam | jtv: my immediate thought is that the timeout passed to LockTimeout is being misinterpreted. The docs say it is 'seconds', but what if it is 'milliseconds' | 06:22 |
| jam | hmmm... the code looks to be using time.timeout, which seems like it would be fine. | 06:23 |
| jam | sorry, time.time() which definitely should be seconds. | 06:23 |
| jtv | jam: any luck with that timeout? I'm guessing you're experimenting with it. | 06:32 |
| jtv | And by the way, no idea whatsoever whether it matters here, but I believe timestamp granularity in ext3 seems to be one second. So your filesystem _might_ be one of those little things to check. | 06:33 |
| jtv | bigjools: I'm hoping to write a cluster controller's uuid to a file in /var/lib/maas, but then we'll have to deal with distribution once we start worrying about cluster HA. | 06:34 |
| bigjools | jtv: let's cross that when we come to it | 06:35 |
| jtv | All for that. Thanks. | 06:35 |
| jam | jtv: well it isn't doing a stat on the fs. what is weird is that it appears to be creating the unique name, hard linking it to the lock file it wants, and then failing with a timeout after it all was successful | 06:35 |
| jtv | What is "it" by the way? | 06:35 |
| jam | jtv: lockfile.FileLock seems to be raising the LockTimeout exception, even though it managed to really acquire the lock. | 06:39 |
| jtv | Urh | 06:40 |
| jam | jtv: however, that is a falsity, because nothing is actually writing to logs/webapp/current, it must be stale data. | 06:40 |
| jtv | Weird clock skew problem? | 06:40 |
| jam | (I nuked the files, and started again) | 06:40 |
| jtv | Or is it doing some post-lock check that's failing, but not showing up in strace? | 06:40 |
| jam | I do see an error in 'managed-keys-zone ./IN: loading from master file failed: file not found' | 06:40 |
| jtv | jam: hunch... could you have a look at your syslog to see if apparmor is throwing a spanner in the works? | 06:41 |
| jtv | jam: oh, on an unrelated topic -- we have a "make lint" target similar to launchpad, except it doesn't care whether changes are committed or not. Please spread the word that it should be run religiously! | 06:43 |
| jam | jtv: named complaining that the socket is already in use? | 06:43 |
| jtv | <genuflectur> | 06:43 |
| jam | jtv: yeah, I've been trying to do so | 06:43 |
| jtv | jam: hnyargh... we've run into that | 06:43 |
| jtv | This is a fresh trunk, not a PPA build, right? | 06:43 |
| jam | jtv: well, my branch, but yeah 'trunk-ish' | 06:44 |
| jtv | Good enough | 06:44 |
| jam | jtv: stracing the 'runserver' pid is showing it blocked on recv(6, | 06:44 |
| jam | that sounds like it is listening | 06:44 |
| jam | jtv: any way to debug what filehandle '6' is? | 06:45 |
| jtv | Any idea where that fd goes? | 06:45 |
| jtv | lsof | 06:45 |
| jam | jtv: localhost:58371 which seems to be an ampq? | 06:46 |
| jam | TCP localhost:58371->localhost:amqp (ESTABLISHED) | 06:47 |
| jam | jtv: so it looks like that is waiting for ampq to tell it to do something, but it isn't getting anything | 06:48 |
| jam | which sounds related to 'rabbit is br0ken on this machine' | 06:48 |
| jtv | yeah | 06:49 |
| jtv | funny thing is, it's a synchronous exchange. | 06:49 |
| jtv | request-wait-receive | 06:50 |
| jtv | You'd expect that to break if there were a serious problem with rabbit. | 06:50 |
| jam | I saw 2 beam processes running, and service stop rabbitmq killed only one of them, and caused a traceback in the terminal | 06:51 |
| jtv | maybe one ate the other one's message | 06:52 |
| jam | If rabbitmq-server is stopped | 06:52 |
| jam | then I get a socket.error tracebakc in 'write_full_dns_config' | 06:53 |
| jam | which seems to be the thing wanting to talk to rabbit | 06:53 |
| jtv | write_full_dns_config? Isn't that one we replaced? | 06:57 |
| * jtv checks | 06:57 | |
| jtv | ah no, I'm thinking of dhcp config. | 06:57 |
| jam | jtv: so from what I can tell, the service is hanging on startup trying to tell rabbit to write the dns configuration, and waiting for rabbit to respond. | 06:57 |
| jam | if I don't have rabbimq-server running, webapp crashes immediately. | 06:58 |
| jam | If I do have it running, it is hung in 'recv()' | 06:58 |
| jtv | Trying to get a confirmation from rabbit that it's got the message, I guess | 06:58 |
| jtv | (The synchronous exchange I described earlier was from the traceback you pasted, in the rabbit test. May not be exactly the same situation.) | 06:59 |
| jtv | Any logs from rabbit? | 06:59 |
| jam | "accepting AMQP connection ..." | 07:00 |
| jam | but nothing else. | 07:00 |
| jam | though it accepts an awful lot of them. | 07:00 |
| jam | 'disk free space limit now exceeded' ? | 07:01 |
| jam | I have 800MB free, but it seems to have a warning at 1GB? | 07:01 |
| jam | jtv: ugh. celeryd has a traceback of 'IOError(ENOENT)' trying to read the DHCP_LEASES_FILE | 07:11 |
| jtv | Hhnnnny | 07:11 |
| jam | I have the feeling the celery worker is dying trying to check if the file is current. | 07:11 |
| jam | so it isn't responding | 07:12 |
| jam | and the main thread is then just hung waiting for it to return. | 07:12 |
| jtv | It should be trying to parse that file when it gets the right task. | 07:12 |
| jtv | Oh! | 07:12 |
| jtv | And we have it set to keep retrying, don't we? | 07:12 |
| jtv | We never really decided how to deal with that sort of thing. | 07:13 |
| jtv | I mean, we decided to set the jobs to keep retrying, but no clear rule for how/when to give up. | 07:13 |
| jam | jtv: from what I can tell, it is trying to load the file, and then process updates and re-write the file | 07:15 |
| jam | but the file doesn't exist | 07:15 |
| jam | so it just dies trying to load it. | 07:15 |
| jtv | We don't rewrite the leases file as such... dhcpd does that. | 07:15 |
| jam | well, I also don't even have a /var/lib/maas directory | 07:15 |
| jam | so something isn't creating it. | 07:15 |
| jam | hmm.. I did not have 'maas-provisioining' installed. | 07:17 |
| jam | still no /var/lib/maas | 07:17 |
| * jam off to go get my son. | 07:27 | |
| rbasak | bigjools, jtv: what do I need to test works on ARM? | 07:28 |
| bigjools | can anyone run lint on quantal? | 07:29 |
| jtv | bigjools: we had some lint earlier, but lint worked | 07:29 |
| bigjools | rbasak: python-netifaces package | 07:29 |
| jtv | rbasak: a python package... hang on... | 07:29 |
| jtv | ah yes that | 07:29 |
| bigjools | would make jtv happy I reckon | 07:29 |
| bigjools | jtv: I get this: | 07:30 |
| bigjools | ImportError: /home/ed/canonical/maas/sandbox/lib/python2.7/lib-dynload/parser.so: undefined symbol: _PyNode_SizeOf | 07:30 |
| bigjools | make: *** [lint] Error 123 | 07:30 |
| jtv | I think I had something like that a few days back but "make distclean build" fixed it. | 07:31 |
| jtv | It works for me in trunk. | 07:32 |
| bigjools | distclean.... weep | 07:32 |
| jtv | "Have you tried turning it off and on again?" | 07:33 |
| bigjools | that fixed it. Stale .so/.pyc file I suppose | 07:34 |
| === rvba is now known as Guest78352 | ||
| rbasak | bigjools, jtv: python-netifaces (out of pypi using easy_install) appears to work fine on armhf/highbank: https://pastebin.canonical.com/75431/ | 08:29 |
| jtv | rbasak: thanks! But... out of pypi? Not the package? | 08:30 |
| rbasak | I didn't see a package | 08:30 |
| rbasak | ah | 08:30 |
| rbasak | OK I see it now | 08:30 |
| rbasak | My hacked ARM MAAS install doesn't set up sources.list right :-/ | 08:30 |
| rbasak | Now...where's easy_uninstall? | 08:31 |
| bigjools | :) | 08:31 |
| * rbasak finds rm -Rf | 08:31 | |
| jtv | Execuse me while I go through 2-factor auth... | 08:32 |
| rbasak | I have a yubikey on the side of my monitor | 08:32 |
| rbasak | The hard part is the first factor because I don't know what my password is | 08:32 |
| rbasak | OK so from the package: https://pastebin.canonical.com/75432/ | 08:33 |
| jtv | _rvba: you mentioned WORKER_UUID... wouldn't CLUSTER_UUID make sense as a name for the UUID setting? | 09:10 |
| _rvba | jtv: yeah, CLUSTER_UUID is probably better. | 09:11 |
| jtv | OK | 09:11 |
| jtv | I guess I'll have to set it both in the global and in the local config, and then postinst will override the latter. | 09:11 |
| jtv | I'm initializing it to None, not the empty string, to avoid any risk of mistaking the initial value for a proper uuid. | 09:12 |
| _rvba | Ok. | 09:13 |
| jtv | _rvba: I've been wondering... do we also need to write queue definitions in the celery config? | 09:18 |
| _rvba | jtv: no, the queues will be auto-created by celery. | 09:18 |
| jtv | Sweet. | 09:18 |
| _rvba | # Each cluster should have its own queue created automatically by Celery. | 09:18 |
| _rvba | CELERY_CREATE_MISSING_QUEUES = True | 09:18 |
| _rvba | jtv: ^ | 09:18 |
| jtv | Perfect. | 09:19 |
| === _rvba is now known as rvba | ||
| jtv | rvba: you did it! | 09:49 |
| rvba | jtv: yep :) | 09:49 |
| * jtv applauds | 09:49 | |
| === matsubara-afk is now known as matsubara | ||
| roaksoax | rvba: howdy | 13:19 |
| rvba | roaksoax: Hi. | 13:19 |
| roaksoax | rvba: so I was looking to add to the Settings page the commisioning_distro_series | 13:19 |
| roaksoax | rvba: so i did, but i think i'm missing something | 13:20 |
| roaksoax | rvba: http://paste.ubuntu.com/1230392/ | 13:20 |
| roaksoax | allenap: howdy! | 13:20 |
| roaksoax | allenap: there's an issue on the tftp server or so it seems... | 13:21 |
| rvba | roaksoax: the 'initial' stuff should not be required I think, it will be picked up based on the config value. | 13:21 |
| allenap | roaksoax: I heard that tests were failing but haven't had a chance to look any further. Is that what you're thinking about? | 13:21 |
| roaksoax | rvba: that's the thing, it doesn't seem to be picking it | 13:22 |
| roaksoax | allenap: nope, let me show you a log | 13:22 |
| rvba | roaksoax: I can do that change to the Settings page for you. | 13:22 |
| roaksoax | rvba: sure! I just wanted to figure out how is it that the value gets updated (the config value) based on what's selected on the UI | 13:22 |
| rvba | roaksoax: especially if that can free up your time so that you can make progress on the packaging stuff ;) | 13:23 |
| rvba | roaksoax: I'm sorry to insist like this, but this is really critical for us. We need it to be able to test and fix stuff. | 13:23 |
| roaksoax | allenap: so the esceneario is simple. I added the squashfs image to the tftp path so that the installer can use it. However, this error appears: https://pastebin.canonical.com/75454/ | 13:25 |
| roaksoax | allenap: that's kinda critical btw :) | 13:25 |
| roaksoax | rvba: hehe no worries, either way I'm still blocked on other stuff | 13:26 |
| roaksoax | forgot to ask bigjools last night about the power settings update on commissionning | 13:27 |
| rvba | roaksoax: ok, still, I'll do that change to the settings page. | 13:27 |
| rvba | roaksoax: that's landed. | 13:27 |
| rvba | roaksoax: the power settings update stuff I mean. | 13:27 |
| roaksoax | rvba: nice! what's the rev? | 13:28 |
| roaksoax | rvba: i see it | 13:28 |
| rvba | 1089 | 13:28 |
| roaksoax | rvba: any examples of how to send the data back? | 13:29 |
| rvba | roaksoax: sure, just one sec. | 13:30 |
| roaksoax | smoser: http://bazaar.launchpad.net/~maas-maintainers/maas/trunk/revision/1089 | 13:30 |
| rvba | roaksoax: you can have a look at test_signal_power_type_stores_params (src/metadataserver/tests/test_api.py) but it's simple: just send a jsonized version of the power parameter in the power_parameter param. | 13:31 |
| roaksoax | rvba: awesome, thanks | 13:35 |
| rvba | welcome | 13:35 |
| allenap | roaksoax: The file is too big to be transferred over TFTP :-/ | 13:36 |
| roaksoax | allenap: right, but what's the size limit then? | 13:39 |
| allenap | roaksoax: The maximum file size is (blocksize * 2**16), blocksize defaults to 512 bytes but can be negotiated up to 1428 on ethernet, so 93585408 bytes, or ~89MB. | 13:41 |
| allenap | With negotiation it's 32MB. | 13:41 |
| allenap | s/With/Without/ | 13:41 |
| allenap | roaksoax: How big is the squashfs? | 13:42 |
| allenap | Can it be transferred via HTTP instead? | 13:42 |
| roaksoax | allenap: then something is wrong | 13:44 |
| roaksoax | ubuntu@maas:/var/lib/maas/tftp/amd64/generic/quantal/install$ du filesystem.squashfs -B MB | 13:44 |
| roaksoax | 64MB filesystem.squashfs | 13:44 |
| allenap | roaksoax: It's not negotiating blksize then. That't not automatic; it's up to the client to request it. | 13:45 |
| allenap | roaksoax: That's a *very* big file for TFTP. Is there any alternative? | 13:45 |
| roaksoax | allenap: http..though we were trying to avoid using it | 13:46 |
| roaksoax | dannf: ^^ | 13:46 |
| roaksoax | err | 13:46 |
| roaksoax | sorry | 13:46 |
| roaksoax | Daviey: ^^ | 13:46 |
| allenap | roaksoax: If it helps, it's trivially easy to add an HTTP server alongside the TFTP server, in the same process, so serving the same files. | 13:46 |
| roaksoax | allenap: yeah I already did :) | 13:47 |
| roaksoax | allenap: but we were trying to avoid having to do that | 13:47 |
| allenap | roaksoax: I don't mean Apache or anything like that, I mean a few lines of Python to make the TFTP server also serve up the tree on HTTP. So, no extra packaging or anything. | 13:48 |
| roaksoax | allenap: http://paste.ubuntu.com/1230452/ | 13:49 |
| roaksoax | allenap: that's what I did | 13:49 |
| roaksoax | allenap: what is your idea? | 13:50 |
| allenap | roaksoax: Right. That's part of the region controller. The TFTP server should be part of the cluster controller, though I'm not sure it is yet, because we don't have a story around mirroring /var/lib/maas/image/ to cluster controllers. | 13:51 |
| roaksoax | allenap: i though all the tftp and preseeds where at the region controller | 13:52 |
| allenap | roaksoax: My idea would be to start an HTTP service in the twistd process that the TFTP server runs in, to save on duplicating config. | 13:52 |
| roaksoax | allenap: right, but that would mean we would have to use a different port | 13:52 |
| allenap | roaksoax: Yeah, they are, but they shouldn't be. The TFTP server was always intended for the cluster controller. | 13:52 |
| roaksoax | allenap: if we are running on all-in-one | 13:53 |
| roaksoax | escenario | 13:53 |
| allenap | roaksoax: Yeah, different port. | 13:53 |
| roaksoax | allenap: right, but at the moment, where is it that the tftp files are? | 13:53 |
| rvba | roaksoax: care to review? https://code.launchpad.net/~rvb/maas/improv-settings/+merge/126689 | 13:55 |
| allenap | roaksoax: The TFTP server needs three things: static file tree (/var/lib/maas/tftp), templates (src/provisioningserver/pxe/config.*), and the URL for the region controller. | 13:55 |
| roaksoax | rvba: whjy are you removing the distro_series from the the NodeForm? | 13:56 |
| roaksoax | rvba: we still need that | 13:56 |
| allenap | roaksoax: Templates are in the package, and the URL is config; the first of those, the boot files, isn't mirrored to the clusters, so we have to run on the region controllers until we do. | 13:57 |
| roaksoax | that's a different series from the commissioning one and the one in settings | 13:57 |
| rvba | roaksoax: ah, indeed. | 13:57 |
| roaksoax | allenap: and when is that going to be done? | 13:57 |
| allenap | roaksoax: No time soon, and it doesn't solve the problem of moving the squashfs over the wire. | 13:58 |
| roaksoax | allenap: right, so we also need to send something like: d-i live-installer/net-image string http://{{server_host}}/MAAS/static/image/{{node.distro_series}}/{{node.architecture}}/quantal-server-amd64.squashfs | 13:59 |
| roaksoax | on the preseed | 13:59 |
| roaksoax | allenap: and if it is not going to be done anytime soon | 13:59 |
| roaksoax | allenap: then i think we could avoid | 14:00 |
| roaksoax | having twisted running an extra HTTP server | 14:00 |
| allenap | roaksoax: That snippet of Apache conf and that update to the preseed sound like things that can be done fairly quickly. I don't see a blocker for those. | 14:00 |
| roaksoax | allenap: right, so when the cluster-controller servers the tftp itself | 14:01 |
| roaksoax | i think we can look into the HTTP stuff | 14:01 |
| roaksoax | becuase either way, we need to tell the preseed *where* the HTTP files | 14:01 |
| roaksoax | allenap: and the preseed wont be able to determine in what cluster controller are they, right? | 14:01 |
| allenap | roaksoax: Yeah. Twisted can run it, or we can run Apache or whatever. | 14:02 |
| jtv | matsubara: hi -- I landed that new command for starting a cluster controller. Once you have packaging r98 and trunk r1091, maybe you could try it? I can't build packages at the moment for some reason. | 14:03 |
| allenap | roaksoax: The code that generates the preseed should know which node it's preparing it for, so it can look-up which cluster controller it should link to. | 14:03 |
| smoser | roaksoax, the signal thing looks reasonable. | 14:03 |
| jtv | Ah, sending up power settings to the metadata signal call? | 14:03 |
| smoser | sorry.. just reading above. | 14:04 |
| smoser | it would seem simpler to me to have maas run a http server | 14:04 |
| smoser | than to bother configuring apache | 14:04 |
| smoser | the only reason i'd be hesitant is that apache can deliver large files REAL FAST and at scale. i dont know how well simple python web server does for that. | 14:04 |
| smoser | (and i'd run the web server not on port 80) | 14:04 |
| matsubara | jtv, will do | 14:05 |
| smoser | if i was doing it from twisted. that just avoids conflict with anything else. | 14:05 |
| rvba | roaksoax: field restored on NodeForm :) | 14:05 |
| jtv | matsubara: thanks! It should be just a matter of making sure that celery is not running, and then doing "maas-provision start-cluster-controller <maas-url>" | 14:05 |
| matsubara | jtv, do you get any error when you try to request a build? | 14:06 |
| matsubara | jtv, I just did and it seemed to work | 14:06 |
| matsubara | I'm wondering if you're hitting the daily build limit | 14:07 |
| jtv | Oh, I haven't tried requesting on in Launchpad. Just locally from my own branches. | 14:07 |
| matsubara | jtv, ah ok | 14:07 |
| roaksoax | allenap: ok, just tested downloading the image with tftp using a tftp-hpa server, and it worked like a charm | 14:08 |
| roaksoax | allenap: so there's an issue on the tftp maas is running | 14:08 |
| roaksoax | not client side | 14:08 |
| allenap | smoser: While we're restricted to running this from the region controller, let's use Apache. | 14:09 |
| allenap | And think again when that situation changes. | 14:09 |
| allenap | roaksoax: What did you download it with? | 14:09 |
| roaksoax | rvba: http://pastebin.ubuntu.com/1230497/ | 14:10 |
| roaksoax | allenap: 'tftp' | 14:10 |
| rvba | roaksoax: arg, the format-import script failed me, fixed. | 14:11 |
| allenap | roaksoax: Okay (there are two packages that provide /usr/bin/tftp, but that doesn't really matter). Does the download fail using tftp against maas's tftp server? | 14:12 |
| allenap | Or was the failure from pxelinux or something? | 14:12 |
| roaksoax | allenap: download fails agains maas tftp server, and download succeeds against tftp-hpa server | 14:13 |
| roaksoax | against* | 14:13 |
| roaksoax | allenap: the file i'm downloading is the squashfs image | 14:13 |
| roaksoax | in both servers | 14:13 |
| roaksoax | allenap: here's the file: http://cdimage.ubuntu.com/ubuntu-server/daily/current/quantal-server-amd64.squashfs | 14:14 |
| roaksoax | the one against the maas tftp server fails, the one against tftp-hpa succeeds | 14:14 |
| allenap | roaksoax: My guess is there's some option negotiation not happening. I'll see if I can debug it. | 14:15 |
| roaksoax | allenap: cool thanks | 14:17 |
| roaksoax | smoser: ok so how can we extend maas-signal to send the power settings? | 14:19 |
| allenap | roaksoax: Yeah, it's getting 32MB then failing. I have to go out now, but I'll be back in ~1h. | 14:20 |
| roaksoax | allenap: ok thanks | 14:20 |
| smoser | roaksoax, i can put that togetheri think. | 14:23 |
| smoser | can you get a json blob collected? | 14:23 |
| roaksoax | sure | 14:25 |
| jam | mgz: poke | 14:27 |
| mgz | jam: wiggle | 14:27 |
| jam | mgz: how's London? | 14:28 |
| jam | when's the conference? | 14:28 |
| jam | My one-hour trip to get my son turned into a 6-hour sojourn to Ikea with my wife, to pick out cabinets and curtains for the new house. | 14:29 |
| mgz | jam: not till 6:30, so, some hours yet | 14:29 |
| jam | So I'm working late tonight. | 14:29 |
| mgz | ikea is all-devouring | 14:29 |
| jam | mgz: I think I have 2 branches for review, but it isn't terribly critical vs making sure we have testable stuff. | 14:30 |
| jam | On the flip side, I couldn't get 'make run' to actually work here, because rabbit or DHCP is not playing along nicely. | 14:30 |
| mgz | so, I have a few things to fix in my pending branches but otherwise we're good I think | 14:30 |
| jam | So I wasn't able to get to the point to audit for exposing stuff to the view, or to make sure the CLI worked how I expected. | 14:30 |
| mgz | I wonder what make run does here... | 14:30 |
| mgz | django.db.utils.DatabaseError: relation "maasserver_config" does not exist | 14:31 |
| mgz | LINE 1: ..._config"."name", "maasserver_config"."value" FROM "maasserve... | 14:31 |
| mgz | hm... | 14:31 |
| mgz | well, apart from that it did things :D | 14:31 |
| jam | mgz: read hacking, I think there is more stuff you need to install | 14:31 |
| roaksoax | smoser: http://paste.ubuntu.com/1230560/ ok so we would need to integrate that... how do you think would be the best option? | 14:38 |
| roaksoax | smoser: integrate it in maas-signal, use it separately? | 14:38 |
| smoser | i'd planon having that invoke maas-signal | 14:38 |
| smoser | and we can modify maas-signal to handle "ipmi" "{json-blob}" or something | 14:39 |
| roaksoax | smoser: alrogitj, one thing that the script needs is to create a temp file to avoid all of those bmc-config --commit commands | 14:39 |
| roaksoax | smoser:right, so get_maas_power_settings returns that "IPMI" "json-blob" | 14:40 |
| rbasak | roaksoax and Daviey: please could you review my branches in https://bugs.launchpad.net/ubuntu/+source/maas-enlist/+bug/1056816 ? This needs to get SRU'd for ARM on MAAS to work. | 14:41 |
| ubot5 | Ubuntu bug 1056816 in maas-enlist (Ubuntu) "maas-enlist does not post subarch" [Undecided,Triaged] | 14:41 |
| roaksoax | smoser: now, another thing, do you think we should do this "if Network is set to static, change it back to DHCP and wait for an IP"? | 14:41 |
| smoser | not without explicit instruction i would htink. | 14:43 |
| roaksoax | smoser: cause if it is static, we will set it to DHCP | 14:44 |
| smoser | right. i was just saying that htat seems like a recipe for breaking something :) | 14:45 |
| smoser | roaksoax, the maas team is in need of packaging help too, right? | 14:45 |
| smoser | did you look at that? | 14:46 |
| roaksoax | smoser: i have been working with bigjools on the packaging | 14:46 |
| roaksoax | smoser: he did some more changes I have yet to test | 14:46 |
| smoser | ok. good. | 14:46 |
| roaksoax | rbasak: is the subarch stuff already in MAAS? | 14:48 |
| rbasak | roaksoax: not yet | 14:48 |
| rbasak | roaksoax: I need this in first before it can land in MAAS, since otherwise it'll break | 14:48 |
| rbasak | roaksoax: by putting this in first, MAAS just ignores the subarchitecture field and doesn't break | 14:48 |
| roaksoax | rbasak: right, so I;d recommend this lands first in MAAS | 14:48 |
| roaksoax | rbasak: because the fact that it will land in MAAS doesn'yt mean it will be released in Quantal | 14:49 |
| rbasak | roaksoax: no, that breaks maas | 14:49 |
| roaksoax | at least not yet | 14:49 |
| rbasak | roaksoax: landing the mass-enlist change first doesn't break anything | 14:49 |
| roaksoax | rbasak: indeed. I will merge this with upstream maas-enlist | 14:50 |
| roaksoax | and upload from there | 14:50 |
| roaksoax | SRU will have to wait though | 14:50 |
| rbasak | roaksoax: thanks! | 14:50 |
| rbasak | roaksoax: SRU will have to wait on what? | 14:51 |
| roaksoax | rbasak: this is basically a new feature rather a bugfix because currently, there's no MAAS in quantal that this can be test against, hence not breaking enlistments from precise into quantal MAAS | 14:53 |
| roaksoax | so we cannot SRU a feature | 14:54 |
| roaksoax | we can SRU a bugfix | 14:54 |
| roaksoax | bug this bugfix has no way to test it, until we have MAAS in archives | 14:54 |
| rbasak | roaksoax: right, but for MAAS on ARM enablement this is required, since MAAS will be deploying precise. Unless we switch to using quantal ephemeral images? | 14:54 |
| rbasak | We just need to make sure that precise MAAS isn't broken by this SRU | 14:54 |
| jam | mgz: let me know if there is anything you need from me for review, etc | 14:55 |
| mgz | jam: maybe an eyeball on my current pending maas branch | 14:55 |
| roaksoax | rbasak: right, but that means currently, it doesn'yt fix any enlistment process becuase there's no new MAAS in precise | 14:55 |
| mgz | apart from that I'm okay I think | 14:55 |
| rbasak | roaksoax: so what do you propose I do? | 14:55 |
| roaksoax | rbasak: I'll push it to quantal, and wait until we have a new MAAS to SRU | 14:56 |
| jam | mgz: link? | 14:56 |
| roaksoax | rbasak: i'm pressuming that the MAAS for ARM enablement is going to the SRU too right? | 14:56 |
| rbasak | roaksoax: we can't have a new MAAS. I can't land the corresponding fix in MAAS without maas-enlist in precise updated | 14:56 |
| rbasak | roaksoax: so if you want to wait we're deadlocked | 14:56 |
| roaksoax | rbasak: is not about me wanting to wait, its about that there's no test case | 14:57 |
| rbasak | roaksoax: the test case for the SRU only matters for released precise MAAS, surely? | 14:57 |
| roaksoax | rbasak: we cannot say "install maas from archives, maas-enlist, things break" | 14:57 |
| rbasak | roaksoax: what else are you worried about the SRU breaking? | 14:57 |
| roaksoax | rbasak: right, but SRU needs ttest cases proving that this *fixes* a bug in *precise* | 14:58 |
| rbasak | roaksoax: SRUs for enablements are permitted too | 14:58 |
| rbasak | roaksoax: I don't see any other option. You can't wait for support for this in MAAS trunk, since I can't land that since it'll break without the maas-enlist SRU in place. | 14:58 |
| rbasak | roaksoax: so I don't see what you're proposing | 14:59 |
| roaksoax | rbasak: alright, so let's do this, I'll upload to quantal | 14:59 |
| rbasak | roaksoax: apart from being deadlocked and this never landing | 14:59 |
| roaksoax | rbasak: and could you please prepare the SRU | 14:59 |
| roaksoax | and I'll sponsor your upload | 14:59 |
| rbasak | roaksoax: SRU alreadyu prepared and linked in the bug | 14:59 |
| roaksoax | then it will be on the hands of someone over the release team | 14:59 |
| rbasak | I've already built a PPA and tested on that | 15:00 |
| roaksoax | rbasak: https://wiki.ubuntu.com/StableReleaseUpdates?action=show&redirect=SRU | 15:00 |
| roaksoax | that's what I mean by preparing an SRU | 15:00 |
| rbasak | I don't have an INtel machine to test with, but I can confirm that running curl int he same way that maas-enlist does with the architecture changed to i386 and subarchitecture generic does appear to enlist on precise packaged maas without any issues | 15:00 |
| rbasak | roaksoax: oh, as in in the bug? | 15:01 |
| rbasak | roaksoax: ok, no problem | 15:01 |
| rbasak | bug description I mean | 15:01 |
| roaksoax | yeah :) | 15:01 |
| rbasak | roaksoax: is the package OK? | 15:01 |
| mgz | jam: <https://code.launchpad.net/~gz/maas/cpu_mem_tag_constraints/+merge/126502> | 15:01 |
| roaksoax | rbasak: yeah it looks good. Note that archdetect corresponds to the one of the dpkg installed | 15:02 |
| jam | mgz: ugh. looks like bigjools' change to subscribers means I'm not getting code review email at all now... :( | 15:03 |
| mgz | jam: I gave in and manually subscribed to the branch | 15:03 |
| mgz | which I think is working | 15:03 |
| roaksoax | so if dpkg is i386 on a amd64 machine, it will be detected as i386. I don't know whether that affects your case | 15:03 |
| rbasak | I purposely skipped that case | 15:04 |
| jam | mgz: I thought I was, but maybe I missed it somewhere. I'll try again. | 15:04 |
| rbasak | I'm using the same detection that was there before | 15:04 |
| mgz | jam: <https://code.launchpad.net/~maas-maintainers/maas/trunk/+edit-subscription> | 15:04 |
| rbasak | And assuming generic for amd64 and i386 | 15:04 |
| rbasak | (rather than asking archdetect) | 15:04 |
| rbasak | roaksoax: ^^ does that sound OK to you? | 15:05 |
| roaksoax | rbasak: right, I'm just making sure you don't jump into the same bug I did. That is enlistment with a i386 installer on a x86_64 machine always resulted in a i386 system enlistmed in MAAS because of archdetect. So In order to successfully detect amd64's i had to do somthing else | 15:05 |
| rbasak | OK | 15:06 |
| jam | mgz: most classes I've seen in Maas override __unicode__ rather than __str__ is there a reason you did __str__ ? | 15:06 |
| mgz | it's truthful | 15:11 |
| mgz | exceptions get stringified in Python 2 | 15:11 |
| mgz | if you write a __unicode__ method on an exception subclass, you're liable to break worse in edge cases | 15:11 |
| mgz | there have been at least three bugs across python versions with that | 15:12 |
| jam | mgz: well, we only care about py2.7 for starters (there are some significant 2.6+isms in the code), and I'd rather be consistent with other exceptions in the module (if they use __str__ then go with it) | 15:13 |
| mgz | they don't use anything | 15:13 |
| jam | mgz: fun times, all google related addresses are failing for me right now. google/gmail/youtube/googleanalytics/... | 15:13 |
| mgz | 8.8.8.8! | 15:13 |
| jam | mgz: filtered at the ipaddress it seems | 15:13 |
| jam | going to 74.125... is failing. | 15:13 |
| mgz | or has dubai blocked google completely? :D | 15:13 |
| jam | I can get a DNS lookup | 15:14 |
| mgz | ehhee | 15:14 |
| jam | and I can use 8.8.8.8 | 15:14 |
| jam | I thought that was it, too. | 15:14 |
| jam | ping 8.8.8.8 is 35ms, but ping www.google.com is timeout | 15:14 |
| jam | mgz: and now it works again. | 15:15 |
| jam | Somebody decided to play nice in the last 20 min. | 15:15 |
| mgz | some google search result had an offensive picture... auto block all of google! | 15:15 |
| jam | mgz: you can get lots of stuff from https://www.google.com :) | 15:16 |
| jam | The cached results is apparently the favorite way to bypass the UAE firewall. :) | 15:16 |
| jam | oops, this isn't SSL IRC, I'll be see.... .gabaou aou | 15:16 |
| jam | a | 15:16 |
| mgz | eheheh | 15:17 |
| roaksoax | rbasak: uploaded | 15:21 |
| rbasak | roaksoax: thank you! | 15:21 |
| allenap | rvba: How do I get South to rename a column? Or do I always have to refer back to the original via db_column? | 15:49 |
| rvba | allenap: you can use something like db.rename_column() in the transition. | 15:50 |
| rbasak | mgz: https://code.launchpad.net/~racb/maas/subarch-model/+merge/126712 - have I broken any constraint stuff? I haven't touched anything, but Node.architecture is now "arch/subarch". | 15:53 |
| mgz | rbasak: so, it looks like you've updated the constraint tests to require the form with "/generic" on the end | 15:55 |
| mgz | so, that's not broken, and can probably be improved in a followup branch | 15:56 |
| rbasak | mgz: ah. That rings a bell, but I don't find it in the diff! | 15:56 |
| rbasak | s/don't/couldn't/ | 15:56 |
| roaksoax | allenap: ok so it is becuase tftp server doesn not support extended mode (whatever that menas :) | 16:10 |
| allenap | roaksoax: I'll have to look that one up. | 16:11 |
| roaksoax | allenap: http://ww2.unime.it/flr/tftpserver/tftp.html he problem is that some network devices (Cisco IOS devices are the most common and annoying case) don't support tftp extended mode though, so don't wonder when you are trying to transfer the latest IOS 12.4 image large 56 Mb to your Cisco router and the tftp transfer fails after 32 Mb have been transferred. | 16:11 |
| roaksoax | so it is the same problem as those cisco IOS devices :) | 16:11 |
| allenap | roaksoax: Ah, there's a mention of block number wrap-around. I'll see if that makes a difference. | 16:12 |
| roaksoax | allenap: yeah if the server doesn not send a block number for the client to ack then i ugess that's why it would only download the first 32mb | 16:14 |
| allenap | roaksoax: It's that the blocknum is limited to 2 bytes in headers. | 16:17 |
| roaksoax | allenap: http://lists.freebsd.org/pipermail/svn-src-head/2011-July/029443.html | 16:19 |
| roaksoax | allenap: now that fix needs to be adapted for python-txtftp | 16:21 |
| roaksoax | at least so it seems as a possible solution | 16:23 |
| allenap | roaksoax: I'll try and get that working. | 16:26 |
| allenap | roaksoax: Still, HTTP would be much better :) | 16:26 |
| roaksoax | allenap: i don't mind, Daviey prefers it to be tftp though | 16:28 |
| === matsubara is now known as matsubara-lunch | ||
| rbasak | roaksoax: do we also need an FFe for maas-enlist? | 16:49 |
| roaksoax | rbasak: not if it is a bugfix, since we are treating it as one, we dont | 16:49 |
| rbasak | roaksoax: OK. Is there anything more I need to do? | 16:50 |
| roaksoax | rbasak: no not for now :) | 16:51 |
| rbasak | OK thanks. Just checking! | 16:52 |
| === Guest75974 is now known as dpb___ | ||
| roaksoax | allenap: any luck? | 17:32 |
| === matsubara-lunch is now known as matsubara | ||
| === melmoth_ is now known as melmoth | ||
| smoser | roaksoax, this may or may not be useful (or work) | 21:14 |
| smoser | lp:~smoser/+junk/mirror-query | 21:15 |
| smoser | ./mirror-query https://maas.ubuntu.com/images/ my.d -vv --checksum | 21:15 |
| smoser | that should mirror maas-ephemeral locally | 21:15 |
| smoser | hmm.. bug | 21:18 |
| roaksoax | smoser: cool thanks | 21:20 |
| roaksoax | smoser: btw.. i'm seeing something wierd on the cacnonistack images | 21:21 |
| roaksoax | smoser: i'm on a root terminal | 21:21 |
| roaksoax | and everytime I do sudo whatever | 21:21 |
| roaksoax | it takes for ever | 21:21 |
| smoser | https://pastebin.canonical.com/75400/ | 21:21 |
| smoser | i opened an rt yesterday | 21:21 |
| smoser | you can fix the sudo issue by putting your fqdn in /etc/hosts | 21:23 |
| smoser | but it affects all lookups | 21:23 |
| roaksoax | smoser: cool thakns | 21:23 |
| smoser | i guess the other thing ot do is change /etc/resolv.conf | 21:23 |
| smoser | to not have that search in it. | 21:23 |
| roaksoax | ack | 21:24 |
| roaksoax | echo "#######################################################" | 21:50 |
| roaksoax | echo "##### Starting maas-region-controller postinst ########" | 21:50 |
| roaksoax | err | 21:50 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!