/srv/irclogs.ubuntu.com/2012/10/16/#maas.txt

=== matsubara is now known as matsubara-afk
ThiagoCMCHi! I'm trying MaaS but I'm facing a lots of problems... Anyway, is this a good doc: http://people.canonical.com/~gavin/docs/lp%3Amaas/install.html ?02:12
ThiagoCMCI'll try first using Ubuntu 12.1002:13
ThiagoCMCAlso, I'm reading this: http://www.ubuntu.com/cloud/private-cloud/reference-architecture this: https://help.ubuntu.com/12.04/serverguide/ubuntucloud.html and this: https://help.ubuntu.com/community/UbuntuCloudInfrastructure ... plus some others...02:15
ThiagoCMCI'm finishing maas-import-pxe-files now... Is maas-import-isos still necessary under 12.10 ?02:16
ThiagoCMCI already tried MaaS more than 10 times by now... But I can't figure out how to put it to work smoothly...  :-(02:18
ThiagoCMCBTW, I'm the author of the XenLiveCD v2.0... I meant, I have a good experience with Debian, Ubuntu, Xen, KVM, etc... But, MaaS is still a bit dark for me...   =P02:19
ThiagoCMCI'll try again with Ubuntu 12.04...  maas-dhcp/maas-dns package on 12.10 do nothing... No dhcp server running after a fresh install...    :-/02:20
flacosteThiagoCMC: the documentation is being revamped for 12.10, try http://evilnick.org/MAAS/02:55
flacoste(this will be published on maas.ubuntu.com for the release)02:56
flacosteThiagoCMC: actually, the ~gavin links also good - it contains the latest documentation generated from trunk02:57
ThiagoCMCThank you!!03:02
ThiagoCMCJust to make sure... Is MaaS usefull without Juju?! I mean, can I play a bit with MaaS before learn and install Juju?!03:08
ThiagoCMCMaybe something like add / install / remove nodes, manually deploy some services on this nodes, etc...?03:09
ThiagoCMCI'm seeing that the Ubuntu Installer, after accept and commission, I think, it just PXE boot and install a Ubuntu Server on the "machine / destination MAC" without asking me about node's disk partitions, user password, etc... And I an unable to login into a fresh installed node, even after it is "ready"... Is there a default user/password?! Is this the expected behavior?03:15
ThiagoCMCSorry if I'm asking too many things at once...03:15
ThiagoCMCI really need to fully understand MaaS...03:16
ThiagoCMCGuys... MaaS installed and managing my DHCP + DNS (Ubuntu 12.10) but, the following message do not disappear: "The region controller does not know whether any boot images have been imported yet. If this message does not disappear in 5 minutes, there may be a communication problem between the region worker process and the region controller. Check the region worker's logs for signs that it was unable to report to the MAAS API."04:27
ThiagoCMCWha can I do?!04:27
ThiagoCMCI already do this: http://evilnick.org/MAAS/04:28
ThiagoCMCdid...04:28
ThiagoCMCWhere is the "region worker's logs"?04:31
ThiagoCMCIs it the Apache's log?04:31
jtvThiagoCMC: yes, sure, you can use maas without juju04:44
jtvIIRC the region worker logs would be in /var/log/celery* on your maas server.04:45
jtvThe worker runs under celeryd, which is entirely separate from apache and the webapp.04:46
ThiagoCMCOkay... Tks!04:58
ThiagoCMCI saw some errors within the Apache log... Something related to /home/maas not being found, and some other errors... Just delete it and doing a new fresh install again... Now I'll use only 1 eth within MaaS server...05:00
ThiagoCMCWell, fresh installed Ubuntu 12.10 with maas dhcp+dns and, I'm seeing a error under apache error.log: 1- "[client 127.0.0.1] File does not exist: /var/www/MAAS" 2- "[alert] (2)No such file or directory: mod_wsgi (pid=7694): Unable to change working directory to '/home/maas'."...05:44
ThiagoCMCAlso, the message "...If this message does not disappear in 5 minutes..." don't go away... Even after ~5 minutes of "sudo maas-import-pxe-files" being executed...05:45
ThiagoCMCWhat can I do? Can I starting adding nodes? It will work?!  =P05:53
ThiagoCMCIs it possible to "enlist (add a node?)" into MaaS, a already-running fresh-installed Ubuntu 12.04 Server? I do not want use DHCP/DNS/PXE/AvahiBoot... I only want to install my ubuntu server, with my raid, my user/password and add it to MaaS, is it possible? If yes, how?06:46
ThiagoCMCYAY! Two nodes deployed... But I'm seeing a lots of errors... On Apache, on dns resolving...06:58
ThiagoCMCAnyway, thank you guys!06:58
ThiagoCMCI'm still seeing " If this message does not disappear in 5 minutes"... But the MaaS seems to be working now...    lol07:00
ThiagoCMCI'll try with Ubuntu 12.04 now...  12.10 is great!   ^_^07:02
dimiternrvba: hi, can you help me with this: when running make syncdb I get "initdb: Postgres-XC node name is mandatory" and "pg_ctl: database system initialization failed"07:06
rvbadimitern: Hi.  I've never seen that error before… I assume you have all the dependencies installed and you are on Quantal right?07:09
dimiternrvba: yes, but once I run make syncdb before it complained pg_ctl is missing, so I installed postgres-xc as was recommended, and now i'm getting this07:10
rvbadimitern: I don't have postgres-xc installed…07:11
dimiternrvba: hmmm... so which package do I need for pg_ctl it's trying to run?07:11
rvbadimitern: can you paste the full error?  The one that says you have a missing binary.07:12
dimiternrvba: just a sec, I'm removing postgres-xc to get the original error07:13
dimiternrvba: crap, so now it fails to install and I reverted the vm to a previous snapshot and need to do the release upgrade again, let's see if it'll work - when I get to the error I'll let you know, 10x07:30
dimiterns/to install/to uninstall07:31
rvbak07:31
dimiternrvba: hey, so I have some progress. After a fresh upgrade to quantal, make install-dependencies, make syncdb, I get this error: ImportError: No module named postgresfixture.main08:16
rvbadimitern: the postgresfixture should have been downloaded from pypi.08:17
rvbadimitern: did you configure a buildout cache in ~/.buildout ?08:18
dimiternwhoops no, that's what I missed, I'll do it now08:18
rvbadimitern: even if you did not do that, it should have worked, but you will have to re-download eggs from pypi each time you create a new branch in a new directory.08:19
rvbadimitern: you need to create that conf file http://paste.ubuntu.com/1282675/, plus the 3 directory mentioned in there.08:20
dimiternrvba: ok, I did that and running syncdb fails, so I did make clean08:21
rvbadimitern: is ~/.buildout/eggs/ populated?08:22
rvbadimitern: does it contain postgresfixture-0.1.2-py2.7.egg ?08:22
dimiternrvba: it's populated, but it's still installing so no postgres yet08:23
dimitern(i did make again after make clean)08:23
allenapdimitern: Are you trying to develop maas, or do you just want to run it?08:25
dimiternallenap: well, develop, if I can make it running :)08:26
allenapdimitern: Cool, right. Someone just whispered in my ear that you're the new on the Blue Squad. Welcome :)08:27
dimiternallenap: yeah, 10q :)08:27
jamallenap: I think you missed him yesterday, dimitern is the new guy on Blue squad.08:27
jamhi dimitern, sorry I missed you around earlier. I think mgz ran into the same thing you are seeing, with pg_ctl conflicting with the postgres package itself.08:28
allenapjam: How did I manage that I wonder?08:28
jamI think he said 'apt-get update' fixed it, but I don't quite remember.08:28
dimiternwell, initially i started dist upgrade from ssh and i think that screwed up the thing at some point, so i restored from a clean snapshot and now seems working better08:28
rbasakDaviey: do we need any MAAS release notes? I don't see any in https://wiki.ubuntu.com/QuantalQuetzal/ReleaseNotes/UbuntuServer but I'd like to have one for bug 1064291 for ARM juju/MAAS users08:55
ubot5Launchpad bug 1064291 in Release Notes for Ubuntu "Default constraints make no sense on MAAS" [Undecided,New] https://launchpad.net/bugs/106429108:55
dimiternrvba: so now, running syncdb gets me this:08:56
dimiternFATAL:  could not open file "pg_xlog/000000010000000000000001" (log file 0, segment 1): No such file or directory08:56
dimiternchild process exited with exit code 108:56
dimiterninitdb: removing contents of data directory "/home/maas/work/maas/db"08:56
dimiternpg_ctl: database system initialization failed08:56
rvbaHum… I think I need to summon our pg expert here… jtv ^ any idea on what might be going on?08:58
jtvHuh?08:58
jtvHmmm08:59
jtvSounds as if it might be an inconsistent database backup.08:59
dimiterni did apt-get update/upgrade just in case - the same error09:00
dimiternjtv: ok, so any clue how i might fix it?09:00
jtvI haven't read the full backscroll... this is in the db directory in your branch?09:00
dimiterni did make syncdb in the main maas dir09:00
jtvIf there's nothing valuable in that database, you can always "make distclean ; rm -rf db"09:01
jtvAnd then start again with your database.09:01
jtvThe postgres-XC bit is surprising to me as well.09:01
jtvIs this a system that was upgraded from an older ubuntu?  Or a fresh Quantal install?09:02
dimiterni did rm -fr db, and run syncdb again - same error09:02
dimiternit's an upgrade from P09:02
jtvSo... upgrade from postgres 9.1 to postgres 9.1 I guess.09:03
jtvMaybe ls /etc/postgresql/ just to be sure?09:03
dimiternit's 9.109:03
jtvI hope we didn't get any unexpected config changes in the package.09:04
jtvAnd you did "make install-dependencies," right?09:04
dimiternyes09:05
dimiternI'm did install --reinstall postgresql-9.1 now09:05
dimiternmake syncdb - same error09:05
jtvweirdweirdweird09:05
jammgz: didn't you run into postgres-XC issues?09:06
jtvHe doesn't have postgres-XC installed, AIUI09:06
jtvBut yes, there was an error about it.09:07
jamdimitern: just as a sanity check, make sure you have enough disk space, and double check what your directory permissions are.09:07
jamI expect those are fine, but it has tripped me up before.09:07
dimiternno, I had -xc installed yesterday, after upgrading to 12.10 and running make complained missing pg_ctl, running it, command-not-found recommended postgres-xc, so i installed it09:07
jamah09:08
dimiternbut today i did a fresh upgrade from a snapshot and now pg_ctl is there, after install-deps09:08
jtvIt should be there anyway, just not necessarily in your PATH.09:08
dimiternnot much info on that pg_xlog error09:08
jtvThe _usual_ cause for that error is sysadmins thinking "oh, it's only a log so I can delete it"09:09
jtvBut somehow I don't think that's the case here.  :)09:09
mgzjam: it's a misleading error09:10
mgzthe actual issue was the database was unhappy09:10
jtvI wonder if any replication code is still running... did you purge postgres-xc?09:11
jtvAs in apt-get remove --purge?09:11
dimiternactually, postgres-xc failed to stop and uninstall09:11
dimiternthat's why i reverted to a snapshot09:11
dimiternthe coordinator hangs while stopping09:12
mgzso, postgres was running okay, but the test, and running make syncdb etc failed trying to run pg_ctl, without a clear reason09:12
dimiternyes, i did it with --purge09:12
jtvargh.09:12
mgzand if you just run pg_ctl as is, you're helpfully told to install the postgres-xc, which is not actually what you want, the command just needs to be run as the right user09:13
jtvIf possible, I'd purge postgres/postgresql-9.1 as well.09:13
jtvAnd the command is hidden away somewhere in /usr/lib -- it's not going to be in your PATH.09:14
dimiternok, but doesn't install --reinstall do just that?09:14
jtvYou shouldn't normally need to run it yourself.09:14
jtvI'm not sure exactly what --reinstall does, or how carefully it checks for errors.  It sounds as if you're in a state you're not supposed to be in, so things will get confused.09:14
mgzright, you don't want to, apart from the test fails with "command returned 1" or something, rather than any indication of the actual problem09:14
mgzso, trying to run the same thing to see what the *actual* problem was seemed reasonable09:15
mgzbut anyway, right response is to ignore all feedback, and just wipe and start again :D09:15
dimiternso I did --purge, then install postgresql-9.1, make syncdb - same error :(09:15
mgzdimitern: and you said you did rm -rf db in the maas tree to?09:16
dimiternmgz: yes09:17
mgzdimitern: another option, if you want to divert via setting up canonistack credentials, would be to use my script which gives you maas on an instance in canonical's cloud09:17
dimiternmgz: but anyway db/ is empty09:17
jtvBest remove it altogether so that our db setup script won't think it has something to work with.09:18
dimiternmgz: does it give maas me from trunk?09:18
mgzyes, it's a mini dev environment thing09:19
dimiternso, in /var/lib/postgresql/9.1/main/pg_xlog/ there is the 0000..... file, i suspect the permissions are the problem09:20
jtvNo, that file will be for the default postgres cluster.09:21
jtvYou get your own private little cluster in the branch.09:21
jamdimitern: I thought 'make syncdb' was supposed to only install locally in $PWD/db/09:21
jtvWhat jam said.09:21
jtvIt also means that permissions are never an issue: you are sole owner and master of your in-branch cluster.09:21
jtvYou are root, you are admin, you are God.09:21
dimiternjtv: ok, but is it supposed to create a structure in db/, similar to the one in /var/lib/postgresql/9.1/main ?09:22
jamdimitern: db/09:22
jam'make syncdb' should not touch /var/lib09:23
jtvdimitern: yes, it creates its own local version of what you see in /var/lib/...09:23
jtvWith its own logs and everything.09:23
dimitern:) ok, so I mkdir db/pg_xlog and now it fails with a different error: initdb: directory "/home/maas/work/maas/db" exists but is not empty09:23
mgzthat sounds hopeful09:24
jtvYou should not need to create pg_xlog.09:24
jtvAnd the db directory should be either functional, or not there at all.09:24
dimiternwell, I probably have a rather unusual setup - I have a vbox shared folder (for some reason mounted automatically in /media/sf_work), and then I did a mount --bind /media/sf_work /home/maas/work09:27
dimiternand the permissions seem more and more to be the problem09:27
jtvOh, your branch is on a "weird" filesystem?09:27
dimitern:)09:28
dimiternsomething like it09:28
jtvAs far as the database is concerned, as long as you are consistently running as the owner of that home directory, there should be no permissions problem.09:28
jtvBut running a database out of a weird filesystem is a problem.09:28
jtvYou get things like locks not working properly.09:28
dimiternok i'll change this so it'll work on a local fs09:28
mgzyou mean weird like nfs? or weird like fat? :)09:29
jtvEither is icky.09:29
dimiternvbox shared folders is rather icky09:29
jtvDon't do that then.  You may be able to link the db directory to something local, so that the rest of your branch is still remote-mounted but the database state is only on the machine that you're running on.09:30
dimiternjtv: how do I do that inside a bound mounted dir?09:31
jtvYou create a softlink to somewhere on your local filesystem.  But I don't know off the top of my head whether that directory already existing, or being a softlink, might confuse our setup script.09:32
jtvI'd try this the simple way first.09:33
jtvWe can worry about making it cool later.09:33
dimiternI moved the whole repo locally, keeping the paths and removed the vbox sf, will see it'll work that way09:34
jtvExactly.  Walk before you run.09:34
dimiternwhooha! it worked :) 10x guys09:35
jtv\o/09:35
dimiterni should probably add bin/ and scripts/ to PATH, right? assuming a normal installation these should be available09:49
dimiternbut after doing that, maas-import-pxe-files tries to access /var/lib/maas and fails09:50
mgzI just sit in the tree and use bin/whatever09:50
dimiternyeah, but if I do that, some scripts fail, since they expect (i.e. maas-provision) to be available globally09:51
dimitern./scripts/maas-import-pxe-files: line 148: maas-provision: command not found09:52
mgzsee the 'Development MAAS server setup' section in HACKING09:52
mgzyou need maas-provision installed09:52
dimiternso from the repo, not the one in trunk? because I have bin/maas-provision09:54
dimiternE: Package 'maas-provision' has no installation candidate09:54
allenapdimitern: Those scripts are exceptional, in that they ought to die before 13.04 (where die means burnt, ashes scattered to the winds) and replaced with something tested. tl;dr Don't draw too many conclusions from their behaviour.09:55
allenapmgz: maas-provision is no longer generated iirc; it was the old Cobbler package.09:56
mgzallenap: it's in hacking, and what I did to get the images I think, though probably on precise09:57
dimiternallenap: ok, I have the webapp running on 5240, but it complains ths images are missing - how do i get them without running that import script?10:01
allenapdimitern: Don't worry about them unless you're doing something that involves them; you can safely ignore them for now.10:02
dimiternok, 10x10:03
allenapmgz: How odd. I'm not sure how that instruction got in there, but we should remove it.10:04
rvbaAny reviewer in the house? https://code.launchpad.net/~rvb/maas/bug-1066938-rndc2/+merge/12984110:22
allenaprvba: Sure.10:25
rvbaallenap: ta10:26
allenaprvba: How do you test packaging branch changes? lxc-start-ephemeral appears to be completely broken in Quantal, so my scripts no longer work.10:27
rvbaallenap: I create a package and then I test it on a canonistack instance.10:28
allenaprvba: How do you create the package?10:33
allenaprvba: The default controls stanza. What silently adds it? Does named see that there's not control statement and add it internally, or is it something the init scripts do?10:34
rvbaallenap: you first have to change 2 things in the packaging branch to point to the right branch/revision10:34
rvbahttp://paste.ubuntu.com/1282812/10:34
rvbaallenap: then bzr bd -- -kmyemail@example.com10:35
rvbaallenap: no, named does that without telling anyone apparently.10:35
rvbaallenap: bzr bd -S -- -kmyemail@example.com  if you just want to build the source package.  To upload it to a ppa for instance.10:36
jtvAnd for the sake of everything you love, do not insert a space between the -k and the email address.10:36
rvba:)10:36
allenapCool, thanks both of you. And FFS to the world.10:36
rvbaallenap: forgot something, if you create the source package to upload to a ppa, you also need to s/UNRELEASED/quantal/ in debian/changelog.10:37
rvbaAs in 'maas (0.1+bzr1277+dfsg-0ubuntu2) UNRELEASED; urgency=low' -> 'maas (0.1+bzr1277+dfsg-0ubuntu2) quantal; urgency=low'10:37
* allenap high-fives bureaucracy in software10:38
jtvRed tape binds the universe together.10:38
allenapI am feeling very cynical today.10:38
jtvDidn't know you had it in you.10:38
allenapHah :)10:38
mgzthis all makes sense in the context of debian, but I inevitably forget at least one of the packaging steps :)10:38
mgzgenerally changelog related...10:39
jtvallenap: you are aware that you have a long-approved MP apparently waiting for you to land it?11:37
jamrvba: I'm getting "access_refused to vhost '/maas_workers' for user 'maas_workers'" after trying to get rabbit back up and running after the IP change.12:01
jamIs there something obvious I'm missing?12:02
jamdpkg-reconfigure does redo the maas_workers password, but it doesn't seem to add it to the vhost?12:02
jamallenap: ^^ if you have an idea12:03
allenapjtv: Yes, but I haven't figured out how to test it yet, wrt jam's comment. I'm actually procrastinating in the hope that Django will be recalled worldwide and fired into the sun, thus avoiding the need to test it.12:04
jtvallenap: chances are slim.  Think of the pollution it might cause in the sun.12:05
allenapjam: No idea I'm afraid :-/ My RabbitMQ knowledge is minimal.12:05
jamallenap: well, another check sasy "rabbitmqctl list_vhosts" doesn't show a maas_workers vhost12:05
allenapjam: I don't know, sorry. roaksoax, can you help jam with this packaging problem?12:16
jamallenap: so I think I sorted it out, it looks like 'dpkg-reconfigure' sees that there is already a 'mass_worker' and changes its password, but doesn't notice that there isn't a /maas_workers vhost, so it doesn't create it and set the permissions.12:28
jam(it uses the 'is there a user' and assumes that if the user exists, then the vhost exists).12:28
jamAnd I think the bug is that if your hostname changes, rabbit changes its working directory.12:28
jamwhich apparently means it keeps the same users, but not vhosts...12:29
jamnot sure12:29
jamrvba: ^^12:29
allenapWe get rid of Cobbler, and end up with Django and RabbitMQ instead. Groan.12:29
rvbajam: that's a packaging bug I was discussing with roaksoax yesterday evening actually.  He wanted me to test something for him and I just noticed that problem (http://paste.ubuntu.com/1282969/).12:32
jamrvba: right, it just needs to decouple the 'is there a vhost' from 'is there a user'.12:33
rvbaYep.12:33
rvbajam: can you please file a bug so that we don't loose track of this.12:33
jamthough I don't know what permissions happen if you have a user but not a vhost, or a vhost but not the user.12:33
jamrvba: is there a tag for packaging issues?12:33
rvbaroaksoax is currently refactoring that code.12:33
jamand what ist he 'packaging' branch specifically?12:33
jamthe12:33
rvbajam: just assign the bug to the package in ubuntu.12:34
jamrvba: bug #106733212:37
ubot5Launchpad bug 1067332 in MAAS "'dkpg-reconfigure' conflates user existing for vhost existing" [High,Triaged] https://launchpad.net/bugs/106733212:37
rvbaroaksoax: could you please have a look at the bug jam just filed? (1067332)12:38
rvbajam: ta12:38
jamrvba: bug #1067336  is that something already known that I should be duping against?12:40
ubot5Launchpad bug 1067336 in MAAS "maas startup can leave lock file" [High,Triaged] https://launchpad.net/bugs/106733612:40
jamEssentially, I see a stale lock file in /run/locks12:40
jamif startup crashes (say because rabbitmq is refusing connections :)12:41
rvbajam: there is a 'finally: lock.release()' in the startup code… so I'm surprised that the lock file does not get cleaned up.12:43
jamrvba: well, it happens somehow.12:43
jamrvba: maybe something is stuck in a loop in inner_start_up.12:45
jamI do see your point about the f inally.12:45
rvbajam: the start_up method fires off tasks… maybe it's stuck in there because rabbitMQ cannot be reached.12:51
jamrvba: yeah it is possible it is actually stuck during startup. I'm guessing we are also in one of those 'we aren't connected to a logger yet' issues.12:51
=== matsubara-afk is now known as matsubara
rvbaallenap: jtv: bzr1280 is currently building in my ppa (ppa:rvb/maas), in case you guys want to test the latest package.14:31
roaksoaxallenap: please add a debian/changelog entry for your change to the packaging branch14:48
allenaproaksoax: Okay.14:48
roaksoaxallenap: refer to the bug too14:49
allenaproaksoax: I don't really know what I'm doing with the changelog. Does http://paste.ubuntu.com/1283217/ look reasonable?14:56
allenaproaksoax: Or should I just edit the 0ubuntu2 stanza?14:57
roaksoaxallenap: no that was released yesterday14:57
allenapOkay.14:57
roaksoaxhold on14:57
* allenap holds14:58
roaksoaxallenap: http://paste.ubuntu.com/1283222/14:58
allenaproaksoax: Ah ha, okay cool. Thanks.14:59
=== adam_g_ is now known as adam_g
=== matsubara is now known as matsubara-lunch
guimalufAnyone know why am I getting Internal Server Error with the following thing: ImproperlyConfigured: Middleware module "django.middleware.csrf" does not define a "CsrfResponseMiddleware" class17:11
guimalufAnyone know why am I getting Internal Server Error with the following thing: ImproperlyConfigured: Middleware module "django.middleware.csrf" does not define a "CsrfResponseMiddleware" class ?17:12
=== matsubara-lunch is now known as matsubara
=== hazmat is now known as kapilt
=== matsubara is now known as matsubara-dinner
=== kapilt is now known as hazmat

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!