/srv/irclogs.ubuntu.com/2014/08/08/#maas.txt

=== CyberJacob is now known as CyberJacob|Away
jason___anybody have a few minutes to point me in the right direction?02:21
mwhudsonjason___: depends. where are you trying to get to?02:22
jason___trying to get farther then a pxe boot and get them to install and work on an HP c700002:23
jason___still digging through all the info i can find :P02:48
jtvbigjools: do you remember what we decided about the API problem of "PUT one field, reset all the others"?  Do we simply accept that clients have to read and re-PUT the full object?03:11
bigjoolsjtv: I don't remember if we even decided anything03:21
bigjoolsI think PUTing the whole thing makes sense03:21
jtvFor some value of sense.03:21
bigjoolssince you can't create that way03:21
bigjoolsbut I expect we have examples where that's not the case03:21
bigjoolsjtv: if you want a break from coding I have a lovely branch up for review :)04:23
jtvCoding?  I wish.04:24
lifelessI knew that word once05:35
roaksoaxjtv: you scheduled the IPv6 meeting for FRiday next week :)06:35
roaksoax34406:35
roaksoaxerr06:35
jtvArgh!06:36
* jtv heads back to Google06:36
jtvAnd the wrong timezone, too...06:37
=== CyberJacob|Away is now known as CyberJacob
=== CyberJacob is now known as CyberJacob|Away
=== jpds_ is now known as jpds
=== jpds is now known as Guest15370
=== Guest15370 is now known as jpds_
=== jamespag` is now known as jamespage
onicrommorning folks11:30
jtvHi onicrom11:35
onicromfingers crossed i can get this 'custom' partition working in curtin11:53
onicromok i seem to have found whats going on12:25
onicromit looks like the default for my system is pt_mbr12:29
onicromwhich has a bug12:29
onicromit also looks like the params passed to pt_mbr are ignored.12:35
onicromalso a bug12:35
onicromok submitted a bug12:43
roaksoax/query/win 1612:48
roaksoaxerr12:48
=== jfarschman is now known as MilesDenver
allenapDoes anyone have time for a shortish review? https://code.launchpad.net/~allenap/maas/rpc-alt-cluster-rpc-fixture/+merge/23010914:03
blake_rallenap: done14:54
allenapblake_r: Thanks!14:54
blake_rallenap: https://code.launchpad.net/~blake-rouse/maas/add-largefile-migration-fix/+merge/23012915:01
blake_rallenap: could I get a really quick review, for my stupidity!15:02
allenapblake_r: Sure.15:02
allenapblake_r: Is IntegerField really not enough? Woo.15:02
blake_rallenap: yeah it is, but might not be if file is larger than 4tb, that should never happen!15:03
blake_rallenap: sorry I mean large than 2gb15:03
blake_rallenap: you set it to approved? not you approving it15:03
allenapblake_r: Sorry! Fixed.15:03
blake_rallenap: thanks15:04
jtvallenap: my branch may have a huge diff but it's actually really really simple: moved a bunch of functions from provisioningserver.utils to provisioningserver.utils.twisted.15:13
onicromok i need to speak to the guy who wrote curtin :)15:22
onicromi have hacked the /usr/lib/curtin/helper/common script 6 ways from sunday15:22
onicromi can see that my chages are being executed, but the installed system always always creates a 2tb root filesystem15:23
jtvI think that's smoser.15:23
jtvblake_r, did you say you figured out how to make curtin sing & dance?15:26
blake_rjtv: I stay far away from the bash scripting that smoser wrote!15:27
jtvGood man.  But _someone_ said they figured it out and it wasn't so hard once you cracked the secret.15:27
jtvjhobbs maybe?15:27
blake_rjtv: i wrote the uefi partitioner in the bash15:27
blake_rjtv: i cried most of the time, lol15:27
jtv(Still think they should have named the GNU shell "gnash")15:28
Spadsthat's the flash player15:28
jtvIt is _now_, yes.  But at the time there wasn't one.  :)15:28
blake_ronicrom: if you have a paste of your bash script I can take a look15:28
onicromblake im updating the bug15:29
onicromblake_r: https://bugs.launchpad.net/maas/+bug/135442615:30
ubot5Ubuntu bug 1354426 in MAAS "curtin creates a 2TB root fs/partition by default" [Undecided,New]15:30
onicromthanks ubot5 :)15:31
blake_ronicrom: you want the partition bigger than 2tb?15:32
blake_ronicrom: you cannot create a partition larger than 2tb on mbr partition layout15:32
blake_ronicrom: you need to use a gpt partition layout15:32
onicromi know15:34
onicromi dont want to15:34
onicromi want to create a 50Gb root partition15:34
onicromthe default option in common is to use mbr, i tried to switch this to gpt and modify the size values there but that just errored completely the pt_gpt function is broken15:35
blake_ronicrom: are you sure that '1,6490,L' is correct?15:43
onicrombased on the sfdisk man page yes15:43
onicromive tried using cylendars sectors etc15:43
onicromsame thing15:43
onicrombased on some math that is the correct number of cyls for 50gb15:44
onicromor ~ anyway im not that picky15:44
blake_rlooks like its only 50gb partition, thats what you want, you just need another line for the other partition15:54
onicromwhat other partition?15:54
onicromno matter what i do something is creating a 2TB partition15:57
onicromso weird doesnt matter what i execute something creates a 2TB partition... i wonder... let me try a brand new machine without any existing table maybe the bit that wipes the existing partitions is broken :)16:02
=== matsubara is now known as matsubara-lunch
jtvblake_r: have you run the 1.6 (or 1.5, 1.4 etc.) tests lately?  I'm seeing a test failure in trunk that's related to commissioning timeouts, and it looks like it might be timezone-sensitive.16:17
jtvYou're in a negative UTC offset now, right?16:18
blake_rjtv: unit tests? i am running trunk16:18
blake_rjtv: never had an issue16:18
jtvRight, unit tests — specifically, src/maasserver/tests/test_api_commissioning.py:TestCommissioningTimeout16:19
blake_rjtv: i am -516:19
blake_rjtv: never seen a failure there16:19
jtvYes, if this is the timezones, then trunk should pass for you — but maybe you'd get the converse bug in 1.6 or older.16:19
blake_rjtv: i will try 1.616:19
jtvWhere the tests creates a node that started commissioning an hour and one second ago, but it doesn't time out yet.16:19
jtvThanks!16:19
jtvYou'd have to run "make && ./bin/test.maas src/maasserver/tests/test_api_commissioning.py:TestCommissioningTimeout"16:20
jtv(I filed this as bug 1354511...)16:21
ubot5bug 1354511 in MAAS "check_commissioning fails test: test_check_with_commissioning_but_not_expired_node" [Critical,Triaged] https://launchpad.net/bugs/135451116:21
blake_rjtv: all 3 passed for me16:21
jtvGrrrrr16:21
jtvThanks.16:21
blake_rYour welcome.16:21
jtvblake_r: I think I'm one step closer!  My databases in 1.6 and trunk seem to be running at different timezone offsets...16:28
jtvIt may have been the travel that caused it.16:28
blake_rjtv: isn't the database created before each test run?16:29
blake_rjtv: its different than make syncdb16:29
jtvYes, but maybe the local database _cluster_ that lives inside the branch still had a remnant of UTC+1...16:29
jtv(Wow, I don't know what type of animal I just slapped off my leg but it had a lot more rump than a mosquito and it spilled a lot of blood...)16:30
jtv(Mine, of course!)16:30
blake_rgot a lot of mosquitos where your at?16:31
jtvOhhh yes.16:32
jtvNot a lot of bites so far, I think.  These are not those little Euro bugs — you feel the sting WHILE they're biting you.16:33
blake_rDamn.16:36
jtvThat's a funny change in habits I had to go through: when I felt a mosquito bite, I used to say to myself "oh well, it's already happened, all I can do now is try not to scratch it."  So I reacted slowly on purpose.16:37
jtvHere, when you feel the bite, you need to hurry so you can still get rid of the bastard!16:38
* jtv looks accusingly at 3 geckos overhead that failed to catch this one16:38
blake_rjtv: where are you? the jungle? lol16:38
jtvPretty much.16:38
onicromis there a way to make the fastpath installer the default?16:41
ctlaughI am trying to get some modifications to dhcpd.conf.template to take effect, but saving the cluster controller does not update /etc/maas/dhcpd.conf.16:45
ctlaugh^ Any suggestions?16:45
ctlaugh(I am running trusty)16:46
jtvonicrom: it's the default now.16:47
jtvctlaugh: try saving a cluster controller interface rather than just the cluster controller.  You may have to make a small change just to convince it.16:48
onicromjtv, not in the version thats installed with trusty16:49
jtvonicrom: then marking a node for the fast-path installer sets a tag.16:49
ctlaughjtv: I tried that as well -- still not getting updated16:49
ctlaughls -al16:49
onicromjtv is there a way to set that tag on all nodes upon creation?16:49
* ctlaugh typed in the wrong window by mistake16:49
jtvonicrom: I think there is, but I haven't done it myself — set an xpath expression for the tag that simply always matches.16:50
jtvonicrom: then for any new node, the system will see if it matches the xpath expression and if so, give it that tag.16:50
ctlaughjtv: Is there any way outside of the web ui (like a command line) to force an update?16:50
jtvThinking...16:51
jtvYou'd have to update a cluster interface field that actually affected the dhcp settings, such as increasing the dynamic IP range by 1 address (and then taking it back again if you care enough).16:51
onicromim beginning to think that the 'helpers' in curtin really dont do anything16:59
ctlaughjtv: That's what I did.  I changed on end of the address range.17:05
jtvHmmm... that ought to restart the dhcp server.17:06
jtvAssuming it's an interface where maas manages dhcp.17:06
ctlaughjtv: Not only is it not picking up my changes (from the template), it's also not getting the range change from what I modified in the UI.17:07
ctlaughHow can I verify that it thinks it's managing dhcp on that interface?17:07
ctlaughSomething I also recently did was change the IP address of the maas server.17:07
jtvShould be simple: the cluster must have been accepted into the maas, and its management setting should be either "DHCP" or "DHCP and DNS."17:08
ctlaughUI shows accepted, and interface shows "Manage DHCP and DNS"17:09
jtvOwww, the mechanism that we use to carry messages from the region controller to the cluster controller, RabbitMQ, doesn't take too kindly to changing addresses.17:09
jtvThat would explain it, I think.17:09
jtv(And yes, we're now in the process of getting rid of it!)17:10
ctlaughI ran dpkg-reconfigure on both maas-cluster-controller and maas-region-controller to fix the addresses, and think I rebooted after doing that (but possibly before)17:11
ctlaughIs there somewhere else that might need to be updated?17:11
jtvTry a "grep -rI $OLD_ADDRESS /etc/rabbit*"17:13
ctlaughjtv: no matches, and /etc/rabbitmq is empty17:14
jtvOh, or /var/lib/rabbit* perhaps?17:16
jtvWe may store that stuff in the maas /etc or /var trees...  I remember running into this in the past and just grepping like mad.17:16
jtvAnd it did turn up rabbit files.17:16
ctlaughjtv: ok, after a reboot and modifying the interface again, it worked.17:18
jtv\o/17:18
ctlaughapparently, I changed the ip address in /etc/interfaces, rebooted, then ran dpkg-reconfigure17:19
ctlaughI should have restarted things after the reconfigure as well17:19
ctlaughjtv: thank you for your help17:20
jtvGlad it worked out.17:20
jtvAs always, "have you tried turning it off and on again?"  :)17:20
ctlaughYes :)17:21
=== matsubara-lunch is now known as matsubara
dpb1Hi -- has anyone noticed/reported that vms with virtio disks do not correctly register all their disks in MAAS?  Is that something that would be fixed if I reported a bug? :)17:43
onicromcan someone running 1.5.2 verify what is on line 22517:54
onicromof /usr/lib/curtin/helpers/common17:54
=== roadmr is now known as roadmr_afk
=== CyberJacob|Away is now known as CyberJacob
blake_rif I could get a review on both of these: https://code.launchpad.net/~blake-rouse/maas/add-bootresource-models/+merge/230161 and https://code.launchpad.net/~blake-rouse/maas/add-bootresource-models/+merge/23016119:09
blake_ri was nice enough to split them up for the reviewer!19:10
blake_r:)19:10
blake_rcrap same link twice, sorry: https://code.launchpad.net/~blake-rouse/maas/bootresource-model-properties/+merge/23016419:10
=== cmagina_ is now known as cmagina
jtvblake_r: having a look, and liking the documentation so far...19:22
jtvblake_r: reviewed one.19:43
onicromcan someone point me to the scripts/source around cloud-init ?19:53
=== roadmr_afk is now known as roadmr
onicromit's doing something to the partition table... i ran a set -x on the curtin partition scripts and nother in there is doing this19:53
onicromcan someone point me to the code that does the initial boot after the 'start' is completed21:33
=== wmf is now known as thewmf
thewmfhowdy maas people21:53
thewmfI'm trying to get multiple NICs to work with curtin but the blog post doesn't make sense to me21:53
thewmfanybody interested?21:54
onicromim having a fun time with curtin :)22:01
thewmfso you're into S&M?22:04
onicromi wanna poke out my eyeballs22:07
thewmfok, that's the same as my experience22:09
thewmfI actually have experience with d-i, but I don't think it's working22:09
onicromim trying to change the default partition size22:15
onicromits nearly impossible and im hacking code22:15
thewmfI saw that thread on the list. not promising22:15
thewmfI hate the d-i partitioner22:16
newellonicrom, still hitting your head against the way with curtin?22:32
newell;)22:32
onicromdood22:32
onicromim dying here22:32
onicromim about to change the grub to drop me to a shell22:33
newellonicrom, the only code that I have modified for curtin so far has been to add the ability to add a separate boot partition, which is only supported for gpt currently22:33
onicromand howd that work?22:33
onicromi switched to gpt22:33
newellgood, its in trunk now22:33
newellwhat you will need to do is you will need to make new block_meta commands22:34
newellto be able to set the size22:34
onicromcan you paste me like to the code?22:34
newelltake a look at curtin/curtin/commands/block_meta.py22:34
onicromalso.... the part that is confusing me is im able to get it to create the partition  layout i want22:35
newellthis is the code that calls the "partition" script which then calls the "common" script22:35
onicromand when helpers/common runs and exits sgdisk -p /dev/sda22:35
onicromprints out what i want22:35
onicromthen it reboots and its gone and changed sda1 to be the full isize of the disk22:35
newellare you modifying templates?22:35
onicromwhere are said templates?22:36
newelllet me re-phrase my question22:36
newellHow are you calling curtin?22:36
newellor are you just hacking the code in curtin?22:36
onicromhacking the code in curtin22:37
onicromwell ... im editing the common shell script which is exected by the partition shell script which is executed by block_meta22:38
newellokay so yeah you can go about it that way too22:38
onicromhave you seen my long ass bug?22:39
newellno, do you have a link?22:39
onicromhttps://bugs.launchpad.net/maas/+bug/135442622:39
ubot5Ubuntu bug 1354426 in MAAS "curtin creates a 2TB root fs/partition by default" [Undecided,New]22:40
onicromthe most relevant bit where i have it outputting exactly what im doing22:40
onicromthen the install finishes and the damn gremlins did somethin22:40
* newell takes a look22:41
newellha...the gremlins22:42
newellis there any way you can convert to the newest code?22:45
onicromsure might need help :)22:45
newellokay no problem22:45
newellI can help22:45
newell$ sudo apt-get install bzr22:46
newellyou need bzr to check out the source22:46
onicromok22:46
newellonce you have bzr you can create a branch22:46
onicromgive me 2 mins22:46
onicromneed to potty break22:46
newell$ bzr branch lp:curtin curtin22:46
newellthat will make a directory called curtin for you22:46
newell$ cd curtin22:47
newell$ ./tools/build-deb -uc -us22:47
newellThe above command will build all the *.deb packages for you that you need22:47
newellthen you can install them doing:22:47
newell$ sudo dpkg -i *.deb22:47
onicromdone22:53
newellonicrom, everything worked?22:54
newellfor install that is22:54
onicromyes im going to rebuild one box22:55
onicromjust to see22:55
newellonicrom, so now you know how to take the source and make a package out of it22:55
newellso, you can hack it up, then install it etc22:56
onicromthats pretty sweet22:56
newellthe results you were mentioning were for hardware correct?22:56
onicromyou mentioned etemplates22:56
newellnot the devel stuff?22:56
onicromwhat do you mean hardware results/22:56
newellI mentioned to you in the email how if you follow doc/devel/README.txt it will show you how to develop for curtin with qemu images22:57
newellI was wondering if the results you mentioned in the bug report are for that (qemu) or on actual hardware?22:57
onicromohhhh that yes hardware22:57
onicromeverything im doing is on baremetal22:58
newellk22:58
onicromi have 20 servers im trying to get ready for openstack :)22:58
newellnice :)22:58
newellso let me know what issues you run into later on but at least you have the most current code installed22:59
onicromi only have ipmi access via serial over lan... and the debian installer hoses the network for ipmi somehow (the nic is shared between the ipmi and the os)22:59
onicromso im forced to use curtin22:59
onicromas it does not do such network fuckery22:59
onicromdo you know what happens with regards to partitions/disks upon first boot after the curtin bit is run?23:00
newellyou mean after curtin installs?23:02
onicromcorrect23:02
onicromok so that didnt work23:03
onicromi have no /boot23:03
newellyou need to use the simple-boot command23:03
newellnot the default simple23:03
newellcurrently it is dependent on which architecture you have23:03
onicromhow do i select23:05
onicromchange in block_meta or ?23:07
newellonicrom, give me a second23:08
onicromfor you23:08
onicromtake 2!23:08
newellonicrom, sorry about that23:13
onicromnp i hard coded23:13
newelltake a look at doc/topics/overview.rst23:13
onicromboot=true23:13
newellyeah you can do that too ;)23:14
newellthat will make you a 512MiB separate /boot partition on /dev/sda123:14
newelland the rest of the disk will have / partition on /dev/sda223:15
onicromi changed that to +50G23:15
onicromi hope hope hope that works23:15
onicrom$end is bad for me :)23:15
newellyeah curtin could really use this feature23:15
onicromok good news23:16
onicromno boot partition23:16
onicromBUT23:16
onicromroot is 50gG!@!!!!!!@#$@%$@#%23:16
newellhow are you verifying the partitions?23:16
onicromsorry let me rephrase23:17
onicrom /boot is there, but there is no fstab reference23:17
newellthat is because you hardcoded it23:17
newellthe fstab code is in block_meta.py23:17
onicromah :)23:17
newellyeah its a cluster fsck23:17
newellonicrom, what you can do is you can hard code the default to get the fstab23:18
newellinstead of doing the hack in common23:19
newellchange...23:19
* newell looks where it is23:19
newellinstall.py at the top has block-meta using 'simple'23:19
newellchange that to 'simple-boot'23:19
newellthat or you can specify the partitioning command as the overview.rst shows23:19
onicromlemme try that one23:20
onicromi still need to hack common23:20
newellyeah for the size part you will23:21
onicrom            --new "1::+1G" --typecode=1:8300 \23:21
onicrom            --new "2::+50G" --typecode=2:8300 "$target" ||23:21
onicromit be nice to pass those variables just lke passing simple-boot23:21
newellfile a bug report for the ability to create custom boot partitions (i.e. the size)23:21
onicromhell it would be simple to pass 1:size:mount and have common iterate over an array23:22
onicromas well as block_meta23:22
newellyeah shouldn't be too hard23:23
newellfeel free to add it and contribute if you like :)23:23
onicromi would put some disclaimer... if you put in numbers here that do not match the disks available its your own damn fault23:24
onicromi mean right now it tries to be smart about the sizes and what not but i say let people shoot themselves in the foot :)23:25
onicromwould paritioning_commands:./curtin/commands/block_meta.py:               'choices': ['raid0', SIMPLE, SIMPLE_BOOT]}),23:30
onicrominside curtin_preseed?23:30
=== CyberJacob is now known as CyberJacob|Away
newellonicrom, did you take a look at overview.rst?23:32
newellit shows how to do the partitioning commands23:32
onicromvi ues23:32
onicrom  50_setup_raid: curtin disk-setup --all-disks raid0 /23:32
newellyes23:32
newellso that gives examples23:33
onicromchange raid0 to SIMPLE_BOOT23:33
newellno23:33
newellyou would do similar to what is install here23:33
newell00_something_blah: curtin block-meta simple-boot...23:34
newellsomething along those lines23:34
newellsimilar to install.py*23:34
onicromahhh block_meta23:35
newellI have never done it this way so not sure on the exact syntax23:35
newellbut I know install.py is doing this (those are the defaults at the top if nothing in the configuration sets it)23:35
onicrom    'partitioning_commands': {23:35
onicrom        'builtin': ['curtin', 'block-meta', 'simple']},23:35
onicromthere we go23:36
onicromparitioning_commands: 10_doshit: ['curtin', 'block-meta', 'simple-boot']23:36
onicromi really need to pick up python :)23:37
newellyeap23:37
newellso where you going to put that last line?23:37
onicrom /etc/maas/preseeds/curtin_userdata23:38
newellyeap ;)23:38
onicromi threw it after early_commands and before late_commands23:38
newellgo ahead and give that a go and let me know how it works23:38
newellcorrect23:38
newellthat is what overview.rst says at least23:38
onicromits running now :)23:38
onicromok cross your fingers the install is going23:39
onicromthe part that was confusing me earlier... i did a set -x in the common script saw exactly what was being run23:40
onicromand i was at a complete loss as to how the partition size was changing23:40
newellcool, let me know how it goes23:40
onicromquestion about python  with the file.py and file.pyc23:42
onicromwill it exec the pyc? so the contents of the py could have been one way and the pyc did something compeltely different?23:42
newellpyc is executed by if there are any modifications to the original py before running it will re-compile the byte code for the pyc23:43
onicromok.23:43
newellso you should be good, as long as you saved the file ;)23:43
onicromalso my new machine now has a 2.7TB fs ....23:43
newellis that what you wanted?23:44
onicromit juuust had a 50G wtf23:44
onicromnope23:44
onicromcommon has the code changes the only difference this time was boot=true was set to false23:44
newellyou changed the curtin_userdata?23:45
onicromcorrect23:45
newelldid it at least create the separate /boot partition?23:45
onicrombut i would think even without that change it would have executed common which would have done:  --new "1::+50G" --typecode=1:8300 "$target" ||23:45
newellwhat does sudo mount say when you login to the node23:46
newell?23:46
newellwhat common file are you editing?23:46
newelldid you re-create the package again?23:46
newellalso for maas, when you change the curtin_userdata...which file are you changing?23:47
newellall those things matter23:48
onicrommount23:48
onicrom /dev/sda1 on / type ext4 (rw)23:48
onicromand the normal tmpfs stuff23:49
newellk, what about the other questions?23:49
onicrom /etc/maas/preseeds/curtin_userdata23:49
onicromediting: /usr/lib/curtin/helpers/common23:49
newellmaybe print to the console to make sure you are executing what you think you should be in common?23:52
onicromim going to set -x that bitch!23:53
newell:)23:53
newellI have never used that, how does it work?23:54
onicromi was very close to adding a /bin/bash to the grub line it enters to drop me to a prompt before the first boot23:54
onicromlol23:54
onicromset -x in bash is essentially debug mode, it will show you everything its doing23:55
newellcool never used it but playing with it now23:55
newellso why are you setting up different partitions, is that something you think you would use often?23:56
onicromi want to use lvm for most of my storage so i can do lvm snapshots for my lxc containers23:57
onicromif i also want to setup drdb replication23:57
onicromlinux has always has /boot as a non-journal'd filesystem for safety23:57
onicromso i want that and generally i throw everything in lvm volumes so that if i need to grow them later its super easy23:58
onicromok so something broke :)23:58
newellwhat did set -x tell you?23:59
onicromhttps://paste.tinyw.in/index.php/view/1165079223:59
onicromit didnt get that far this time..23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!