[17:40] <harmw> smoser: ready for new release?
[17:40] <smoser> :)
[17:40] <smoser> dont' you avhe something else to do on friday night then bother me
[17:40] <harmw> forgive me for asking so often, I'm just eager to submit that fbsd port
[17:40] <harmw> hehe
[17:44] <smoser> you are completely justified there, harmw 
[18:02]  * hiren_ likes harmw's persistence ;-)
[18:02] <harmw> lol
[18:02] <harmw> yea
[18:45] <harlowja> damn i must of missed an important conversation, lol
[18:45] <harmw> dont you always 
[18:45] <harlowja> i think so :-P
[18:46] <harlowja_> of course right when i say that my thunderbolt crap cable comes undone, lol
[18:46] <harlowja_> thats what i don't like about the cable, it doesn't hold itself in, lol
[18:46] <harlowja_> stupid apple
[18:47] <harmw> :p
[19:03] <harmw> harlowja_: how sucky  is the Y! cloud?
[19:03] <harlowja_> lol
[19:04] <harlowja_> define sucky
[19:04] <harlowja_> lol
[19:04] <harlowja_> define parameters to be sucky
[19:04] <harlowja_> haha
[19:04] <harmw> hiren_'s having a hard time getting cirros up and running
[19:04] <harlowja_> hmmm, not sure, haven't heard what he's doing
[19:04] <hiren_> harlowja_: in our internal n/w
[19:04] <harlowja_> well shouldn't be that hard, idk how well cirros supports config drive
[19:04] <harlowja_> if it don't support config drive, then it may not work :-P
[19:05] <harmw> isn't there a normal metadataservice?
[19:05] <harlowja_> nope
[19:06] <harlowja_> just config-drive (until we revist that debate)
[19:06] <harlowja_> our security team didn't want a channel from VM -> controller layer
[19:06] <harmw> jeez
[19:06] <hiren_>  http://dpaste.com/184H91R
[19:06] <harlowja_> and metadata service is one such channel
[19:06] <harmw> wankers
[19:06] <harlowja_> ya, i tried fighting that, i gave up
[19:07] <JayF> Doing a metadata service in a secure and multitenant way is not an easy task :)
[19:07] <harlowja_> config-drive is nice and read-only, no two way channel...
[19:07] <JayF> putting an ISO partition on a VM/disk is super easy :)
[19:07] <harmw> so true
[19:07] <harlowja_> right, thats partially why its very attractive for security scaredfolks
[19:07] <JayF> harlowja_: actually, you can put ConfigDrives in vfat according to the spec
[19:07] <harlowja_> ya, vfat, iso9660
[19:07] <JayF> harlowja_: so it doesn't have to be r/o... although we implement it as an iso9660
[19:07] <harlowja_> right
[19:07] <harlowja_> well r/w it will still be a local thing
[19:08] <harlowja_> r/o is just more of an optimization
[19:08] <harlowja_> so hiren_ the following seems odd
[19:08] <harlowja_> cp: write error: No space left on device
[19:08] <harlowja_> cp: write error: No space left on device
[19:08] <harlowja_> cp: write error: No space left on device
[19:08] <harlowja_> cp: write error: No space left on device
[19:08] <harlowja_> failed to copy results from configdrive to /run/cirros/datasource
[19:08] <harlowja_> :-/
[19:08] <harlowja_> that would seem to be an issue, lol
[19:08] <hiren_> heh yeah
[19:08] <harmw> :)
[19:09] <hiren_> brb.
[19:09] <harmw> harlowja_: there is dhcp or did they skip that as well?
[19:09] <harlowja_> not for vms
[19:10] <harlowja_> for the existing way baremetal is deployed, it uses dhcp
[19:10] <harlowja_> and pxeboot 
[19:10] <harmw> so they must get their config from configdrive, right?
[19:10] <harlowja_> yes
[19:10] <harmw> hmk
[19:11] <harmw> interesting
[19:11]  * harlowja_ we'll move over to ironic which afaik has a similar dhcp, pxeboot, ipmi as the thing we already have (people are shifting from that team to ironic)
[19:11] <harlowja_> JayF will get a bunch of new iroinc friends (besides rloo)
[19:11] <harlowja_> soon enough, ha
[19:11] <harmw> :P
[19:11] <JayF> You guys going to use ipa?
[19:11] <harmw> ipa?
[19:11] <harlowja_> unsure
[19:12] <harlowja_> JayF probably, although i'm not that in touch with all that stuff, haha
[19:12] <harmw> whats ipa :)
[19:12] <JayF> ironic-python-agent
[19:12] <harmw> ah
[19:12] <JayF> the newest, sexiest deploy driver for ironic
[19:12] <JayF> :P
[19:12] <harmw> lol k
[19:12] <harmw> i'm still clueless when it comes to ironic :p
[19:12]  * harlowja_ mostly me too, ha
[19:12] <harlowja_> can't be everywhere :-P
[19:13] <harmw> :p
[19:13] <harlowja_> y! will likely have to figure out a different mechanism than config-drive for ironic stuff though, something like maybe what JayF and folks have done (writing the config-drive on the main disk)
[19:13] <harlowja_> attaching a cd isn't gonna work, lol
[19:14] <harlowja_> or maybe we'll revisit that whole networking metadata webservice debate
[19:14] <harmw> :)
[19:14] <JayF> Dude, we already have it handled
[19:14] <harlowja_> even better, ha
[19:14] <harmw> smoser: did that configdrive change for fbsd got merged yet? from raginbajin?
[19:15] <smoser> i dont think so.
[19:15] <smoser> there was some work to still dothere.
[19:15] <JayF> harlowja_: Yeah, I am not sure if it's fully upstreamed, but it works entirely and we'll help you get it working if you need :)
[19:15] <harmw> hm ok, 
[19:15] <JayF> harlowja_: nova is the one who generates teh configdrive... it just gets passed through ironic, to the agent, into the drive
[19:15] <harmw> well I need it to test with configdrive, since Y! apparently requires/uses that
[19:15] <harlowja_> JayF ya, that seems nutty :-P
[19:15] <JayF> harlowja_: we just create a small partition at the end of the disk, and write it out
[19:15] <harlowja_> to much passing of crap around, lol
[19:15] <JayF> harlowja_: that's the Openstack Way(tm)
[19:15] <harlowja_> :(
[19:16] <smoser> for ocnfig-drive on bare metal...
[19:16] <JayF> harlowja_: in our original implementation, the agent built the iso :(
[19:16] <harlowja_> JayF why doesn't nova just pass the data that is the config-drive to ironic
[19:16] <harlowja_> seems saner
[19:16] <smoser> my opinion is that long term, nova (or deployer, whatever) has to be *very* stupid.
[19:16] <harlowja_> then passing a binary disk
[19:16] <smoser> and just dd stuff to the first disk
[19:16] <smoser> and then look for a partition on that disk named "config-drive" or re-use the EFI partition or something
[19:16] <smoser> and write the data in there.
[19:17] <smoser> in that way, the image is smart
[19:17] <JayF> harlowja_: because Nova is used to just writing it out itself
[19:17] <smoser> and tine installer is dumb
[19:17] <harlowja_> sux
[19:17] <smoser> and you have a standard.
[19:17] <JayF> smoser: that's pretty similar to what ipa does
[19:17] <harlowja_> nova's like an old grandpa or something, lol
[19:17] <smoser> sort of similar.
[19:17] <smoser> but ipa (i think) has to know how to "make it boot". ?
[19:17] <JayF> smoser: puts an image on a disk, looks for a partition labelled 'config-2', if it exists, we dd the configdrive into that partition, if not, we create it at the end of the disk
[19:17] <JayF> smoser: the bootloader is entirely in the image
[19:17] <smoser> it dd the disk ?
[19:18] <JayF> yeah
[19:18] <smoser> including the partition table ?
[19:18] <JayF> let me link you the code
[19:18] <JayF> yeahhh
[19:18] <smoser> nice. 
[19:18] <JayF> now we'll have to support the partition-images eventually
[19:18] <smoser> yeah, that is theo nly way you can actually accomplish secureboot
[19:18] <JayF> bceause --preserve-ephemeral (hate)
[19:18] <smoser> meh
[19:18] <smoser> partition images dont have to be supported.
[19:18] <JayF> but I would not use it :)
[19:18] <JayF> smoser: tell that to Devananda, hahaha
[19:18] <smoser> its just not scalable.
[19:19] <smoser> it means that the installer has to know information about the things its installing
[19:19] <JayF> smoser: https://github.com/openstack/ironic-python-agent/blob/master/ironic_python_agent/shell/write_image.sh + https://github.com/openstack/ironic-python-agent/blob/master/ironic_python_agent/shell/copy_configdrive_to_disk.sh
[19:19] <smoser> --preserve-ephemeral could just be "i write as many blocks as are in the image. no more , no less"
[19:20] <smoser> you want presevation of data then keep the thing i'm writing small.
[19:20] <JayF> I'm not sure I agree, but I also hate the same feature you hate which is funny
[19:20] <harlowja_> haters gonna hate
[19:20] <smoser> where is /tmp ?
[19:20] <smoser> is that dis ?
[19:20] <JayF> smoser: that code runs from inside the ramdisk agent
[19:20] <smoser> and why do you "erase mbr from device?"
[19:21] <smoser> so qemu-img convert -O raw $IMAGEFILE /tmp
[19:21] <JayF> puts it into the disk :)
[19:21] <JayF> er, into ram
[19:21] <smoser> means that you have enough ram to contain the entire contents of the disk?
[19:21] <JayF> yeah, right now
[19:21] <JayF> we want to make that stream eventually
[19:21] <smoser> good thing most people have way more ram than disk space
[19:21] <smoser> oh wait
[19:21] <smoser> :)
[19:21] <JayF> heh
[19:21] <JayF> in this case? every server it's running on
[19:21] <JayF> has at least as much disk as ram
[19:22] <JayF> in 2/3 cases it's less disk than ram 
[19:22] <JayF> (for the OnMetal case specifically)
[19:22] <smoser> curtin reads tar file extracts to stdout | dd of=/dev/foo
[19:22] <JayF> yeah qemu-convert doesn't output to stdout
[19:22] <JayF> if it did I would've done something like that
[19:22] <smoser> well, you dont have to support a silly format :)
[19:22] <JayF> someone is working on vhd support, which I think that whole bucket of things will get refactored
[19:22] <smoser> (and i fully realize i tell everyone they have to support qcow2)
[19:23] <JayF> It is what it is man :) We're making it better, but it works now, and it works pretty reliably
[19:23] <JayF> I have trouble finding too much fault with working software :P
[19:23] <smoser> yeah. 
[19:23] <smoser> oh.
[19:23] <smoser> fyi, qemu-img convert -O raw http://foo.bar/my-image /dev/sda
[19:24] <smoser> that requires seek support in the http server
[19:24] <smoser> but works otherwise.
[19:24] <JayF> while this is a shitty answer for purposes of open source
[19:24] <JayF> when we implemented it, we found it was much faster do convert, then dd
[19:24] <JayF> because we could set dd options that made imaging on our satadoms much faster
[19:24] <smoser> yeah. realistically you need to just fix the image format
[19:24] <smoser> why did you get an image format in qcow2?
[19:24] <harlowja_> O raw http://foo.bar/my-image /dev/sda would be neat if nova hosted the image
[19:24] <JayF> this was when this  was still teeth-agent not ironic-python-agent yet
[19:24] <smoser> that doesn't make any sense.
[19:25] <harlowja_> or ironic/nova 
[19:25] <JayF> smoser: I don't know man :) that was a long time ago
[19:25] <JayF> harlowja_: right now we only support images from swift temp urls
[19:25] <JayF> harlowja_: so it's already a direct download
[19:25] <harlowja_> cool
[19:25] <smoser> so the easiest solution is to fix the producer of the images to create something that streams.
[19:25] <harlowja_> except for non-swift users, haha
[19:25] <JayF> Well yeah man, we made it work for our case
[19:25] <JayF> and now the gaps get filled in as ironic gets more upstream support
[19:25] <harlowja_> wfm
[19:26] <JayF> the agent has support for probably a half dozen things that won't land until k
[19:26] <harlowja_> sounds like openstack
[19:26] <harlowja_> lol
[19:28] <harlowja_> reminds me gotta get my plane tickets
[19:28] <harlowja_> smoser u going to paris?
[19:29]  * JayF will be in paris
[19:29] <JayF> we should have a cloud-init design thinger one evening
[19:29] <harlowja_> sure
[19:29] <smoser> i will.
[19:29] <smoser> we should.
[19:30] <smoser> i was wanting to say we shoudl have a hack fest or somethign.
[19:30] <JayF> I mean, my brain will be mush, almost certainly
[19:30] <harlowja_> i'm up for either
[19:32] <harlowja_> we can have pow wow
[19:33] <harmw> Paris is first week of november, right?
[19:33] <smoser> yeah.
[19:33] <harmw> sad that's not an option though
[19:33] <smoser> i go from paris (openstack) to re:invent (aws)
[19:33] <harmw> cool
[19:33] <smoser> harmw, :-(
[19:33] <harmw> yea well, it's my first week at $newjob
[19:34] <harmw> so not wise to jump in plane instead of meating $newppl :P
[19:34] <harlowja_> meat them
[19:34] <harlowja_> haha
[19:34] <harlowja_> those meatbags
[19:34] <harmw> lol
[19:34] <harmw> damn
[19:34] <harlowja_> :)
[19:34] <harmw> thats probably the most lame typo ever
[20:09] <harmw> nice, Jenkins finaly archived my 3 shiny cirros images