=== harlowja_away is now known as harlowja
=== harlowja is now known as harlowja_away
[18:15] <harlowja> harmw sean hopefully getting me an image today :-P
[21:08] <harmw> ah nice harlowja 
[21:12] <harmw> first things first though, time to fix my broken havana upgrade
[21:40] <harlowja> ah, good luck :-/
[21:40] <harmw> god how I hate openstack for beeing such a pig to debug in case of failures :| especially since it now just works
[21:40] <harmw> oh, haha
[21:40] <harmw> ^^
[21:40] <harlowja> just works??
[21:40] <harlowja> lol
[21:40] <harlowja> u so funny
[21:41] <harlowja> we are working through the havana upgrade as we speak afaik
[21:41] <harmw> it was bugging me about not beeing able to find drive.conf, even though i configured force_config_drive=false
[21:41] <harlowja> saw on the ML that some migration is possibly busted
[21:41] <harlowja> drive.conf?
[21:41] <harmw> yeah, whats it called
[21:41] <harlowja> odd
[21:41] <harmw> in the instance dir
[21:41] <harmw> or just 'disk'
[21:42] <harlowja> ya, thats config drive stuff
[21:42] <harlowja> *at least disk.config is 
[21:42] <harmw> yes , indeed
[21:42] <harmw> and which I told nova to have have disabled
[21:42] <harlowja> ya, :-/
[21:42] <harlowja> and u restarted nova processes?
[21:42] <harmw> it also complained about timeouts with neutron, causing bad behaviour aswell
[21:43] <harmw> ofc :)
[21:43] <harlowja> k, odd
[21:43] <harmw> well apart from that, it now 'just' works
[21:43] <harmw> grizzly to havana
[21:43] <harlowja> ya
[21:44] <harlowja> i haven't heard anything bad from the guys that are working on that upgrade here
[21:44] <harlowja> just takes time to make sure :-P
[21:44] <harlowja> and once u go forward u never go back (sadly)
[21:44] <harmw> having to do db_sync for nova/cinder/glance/etc. was the only real bug i guess
[21:46] <harmw> lol, interestingly enough, my newly created instance has a disk.config file :|
[21:46] <harmw> force_config_drive = false
[21:48] <harlowja> :-/
[21:49] <harmw> 2013-12-30 22:49:00.693 25436 INFO nova.virt.libvirt.driver [req-51d97fd0-50b5-4c9c-be1d-c4767df31cf5 30f8cf93273345d1b7dc4e22da05536d 04826ef02a00466da4af5e70ddc67038] [instance: 87b2cf14-bd06-475c-a5a2-293969d31960] Using config drive
[21:49] <harmw> wtf
[21:49] <harlowja> ya
[21:49] <harlowja> odd
[21:50] <harlowja> https://github.com/openstack/nova/blob/stable/havana/nova/virt/libvirt/driver.py#L2419
[21:50] <harmw> ah, and here we go again: 2013-12-30 22:49:53.105 25436 TRACE nova.compute.manager [instance: 87b2cf14-bd06-475c-a5a2-293969d31960] ConnectionFailed: Connection to neutron failed: timed out
[21:50] <harlowja> https://github.com/openstack/nova/blob/stable/havana/nova/virt/configdrive.py#L180
[21:50] <harlowja> instance.get('config_drive') or CONF.force_config_drive
[21:50] <harlowja> so maybe your instance think it needs the config_Drive
[21:50] <harlowja> and thats overriding force setting
[21:51] <harmw> hm, well nova boot isn't telling it to use it
[21:52] <harlowja> ya, someone is setting that i think
[21:53] <harmw> i was hoping to -not- having to go through sourcecode to get this fixed...  :p
[21:54] <harlowja> ya
[21:54] <harlowja> can u paste the debug request logs
[21:54] <harlowja> https://github.com/openstack/nova/blob/stable/havana/nova/api/openstack/compute/servers.py#L763
[21:54] <harlowja> my guess is that code is getting activated, which is saving sometihing in the instance
[21:54] <harlowja> a favorite saying of a person on my team
[21:54] <harlowja> 'its openstack relaxxxxx'
[21:54] <harlowja> *long x, lol
[21:55] <harmw> :p
[21:59] <harlowja> does seem odd that it isn't turned off though
[21:59] <harlowja> when booting use --debug and see what the heck nova is sending
[22:03] <harmw> "name": "dummy", "created": "2013-12-30T22:02:04Z", "tenant_id": "04826ef02a00466da4af5e70ddc67038", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [{"id": "07c70f2f-9aa5-46fc-ba40-768b1cc412e4"}], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 0, "config_drive": "", "metadata": {}}}
[22:04] <harmw> though now its hitting a neutron timeout
[22:05] <harlowja> odd, ya, "" == false in python
[22:12] <harlowja> its openstack rellaxxxx
[22:12] <harlowja> lol
[22:12] <harmw> openstack should invest some time in making stuff like this easier to debug :)
[22:20] <harmw> ffs, ive just ran the build-me-a-new-instance script again, but this thime on the controller
[22:20] <harmw> and volia, no neutron timeout :|
[22:21] <harmw> difference is fedora workstation with grizzly cmdline tools, controller has havana
[22:21] <harmw> though its probably just dumb luck
[22:21] <harmw> its still creating a config_drive though
[22:24] <harmw> 2013-12-30 23:24:08.190 25862 DEBUG nova.openstack.common.service [-] force_config_drive             = false log_opt_values /usr/lib/python2.6/site-packages/oslo/config/cfg.py:1945
[22:24] <harmw> from nova-compute startup
[22:34] <harlowja> :-/
[22:34] <harlowja> did u try setting no value for force_config_drive
[22:35] <harlowja> harmw ya, i think i see it
[22:35] <harlowja> lol
[22:35] <harlowja> https://github.com/openstack/nova/blob/master/nova/virt/configdrive.py#L46
[22:35] <harlowja> cfg.StrOpt
[22:35] <harlowja> haha
[22:36] <harlowja> so leave it empty, not 'false'
[22:36]  * harlowja not really funny :-/
[22:36] <harmw> +1 for the ever consistent openstack
[22:36] <harlowja> def
[22:36] <harlowja> force_config_drive is a string option, to allow for future behaviors
[22:36] <harlowja> lol
[22:36] <harlowja> 'future behaviors'
[22:36] <harlowja> lol
[22:37] <harmw> and empty is "" or just realy NULL ?
[22:37] <harlowja> i'd just do
[22:37] <harlowja> force_config_drive             =
[22:37] <harmw> yea
[22:37] <harmw> ok
[22:38] <harlowja> i guess that would be null
[22:39] <harlowja> or should be
[22:39] <harmw> 2013-12-30 23:38:59.843 26681 WARNING nova.virt.disk.api [req-9093c6c8-eca4-4107-9fea-deae1409d02a 30f8cf93273345d1b7dc4e22da05536d 04826ef02a00466da4af5e70ddc67038] Ignoring error injecting data into image ([Errno 2] No such file or directory: '/data/openstack/nova//instances/0f6f6e41-cc37-4bf0-983b-a48dff16c9db/disk')
[22:40] <harmw> 2013-12-30 23:39:02.071 26681 INFO nova.compute.manager [-] Lifecycle event 0 on VM 0f6f6e41-cc37-4bf0-983b-a48dff16c9db
[22:40] <harmw> 2013-12-30 23:39:02.388 26681 INFO nova.virt.libvirt.driver [-] [instance: 0f6f6e41-cc37-4bf0-983b-a48dff16c9db] Instance spawned successfully.
[22:40] <harmw> there we go
[22:40] <harmw> thanks harlowja 
[22:40] <harlowja> np
[22:40] <harmw> +infinity for opensource :)
[22:41] <harlowja> :)
[22:41] <harlowja> mostly works some of the time, ha
[22:41] <harlowja> ^ thats opensource, lol
[22:41] <harmw> :)
[22:46] <harmw> a little over 24hours away from nye :)
[22:47] <harlowja> def
[22:48] <harlowja> 2014, the year of linux
[22:48] <harlowja> lol
[22:48] <harmw> lol
[22:50] <harlowja> or maybe the year of openstack, idk
[23:29] <harlowja> woot, got a freebsd to locally run
[23:29] <harlowja> devfs           1.0K    1.0K      0B   100%    /dev
[23:29] <harlowja> procfs          4.0K    4.0K      0B   100%    /proc
[23:29] <harlowja>  /dev/vtbd0p2    9.6G    1.4G    7.5G    16%    
[23:30] <harlowja> harmw do u have an simple instructions i can do to make it active, since i'm guessing its not install rpm :-P