| === harlowja_away is now known as harlowja | ||
| === harlowja is now known as harlowja_away | ||
| harlowja | harmw sean hopefully getting me an image today :-P | 18:15 |
|---|---|---|
| harmw | ah nice harlowja | 21:08 |
| harmw | first things first though, time to fix my broken havana upgrade | 21:12 |
| harlowja | ah, good luck :-/ | 21:40 |
| harmw | god how I hate openstack for beeing such a pig to debug in case of failures :| especially since it now just works | 21:40 |
| harmw | oh, haha | 21:40 |
| harmw | ^^ | 21:40 |
| harlowja | just works?? | 21:40 |
| harlowja | lol | 21:40 |
| harlowja | u so funny | 21:40 |
| harlowja | we are working through the havana upgrade as we speak afaik | 21:41 |
| harmw | it was bugging me about not beeing able to find drive.conf, even though i configured force_config_drive=false | 21:41 |
| harlowja | saw on the ML that some migration is possibly busted | 21:41 |
| harlowja | drive.conf? | 21:41 |
| harmw | yeah, whats it called | 21:41 |
| harlowja | odd | 21:41 |
| harmw | in the instance dir | 21:41 |
| harmw | or just 'disk' | 21:41 |
| harlowja | ya, thats config drive stuff | 21:42 |
| harlowja | *at least disk.config is | 21:42 |
| harmw | yes , indeed | 21:42 |
| harmw | and which I told nova to have have disabled | 21:42 |
| harlowja | ya, :-/ | 21:42 |
| harlowja | and u restarted nova processes? | 21:42 |
| harmw | it also complained about timeouts with neutron, causing bad behaviour aswell | 21:42 |
| harmw | ofc :) | 21:43 |
| harlowja | k, odd | 21:43 |
| harmw | well apart from that, it now 'just' works | 21:43 |
| harmw | grizzly to havana | 21:43 |
| harlowja | ya | 21:43 |
| harlowja | i haven't heard anything bad from the guys that are working on that upgrade here | 21:44 |
| harlowja | just takes time to make sure :-P | 21:44 |
| harlowja | and once u go forward u never go back (sadly) | 21:44 |
| harmw | having to do db_sync for nova/cinder/glance/etc. was the only real bug i guess | 21:44 |
| harmw | lol, interestingly enough, my newly created instance has a disk.config file :| | 21:46 |
| harmw | force_config_drive = false | 21:46 |
| harlowja | :-/ | 21:48 |
| harmw | 2013-12-30 22:49:00.693 25436 INFO nova.virt.libvirt.driver [req-51d97fd0-50b5-4c9c-be1d-c4767df31cf5 30f8cf93273345d1b7dc4e22da05536d 04826ef02a00466da4af5e70ddc67038] [instance: 87b2cf14-bd06-475c-a5a2-293969d31960] Using config drive | 21:49 |
| harmw | wtf | 21:49 |
| harlowja | ya | 21:49 |
| harlowja | odd | 21:49 |
| harlowja | https://github.com/openstack/nova/blob/stable/havana/nova/virt/libvirt/driver.py#L2419 | 21:50 |
| harmw | ah, and here we go again: 2013-12-30 22:49:53.105 25436 TRACE nova.compute.manager [instance: 87b2cf14-bd06-475c-a5a2-293969d31960] ConnectionFailed: Connection to neutron failed: timed out | 21:50 |
| harlowja | https://github.com/openstack/nova/blob/stable/havana/nova/virt/configdrive.py#L180 | 21:50 |
| harlowja | instance.get('config_drive') or CONF.force_config_drive | 21:50 |
| harlowja | so maybe your instance think it needs the config_Drive | 21:50 |
| harlowja | and thats overriding force setting | 21:50 |
| harmw | hm, well nova boot isn't telling it to use it | 21:51 |
| harlowja | ya, someone is setting that i think | 21:52 |
| harmw | i was hoping to -not- having to go through sourcecode to get this fixed... :p | 21:53 |
| harlowja | ya | 21:54 |
| harlowja | can u paste the debug request logs | 21:54 |
| harlowja | https://github.com/openstack/nova/blob/stable/havana/nova/api/openstack/compute/servers.py#L763 | 21:54 |
| harlowja | my guess is that code is getting activated, which is saving sometihing in the instance | 21:54 |
| harlowja | a favorite saying of a person on my team | 21:54 |
| harlowja | 'its openstack relaxxxxx' | 21:54 |
| harlowja | *long x, lol | 21:54 |
| harmw | :p | 21:55 |
| harlowja | does seem odd that it isn't turned off though | 21:59 |
| harlowja | when booting use --debug and see what the heck nova is sending | 21:59 |
| harmw | "name": "dummy", "created": "2013-12-30T22:02:04Z", "tenant_id": "04826ef02a00466da4af5e70ddc67038", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [{"id": "07c70f2f-9aa5-46fc-ba40-768b1cc412e4"}], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 0, "config_drive": "", "metadata": {}}} | 22:03 |
| harmw | though now its hitting a neutron timeout | 22:04 |
| harlowja | odd, ya, "" == false in python | 22:05 |
| harlowja | its openstack rellaxxxx | 22:12 |
| harlowja | lol | 22:12 |
| harmw | openstack should invest some time in making stuff like this easier to debug :) | 22:12 |
| harmw | ffs, ive just ran the build-me-a-new-instance script again, but this thime on the controller | 22:20 |
| harmw | and volia, no neutron timeout :| | 22:20 |
| harmw | difference is fedora workstation with grizzly cmdline tools, controller has havana | 22:21 |
| harmw | though its probably just dumb luck | 22:21 |
| harmw | its still creating a config_drive though | 22:21 |
| harmw | 2013-12-30 23:24:08.190 25862 DEBUG nova.openstack.common.service [-] force_config_drive = false log_opt_values /usr/lib/python2.6/site-packages/oslo/config/cfg.py:1945 | 22:24 |
| harmw | from nova-compute startup | 22:24 |
| harlowja | :-/ | 22:34 |
| harlowja | did u try setting no value for force_config_drive | 22:34 |
| harlowja | harmw ya, i think i see it | 22:35 |
| harlowja | lol | 22:35 |
| harlowja | https://github.com/openstack/nova/blob/master/nova/virt/configdrive.py#L46 | 22:35 |
| harlowja | cfg.StrOpt | 22:35 |
| harlowja | haha | 22:35 |
| harlowja | so leave it empty, not 'false' | 22:36 |
| * harlowja not really funny :-/ | 22:36 | |
| harmw | +1 for the ever consistent openstack | 22:36 |
| harlowja | def | 22:36 |
| harlowja | force_config_drive is a string option, to allow for future behaviors | 22:36 |
| harlowja | lol | 22:36 |
| harlowja | 'future behaviors' | 22:36 |
| harlowja | lol | 22:36 |
| harmw | and empty is "" or just realy NULL ? | 22:37 |
| harlowja | i'd just do | 22:37 |
| harlowja | force_config_drive = | 22:37 |
| harmw | yea | 22:37 |
| harmw | ok | 22:37 |
| harlowja | i guess that would be null | 22:38 |
| harlowja | or should be | 22:39 |
| harmw | 2013-12-30 23:38:59.843 26681 WARNING nova.virt.disk.api [req-9093c6c8-eca4-4107-9fea-deae1409d02a 30f8cf93273345d1b7dc4e22da05536d 04826ef02a00466da4af5e70ddc67038] Ignoring error injecting data into image ([Errno 2] No such file or directory: '/data/openstack/nova//instances/0f6f6e41-cc37-4bf0-983b-a48dff16c9db/disk') | 22:39 |
| harmw | 2013-12-30 23:39:02.071 26681 INFO nova.compute.manager [-] Lifecycle event 0 on VM 0f6f6e41-cc37-4bf0-983b-a48dff16c9db | 22:40 |
| harmw | 2013-12-30 23:39:02.388 26681 INFO nova.virt.libvirt.driver [-] [instance: 0f6f6e41-cc37-4bf0-983b-a48dff16c9db] Instance spawned successfully. | 22:40 |
| harmw | there we go | 22:40 |
| harmw | thanks harlowja | 22:40 |
| harlowja | np | 22:40 |
| harmw | +infinity for opensource :) | 22:40 |
| harlowja | :) | 22:41 |
| harlowja | mostly works some of the time, ha | 22:41 |
| harlowja | ^ thats opensource, lol | 22:41 |
| harmw | :) | 22:41 |
| harmw | a little over 24hours away from nye :) | 22:46 |
| harlowja | def | 22:47 |
| harlowja | 2014, the year of linux | 22:48 |
| harlowja | lol | 22:48 |
| harmw | lol | 22:48 |
| harlowja | or maybe the year of openstack, idk | 22:50 |
| harlowja | woot, got a freebsd to locally run | 23:29 |
| harlowja | devfs 1.0K 1.0K 0B 100% /dev | 23:29 |
| harlowja | procfs 4.0K 4.0K 0B 100% /proc | 23:29 |
| harlowja | /dev/vtbd0p2 9.6G 1.4G 7.5G 16% | 23:29 |
| harlowja | harmw do u have an simple instructions i can do to make it active, since i'm guessing its not install rpm :-P | 23:30 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!