| === Wulf4 is now known as Wulf | ||
| === blaisebool is now known as Guest46113 | ||
| Wulf | I'm running AWS EC2 instances. I would like to pass a parametrized URL as userdata like "#include http://path/foo?a=b&c=d". foo should contain python code (same for all instances) that will be executed by cloud-init and dynamically create a cloud-config configuration and inject it into cloud-init. I kind of got it working with a part-handler and sys._getframe, but it's really ugly. Is there (or should | 16:21 |
|---|---|---|
| Wulf | there be) any proper way to achieve the same? | 16:21 |
| smoser | Wulf, you're wanting the instance to identify itself in the '#include' i guess ? | 16:26 |
| smoser | somehow ? | 16:26 |
| smoser | (headers would be an option) | 16:26 |
| Wulf | smoser: no, the web server is static (e.g. s3), so the client (cloud-init) won't identify itself | 16:27 |
| Wulf | smoser: but the url might contain like ?name=newhostname | 16:27 |
| smoser | i guess you overrode the part-handler for '#include' ? | 16:28 |
| smoser | what you're asking for does sound interesting | 16:28 |
| Wulf | smoser: no, for a new mime type | 16:28 |
| Wulf | So is there currently any other way to download+execute arbitrary code than a part-handler? | 16:42 |
| smoser | well, a '#!' | 16:43 |
| smoser | Wulf, but that has the same general issue ... i think you're wanting python access to hostname or instanceid ... is that right ? | 16:44 |
| smoser | is that what you were using sys._getframe for ? | 16:44 |
| Wulf | smoser: I want python access to the cloud-config part so I can set the hostname of a list off ssh keys, host specific mounts, etc. I use sys._getframe to access walker_callback.data['handlers']['text/cloud-config'] | 16:46 |
| Wulf | *or a list of ssh...* | 16:47 |
| smoser | so i think i udnerstand, but i'm kind of confused. | 16:49 |
| smoser | is the url static for each node ? | 16:51 |
| smoser | ie, you want static url and static content | 16:51 |
| smoser | that produces different cloud-config for the node based on information available on the node. | 16:52 |
| Wulf | smoser: the content is static, the url might vary with ?parameter=value which the webserver behind it ignores | 16:52 |
| smoser | i think | 16:52 |
| smoser | powersj, do you know why the copr build failures ? | 17:14 |
| powersj | smoser: I looked briefly friday and it appears that the lxd pull is failing | 17:15 |
| powersj | lxd file pull* | 17:15 |
| powersj | says the file does not exist; I didn't have enough time to determine if it was due to the lxd 2.15 update, but that is the only thing to have changed | 17:16 |
| === blackboxsw_away is now known as blackboxsw | ||
| powersj | blackboxsw: \o/ | 17:23 |
| blackboxsw | powersj: and smoser you guys are around an awful lot for vacationing ;) | 17:27 |
| smoser | blackboxsw, i'm officiall in today | 17:27 |
| blackboxsw | ohh didn't realize that. | 17:27 |
| * powersj isn't, but broken AC means I'm sitting at coffee shop | 17:27 | |
| smoser | powersj, has no excuse. | 17:27 |
| smoser | blackboxsw, i'm out the rest of the week thoguh | 17:28 |
| smoser | blackboxsw, if you were just bored... | 18:08 |
| smoser | 2 things | 18:09 |
| smoser | a.) when i run: tox-venv py3 python3 -m nose tests/unittests/ | 18:09 |
| smoser | tests.unittests.test_datasource.test_openstack.TestOpenStackDataSource is the slowest. | 18:09 |
| smoser | b.) i believe if you launch an openstack instance without user-data then it will re-try to get it (if its not been given it will 404) | 18:10 |
| smoser | and we should accept that as "no user data", rather than trying again | 18:10 |
| smoser | (i think these 2 things might be related) | 18:11 |
| blackboxsw | roger smoser | 18:12 |
| blackboxsw | ok so we want the code to avoid retries on 404? | 18:12 |
| smoser | for user-data specifically | 18:13 |
| blackboxsw | hmm I already see MetadataReader.should_retry_cb in cloudinit/sources/helpers/openstack.py which should return False if error code >= 400 | 18:25 |
| smoser | blackboxsw, ssh ubuntu@10.245.162.120 | 18:34 |
| smoser | i think you should be able to get there (with vpn) | 18:34 |
| smoser | /var/log/cloud-init.log -> http://paste.ubuntu.com/25012904/ | 18:34 |
| blackboxsw | I'm there | 18:34 |
| smoser | 2017-07-03 18:26:51,445 - url_helper.py[DEBUG]: [0/6] open 'http://169.254.169.254/openstack/latest/user_data' with {'timeout': 10.0, 'method': 'GET', 'allow_redirects': True, 'headers': {'User-Agent': 'Cloud-Init/0.7.9'}, 'url': 'http://169.254.169.254/openstack/latest/user_data'} configuration | 18:35 |
| smoser | 2017-07-03 18:26:52,514 - url_helper.py[DEBUG]: Please wait 1 seconds while we wait to try again | 18:35 |
| blackboxsw | heh, well that looks like it's not using that retry logic I saw for the base metadata crawler. ok thx. | 18:35 |
| blackboxsw | looks like it hit that retry about 5 times/ | 18:36 |
| blackboxsw | ok | 18:36 |
| smoser | right | 18:36 |
| blackboxsw | ok I exited your instance | 18:37 |
| blackboxsw | ok it's the wait _for_url call | 18:38 |
| blackboxsw | got it. | 18:38 |
| blackboxsw | sure I'll pull together a fix | 18:38 |
| === MrWatson is now known as NostawRm | ||
| smoser | blackboxsw, file a bug please too | 18:45 |
| smoser | and thank you | 18:45 |
| blackboxsw | no prob | 18:45 |
| blackboxsw | smoser: vendordata and networkdata (both are optional metadata, shall we also avoid retries in those cases?) | 19:13 |
| smoser | i think those work as expected. | 19:13 |
| smoser | i think. | 19:13 |
| smoser | i think they're both guaranteed | 19:14 |
| blackboxsw | ok I was just trying to queue off of the commonolity of networkdata and vendordata also being listed as optional in cloudinit/sources/helpers/openstack.py 227-241 | 19:16 |
| blackboxsw | commonality rather | 19:17 |
| blackboxsw | as in, if optional: don't retry 404 | 19:17 |
| blackboxsw | but we can make it specific to just user_data if we want | 19:17 |
| smoser | blackboxsw, they may be optional. i was just going from memory | 19:23 |
| smoser | you can look in https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L449 | 19:24 |
| smoser | thats the backend | 19:24 |
| blackboxsw | If I'm reading things right, looks like network_data is avail on Liberty, but not on other versions. Vendor data is available on Havana, but Vendor-data2 is avail on Newton2. So they too look optional. | 19:58 |
| blackboxsw | depending on the version of openstack | 19:58 |
| blackboxsw | https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L627 | 19:59 |
| blackboxsw | ahh that _check_os_version call is that the version is >= <version_name> so vendor_data exists >= Havana, network_data exists >= Liberty | 20:03 |
| blackboxsw | does cloud-init need to support < Havana? | 20:03 |
| smoser | i didnt know there is a vendor-data2. | 20:05 |
| smoser | blackboxsw, https://releases.openstack.org/ | 20:07 |
| smoser | i'd say we can get away with breaking support for a platform that has been EOL for 2.5 years. | 20:08 |
| smoser | i guess the realistic scenario would be someone running 12.04 but wanted to run 16.04 guests... we'd break them. | 20:08 |
| blackboxsw | heh, didn't know if cloud-init had compelling customer base running on pre-Havana (I'd think any vendor running on that version of openstack would have moved to something a bit more recent anyway) | 20:09 |
| blackboxsw | gotta head out for the day | 22:57 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!