/srv/irclogs.ubuntu.com/2013/11/01/#cloud-init.txt

Dr_Memoryso once upon a time, I had a multipart mime cloudinit script in ec2 userdata that worked just fine on both lucid and precise: http://pastebin.com/8WPmCmAQ17:39
Dr_Memoryon saucy, however, it appears to do... nothing.17:40
Dr_Memorythe log output on saucy: http://pastebin.com/PY2jeRSk17:41
Dr_Memorythe text/cloud-init section of the mime blob does not seem to have been written out anywhere under /var/lib/cloud, which I'm guessing is the problem?  But it's unclear to me why.17:43
Dr_Memoryany pointers, even if to the relevant sections of TFM, would be appreciated. :)17:44
* Dr_Memory drops a pin :)18:02
kwadronautsssht! in the changelog i see one -maybe- relevant piece touched between precise and saucy, might want to have a closer look at https://bugs.launchpad.net/cloud-init/+bug/106511618:15
kwadronautthis channel isn't very active, btw, patience helps. or a bug, mail, ..18:16
Dr_Memorykwadronaut: thanks.  I realized after pin-dropping that most ppl here were on the plus side of GMT, so I will be patient. :)18:25
Dr_Memory(also not sure 1065116 is relevant on first blush -- I don't see a KeyError anywhere in cloud-init.log)18:29
kwadronautI took that pin and threw it in a haystack. but you're probably right, wrong guess of me.18:32
harlowjaalso i think that smoser and i will be travelling soon to, so it might get even more quiet19:43
harlowjaDr_Memory i'd be useful to know whats in /var/lib/cloud/instances/i-fa2e879e/user-data.txt19:45
harlowjaif u want to share19:45
Dr_Memoryharlowja: just a sec19:45
harlowjathe debug logs look ok, just as u said, not seeing any mime writing really19:46
harlowjaor much other file writing19:46
harlowjawhich seems off19:46
smoserDr_Memory, it doen't look terribly unreasonable.19:47
Dr_Memoryharlowja: just a sec19:47
Dr_Memoryhttp://pastebin.com/WwDY5MTZ19:47
Dr_Memory(I've been fiddling a bit and this is a new instance from the last one I tried, but the behavior has been the same.19:48
Dr_Memory)19:48
smoseruser-data.txt.i19:48
Dr_Memory(possibly of note: there is no newline at the end of the last mime header there?)19:48
Dr_Memoryls: cannot access /var/lib/cloud/instance/user-data.txt.i: No such file or directory19:48
smoserDr_Memory, /var/log/cloud-init.klog19:50
smosers/klog/log19:50
harlowjaya, the full contents of that log file should give us the dirty details19:51
harlowja*or not so dirty19:51
Dr_Memoryjust a sec :)19:52
Dr_Memorythe log: http://pastebin.com/BTjQw2Vg19:53
Dr_Memoryor rather, that's the log from the last reboot -- if you like I can spawn a new instance and get a clean log19:53
Dr_MemoryI tried, in desperation, putting the "cloud_final_modules:" stanza into /etc/cloud/cloud.cfg.d/99_final.cfg (and then rm -rf /var/lib/cloud; reboot), which is why you see it referenced in the logs there.19:55
utlemmingsmoser: just pinged you privately19:56
harlowjanp dr. a clean instance log might be the best i think19:57
Dr_Memoryharlowja: figured.  on moment, por favor :)19:57
Dr_Memory(cloudformation is thinking... thinking... thinking...)19:58
harlowjamore thinkin19:59
Dr_Memory(AWS gears grind slowly, but they grind exceedingly... slow.)19:59
Dr_Memoryokay, virgin log: http://pastebin.com/FrpZp8ir20:01
Dr_Memoryuser-data.txt still the same.  user-data.txt.i still nonexistent.20:02
harlowjadamn, who put all this merging logs, hahaha20:05
harlowja:-/20:06
harlowjalike it seems to be doing stuff20:07
harlowjais https://org.blank.bootstrap.s3.amazonaws.co ok?20:08
harlowjanot sure what thats supposed to return for u20:08
Dr_Memoryyeah, I can manually grab that URL with curl/wget20:08
Dr_Memoryit returns a #!/bin/sh file20:08
harlowjak20:08
* harlowja scanning codes20:11
Dr_Memorylike so: 20:12
Dr_Memoryhttp://pastebin.com/kififAdN20:12
harlowjasure20:14
Dr_Memoryhuh.  I wonder if some library got more strict about certificate alt name validation between precise and saucy?20:14
Dr_Memoryalthough there's nothing in the cloudinit log to suggest that fetching that url failed20:15
harlowjaya20:16
harlowjait seems to have worked, although it didn't write out the right file20:16
harlowjawhat does 'ls /var/lib/cloud/instance/' show?20:17
harlowjaor 'find  /var/lib/cloud/instance/'20:17
Dr_Memoryholy shit20:17
Dr_MemoryI just s/https/http/20:17
Dr_Memory...and it worked20:17
harlowjahmmmm20:18
Dr_Memory*facepalm*20:18
harlowjaif u also try #include-once this will write out a file20:18
harlowjathat file writing should showup in the log20:18
harlowjajust #include just loads it into memory20:19
harlowja*no log20:19
Dr_Memoryah, interesting20:19
harlowjaalthough ssh/not ssh is odd20:19
harlowja*https/not https20:19
harlowja(brainfart)20:20
Dr_Memorywell, S3 signed urls are kinda special20:20
Dr_Memorythey end up being https://bucketname.s3.amazonaws.com/20:20
harlowjahmmm20:20
Dr_Memoryand if your bucketname has dots in it: https://bucket.name.s3.amazonaws.com/20:20
Dr_Memorywhich doesn't match their wildcard cert20:20
harlowjahehe, u out of my area of expertise :-P openstack doesn't have these ;)20:21
Dr_Memoryis this worth a bug report?20:22
harlowjasmoser what do u think20:23
Dr_Memoryarguably "don't provide https include urls to sites that don't provide a correct certificate" is a "doctor it hurts when I do this" issue 20:23
harlowjait does seem like odd behavior20:23
Dr_Memorybut the logging could definitely have been better in this case :(20:23
harlowjadef20:23
Dr_Memoryand the behavior is, if not a regression, certainly a change20:23
harlowjaya, we switched to using the requests library, which is more strict about this stuff20:24
harlowjaalthough i would have expected some log to20:24
harlowjai'd be fine with a bug, but smoser might think otherwise20:25
harlowjahttp://www.python-requests.org/en/latest/20:25
smoserwhat was the issue there ?20:39
smoseryou effectively had an invalid cert ?20:39
Dr_Memorysmoser: not 100% sure, but when I changed the #include url from https://org.blank.bootstrap.s3.amazon.com/ to http:// suddenly everything just worked.20:40
Dr_Memoryand yes: amazon has a wildcard cert for *.s3.amazonaws.com but wildcard certs AFAIK can't cover sub-subdomains.20:40
smoserthe can i think20:49
smoserit'd seem like possibly a bug in python-requests20:49
smoseror possibly its doing the right thing20:49
smoseri'm not sure.20:49
Dr_Memoryyeah20:51
Dr_Memoryif nothing else, I feel like the log should have told us a bit more about what was going on20:52

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!