=== praneshp_ is now known as praneshp === harlowja is now known as harlowja_away === pquerna_ is now known as pquerna [11:08] smoser: hi, got a minute? [13:20] mhroncok, whats up? [13:21] smoser: I wan to talk with you about cloud-init and Python 3 [13:21] smoser: cloud-init is the last thing in Fedora cloud stack, that doesn't support Python 3 [13:21] smoser: and we would like to make it happen [13:22] how can we help? [13:22] its on a list, and it should have been done alrady. [13:23] i'm open to patches for that. we've done some work in that direction (dropping boto and cheetah recently) [13:23] there are several relevant issues opened, but it seems nothing is happening, so we we would be happy to help with patches - however we are not sure what should we focus on first [13:23] BTW boto now supports Python 3 [13:24] I've seen this: https://code.launchpad.net/~harlowja/cloud-init/changeable-templates/+merge/208994 [13:25] so now it should only be about cloud-init itself? [13:26] i didn't know about boto and python3, thats good. yeah, it should be only cloud-init itself. [13:27] is there any branch for python 3 porting or stuff liek tyhat, or we should just start with trunk? [13:27] s/liek tyhat/like that/ [13:27] trunk. [13:28] harlowja_away, may have taken some further look at it. [13:28] smoser: ok, thanks for info [13:30] i think it makes sense to get to python3 support in cloud-init. [13:31] there is some discussion about doing a cloud-init 2.0, which would start with python3 as the starting point. [13:31] and probably not bother with python2 support [13:31] smoser: is there a way to send patches, but don not sign CCA? [13:33] i'm sorry, there is not. [13:33] contributors agreement are required i many projects. [13:34] I'm not even sure I can sign that, will consult my boss :) [14:14] hi [14:14] I am doing some modifications to a cloud init datasource [14:15] but I am unable to get the error [14:15] I only get a warning saying "Getting data from I only get a warning saying "Getting data from failed [14:16] is there any way I can see the errors? [14:38] jfontan, maybe /var/log/cloud-init.log has an error ? [14:45] nope, that is the only error [14:46] I've added a traceback print to may copy of cloud-init [14:46] in find_source [14:46] may=my [16:03] jfontan, you should get something else along side that error. [16:06] it only said it failed [16:06] it was an error in the code [16:07] but the exception blod just printed that it could not get the data [16:07] block [16:08] here [16:08] http://bazaar.launchpad.net/~cloud-init-dev/cloud-init/trunk/view/head:/cloudinit/sources/__init__.py#L255 [16:57] harmw, what do you need me to merge ? [16:57] jfontan, yeah, but it should log a stack trace [16:57] it didn't for me [17:02] can you pastebinit ? [17:02] the whole log ? [17:08] I'll have to create the image again [17:10] as I don't have the error in the code anymore and it has the trace print in. I'll check if I have an old vm [17:18] smoser, https://gist.github.com/jfontan/bcf18f262cd06252ff1a#file-gistfile1-txt-L13 [17:19] it only says that it failed but no stacktrace [17:19] I'm using trunk [17:20] so the error you see there is the one you added ? [17:20] the stack trace [17:21] smoser did i hear python3 [17:21] lol [17:21] nope, I took out the strack trace printing code [17:21] the error is in OpenNebula Data source [17:21] and just tells it failed [17:22] no stacktrace [17:22] hm.. that is odd. i dont know why. [17:22] there is an stacktrace for openstack but that's something I'm not working on [17:22] yeah, and that is wrong. [17:22] you're using turnk her e? [17:22] yes [17:22] harlowja, you see that ^ . [17:22] that should probably not be a fail [17:22] whats the trace? [17:22] but rather a "no datasource here, move along" [17:23] https://gist.githubusercontent.com/jfontan/bcf18f262cd06252ff1a/raw/960d80f5263ebbe909ab786ef1ece8bc5d04cda6/gistfile1.txt [17:23] smoser hmmm, will fix [17:23] it's a failure. I mistyped a variable [17:23] and any idea why we wouldnt get a log [17:23] of that failure there. [17:24] for the 'DataSourceOpenNebula' line [17:24] it could be the code in data source [17:24] maybe it's catching all exceptions [17:24] well, it is. [17:24] I'll take a look [17:25] but then it calls [17:25] util.logexc(LOG, "Getting data from %s failed", cls) [17:26] so that logexc should print the trace, isn't it? [17:26] yeah. [17:30] I have to go [17:30] good luck [17:37] smoser https://code.launchpad.net/~harlowja/cloud-init/mini-os-fixes/+merge/233399 [18:02] mhroncok also https://code.launchpad.net/~harlowja/cloud-init/py2-3 for your py3 messages [18:02] thats the branch that imho will enable mixed py2/py3 mode [18:03] which will be required for older distros that aren't all py3 yet [18:03] harlowja: great, thanks [18:03] i did some basic testing from what i remember with py3 and pretty sure i nailed most of the issues down [18:03] BTW harlowja smoser, cannot I just give you my patches as Public domain? [18:04] mhroncok smoser probably knows better than i all that stuff, i never got into the legal stuff :-P [18:04] mhroncok, i dont think so. [18:04] ok, waiting to hear from our legal :D [19:03] harlowja, i don think you fixed https://gist.githubusercontent.com/jfontan/bcf18f262cd06252ff1a/raw/960d80f5263ebbe909ab786ef1ece8bc5d04cda6/gistfile1.txt [19:03] in mini-os [19:03] mini-os-fixes [19:04] k, maybe i misunderstand ? [19:04] so in that log [19:04] hm.. [19:04] oldd. [19:04] 'openstack.py[ERROR]: Failed reading mandatory path /tmp/tmpX2lt9o/openstack/latest/meta_data.json' ? [19:04] thats now demoted to debug [19:04] i have to look at this more. i didn't hitnk he had a config drive there. [19:05] oh i see. [19:05] so that would be debug, but then there is / should be no ERROR [19:05] _fetch_available_versions() takes exactly 1 argument (2 given) also should be fixed [19:05] agreed there. [19:05] i thought what had happend there was that there was no config drive [19:06] and that should result in the DSs' _get_data() returnning False [19:06] with only debug messages [19:07] sure, i just think the differeniation between searching for get_data that will work and actually using a get_data that then fails isn't clear [19:07] thats probably part of it [19:07] maybe should be refactored to find_data (which then only outputs debug messages) and get_data (which actually outputs errors) [19:08] sepearting the non-failure find process from the actual problems get_data [19:08] there sorta munged together at this point [19:16] well, _get_data returns True on "I've found" [19:17] and False on "nope" [19:19] right, but say it had a finding method, this one would return True/False, then it had a read method that would read from the previous location found (if it was) and would log errors and such [19:19] the find method would be expected to never log errors and such [19:20] but the read method could (instead of what we currently do is make everything debug, since we are doing both find and read in the same method) [19:25] i agree, it can be better. [19:28] harlowja, can you fix that though ? [19:28] hehe, what i'm supposed to fix? [19:28] lol [19:29] it needs to be debug only on "not found" [19:29] and ideally not stack trace :) [19:30] right, https://code.launchpad.net/~harlowja/cloud-init/mini-os-fixes/+merge/233399 switches those to debug ? [19:30] with no stack-trace [19:31] but i might still be confused, lol [19:31] oh, i think i see one more [19:34] ok, think i got them (reuploaded) [20:00] how did it do no stacktrace [20:03] except openstack.NonReadable: [20:03] return False [20:03] probably that [20:03] except openstack.NonReadable: [20:03] return False [20:03] except (openstack.BrokenMetadata, IOError) as e: [20:03] LOG.debug("Broken metadata address %s: %s", [20:03] self.metadata_address, e) [20:03] return False [20:04] shall that be changed? [20:04] or similar in 'DataSourceConfigDrive' [20:15] smoser: https://code.launchpad.net/~harmw/cloud-init/freebsd-fixes [20:15] https://code.launchpad.net/~harmw/cloud-init/freebsd-fixes/+merge/233247 [20:23] harmw, tried to build the cirros with patched busybox [20:23] but busubox didn't get patched [20:23] not sure why [21:07] sorry man, this time it's me beeing way to busy :) [21:16] harmw, no worries. [21:16] it seems like an easy fix [21:16] http://paste.ubuntu.com/8253590/ [21:53] hm, that makefile change... can't recall i needed that [22:11] no [22:11] you didn't [22:11] that was debug === gondoi is now known as zz_gondoi