meenaGoneri: ifconfig_vtnet0=dhcp was already there before cloud-init touched it. I'm talking about the defaultrouter line!00:08
Gonerimeena, there is probably a name=eth0 in the metadata that force the renaming, so line 12 and 13 are ok00:09
Goneriand so far, the provider does not clean up the previous lines from the /etc/rc.conf, should it?00:09
Goneriah nice defaultrouter00:10
meenare cleanup: nah00:12
* meena sleep now00:12
=== tds9 is now known as tds
Gonerithanks you rharper and Odd_Bloke for the reviews, I think I've addressed all of them. I'm regenerating new images.01:13
=== tds2 is now known as tds
meenahttps://github.com/canonical/cloud-init/pull/61#discussion_r359656257 hell no.08:08
meenawyoung: Heya10:28
wyoungHey meena !  How's stuff and / or junk?10:58
mkrai__Hi cloud-init team, is there any centos cloud image with cloud-init-18.5?11:19
mkrai__meena, Hi11:23
meenamkrai__: why so specific?11:41
mkrai__meena, Hi, I am facing issue on centos 7.6 with cloud-init11:42
mkrai__network is not configured11:42
mkrai__the cloud-init configures the wrong interface11:45
mkrai__meena, ^11:51
meenamkrai__: which cloud? how exactly is it configured wrong?11:52
mkrai__meena OpenStack11:52
meenamkrai__: what do the logs say?11:54
mkrai__meena, I have 3 interfaces on the node, 2 ethernet(enps0f0 and enps0f1) and 1 HFI(ib0). Openstack tries to boot interface on enps0f1 but cloud-init does on enps0f011:54
mkrai__meena, http://paste.openstack.org/show/787707/11:55
meenamkrai__: and paste cloud-init query --all12:37
meenathat was supposed to be expressed less urgent and more friendly, but, phone swipe12:39
mkrai__meena, http://paste.openstack.org/show/787784/12:41
meenamkrai__: as root or with sudo ;)12:57
meenawait that is12:57
mkrai__meena, with sudo12:58
meenamkrai__: yeah, sorry, what i mean is, the result is weird13:03
mkrai__meena, yeah, that seems weird to me to ;)13:04
meenamkrai__: can you curl the metadata URL?13:05
mkrai__meena network is not configured so I can't13:05
meenawell, yeah, that makes sense13:06
meenai just admit I've never setup a three interface computer with cloud-init, we'd usually only setup one interface, and do the rest with puppet13:09
anankeI'm trying to wrap my head around how to leverage packer and cloud-init to automate creation of golden AMIs. there are some actions that need to take place while the given AMI is being baked, and there are some that will happen on each boot of an instance using that AMI13:18
anankewith that in mind for the actions that need to take place on each boot, should I be placing cloud-init stuff in /var/lib/cloud/scripts/per-boot, or should I tack onto /etc/cloud/cloud.cfg.d/ ?13:19
anankemy source will be various linux distros sanctioned by their vendors, such as ubuntu/centos/etc, so they already have cloud-init in their AMIs13:20
meenaananke: unless Packer provides a metadata service, https://cloudinit.readthedocs.io/en/latest/topics/datasources.html you'd wanna stick with a script13:33
meenaananke: cloud-init should only run on the first boot on your AMI, to fix the partition and fs sizes and setup network and hostname13:34
anankemeena: packer utilizes ec2 metadata server to seed it the initial user data. these will be golden AMIs that will receive additional setup when they become instances13:36
meenaananke: cool cool cool13:37
anankeseeing as cloud-init is supposed to provide all of the above functionality, per-instance, per-boot, per-once, etc - I'm wondering what is the appropriate location I should be leveraging. it seems that these days cloud-init is baked into most major AMIs13:37
meenaI'm just a firm believer in idempotency, and puppet13:57
meenawhat with being Co-founder of voxpupuli and all13:59
Odd_Blokeananke: The /var/lib/cloud/scripts/per-* paths sound like what you want, I think.14:54
Odd_Blokemeena: cloud-init runs on every boot, but a lot of what it does only happens on first boot.14:54
otuboOdd_Bloke: meena thanks for the reviews. I updated my branch with the fixes. Also, I force pushed a commit to remove an automatic non-ff merge from master (ugh, sorry), shouldn't be a problem, though.15:21
meenaOdd_Bloke: that does not change my preference towards systems that are made to be idempotent.15:22
Odd_Blokemeena: Sure, but "cloud-init should only run on the first boot on your AMI" does not describe cloud-init's default behaviour, nor its behaviour in any distros I'm aware of. :p15:36
Odd_Bloke(If you want to install Ruby on your systems, that's your business. ;)15:36
meenaRuby is one of the best debuggable systems i know, so yes, i love working with it15:37
meenahit me up, as soon as python has something close in comfort and power to pry and pry-byebug15:38
Odd_Blokemeena: ipdb?15:40
meenaOdd_Bloke: how do i show the source code of a thing in ipdb?15:46
powersjmeena, if you are at a break point type 'l'15:48
Odd_Blokemeena: `l` will show you your current source code context, is that what you meant?15:52
meenaOdd_Bloke: nah, more like show me the implementation of x15:55
Odd_BlokeSo in IPython you can do foo?? and it will display that.  `ipdb` gives me a SyntaxError if I try to do that, so maybe it isn't possible.15:56
Odd_Blokemeena: Aha, `psource`.16:01
mkrai__Odd_Bloke, portdirect smoser meena https://bugs.launchpad.net/cloud-init/+bug/1857031 whenever you've time. Thanks!16:53
ubot5Ubuntu bug 1857031 in OpenStack Compute (nova) "cloud-init configures wrong interface when trying to configure two interfaces with OpenStack cloud" [Undecided,New]16:53
blackboxswmkrai__: can you please run "cloud-init query --all" on that machine and attach the content to the bug?  I'd particularly like to see the contenst of network_json that is reported there16:56
blackboxswbah missed it, I'll add it to the bug16:56
smoserhe's gone16:56
blackboxswyeah followup up on the bug :/16:56
smoserlook for WARN16:56
smoserthats the issue16:56
smosercentos 7 .16:56
blackboxswahh thanks, just did a quick driveby and hadn't caught up on backlog16:57
blackboxswand looks like the submitter also attached a paste of network data .json already to the bug anyway too16:57
smoserits a dupe of https://bugs.launchpad.net/cloud-init/+bug/180136416:58
ubot5Ubuntu bug 1801364 in cloud-init "persisting OpenStack metadata fails" [Undecided,Fix committed]16:58
blackboxswahh right, yeah16:58
blackboxswyou nailed that symptom/fix, but that shouldn't have affected which network device got chosen I would think. but looking a bit more into it16:58
smoserwell,  it fails during local16:59
smoserso it just tries the fallback/dhcp16:59
blackboxswand interesting is that the 'fix' was released in 18.5 I think and logs are from 19.2 cloud-init17:00
blackboxswohhh 18.217:01
blackboxswnot 19.217:01
blackboxswmy mind was playing tricks on me17:01
smoseri'm not certain ther are not other issues at play17:01
smoserthere may well be.17:01
smoserbut if it doesn't persist the data then we're down a sour path17:02
anankeOdd_Bloke: thanks!17:06
blackboxswthx for the triage on that bug smoser. yes on the instance-data.json being a sour path. Yet, the perist_instance_data happens after _get_data was already run successfully or otherwise. So, I *think* we just don't get the instance-data.json in that case without any other fallout.   In either event, 18.2 is missing a bunch of fixes over the last year and a half for both network, so I just pointed them at17:49
blackboxswcopr/el-testing and asked for a reproducer17:49
anankeoops, sorry17:55
smoserblackboxsw: yeah, for a lot of reasons copr repo is a good iea there.18:02
meenai approve: https://github.com/canonical/cloud-init/pull/13219:04
meenarharper: added your test: https://github.com/canonical/cloud-init/pull/5319:22
Odd_Blokemeena: rharper is done for the year, FYI.19:22
Odd_Blokepowersj: blackboxsw: https://github.com/canonical/cloud-init/pull/130 <-- would be good to land this clarification to HACKING19:29
meenaOdd_Bloke: right, you mentioned that yesterday.19:35
meenaOdd_Bloke: you should also add how to do stuff at lp, cuz lotsa people find it confusing.19:38
Odd_Blokemeena: "do stuff at lp"?19:38
meenaOdd_Bloke: how to fork stuff @ launchpad19:39
meenaand how to push there, cuz i've seen at least 2 found that challenging.19:39
Odd_Blokemeena: Oh, for the CLA stuff?19:42
Odd_BlokeYeah, that would be good.19:43
Odd_BlokeI was on vacation when the migration happened, so I don't really know how much the script handles etc.19:43
meenai haven't looked at the script lately, tbf. so maybe it's magically fixed by now19:54
Odd_Blokemeena: So regarding Cirrus CI, we'd be happy to introduce it as a non-voting status check provided it wouldn't cost us anything (which, looking at the docs, it shouldn't).  So if you want to go take a look at making that happen, please feel free!19:54
blackboxsw#130 is approved. I'll run through the migration tool again now in light of upstream now being in github to see if it works19:54
Odd_Blokemeena: (For reference, when I was iterating on our Travis config, I just configured it against my fork, so hopefully you shouldn't need anything from us to get something working.)19:55
meenaOdd_Bloke: i've configured cirrus before: https://github.com/bsdci/libioc/blob/master/.cirrus.yml19:56
Gonerirharper, Odd_Bloke: I've addressed all your comments https://github.com/canonical/cloud-init/pull/61 and re-tested with FreeBSD 10, 11 and 12. Bonus point, I've pushed two extra fixes for minor issues.20:15
GoneriI'm totally confident the branch can be merged.20:15
meenaI'll be testing it in a minute.20:18
Odd_BlokeGoneri: Nice!20:18
GoneriI'm uploading the refresh qcow2 images20:19
Odd_BlokeGoneri: Looks like a pyflakes failure on #6120:27
Gonerinaahh, it's impossible!20:37
* Goneri takes a look20:37
Odd_BlokeGoneri: Also it looks like you haven't migrated your CLA signature over to GitHub yet.20:38
Odd_BlokeGoneri: https://cloudinit.readthedocs.io/en/latest/topics/hacking.html tells you how to do that (TL;DR: use tools/migrate-lp-user-to-github)20:39
GoneriOdd_Bloke, https://github.com/canonical/cloud-init/pull/13320:42
meenaGoneri: i got a stacktrace.20:59
meenaGoneri: ah, yeah, makes sense. https://gist.github.com/c4201008d52bc1bab7bd9cc81d21795621:04
Gonerimeena, lets me guess IPV6 with CIDR notation?21:05
meenalemme show you ;)21:05
Odd_BlokeIf we know IPv6 isn't supported yet, is that a blocker?21:06
Gonerinot really, I will just add a skip if netmask is null21:07
Odd_BlokeOK, cool.21:07
meenaGoneri: you should skip everything that's None ;)21:09
meena"review" https://github.com/canonical/cloud-init/pull/61#pullrequestreview-33493345621:12
Gonerimeena, https://github.com/goneri/cloud-init/commit/3e6a1199031d9477ddd8d33234023f942a2ba79f21:17
blackboxswGoneri: per https://github.com/canonical/cloud-init/pull/133  I'm missing a correlating launchpad branch for you. and I expected the PR message was going to be something other than goneri as the username21:17
Odd_Blokeblackboxsw: I closed out the MP.21:18
Odd_Blokeblackboxsw: And what do you mean by "something other than goneri as the username"?21:18
GoneriI'm confused too :-X21:18
blackboxswthat mp is open21:19
Odd_BlokeThat's a PR.21:19
Odd_BlokeI closed the MP.21:19
blackboxswok nevermind, you were on it Odd_Bloke21:19
blackboxswI was expecting to see a branch in LP authored by21:20
blackboxswGonéri Le Bouder21:20
blackboxswwhich I didn't realize mapped to goneri :)21:20
Odd_Blokeblackboxsw: https://code.launchpad.net/~goneri/cloud-init/+git/cloud-init/+merge/377008 :)21:20
blackboxswand since I saw no branch over there I thought maybe it was an accidental wrong username supplied21:20
meenaGoneri: IPv4 could also be in CIDR notation.21:20
blackboxsw+1 Odd_Bloke Goneri ... don't mind me21:20
meenaor? do we need to back-calculate it then?21:21
Gonerimeena, the existing code base does not support IPv4 CIDR notation, so it's not a regression.21:23
Goneriand it's a corner case anyway, I doubt it happens often :-)21:27
meenadoes any of the other renderers handle it?21:29
Odd_BlokeIf it's not supported on FreeBSD in the current codebase, I think we can land this PR without it.21:30
Odd_Blokemeena: Do you disagree?21:30
meenaOdd_Bloke: aye, makes sense given that nothing much is supported in the current code base.21:30
Odd_BlokeCool. :)21:31
Odd_Blokemeena: Goneri: So are we good to merge #61 (after an up-to-date CI run, of course)?  Or do you want to do another round of testing?21:34
meenai'll do another reboot and see what it does :O21:35
meenaalso, can someone tell me why cloud-init would refuse to run my runcmd section?21:35
GoneriI'm confident we won't see a horde of FreeBSD users coming on this channel in the coming days21:35
GoneriI've to go, I will be back later today.21:35
blackboxsweither, already ran on that instance (not per boot),  bad yaml, or disabled runcmd in /etc/cloud/cloud.cfg(.d/*cfg) ?21:38
meenablackboxsw: could be bad yaml…21:39
meenablackboxsw: https://gist.github.com/90f3ea89f4339d2297a9f5a356e04b8d21:40
blackboxswmeena: try this:     sudo cloud-init query userdata > myud.yaml; cloud-init devel schema -c myud.yaml --annotate21:40
blackboxswit'll quickly vet your yaml at least21:41
blackboxswruncmd.   <- the dot21:41
blackboxswhrm nope ... sorry : it was offscreen for me on the laptop21:41
meenablackboxsw: i'm thinking it's - # these comments probably don't work21:42
meenayupp. that's what it is.21:43
meenaCloud config schema errors: runcmd.2: None is not valid under any of the given schemas, runcmd.5: None is not valid under any of the given schemas, runcmd.8: None is not valid under any of the given schemas21:44
meenalines 2, 5, and 8 are comments21:44
blackboxswooh interesting. hrm. that schema is defined so validation was attempted.21:45
Odd_BlokeLines 2, 5 and 8 are empty list items followed by comments.21:45
Odd_BlokeIf the comment marker was before the -, everything would be fine.21:46
blackboxswI see, word wrap was making that hard to read for me21:46
meenaso the damage is self-inflicted.21:47
blackboxswahh and meena I'd also expect to see something like 2019-12-19 21:43:05,262 - util.py[WARNING]: Failed to shellify .... into /var/lib/cloud/instances/loved-seal/scripts/runcmd21:47
meenalet's see.21:47
blackboxswin your /var/log/cloud-init.log21:47
meenai'm pretty, and sure, i've posted the logs; but let's try again.21:48
blackboxswit would be nice if we bubbled up warnings to cloud-init status --long21:48
meenablackboxsw: also, i'd expect that to be a slightly higher error level, so you know you fucked.21:48
blackboxswyeah fairly. though cloud-init walks a line and tries not to be fatal if some components are not run. runcmd may not be critical to the operation of the node. but it certainly is a case where the user should be alerted21:49
meenablackboxsw: maybe it'd be cool if *i* could decide if runcmd is critical or not…21:50
blackboxswmeena: heh truly21:50
meenayeah, so cloud-init status only gives us errors: https://gist.github.com/126df102d581a75572fff2c74eb69b0f21:51
blackboxswyeah meena, it only bubbles up errors, it doesn't queue and raise warnings21:51
blackboxswand I think it may only bubble up one error (not all of them)21:51
blackboxswso there is improvement to be had there21:53
blackboxswit's worth a bug on runcmd not being rendered, at least we could raise the warning to error21:54
blackboxswand it's also a place that is a source of many many human-introduced errors21:55
meenai don't have a WARNING failed to shellify blah, cuz it's failing earlier. (i reckon)21:55
meenaI'll post the logs maybe you can read them easier.21:55
Odd_Blokemeena: I'm heading out now, but I'll check back in later because I'd love to get #61 landed.  If Goneri returns, could the two of you decide if we're good to go and ping me to let me know?21:59
meenaOdd_Bloke: ok, cool — thanks for all the help22:03
smoserblackboxsw: https://bugs.launchpad.net/cloud-init/+bug/1801364 is fix-released ?22:16
ubot5Ubuntu bug 1801364 in cloud-init "persisting OpenStack metadata fails" [Undecided,Fix committed]22:16
blackboxswsmoser: should be as of 19.2-53-g067516d7b22:18
blackboxswwhich is Xenial ++22:19
smoserso that bug should be Fix Relased22:19
smoser not Committed ?22:19
smosersomehow it got missed22:19
blackboxswsmoser: ahh right, I think this could be due to the shift to github. yes. I'll scrub the bug list that's been released and confir,22:20
blackboxswconfirm even22:20
meenai'm happy with Goneri's patch. but I'll add another patch to beautify the code a bit.22:34
blackboxswok found 44 bugs released in 19.2 or later. only 17 or which were fix released.22:56
blackboxswI'm running a script now to close them out as fix released with the appropriate comment about the expected cloud-init version that released them22:56
blackboxswok script complete, if anyone notices bugs in fix committed state that should be fix released please let us know. I'm adapting our release and publishing scripts to try to account for this gap.23:04
blackboxswthanks for the pretty red and green label colors OddBloke. I'm getting into the Christmas Spirit23:34
blackboxswotubo: if you get a chance in the next few days please run:     ./tools/migrate-lp-user-to-github otubo otubo       # to correlate your launchpad user to github user accounts23:38
meenaopened a fresh PR for Goneri: https://github.com/goneri/cloud-init/pull/223:39
meenaGoneri: https://github.com/goneri/cloud-init/pull/2 some æsthetics.23:56
* meena → bed.23:56

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!