[01:39] <compufreak> I have a script that pulls the machine name from /var/lib/hyperv/.kvp_pool_3 and I'd like to use that as the hostname during cloud-init-local step. What's a normal place to put this? cloud-init pulls regular user-data from a network service
[01:41] <compufreak> seems like maybe vendor-data but not sure where to put it
[13:20] <Odd_Bloke> meena: Yeah, AFAIK NoCloud is a cloud-init thing.
[13:22] <Odd_Bloke> compufreak: vendor-data comes from the same source as user-data; it is intended to handle the case where there is cloud-config that a cloud vendor would like applied to every instance (e.g. mirror configuration, NTP, etc.) while still allowing the user to (a) specify user-data, and (b) _disable_ vendor-data if they want.
[13:23] <Odd_Bloke> So probably not what you're looking for in this instance.
[13:29] <Odd_Bloke> compufreak: Your best bet may be to configure cloud-init with `preserve_hostname: true` (https://cloudinit.readthedocs.io/en/latest/topics/modules.html#set-hostname) and a bootcmd (https://cloudinit.readthedocs.io/en/latest/topics/modules.html#bootcmd) which runs your script.
[13:41] <compufreak> hmm, thanks, I'll take a look!
[13:45] <smoser> compufreak: is that hyperv but not azure (or azure on-prem)?
[13:46] <smoser> if its azure, then we should make azure datasource do the right thing.
[13:46] <smoser> if its something else, then Odd_Bloke did a good job of describing a solution.
[13:50] <compufreak> yeah this isn't azure but has some similar mechanics--it's running directly on hyperv (just a pet project)
[13:51] <compufreak> afaik azure hypervisor is a customized version of hyper-v
[13:52] <compufreak> although hyper-v key-value pair through the data exchange integration could be an interesting data source
[13:54] <compufreak> not sure if there's much interest in hyper-v, but here's some notes https://gist.github.com/nijave/f323eb1756933b968b70f0cb951ea619 (the altaro link has a lot of details)
[13:55] <compufreak> you can actually create a socket through vmbus hyper-v provides so you could make a psuedo-network service that works without the VM having a network connection
[13:56] <Odd_Bloke> Oh, that's cool.
[14:05] <smoser> compufreak: i'm pretty sure cloud-init uses that on azure to post logs.
[14:07] <smoser> yeah, see push_log_to_kvmp/report_compressed_event
[14:59] <Odd_Bloke> compufreak: How are the key/value pairs in .kvp_pool_3 determined, do you know?
[15:05] <amansi26> blackboxsw:I need to clarification about: https://bugs.launchpad.net/cloud-init/+bug/1894839    I am using preserve_hostname: false and did a capture deploy, the VM hostname is expected as the name associated with IP, or the name using which we deployed the VM
[15:05] <ubot5> Ubuntu bug 1894839 in cloud-init "hostname not getting set as per the dns" [Undecided,New]
[15:25] <compufreak> Odd_Bloke: see https://www.altaro.com/hyper-v/key-value-pair-data-exchange-3-linux/
[15:26] <compufreak> Odd_Bloke: basically there's 4 "pools" host->guest (read-only) host->guest rw, and vica-versa and the files are fixed field size kv pairs with nul byte padding
[15:39] <rs_goyal__> I am using centos7/8 standard images(https://cloud.centos.org/centos/) to created an instance and openstack is the datasource. I am trying to push a shell script  via vendor data, the script gets copied in `/var/lib/cloud/instance/scripts/vendor/script` but does not get run on the boot up. The same works for other distributions like ubuntu/fedora etc. From the cloud-init logs I was able to see that, it did not
[15:39] <rs_goyal__> run the script in final stage. Let me know if someone has any idea on this.
[16:08] <blackboxsw> amansi26: preserve_hostname: false means cloud-init will set hostname to whatever metadata says the hostname should be. If True, it means it'll leave the hostname whatever it is already configured to in the image.
[16:13] <Odd_Bloke> compufreak: Right, I read through that; my questions are more: what determines the contents of pool 3 on the host side?  Is it reliably similar across Hyper-V deployments?  Does it change across versions of Hyper-V?  Can admins modify (all of?) it?
[16:15] <Odd_Bloke> rs_goyal__: Are you able to pastebin cloud-init.log?
[16:18] <blackboxsw> #startmeeting cloud-init status meeting
[16:18] <meetingology> Meeting started Tue Sep  8 16:18:47 2020 UTC.  The chair is blackboxsw. Information about MeetBot at http://wiki.ubuntu.com/meetingology.
[16:18] <meetingology> Available commands: action commands idea info link nick
[16:19] <blackboxsw> #chairs smoser Odd_Bloke rharper falcojr lucasmoura
[16:19] <blackboxsw> hey folks. welcome to another public cloud-init status meeting
[16:19] <blackboxsw> disclaimer: interruptions and side conversations are welcome
[16:19] <blackboxsw> We use this platform/channel to discuss latest and greatest cloud-init, as well as ensuring that there are a couple of upstream developers present to field questions or discussion as needed.
[16:20] <blackboxsw> We gather here in this IRC channel every 2 weeks to discuss current development tasks and progress on cloud-init.
[16:20] <blackboxsw> Previous meeting minutes are here;
[16:20] <blackboxsw> #link https://cloud-init.github.io/status-2020-08-25.html#status-2020-08-25
[16:20] <blackboxsw>  The topics we'll cover today: Previous Actions, Recent Changes, In-progress Development, Community Charter, Office Hours (~30 mins).
[16:21] <blackboxsw> I expect today will be short as the entire Canonical team is involved in cloud-init SRU verification for Ubuntu at the moment
[16:21] <blackboxsw> #topic Previous Actions
[16:22] <blackboxsw> last meeting had an action item we needed to resolve
[16:22] <blackboxsw>  bbsw add workitem to SRU release process to announce to mailinglist estimated next SRU timeframe.
[16:24] <blackboxsw> this item can be resolved as I've added the content requested to our email template which will be sent out once this SRU completes.
[16:24] <blackboxsw> I see no other actions from last meeting
[16:25] <blackboxsw> #topic Recent Changes
[16:26] <blackboxsw> The following are upstream commits landed in cloud-init's master branch:
[16:26] <blackboxsw> #link https://paste.ubuntu.com/p/NgqncRMG9c/
[16:28] <blackboxsw> In the last couple of weeks we cut the upstream 20.3 release (thanks everyone for all the help there).  Queued SRU uploads for ubuntu/xenial, bionic and focal release testing.
[16:28] <amansi26> blackboxsw: metadata here will be the configdrive, if my understanding is right?
[16:30] <blackboxsw> And added some goodness to systemd units and ordering (sort systemd cloud-init-local.service hv_kvp_daemon and systemd: add Before=shutdown.target when Conflicts=shutdown.target is
[16:30] <blackboxsw>       used )
[16:30] <blackboxsw> thanks paride and robjo for those commits
[16:30] <blackboxsw> amansi26: +1 you can see the metadata configured hostname from cloud-init query local-hostname I think
[16:30] <blackboxsw> amansi26: +1 you can see the metadata configured hostname from `cloud-init query local-hostname` I think
[16:30] <blackboxsw> amansi26: I was just starting to respond to your bug you linked too
[16:31] <blackboxsw> I think preserve_hostname: false (which is cloud-init's default behavior )  means cloud-init will read that hostname from metadata and apply it to the system
[16:31] <amansi26> Sure. there is another bug which I observed on a RHEL8 environment: https://bugs.launchpad.net/cloud-init/+bug/1894837
[16:31] <ubot5> Ubuntu bug 1894837 in cloud-init "RHEL8 ipv4 IPs not getting set" [Undecided,New]
[16:35] <blackboxsw> amansi26: sorry cloud-init query local_hostname   (# not with a hyphen)
[16:35] <blackboxsw> checking 2nd bug
[16:38] <blackboxsw> so amansi26 you'd like the ability to override the iface_defaults on rhel systems for NM_CONTROLLED to set  True instead of false for cloud-init interfaces?
[16:40] <blackboxsw> generally if cloud-init is rendering network configuration on an instance, it tries to avoid using network manager by default. I think it's worth requesting logs on  your bug
[16:40] <blackboxsw> those cloud-init logs can be obtained using cloud-init collect-logs (which generates a tar.gz file in the current working directory). then attach that to the bug
[16:41] <amansi26> yes, since I was reading the documentation for RHEL8 network configuration, I found that NM_CONTROLLED = yes should be there. but we are passing the value as No.  Sure I will attach the logs to the defect
[16:43] <blackboxsw> thanks amansi26 I responded on that bug too
[16:46] <blackboxsw> Ok, per the meeting,  that wraps #recent-changes topic I believe
[16:46] <blackboxsw> #topic In-progress Development
[16:48] <blackboxsw> Currently the Canonical team is working hard on SRU verification so we can release cloud-init v. 20.3 to Xenial, Bionic and Focal. It looks like we are done with most major cloud verification and walking through individual verification items.
[16:50] <blackboxsw> I believe falcojr mentioned this morning we are about 5 of 30ish verification items complete.
[16:50] <blackboxsw> we are continuing to work this verification as our top priority
[16:50] <blackboxsw> folks interested should subscribe to updates on our SRU bug
[16:51] <blackboxsw> #link https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1893064
[16:51] <ubot5> Ubuntu bug 1893064 in cloud-init (Ubuntu) "sru cloud-init (20.2-45 to 20.3-2) Xenial, Bionic, and Focal" [Undecided,In progress]
[16:53] <blackboxsw> that bug will transition to verification-complete once all verification is done
[16:54] <blackboxsw>  #topic Community Charter
[16:54] <blackboxsw> The following topics are still topics for ongoing community development anyone new to cloud-init, or with a bit of time could easily grab one of these bitesized tasks:
[16:54] <blackboxsw>  JSON schema extensions to validate user-data before instance launch: https://bugs.launchpad.net/cloud-init/?field.tag=bitesize
[16:54] <blackboxsw> - cloudinit.net refactor into distro-specific networking subclasses cloudinit.distros.networking: https://bugs.launchpad.net/cloud-init/+bugs?field.tag=net-refactor
[16:54] <blackboxsw> If anyone would like to be involved more than they currently are, please feel free to contact us here in IRC #cloud-init on Freenode or on the mailing list cloud-init@lists.launchpad.net and we can see how best we can get you "set up"
[16:54] <blackboxsw> #topic Office Hours (next ~30 mins)
[16:55] <blackboxsw> this time of the meeting is really just an open door for any discussions, concerns, bugs, questions or general prodding of upstream devs to make sure existing development work is unblocked where possible.
[16:55] <blackboxsw> in absence of discussions. We actually will be focused on SRU verification tasks today.
[16:56] <blackboxsw> each of these verification logs and scripts are pushed as pull requests  to https://github.com/cloud-init/ubuntu-sru/pulls
[17:13] <blackboxsw> ok I think that about wraps today's session. Next meeting will be in two weeks, but we'll likely see you in channel earlier.
=== blackboxsw changed the topic of #cloud-init to: pull-requests https://git.io/JeVed | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting Sept 22 16:15 UTC | 20.3 (Aug 25) | https://bugs.launchpad.net/cloud-init/+filebug
[17:13] <blackboxsw> #endmeeting
[17:13] <meetingology> Meeting ended Tue Sep  8 17:13:31 2020 UTC.
[17:13] <meetingology> Minutes:        http://ubottu.com/meetingology/logs/cloud-init/2020/cloud-init.2020-09-08-16.18.moin.txt
[17:14] <blackboxsw> ok just published minutes
[17:14] <blackboxsw> the should show up here in a few mins: https://cloud-init.github.io/
[17:23] <lucasmoura> Hey everyone, I am trying to manually test the following PR, but it seems that I will need to pass a custom datasource to set the region in a way that ec2 regex will match. Is there an easy way to provide a custom datasource using cloudinit ?
[17:24] <lucasmoura> I have looked at the NoCloud datasource, but it seems even using it I would need to pass a kernel cmdline to pass a location where cloudinit will download the metadata files
[17:24] <lucasmoura> So maybe there is a more straightforward approach on this situation
[18:02] <meena> Odd_Bloke: if we're responsible for NoCloud… then we should document it… i wanted to write better… but given how poorly it is documented right now, anything would be better. We should also provide canonical ;))) tooling for it.
[18:02] <meena> just a thought
[18:18] <minimal> meena: Hi, just caught the end of your conversation. What's the documentation issue with NoCloud? I've been using it quite a bit and don't remember noticing any omissions in the docs
[19:47] <blackboxsw> falcojr: just put up focal openstack https://github.com/cloud-init/ubuntu-sru/pull/154
[19:47] <blackboxsw> SRU verification
[19:47] <blackboxsw> I'll hit the open reviews now
[20:30] <lucasmoura> Is anyone having any trouble with the cloud-init-dev/proposed ppa ? I am trying to add it, I get the following error: ERROR: '~cloud-init-dev' user or team does not exist
[20:30] <lucasmoura> But looking at the ppa page, it seems fine
[20:30] <blackboxsw> no ~ I think
[20:31] <blackboxsw> yeah  ppa:cloud-init-dev/proposed
[20:31] <blackboxsw> lucasmoura: but also, we should be using -proposed directly
[20:31] <lucasmoura> No error when you run add-apt-repository ppa:cloud-init-dev/proposed -y ?
[20:32] <blackboxsw> https://paste.ubuntu.com/p/wpW3RtMCMZ/ not for me
[20:32] <lucasmoura> Forget it, I think I now what is happening. I doing a manual verification that messes the network-config. That is the reason :facepalm:
[20:33] <blackboxsw> lucasmoura: https://github.com/cloud-init/ubuntu-sru/pull/153#discussion_r485169456 is what I was referring to
[20:33] <blackboxsw> isntead of the cloud-init-dev/ppa
[20:34] <lucasmoura> blackboxsw, ack
[20:45] <Odd_Bloke> blackboxsw: falcojr: lucasmoura: paride: FYI I just accidentally pushed to ubuntu-sru master and force-pushed back to the correct HEAD of master.  (You should be fine if you haven't fetched in the last ~3 minutes.)
[20:51] <meena> minimal: i don't know what to tell ya, for something that documents a standard / protocol, i find it lacking. same with the tooling. we don't provide any.
[21:09] <minimal> meema: for tooling that's what cloud-utils is for