/srv/irclogs.ubuntu.com/2020/03/10/#cloud-init.txt

Odd_Blokerharper: blackboxsw: I'd really like us to resolve the FFE/landing new things logjam today.  AIUI, we have two changes that we would like to land in focal before release, both of which have PRs open.  https://github.com/canonical/cloud-init/pull/114 isn't ready to land, but https://github.com/canonical/cloud-init/pull/214/ is.14:17
Odd_Blokeblackboxsw: What are we waiting on for #114?  CI is failing, is fixing that all we need?14:18
Odd_BlokeActually, #214 is Approved, CI is passing and the FFE has been granted, so I've just landed that.14:22
Odd_BlokeBetter to ask forgiveness etc.14:22
rharperOdd_Bloke: +1 on landing14:49
rharperOdd_Bloke: AIUI,  I was just looking for confirmation that we'll land whatever in master, and cherry pick into focal, and next ubuntu/devel new-upstream-snapshot will just need to drop the cherry picks (as patches) as the snashot will contain those;    I'm being lazy hoping someone else confirms;  but I could step through that process on local branches and make sure the tools DTRT14:51
Odd_Blokeblackboxsw: Given our earlier conversation, I think https://github.com/canonical/cloud-init/pull/211 can now get a +1 from you?16:06
blackboxswOdd_Bloke: yes I think we can, wrapping up a meeting. and we are starting the next meeting16:17
blackboxsw #startmeeting Cloud-init bi-weekly status16:20
blackboxswHello and welcome to another cloud-init community status meeting.16:20
blackboxswour IRC channel topic carries the next planned status meeting for those that wish to participate.16:21
blackboxswAll are welcome and interruptions encouraged16:21
blackboxsw#chair rharper Odd_Bloke smoser16:22
blackboxswLet's try that again16:22
blackboxsw#startmeeting Cloud-init bi-weekly status16:22
meetingologyMeeting started Tue Mar 10 16:22:58 2020 UTC.  The chair is blackboxsw. Information about MeetBot at http://wiki.ubuntu.com/meetingology.16:22
meetingologyAvailable commands: action commands idea info link nick16:22
blackboxswHello and welcome to another cloud-init community status meeting.16:23
blackboxswour IRC channel topic carries the next planned status meeting for those that wish to participate.16:23
blackboxswAll are welcome and interruptions encouraged16:23
blackboxsw#chair rharper Odd_Bloke smoser16:23
meetingologyCurrent chairs: Odd_Bloke blackboxsw rharper smoser16:23
blackboxswPrevious meeting notes are here16:23
blackboxsw#link https://cloud-init.github.io/status-2020-02-18.html#status-2020-02-1816:24
blackboxswhe topics we cover in this meeting are the following: Previous Actions, Recent Changes, In-progress Development, Community Charter, Upcoming Meetings, Office Hours (~30 mins).16:24
blackboxsw*the even16:24
Odd_Blokeo/16:24
blackboxsw#topic Previous Actions16:24
blackboxsw\O16:24
blackboxswsorry, have my big head on16:24
tribaalo/16:24
blackboxsw:).    Last meeting had no actions carried over. So I think this topic is a noop this week16:25
blackboxsw#topic Recent Changes16:25
blackboxswrecent changes landed in tip of master via git log --since 2020-02-18  https://paste.ubuntu.com/p/sJVpvjFbPj/16:26
blackboxswwe've added some tooling/actions for github, ec2 IMDSv2 token redacting from logs, alloowing kernel cmdline to tell cloud-init network-config=disabled  and not falling back to IMDSv1 on Ec2-proper platform16:27
blackboxswthanks fred-lefebvre for the ec2 IMDS fallback branch and others for some additional driveby doc updates16:28
blackboxswAlso, we performed an upload to Ubuntu Focal (20.04) series with latest tip of cloud-init to make sure the development release is up to date with recent features16:29
blackboxswUbuntu Focal release is currently in feature freeze, so that will affect what patches we pull into Ubuntu Focal at this time as 'new features' would need a Feature Freeze Exception during the stage of Ubuntu development.16:30
blackboxsw#link https://wiki.ubuntu.com/FocalFossa/ReleaseSchedule16:30
blackboxswAs Odd_Bloke alluded to just before this meeting, we are trying to keep tip of master16:31
blackboxswopen for commits.16:31
blackboxswOn the ubuntu-side of the house we will sort cherry picking bug fixes into ubuntu focal during this short feature freeze period of time16:32
blackboxswIf there are significant features that your cloud platform really would like to see on the first public release of Ubuntu Focal, then please get ahold of us in channel of on the mailing list to suggest that we shepherd those features in during this freeze.16:33
blackboxswBut, generally cloud-init team will continue to follow the SRU process to get updates into Focal after feature freeze is lifted.16:33
blackboxswand again, our SRU test/verification process for Ubuntu will continue to target Xenial, Bionic, Eoan and Focal series for the updates we plan to make in the near future16:35
blackboxswone thing to note in recent changes as well is that we've now added the ability to query distro, kernel, cpu arch, python runtime version and and merged cloud-config to cloud-config jinja templates. So #cloud-config  userdata can be opinionated based on your target distribution or runtime environment.16:37
blackboxsw#link https://cloudinit.readthedocs.io/en/latest/topics/instancedata.html#format-of-instance-data-json16:37
blackboxswI think that about wraps recent changes16:37
blackboxsw#topic In-progress Development16:37
blackboxsw#link https://github.com/canonical/cloud-init/pulls16:38
blackboxswour active pulls above is probably the best source of info on features/bugfixes in flight.16:38
blackboxswThough behind the scenes we have held a couple of meetings to determine how much more automation/tooling  we need to clean up to improve our github developer process16:39
blackboxswI think Odd_Bloke and I have around 4 PRs that we are hoping to clean up to get a couple of things in place:16:39
blackboxswforemost I believe Odd_Bloke is scrubbing the github review process PR so that we have a good starting point for expectations for every developer, author or committer.16:40
blackboxswI think ultimately the goal there is to make sure committers can provide a set of expectations on active PR reviews to PR authors, so that active developers get better prioritized reviews.16:42
blackboxswwe are going to add and enable a number of github actions and workflows that should do the following:16:42
blackboxsw  - age PRs and add labelling to indicate to reviewers and authors that a review needs attention or it will be automatically closed (after around 4 weeks of languishing)16:43
blackboxsw-  label/notify steps to signed the contributor license agreement if unsigned16:43
blackboxsw- run addtional integration tests on active PRs in CI16:44
blackboxswnot sure if I am I missing anything else there.16:45
blackboxswbut ideally we'd like to find a process that helps upstream unblock PRs and get review comments faster16:45
blackboxswso, it'll be an iterative process16:45
blackboxswand thanks for the reviews and suggestions so far on https://github.com/canonical/cloud-init/pull/160 as it is the first cut at trying to document the process16:46
tribaalNice!16:47
blackboxswwoot. the hope I believe is to land that this week as well as branches like https://github.com/canonical/cloud-init/pull/164 https://github.com/canonical/cloud-init/pull/236 and  https://github.com/canonical/cloud-init/pull/12516:48
blackboxswadditionally a gap that we still have vs when we hosted in Launchpad, is our auto-merge Launchpad bug commenting/maintenance:16:49
blackboxsw We still have a need for the following:16:49
blackboxsw  - comment on LP bugs linking to an open github PR16:49
blackboxsw - comment on merged commitish in github and Fix Commited state when a PR lands in upstream16:49
blackboxswso we'll be tackling that too in order to make upstream maintainers happier and better advertise fixes to bug filers16:50
blackboxswright now that's all a manual process since we haven't retooled our bug-related tooling16:50
blackboxsw#topic Community Charter  and upcoming meeting16:51
blackboxswlet's set the status meeting for next session16:52
blackboxswoops and I realize only now that I blew it this week due to daylight savings... meeting wasn't 'supposed' to start until 25 mins from now : /16:52
blackboxsw#topic cloud-init pull-requests https://git.io/JeVed | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting March 1 16:15 UTC | 19.4 (Dec 17) drops Py2.7 : origin/stable-19.4 | 20.1 (Feb 18) | https://bugs.launchpad.net/cloud-init/+filebug16:53
=== blackboxsw changed the topic of #cloud-init to: pull-requests https://git.io/JeVed | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting March 1 16:15 UTC | 19.4 (Dec 17) drops Py2.7 : origin/stable-19.4 | 20.1 (Feb 18) | https://bugs.launchpad.net/cloud-init/+filebug
blackboxswthat's better.16:53
AnhVoMSFTit says March 1, is that correct?16:53
=== blackboxsw changed the topic of #cloud-init to: pull-requests https://git.io/JeVed | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting March 24 16:15 UTC | 19.4 (Dec 17) drops Py2.7 : origin/stable-19.4 | 20.1 (Feb 18) | https://bugs.launchpad.net/cloud-init/+filebug
tribaalthere :)16:54
blackboxswhah, good I got another participant16:54
blackboxsw:)16:54
AnhVoMSFTUK will also have their own daylight savings March 29th I believe16:54
blackboxswsorry AnhVoMSFT tribaal :)16:54
blackboxswyeah this time of year always messes with timing. We try to set things in terms of UTC to avoid thrashing16:54
blackboxswbut even that fails due to human error (my bad)16:55
blackboxswOther community charter tasks are generally categorized in bugs labelled bitesize16:56
blackboxsw#link  https://bugs.launchpad.net/cloud-init/+bugs?field.tag=bitesize16:56
blackboxswgeneral topics for this year were tasks that are easily done in parallel, such as json schema addtions and datasource readthe docs updates/corrections and fleshing out.16:57
blackboxswjsonschema example is here for review if anyone wants to take a stab at testing it out. or extending schema for other config modules.https://github.com/canonical/cloud-init/pull/15216:57
blackboxswand again all cloud-init contributors are encouraged to review/comment any active cloud-init PRs  @ https://github.com/canonical/cloud-init/pulls  the more voices, the better the quality16:58
blackboxsw#topic Office Hours (next 30 mins)16:58
blackboxswDuring this topic, please bring up any questions, discussions, bugs or features or paper cuts that need attention. there should be a couple of cloud-init developers with eyes on the channel to actively respond.16:59
blackboxswjust before the start of this meeting Odd_Bloke was asking about getting the pytest branch landed for cloud-init. (moving off of nosetests as the project is EOL/unmaintained)17:00
tribaalthat's nice. pytest is becoming the de-facto standard these days anyway17:00
blackboxswyeah, didn't want to get stuck using something that becomes unsupported or unsupportable. we don't have the bandwidth in this project to maintain stacks that aren't being looked at by the collective internet ;)17:05
Odd_Blokeblackboxsw: I believe that branch is now only blocked on you removing your "Request changes" review now that we've established that we don't need to hold off on landing things for Feature Freeze.17:05
tribaalmakes total sense :)17:05
blackboxswOdd_Bloke: do you know if rharper did the new-upstream-snapshot into focal already17:05
blackboxswto have a 'clean slate' for the pytest branch landing17:05
Odd_Blokeblackboxsw: We can new-upstream-snapshot from an older commit, I don't believe that's a blocker.17:06
blackboxswOdd_Bloke: not a blocker, but I could do that now as it's 5 mins17:06
blackboxswthen we can land right aftr17:07
blackboxswsound good? I see nothing queued https://launchpad.net/ubuntu/focal/+queue?queue_state=3&queue_text=cloud-init17:07
Odd_BlokeSure, if you're happier doing that. :)17:08
blackboxswI aam :)17:09
blackboxswok doing that right now17:09
blackboxswthen we can start the cherry picking just after17:09
blackboxswOdd_Bloke: I'm adding this as the debian/changelog section title17:10
blackboxsw  * New upstream snapshot: bug-fix-only feature-freeze-exception17:10
blackboxswinstead of   * New upstream snapshot:17:11
blackboxswsound reasonable?17:11
Odd_BlokeIt isn't bug-fix-only because we have the FFe for a non-bugfix.17:11
Odd_BlokeI was just reading the wiki page that suggested wording, I think, let me take a look.17:12
blackboxswhttps://github.com/canonical/cloud-init/pull/24117:13
blackboxswahh right, reviewing that now17:13
blackboxswyeah not quite sure how to handle our FFe uploads17:13
Odd_BlokeOh, if it's only that change, then I don't think we need anything specific in the changelog.  We have an FFE bug that we're closing with that upload.17:14
* blackboxsw re-reads https://wiki.ubuntu.com/FreezeExceptionProcess17:14
Odd_BlokeAnd that means it's _definitely_ not bug-fix-only, there isn't a single bugfix in there. ;)17:14
blackboxswok that sounds good, will just keep the New upstream snapshot17:14
blackboxswok thanks for the review. redoing.17:14
Odd_BlokeHopefully I'm right and you don't get yelled at. :p17:14
powersjbetter to upload and ask for forgiveness...17:15
blackboxswehh, unlikely :) it seems like steve and others have been pretty lax about changelog text (or manipulating it after the fact) :)17:15
Odd_BlokeCool, I'll do the same thing locally to review.17:15
blackboxswOdd_Bloke: force pushed17:16
blackboxswhttps://github.com/canonical/cloud-init/pull/241/files17:16
Odd_Blokeblackboxsw: Approved.17:16
blackboxswthanks Odd_Bloke17:17
blackboxswbuild-and-pushing it up17:17
blackboxswok onto your pytest branch now17:18
blackboxswwhile I await the ubuntu "accepted" response email17:18
blackboxsw  Uploading cloud-init_20.1-10-g71af48df-0ubuntu1.dsc: done.17:20
blackboxswjust waiting on review/acceptance17:21
blackboxswcommunity-notice: tip of cloud-init published into Ubuntu Focal (20.04) [ubuntu/focal-proposed] cloud-init 20.1-10-g71af48df-0ubuntu1 (Accepted)17:22
blackboxswok Odd_Bloke merged at long last https://github.com/canonical/cloud-init/pull/21117:26
blackboxswnosetest is dead, long live pytest17:26
Odd_Bloke\o/17:26
Odd_Blokeblackboxsw: https://github.com/canonical/cloud-init/pull/239 <-- another small one for you17:27
blackboxswapprove Odd_Bloke and thanks. it is waiting on you for merge (and CI completion)17:29
blackboxswworks on my focal box17:30
blackboxswwhich was broken before17:30
blackboxswOdd_Bloke: https://github.com/canonical/cloud-init/pull/164 is ready for you I think (labeling  in cron)17:33
blackboxswfor CLA ! CLA.17:33
blackboxswor do we want that PR to actually ignore certain paths (like doc changes) as not-requiring CLA17:33
Goneriblackboxsw, could you take a look at https://github.com/canonical/cloud-init/pull/62 Pleaaaase :-)17:43
blackboxswGoneri: yes, and so sorry about that.17:44
Gonerinp, and Yeah! for pytest :-D17:44
blackboxsw... and that about wraps up on our cloud-init status meeting. :) I'll close it out and post the minutes for next time17:44
blackboxsw#endmeeting17:45
meetingologyMeeting ended Tue Mar 10 17:45:01 2020 UTC.17:45
meetingologyMinutes:        http://ubottu.com/meetingology/logs/cloud-init/2020/cloud-init.2020-03-10-16.22.moin.txt17:45
blackboxswok minutes published to cloud-init.github.io should be up sson17:46
blackboxswsoon17:46
meenasweet mother of glob, it's Tuesday already18:39
Odd_Blokeblackboxsw: I've approved https://github.com/canonical/cloud-init/pull/164 and have just rebased it. :)18:42
blackboxswthanks Odd_Bloke I'll watch CI and land when complete18:42
tribaalmeena: scary isn't it?18:50
meenawhat a week / month18:52
* meena is now doing the mom at home thing, and my partner is back to work18:53
blackboxswmeena it is crazy how much the the being at home thing affects us all :). if I didn't have a calendar invite telling me it's tuesday, I'd never know what day it was.19:07
meenai had an appointment today (well, the baby did) so i was out, and i should've known which day it is, but since then it feels like another two days could've gone by19:08
blackboxswheh it's tough on disrupted sleep too I bet19:19
blackboxswOdd_Bloke: rharper: just confirmed the ec2 redacted token fix that landed is good on latest ec2 cloud-images for cloud-init 20.1.9 and Fred's not falling back to IMDSv1 is in on ec2-proper good shape too.19:20
blackboxswjust double checked since that landed in our previous new-upstream-snapshot before the FFe today and cloud-images looked updated19:21
rharperblackboxsw: nice19:22
sarnoldblackboxsw: do you have a link handy for that fix?19:25
Odd_BlokeWe're seeing intermittent CI failures during cloud tests.  For example, https://travis-ci.org/canonical/cloud-init/jobs/660756966.  An educated guess is that we're taking too long to download lxd images due to bandwidth constraints, but I don't know that for sure.19:26
blackboxswsarnold: you mean the fix to avoid falling back to IMDSv1 on true ec2 clouds?20:18
blackboxswhttps://github.com/canonical/cloud-init/commit/1f860e5ac7ebb5b809c72d8703a0b7cb3e84ccd0 for the above20:19
sarnoldblackboxsw: hmm, I meant the redacted tokens in the json20:19
blackboxswahh one sec20:19
blackboxswsarnold: https://github.com/canonical/cloud-init/commit/fa639704f67539d9c1d8668383f755cb0213fd4a20:19
sarnoldblackboxsw: cool, thanks20:20
blackboxswno problem.20:20
rharperOdd_Bloke: so, paride reported iso tests failing due to snapd.seeded issues once again20:32
rharperOdd_Bloke: I would suspect it's the same for those images with lxd as snap20:32
blackboxswsarnold: also FWIW, I just launched a focal minimal VM via an IAM profile and re-enabled security-credentials crawling to validate that that sensitive key is properly redacted for non-root user by runnning cloud-init query --all | grep redact | pastebinit   https://paste.ubuntu.com/p/874pcvn326/20:36
rharperahosmanMSFT: I tested your https://github.com/canonical/cloud-init/pull/206 today; and it needed just a bit more to keep the instance around;  without the extra changes when the snapshot and image get torn down in my testing20:37
Odd_Blokerharper: Aha, good point.20:38
Odd_BlokeAnother small tox PR: https://github.com/canonical/cloud-init/pull/24221:17
Odd_Blokeblackboxsw: I noticed a slight issue with the CLA workflow which is fixed in https://github.com/canonical/cloud-init/pull/24321:30
blackboxswcool Odd_Bloke can you add a trello card + PR link there for tracking please?21:31
blackboxswso if I don't get to it we can make sure to wrap it up tomorrow early21:31
* blackboxsw is in omg need more trello cards mood at the moment21:32
Odd_Blokeblackboxsw: Why don't you assign yourself? :p21:33
blackboxswheh21:33
blackboxswcan do21:33
Odd_Blokerharper: Were those snapd.seeded issues happening on xenial, do you know?21:38
rharperno21:38
rharperbionic and newer21:38
rharperlxd is still a deb in Xenial AFAIK21:38
Odd_BlokeOK, so probably not the source of our CI issues, as that should be running xenial.21:38
rharperah, ok21:39
blackboxswcreated my needed trello card... and the world is right again21:39
Nick_Awhat would be the best way to get cloud-init to add "critical: true" to every interface it sticks in netplan on ubuntu?22:31
sarnoldohai Nick_A :)22:33
Nick_Ahey22:33
Nick_Awhat channels are you not in?22:35
sarnoldI ask myself that every day ..22:35
powersjNick_A, a bug would be a good start22:53
powersjI don't think our network config handles that, but rharper can confirm22:54
rharperNick_A: in the case that you provide netplan as  network-config to cloud-init we pass-through this config to the OS;  we do not tag any interface with critical: true as we don't know that it is (except in iscsi-root scenario, where we do mark the iscsi interfaces a critical-connection)22:58
blackboxswrharper: just confirmed ec2 doesn't provide classless static routes via dhcp responses.  so  I *think* incrementing route-metric is unneeded23:06
blackboxswwill pull it from my branch23:06
rharperblackboxsw: ok23:08
blackboxswrharper: pastebin coming to confirm with you23:09
blackboxswhttps://paste.ubuntu.com/p/zrFtx7S7Ct/23:10
rharperblackboxsw: yes, agreed23:10
blackboxswI think the ec2 networkd dhcp internal response representation lacking "ROUTES" means no classless routes are used for multiple  nics23:10
blackboxswok goo23:10
blackboxswgood even. and goo23:11
blackboxswok will have ec2 ready for review tomorrow. touching up unit test now23:11
blackboxswand will file the related FFe bug23:13
blackboxswfor ubuntu inclusion in focal23:13

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!