/srv/irclogs.ubuntu.com/2018/02/16/#cloud-init.txt

=== hrybacki is now known as hybacki|mtg
=== hybacki|mtg is now known as hrybacki
stanguturiHi, Is this correct channel for the bi-weekly meeting for 18.1 or do I need to login in any other channel. Thans.16:01
blackboxswstanguturi: absolutely. probably going to start it in a couple minutes16:01
stanguturiok Great. Thanks.16:01
blackboxswok here goes16:04
blackboxsw #startmeeting Cloud-init bi-weekly status meeting16:04
blackboxswhey folks thanks for joining in to another cloud-init biweekly status meeting16:04
blackboxswthe early meeting day this week is to avoid hitting the upcoming US holiday on Monday16:05
blackboxswThis meeting is probably going to be short, but we wanted to generate any discussion around the release we have scheduled for next week. I'll go through the following topics16:05
blackboxswrecent changes, In-progress development, Release 18.1 Discussion, Office hours (30 mins)16:06
blackboxswWithout further ado...16:06
blackboxsw#topic Recent changes16:06
* blackboxsw is sad I don't think meetingology is logging this meeting16:07
naccblackboxsw: i saw a leading space in #startmeeting16:07
naccnot sure if it matters16:07
blackboxswahh nacc I'll try again16:07
blackboxsw#startmeeting Cloud-init bi-weekly status meeting16:08
meetingologyMeeting started Fri Feb 16 16:08:08 2018 UTC.  The chair is blackboxsw. Information about MeetBot at http://wiki.ubuntu.com/meetingology.16:08
meetingologyAvailable commands: action commands idea info link nick16:08
blackboxswmuch better thanks nacc16:08
naccblackboxsw: yw16:08
blackboxsw#topic Recent changes16:08
blackboxswCloud-init upstream team has been working on an SRU for Artful and Xenial.16:08
blackboxswWe discovered a couple of SRU-blocking bugs on EC2 as well as cloud-init subcommands so we've landed a couple of fixes there which are queued for SRU now16:09
blackboxsw* cloud-init status --wait blocks until all stages complete (LP: #1747965)16:09
blackboxsw* SRU EC2 upgrade path fix for 'systemctl restart cloud-init.service' (LP:1748354)16:09
blackboxsw* Fix ds-identify nocloud detection with bind mounted writable/system-data directory (LP: #1747070)16:09
blackboxsw* Tests: include missing unitests in python2.6 environments. Fix py2.6 incompatilibilies16:09
ubot5Launchpad bug 1747965 in cloud-init (Ubuntu) "cloud-init status reports done before boot is finished" [High,Fix released] https://launchpad.net/bugs/174796516:09
ubot5Launchpad bug 1747070 in cloud-init "ds-identify does not see nocloud seed in core snap" [Medium,Fix committed] https://launchpad.net/bugs/174707016:09
blackboxsw* Fixed centos cloud-init build and test tooliing16:11
blackboxsw* SUSE: Fix groups used for ownership of cloud-init.log [RobertS]16:12
blackboxswthanks folks for continuing to push on quality of cloud-init releases.16:12
smosero/ thanks for starting blackboxsw16:12
blackboxswnot sure if I'm missing any other content that has landed in the last week and a half16:13
blackboxswI also think powersj rharper may have sorted a couple of issues with storage on our common CI on Jenkins16:14
blackboxsw#link https://jenkins.ubuntu.com/server/view/cloud-init/16:14
powersjYes CI is up and running again, I have more defensive statements in to prevent us from running out of storage16:14
* blackboxsw is not sure, are there rumors we might have more hardware dedicated to jenkins in the future powersj ?16:15
powersjWe do, however it is our jenkins master that runs out of storage :\16:15
blackboxswahh gotcha, SPOF16:15
powersjyeah16:16
blackboxswok, if no other work is 'complete'; let's  jump topics16:16
blackboxswahh forgot ryan landed16:16
blackboxsw    net: accept network-config in netplan format for renaming interfaces16:16
blackboxswper LP: #170971516:17
ubot5Launchpad bug 1709715 in cloud-init "cloud-init apply_net_config_names doesn't grok v2 configs" [Medium,Confirmed] https://launchpad.net/bugs/170971516:17
blackboxsw#topic In-progress Development16:18
blackboxswSo we are working toward quality on the 18.1 release for next week.16:18
blackboxswUbuntu specifically is finalizing verification on cloud-init 17.2.35  update for Xenial and Artful series (expectation is that this SRU will be public in 1 week).   17.2.35 is a snapshot of tip from a couple days ago16:19
blackboxswwe've also published tip of cloud-init master to bionic to keep the development release up to date with latest cloud-init16:20
blackboxswcurrent ongoing work as always is on our trello board. we tried tidying up the cards a bit16:20
blackboxsw#link https://trello.com/b/hFtWKUn3/daily-cloud-init-curtin16:20
blackboxswwe have upcoming branches for a new snap cloud-config module for configuring and maintaining snap packages16:21
rharperhttps://bugs.launchpad.net/cloud-init/+bug/174972216:21
ubot5Ubuntu bug 1749722 in cloud-init "NTP: take into account systemd-timesyncd where present" [Medium,In progress]16:21
rharperI'm actively working on that16:21
blackboxswthis snap work will obsolete snappy and snap_config modules, so expect that they'll be deprecated. in 18.1 and dropped completely in 18.216:22
smoserhttps://code.launchpad.net/~rski/cloud-init/+git/cloud-init/+merge/31228416:22
smoseri just moved that back into review16:22
blackboxsw#link https://bugs.launchpad.net/cloud-init/+bug/174972216:22
smoserhope to take a lookc at it today.16:22
blackboxsw#link https://code.launchpad.net/~rski/cloud-init/+git/cloud-init/+merge/31228416:22
blackboxswso per rharper's; chrony will be first class citizen in cloud-init16:23
blackboxswper cards in our trello board TODO lane, any card above the 18.1 release card (and anything in Doing/Review  lane) is something we want to land in the 18.1 release16:26
blackboxsw... next topic so we can talk about release16:26
blackboxsw#topic cloud-init version 18.1 release (2/23/2018)16:27
blackboxswnext thursday we want to cut tip of cloud-init with any features we want to fold into the 18.1 release16:27
blackboxswthis point in the meeting is a good opportunity for us to discuss features and bugs that any folks think are a priority for this release16:28
blackboxswsmoser we saw some talk about archlinux support/updates, do we know whether we've gotten any updates about gaps/needs/bugs there?16:29
stanguturi@blackboxsw: I have two requests. One for the merge request and one about the bug.16:29
smoserblackboxsw: i've not seen any more than that developer asked about here in the channel.16:29
stanguturi@blackboxsw: Let me know if I can post my questions here or discuss them offline.16:30
blackboxswstanguturi: please do discuss here. open forum :)16:30
blackboxswif it gets too long a discussion, we can take it to your branch or email16:30
blackboxsw#link https://code.launchpad.net/~sankaraditya/cloud-init/+git/cloud-init/+merge/33773616:31
blackboxswfor reference right ?16:31
stanguturi@blackboxsw: Thanks. I have a merge request posted at https://code.launchpad.net/~sankaraditya/cloud-init/+git/cloud-init/+merge/33773616:31
stanguturiWant this to get into 18.1 It's a low-risk fix. Should not break anything.16:31
stanguturiAlso, found a bug in ds-identify . https://bugs.launchpad.net/cloud-init/+bug/174998016:32
ubot5Ubuntu bug 1749980 in cloud-init "ds-identify doesn't properly detect ISO" [Undecided,New]16:32
blackboxswok just glancing at your branch now stanguturi looks fairly straight forward, and as always I'd like to see some unit tests covering that changeset16:32
stanguturi@blackboxsw: We already have unit tests for DataSourceOVF. This actually doesn't add any new functionality. The existing test cases should be sufficient enough.16:33
blackboxswwe have existing unit tests in tests/unittests/test_ds_identify.py which should be easy to extend for the additional detection16:33
blackboxswin ds-identify16:33
blackboxswyeah I was thinking more about ds-identify specifically16:34
blackboxswall said though, that branch looks low-risk and we can probably get that landed before release.16:35
blackboxswI'll add a card to trello for us to shepherd that in.16:35
stanguturi@blackboxsw: Great. Thanks.16:35
stanguturi@blackboxsw: Also I have a question about https://bugs.launchpad.net/cloud-init/+bug/1749980 Any inputs will be great.16:36
ubot5Ubuntu bug 1749980 in cloud-init "ds-identify doesn't properly detect ISO" [Undecided,New]16:36
blackboxsw#link https://bugs.launchpad.net/cloud-init/+bug/174998016:37
blackboxswlooking16:37
blackboxswohh good stanguturi we'll sort that bug and either provide more information on this16:38
blackboxswfor that bug discussion, let's move it to the "office hours" topic which comes up next16:38
blackboxswI'd like smoser rharper to peek at that too16:38
stanguturi@blackboxsw: Ok. Sure. Thanks16:38
blackboxswany other topics, branches or bugs that folks are itching to get in for 18.1 release?16:39
blackboxswkpcyrd: any opdates or concerns on archlinux that you are aware of currently?16:41
smoserstanguturi: you can run a command there now ?16:42
blackboxswlet's transition to office hours now16:42
smoser2 things16:42
blackboxsw#topic Office hours (next ~30 mins)16:42
stanguturi@smoser: Sorry. Didn't quite get the question.16:43
blackboxswAnd thanks all for joining. Any burning questions, bugs, branches that need discussion can be brought up now.16:43
stanguturi@smoser: Oh. Are you asking if I can run any commands in my virtual machine right now.? Yeah. Sure.16:44
smoserstanguturi: can you run stuff int hat system ?16:44
smosera.) cat /run/cloud-init/ds-identify.log16:44
smoserb.) idstr="http://schemas.dmtf.org/ovf/environment/1"16:44
smosergrep --quiet --ignore-case "$idstr" /dev/sr016:45
smosergrep --quiet --ignore-case "$idstr" /dev/sr0 && echo y || echo n16:45
smoserstanguturi: basically the 'is_cdrom_ovf' should have gone down the path into that grep of the cdrom block device16:46
stanguturi@smoser: grep --quiet --ignore-case "$idstr" /dev/sr0 returned "grep: /dev/sr0: Input/output error"16:48
stanguturi@smoser: grep --quiet --ignore-case "$idstr" /dev/sr0 && echo y || echo n returned "grep: /dev/sr0: Input/output error and then new line and then n'16:48
meetingologystanguturi: Error: No closing quotation16:48
blackboxswheh thanks meetingology16:48
stanguturi@smoser: Actually, read_fs_info doesn't DI_ISO9660_DEVS in my system. and because of this, dscheck_OVF returns DS_NOT_FOUND.16:50
smoserstanguturi: what release are you on ?16:51
stanguturiTrying it on 17.04 zesty desktop16:51
stanguturiand tried with top of the tree code in cloud-init.16:52
smoserstanguturi: could you potentially let me in via ssh ?16:56
stanguturi@smoser: Sorry. It's on my private network. Will not be able to provide ssh.16:57
stanguturi@smoser: We can do a webex conference if you want.16:58
smoserstanguturi: can you ssh out of the node ?17:03
stanguturi@smoser: Yes.17:03
smoserok. /query window17:07
blackboxswok this triage will continue. if there are no other pressing bugs/concerns, we'll close out this meeting and keep pushing toward 18.1 upstream release next thursday17:11
blackboxswthanks again for your time folks. I'll post these minutes to the cloud-init github page17:11
blackboxsw#link https://cloud-init.github.io17:12
blackboxswnext meeting march 5th same "bat time" same "bat channel"17:17
blackboxsw#endmeeting17:18
meetingologyMeeting ended Fri Feb 16 17:18:00 2018 UTC.17:18
meetingologyMinutes:        http://ubottu.com/meetingology/logs/cloud-init/2018/cloud-init.2018-02-16-16.08.moin.txt17:18
=== blackboxsw changed the topic of #cloud-init to: Reviews: http://bit.ly/ci-reviews | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting: Monday 3/5 16:00 UTC | cloud-init 17.2 released (Dec 14, 2017) | cloud-init 18.1 pending-release (Feb 22)
rharperblackboxsw: thanks!17:22
kpcyrdblackboxsw: I didn't have the time to test it yet. Do you have any recommendations for a test-bed?17:39
kpcyrdalso, if somebody knows somebody at OVH I would be very interested in their custom cloud-init build for archlinux :)17:40
blackboxswkpcyrd: not sure exactly what you are looking for but lxc looks to have an archlinux image:18:21
blackboxsw| archlinux (5 more)            | 03a5245fd014 | yes    | Archlinux current amd64 (20180216_01:27) | x86_64  | 130.49MB | Feb 16, 2018 at 12:00am (UTC) |18:21
blackboxswthat's from 'lxc image list images:'18:21
blackboxswso if you are on ubuntu lxc launch images:archlinux myarch-container might get you setup18:22
blackboxswI'm not sure if cloud-init is installed in that archlinux container image though :/18:24
=== r-daneel_ is now known as r-daneel
blackboxswrharper: smoser ok, so I have a puzzle to ponder for the snap module21:57
blackboxswinstalling snaps on containers requires that squashfuse get installed. so I thought I'd provide the following config21:58
blackboxswhttps://pastebin.ubuntu.com/p/FzXYSJyX2d/21:59
blackboxswI need apt upgrade to run first on an image so I can apt install squashfuse21:59
blackboxswbut uprades are run in cloud-init final stage22:00
blackboxswand I have snap module schedule at module config timefreame22:00
blackboxswany suggestions? though I could just provide snap: {commands: [apt-get update, apt-get install squashfuse]22:01
blackboxswbah and reminds me I needed to bring up again whether we actually want to try limiting snap:commands to only running snappy commands to avoid potential abuse/bad practices22:02
blackboxswor since squashfuse is a known dependency, maybe the snap module should apt update && apt install squashfuse for us if snap configuration is provided22:03
blackboxsw... and we know that we are in a container22:03
smoserblackboxsw: you might not have seen my thread on that.22:14
smoser https://bugs.launchpad.net/ubuntu/+source/squashfuse/+bug/162828922:14
ubot5Ubuntu bug 1628289 in Snappy "snapd should depend on squashfuse (for use in containers)" [Undecided,In progress]22:14
rharperblackboxsw: yeah;  I think it would be OK to install snapfuse if it's not already present and we're in a container22:16
smoserblackboxsw: its busted. dont work around it in cloud-init.22:17
blackboxsw"it's busted"  you mean snappy requiring squashfuse to run in a container?22:18
smoserthe container image should have it.22:18
smoserfor unknown reason snapd does not want to fix that.22:18
smoserhttps://github.com/snapcore/snapd/pull/360522:18
smoserhttps://github.com/snapcore/snapd/pull/285622:19
smoserthey are not able to sru it because it would cause issue (due to an apt bug that would hold snapd rather than grab the new recommends)22:19
rharperlet's raise it again22:19
smoserbut that has no bearing against bionic , where they're just ignoring it22:19
smosersee the second. i asked on jan 1722:19
rharperto kirkland22:19
smoseryou saw my thread, rharper. i raised to Beret22:19
smoserblackboxsw: so cloud-init should not try to fix this broken scenario22:20
smoseri too went down that route which is how i got to know this stuff.22:20
blackboxswok, so cloud-init should expect breakage on lxd platform22:20
rharpersmoser: yes, I'm fine with not working around it, should we at least raise a warning if we detect snap installs and on-container in cloud-init and reference the LP and PRs ?22:21
rharperI'm sorta of the mind that we shove it in for testing for now; it's just much nicer to test cloud-config with lxd22:21
smoserwhats annoying is that if they do not fix it in bionic, then it will have another 2 years (at least) until fixed22:21
smoserhow about this22:21
blackboxswcloud-init may not need logic to forcibly install squashfuse on a container, but we could present an example doc that says this is how to install snaps on a container.22:21
smosera.) do not restrict snap commands to 'snap' ...22:21
blackboxswsmoser my current branch doesn't restrict22:22
smoserb.) warn if snap commands have a arg0 other than snap22:22
blackboxswsure22:22
smoser(to discourage as you suggest)22:22
smoserc.) then we can feed 00_apt: [apt-get, install, -qy, squashfs]22:23
blackboxswand cloudinit module example will list an lxd-supported snap:commands  cloud-config that notes the bug22:23
blackboxswyeah22:23
blackboxswdocs are already in place for this. just wanted to check if we wanted to bake that 'fix' into cloud-init module logic instead of exposing it22:23
smoseri guess i'm even open to taking it another step22:23
smoser snap/install_squashfs: true22:23
smoseror22:24
smoser snap/squashfuse_in_container: true22:24
blackboxswhrm since we know it's a bug, I agree we probably shouldn't bake in a workaround into our new snap module configuration properties. but I can be swayed.22:24
smoseras rharper suggested, for test... its just so useful22:26
smoseryou can document that thing as E_NO_RELY_ON_THIS_TESTING_ONLY22:27
blackboxswsecondary (unrelated) question about snap module:     our old snap_config module ran a "snap managed" check  before trying to create a snap user, I'm planning on an line shell conditional example to check snap managed before "snap known system-user" call to cover this case22:27
smosereven warn if its used.22:27
blackboxsw.. planning an *inline shell conditional documentation example* which would showcase check managed before create user22:27
rharperblackboxsw: I;ve not tried in a while, maybe the create-user does the check now22:29
rharperthat'd be ideal22:29
blackboxswagreed , I'll poke at it22:30
blackboxswok, so back to snaps on lxd for testing. rharper/smoser you are of the mind that snap config module just does the lift for us on containers with a warning message?22:30
rharperblackboxsw: I dunno how I feel about leaving a warning in about brokenness; which we'd need to update;22:31
rharpermaybe in exception handler we could check if incontainer and no squashfuse but that still feels wrong22:31
rharperwe don't really know what container environment we may be in22:31
rharpersome may be privledged and others not22:31
blackboxswvsm22:33
blackboxswoops22:33
blackboxswcan't we know what container we're in checking /run/systemd/container22:34
blackboxswand installing only if that's "lxc"22:34
rharperwell, it's not the container name22:35
rharperit's the capabilities22:35
smoserwait now.22:37
smoseri w was not clear22:38
smosersnap/squasfuse_in_container: false22:38
blackboxswok, hmm. so explicit better than implicit side-effects based on perceived environment I suppose.  Shall we just surface the snap/squashfuse_in_container: true option then?22:38
smoserdefault to false22:38
blackboxswyeah that's easy enough and easy to deprecate that option when that bug is fixed22:38
smoserand use util.is_container22:38
blackboxsw+1 on is_container. BTW I'm adding deprecation warning messages to both snappy and snap_config modules in my snap branch. I wanted to warn existing users that those modules will be removed in 18.222:39
blackboxswsound ok?22:39
smosersure.22:39
* smoser has to run.22:40
blackboxswwhat about snapuser config option under users_and_groups?22:40
blackboxswhave a good one smoser22:40
blackboxswcan talk about this against my branch when I post it22:40

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!