/srv/irclogs.ubuntu.com/2020/06/05/#cloud-init.txt

=== vrubiolo1 is now known as vrubiolo
=== hggdh is now known as hggdh-msft
smoser1hey. if someone other than me wanted to look at14:01
smoser1 https://github.com/canonical/cloud-init/pull/413#pullrequestreview-42532727614:01
smoser1i'd appreciate it. i dont like giving people the runaround . if someone else is happy withthe existing PR then i'm fine too.14:02
=== smoser1 is now known as smoser
AnhVoMSFTugh I hate the github UI when posting comments - @Odd_Bloke I was trying to respond to your comment and somehow did cancel review by mistake and all my comments wiped14:38
Odd_BlokeAnhVoMSFT: UGH, bummer.14:41
AnhVoMSFTi posted my comment, happy to discuss further here if you would like14:44
AnhVoMSFTPR: https://github.com/canonical/cloud-init/pull/36914:44
AnhVoMSFT@OddBloke What we have been seeing from some of our investigation into some of the latency issue during boot is slow DHCP response from DHCP server. The output of dhclient's stderr was the one that helped nailed it. In particular, we could see multiple DHCPREQUEST from dhclient (due to DHCP server being overloaded and not responded timely to the first DHCPREQUEST). In addition, we also14:44
AnhVoMSFTsaw cases where DHCPOFFER was posted, but then DHCPACK arrived too late, which triggered dhclient to re-send DHCPREQUEST, etc...14:44
AnhVoMSFTSo yes, even in the successful case, you could tell how many attempts it took for dhclient to actually negotiate the dhcp leases successfully. Ideally we would want to see a timestamp PER message of dhclient, but this is only available through journalctl (unless we stream the stderr pipe to cloud-init.log, which is going to be not trivial how the current code is setup)14:44
AnhVoMSFTI do agree we should log both success and failed path - I left a comment there about it as well.14:44
smoserOdd_Bloke: thanks for comment on #41314:56
smoserwe really ought to make subp return a named tuple14:57
smoserwith exit_code, out, err14:57
smoseror otherwise at least return exit code. because if you pass rcs= then it gets lost14:57
falcojrdo we have something like "lxc-proposed-snapshot" but lets you pass in an arbitrary deb? I'm wanting to run cloud init in a VM based off a particular commit16:47
falcojrs/VM/container16:50
smoserit feels like i've done that before...16:52
smoserfor sure you can point it at a ppa and it wil do the right thing16:52
smoserslower for sure16:52
smoserfalcojr: https://git.launchpad.net/ubuntu/+source/open-iscsi/tree/debian/tests/patch-image16:54
smoserthats where i've done it before...16:54
smoseryou shoudl add that to patch-image (which lxc-proposed-snapshot calls). and then it'd be functional in either lxc-proposed-snapshot or get-proposed-cloudimg16:56
smosersorry. above, s/patch-image/uipdate-root/16:56
falcojrinteresting, I'll have to play with that16:57
falcojrthanks16:57
smoseryeah.. so it looks like you'd have to add the "copy debs" stuff in lxc-propsoed-snapshot and get-proposed-cloudimg16:57
smoserand then add some '--install-debs' or '--install-debs-dir' to update-root16:57
smoserthanks for your work on cloud-init. from this point of view it looks like you're doing great.16:58
pleusmannHI. I am trying to use cloud-init with CentOS 7. I need to use it for network-config: I need to get the ip for an interface by DHCP, but I need to manually set the nameservers.18:38
pleusmannI added a network-config in /etc/cloud/cloud.cfg.d/ but it seems to get ignored. In the logfile I see it being written to the ifcfg-script but there are no nameservers set :(18:40
pleusmannSorry, I cannot paste the exact config easily as I am on a vmware console. I used networks v2, with ethernets, dhcp: true and addresses for two nameservers18:42
pleusmannIs there anything I have to care about?18:44
pleusmannIt would also be fine for me to not have managed network by cloud-init, but disable-networking also doesn't have a noticeable effect.18:44
Odd_Blokerharper: Updated https://github.com/canonical/cloud-init/pull/391/ to address your comments _except_ for the pass to see if we can use any existing libraries instead of our own homegrown code, I'll do that now.19:00
rharperOdd_Bloke: ok, cool19:05
rharperpleusmann: can you share your v2 config you'd like to deploy with (or something similar) ?19:06
pleusmannOdd_Bloke: I have to share a screenshot: https://ibb.co/SXDpnSS19:09
rharperpleusmann: looking19:13
rharpergood enough19:13
lucasmourablackboxsw, I am working on the nic manual testing for ec2 instances and I fought that having at least 3 nic would make the test better. However, it seems that the t2.micro does not support more than 2 network interfaces19:13
powersjyaml and spaces...19:14
lucasmouraAn error occurred (AttachmentLimitExceeded) when calling the AttachNetworkInterface operation: Interface count 3 exceeds the limit for t2.micro19:14
lucasmouraShould we choose another machine or testing with only 2 network interfaces is enough ?19:14
powersjlucasmoura, fwiw here are the limits: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-eni.html19:15
powersjrharper, does that yaml look valid? or should ens160 be one more space in?19:15
rharperpowersj: I think it's valid;19:16
blackboxswlucasmoura: for testing if you'd like to test 3 nics I think you can do t2.small for your test19:16
lucasmourapowersj, thanks for the info =)19:17
lucasmourablackboxsw, ack19:17
blackboxswand lucasmoura bringing up a bigger instance temporarily to validate specific tests is ok as far as costs, we just don't want to leave bigger instances running long19:18
rharperpleusmann: ah, that's right;  since you have DHCP configured, cloud-init does not render DNS entries ;;; the expectation is that DNS info will be provided by DHCP response19:18
pleusmannrharper: It provides the wrong ones :(19:19
rharpercan you use static ip instead ?19:19
pleusmannnope19:19
rharperok, so netplan does allow for dhcp-overrides section , I don't think cloud-init net rendering checks for dhcp-overrides when rendering different outputs though;19:21
rharperyou would want: to add a dhcp4-overrides: {'use-dns': 'false'}19:21
rharperbut cloud-init isn't yet looking at dhcp overrides so that it would properly emit the dns entries that are being ignored19:22
pleusmannOk, I understand I am on an edge case and hopefully will get that dhcp-server fixed. Nevertheless I guess the usecase is valid. Hope you can put it on the backlog19:23
rharperpleusmann: please do file a bug if you have time19:23
pleusmannrharper: Where is your bug database?19:28
meenapleusmann: in the topic19:30
rharperhttps://bugs.launchpad.net/cloud-init/+filebug19:30
pleusmannfound it. thx19:32
blackboxswlucasmoura: review on your chef schema for monday https://github.com/canonical/cloud-init/pull/375#pullrequestreview-42555864819:37
lucasmourablackboxsw, ack19:37
* blackboxsw goes down the active review queue for cloud-init the rest of the day (checking SRU PRs too)19:37
lucasmourablackboxsw, is it xenial that we should check the network config on a different path than /etc/netplan/50-cloud-init.yaml ?19:58
blackboxswfalcojr: did you see that rharper already had a pr up for this https://trello.com/c/Jk4enIi0/43-09fea85fhttps-gitlaunchpadnet-cloud-init-commit-id09fea85f-1870421http-padlv-1870421-net-ignore-renderer-key-in-netplan-config-320:01
blackboxswwas that what you referred to in standup?20:01
blackboxswI just landed PR https://github.com/cloud-init/ubuntu-sru/pull/10020:02
blackboxswwhich I think mapped to that test20:02
falcojryeah, that's what I mentioned this morning20:03
blackboxswlucasmoura: yes xenial should be /etc/network/interfaces.d/50-cloud-init.cfg20:03
blackboxswfalcojr: ok I'll put that rharper guy on that card and mark it done.20:03
blackboxsw:/20:03
blackboxsw:)20:03
rharperblackboxsw: =)20:03
rharperI need to grab another one,  but I can't see the board20:03
blackboxswrharper: yeah I mentioned that in standup, we might want to open up that board and make it public given that we have an amazing cloud-init community helping with SRUs ;)20:04
rharperblackboxsw: hehe20:04
blackboxswnot sure how to go about that at the moment.20:04
rharperyeah, no worries about the board;  if you tag me in here with the bug, I can work through a few at a time20:05
blackboxswwill take it up w/ rick_h and team on Monday  to see what folks think. in the meantime, some that look good for rharper:20:08
blackboxswsru verification requests: https://git.launchpad.net/cloud-init/commit/?id=46cf23c2 and https://git.launchpad.net/cloud-init/commit/?id=723e2bc120:09
blackboxswfigured storagey would be good ?20:09
rharperack20:10
pleusmannrharper: https://bugs.launchpad.net/cloud-init/+bug/188230020:11
ubot5Ubuntu bug 1882300 in cloud-init "not possible to override dns servers when using dhcp" [Undecided,New]20:11
rharperpleusmann: cool, thanks20:12
pleusmannwill cloud.cfg somehow be rewritten on first boot after installation of cloud-init? I added disable-network-config directives to the end of the file, but they are gone after first boot. on subsequent boot they seem to persist20:27
pleusmann"network-config=disabled" kernel parameter doesn't seems to be respected, BTW20:28
rharperpleusmann: cloud.cfg files are not removed/overwritten; it's a permanent config;20:34
rharperpleusmann: typically, network-config is provided by platforms on a per-instance basis;  so on OpenStack or Ec2 or Azure, cloud-init queries the metadata service for a network-config that describes the config for this instance20:34
rharpermore static datasources, like NoCloud or ConfigDrive, include a network-config in their meta-data;  but statically; it has to be available locally (as a file, part of the datasource attached to the instance)20:35
rharperpleusmann:  there was a recent bug w.r.t the kernel cmdline disable, you have to base64 encode it on older versions of cloud-init (not sure what you're running right now)20:36
rharperif you're on centos7, you might try out our daily rpm builds to see if things are working better  there, https://copr.fedorainfracloud.org/coprs/g/cloud-init/cloud-init-dev/20:36
pleusmannI am preparing a vsphere template. later they a running "nocloud", but I experience this behavior when running the initial container. no non-local datasources attached20:37
rharperwell, nothing in cloud-init itself deletes files in /etc20:37
rharperso not sure what you're seeing20:37
rharperhttps://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/186270220:38
ubot5Ubuntu bug 1862702 in cloud-init (Ubuntu) "cannot disable cloud-init networking despite trying hard" [Medium,Fix released]20:38
pleusmannrharper: Do I get it right, that "network-config=disabled" only works in quite recent builds, but base64-encoding the yaml-equivalent works in older releases?20:42
rharperpleusmann: for kernel command line, yes20:43
pleusmannOk. Thanks. Probably I'll just get that damn DHCP-Server fixed ;)20:44
pleusmannThanks for your help, anyway20:44
lucasmourablackboxsw, should we terminate the instance after performing the test ? Currently, the ec2-sru template does not do that, but is there is a reason for not terminating ?20:45
falcojrblackboxsw: where did you get those issues you just gave to rharper ?20:46
falcojrI'm not seeing them on our board and I thought our board had everything we had accounted for after being scrubbed20:46
blackboxswfalcojr: I grabbed them from https://github.com/cloud-init/ubuntu-sru/pull/100https://trello.com/c/Jk4enIi0/43-09fea85fhttps-gitlaunchpadnet-cloud-init-commit-id09fea85f-1870421http-padlv-1870421-net-ignore-renderer-key-in-netplan-config-3 and I put rharper's head on them, but I was going to chat with you lucasmoura and Odd_Bloke to see if we want to keep spinning out separate cards for each item in that20:49
blackboxswverification list or just assign each item from that verification checklist and "check" the checkbox once a PR lands related to it?20:49
blackboxswfalcojr: Odd_Bloke lucasmoura what would you prefer, ejecting each item to separate cards in the SRU Verification lane, or separate cards we can mark as closed20:51
blackboxswsorry my cut-n-paste leaves a lot to be desired: if you open up the card https://trello.com/c/g8Wf4n6c/9-create-trello-cards-for-each-commit-that-could-represent-a-functional-change-to-ubuntu  you can see rharper's avatar on 2 checklist items20:52
falcojryeah, I just found the card cause that was a fun link :D20:53
blackboxswdo you prefer this approach to allocating ownership, or "convert to card" to kick that item out of the list20:53
blackboxswI want to cut down on pointy clicky work related to this, so whatever's easier. And we'll talk post SRU with rick about the biggest pain points with this SRU (as it's a big one) to see how we can make this process easier/simpler20:54
falcojrsince we can put our heads on checklists, I'm fine with just the checklist, but don't have strong opinions either way20:54
Odd_BlokeI'm happy to follow what you folks decide.20:54
lucasmouraI am fine with the checklist as well20:54
blackboxswyeah the heads on checklists is a newer trello feature. ok let's do that, and when the PR is merged, we'll just tick the checklist item20:54
blackboxswthen the lane stays smaller20:55
* falcojr thumbs up20:55
blackboxswand we have less copying20:55
blackboxswthx20:55
falcojrand you pruned this list already, correct?20:55
falcojrgeez, I thought we were almost done with the manual tasks20:55
rharpertwo paths, manual platform tests, and then *per bug fix* verification20:56
rharperthe latter is the long pole since the previous SRU was  a while back20:57
blackboxswlucasmoura: review on https://github.com/cloud-init/ubuntu-sru/pull/99/files#diff-92de51f24fc6c44bb6d06af7734d8e34R34-R45 for monday21:08
blackboxswfalcojr: I did, but you have plenty of room to question whether something sounds like it may not need a verification test.21:08
blackboxswI'm thinking we can punt anything that generally should be execised by typical cloud-init successfully completing without WARNING/traceback in normal boot logs.21:09
blackboxswfalcojr: as soon as I'm through SRU reviews I'll re-prune that list from top to bottom to see if I can eject any more from our SRU process21:10
blackboxswfalcojr: lucasmoura biggest/most critcal for SRU verification are the big cloud manual verification test runs21:11
blackboxswabove and beyond the individual verification21:11
blackboxswbecause failure to succeed on cloud boot/upgrade/verification affect all VMs not just ancillary  features (and would result in us blocking the current SRU and respinning the upload with a fix)21:12
blackboxswWhereas, with these individual feature verifications, if we find a bug in the feature during SRU validation, we have been known to categorize that as something which doesn't have to block the SRU and we can work it after the SRU is completes.21:15
blackboxswalso I'm going to start grabbing items from this queue today too.21:23
blackboxswfalcojr: minor change request for https://github.com/cloud-init/ubuntu-sru/pull/101#pullrequestreview-42563589421:29
blackboxswjust to link all extra verification work to that SRU top-level readme21:29
blackboxswand we'll land it21:29
blackboxswlucasmoura: were you working on [70dbccbb](https://git.launchpad.net/cloud-init/commit/?id=70dbccbb) [#1876312](http://pad.lv/#1876312) DataSourceEc2: use metadata's NIC ordering to determine route-metrics (#342) ?21:30
blackboxswor something slightly different21:30
lucasmouraI am, but not on the individual SRU test21:30
lucasmouraboth on the ec2 instance directly21:31
lucasmourausing the ec2-sru template for testing it21:32
blackboxswsorry I don't follow?21:32
blackboxswahh you are doing that as part of extending the ec2 manual cloud test template?21:32
lucasmourayes21:32
blackboxswok then, I'll take my face off that card, since it sounds like you are going to tackle part of that in the manual Ec2 test.21:33
blackboxswand I'll grab a different item21:33
lucasmouraOkay21:33
=== Odd_Bloke changed the topic of #cloud-init to: Migration to travis-ci.com in progress, PR merges blocked until Monday | pull-requests https://git.io/JeVed | Meeting minutes: https://goo.gl/mrHdaj | Next status meeting June 16 16:15 UTC | 20.1 (Feb 18) | 20.2 (Apr 28) | https://bugs.launchpad.net/cloud-init/+filebug
Odd_Blokepowersj: If you're around, you might have the permissions on the repo to change the status check which blocks PRs from the old Travis CI one to the new Travis CI one; that would fix the issue I just updated the topic with.22:06
powersjOdd_Bloke, any idea where I would go to do that?22:07
powersjI see a webhook for travis-ci.org22:07
smoserhttps://github.com/canonical/cloud-init/pull/41622:18
smoserit passes tox -e py322:18
smoserbut dont know more than that at the moment.22:18
blackboxswholy moly. smoser going for karma :)22:20
=== hggdh-msft is now known as hggdh
blackboxswfalcojr: landed https://github.com/cloud-init/ubuntu-sru/pull/101 thx23:05
powersjOdd_Bloke, I changed the status check, but I see 2x Travis CI builds on my PR23:21
powersjOdd_Bloke, actually this looks right now: https://github.com/canonical/cloud-init/pull/418 so we'll need to re-check old merge requests23:25

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!