/srv/irclogs.ubuntu.com/2017/09/18/#cloud-init.txt

=== shardy_afk is now known as shardy
=== shardy is now known as shardy_afk
=== shardy_afk is now known as shardy
=== shardy is now known as shardy_afk
=== shardy_afk is now known as shardy
blackboxswhey cloud-init, meeting will probably start a couple mins late16:00
ajorgok16:01
smoserblackboxsw, how do i make the bot start logging ?16:02
dpb1o/16:03
blackboxsw#  meetingology startmeeting16:03
blackboxswhttps://wiki.ubuntu.com/meetingology16:03
blackboxsw# #startmeeting cloud-init status meeting16:03
smoser#startmeeting cloud-init status meeting16:04
meetingologyMeeting started Mon Sep 18 16:04:28 2017 UTC.  The chair is smoser. Information about MeetBot at http://wiki.ubuntu.com/meetingology.16:04
meetingologyAvailable commands: action commands idea info link nick16:04
blackboxswhiya o/16:05
rharpero/16:05
smoser#link https://public.etherpad-mozilla.org/p/cloud-init-meeting16:05
dpb1hello16:05
smoserso that contains a agenda that we'd been following16:06
smoser#link https://lists.launchpad.net/cloud-init/msg00100.html16:06
smosersorry for slow going here.16:07
=== smoser changed the topic of #cloud-init to: Release Preparation
smosershoot16:08
smoser#topic Release Preparation16:08
smoser#subtopic Release Preparation16:08
smoserhm..16:08
smoseranyway16:09
smoser https://lists.launchpad.net/cloud-init/msg00100.html16:09
smoserthat is the primariy point of this meeting for today.16:09
smoserThe goal is to make a release named 17.1 on Thursday of this week.16:09
blackboxswstrange16:09
smoserWe have landed several branches in the last few days, and have 2 more to land at least.16:09
smoserfrom http://bit.ly/ci-reviews16:10
dpb1meetingology │ Available commands: action commands idea info link nick16:10
dpb1something to look into. :)16:10
blackboxsw#link http://bit.ly/ci-reviews16:10
smoserthe two we consider needs to be integrated are16:10
smoser https://code.launchpad.net/~chad.smith/cloud-init/+git/cloud-init/+merge/33087516:10
smoser  https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/33088016:10
smoserand Chad's (the first) is the one we're looking at now.16:11
smoseror that is the one that is non-trivial16:11
smoserdoes anyone here wnat to raise other bugs or MP that they believe should be pulled ?16:11
smoser...16:12
smoserajorg, i think its best to hold off on some of yours until after release.16:12
smoseranyone have anything else ?16:13
blackboxswmsaika (vmware) pinged on a branch a couple days ago.  but I think there is a little of discussion/re-work that's needed there before we land16:13
ajorgsmoser: I assume you mean the instance identity one, in which case I agree.16:13
ajorg(in either case I'd agree)16:13
smoserand simpletable16:13
smoseryeah16:13
smoserok. so that is where we are. we are still targettin a release on Thursday.16:14
smoserother than that, i thinkw e move on to open discussion or office hours16:14
smoser#topic Open Discussion16:14
smoseranyone have anything for this ?16:14
robjoCustomer has run into an issue where we run out of threads during the user script phase, should generally set TasksMax in the service file, i.e. is that of interest upstream?16:14
robjowe are still testing, but that appears to be the solution for this particular problem16:15
smoserrobjo, i dont have an immediate objection to that idea.16:16
smosercould you open a bug ?16:16
robjosure16:16
smoseri dont think that we'd want to pull that change in right now, but it otherwise seems reasonable at frist b lush.16:17
smoseranything else ?16:18
robjoAgreed, do't think this is sufficiently urgent for Thursday's release, it can wait until the next one16:18
ajorgwere there other bugs that we should consider high enough prio to deserve landing a fix in the release?16:19
smoserajorg, the only 2 that i'm aware of are linked in those mp. i can dig the numbers16:20
smoser * bug 171759816:21
ubot5bug 1717598 in cloud-init (Ubuntu) "Traceback when passing user-data on GCE" [High,In progress] https://launchpad.net/bugs/171759816:21
smoser * bug 171762716:21
ubot5bug 1717627 in cloud-init "permission denied when executing dhclient in Ec2 datasource" [High,In progress] https://launchpad.net/bugs/171762716:21
ajorgok16:21
smoserAnything else? other wise i'll call this meeting done and hang around for office hours for the next 30 m inutes at least.16:22
smoserthanks for attending / feedback, robjo and ajorg16:22
blackboxsw#link  https://launchpad.net/bugs/171759816:23
ubot5Ubuntu bug 1717598 in cloud-init (Ubuntu) "Traceback when passing user-data on GCE" [High,In progress]16:23
blackboxsw#linkhttps://launchpad.net/bugs/171762716:24
ubot5Ubuntu bug 1717627 in cloud-init "permission denied when executing dhclient in Ec2 datasource" [High,In progress]16:24
blackboxswjust in case16:24
blackboxswduno whats up with the bot.... again16:24
smoserok. well, lets move on16:27
smoser#endmeeting16:27
meetingologyMeeting ended Mon Sep 18 16:27:32 2017 UTC.16:27
meetingologyMinutes:        http://ubottu.com/meetingology/logs/cloud-init/2017/cloud-init.2017-09-18-16.04.moin.txt16:27
smoseroffice hours now if you have anything16:27
dpb1blackboxsw: bot looks ok, but... it doesn't understand topics16:28
dpb1blackboxsw: it never echos on links or infos, that is normal16:28
ajorgI'm playing with making simpletable output look like prettytable output, even though I think simpletable is prettier16:28
blackboxswpublished minutes will show up at https://cloud-init.github.io/from now on16:29
blackboxswheh ajorg  nice16:29
rharperajorg: lol16:30
ajorgsmoser: I did want you to take another look at the instance identity thing. I think you had your resolution comments backwards16:33
smoserajorg, ok.16:36
smoseri have sense looked at that and the dns is wierd.16:36
smoser$ host why-does-this-exist.ec2.archive.ubuntu.com16:36
smoserwhy-does-this-exist.ec2.archive.ubuntu.com has address 91.189.92.20116:36
smoserwhy-does-this-exist.ec2.archive.ubuntu.com has IPv6 address 2001:67c:1360:8c01::1916:36
smoseri think you showed (and i see elsewhere)16:37
smoser$ host why-does-this-exist.ec2.archive.ubuntu.com16:37
smoserHost why-does-this-exist.ec2.archive.ubuntu.com not found: 3(NXDOMAIN)16:37
ajorgmeaning it's different depending on where we're calling from?16:37
smoseryeah. somewhat. but mostly i was just giving you bad information16:38
smoseri had a canonical VPN up.16:38
smoserand was getting a dns response over that . i just figured this out... shut that down and i get the does not exist16:38
rharpersmoser: you route everything through the VPN right ?16:39
smosernot everything.16:39
smoserbut apparently dns was going there for at lease *canonical16:39
smoserer.. *ubuntu16:39
rharperstrange, I know I'm on a diff setup; but same vpn, and I've never had that host resolve; it always failed to resolve for me (with vpn up)16:39
ajorgah. so in The Real World it probably works the way I think it does?16:40
smoserajorg, right.16:40
smoserat least for now :)16:40
smoserrharper, i'm also using artful. so its possible network manager tied better into systemd-networkd or osmething and got *.ubuntu.com passed to vpn dns16:41
smoseri dont know16:41
rharperyeah;  on an internal system, I can see the wildcard working as you saw16:41
smoserajorg, so we have more thinking to do there. but i unfortunately can't prioritize said thinking right now.16:44
ajorgokay. It can wait. I do hope you'll get back on it soon, because it's one of the more important patches we're carrying.16:45
ajorgwell, that wasn't too hard: http://paste.ubuntu.com/25566740/17:09
ajorgI'll write a unit test or three this week and resubmit that with PrettyTable ripped out completely.17:11
ajorgDo I recall correctly that we're encouraging putting tests next to modules now?17:11
blackboxswajorg: yes please17:16
ajorgthanks, will do17:17
blackboxswif there isn't a tests/ subdir next to your module just add one. post this release I think we'll overhaul the tests in one mega branch and put them all in the 'proper' location17:17
ajorgcool17:21
blackboxswsmoser: commented on https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/33088018:01
blackboxswapprove with a nit18:01
* blackboxsw thought about adding a more significant unit test for main, but I'd ultimately like that to go away anyway with a standardized datasource.crawl_metadata() method (and cloud-init devel crawl subcommand)18:04
blackboxswso I figure why spend much time on covering that main() method w/ tests18:04
blackboxswsince I'd like to see it dropped in a couple weeks18:04
smoserthe mains are debug only anyway18:05
smoserdevloper tools18:05
smoseri took your suggested test cahnge18:05
smoserand committed and pushed18:05
smoserrunnign tox here18:05
blackboxsw+118:22
SachithHi18:41
Sachithanyone here?18:42
* dpb1 hides18:43
rharperdpb1: huh. maybe you shouldn't have hid18:55
dpb1LOL18:55
paulmeysmoser: Re https://code.launchpad.net/~paul-meyer/cloud-init/+git/cloud-init/+merge/33092518:56
paulmeyFrom history we know that some infrastructure updates take at least 5 minutes and may induce transitional failures in the wire server...18:57
paulmeyOf course, that's unacceptable in the provisioning path, which we'll work on separately...18:57
paulmeyI'd like to set the timeout at 900 to be on the safe side of 300+...18:58
paulmeyIs that within the realm of possibilities?18:58
msaikiahi, can anyone take a look at my review request. https://code.launchpad.net/~msaikia/cloud-init/+git/cloud-init/+merge/33010519:03
cjhey folks19:03
cjcan I get help for cloudbase-init here?19:03
cjI'm trying to kick off a jenkins jnlp windows slave, but can't seem to get the user-data I specify with Jenkins' Cloud plugin to execute19:04
powersjcj: do you have access to the logs to see if your user-data had any issues?19:15
cjI think I do.  I'm pretty sure I specified where the logs should live...19:18
cj"msiexec /i C:\\packer\\CloudbaseInitSetup_Stable_x64.msi /qn /l*v c:\\packer\\cbi-log.txt"19:19
cjfrom line 72 of https://gerrit.iotivity.org/gerrit/#/c/21639/41/packer/templates/baseline-win.json19:19
cjor is this just the installation log?19:19
powersjcj: tbh not sure, as I am not 100% certain 1) how much different cloudbase init is from cloud-init and 2) how things get run on windows ;)19:20
smoserpaulmey, i'm willing to defer to you.19:27
paulmeyAlrighty, mp updated19:29
dpb1cj: well19:30
smoserblackboxsw, subp_blob_in_tempfile will need updating19:31
dpb1cj: it's not in tree, and not supported by people here directly.19:31
smoserto /var/tmp/19:31
blackboxswsmoser: yeah I wasn't sure if we wanted that in this branch or not. We could just change temp_utils.tempdir()19:32
blackboxswthen we don't have to change it in all call-sites in the future19:32
smoseror put a define somewhere.19:33
smoserTEMP_EXE_DIR19:33
smoseror something19:33
smoserand then use that from both?19:33
blackboxswwhy would we not want to use it in all cases?19:36
blackboxsw_ROOT_TMPDIR == '/var/tmp'19:36
blackboxswone place to fix, instead of the caller having to know that they want exec perms19:36
dpb1cj: I'd say look here: https://ask.cloudbase.it/questions/, it seems to be their preferred method of Q/A19:36
smoserblackboxsw, i'm not opposed... but it seems good to identify the places that do need exe19:37
smoserbut yeah, you're right in that we'd need also a non root value19:37
blackboxsw?19:37
blackboxswoops typo19:37
blackboxswsmoser: is it worth a param to temp_dir(exec=True) ?19:38
blackboxswwhich then gets sorted19:38
smoseranother option would be to have a kwarg 'needs_exe' or something.19:38
blackboxswyea19:38
blackboxswI'm all for needs_exe, it'll make it explicit for the caller.  and they won't have to deal w/ imports of TEMP_EXE_DIR etc19:39
smoserif you can do that in short term, next hour or so i'm good with that . but for the moment i'm also ok with everything being /var/tmp.  assuming we're reasonably confident that /var/tmp isnt going to be cleaned on boot19:39
cjthanks, dpb119:40
blackboxswsmoser: shall we put unpriveleged users of temp_dir(needs_exec=True) in /var/tmp/cloud-init  or just root19:45
smoserblackboxsw, i think its fine to put unpriv users tehre. we do set the perms so they can , i think. on creation19:46
blackboxsw        os.chmod(tdir, 0o1777)19:46
blackboxswyeah19:46
blackboxswok will do19:47
blackboxswI only need another 20mins I think  on this.19:47
blackboxswwill have a fix19:47
blackboxswadding a couple unit tests now19:48
smoserk. thanks.19:48
smoserblackboxsw, what do you think about https://code.launchpad.net/~paul-meyer/cloud-init/+git/cloud-init/+merge/33092520:29
paulmeyrharper: remind me again where vendor data comes from?20:32
rharperthe cloud metadata service20:32
paulmeyvia the cloud-specific data source?20:32
rharpercloud-init fetches 'user-data' key from the metadata service, it will/can also look for 'vendor-data' ; yeah inside the DataSource20:32
paulmeyok, I don't think Azure currently has that...20:33
paulmeybut it would be good to think about that...20:33
smoserazure does not provide vendor data at the moment.20:34
rharperyeah20:34
paulmeyI'll put it on my wish list20:34
blackboxswsmoser: I guess we're dropping the maxwait default in the Azure data source, so it's a required param now per paul's branch. I only see two callers of that function, so sure.  I'm +1 https://code.launchpad.net/~paul-meyer/cloud-init/+git/cloud-init/+merge/33092520:38
blackboxswIt'd be nice if we had a way to introspect the walinux agent health on this  instead waiting. But, maybe that's the approach we take for now and we improve upon it as time permits20:40
paulmeyit wouldn't look very healthy...20:40
rharperlol20:40
rharperthe health check would block forever ?20:40
paulmeyshowing 503/404 for requests to the wireserver/metadata server20:40
paulmeyor just timing out there...20:41
blackboxswI suppose that's what paulmey means by "I'm working on a fix for this issue." :)20:41
paulmeythe issue is on the host20:41
paulmey:-) sure20:41
paulmeyI should probably have said "I have other teams working on a fix for this issue"20:42
blackboxswhah20:42
paulmeysilent provisioning failures lead to customer support calls20:43
paulmeylong provisioning times and failures just yield bad rep20:43
blackboxsws/bad rep/bad bug reports/20:43
rharperor both20:43
paulmeyyeah20:43
smoserbad rep leads to mean tweets20:44
smosermean tweets lead to executive calls20:44
blackboxswand mean tweets lead to smoser losing sleep20:44
paulmeylol20:44
blackboxswso paulmey if we block waiting on certs and does walinux agent ever fix itself in these cases?20:45
paulmeyYes, it should. Eventually the wire server should be up again.20:46
rharperhrm, we could add a smoser reads mean tweets to the cloud-init meeting agenda20:46
paulmeyThis situation mainly occurs when the wireserver itself is being updated20:46
smoserrharper, once for uds or uos (online) we had the security team read mean tweets20:47
rharperhehe20:47
smoserhttps://youtu.be/4fB94_DndL820:50
smoserblackboxsw, https://code.launchpad.net/~chad.smith/cloud-init/+git/cloud-init/+merge/33087521:02
smoserany status ?21:02
smoseri've got to be running.21:02
smoserwhat i'll do right now is upload trunk to artful21:02
smoserthat will get us the gce fix21:02
smoserand then i'll come back in ~ 4 hours and if you have merged paulmey and your branch i'll grab and upload those too21:02
blackboxswsmoser: yep just finished a patch21:06
blackboxswtook a while to setup the unit tests21:06
blackboxswwrap_and_call issues on my sid21:07
blackboxswfinally pushed to the right branch https://git.launchpad.net/~chad.smith/cloud-init/commit/?id=a3a33b43c3c62b82c30050a78c69a11a5eca8c4021:33
blackboxswwill await CI and run an AWS deploy test on this latest21:34
blackboxswpaulmey: merged your branch and updated the commit message. it should be in our next release (which we are cutting this week)22:10
blackboxswhttps://code.launchpad.net/~paul-meyer/cloud-init/+git/cloud-init/+merge/33092522:10
blackboxswthanks again22:10
paulmeyblackboxsw: thanks!22:11

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!