/srv/irclogs.ubuntu.com/2017/06/02/#cloud-init.txt

rharperit defaults to user fedora  (versus say centos); not sure what the default for the centos6 AMI was00:00
powersjrharper: thx for review that is exactly what I was looking for :)00:41
rharpercool00:46
=== sambetts|afk is now known as sambetts
smoserrharper, ping13:13
smoserwould this be expected to render functional networking ?13:14
smoser http://paste.ubuntu.com/24748335/13:14
rharpersmoser: reading13:40
rharperfirst glance looks sane; I generally run it through curtin apply_net or cloud-init net_convert and see what the eni ends up looking like13:41
=== rangerpbzzzz is now known as rangerpb
rharpersmoser:  this is what curtin renders as eni with that:  http://paste.ubuntu.com/24748563/13:43
smoserbah13:51
smoserhttp://paste.ubuntu.com/24748651/13:51
smoseri ended up figuring it out.13:52
smoserwow.14:12
smoserso that was a large time sync, but ended up verifying this actually works. so thats nice.14:12
rharperoh, if I read that right;' that's nasty;  the vlan got the ens3 name because of the duplicate macs14:17
smoseryeah14:17
dpb1where did duplicate macs come from?  random?14:17
smoserthe .link file that i left around14:17
smoserit renamed the newly created vlan device14:17
smoserand then vlan was like WTH!14:17
smoserrharper, i'm not sure why udev doesn't do this for us14:18
rharperwhat should udev do for us ?14:18
smoserie, we say DRIVERS=="?*"14:18
smoserwhy doesn't udev see the newly created vlan device14:19
smoserand rename it14:19
rharperthe vlan isn't going to generate a udev event14:19
smoser(that would be bad... but what prevents it)14:19
smoserthen why did systemd.link do it?14:19
rharperat least, I don't think it would but I'm not sure14:19
rharperwe create a vlan dev *with* the name eth0.10114:19
rharperthere's not rename event to occur14:19
smoserright14:20
rharpers/not/no14:20
smoserwith a name eth0.101 and a mac that matches that of eth014:20
smosermaybe udev just fails to rename it14:20
smoserwhat i'm asking is...14:20
rharperwell, I guess I'm saying, I wouldn't expect udev to rename unless it saw an event for a device;  and there's no need to do a rename because it's already at the name we expect14:21
smosera.) system boots, ethernet device is present, udev hotplug... that gets named 'eth0'14:21
smoserper14:21
smoser SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="fa:16:3e:4b:63:49", NAME="eth0"14:21
smoserb.) vlan device is created that has a name eth0.10114:21
smoserbut has the mac "fa:16:3e:4b:63:49"14:21
smoserin my buggy scenario a .link file renamed eth0.101 to 'ens3'14:22
smoserbut why wouldn't udev *attempt* to rename eth0.101 to eth0 ?14:22
rharperthat's a good question w.r.t eth0.101 getting renamed by systemd;  I would have thought that the device type would have prevented it from getting renamed14:22
rharperwhat was the rename value in sysfs ?14:22
smoserwhat is the field ?14:23
smoseri had collected grep -r . ens3/14:23
smoser(see the paste)14:23
rharperlooking14:26
blackboxswmorning14:26
rharperens3/name_assign_type:414:26
* rharper googles 14:27
rharperhttps://patchwork.kernel.org/patch/4526491/14:28
rharperI think the link file we wrote is not strict enought;  the vlan matched by mac only;  we don't have the DRIVERS=?* equivalent which was meant to ignore "virtual" network devices14:34
rharpernow that we remove it, we don't get a second rename of devices with matching mac addresses14:34
rharperalternatively we would need to ensure the .link files included something in-addition to the mac address to prevent it from matching on non-physical devices14:35
rharperpossibly reading the driver of the interface and including that in the [Match] section14:35
smoserpowersj, the other hting i have today... the daily builds from recipe started faling yesterday15:18
smoserbecause some of the patches in need updating15:18
smoser(ubuntu/xenial and ubunty/yakkety have patches ... to the azure ds and blackboxsw's' changes there caused us to need to refresh them.. easy, just hae to do it)15:18
=== sambetts is now known as sambetts|afk
rharpersmoser: you know, (see above for the .link trouble we had with vlans and bonds I suspect);  I wonder if much of that trouble xnox had was related to those .link files matching on the virtual devices as well15:42
smoserthats possible.15:43
smoserif he wasnt cleaning them.15:43
smoserbut cloud-init *would* clean them.15:43
dgarstangWell it sucks I can't use cloud-init. :(15:43
smoser(which ... unfortunately now it will not...so ones that it wrote before it wont clean on upgrade)15:43
smoserdgarstang, we'll get you there.15:43
smoserdgarstang, if you want... and you have an instance that i can ssh into, with trunk rpm... i could poke a bit15:44
dgarstangsmoser: Thanks, appreciate it, but for the time being I'll just have to do it with scripts executed from cloud-init15:44
rharperdgarstang: did we file a bug yet with your issue?  I'd like to get one so we can track it;  we'll be doing more with centos and updated cloud-init and certainly want to get your issue resolved15:44
dgarstangI don't really know how to categorise the issue exactly15:44
rharperno need to , just say "disk setup and mounts not working on centos6 ami on ec2"15:44
rharperdump in your user-data you gisted and that should be all we need15:45
smoserincluding the ami id that you used woudl be good.15:45
smoseror if it was a custom one...reproducing with a "official" of some sort15:45
dgarstangGonna retry it first with a fresh pair of eyes15:46
dgarstangSo, I just tried this again, I see this in the output ... "mkfs.ext2: option requires an argument -- 't'" and "Usage: mkfs.ext2 [-c|-l filename] [-b block-size] [-C cluster-size]"... I don't know why since I told it to use ext416:16
dgarstangscrap that. USer error16:16
blackboxswsmoser: I need to fix this right ? https://launchpadlibrarian.net/322019862/buildlog_ubuntu-zesty-amd64.cloud-init_0.7.9-1538-g0a448dd-0ubuntu1+1438~trunk~ubuntu17.04.1_BUILDING.txt.gz   As in we should skip unit tests around json schema if the dependency isn't present right?18:38
blackboxswor should we make sure the python-jsonschema dep is called out for the build env.18:39
blackboxswyep, it's also the same issue w/ powersj's https://bugs.launchpad.net/cloud-init/+bug/169531818:43
ubot5Ubuntu bug 1695318 in cloud-init "centos 6/7 schema unittests failing" [Undecided,In progress]18:43
blackboxswok right, grabbed it.18:44
smoserblackboxsw, yes we should skip i think18:45
smoserblackboxsw, did you click the checkymark on 1692087 or did i18:45
smoseroh. i see in the log that you did.18:46
blackboxswoops smoser, I just finished 2093. I think I fat-fingered 208718:47
blackboxswwas thinking of relying on a quick azure deployment test in 2093's case. /me is setting up my own account18:47
smoserblackboxsw, for that bug, https://git.launchpad.net/~smoser/cloud-init/+git/sru-info/tree/bugs/lp-1686514/disk-setup can help format a device to look like ntfs and/or gpt18:49
smoser(i was launching ones in serverstack and using /dev/vdb)18:49
blackboxswsmoser: like https://bugs.launchpad.net/cloud-init/+bug/1695318 maybe18:51
ubot5Ubuntu bug 1695318 in cloud-init "centos 6/7 schema unittests failing" [Undecided,In progress]18:51
blackboxswoops I mean..18:51
blackboxsw#163467818:51
blackboxswsmoser: like https://bugs.launchpad.net/cloud-init/+bug/163467818:51
ubot5Ubuntu bug 1634678 in cloud-init (Ubuntu Trusty) "fs_setup always creates new filesystem with partition 'auto'" [Low,Confirmed]18:52
smoserblackboxsw, so we think we're done with sru templates ?18:52
blackboxswI'm checking again. you did the lion's share thx18:53
blackboxswsmoser: yes looks done18:54
smosernone on bug 169208718:57
ubot5bug 1692087 in cloud-init (Ubuntu Zesty) "check_partition_layout has false positives when partitioned with gpt" [Medium,Confirmed] https://launchpad.net/bugs/169208718:57
smoseri think18:57
smoseri'll do that one.18:57
shaharmorHello, anyone around?19:27
smoserhey19:28
shaharmorHey @smoser19:29
shaharmorI'm having some trouble with cloud-init getting stuck before finishing the module:config part19:30
shaharmorI opened this bug: https://bugs.launchpad.net/cloud-init/+bug/169439919:30
ubot5Ubuntu bug 1694399 in cloud-init "module:config isn't finishing, stuck after locale configuration" [Undecided,New]19:30
shaharmorI'm able to replicate it every few instances I start19:31
shaharmorI'm wondering if its something wrong specifically in my machine or a general thing19:31
shaharmorbecause I believe cloud-init is something that is used extensively19:31
smosershaharmor, cloud-final.conf runs that19:32
smoserand runs19:32
smoserstart on (stopped rc RUNLEVEL=[2345] and stopped cloud-config)19:32
smoser(per /etc/init/cloud-final.conf)19:32
smoseri suspect cloud-config has stopped , as it clearly ran. i doubt its hung there.19:33
shaharmoryeah I'm not sure its hung19:33
smoserbut something on your system is preventing 'rc' from finishing19:33
shaharmorBut the thing is that its not always happening19:33
smoserthis is an official ubuntu image ?19:34
shaharmorIt was started from the official one (On AWS), and some stuff added on it19:34
shaharmorthen an AMI is created19:35
shaharmorand when that AMI is used with "userdata", this happens occasionally19:35
smoserits been a long time. i can tell you that its very unlikely that there is a general bug like you're describing19:36
smosershaharmor, can you run 'initctl list'19:37
shaharmorThats what I though19:37
shaharmorLet me try to replicate it again because I already shut down that machine19:37
=== nacc_ is now known as ancc
=== ancc is now known as nacc
shaharmor@smoser ok I managed to reproduce20:03
shaharmorrunning it now20:03
shaharmoroutput of 'initctl list': https://pastebin.com/7i3Wq3MQ20:04
shaharmorthis is the command that runs the init.d scripts? /bin/sh /etc/init.d/rc 220:09
shaharmorcould it be that its still running other scripts in init rc2 and just waits for them to qui?20:09
shaharmorok I figured it out20:17
shaharmorI had another script (not related to the userdata) that was set to run on rc2 that was stuck20:19
shaharmorwhen I killed it, the module:final ran20:19
smoserblackboxsw, you're working https://bugs.launchpad.net/cloud-init/+bug/169531820:33
smoserright ?20:33
ubot5Ubuntu bug 1695318 in cloud-init "centos 6/7 schema unittests failing" [Undecided,In progress]20:33
blackboxswalmost done smoser20:33
blackboxswyep20:33
smoserand i'll need that to get the xenial, yakkety, zesty dailiy archive builds20:33
blackboxswwas adding a card for that20:34
smoseri think those will just start workign again ocne we merge your fix to trunk20:34
smoserie:20:34
smoser https://code.launchpad.net/~cloud-init-dev/+recipe/cloud-init-daily-yakkety20:35
smoser https://launchpadlibrarian.net/322160649/buildlog_ubuntu-yakkety-amd64.cloud-init_0.7.9-1541-g1cd4323-0ubuntu1+1385~trunk~ubuntu16.10.1_BUILDING.txt.gz20:35
blackboxswpushing a branch for review20:36
blackboxswsmoser: powersj https://code.launchpad.net/~chad.smith/cloud-init/+git/cloud-init/+merge/32502420:47
smoserblackboxsw, love it20:48
blackboxswlet's just hope that handles it. I'm trying to get my cent6 lxd up again20:49
blackboxswIt should have covered all the atttached unit test failure in the bug. Just not sure if there are more now.20:49
smoserjust queued a build at https://code.launchpad.net/~cloud-init-dev/+recipe/cloud-init-daily-xenial20:50
smoserand https://code.launchpad.net/~cloud-init-dev/+recipe/cloud-init-daily-devel20:51
smoserfingers crossed20:51
smoserand i have to run20:51
blackboxswthx smoser21:00
blackboxswpowersj: I'm extending to https://git.launchpad.net/server-team-ci/    allow passing in parameters like WIP branch URL so that it can work with more than just cloud-init/master21:02
powersjblackboxsw: I assume you are referring to the centos tests?21:02
powersjI am re-writting those right now21:02
blackboxswhttps://git.launchpad.net/server-team-ci/scripts/centos/centos-run.sh rather21:02
blackboxswright, if you are touching it I'll be hands off21:03
powersjhttps://code.launchpad.net/~powersj/cloud-init/+git/cloud-init/+merge/32498221:03
blackboxswreviewing21:03
powersjI'm extending it so we can make it part of the pipeline21:03
blackboxsw++21:03
powersjhave all these nice tests, now time to run them on every merge proposal rather than daily :D21:04
blackboxswheh21:04
blackboxswman, I'd really love to use python instead of bash for any new scripts we write21:04
blackboxswbut, that's just because my shell chops are el-stinko21:05
blackboxswand bash is hard to test.21:05
blackboxswwas just referring to the newscript comment from smoser on your branch21:05
powersjI hear you; I switch between both21:07
powersjthe proposed automation is in python so far, but rest will be shell21:07
blackboxswyeah so many external calls 'lxc ... ' it lends itself more easily to shell scripts. but, yeah.21:09
blackboxswyay green, thx powersj smoser https://jenkins.ubuntu.com/server/view/Cloud-init/job/cloud-init-centos-6/21/21:52
powersjawesome21:52
blackboxswpowersj: per the other comment you got on your branch about not dup'ing the dependencies, I'll get a make ci-deps Makefile target to you. I'm trying to test out something right now21:53
powersjsweet21:53
blackboxswit won't be until Monday though, so it probably won't help your existing branch.21:53
blackboxswit won't be reviewed/landed21:53
=== rangerpb is now known as rangerpbzzzz
=== Hazelesque_ is now known as Hazelesque

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!