/srv/irclogs.ubuntu.com/2018/04/27/#cloud-init.txt

guest____hello there00:05
dpb1o/00:38
rharperpaulmey: so os.path.exists('/sys/module/ntfs')  is one; and typically there should be a mount.$fstype binary in $PATH; so we have /sbin/mount.ntfs ;  mount -t $sf is going to invoke a mount.$fs binary to handle it;01:55
smoserrharper: i just uploaded .. slight change to your MP.01:56
smoserwe had not added chagnelog entries for the commits on the ubuntu/devel branch01:56
smoserso i added them.01:56
smoserits https://launchpad.net/ubuntu/bionic/+queue?queue_state=1&queue_text= now01:59
rharpersmoser: ok; is that change that should be in qa-scripts new-upstream-snapshot ?14:16
smoserrharper: i'm not sure. that might be possible.14:25
smoserbut what I had always been doing is when i commit to the ubuntu/devel branch (or any ubuntu/* branch)14:25
smoserto "queue" the commits for next14:26
smoseri would 'dch -i'14:26
smoserand make a commit with 'git commit -m "update changelog"' debian/changelog14:26
smoseri guess we could traverse the ubuntu branch since merge also and grab those commits to write the entry.14:27
smoserkind of weird to have new-upstream-snapshot do it though as those commits/entries-in-changelog are not from the new-upstream-snapshot. they were from commits to the ubuntu/ branch14:28
smoserwoudl be nice though to have something doing that / envforcing it.14:28
rharperI didnt mean for it to do it, but just printing of the steps14:29
rharperI just need a reminder14:30
smoseroh. well, they're kind of supposed to be done *befor* you run new-upstream-snapshot14:30
smoserie, when we commit to that branch14:30
rharperheh14:30
smoserwe should do it14:30
rharperhrm14:30
rharpernothing new is committed ot ubuntu devel until we do the snapshot, right ?14:30
rharperI'm confused (as you already knew)14:30
smoserrharper: see 85ff391b29ec8ea2168371498ffe083c51258ef314:44
smoserwe have packaging only on the ubuntu branches14:45
smoserso those commits have to go to that branch14:45
smoseri prefer commits like that to be in one commit that makes the change, and one commit that updates the changelog ("git commit -m 'update changelog'")14:46
smoserthat way they can be easily cherry-picked to other ubuntu/ branches14:46
smoseras debian/changelog changes are going to always conflict14:46
rharperoh, I see14:46
rharperthat hit master, but should ahve been ubuntu/devel only14:47
smoserrharper: well we fixed in on master too14:54
smoserin master its just for the bddeb work flow14:54
rharperok14:54
rharperright14:54
smoseri really only noticed that because I knew wer were explicitly looking for those 2 fixes14:55
smoser(isc-dhcp-client and iproute2)14:55
blackboxswsmoser: you setting up the Bionic update ?15:15
smoserblackboxsw: yeah, i'll file a bug now15:21
blackboxswok then I'll poke at IBM xenial a bit15:21
smoserblackboxsw: https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/176741215:32
ubot5Launchpad bug 1767412 in cloud-init (Ubuntu Bionic) "SRU cloud-init 18.2-27-g6ef92c98-0ubuntu1" [Medium,Confirmed]15:32
rharpersmoser: blackboxsw and I were discussing if there was a way to keep the ConfigDrive -> softlayer detection in the xenial/artful only branches so bionic didn;t have to have that logic; but there is that gnarly hard-coded datasource list in /etc/cloud/cloud.cfg.d/ that's present which restricts what ds-identify looks for;15:33
smoserum... what detection is that ?15:34
rharperI don't think we have a way to tell ds_check on a particular datasource that it's really a different one;15:34
rharperthere's a datasource_list: [NoCloud, ConfigDrive, None] list in those images, that's what blackboxsw found on the xenial instance15:34
smoserright15:34
rharperwhich means that after upgrade, ds-identify still won't "See"  softlayer15:34
rharperhoping to somehow transition to the softlayer datasource but that sort of means either nuke or re-writing , or somehow overriding it15:35
rharperwhich I'm not sure how we can do that reasonably15:35
smoserit should nto "see" softlayer15:37
smoserthats the plan15:37
smoserit shoudl go on using the datasource on disk.15:38
smoserseparately we can/should discuss with CPC for them to start making new images on IBM in the same way they make bionic images.15:39
smoserso as to not have the slop that is there.15:39
danMS@rharper thanks for taking a look at the ntfs bug (1767002), i saw your comments from yesterday, you asked if there are further checks that can be done, but I’m not sure what further checks can be done? Many of the distro’s on the platform do not support ntfs in the images.15:41
rharperdanMS: generally, is there a kernel module loaded (ntfs); and are there tools (mount.ntfs, fsck.ntfs, mkfs.ntfs); would be two other indicators (specically mount.ntfs)15:42
rharperthat would allow modified centos/rhel images which have those tools to work rather than banning the distro entirely15:42
rharperif that makes sense15:42
smoserdanMS: maybe another way out of this would be to just allow this configurable15:45
smoserand have RH and SuSE build images with "support_ntfs: false"15:45
smoseror what not.15:45
smoserhten dont worry at all about blowing away data on an ntfs partition.15:46
smoserrharper: http://paste.ubuntu.com/p/GYsxMyTR2F/15:46
smoserblackboxsw: ^ that is what i was thinking is the fix15:46
rharpersmoser: but how would the softlayer ds get added to the datasource_list ?15:47
smoserit wont15:48
smoserand thats fine.15:48
rharpersmoser: I was hoping to transition into the softlayer datasource15:48
rharperoh15:48
rharperso, once launched on a ConfigDrive, it would stay that way through upgrade and dist-upgrade  to bionic ?15:49
smoseryeah.15:50
rharperthat has some asymmetry w.r.t things checking what ds was used;  not sure if that's a big issue or not15:50
smoserif the user removed the entry from the 99networklayer.cfg and dpkg-reconfigure, then they'd transition just as a new instance had been created.15:50
rharperright15:50
blackboxswsure on pastebin smoser though maybe we can fold in the is_ds_enabled check inside is_ibm_cloud in ds-identify15:51
blackboxswbecause we also have that check in dscheck_NoCloud15:51
blackboxswI also just noted that our DataSourceNoCloud doesn't have a comparable filter for ibm too15:53
blackboxswlike ds-identify does15:53
smoserblackboxsw: yeah, you could potentially do that. but the fact that something is or is_not ibm cloud is not specifically related to whether or not hte datasource is in that list15:53
smoserso.. i just wrapped. but yeah, i dont have a real good reason to not do what you did.15:53
smoseruyeah..that was kidn of why i dropped the check in NoCloud15:54
smoser(in my diff)15:54
smoserif you have a Nocloud, then thats your issue. (and ours since we have aofficial images with it... )15:54
danMSthanks guys, will chat with paulmey15:57
smoserrharper: i'm going to force push the ubuntu/devel branch back to before we merged you.15:58
rharpersmoser: ok15:58
smoserand then i'm going to make a bionic branch15:58
rharpersure15:59
smoserrharper: you want to do this or wnat me to ?16:26
rharperwhich ?16:27
rharperor what16:27
smoserubuntu/bionic is now in a state that you can run new-upstream-snapshot16:27
smoserand it will all "just work"16:27
smoserone change to new-upstream-snapshot that i just pushed16:27
rharperI can run it again, but likely faster for you to do it16:27
smoserand your bug nuber is dch --release --distribution=bionic16:27
smoseroops16:27
smoserbug number is 176741216:27
smoserok. i can just do it.16:27
* rharper looks at git log to see what's different16:28
=== r-daneel_ is now known as r-daneel
rharpersmoser: nice change to new-upstream-snapshot16:32
smoserrharper: it should differ only in the changelog16:32
* smoser verifies that is true :)16:32
rharperfrom what to what ?16:33
smoser 7609065fd30c3a02122bded6ab213ebc3912584b16:34
smoseris raharper/ubuntu/devel/newupstream-2018042616:34
smoserwhat you had proposed16:34
smoserand diff current ubuntu/bionic -> that16:34
smoseryou get16:34
dpb1smoser: upload good now?16:34
smoserhttp://paste.ubuntu.com/p/ScfhfhXvBP/16:35
smoseryeah, i just uploaded16:35
rharperyes16:35
smoseri shoudl have reversed the order there16:35
smoserbut good.16:35
rharpersmoser: that looks right (minus the order)16:35
rharperhttp://paste.ubuntu.com/p/DbqJ945jMh/16:36
rharperI put that here: raharper/ubuntu/devel/newupstream-2018042716:36
smoserjust uploaded16:36
rharper\o/16:37
smoserhttps://launchpad.net/ubuntu/bionic/+queue?queue_state=1&queue_text= shows it.16:37
jochablackboxsw: Hey, just following up on merge request: https://code.launchpad.net/~jocha/cloud-init/+git/cloud-init/+merge/344192 :)16:42
blackboxswjocha: thanks sorry for the delay, if I can't get to it today, it will be tomorrow. (was on vacation yesterday)16:42
jochano worries! I understand that you must have a lot on your plate16:43
smoserblackboxsw: did you get sorted on launch ?16:44
blackboxswsmoser: I'm currently trying to use the UI for it. I'll try again cli and really look at the traceback to see what gives16:44
blackboxswsmoser: this is what I hit https://pastebin.ubuntu.com/p/Vq7fw5S2tf/16:46
blackboxswahh got it smoser16:50
blackboxswit's because of how I set up my account16:50
blackboxswto automatically inject my ssh key.16:50
blackboxswadding a check in launch-softlayer now16:50
blackboxswok have a fix. pushing now16:57
blackboxswpushed, testing a potential SL fix now17:10
smoserblackboxsw: i just pushed another on top there.17:35
smosermake sure it still works for you17:35
smoseri just verified emptying my keys and having it add one for me and then matching too.17:35
smoserblackboxsw: you make progress ?18:13
smoseri booted xenial on IBMCloud, upgraded, put this chagne in place18:13
smoser http://paste.ubuntu.com/p/cRPzBt3Qg7/18:13
smoser(by hand)18:14
smoserand then rebooted and came up ok.18:14
blackboxswsmoser: I used the original changeset and tried a ds-identify run and saw an error on line 61618:16
blackboxswDS_LIST param not set18:16
smoseryeah. i fixed taht18:16
smoserDI_DSLIST18:16
smoseris the name18:16
blackboxswyeah18:16
blackboxswsmoser: the issue I think I'm seeing with that fixed is that xenial was originally ds-id'd as ConfigDrive but now returns NoCloiud18:18
blackboxswhrm, wait a sec18:18
blackboxswneed to recheck that18:18
blackboxsw:q18:18
blackboxswn/m strike that, it was originally detected NoCloud, not ConfigDrive. ok so logic remains intact18:20
smoserwell,. remember 4 scenarios18:20
smoserwith user-data and without, template and os_code18:20
* blackboxsw is waiting on reboot and reboot clean18:22
blackboxsweven though the clean reboot isn't really an intended upgrade path.18:23
smosertheir apt  mirror is nice18:29
smoserFetched 83.1 MB in 2s (28.2 MB/s)18:29
rharpersuggests IO is decent as well18:30
smoserwell, eatmydata helps with the io18:30
smoserand i dont run apt-get any other way :)18:31
rharperlol18:31
=== r-daneel_ is now known as r-daneel
paulmeyrharper: re "is there an ntfs kernel module", I propose to run 'modinfo ntfs" (rc=0) to check that is true and I'll run a util.which on 'mount.ntfs' to see if that exists in $PATH18:57
paulmeydoes that sound like the right path?18:58
rharperpaulmey: yes;18:59
=== r-daneel_ is now known as r-daneel
=== r-daneel_ is now known as r-daneel
paulmeyalright, I'll make it so...21:31
smoserblackboxsw: I did get the datasource list rioght in ConfigDrive21:45
smoser2018-04-27 20:52:41,219 - DataSourceConfigDrive.py[DEBUG]: devices=['/dev/xvdh'] dslist=['ConfigDrive', 'NoCloud']21:45
smoseryeah, and then as i think....21:46
smoseryour case enabling IBMcloud on a template image without user-data on xenial21:46
smoserhm.. maybe not21:46
smoseri htought i had a thoguht on it.21:46
smoserbuti have to go now.21:47
smoserlater.21:47
blackboxswlater21:47
blackboxswyeah and going through the motions here21:47

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!