/srv/irclogs.ubuntu.com/2017/06/15/#cloud-init.txt

blackboxswyeah, unfortunately, I didn't actually merge it ;)00:00
blackboxswPermission denied (publickey).00:01
blackboxswfatal: Could not read from remote repository.00:01
powersjO.o you are in the group00:03
powersjhttps://launchpad.net/~cloud-init-dev/+members#active00:03
blackboxswyeah, git push origin master was a no go. hmm.00:04
blackboxswI'll try a fresh clone merge push00:04
blackboxswhrm fresh clone shows it merged.00:08
blackboxswso when we git push origin master does launchpad automatically mark the branch merged?00:08
blackboxswor is that manual00:08
blackboxswI was used to LP marking my branches as merged automagically for bzr branches. not sure if that's the same for gitlp00:09
powersjblackboxsw: I think you have to mark it00:10
powersjI don't recall doing it automatically, only in bugs00:10
blackboxswok thx powersj yeah that was my confusion (and LP git was also showing stale data @ https://code.launchpad.net/~cloud-init-dev/cloud-init/+git/cloud-init/+ref/master)00:14
blackboxswso I *think* rev b23d9d7 is in build https://jenkins.ubuntu.com/server/view/Cloud-init/job/cloud-init-integration-y/227/ too, so ok, we should be testing what I landed00:16
smoserblackboxsw, powersj it will mark merge in one of 2 ways (which are really kind of the same)01:13
smosera.) you 'git merge' && 'git push'01:14
smoserb.) you squash, rebase, push --force [to your repo], then merge01:14
smoserbut only you can do 'b', and i prefer the squash to the merge. so really only people with commit access can end up getting that to happen unless they rebase exactly on master with no in the middle commits.01:15
powersjyeah squash should be done imo01:16
smoserso... often times i go and mark 'merged' and then hit the edit button for 'merged at revision'01:16
smoserand put in the actual commit id01:16
smoserpowersj, so do we think we're happy in trunk now?01:16
powersjFor trunk build yes01:19
powersjI do see a centos build failure: https://jenkins.ubuntu.com/server/job/cloud-init-copr-build/8/console01:19
powersjand integration tests failed but due to test failures, those were during the firewall reboot, so I'll let them go for now.01:19
smoserpowersj, you're missing python-jinja there01:25
smoseris that in a fresh container ?01:25
smoserthat error is horrific. it should fail with a sane error rather than attempting to render a template with 'basic' when the template declares it is jinja and it knows it has no jinja01:26
blackboxswhmm build failure on 227 above http://pastebin.ubuntu.com/24861805/03:07
blackboxswhave we seen this before? " Could not resolve \'us.archive.ubuntu.com\"03:07
powersjwhat time was that failure at? It may have been during firewall maintenance03:41
powersjI should just disable tests when we have those planned...03:41
=== sambetts|afk is now known as sambetts
nilujeanyone knows how to submit a merge request with launchpad?13:48
nilujethe "propose for merging" button doens't seem to exist on https://git.launchpad.net/~jcastets/cloud-init/13:48
nilujeoh ok. Only available from code.launchpad.net, not from git.13:54
nilujehttps://code.launchpad.net/~jcastets/cloud-init/+git/cloud-init/+merge/32574013:55
smoserniluje, thanks!14:04
smoserniluje, fyi http://cloudinit.readthedocs.io/en/latest/topics/hacking.html kind of explains it14:04
blackboxswok things looking a bit better on jenkins. though integration-x is failing w/ 2017-06-15 11:44:37,781 - tests.cloud_tests - ERROR - stage: collect for platform: lxd encountered error: Failed to create ZFS snapshot: cannot create snapshot 'default/images/ee1831d4efcc74310def225ec449c1b6a49cc371a744cbbb79ea5bf21b05c3b6@readonly': dataset already exists14:26
blackboxswhttps://jenkins.ubuntu.com/server/view/Cloud-init/job/cloud-init-integration-x/220/console14:27
smoserblackboxsw, well, at least that doesn'st smell like cloud-init code regression14:29
blackboxswamen to that14:29
smoserhttps://jenkins.ubuntu.com/server/view/Cloud-init/job/cloud-init-copr-build/8/console14:29
blackboxswjinja template changes +  brpm changes14:30
blackboxswsmoser: I can take that if you haven't already14:30
smoserblackboxsw, you can. i think it needs jenkins change14:31
smoserright? it is just that wherever that is run it needs jinja14:31
smoserideally it runs in a container. or it could use:14:32
smoser ./tools/run-centos 6 --srpm --artifact14:32
smoserhttp://paste.ubuntu.com/24864792/14:33
smoserit could be useful to chagne run-centos to take a '--artifact-dir' to put artifacts (the srpm) in that directory rather than '.'14:34
blackboxswthat's a good call. I'll go that route14:35
smoseri dont think we need the '--artifact-dir' here as the build will always take place in a clean environment14:35
smoserhttps://git.launchpad.net/server-team-ci/tree/jenkins/cloud-init/centos.yaml is what you need to change i think14:36
blackboxswyeah we can just switch CI to use run-centos I have a couple other jenkins changes from yesterday (to get deps installed for the integration-# builds too. so I'll fold them together14:37
smoserk14:38
nilujesmoser: yep, I read the document but didn't notice it was only available on "code.laucnhpad.net" and not on "git.launchpad.net"14:40
smoserfair. i reviewed your proposal.14:43
nilujesmoser: "we really, *REALLY* want a positive non-network identification" -> we already discussed about this on the previous PR (which was made longtimeeee ago), and unfortunately there no way to implement the on_scaleway method without hitting a network ressource14:43
smoser:)14:43
nilujeyou suggested to call dmidecode, it wouldn't work as we don't provide such info14:43
smoseryeah. feel free to link to that if you'd like.14:43
nilujesmoser: just a thing about vendor-data. I added them in self.metadata['vendor-data']. Is it what is expected by cloud-init?14:45
smoserniluje, the datasource wants a14:50
smoser self.vendordata_raw14:50
nilujeis the interface documented somewhere?14:51
smoserwell cloudinit/sources/__init__.py14:51
nilujeoh14:53
niluje'user-data' and 'vendor-data' are not expected to be in metadata14:53
nilujeI thought so :p14:54
smoserwell, cloud-init doesn't get to chose where you put information on the other end.14:54
nilujeok14:55
smoseri'm sorry if i sound like pestering...14:55
smoserare there plans (at least in the vms) to put some dmi information in ?14:55
smoseror some other way of identifying "you are on scaleway"14:55
smoserniluje, i'm really sorry if you've told me all this before. if I had a nickle for for all the things i'd forgotten...14:58
blackboxswpowersj: just put a branch for review https://code.launchpad.net/~chad.smith/server-team-ci/+git/server-team-ci/+merge/325745.14:59
powersjblackboxsw: thanks15:02
nilujesmoser: we have two options15:08
nilujesmoser: 1/ we can update our initrd to create the file /var/run/scaleway and check this file exists in cloud-init15:08
niluje2/ we can add "scaleway" in the kernel cmdline and check it in cloud-init15:08
nilujethis way the network check can go away15:09
nilujeany preference?15:09
smosersince you already ahve a custom initrd, that seems fine.15:21
smoserin your vm images do you have a custom initrd ?15:22
smoserie, the 'vc1s' does that have a custom initrd ?15:23
smosereither is fine. i think maybe kernel cmdline seems easier to maintain long term.15:24
smoseri'd like it if15:24
smosera.) your vm instance types (vc1s, vc1m, vc1l) provided some dmi data . in theory that shoudl work even on arm64 vms (i dont know if you offer those), but reality differs15:25
niluje(yes we do)15:25
nilujefor dmi data, it's really not an option as you have some baremetal servers and we don't want to maintain several solutions to identify the hardware15:26
smoserb.) your bare metal instance types, it seems like kernel cmdline is acceptable. at some point in the future when you started  being able to use stock images there, with a grub that loaded a kernel from inside the image... we'd have to figure someway out. maybe you'd have to modify the image to keep the kernel param on, or just touch a file or static config.15:26
nilujeand we'd like to eventually get rid of the initrd (which is currently also used for vm)15:26
nilujeif that's ok to you let's go for the commandline15:26
smoserin vm instances dmidata shoudl be possible15:26
smoserbecause at some point you want to get off maintaining your own images for vms (i'd think)15:27
smoserand having easy check of dmi platform data that says 'scaleway' is a win there.15:27
smosereven if its harder to get that same win elsewhere.15:27
nilujesmoser: what about adding three checks ? dmidecode + cmdline + /var/run/scaleway?15:28
nilujethis way we can just update the cmdline for now and/or update the initrd, and we have the flexibility to add dmidecode on our vm later when we'll (hopefully) allow to run custom images/kernels15:29
smoserthat is fine with me.15:31
nilujeawesome :)15:31
nilujelast thing, what's the LP #id you want me to put in the commit message?15:31
nilujethe MR id?15:31
smoserno. bug number15:36
smoseri you want to file a bug, you can.15:36
smoserthat'd be nice.15:36
smoserbut if you dont', then thats fine too15:37
nilujeok15:38
nilujethanks15:38
nilujeI'll get back to you with improvements and unittests (and not in weeks, this time)15:38
smoserpowersj, i suspect it'd be possible to get a freebsd vm into our jenkins right ?15:56
smoserin a low tech sort of way... powersj gets a vm image of freebsd or does an install, adds it to a libvirt and adds jenkins to it ?15:57
smoserthen we could run freebsd c-i on that system.15:57
powersjsmoser: yeah15:59
powersjassuming the jenkins client (java) runs on freebsd16:00
rharperhttps://docs.openstack.org/image-guide/freebsd-image.html16:01
smoser"You can specify up to 1 GB additional RAM to make the installation process run faster."16:02
powersjnice!16:02
powersjlol16:02
smoserany more than that, and its going to fail :)16:02
smoserblackboxsw, https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/32576016:54
smoseri'd appreciate read of that if you had some minutes16:54
blackboxswgrabbing right now16:56
blackboxswpowersj: https://jenkins.ubuntu.com/server/job/z_integration_y/1/console looks pretty good for the 2nd part of validation on https://code.launchpad.net/~chad.smith/server-team-ci/+git/server-team-ci/+merge/32574516:56
blackboxswsmoser: ci didn't like first pass. https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/32576016:57
blackboxswbut reviewing code now16:58
smoserits running the second now.16:58
powersjblackboxsw: your merge looks good to me16:58
smoseri dropped the pylint ignore on platform.dist()16:58
smoserwhich is unfortunatlye deprecated (but so was linux_distribution())16:58
smoser:-(16:58
smoserhttps://bugs.python.org/issue132216:58
rharperaw bummer17:02
=== sambetts is now known as sambetts|afk
NostawRmlong shot, but I'm trying to find anyway that I can specify some network configurations because I'm not happy with Openstack's IP selection. I just saw that using user data is not an option, so I'm seeing what other options I have17:19
NostawRmI  know I could just make a script to use but that's less than ideal :/ having it done proper by cloud-init would be better imo17:20
smoserNostawRm, i'm not sure that you can do that .17:22
smoserif openstack told you what your ip is, then its quite likely not going to route traffic if you take a different one17:22
NostawRmI thought not. Surely if I could, I would have found it right now :/17:23
NostawRmwell, its a single interface/port with multiple IPs17:23
NostawRmand openstack just picks the first one in the list, but if a new one is added that is then the first one in the list, then say on a rebuild, the 'main' IP would change17:23
NostawRmdon't know if that explains it well heh17:24
blackboxswsmoser: minor comment about suse on https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/32576017:28
=== Hazelesque_ is now known as Hazelesque
powersjsmoser: re: CI pipeline I have something here: https://jenkins.ubuntu.com/server/job/cloud-init-pipeline-ci/18:52
powersjI would like to keep the run times below 10 mins, so what I am going to do is work on creating parallel stages going and write a short integration test that hits as many areas as possible rather than running all the lxd-based tests.18:53
powersjThen plan would then be to replace the daily build/unit test with this and replace the per-merge CI tests with this as well, so every merge has coverage here.18:54
smoserhttp://doodle.com/poll/tq43i9876sw2vqca19:08
smoserlarsks, ^ rharper powersj dpb119:08
blackboxswhttps://jenkins.ubuntu.com/server/view/Cloud-init/ all the green balls19:12
blackboxsw:)19:12
smoserblackboxsw, thanks for the suse . i will fix.19:13
smoserblackboxsw, actually..19:16
blackboxswyeah was wondering what our story is with suse and templating?19:16
smoseryeah19:17
smosersee comment19:17
powersjsmoser: FYI http://paste.ubuntu.com/24866805/19:51
powersjthat just happened19:51
powersjcentos719:52
smoserthati sodd19:53
smoserpowersj, i'll get it fixed.20:00
blackboxswdid I mention I love the cI20:15
blackboxswdid I mention I love the ci -- continuous integration for the win20:16
rharper*whew* ;  all but one integration test passing,   the mixed ipv6 mtu and device mtu case (which we have to workaround in ubuntu as well);20:19
rharpersmoser: do you prefer a MR per bug/issue, or would you like a PR with all of the fixes and bugs?20:20
smoserwell, i think one per issue is better.20:23
rharperok20:23
smoserpowersj, blackboxsw i can recreate that in a centos 6 container (./tools/run-centos 6)20:23
smoserbut i dont understand it20:23
smoserwhy would this not show failure:20:23
smoser$ python -c 'from cloudinit import util; print(util.is_FreeBSD())'20:24
smoserFalse20:24
smoseror20:24
smoser$ python -c 'import platform; print(platform.dist())'20:24
smoser('centos', '7.3.1611', 'Core')20:24
smoserhttp://paste.ubuntu.com/24867035/20:24
smoseroh. because he mocked platform.platform20:27
smoserblackboxsw, powersj https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/32577120:43
powersjsmoser: there will be tox failures on that20:51
smoseri think fixed20:54
smoserpowersj, ^20:55
smoserblackboxsw, ^ a review would be good. or rharper21:00
blackboxswsmoser comment added21:00
blackboxswdoesn't look like _check_freebsd_cdrom returns anything21:00
rharper?21:01
rharpertrue or false21:01
rharperit's just code motion for mocking21:01
rharpersmoser: why don't you need the PY3 in mock anymore ?21:02
smoserblackboxsw, you reviewed an older version21:02
smoserand caught a valid concern21:02
smoserwhich is now fixed21:02
smoserwe mock just earlier now, so dont need PY321:02
smoserlook at updated diff. you see i remove usage of it.21:03
rharpersmoser: gotcha, we're mocking the function, so no need to mock open21:03
smoseryeah.21:04
blackboxswminor assert param reorder. but +121:11
smoserblackboxsw, ?21:14
smoseri'm running a ./tools/run-centos and tox on feature/freebsd-variant21:15
smoser https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/32576021:15
smoserbah21:17
smoserblackboxsw, you're right. it shoudl ahve been reordered21:17
smosersorry21:17
smoserit is pushed now, and i just pushed https://code.launchpad.net/~smoser/cloud-init/+git/cloud-init/+merge/325760 also21:17
blackboxsw+121:18
blackboxswwill watch jenkins21:18
* smoser goes out. i'll check back in in a few hours21:19
rharperlater21:19

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!