/srv/irclogs.ubuntu.com/2019/12/12/#cloud-init.txt

blackboxswmeena: will have to get to it tomorrow. we're wrapping up SRU testing (and should be done tomorrow)00:24
blackboxswsoftlayer SRU redone https://github.com/cloud-init/ubuntu-sru/pull/71 repushed. should be done tomorrow w/ puppet testng00:25
otubomeena: I could take a look at your PRs. Not sure if 93, 53 or 42. Or all of them.12:00
meenaotubo: cool thanks13:43
meenai tried to write a patch to @goneri's code, but somehow sleep seemed like a much more attractive option13:45
otubomeena: all those PRs? Or just one of them?13:46
meenaGoneri: your code is missing at least one function, _supported_write_network_config13:47
Gonerimeena, Aloha! Thanks for the information. I plan to work on it next week-end.13:48
meenaotubo: let's start with #93. but generally, whatever you can independently verify would be great to ➕113:53
meenaGoneri: i might get to it earlier13:54
Gonerimeena, Yeah! You're a machine :-)13:54
meenanah, i just have a very nice evening ritual off sitting in front of the TV with my partner, after the baby is in bed, and we both stare at our laptops13:56
meenaotubo: #42, by some miracle, is merged. but #69 is not, and isn't freebsd specific13:58
otubomeena: awesome, I think I still have some time today. So I'll take a look :)13:58
Odd_Blokemeena: I've been using Python since 1.5.x, I have all sorts of trivia stored in my head. :p14:47
Odd_Blokemeena: I'm not sure, but I wouldn't be surprised if the mock object doesn't know its fully qualified name.  It's just a (special) Python object with a name attribute, really.  But maybe there's some trivia for me to learn here. :p14:50
smosersomeone needs to file an lxc issue for pstart fails.15:01
smoserlxc-pstart really isn't doing anything hacky.  basically it just15:02
smoser - creates a profile with its own network15:02
smoser - modifies container to be on that profile15:02
smoser - inserts an 'init' and sets 'lxc.initcmd=<that>'15:02
smoser - starts container and runs stuff15:03
smoser - stops container15:03
smoser - removes profile15:03
Odd_Blokemeena: One minor change requested on #93. :)15:03
smoserand lxc-proposed-nsapshot just does that, and then uses lxc publish.15:04
Odd_Blokesmoser: Is there an easy way we can dump the lxd commands that lxc-pstart is performing?  A bug report would probably have less friction if we don't need upstream to use our tooling to reproduce.15:06
smoserit does have pretty good debug output15:07
smoserOdd_Bloke: https://hastebin.com/levavikayi.cs15:09
smoseroh15:10
smoserthere it is15:10
smoser--dump-commands15:10
smoserOdd_Bloke: https://hastebin.com/agolazazin15:14
meenaOdd_Bloke: will have to sit until 19:00, or else you propose a change, or, even push directly to my branch15:26
MrGeneralHello guys:15:28
MrGeneral2019-12-12 14:55:06,854 - __init__.py[DEBUG]: Searching for local data source in: ['DataSourceNoCloud', 'DataSourceConfigDrive', 'DataSourceOpenNebula', 'DataSourceDigitalOcean', 'DataSourceAzure', 'DataS>15:28
MrGeneral2019-12-12 14:55:06,855 - handlers.py[DEBUG]: start: init-local/search-NoCloud: searching for local data from DataSourceNoCloud15:28
MrGeneral2019-12-12 14:55:06,855 - __init__.py[DEBUG]: Seeing if we can get any data from <class 'cloudinit.sources.DataSourceNoCloud.DataSourceNoCloud'>15:28
MrGeneral2019-12-12 14:55:06,855 - __init__.py[DEBUG]: Update datasource metadata and network config due to events: New instance first boot15:28
MrGeneralCan't get cloud-init in proxmox to be read from ide215:28
MrGeneralAny hint? Sorry for the spam btw.15:28
Odd_Blokemeena: No rush. :)15:52
Odd_BlokeMrGeneral: What is "ide2"?15:53
MrGeneralOdd_Bloke , Cloud-init drive in proxmox :\16:00
MrGeneralis there any way to specify the /dev/srID for cloud-init?16:00
Odd_BlokeMrGeneral: Before we get into specific solutions, let's make sure we understand the problem.  Can you open a bug at https://bugs.launchpad.net/cloud-init/+filebug and attach the tarball produced by `cloud-init collect-logs` to it, please?16:01
Odd_BlokeThat'll get us the info we need to properly help you out. :)16:02
MrGeneralI'll try thanks Odd_Bloke16:02
MrGeneralyep :)16:02
MrGeneraltrying to sort the issue tho16:02
MrGeneralsupposedly, the data source is a cdrom generated by proxmox mounted in the server16:02
MrGeneralthough as I install an ISO and load the cloud-init drive it sets by default from /dev/sr216:02
MrGeneralactually16:02
MrGeneralsr116:02
MrGeneralinstead of sr016:02
MrGeneralOuch was finally able to get it working @Odd_Bloke, just didn't setup the network!16:13
MrGenerallet's find out why.16:13
MrGeneralresize, hostname, root login enabled, etc. did work.16:14
MrGeneralk, I know what to do I think.16:14
MrGeneral@Odd_Bloke may have more info. So, I install the iso which already comes with cloud-int, then I create a template in proxmox. everything is confgiured other than networking, any idea?16:55
ahosmanMSFTblackboxsw: any updates on the bug merge?17:01
Odd_BlokeMrGeneral: Not really; gathering the info I requested earlier is really the next step.17:07
MrGeneralGot it all working, Odd_Bloke, thanks, was my fault tho. :P17:07
MrGeneralWindows with Cloud-init WILL be a pita tho!17:08
Odd_BlokeGlad to hear it's working! :)17:08
MrGeneralThanks sir :)17:08
Odd_Blokeblackboxsw: Am I remembering correctly that the Softlayer SRU PR is ready for re-review?17:09
blackboxswOdd_Bloke: yes it is https://github.com/cloud-init/ubuntu-sru/pull/71   I repushed late yesterday17:12
blackboxswincreased a timeout to an unreasonable amount17:12
Odd_BlokeCool, will look in a minute.17:14
meenaOdd_Bloke: im too old/young to be in a rush17:15
blackboxswahosmanMSFT: I left you comments on the PR17:19
blackboxswahosmanMSFT: https://github.com/canonical/cloud-init/pull/84#discussion_r35636981217:20
blackboxswlast item and should be good17:20
ahosmanMSFTblackboxsw Just fixed and pushed17:25
blackboxswthx17:30
rharperblackboxsw: Odd_Bloke: https://github.com/cloud-init/ubuntu-sru/pull/7519:03
blackboxswreviewing19:09
blackboxswrharper: https://github.com/cloud-init/ubuntu-sru/pull/6619:10
rharperreviewing19:10
meenaOdd_Bloke: pushed. (and rebased again)19:40
Odd_Blokemeena: Merged, thanks!20:05
meenaGoneri: any chance you can tell me what function _supported_write_config is supposed to be?20:05
meenaOdd_Bloke: what about my other seventeen patches & bugs tho?20:07
Odd_BlokeOh wow look what's that over there behind you20:07
* Odd_Bloke runs20:07
meenaOdd_Bloke: a santa hat.20:08
meenaincidentally, we're also watching Rare Exports rn.20:08
blackboxswrharper: btw that is a painful script to have to have written for intermittent Openstack deployment failures :/20:11
rharper=(20:12
rharpertook better part of a day; but it's written now =)20:12
meenahow do i ask cloud-id to give me debug (trace!) output from why it thinks it's on a None cloud?20:14
powersjha I have a merge to update our FAQ with that very command20:14
powersjsudo DEBUG_LEVEL=2 DI_LOG=stderr /usr/lib/cloud-init/ds-identify --force20:15
powersjwe should clean that up fwiw20:15
powersjand give cloud-id an alias to run that20:15
blackboxswnice powersj (your FAQ radar was up on that ;) )20:15
meenapowersj: i've hacked up ds-identity to do the right thing… but cloud-id / cloud-init don't20:17
Odd_Blokemeena: As background, cloud-id just reads data that cloud-init wrote when it was running.  Josh has pointed you at the command that does the actual determination.20:17
Odd_BlokeHmm, interesting.20:17
Odd_Blokemeena: Can you describe the problem in more detail?20:17
meenaactually, let'stry to run that command, and see wht happens, cuz i just looked at my /run/cloud-init/cloud.cfg and i modified it, so it might be wrong: https://gist.github.com/56a994dc4ccba1a81d7024c24bcd2aa420:19
meenahttps://gist.github.com/27ac6b7ad02e1fa9de9145b1f4458f4d ← output20:24
meenacloud-id is stil saying none20:25
rharpercloud-init pulls from the instance-data.json in /run/cloud-init ;  so unless you've re-run cloud-init after making ds-identify changes, you won't get a new instance-data.json file20:28
rharpermeena: so, 1) modify ds-identify 2) forcefully run it;  3) cloud-init clean --logs  4) cloud-init init --local; cloud-init init20:29
rharperthat'll be enough to have cloud-init go through the datasource and write out instance-data.json20:29
meenarharper: ds-identify is giving the right response: datasource_list: [ Hetzner, None ]20:30
rharperlook at instance-data.json20:30
meenai think the problem is still that i'm on Goneri\s branch and the network stuff is write-only…20:31
rharperright, if you can;t reach the hetzner network IMDS, then you won't get the DataSourceHetzner to indicate that it was found; and no datasource was processed20:32
meenanow let's fix that before i continue to nonsensicle debugging…20:34
meenarharper: https://twitter.com/emilyst/status/1204823144956977152 apropos of almost nothing. (except, perhaps, https://github.com/canonical/cloud-init/pull/53 ;)20:43
Odd_Blokeblackboxsw: https://trello.com/c/6Pr4OxuI/48-sru-verification-10-azure-do-not-lock-user-on-instance-id-change doesn't have anyone's face on it but is marked complete, and I don't see a verification script in the repo.20:52
Odd_BlokeWas that intentional?20:52
blackboxswOdd_Bloke: yes was intentional as we pinging the microsoft bug author on that one since we can't reproduce that failure mode easily20:53
blackboxswso I marked complete, but no owner for us Odd_Bloke20:54
Odd_Blokeblackboxsw: But don't we need the SRU template stuff for our exception?20:54
blackboxswOdd_Bloke: nope. The SRU template stuff is for us to continue to go above and beyond our existing exception in cases where we think we might have a regression.  Our exception is really just. does cloud-init CI and integration test suite continue to pass, and can manual upgrade validation on ## clouds validate we haven't regressed (plus maas and cdoqa)20:57
blackboxswOdd_Bloke: any other one off validation we do (with SRU templates) is just performed as we see fit (because we don't officially have to do that anymore due to our exception)20:58
blackboxswOdd_Bloke: rharper we were planning on dropping some of this one-off validation additional work when we've cleared a couple of SRUs without detecting potential regressions during SRU validation process.20:58
blackboxswearlier it had  been fairly frequent where we have detected some potential regression during our one-off SRU validation.20:59
Odd_Bloke"The test case should be developed as a part of each resolved bug or new feature." <-- this makes it sound like it's expected that we are validating bug fixes and features20:59
blackboxswOdd_Bloke: I had been those test cases as only those applicable to the given manual cloud test (as we require unit tests for any new feature/bug fix that is added in general)21:01
blackboxswand in the previous 6 or so SRUs, we don't attach any manual SRU one-off validation test output to the SRU bug21:01
blackboxswonly the cloud-specific test21:02
blackboxswand maas/cdoqa21:02
Odd_BlokeOK, fair enough.21:04
Odd_BlokeI hadn't realised (or had forgotten :p) we were doing more than we needed, that may have modified my opinion on which issues needed additional verification.21:05
blackboxswwe are just *that* amaaaazing21:05
blackboxswyeah, which is also why our reviews on this one-offs (non-cloud) don't really need to be too strict. But, good to show that the feature is exercised without regression to common install behavoir.21:06
blackboxswrharper: https://github.com/cloud-init/ubuntu-sru/pull/75/files#r357378780 one question otherwise +1 on openstack21:26
meenadef _supported_write_network_config() is part of distros/__init__.py21:28
meenais there a way to set a breakpoint in the distro base class, so that when i run what rharper suggested, I'll know which methods i need to fix / reimplement / restore?21:31
Odd_Blokemeena: Is what he suggested not addressing the issue?21:32
meenaOdd_Bloke: as mentioned previously, @goneri's branch is currently write only, in terms of networking, he was quite zealous in removing some quite rusty code… instead of trying to grease it21:34
meenabut that rusty code was still capable of answering questions like, are we connected?21:35
meenais this interface up?21:35
* meena taps mic: is this thing on? 21:36
Odd_Blokemeena: Sorry, is this related to the cloud-id issue, or a separate thing?21:36
meenayesno21:36
Odd_Blokeblackboxsw: rharper: https://bugs.launchpad.net/cloud-init/+bug/1849731 <-- do you have any suggestions on how to construct a test for this?21:37
ubot5Ubuntu bug 1849731 in cloud-init "Introduction of subplatform around 18.5 broke ConfigDrive" [Undecided,Fix committed]21:37
meenait's python debugging: how do i find out when my parent class is being called, so i know which methods i need to implement21:37
Odd_Blokemeena: I'm afraid I still don't really understand what you're trying to do.21:39
Odd_BlokeBut maybe trying to do One Big Branch which will address a bunch of issues is what is tripping (you|Goneri) up?21:40
meenahttps://stackoverflow.com/questions/6954116/ruby-s-method-missing-in-python this. i basically need to log here21:40
Odd_BlokeYeah, that would do what you described.21:41
meenathanks for rubbery duckling21:42
meenaeven though you doubted me 😒21:42
Odd_Blokemeena: My concern with using the __getattr__ method is that it presupposes that you will be running the code in a way which will actually call all the methods that are missing.21:46
Odd_BlokeIf this is about working out which of the removed methods should be restored, I think you're better inspecting the codebase to work that out.21:47
meenabut there's so much code 🙀21:48
meenabut, yeah, might be more feasible21:49
Odd_Blokemeena: FreeBSD has a grep implementation though, right? ;)21:49
meenai use ripgrep, and emacs' jump to definition21:50
meenawell, on my Ubuntu (elementary) laptop. on the servers its mostly vi, cuz i keep forgetting I've installed nvim21:53
Odd_Blokemeena: https://github.com/canonical/cloud-init/pull/61/files#r357391834 <-- I broke down how I looked at one of these, as I figured my working might be useful reference21:57
Odd_Blokemeena: I think my most important realisation was that all of our Distro subclasses are also called Distro, so the `Distro.get_devicelist` calls are referencing cloudinit.distros.freebsd.Distro, _not_ the super-class.21:58
Odd_BlokeWhich is _extremely_ confusing when reading that code.21:58
blackboxswOdd_Bloke: for testing config drive you could create an lxc with a /config-drive directory (via lxc-proposed-snapshot  on bionic)22:02
meenaOdd_Bloke: i do have that much figured out already, but, yeah, it's incredibly confusing, and, unnecessarily so22:02
blackboxswOdd_Bloke: this may be helpful https://github.com/cloud-init/ubuntu-sru/blob/master/bugs/lp-1673637.txt22:04
blackboxswit's a test case seeding config-drive content on lxc22:05
blackboxswand the validation would be cloud-init query v1.subplatform22:06
powersjblackboxsw, so are we all set on the SRU minus some internal testing?22:08
blackboxswpowersj: yep, I'm adding a nit for puppet validation of csr. I think Odd_Bloke is grabbing the configdrive22:08
blackboxswI'll attach the cloud logs now22:08
blackboxswso SRU will be ready minus internal testing22:08
powersjok so monday, darn22:09
blackboxswjust attached all SRU logs to the bug https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/185487223:06
ubot5Ubuntu bug 1854872 in cloud-init (Ubuntu Eoan) "sru cloud-init (19.2.36 to 19.3.41) Xenial, Bionic, Disco, Eoan" [Undecided,Fix committed]23:06
blackboxswahosmanMSFT: and I just published tip of cloud-init to Ubuntu Focal 20.04:   cloud-init v. 19.3-74-g129b1c4e-0ubuntu123:09
blackboxswcoincidentally this will also drop a package dependency on ifupdown2 from focal as well23:10
tribaalawww rharper spent some time on my unfinished branch... sorry man!23:34
tribaalI should not have opened it (even though it's a "draft" PR23:35

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!