/srv/irclogs.ubuntu.com/2021/03/22/#ubuntu-devel.txt

=== juergh is now known as Guest58246
eoli3n_Hi08:34
eoli3n_is there any plan to let desktop image use autoinstall ?08:35
eoli3n_as you removed kickstart support since 20.04, what is the recommended way to automate desktops desployments ?08:45
eoli3n_deployments*08:46
eoli3n_what is the nickname of Ryan Harper here please ?08:57
xnoxeoli3n_:  i'm not sure what you mean by kickstart support being removed.12:15
xnoxeoli3n_:  desktop installation automation has not been changed for years, and can be done in 20.04 the same way it has always been possible to do.12:15
eoli3n_actually i was wrong, just reworking on this. Problem is not that kickstart is removed, problem is that i can't deploy in EFI mode with kickstart12:15
xnoxeoli3n_: what's not working for you?12:16
xnoxi deploy ubuntu desktop with EFI always.12:16
eoli3n_with kickstart ?12:16
xnoxyes12:16
eoli3n_hm12:16
xnoxeoli3n_:  your partitioning does have ESP right?12:16
xnoxone kind of needs that =)12:16
eoli3n_how do you trigger EFI deploy mode with kickstart ?12:17
xnoxby booting the machine in EFI mode12:17
=== jamesh_ is now known as jamesh
xnoxwith either EFI iPXE or EFI Http boot12:17
eoli3n_yes, but when i tested, my booted EFI host deploy legacy system, but maybe i did forget to adapt my partition table12:17
eoli3n_xnox what iso do you use ?12:24
eoli3n_the main desktop one ?12:24
eoli3n_i used the netboot one, which can't deploy in efi mode12:25
xnoxeoli3n_:  yes i always use the desktop one.12:25
xnoxand i network boot initrd & kernel from it, using shim + network build of grub grubnetx64.efi. And pass url=http://path/to/matching-desktop.iso12:26
xnoxeoli3n_: i only always deploy desktop using the desktop.iso with preseeding.12:26
xnoxthat's the only way to deploy Ubuntu Desktop the right way.12:27
eoli3n_any link which describe the process ?12:27
eoli3n_xnox is there any chance to adapt it to nfsroot the iso ?12:29
eoli3n_i manage 800 nodes, deployed by group of 4012:30
eoli3n_i can't let each node get a full 2G iso12:30
xnoxeoli3n_:  "i can't let each node get a full 2G iso" => but they will need to get 2G of data one way or another to complete desktop install.12:31
xnoxso not sure it matters _when_ they do that =) from initrd on boot, or elsehow.12:31
xnoxBut there is nfs root mount option too, if you can export nfs mount.12:31
xnoxhttps://discourse.ubuntu.com/t/netbooting-the-live-server-installer/14510 => is how to setup pxeboot, it does work with UEFI too if your UEFI supports pxe (see like the first comment). Instead of the live-server.iso you just use the desktop one.12:31
eoli3n_xnox nfsroot is much more efficient12:34
eoli3n_because of the server itself12:34
eoli3n_40x dl of a big file is worse than letting clients get a lots of little files12:35
xnoxboot=casper netboot=nfs nfsroot=192.168.122.73:/srv/iso-mount/ => make sure that you export the full mounted desktop iso; and that initrd&vmlinuz you boot are from it.12:35
xnoxif you can't mount the iso make sure to copy _all_ of it, including hidden files.12:35
xnoxthere are some details on automating the preseed of Ubiquity https://wiki.ubuntu.com/UbiquityAutomation12:36
xnoxi.e. booting with automatic-ubiquity and supplying the preseed.12:36
xnoxi.e. cp -r /mnt/. /srv/nfs/somewhere => note the '.' in /mnt/. to ensure all the hidden files are copied and exported.12:37
eoli3n_i already does this12:37
eoli3n_do*12:38
xnoxeoli3n_:  cool. so yeah, my preference is to boot in uefi, either download/mount iso from the initrd (url=http://...) or do nfsroot mount, and automate that. There are no reasons not to boot in EFI mode.12:41
xnoxeoli3n_: if you don't want to use PXE / tftp, you can point your servers to perfrom UEFI HTTP boot => point them at shim + grubnetx64.efi12:42
eoli3n_but you use kickstart or ubiquity only  ?12:42
eoli3n_i use ipxe and tftp12:42
xnoxeoli3n_:  there is no native support for kickstart, and never was. it always translated kickstart into d-i/ubiquity compatible preseed.12:42
xnoxeoli3n_:  thus i prefer to use native formats, thus yes, i simply write/serve/boot with preseed for ubiquity.12:43
eoli3n_i know, but i already have a kickstart script for legacy mode12:43
xnoxor autoinstall.yml for the subiquity live-server iso.12:43
eoli3n_xnox oula oula oula oula12:43
eoli3n_lets restart fresh, to let you understand from where i come, to where i want to go, and where i'm now12:43
xnoxeoli3n_: kickstart should work too. I can't remember if we build preseed-kickstart into the ubiquity images.12:43
xnoxlet me check that.12:44
xnoxeoli3n_:  you also did say taht your kickstart doesn't work, rigth? =) in EFI... hence if it doesn't work, is it really there?12:44
eoli3n_i used ubuntu ""kickstart"" to deploy legacy hosts with pxelinux/tftp. Now i need to deploy in EFI mode so i worked a lot on server iso to use autoinstall, i'm really near to get it work12:45
eoli3n_but i wonder if its the right way12:45
eoli3n_now i don't have much time so i need to choose a quick and proper way12:46
eoli3n_there is no good documentation about this12:46
eoli3n_that's sad12:46
eoli3n_a kind of guide12:47
xnoxeoli3n_:  when you say you used ubuntu ""kickstart"" can you show me what you mean?12:47
eoli3n_yes, just a sec12:47
xnoxjust a few snippets / quotes of it.12:47
xnoxeoli3n_:  your request is not unique. I am pondering to run a public demo netboot/install server that "works" and then let people copy it.12:48
eoli3n_xnox https://x0.at/UWZ.txt12:48
eoli3n_i need to deal with dualboot12:48
xnoxeoli3n_:  the only bad thing about your preseed is the part of "generate partitioning script"12:49
eoli3n_i can't do without it12:49
eoli3n_because of dualbooting12:49
xnoxeoli3n_:  if you change the sfdisk <<EOSF bits to use label gpt, add EFI partition, then add disk_partone => it will start to work in EFI mode too.12:49
eoli3n_ahhh12:50
eoli3n_ok12:50
xnoxeoli3n_:  you need to adjust that one, to create ESP12:50
eoli3n_that was my question12:50
xnoxeoli3n_:  that's what i did tell you at the very start of our conversation =)12:50
xnox"xnox>eoli3n_:  your partitioning does have ESP right?"12:50
eoli3n_yep yep12:50
xnoxif you have no ESP in your partitioning, when installer gets to "now i install shim+grub into ESP, it goes oh oh"12:51
xnoxeoli3n_:  and it's best to always create ESP and always use GPT => it works with legacy mode, efi mode, dual boot, with any windows&linux combo, etc.12:51
eoli3n_ok12:51
xnoxeven if the deploy is done in bios or efi mode, it will installs and boot in either.12:52
xnoxour ubuntu desktop is versatile like that, and allows to boot itself irrespective of how one installed it.12:52
eoli3n_so lets try to adapt this instead of working with autoinstall12:52
eoli3n_xnox http://archive.ubuntu.com/ubuntu/dists/bionic/main/installer-amd64/current/images/netboot/netboot.tar.gz12:53
eoli3n_is this able to deploy in EFI  mode ?12:53
xnoxeoli3n_:  it's incomplete. and does not support secureboot.12:54
eoli3n_i don't use secureboot12:54
eoli3n_what do you mean by "incomplete" ?12:54
xnoxeoli3n_:  you'd need to add shimx64.efi / uefi-ipxe / grubnetx64.efi to get secureboot (shim), uefi netboot capability (ipxe or httpboot grubnetx64.efi from focal+)12:55
xnoxeoli3n_: one needs more than just that, to boot in efi mode is what i mean.12:55
eoli3n_if i extract kernel+initrd and boot it with ipxe, no problem then, right ?12:56
xnoxyeah, that works.12:56
xnoxsome expect the shim/signed uefi ipxe/grub/configs to be in that tarball too.12:56
eoli3n_so in that case, what is the benefit to prefer the main desktop.iso ?12:56
xnoxeoli3n_:  that thing, will never deploy the same desktop as the desktop.iso will.12:57
eoli3n_lets precise something12:57
eoli3n_i just need the installer to deploy the minimal system12:57
xnoxeoli3n_:  no option to install minimum ubuntu desktop; no option to install correct matching nvidia drivers; no way to configure and install OEM kernel for the certified hardware12:57
eoli3n_then i use ansible to deploy everything else12:57
eoli3n_ansible does all those things for me12:57
xnoxno option to have the correct defautl snaps installed; following the correct tracks12:57
xnoxno oem config...12:58
eoli3n_hm12:58
xnoxeoli3n_:  some/none of the above maybe of interest to you12:58
xnoxeoli3n_:  and/or you may already be fixing those things separately.12:58
eoli3n_but then will not be any 22.04 netboot so12:58
eoli3n_lets switch to the main desktop.iso12:58
xnoxeoli3n_:  i also don't see ubiquity supporting kickstarts. and there is new installer in progress which will have autoinstall.yml support just like server iso12:58
eoli3n_thanks for your help xnox, i was a bit lost12:58
eoli3n_"there is new installer in progress which will have autoinstall.yml"12:59
eoli3n_i need this !12:59
xnoxeoli3n_:  swithcing to the main desktop.iso / and or testing that, may help to futureproof your deployements.12:59
eoli3n_ok12:59
xnoxeoli3n_:  see the New Installer articles / github repo where it is being developed. At the moment early design stages.12:59
eoli3n_so two moves : move to desktop.iso, and translate the kickstart part to ubiquity script12:59
eoli3n_any link about this ?13:00
xnoxeoli3n_:  yes, if you boot / deploy your kickstart, there should be somewhere in /var/log/installer the translation. Cause d-i does translates it into preseed. It should be a good enough starting point.13:00
xnoxeoli3n_:  plus you don't actually do anything special much.13:01
xnoxyou pick the right disk; and configure ansible13:01
xnoxhttps://code.launchpad.net/ubuntu-test-cases => we have many preseeds automation for various things13:02
eoli3n_does ubiquity automation only, support %post chrooted script and %pre ?13:02
xnoxeoli3n_:  https://bazaar.launchpad.net/~ubuntu-test-case-dev/ubuntu-test-cases/desktop/view/head:/preseeds/default.cfg is more or less all you need.13:02
xnoxbut you do need preseed/late_command to do more things kind of like what your %post does to do ansible13:02
xnoxand i think you will want to do a hook before partma to figure out the right drive to autopartition with a shell script13:03
xnoxcause i think you are trying to iterate things and find the one you like.13:03
xnoxfor that you can use partman/early_command13:03
xnoxeoli3n_:  or check what your kickstart got translated into preseed terms.13:04
xnoxi am sorry, i have to go, but i will come back to read backscroll here.13:04
eoli3n_thanks a lot for your help13:06
=== mfo_ is now known as mfo
rbasakcjwatson: any further thoughts on my git-ubuntu rich history thread please? I think, with your feedback in mind, it still makes sense to implement my proposed spec (but with a singular Vcs-Git-Ref), with a view to switching to "push" at some far point in the future. Do you concur?13:07
cjwatsonrbasak: Since you're treating the rich history as best-effort, I think I concur for now, yes.13:10
rbasakOK, thanks! And for your detailed feedback.13:11
cjwatsonrbasak: I do think you should add at least some kind of fallback-and-retry for temporary failures even in the short term - they won't be *that* uncommon13:11
cjwatsonrbasak: Even if it's just the kind of fairly basic thing that lazr.restfulclient does (I mean in terms of overall algorithm, rather than specifics)13:12
rbasakUnderstood.13:13
rbasakI can add some short-lived retries that will hold up the importer worker (and therefore other imports) for an hour or two.13:14
rbasakLeaving the import to move on to others and then come back to it is harder, since I don't currently have a soft-fail mechanism in the queue architecture.13:15
rbasakThat's something I should probably add, but isn't there yet.13:15
cjwatsonrbasak: Seems reasonable.  Most such temporary failures are likely to be service-wide anyway13:33
eoli3n_xnox any chance to get my ks file to work as is ?14:26
eoli3n_i found the translation in /var/lib/preseed/log, but it doesnt contains everything14:26
eoli3n_"xnox: eoli3n_:  i also don't see ubiquity supporting kickstarts."14:40
eoli3n_hm.. ok14:41
eoli3n_xnox some questions :14:55
eoli3n_- how to generate my partman-pre script14:56
eoli3n_- how to run multiple command in chroot after install14:56
eoli3n_https://help.ubuntu.com/lts/installation-guide/armhf/apbs05.html#preseed-hooks14:56
eoli3n_this is really unclear14:56
eoli3n_found this about multiple command in chroot : https://github.com/dsgnr/Ubuntu-16.04-Unattended-Install/blob/master/preseed.cfg#L19515:02
xnoxeoli3n_:  yeah ';' works for multiple commands. not nice, but it's what it is.15:12
xnox"how to generate my partman-pre script" => not sure what you mean.15:12
eoli3n_https://x0.at/UWZ.txt15:13
eoli3n_see the # PRE # part15:13
xnoxeoli3n_:  if you want to control everything by hand, something like this works => https://secopsmonkey.com/custom-partioning-using-preseed.html15:13
xnoxwhich disables all the automatic partitioning, and does it by hand.15:13
eoli3n_i do want automatic partitionning15:13
eoli3n_i just want to force to restore part1 which is windows15:14
eoli3n_my pre part is to not overwrite windows if present15:14
eoli3n_if not present, it prepare the place15:14
eoli3n_that's why i dump diskid15:14
eoli3n_and regenerate as is15:14
eoli3n_it actually clear everything except windows part15:15
eoli3n_clears15:15
eoli3n_can i wget that script ?15:15
eoli3n_d-i partman/early_command string wget -O /tmp/pre.sh http://prodpeda-cesium.infra.domain.fr/preseed/fds/pre.sh; /bin/bash /tmp/pre.sh15:17
xnoxeoli3n_:  so you either have empty disk => wipe everything; or you have windows on part1.15:17
eoli3n_lets try this15:17
eoli3n_xnox i don't get your question15:17
eoli3n_i do have both15:17
xnoxeoli3n_:  when you have part1 => do you have enough disk space after part1? or do you need to resize windows too?15:17
eoli3n_if this is a new host, first use, then prepare part1, else if windows present, keep it functionnal15:17
eoli3n_i have enough space15:18
xnoxeoli3n_:  cause i wonder if you can just select use largest free, and it will always do the right thing.15:18
eoli3n_that's what i use15:18
eoli3n_preseed partman-auto/init_automatically_partition select biggest_free15:19
xnoxhm15:19
xnoxoh, so you create empty part1, such that later you can have windows on it?15:19
xnoxinteresting.15:19
eoli3n_better than that15:19
xnoxor if it is there already, don't touch it?15:19
eoli3n_if windows is present, is "recreate" over it to keep it intact15:19
eoli3n_yes15:19
xnoxinteresting.15:19
xnoxdo we currently break windows? =/15:20
eoli3n_that was the only way i found15:20
xnoxcause i would have hoped that biggest_free doesn't break/touch windows that is there anyway.15:20
eoli3n_i had some issues yes15:20
xnoxah, netboot.tar breaks things yes.15:20
eoli3n_windows needs a repair if disk_id changed15:20
xnoxubiquity doesn't => it has more logic.15:20
eoli3n_oh !15:20
eoli3n_lets try without then15:21
xnoxeoli3n_:  ah, interesting. maybe we still break disk_id, but i thought we didn't.15:21
eoli3n_but with GPT partition table, maybe its different15:21
xnoxeoli3n_:  it would be interesting to try without anything. Imho, it is a bug if it breaks windows and doesn't just use biggest_free.15:21
eoli3n_problem is that i fix two cases15:22
xnoxtrue....15:22
eoli3n_first is windows is present : so without anything it "would" work, as you say15:22
eoli3n_but if nothing is already present, the place will not be prepared if i drop my script15:22
xnoxhopefully doing "d-i partman/early_command string wget -O /tmp/pre.sh http://prodpeda-cesium.infra.domain.fr/preseed/fds/pre.sh; /bin/bash /tmp/pre.sh" will just work as you mentioned earlier.15:22
eoli3n_ok15:22
eoli3n_maybe i can use sfdisk in another way15:23
eoli3n_to just create the part without restauring the full partition table15:23
eoli3n_in 2 steps15:23
eoli3n_restoring15:23
eoli3n_running15:30
eoli3n_just a thing : how to disable the filesystem check at startup ?15:30
eoli3n_that one : https://x0.at/xsf.png15:32
xnoxeoli3n_:  it's turned off by default in hirsute; i think you can boot with fsck.mode=skip and it will not run.15:34
eoli3n_what is hirsute ?15:34
eoli3n_lets try "fsck.mode=skip"15:34
xnoxeoli3n_:  Ubuntu 21.04 => development version of the next Ubuntu release.15:34
eoli3n_oh ok15:35
eoli3n_fsck.mode=skip doesnt disable the filesystem check15:38
eoli3n_https://x0.at/zL_.txt15:38
eoli3n_if you have more exemples of seed files, i take15:45
eoli3n_(filesystem check seems to still print but does not run (stuck at 0% then disapear))15:51
oSoMoNxnox, what's the state of https://bileto.ubuntu.com/#/ticket/4491, are you still working on it?15:52
xnoxoSoMoN:  that approach failed, but yes still working on it.16:09
oSoMoNack, thanks16:09
xnoxeoli3n_:  stuck at 0% then disappear => is not running =) the visual UX improved later.16:10
=== ijohnson is now known as ijohnson|lunch
=== ijohnson|lunch is now known as ijohnson

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!