/srv/irclogs.ubuntu.com/2015/10/27/#ubuntu-devel.txt

=== salem_ is now known as _salem
=== _salem is now known as salem_
=== salem_ is now known as _salem
pittiapw: ack, I filed bug 1510362 about it for nwo03:57
ubottubug 1510362 in linux (Ubuntu) "[xenial] autopkgtest regression" [Undecided,New] https://launchpad.net/bugs/151036203:57
pittiGood morning03:57
=== nudtrobert1 is now known as nudtrobert
dholbachgood morning07:59
seb128hey dholbach08:02
dholbachsalut seb12808:04
melodiehi11:13
sladenhello melodie11:14
melodiehi sladen11:14
sladenjust ask your question so that everyone can see it at the same time11:14
melodieI have a question about the content of ISO, because I want to improve Bento Openbox Remix build. The question is about pool/dist and about EFI or any added package such as drivers for specific hardware, and so on: how does the system know if it has to choose a package in the pool directory? Does it work just by "magic hardware detection" and some pipes between it and apt?11:16
melodieI hope my question does not sound too dumb, as I really don't have a clear idea about that sphere of processes11:16
melodiesladen do you think anyone here will have a doc to point me to, or insights they can provide?11:19
sladenasking questions is never dumb11:19
melodiethanks :D11:19
sladenhowever I'm still trying to work out if /I/ understand the question correctly, in order to be able to answer it or point you towards somebody who might know11:19
sladenmelodie: have you got an example of package that might/might not be chosen, and which you have in mind?11:20
sladenmelodie: eg. are you thinking of something like an Nvidia graphics driver, or a USB modem driver?11:21
sladenmelodie: ideally all hardware should do something useful/sensible when plugged in, and it's a bug if it doesn't11:21
melodieyes, first idea is about efibootmgr11:21
sladenmelodie: but remixes are normally more about remixing the user applications/desktop environments/languages rather than hardware support11:22
melodieI aim to bring Bento Openbox Remix to a tech level as close as possible to what is provided by the official versions11:22
melodieI do it starting from "outside", and will dive into the tech deeper and deeper as time goes11:23
melodie2012: the remix is LTS and works (done with Ubuntu Builder)11:23
melodie2014 started working on the Trusty LTS (still the same tool but is not dev anymore, and someone shows me the seeds, however my configs aren't packaged so I have to be patient)11:24
sladenI think vaillant used to be one of the developers of Ubuntu Builder11:24
melodienow I start using Customizer instead of Ubuntu-Builder, but I want to master the "pool/dist" area, which I haven't so far. next I'll see if I can learn packaging the user prefs11:24
sergiusenscjwatson, hey, is that "y-series" for destination series I see on launchpad's copy packages interface expected?11:25
melodienever mind Ubuntu Builder, it's over. Customizer works and while the project continues to provide recent ISO's it's alive. Between versions I want to learn to make it better11:25
cjwatsonsergiusens: yes, you won't actually be able to copy to it because it's marked Future but the series exists11:26
cjwatsonsergiusens: though maybe the copy target vocabulary should filter it out, file a bug11:26
melodiesladen when I'll handle  pool/dist and be able to package the parts that still need to be packaged, I'll do a meta-package, a session and see if I can start using real seeds.11:27
sergiusenscjwatson, sure thing, thanks11:27
melodiesladen so in the case of efibootmgr package, and knowing there is also the BOOT/EFI/ directory in the 64bits isos, how does that work under the hood? would you know that,11:28
melodie?11:28
sladenFourDollars: ^^think you might have been the last person to touch efibootmgr (since then it's been a straight import from Debian)11:29
FourDollarssladen: yes?11:30
melodiesladen oh!11:30
melodiehi FourDollars11:30
FourDollarsHi melodie11:30
melodiethis is about my noobs questions related to how pool/dist and other additions such as BOOT/EFI/* are "seen" and used in the 64bits ISOs (or other pool packages seen but the hardware recognition tools)11:31
melodieI'd like to understand how all this is processed during the start of the live and or after it's started11:31
sladenmelodie: I don't know boot stuff well anymore; but I should imagine that locating packages comes a lot later than the early stages of boot.  So they seem to be going in different directions11:34
FourDollarsThe files under BOOT/EFI/* can be downloaded from some url. Let me search for it.11:34
sladenmelodie: EFI->Grub->Kernel->initramfs->rootfs->...->Debian-installer (or any particular GUI font end for it)11:35
melodiesladen where "EFI →" is the EFI in the "BIOS / EFI" computer?11:36
melodiethat would be "EFI → Grub-EFI" ?11:36
FourDollars /EFI/BOOT/BOOTx64.efi is defined by the UEFI spec. for 64 bits UEFI BIOS.11:36
melodieFourDollars I read you11:37
FourDollarsRead it from http://www.uefi.org/specifications11:37
FourDollars /EFI/BOOT/BOOTx64.efi will bring up the GRUB and then GRUB will bring up the Linux kernel and initramfs.11:38
melodiehow does the "system" (what part of it?) acknowledges the /EFI/BOOT/BOOTx64.EFI|grubx64.efi presence?11:40
melodieFourDollars I try to understand how the "magic" works there11:40
FourDollarsThat is what UEFI BIOS does.11:40
sladenmelodie: the EFI firmware looks through the available boot devices, and looks if any of the available boot devices contains a file called '/EFI/BOOT/BOOTx64.EFI', loads it into memory, and runs it11:41
FourDollarsmelodie: UEFI BIOS will try all boot entries in NVRAM and then search for some pre-defined files.11:41
FourDollarsmelodie: There is no magic and they are documented at http://www.uefi.org/specifications.11:42
melodiesladen oh ok!11:42
melodieFourDollars ok, some reading to do, thanks11:43
FourDollarsmelodie: no problem11:43
melodieif you have insights for me, about how that works for other packages in pool in the ISOS? I have browsed through the pool of several Ubuntu official flavors and noticed they don't necessarily contain the same packages, which means the devs did different choices (not fixed by an Ubuntu convention for instance)11:45
FourDollarsmelodie: BTW, the efibootmgr only edits some variables in NVRAM as I know.11:45
melodieFourDollars I don't know about that, it's deeped (lower/closer to the hardwareà that I have learned about.11:46
melodieFourDollars I just browsed my favorite computer dictionnary to read about NVRAM : that's the firmware, right?11:47
melodiedeeped/deeper* (sorry for the typo)11:47
sladenmelodie: one (shouldn't) need to worry about EFI when remixing11:47
FourDollarsmelodie: http://archive.ubuntu.com/ubuntu/dists/trusty/main/installer-amd64/current/images/cdrom/debian-cd_info.tar.gz11:48
melodiesladen I use Ubuntu Mini Remix to build on it, which means there is no EFI nor pool/dist at the beginning11:48
melodieFourDollars I look11:48
TJ-melodie: UEFI boot from removable media expects to find the Simple Media Boot Path, which means an EFI System Partition with the boot-loader at /EFI/BOOT/BOOT${ARCH}.EFI11:48
melodieFourDollars that's the sources?11:49
sladenmelodie: Grub11:50
FourDollarsmelodie: The files under /EFI/BOOT/ such as BOOTx64.efi is in ./grub/efi.img in  http://archive.ubuntu.com/ubuntu/dists/trusty/main/installer-amd64/current/images/cdrom/debian-cd_info.tar.gz.11:50
melodieTJ- yes, ok I get this. (I have installed only on two machines having UEFI so far, and learned that side of the story)11:50
FourDollarss/is/are/11:50
TJ-melodie: OK, I only just came in. Was there some other aspect to the info you are looking for?11:51
melodieTJ yes, about the packages in pool/dist : what process makes them either chosen or ignored, depending on the hardware where the live boots?11:51
sladenmelodie: are you wondering about different architectures (x86 vs amd64)11:52
melodieFourDollars I would not know yet how to use the link you just gave me, apart from looking what it contains (but I'll learn that later when the time comes, now I just try to understand the mechanics)11:52
TJ-melodie: Do you mean, for an ISO image which has package A in its /pool/ already, what makes the installer (d-i/ubiquity) install that package, or do you mean what controls the packages actually included in the /pool/ at CD image creation time?11:52
melodiesladen no, I guess 32bits don't have UEFI?11:53
FourDollarsmelodie: OK11:53
TJ-melodie: there is 32-bit UEFI too11:53
melodieTJ- " what makes the installer (d-i/ubiquity) install that package" and if you explain me what controls the package installed in the pool at CD image creation time, I'll just ask you if the info in that doc is enough for me to get the anwser?  →11:54
melodiehttps://help.ubuntu.com/community/InstallCDCustomization#Modify_pool_structure_to_include_more_packages11:55
melodieTJ- ah!11:55
TJ-melodie: The installed image, including packages, is generally controlled by a preseed file11:55
melodie32 bit uefi...11:55
TJ-melodie: the preseed file is generally included on the kernel command-line at boot-time, by the boot-manager11:56
melodieTJ- ok preseed, the last thing I'll need to worry about, once I will have created packages for everything, which I haven't yet11:56
melodieI'll do some tests with the command lines included in that part https://help.ubuntu.com/community/InstallCDCustomization#Modify_pool_structure_to_include_more_packages11:59
=== hikiko is now known as hikiko|ln
FourDollarsmelodie: The live system is bought up by casper. You can see boot=casper in the kernel parameter.12:00
melodieFourDollars yes!12:01
FourDollarsmelodie: It is very helpful to extract initrd.lz and read what it is doing.12:01
FourDollarss/extract/decompress/12:01
melodiesome time I'll ask to be explained the different contents in /usr/share/casper, for now all I know is that some scripts are to be considered and or added in the casper/bottom section.12:01
melodieFourDollars initrd.lz needs to be renamed to be extracted, right?12:02
melodieto .gz then gunzip?12:02
TJ-melodie: best thing is to read the source/documentation od the cdimage package. See e.g. http://bazaar.launchpad.net/~ubuntu-cdimage/ubuntu-cdimage/mainline/view/head:/README12:02
cjwatsoninitrd.lz is compressed with lzma, not gzip.  use unlzma -S .lz12:03
cjwatson(might be worth making it be xz at some point so that we don't have to argue with iso9660 file formats about >3-char extensions)12:03
melodie"cpio -i < initrd12:04
melodie185979 blocs12:04
melodie"12:04
=== _salem is now known as salem_
melodiecjwatson oh so!12:04
FourDollarsmelodie: https://wiki.ubuntu.com/CustomizeLiveInitrd12:05
melodiecjwatson I didn't know about the "unlzma -S .lz" and renaming it to gz then gunzip then cpio worked. there is some trick under.. ?12:06
melodieFourDollars I look12:06
melodieFourDollars cjwatson TJ- sladen I appreciate your help and insights greatly! This is all very good knowledge for me. I need a cup of coffee and a piece of bread and will be right back. :)12:08
melodiecjwatson unlzma -S does that:12:24
melodie"# unlzma -S initrd.lz12:24
melodieunlzma: compressed data not read from a terminal. Use -f to force decompression.12:24
melodieunlzma: For help, type: unlzma -h"12:24
melodieI'll retry with -f12:25
cjwatsonmelodie: you didn't accurately transcribe what I said12:25
cjwatson-S is an option that takes an extension12:25
cjwatsonunlzma -S .lz initrd.lz12:25
melodieah!12:25
melodieok12:25
melodiecjwatson well:12:26
melodie# unlzma -S .lz initrd.lz12:26
melodieunlzma: Decoder error12:26
melodieand:12:26
melodie# file initrd.lz12:26
melodieinitrd.lz: gzip compressed data, from Unix, last modified: Thu Oct 22 22:47:26 201512:26
melodiewhen I do move to gz, then gunzip, then cpio -i it works12:26
cjwatsonoh, well, if your image is broken such that it's generating gzipped files and putting them in .lz ...12:27
cjwatsonafaik the standard Ubuntu images are not broken in that way12:27
cjwatson$ sudo mount -oro vivid-desktop-amd64.iso /mnt12:27
cjwatson$ file /mnt/casper/initrd.lz12:27
cjwatson/mnt/casper/initrd.lz: LZMA compressed data, streamed12:27
melodiecjwatson that's intriguing I'll do a search to try to find why12:33
=== hikiko|ln is now known as hikiko
melodiecjwatson I'll try to see if I find a difference in the /etc/mksquashfs directory scripts12:59
mitya57slangasek, can you please subscribe the foundations team to setuptools-scm bugs (for bug 1510532)?13:03
ubottubug 1510532 in setuptools-scm (Ubuntu) "[MIR] setuptools-scm" [Undecided,New] https://launchpad.net/bugs/151053213:03
=== nudtrobert1 is now known as nudtrobert
dokomitya57, tumbleweed, barry: python3.5 now the default in xenial13:38
barrydoko: +113:39
mitya57\o/13:39
rbasakXenial is open for general uploads now, right? That's what "Archive: open" means?13:40
barrydoko: https://docs.google.com/spreadsheets/d/1PnPLZRM2hu7ucv1yuq7Fd5hjNw_DYupHIYZpoP4-xHk/edit#gid=013:41
rbasakOnly there hasn't been an ubuntu-devel-announce mail, hence I'm not sure.13:42
dokoohh, have to finish that one ... doing now13:42
dokorbasak, sure, but keep stuff migratiing, look at update_excuses13:43
mitya57doko, and thanks for quick processing of my mir/rm bugs!13:43
mitya57Why is pdf2djvu build failing on ppc64el without any log? https://launchpad.net/ubuntu/+source/pdf2djvu/0.9.2-2ubuntu1/+build/819690313:47
mitya57Tried retrying, without any change. Built on other 5 archs successfully.13:47
barryanybody looking at software-properties i386 failure?  if not i will13:50
cjwatsonmitya57: that would mean it crashed the builder13:52
cjwatsonthough that's an awfully quick BUILDERFAIL ...13:53
cjwatsonoh, there was a DNS event earlier today, wonder if it was that13:54
cjwatsonmitya57: right, it's building now, I bet it was the internal DNS outage on that nameserver that was fixed earlier.  I'll clean up the other similar occurrences13:57
cjwatsonthough I'm still seeing even quite recent failures13:57
rbasakdoko: thanks14:05
cjwatsonmitya57: definitely still something up, I've raised it with ops14:12
tumbleweeddoko: \o/14:19
tumbleweedI guess my python-cffi autopkgtest fix worked then :)14:19
dokotumbleweed, we overrode it14:20
tumbleweedaww14:20
* tumbleweed goes to see if it worked14:20
tumbleweedyep14:21
tumbleweedexcellent14:21
dokotumbleweed, mitya57: so the one big exception is ipython (just disabled the tests). not sure if an update to the 3.x or 4.x series would be any better, but the strange thing is they do not mention python 3.5 at all on their site14:21
dokobarry, fyi, I'm waiting with the 3.4 removal until -proposed is a bit more settled14:25
cjwatson^- I'm not sure that's what I needed to see in a professional channel14:25
barrydoko: +114:26
barrybdmurray: mind doing a quick review of https://code.launchpad.net/~barry/software-properties/lp1510558/+merge/27585414:45
deepak_bhagchandi have to perform a benchmarking exercise in which i have to compare performace of two virtual machines hosting a mail server in one i have to use a full fledge operating system(linux) and in other i have to use a shell down version of the same linux in which i have to remove the modules with functionalities idont require for my application15:25
rbasakdoko: I would get augeas migrating but it's stuck on a ppc64el build failure with no build log. Known issue I hear?15:32
dokorbasak, retried15:33
rbasakI tried retrying already (I think), still failed.15:33
dokorbasak, it's how you need to push the retry button ;p built.15:38
rbasakdoko: thanks :)15:38
rbasakdoko: FYI, the first time I got what looked like a random segfault (I did have a build log). Then on retry I failed to get build logs. In case that matters with other failures.15:39
rbasakTechnically not a segfault15:39
rbasakPASS: test-wctype-h15:39
rbasakSKIP: test-wcrtomb-w32-5.sh15:39
rbasakPASS: test-verify.sh15:39
rbasak../../build/ac-aux/test-driver: line 95: 21284 Aborted                 (core dumped) "$@" > $log_file 2>&115:39
rbasakFAIL: test-lock15:39
=== NishanthMenon__ is now known as NishanthMenon
=== kyrofa_ is now known as kyrofa
mitya57cjwatson, it's fixed now, thanks for the investigation15:48
cjwatsonmitya57: well15:52
cjwatsonmitya57: sort of, depending on luck15:52
cjwatsonrbasak: DNS resolution issue in the bos01 region, IS has been trying to figure it out this afternoon15:53
cjwatsonrbasak,doko: I'll be retrying all the affected builds in bulk once it's sorted out15:53
rbasakOK, thanks.15:55
slangasekmitya57: setuptools-scm> done, though the intended process is to get agreement from the team that they will be the bug contact, and get them subscribed, before the package is promoted... (doko)15:55
dokomitya57, I agreed =)15:55
dokoslangasek, I agreed =)15:56
slangasekdoko: ah, and apparently did the subscription too, so ok ;)15:56
dokoyes15:56
dokodirecthex, do you plan a mono update for this cycle?15:57
directhexdoko: yes. have been snarled up by unrelated work stuff, but should have time to get that done in early december with any luck15:58
dokota15:58
directhex4.0 or 4.2 series, depending on QA15:58
directhexthe packaging work is ~done since i get paid to do it, it's the distro integration which takes time now15:59
=== davidcalle is now known as davidcalle_afk
stgraberinfinity: TB meeting?17:06
TJ-any network-manager maintainer about? I'm trying to debug bug #1048430 and it seems to depend on an Ubuntu-specific patch adding DBus dnsmasq updates17:27
ubottubug 1048430 in network-manager (Ubuntu) ""dnsmasq not available on the bus"" [Undecided,Confirmed] https://launchpad.net/bugs/104843017:27
cjwatsonrbasak,doko,mitya57: all fixed now for real thanks to IS figuring out that one of the two DNS forwarders was busted17:28
rbasakThanks17:31
=== pstolowski is now known as pstolowski|afk
cjwatsonhttp://blog.launchpad.net/ppa/ppas-for-ppc64el may be interesting to people who want to work on ppc64el build failures17:37
ogra_cjwatson, erm, did someone just switch the image builders to default to xenial ?18:24
* ogra_ just had a (what he thought) wily rebuild explode on all arches18:24
infinityogra_: xenial's the devel series, not sure what you expect.18:25
infinityogra_: A wily build would need DIST=wily18:25
ogra_infinity, dunno, that image builds only default to it once it actualy can build ... i.e. once the archive is complete enough :)18:26
infinityThe arvhive is "complete" from day 1...18:27
infinityarchive, too.18:27
infinityIt's not like we start from scratch.18:27
ogra_well, i have different 404s on the different arches in the logs18:27
infinityLog?18:27
ogra_oh and we use a PPA18:28
ogra_which also doesnt have xenial support yet18:28
infinityRight, if your PPA is 404ing, you could mass copy from wily to xenial. :P18:28
ogra_well, i could just turn on xenial at all for the PPA, prehaps thats sufficient ...18:29
cjwatsonogra_: yeah this is just your PPA18:32
ogra_right18:32
cjwatsonogra_: you can only "turn it on" by uploading or copying something into it18:32
ogra_i just did a xenial upload to it, that should get me the Packages files18:32
cjwatsonmass copying would normally be sensible, why not do that?18:33
ogra_the wily stuff should all be in archive already anyway18:33
cjwatsonok, well, either make the Packages files exist, or make your lb config stop using the PPA, one or the other18:33
* ogra_ would like to only use the PPA for overrides and in case something is missing, directly copy to the archive 18:34
ogra_a new release is a good reason to clean up :)18:34
dobey or make it not fail if the Packages file in the PPA doesn't exist :)18:45
dobeyrobustness ftw18:45
ogra_i guess that would have to be hacked into apt18:46
=== pstolowski|afk is now known as pstolowski
infinitydobey: I wouldn't call that robust, I'd call it just the opposite.  If you ask it to use a PPA and the PPA is busted, that *should* fail.19:04
infinitySo, the only correct answers are "don't use the PPA" or "populate the PPA".19:05
dobeypotato, legume19:15
=== davidcalle_afk is now known as davidcalle
tewardwith a Conflicts: line in a package, is there such a thing as version not equal to the version provided in the source package?19:48
teward(i.e. this:    Conflicts: package (!= ${source:Version}),...19:48
=== salem_ is now known as _salem
gQuigsis anyone already planning a systemd related UDS session?  (I'd like to discuss systemd user sessions, but it doesn't seem to warrant a session to itself)20:07
=== _salem is now known as salem_
=== salem_ is now known as _salem
sil2100cyphermox, doko: re: the ocaml transition, looking at xstrp4 it seems that the installability issue would be resolved by us pullin in the camlp4 source package from Debian - which, on the other hand, requires us to first merge the new ocaml version from Debian21:03
sil2100cyphermox, doko: so I guess this would have to wait as doko mentioned Debian prepares a new ocaml version anyway or something21:04
sil2100Moving forward21:05
sil2100cyphermox, doko: anyway, how would you guys prefer me to resolve those issues? Since for most cases I don't have the permissions to merge/sync - is poking here ok?21:13

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!