/srv/irclogs.ubuntu.com/2014/03/18/#ubuntu-kernel.txt

hallynxnox: sadly, that didn't actually help00:51
xnoxhallyn: =/ oh well.00:51
xnoxhallyn: i can try to dig into it, but deffinatly not tonight.00:52
hallynnow really i expected it to make it worse (since noone is using it :)00:52
hallynxnox: np, it's late there - ttyl00:53
hallynthanks! gn00:53
ParkerROr as another alternative... is the kernel in the new builds managed by a deb file?00:53
ParkerR*new touch builds00:55
=== _leb is now known as leb
=== hatch__ is now known as hatch
=== gerald is now known as Guest85398
=== lag is now known as lag`
=== lag` is now known as lag
=== henrix_ is now known as henrix
apwParkerR, the kernel is built in a .deb yes though typically upgrades in touch images are not done directly11:38
ogra_the kernel deb is only used by the android package 11:39
ogra_(which generates boot.img and system.img (the latter has the modules))11:39
ogra_just on a sidenote, forcing performance from initrd on boot on mako gains exactly nothing :(11:44
apwogra_, worth a try11:55
ogra_yeah11:55
ogra_it actually takes a few milliseconds longer with performance ... i guess thats due to the echoing "performance" into sysfs11:56
ogra_AHA !12:13
ogra_root@ubuntu-phablet:/# ls -l /var/lib/ureadahead/debugfs/12:13
ogra_total 012:13
ogra_root@ubuntu-phablet:/# mount | grep debugfs                              12:13
ogra_none on /sys/kernel/debug type debugfs (rw,relatime)12:13
ogra_so i guess thats why ureadahead doesnt work anymore12:13
apwaha?12:13
ogra_well, ureadahead reads from /var/lib/ureadahead/debugfs/12:14
ogra_doesnt it ?12:14
apwisn't that normal?  doesn't ureadahead mount it temporarily on its own mointpoint during its run and unmount it after?12:14
ogra_hmm12:15
apwas it may need it before it is mounted by the system12:15
ogra_hmm12:16
apwogra_, so actually it uses /sys if it is mounted, else it mounts its own12:17
ogra_ah, k 12:17
apwogra_, is there a bug for this ?12:21
ogra_nope, still researching 12:22
ogra_funnily it seems ot have profiled something at some point 12:22
ogra_*to12:22
ogra_but it is never executed on boot after that 12:22
apwis the packs directory writable ?12:22
apwor ... the place that the "reprofile" marker is stored12:23
ogra_yes12:23
ogra_i see packs that have been generated on first boot 12:23
ogra_http://paste.ubuntu.com/7113774/12:23
ogra_even specoific ones for the container 12:23
apwhave you tried just running it to see if it works?12:24
ogra_it doesnt 12:24
ogra_root@ubuntu-phablet:/# start ureadahead12:24
ogra_ureadahead stop/waiting12:24
ogra_callong "ureadahead --daemon" directly immediately returns ... i dont see it in the processlist12:25
apwogra_, and without --daemon and with --verbose ?12:33
ogra_looks ok http://paste.ubuntu.com/7113819/12:34
apwogra_, ok so you don't see it because it only takes 0.02s to do the readahead, as this is flash it is not that supprising12:36
ogra_it would still show up in a bootchart 12:37
ogra_(it used to)12:37
apwso that implies it is not starting, which says the start condition is wrong12:37
apwi assume we ahve a mountall job still ?12:38
apwogra_, ^12:40
ogra_yep12:40
ogra_http://people.canonical.com/~ogra/touch-bootcharts/ubuntu-phablet-trusty-243.png12:41
zequenceinfinity: No update to the precise kernel?12:44
apwogra_, there is a level at which things get collapsed when they are tooo short12:45
ogra_hmm12:45
apwwhich you can turn off when generating hte graph12:46
ogra_ah, there is a HZ= setting 12:47
* ogra_ sets it from 25 to 50Hz12:48
ogra_so that gets me a lot more small processes listed (and makes the tgz of the bootchart twice as big) ... but still no trace of ureadahead ... 12:54
ogra_now i wonder ... 12:55
apwogra_, could still be tooo small to see i be reconing12:55
ogra_yes, the point is that the interesting pack files arent the default pack 12:56
ogra_(see my ls output of /var/lib/ureadahead above) 12:56
apwarn't those loaded by the other job?12:56
ogra_and these mountpoinnts arent handled by mountall 12:56
ogra_but before in the initrd12:56
ogra_i.e. they are already mounted when mountall starts 12:57
apwok then they won't get loaded anyhow12:57
ogra_start on mounted DEVICE=[/UL]* MOUNTPOINT=/?*12:57
apwsee /etc/init/ureadahead-other.conf which loads them based on the mount announcements12:57
apwso i suspect you want your own job which runs ureadahead against the special mounts12:58
ogra_so the question is, does mountall emit "mounted" for already mounted devices in fstab12:58
ogra_jodh, do you know ?^^^12:58
apwi would doubt it, you can look at the emitted events right?12:59
ogra_i think we dropped "initrcl events" at some point 12:59
apw"The  mounted event is generated by the mountall(8) daemon after it has mounted a filesystem."13:00
apwi read that as for things it has mounted itself only13:00
ogra_bah, k 13:01
ogra_so i need something that loops through fstab and calls ureadahead for each mountpoint regardless13:01
ogra_and starts on startup or so 13:01
apwyou know your special ones right?13:01
apwthey are always the same phone wise ?13:01
ogra_well, i guess we want everything but rootfs13:02
ogra_no, but fstab is assembled by initrd on boot 13:02
ogra_(on every boot)13:02
ogra_bah, and now i killed my remote device :(13:24
jodhogra_: yep, apw is correct.13:53
* ogra_ tries ureadahead-other with a hardcoded value for MOUNTPOINT ... but that doesnt seem to work either 13:55
apw?13:57
apwwhat did you put in there13:57
apwogra_, ^13:57
ogra_/android/system13:57
ogra_my main concern is to get the container up faster (since most of the other bits have to wait for it)13:58
ogra_i made the ureadahead-other job start on "starting mountall" and replaced the $MOUNTPOINT in the exec line with the path 13:59
ogra_i was assuming this should just work 14:00
ogra_but i neither see it in the bootchart nor do i notice any speedup ... 14:00
apwperhaps boot it --debug on the kernle command line to see if it runs14:06
jodhogra_: try adding '--force-trace'14:07
jodhogra_: also, what's in /var/log/upstart/ureadahead-other.log ?14:07
ogra_jodh, but that will create a new pack ... i have the packs from first boot already14:07
ogra_i just want it to make use of them :) 14:07
jodhogra_: on those new mountpoints?14:08
ogra_i emptied the log a few boots ago (before i started hacking the job) and there is now nothing in it 14:08
ogra_root@ubuntu-phablet:/# ls /var/lib/ureadahead/android*14:08
ogra_/var/lib/ureadahead/android.firmware.pack14:08
ogra_/var/lib/ureadahead/android.persist.pack14:08
ogra_/var/lib/ureadahead/android.system.pack14:08
ogra_so there is one pack for /android/system ... if i read that correctly 14:09
jodhogra_: ok, have you added --verbose atleast then to get some output?14:09
ogra_not yet 14:09
ogra_will do that now14:09
* ogra_ reboots with --verbose14:09
ogra_root@ubuntu-phablet:/# cat /var/log/upstart/ureadahead-other.log 14:11
ogra_nothing ...14:11
* ogra_ moves the start condition to "started mountall"14:12
ogra_still no log 14:12
ogra_aha14:12
ogra_manually starting it produces something in the log14:13
ogra_http://paste.ubuntu.com/7114261/14:13
ogra_smells like mountall is never emitting "started" or so 14:13
* ogra_ moves to "start on startup" 14:14
ogra_lets see14:14
ogra_funny, nothing new in the log14:15
jodhogra_: is ureadahead-other.log empty or non-existent?14:15
jodhogra_: try running "sudo initctl notify-disk-writeable" and check the log again14:15
ogra_it was empty (because i did "echo > ... " ) ... 14:15
ogra_it got conent when i manually started the job 14:15
jodhogra_: that's cheating :)14:16
ogra_ok, got it 14:16
ogra_"start on filesystem" works 14:16
ogra_now it writes to the log on every boot14:16
* ogra_ dropes the --verbose and creates a bootchart 14:17
ogra_*drops14:17
ogra_i dont get why "start on startup" didnt work though 14:18
apwmaybe you don't have the ureadahead daemon availabe then14:18
apwand it would want to write to teh ro filessytems anyhow14:19
ogra_nope14:19
ogra_the filesystem is assembled from initrd14:20
ogra_it is fully set up before we even get to the rootfs14:20
ogra_with all writable bits 14:20
ogra_and now i see ureadahead in my bootchart \o/14:20
ogra_finally14:20
ogra_but it doesnt speed up anything :(14:21
ogra_ah, no, it gains me .5 sec 14:22
ogra_lxc-start runs half a sec earlier now14:22
ogra_what a great gain for half a day of work :P14:23
apwogra_, thats pretty good :)14:27
ogra_well, lets see, i guess i can write a loop script that processes all packs (apart from the default one)14:29
ogra_that might in the end get me 2sec then :P14:29
=== hatch__ is now known as hatch
=== cmagina is now known as cmagina-away
apwyeah it might14:47
=== hatch is now known as negatron
=== negatron is now known as hatch
jsalisbury**14:54
jsalisbury** Ubuntu Kernel Team Meeting - Today @ 17:00 UTC - #ubuntu-meeting14:54
jsalisbury**14:54
=== cmagina-away is now known as cmagina
mdeslaurcking: so is thermald a dependency of something? what pulls it in? should I install it?14:58
ckingmdeslaur, just install it14:59
mdeslaurcking: is something going to install it by default on our images?14:59
ckingfor t+1 we will make it a dependency on the kernel14:59
ckingbut for now it's an opt-in14:59
ckingit still is a "maturing" daemon15:00
mdeslaurcking: ok, thanks!15:00
=== cmagina is now known as cmagina-away
=== cmagina-away is now known as cmagina
=== cmagina is now known as cmagina-away
apwhallyn, ok this is occuring because you have to have read/execute access to all layers in a directory "sandwich" to read the directory15:09
apwhallyn, i am trying to figure out if this is an oversite of a deliberate decision15:10
hallynapw: yeah it seemed possible to be on purpose, but i couldn't find where in the code itw as doing it15:13
apwhallyn, you are hitting the opendir behaviour there, where it opens each dir in each layer and merges the contents to make the virtual dir you see15:15
apwso if you make the bottom directory rx the you can see in there as well15:15
apwand i asusme the under in your scenario is empty as well15:16
=== cmagina-away is now known as cmagina
apwhallyn, and the permissions check is specifically checking all layers, it is not an accident15:18
apwhallyn, it has a little loop for when we are talking about a read from a directory15:18
apwhallyn, i assume this comes from using an unmodified directory image as a lower level here ?15:21
hallynapw: it may nto be an accident, but is it worthwhile?15:21
hallynyes15:21
hallynoverlayfs doesn't do it...15:21
apwoverlayfs is much less mature, so that tells me little about which is right15:22
apwwhat is it stopping you doing15:24
hallynapw: juju creates a clone of a stock ubuntu image, then wants to chown ubuntu: /etc/ssl/private15:24
hallynapw: thinking sensibly about the behavior, I really think aufs is the one in the wrong15:25
apwi think you need to justify that15:25
hallynsure,15:25
hallynto do the chown you have to be root in the first place,15:25
hallynyou can't end up corrupting the underlyign fs, you can only 'leak' data through the upper fs,15:26
hallynbut since you're root, you *could* just as well do it to the underlying fs.  there is no reasonable case i can think of where you werne't meant to 'leak' the data in the file you're chowning15:26
infinityzequence: Nope.15:30
apwhallyn, ok that needs some thinking about and upstream discussion i am sure, i'll see if i can fix it as a basis or that discussion15:43
hallynapw: ok, thanks.  i'll watch for the thread.15:48
hallynapw: if upstream nacks it, then i guess we'll just have to issue a warning somewhere in lxc15:49
hallyn(or drop aufs from lxc clone support - stgraber :)15:49
infinityhallyn: Well, juju could hack around the issue with 'cp -a /etc/ssl/private /etc/ssl/private.new && rm -r /etc/ssl/private && mv /etc/ssl/private.new /etc/ssl/private'16:19
infinityWith a chown in there somewhere.16:19
infinityNot that that's ideal, but would get you over the hump for now.16:19
hallyninfinity: for that particular case, yeah.  but if we're goign to suggest that aufs is usable for lxc clones, that's not sufficient16:19
hallynlike i say every backing store has its deficiencies for clones, but that's just not usable16:20
infinityhallyn: Not usable is a bit extreme.  How often does one actually try to do that (traverse a directory they can't read)?16:20
infinityIs that chown happening in an unprivileged container, or outside?16:21
infinity(ie: do you have real root?)16:21
infinityIf you have real root, I agree that the behaviour seems entirely wrong.16:21
infinityIf you don't, I'm not sure how you're reading it at all, seems like a different bug being leveraged. :P16:21
hallyninfinity: i don't think real root matters.16:22
hallynif i create a rootfs,16:22
hallynthen create an aufs clone container from that unprivileged, it shoudl be the same situation16:22
hallynuid 100000 (my root) chowns a dir to uid 1001000,16:22
hallynbut uid 1001000 can't read it despite owning it16:22
hallynmaybe instead of not suable i should have said not supportable :)16:23
hallyn(as in we'll get tons of weird bug reports)16:24
infinityI'm struggling to even find a 750 directory in my schroots to experiment with. :P16:24
infinityAhh, hello /var/cache/ldconfig16:25
infinityOkay, yeahp, has nothing to do with containers at all, that's what I wanted to make sure of.16:26
infinity(trusty-amd64)adconrad@cthulhu:/var/cache$ ls -al | grep ldconfig16:26
infinitydrwx------  2 adconrad adconrad   60 Mar 18 10:25 ldconfig16:26
infinity(trusty-amd64)adconrad@cthulhu:/var/cache$ ls ldconfig/16:26
infinityls: cannot open directory ldconfig/: Permission denied16:26
infinityThat seems fundamentally broken to me.16:26
hallynthe only way it would be needed is if aufs wrongly allowed non-root to chown the dir16:27
hallynor, does aufs support some fancy uid translation gorp?  /me checks16:27
hallynnot sure waht the 'different uid/gid/permission' in mount.aufs manpage is referring to16:28
apwmost of the docs are in janglish16:53
jsalisbury##16:54
jsalisbury## Ubuntu Kernel Team Meeting - in 5 minutes - #ubuntu-meeting16:54
jsalisbury##16:54
* ppisati -> chest press17:06
=== jsalisbury changed the topic of #ubuntu-kernel to: Home: https://wiki.ubuntu.com/Kernel/ || Ubuntu Kernel Team Meeting - Tues March 25th, 2014 - 17:00 UTC || If you have a question just ask, and do wait around for an answer!
UserErrorWhy is the Lustre FS in staging?17:50
UserErrorIt can be used from userspace and none of the desktop or notebook users will ever use it. You have a greater chance of someone using the tdfx support.17:51
ogra_why do you ask downstream ? 17:51
ogra_thats a question for the people that decided to put it in stagint (the linux kernel ML for example)17:52
UserErrorUbuntu has made additions and subtractions17:52
UserErrorDon't play that game.17:52
UserErrorThis is pure bullshit bloat for something that should be in userspace on non-niche distros17:53
apwUserError, why are we worrying about 1.3M ?18:03
UserError10MB18:03
UserErrorfor a feature no-one will ever use and will also be in VM kernels by default18:04
apwi can only find one module, which is 1.3M, and why would it be in VMs18:04
UserErroraccording to the latest staging on 3.13.518:04
UserErrorit is nearing 10MB on 64bit18:04
UserErrorwhich is the only one worth using since 32bit still targets i68618:05
UserErrorapw, Ubuntu stated the reason it wasn't including that vpadu stuff was because of ISO size18:06
UserErrorSo i started figuring out that the reasoning was bullshit18:06
UserErrorBy going through every single file that was useless. Now i'm on the kernel.18:06
UserErrorWay to keep PandaBoard and Tegra shit in an x86 FS18:07
UserErrorand exynos in the kernel18:07
apwso build your own kernel with what you want in it18:12
apwnot that the size of them in the filesystem tells you waht they are on the iso18:13
UserErrorIgnore the bloat behind the curtain until you make your own curtain18:14
UserErrorNevermind that Exynos = ARM18:14
apwit is a trade off between the greatest usability against the effort to work out what is completely unusable18:15
UserErrorIt isn't usability if it is impossible to use18:15
UserErrorPlease, please use an x86 kernel on a exynos SoC18:15
apwif the config system says something is usable, turning it on is therefore the default position, if the thing is actually configurable but useless would require individual items to be investigated18:16
apwso i am sure we have a number of things turned on which cannot be used, due to the lack of correct dependancies18:16
UserErrorARM =/= X8618:16
UserErrorwhat is the problem18:17
UserErrorNothing is going to change that18:17
apwyou are not hearing me, i am telling you how one ends up in this position18:17
apwyou may have found a clear case indeed and if someone files a bug for it, we may indeed turn it off18:17
apwi am saying that these cases are not clear wthout investigation18:18
UserErrorOk fine, FS wise, off the top of my head18:18
UserErroralsa package18:18
UserErrorkernel wise, hw arch exynos18:18
UserErrorAlso some TI stuff in there i have the path to somewhere18:19
apwyep and if someone has the configuration options and the justificaiton, and puts them in a bug18:20
apwthere is a high probability it will get looked at and turned off18:20
UserErrorRight but the flaw is the fact that it could've been added from the beginning when the same SoC is powering the phones of the people who should know better18:21
apwwhen every kernel update has hundreds of new options one has to have a default position18:21
apwand that is to turn on things which the config system says are applicable to an arch18:21
apwand if we have 100 engineers looking at the config then it would likely be perfect18:22
UserErroryou could literally just use grep on the config with the major arm licensee models18:23
apwi could go and save space on a machine whiich on average doesn't care18:23
apwor i could go and work on some new feature we need18:23
apwwhich is it18:23
UserErrorright, which is going to harm the idea of ubuntu touch and other modile ideas18:24
apwnope they have non-generic kernels which are much much smaller18:24
UserErrorwhen you are having that many writes on every security update18:24
UserErrorevery hyrbid device with similar nand/emmc to a phone18:24
UserErrorall those writes18:25
apwand touch devices have a minimal config, so this does not apply18:25
UserErrorall the VMs and appliance containers18:25
UserErroryou assume they are minimal, i beg to differ18:25
apwand the VMs do not have the entier kernel installed18:25
apwthere is a split, between the core bits needed on a virtual system, and the rest18:25
UserErroryou're right, they only have joystick nonsense by default18:26
UserErrorand sound18:26
apwi am sure they have some bits they should not indeed, but they are less than a third of the size of the full ones18:26
apwand if you have some concrete config changes you thing are viable, feel free to propose them18:27
apwalong with a testing plan18:27
UserErrorThe thing is that this has a commutative impact18:27
UserErrorwhat is the launchpad for this18:28
apwi asume you are asking what package to file bugs against, that would be 'linux'18:28
apwbut "your package is crap" isn't going to get much attention, concrete changes would likely18:29
UserErrorpretty much removal18:29
UserErrorthe package is crap18:29
UserErrori went through every file on sunday18:30
apwwhat is vpadu18:32
UserErrorvdpau*18:33
UserErrorhttp://www.phoronix.com/scan.php?page=news_item&px=MTYwNzU18:33
UserError"too big"18:34
UserErroryet the kernel can grow by tens of MB in a day18:34
UserErroryet panda and tegra can just chill in alsa never to be used ever by anyone18:35
apwfrankly though i may even agree that we have a lot of bloat, your attitude is getting to me18:35
* ogra_ wonders if UserError is like that in real life too 18:35
apwi dunno, i am nicer on irc than in real life in general18:40
ogra_heh18:41
apwto which i am sure you can attest :)18:42
ogra_well, when i meet you in person you are usually drunk already :P 18:42
apwi tend to mellow after enough of that18:43
ogra_(but i'm usually in the same state) 18:43
UserErrorIs there any plan to make the 32bit kernel or X11 / toolkit / MIR visual packages useful by targeting anything other than the PentiumPro platform with zero optimizations for hardware that actually fits the ram and CPU minimums? 18:43
infinityUserError: Why would we build a 32-bit kernel that doesn't run on 32-bit hardware?18:43
infinity(Hint, you can install the amd64 kernel with a 32-bit userspace, if that's what you're after)18:44
UserErrori686 with a single chipset that supports a theoretical minimum on one hand is insanity 18:44
UserErrornot what i am talking about18:44
UserErrorIf the recommended minimum for many packages is 800-1Ghz, and only one i686 era CPU can meet those marks on a quad setup that threads horribly...18:45
UserErrorIntel even proved that the major reason 64bit was faster was optimizations18:46
infinityErr, they did?  Neat trick.18:46
UserErroryeh, they did18:46
UserErrorin 201218:46
infinityThe major reason x86_64 is faster is lack of register pressure.18:46
UserErrorhttp://software.intel.com/en-us/blogs/2012/09/26/gcc-x86-performance-hints18:47
UserErrorcough18:47
infinityFor some things like string functions, optimisation can make a huge difference, but you get that regardless.18:47
infinityBecause IFUNC is a beautiful thing.18:47
mjg59UserError: That page appears to contain nothing to support your assertion18:47
UserErrorPeople are holding back performance on 32bit because of a single chipset18:48
apwindeed it seems to support the contention that increased registers is a ke factor18:48
UserErrormjg, the gain difference with the same CPU18:48
apwkey18:48
UserErrorbecause of initial targeting of SSE2 vs nothing18:48
UserErrori686 is nothing18:48
UserErrorIn a few months it will be the birthday of the MMX instruction set.18:56
UserErrorStill lacking, since 1997 http://download.intel.com/support/processors/pentiummmx/sb/24318504.pdf18:56
=== retoaded is now known as retoaded_afk
=== cmagina is now known as cmagina-away
infinityzequence: You happy with the kernels in your PPA?22:25
infinityzequence: Nevermind, they look good to me, copying.22:27
=== alai is now known as alai_afk
UserErrorsubmitted the exynos and lustre paths22:39
UserErroron to the nitty gritty22:39
infinityUserError: Is all this really fallout from one article quoting one guy as to why he's not shipping and supporting a mesa driver?22:59
UserErrorNo22:59
infinitySure sounded like it.22:59
UserErrorI'm just removing the excuse of the diff as icing on the cake. I actually am super anal about bloat23:00
UserErrorbut their words did get plenty of my side-eye23:00
=== emma__ is now known as emma

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!