/srv/irclogs.ubuntu.com/2010/03/12/#ubuntu-devel.txt

blueyed_Apport retracing service is down?00:01
Debian911can anyone confirm that the version of eglibc (2.11.1-0ubuntu4) is superior then that of Debian Expermential is using as I can see there version 2.11-0exp6 lists a fix for "Add the fallocate64() syscall.  Closes: bug#568924" but cant see it listed in Ubuntus' changelog - http://changelogs.ubuntu.com/changelogs/pool/main/e/eglibc/eglibc_2.11.1-0ubuntu4/changelog and http://packages.debian.org/changelogs/pool/main/e/eglibc/e00:37
cjwatson$ nm -D /lib/libc.so.6 | grep fallocate6400:37
cjwatson000c5f70 T fallocate6400:37
Debian911cjwatson: 00000000000dd130 T fallocate64, 00000000000da010 T posix_fallocate64 - am I to assume we're fine and my system has fallocate?00:39
cjwatsonthat means your libc has the fallocate64 syscall stub, yes00:39
crimsunDebian911: since you parted +1 before I could paste the reference, see http://sourceware.org/git/?p=glibc.git;a=commitdiff;h=1f3615a1c97a030bca59f728f998947f852679b9 and walk the appropriate sources in loggerhead, e.g., http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/lucid/eglibc/lucid/annotate/head:/sysdeps/unix/sysv/linux/wordsize-64/Versions00:40
slangasekKeybuk: so when casper-md5check is done checking, it says "press any key to continue"... what's a better way to do that than exhaustively listing all possible keys in an argument to ply_boot_client_ask_daemon_to_watch_for_keystroke()? :)  Should I tell plymouth to shutdown and stay on screen, then claim the console back?00:46
jonoare you folks aware of a bug in Rhythmbox where the volume is set to minimum by default?00:49
Keybukslangasek: you can't claim the console if you've told plymouth to shutdown00:50
Keybuknot unless you want to deal with raw keyboard and graphics mode00:50
KeybukI guess you'd want to extend plymouth to support any key press00:51
slangasekKeybuk: OOI, would dealing with raw keyboard and graphics mode be so hard?  Would getchar() no longer DWIM?00:56
Keybukslangasek: it would very definitely not DWYM00:57
Keybukthat kind of thing only works in XLATE00:57
slangasekthere'd be characters on the fd even when no key was pressed?00:57
Keybukyeah, you get them for other things iirc00:58
slangasekhuh, ok00:58
* Keybuk isn't an expoert00:58
Keybukyou can try it, of course00:58
Keybukplymouth quit --retain-splash is probably what you want00:58
Keybukthat'll leave you in graphics mode, with the keyboard in raw00:58
* slangasek nods00:59
directhexwhat was i supposed to add to /etc/fstab to make my ntfs mount not hang forever?01:00
directhexah, nobootwait01:01
* lamont pounds his head on grub2's desk01:04
lamontgiven the wonderful error messages about "terminal" and "serial" being unknown/invalid/lalala-need-to-reboot-_AGAIN_, how do I teach grub2 that the console lives on ttyS1,38400?01:05
* \sh tells lamont to use ILO2 and runs far far away ;-)01:08
* lamont throws rocks at \sh01:09
lamontno ilo on this beast01:09
micahglamont: any chance of an updated nmap in debian?01:09
lamontfortunately, I was done playing with what I needed to do today, and decided to maybe put lucid on it to play01:09
\shlamont: GRUB_CMDLINE_LINUX_DEFAULT="console=tty0 console=ttyS0,9600n8" ?01:09
lamontmicahg: I think I even have it packaged.  I just need to verify it and upload.  OTOH, been sick much of this week, so I'm playing catchup tomorrow01:10
micahglamont: k, thanks, feel better :)01:10
\shlamont: the hint came from http://linux.xvx.cz/2009/08/debian-with-grub2-and-serial-connection/#comments01:11
lamont\sh: and I set that where, I wonder.01:12
* lamont goes to read01:12
\shlamont: Quote: Edit file containing configuration in Debian: /etc/default/grub01:12
\shdunno if that helps you01:12
lamontwe'll see01:14
\shlamont: report back pls :)01:18
lamontCannot find list of partitions!01:19
lamontI wonder where it expects to find that01:20
lamontunder /sys, of course.01:21
lamonterror: bad unit number.01:25
lamonterror: unknown terminal 'serial'01:25
lamont.01:25
lamonterror: unknown command `terminal'.01:25
lamonterror: unknown terminal 'serial'01:25
lamont.01:25
lamonterror: unknown command `terminal'.01:25
lamont[    0.000000] Initializing cgroup subsys cpuset01:25
lamontbut it does continue on into the boot01:25
lamontand then there's the "cute" bit where it drops to busybox because the root disk wasn't there yet, somewhere between 19 and 34 seconds into the boot.  The drive showed up at 38 seconds01:26
lamontso typing 'exit' to busybox?  win01:27
lamontanyway, yeah... that fixed it... now I just need to automate that bit... :-(01:28
lamontand afk for a few hours.01:28
lamont\sh: thanks much01:28
\shlamont: did it work as documented?01:29
\shlamont: plus "add ttyS1 to /etc/inittab" or say upstart to start up a getty for a ttyS01:29
\shor simply add a RIB to your machine ;)01:30
lamontgot a getty all by itself01:30
psusiI'm going over some upstart rules trying to make sure I understand everything and I notice that mountall.conf says stop on starting rcS... does that not block rcS from running until after mountall finishes?  but then mountall daemonizes, which seems to negate that?01:32
slangasekpsusi: what do you mean, "daemonizes"?  upstart supervises daemons.01:34
slangasekand it doesn't block rcS from running until mountall /finishes/, it blocks rcS from running until mountall is /stopped/01:34
psusiwell, the job runs mountall --daemon, so mountall forks into the background to continue mounting and monitoring for devices to appear that still need mounting, then the initial mountall process exits, which means the mountall task is now finished doesn't it?01:34
psusiyes, that difference is what I'm trying to understand01:35
slangasekno, --daemon doesn't mean the task is finished01:35
slangasekthe 'expect daemon' at the top tells upstart to track the grandchild process01:36
psusiso rcS is blocked from running until the mountall daemon finishes, even though the initial mountall process exits after forking?  and that does not happen until all of the devices listed in fstab are detected and mounted?01:36
slangasekno, not "finishes"01:36
slangasekyou're reading it backwards01:36
slangasekwhen rcS starts, upstart *kills* mountall if it's still running01:36
psusithat doesn't make sense... since it should try to start rcS immediately after starting mountall, which can take some time to finish01:37
slangasekno01:37
slangasekI think you misunderstand what the rcS job is01:37
slangasekrcS != /etc/rcS.d01:38
psusiit isn't?  I thought the rcS event caused /etc/rcS to run which executes all the scripts in /etc/rcS.d?01:39
slangasekread /etc/init/rcS.conf for yourself01:39
slangasekit's only executed when booting into single user mode01:39
psusiohh01:40
psusiwhy was I thinking that /etc/rcS was executed on startup?01:40
slangasekit is, but that's executed by /etc/init/rc-sysinit.conf01:40
psusihrm... so a switch to single user runlevel kills mountall then01:40
slangasekyes01:41
psusiso if you boot into single user mode, and mountall takes some time to complete, it is terminated before it finishes mounting everything?01:41
slangasekrc-sysinit.conf is 'start on filesystem' - so mountall won't be killed until it's at least mounted all of the core filesystems01:42
slangasekbecause it's mountall emits 'filesystem', rc-sysinit.conf executes and calls "telinit S", which kills mountall and starts the rcS job01:43
psusiI see, so the mountall process directly contacts init and emits these listed events as it mounts the various filesystems, and the sysV rc system doesn't start up until after mountall has finished mounting the core filesystems?  what are NON core filesystems that it could still be trying to mount?01:43
slangasekat this point, I think it may only be those filesystems explicitly marked 'nobootwait' in /etc/fstab01:47
psusiI see... ok, starting to make sense now... what is the difference between expect fork and expect daemon?  the man page says something about daemon forking twice... I thought a daemon forked once, and the parent process exited leaving the child in the background?01:47
psusiureadahead.conf says exec ureadahead --daemon but expect fork01:48
slangasekmost daemons fork twice, due to esoteric requirements involving process groups01:49
psusiok, so since mountall starts on startup, and ureadahead starts on starting mountall, upstart starts mountall, then without waiting for it to complete, starts ureadahead in paralell?  if so why does ureadahead start on starting mountall instead of on startup?01:51
psusiohh, but because of the daemon directive, it waits for mountall to perform initial startup, then background the daemon before starting ureadahead?01:52
slangasekno, "start on starting" blocks mountall until ureadahead is done01:52
psusihuh?  I thought starting was the very first event auto generated by init?01:52
slangasekstarting, not startup01:53
slangasekbut reading the ureadahead job, I'm wrong01:53
slangasek"start on starting" means ureadahead has to be started before mountall starts01:53
psusiyea, it's mountall that is start on startup, ureadhead is start on starting mountall01:53
slangasek(if ureadahead were a task, mountall couldn't start until ureadahead was done)01:54
psusiI thought it meant ureadahead is started between the time mountall's startup job is run ( which there is none ) and mountall's main job is run01:54
slangasekby "startup", do you mean "pre-start"?01:54
psusiyea01:54
slangasekinit(5) - "pre-start [...] This process will be run after the job's starting(7) event has finished"01:55
slangasekso ureadahead would be started before any pre-start script01:55
psusiso start on starting means this job has to be running before the other job is even pre started?01:56
psusihrm...01:56
slangasekyes01:56
psusibut the other job can be started before this job is considered running?01:57
psusii.e. start this job first, and if it forks or daemonizes, THEN you can start the other job?01:57
slangasekthe processing of the "starting" signal is only done when the jobs it triggers are running01:58
slangasekif this job forks or daemonizes, that's what tells upstart that it *is* running01:58
psusiso if it does not fork or daemonize, but just keeps running... is post-start then run if it exists, then when THAT finishes, the job is considered running?01:59
slangasekpost-start is run after upstart considers the job to be running.  there are a number of different conditions you can set for upstart to wait for before considering the job to be running - the 'expect' options documented in init(5)02:01
psusiwait a second though... ureadahead starts on mountall startING, not started, so it should run in paralell with mountall, not before it02:03
slangasekonce ureadahead has forked, telling upstart that it's started, mountall will run in parallel, yes02:05
psusiI think that is what would happen if it was on startED, but not startING02:05
slangasekno02:05
slangasekthe start condition for mountall is met02:06
slangasekso upstart looks for other jobs that are 'start on starting mountall' or 'stop on starting mountall'02:06
slangasekand processes those first02:06
slangasekand the 'starting' signal isn't done until those other jobs that are '(start|stop) on starting mountall' are started or stopped02:06
psusiit seems to me that the man page is saying that the starting event for mountall is emitted before even the pre-start for mountall is run02:07
slangasekyes02:07
psusiohh... so it processes the starting event, which means start readahead, THEN actually starts mountall?02:08
slangasekyes02:08
psusiso the starting event being emitted is processed synchronously before moving on?  hrm...02:09
Emzzzzhttp://imggmi.info/DSC-1268361777.jpg/ do my tits look big?02:49
=== funkyHat is now known as funkyGit
=== funkyGit is now known as funkyHat
lamontagainst which package do I file the bug where boot bails out to busybox because it gives up on the root disk showing up 4-20 seconds before it does?04:35
lamontwhen the hell did netcat-openbsd become the default?04:39
slangasekmid-lucid-cycle04:40
* lamont looks for a place to vomit04:40
lamontI assume it had rational arguments...04:40
slangasekI don't recall seeing any04:41
lamontI wonder if it's related to us maintaining a fork of netcat-openbsd since hardy04:44
lifelesshmm, confused langpack.. logged in with latin, have klingon menus ><06:10
jdong*blinks*06:23
jdonghttp://manpages.ubuntu.com/manpages/intrepid/man3/printf.3.html06:23
jdong"including the trailing null byte (' <EOF>"06:23
jdongdid what I think happen just happen there?06:23
joefoxlooks like there is something missing...06:25
jdongit literally attempted to interpret the NULL byte in the manpage06:25
jdongwhich signaled an end of string XD06:25
joefoxa '\0' ?06:26
joefoxXD06:26
jdongyup06:26
RAOFInput sanitisation is for wimps.06:27
jdongXD06:27
jdonganyone wanna submit that to thedailywtf for giggles?06:27
jdongor planet Ubuntu?06:27
RAOFAh.  Sweet, sweet SIGILL06:29
joefoxwhat does SIGILL mean?06:30
jdongillegal opcode I'd guess06:30
RAOFThe CPU has barfed on the illegal instruction you've sent it.06:30
joefoxah ok. i am new in this channel06:30
RAOFWell, there's a surprise.  JIT breaks gjs on armel.06:34
RAOFAnd for an *actual* surprise, it also breaks gjs on i386.06:35
RAOFBut works on amd64.  Take that, IA32!06:36
joefox^^06:36
joefoxwhat is armel? sorry all the questions :/06:37
RAOFArm - those swanky, tiny, processors found in phones and moving into tiny netbooks.06:37
joefoxoh ok i know arm06:38
RAOFHurray for trying to build a stable library upon mozjs. :/06:44
micahgRAOF: a bug in mozjs?06:45
RAOFProbably not a bug so much as a changed API without a changed ABI.06:45
RAOFWell, except perhaps on arm, where it SIGILLS.06:45
* micahg just got an armel failure for another uploaded xul192 port06:46
RAOFBut that's xulrunner-1.9.1, 'cause I can't install xul-1.9.2 on there.06:46
RAOFIt also seems that something's changed in the mozjs API.  gjs seems to be assuming that destroying a context will call the finaliser, but it's not getting called.06:47
micahgRAOF: can you tell me where, that's one reason we can't package it as the api changes, I can look it up for you though06:47
RAOFStrangely, this seems to only apply to i386; amd64 sails happily along with the previous behaviour.06:48
micahgRAOF: that's weird06:49
micahgRAOF: is it that test that failed for me?06:49
RAOFIf it was a testsuite failure on gjs-unit /js/self on i386, then yes.06:49
micahgRAOF: jsapi06:50
micahgoh,, js/self06:50
micahgyes06:50
micahgRAOF: do you want me to look into it?06:50
RAOFYeah.06:50
RAOFIf you're likely to be able to hunt it down faster, go for it.06:51
RAOFI'll give you what I've got so far.06:51
RAOF(Once I rebuild this with -DGJS_ENABLE_LIFECYCLE)06:51
micahgRAOF: k06:52
RAOFIt doesn't *actually* break the tests on i386; it just makes them leak memory, which the testsuite detects, and causes a failure.06:52
micahgRAOF: do you know which one specifically?06:53
RAOFGjsFileImporter06:53
RAOFIn particular, initialising GjsFileImporter & then destroying the context won't result in it's finalizer being called, which the testsuite detects and bails on.06:54
RAOFIf you disable JIT, then everything goes swimmingly06:54
RAOFGJS_DISABLE_JIT="aww, yeah" make check succeeds.06:54
micahgbut is it the test or funxtions?06:55
StevenKRAOF: A Duffman quote?06:55
RAOFStevenK: It was going to be GJS_DISABLE_JIT="hells, yes".  Not a Duffman quote :)06:56
RAOFmicahg: I'm not sure what you mean.  The tests themselves generate the expected output.  It's in the teardown method of the testsuite which destroys the js context and then checks that everything's been properly destroyed that it fails.06:57
micahgRAOF: I don't see GjsFileImporter defined anywhere06:57
RAOFgjs/importer.c; it's the javascript name for it.06:58
micahgah, k, sorry, I'm used to C++...06:58
RAOFAs you would be, if you've been wrestling the mozilla beast.06:58
RAOFSo, if you define GJS_VERBOSE_ENABLE_LIFECYCLE during the build, test_user_data/logs/gjs.log will contain debugging information about the initialisation & finalisation of JS IMPORT.07:00
micahgRAOF: do you have the output of that handy?07:00
RAOFhttp://pastebin.ca/1835094 ← successful check, with GJS_DISABLE_JIT07:01
RAOFhttp://pastebin.ca/1835095 -07:02
RAOFThat one's failed.  Note that there's no finaliser called after Destroying JS context07:02
micahgI'll check the finalize function...07:03
RAOFLine 973 of gjs/importer.c07:03
RAOFThat function is simple enough; it's not called anywhere by the gjs code, but it's shoved in the GjsFileImporter JSClass vtable.07:05
micahgyes, but I'm wondeing about the functions it uses07:05
pittiGood morning07:16
pittislangasek: oh, is that not in sendsigs/omit.d? I'll have a look07:17
slangasekpitti: it's an upstart job, so it looks like the handling in /etc/init.d/sendsigs is supposed to ignore it07:17
pittislangasek: I'll track it down07:18
micahgpitti: are the retracers working?07:21
pittimicahg: no, they broke down a couple of days ago, I didn't yet find time to restore them07:21
micahgpitti: k, thanks07:22
RAOFmicahg: Can I leave that with you?  At worst, we can disable JIT on armel & i386, and everything should work.07:25
micahgRAOF: sure07:25
micahgRAOF: my guess is it's returning null where it shouldn't07:26
micahgbut I have to see how the js functions changed07:26
micahgRAOF: would you be able to file a bug in LP and assign to me?07:26
=== tkamppeter_ is now known as tkamppeter
micahgRAOF: actually, I can do it07:27
RAOFOk.  Thanks.07:27
micahgRAOF: I'll talk to asac in the morning (CST) and see if it's worth working on now or later07:28
micahgbut I'll file the bug so we don't lose it07:28
dholbachgood morning07:38
thekorngood morning dholbach :)07:43
dholbachhey thekorn07:43
micahgRAOF: is bug 537903 sufficient?07:50
ubottuLaunchpad bug 537903 in gjs "JS tests failing in gjs on i386 and armel" [Low,Triaged] https://launchpad.net/bugs/53790307:50
RAOFarmel doesn't fail to call the finalizer; it SIGILLs in libmozjs.  I'll add that to the bug07:54
RAOFmicahg: There you go; backtrace, such as it is, of gjs dying on armel added to the bug.08:00
micahgRAOF: ah, maybe they should be two bugs then?08:01
RAOFQuite possibly.08:02
siretart`fta: I hope you don't expect to "push" that branch to lucid. what were you referring to?08:03
micahgRAOF: k, thanks, I'll talk to asac in the morning08:05
micahgRAOF: so, we only have a workaround for i386?08:07
RAOFmicahg: Disabling JIT works on both i386 and armel.08:31
micahgRAOF: k08:32
alkisgseb128: in LP bug #401497 you asked if the gdm keyboard layout problem is still an issue in Lucid. I answered there -it is, e.g. Greek people can't write Greek with the default installation- but if you need any more info/testing, I'd be glad to help as much as I can.08:44
ubottuLaunchpad bug 401497 in ubiquity "wrong keyboard layout after upgrade with autologin" [Low,Confirmed] https://launchpad.net/bugs/40149708:44
seb128alkisg, why can't they? it's a bit weird08:44
alkisgseb128: because gdm forces a [us] layout08:45
seb128alkisg, I don't plan to work on this bug specifically but thanks for being responsive, I'm just looking at bugs we want to milestone for lucid08:45
alkisgIt doesn't respect the system wide default in /etc/default/console-setup...08:45
seb128alkisg, what do you have in this file?08:45
alkisgXKBLAYOUT="us,gr"08:45
seb128console-setup that is08:45
seb128ok08:45
seb128I think it's a known issue with multiple values there08:45
seb128I'm not sure why you don't get ="gr"08:46
alkisgYes, I think so too. It's really annoying, i.e. we can't preselect greek for e.g. a school08:46
seb128I think pitti was looking at that some time ago08:46
alkisgseb128: =gr is  *not* a correct value08:46
alkisgI needs to be [us,gr]08:46
seb128why?08:46
seb128that seems to be 2 layouts?08:46
alkisgYes, it is08:46
alkisg2 layouts are needed in many countries08:46
seb128why do you need 2 default layouts?08:46
persiaseb128: Many keyboards *need* multilayer to handle things smoothly.08:47
seb128I'm just trying to understand the issue08:47
alkisgBecause I can't type "www.google.com" without a us layout08:47
persiaseb128: So you can type in roman and non-roman alphabets easily.08:47
seb128alkisg, persia: ok thanks, that's valuable information, I will milestone this bug08:47
persiaseb128: For reference this affects all non-latin except CJKV08:48
seb128persia, ok thanks08:48
seb128it makes a good candidate for the lucid buglist I'm building for the desktop team08:48
alkisgseb128: as I say in the last comment in the bug report, a reasonable way to solve this is to have a "system default layout" entry in the combobox in the gdm login screen08:49
alkisgIt's really important for many countries. Thanks for milestoning this :)08:49
seb128alkisg, I don't we will do UI changes and new feature now08:49
alkisgseb128: no, that's not a new feature08:49
alkisgThere's a combo box with 200 keyboard layouts there08:49
alkisgThe default is [us]08:49
alkisgThat's a wrong assumption08:49
seb128well08:49
alkisgThe default should be [system default]08:49
seb128<alkisg> XKBLAYOUT="us,gr"08:49
seb128the default is the first in that list08:50
alkisgTaken from console-setup...08:50
seb128should it be gr,us?08:50
alkisgNo08:50
persiaseb128: The list needs to handle multilayer layouts08:50
persia(or perhaps not be a list)08:50
alkisgBy "default" gdm means *the only* layout08:50
seb128well, would it be fine if you have us and gr under GNOME08:50
seb128with the notification icon to switch08:50
seb128and default being set to "us"08:50
seb128or would that still be buggy?08:51
persiaseb128: Not if you use greek in your password.08:51
alkisgRight. So gdm is broken now. It doesn't set 2 layouts, it only sets the first one.08:51
seb128you can set 2 layouts at the same time?08:51
persiaseb128: Yes.  Multilayer.08:51
seb128or do you mean you need to be able to switch between those?08:51
alkisgTo be able to switch between them08:51
alkisgGdm *removes* this possibility08:51
persiaseb128: at the same time.  There's usually special keystrokes that switch between layers.08:51
alkisgpersia: that's part of the same layout, though08:52
seb128persia, right but you can only have 1 layout at time, ie you have both configured and you switch with a shortcut right?08:52
alkisgI.e. in Greek I can use right alt+E to type the euro sign08:52
slangasekseb128: morning - can you tell me who the right person is to look at bug #445621 in gtk?08:52
ubottuLaunchpad bug 445621 in libgtk2-perl "libgtk2-perl FTBFS on all archs -- test failures" [High,Triaged] https://launchpad.net/bugs/44562108:52
seb128slangasek, I think it's a libgtk2-perl bug08:52
slangasekseb128: you think the second failure is, too?08:53
persiaseb128: No.  X supports up to 4 layers in a keymap.08:53
seb128slangasek, I was planning to look at it but tried to finish things before you freeze lucid first :p08:53
seb128slangasek, yes08:53
slangasekhmm, ok08:53
seb128slangasek, let me get you the upstream change08:53
persiaseb128: So depending on hardware, etc. it's potentially possible to have several simultaneously enabled.08:53
alkisgseb128: to make it as clear as I can, because my english isn't good enough: we're not asking for a new feature. It's a bug that wasn't there up until jaunty, and was introduced with the new gdm in karmic. We just need gdm to not mess up with the system defaults...08:54
seb128alkisg, right, I don't discuss that there is a bug to fix, I'm just not sure it requires new UI rather than just settings things correctly08:55
alkisgThe current UI is fine08:55
alkisgThere's a combobox there with 200 different layout08:55
alkisgIt just lacks an additional entry: "use the system default layout"08:55
seb128slangasek, https://bugzilla.gnome.org/show_bug.cgi?id=59108508:55
ubottuGnome bug 591085 in GtkBuilder "GtkBuilder object ID bounded to GtkWidget "name" property" [Normal,Resolved: fixed]08:55
persiaWell, the combobox is defective because it can7t handle dual layouts, but that's a different issue.08:55
alkisgpersia: ok, but I'm not asking for this08:55
seb128slangasek, see comment #1908:55
alkisgI'm not asking for a new UI that would enable someone to select multiple layouts08:56
persiaalkisg: Understood.  The "system default" choice is the best workaround we can expect for lucid.08:56
alkisgI'm just asking for an entry to respect the system defaults08:56
alkisgWhatever those may be. Either 1, 2, or 10 different layouts in XKBLAYOUT, gdm should use those.08:56
seb128alkisg, right08:57
seb128gotcha08:57
alkisgIt shouldn't be hard - a copy from console-setup to the gconf key.08:57
seb128I would just expect the gconf key in GNOME to be the XKBLAYOUT list by default08:57
seb128right08:57
slangasekseb128: so we can expect other parts of this test suite to break in the future, because get_name() is not guaranteed to return this value?08:58
slangasek(the reason I thought it was a gtk bug was that it's only one object out of several that causes the error)08:58
seb128slangasek, well, the semantic changed, it was buggy before and has been fixed, it should not change again no, ie once you fix the testsuite you should be good09:00
geserdoes somebody know if the python-apt 0.8 API gets into lucid?09:00
seb128slangasek, but you will probably get the same issue for any get_name() used this way yes09:00
seb128slangasek, I can have a look in fixing that today if you want09:01
slangasekseb128: no, that's my point, it's only *one* object that shows this behavior with get_name(), and the test suite tests multiple objects09:01
persiageser: DktrKranz and mvo were discussing an updated merge.  Check the bugs.09:01
seb128slangasek, hum ok, I will have to check what happens there09:01
seb128slangasek, I will do that today09:01
slangasekseb128: ok, cheers09:02
seb128np09:02
seb128slangasek, http://git.gnome.org/browse/perl-Gtk2/commit/?id=d0b0e0baf7a611c307040cef13773556a4898d0809:06
seb128slangasek, ?09:06
slangasekseb128: aha, that's it :)09:06
seb128slangasek, good ;-)09:06
seb128slangasek, I like when upstream does fix bugs before we report those :p09:07
slangasek:)09:07
seb128slangasek, the comment also explain why you get it only for that widget09:07
* slangasek nods09:07
seb128which is good to know too ;-)09:07
pittiseb128: XKBLAYOUT="us,gr" -> that bug is known; it originally seems to be an installer bug, but we have to workaround it in existing installations09:27
seb128pitti, do you have the bug number? I want to add it to our lucid list09:28
seb128pitti, if you read backlog that seems to not be a bug in the installer09:28
seb128pitti, they apparently need 2 layouts in non latin cases09:28
seb128pitti, those 2 same layouts should be in gdm and GNOME09:28
pittiseb128: ok, that requires a more intrusive fix then (it's currently a signle layout, not a list09:29
pittiseb128: bug 46032809:29
ubottuLaunchpad bug 460328 in xserver-xorg-input-evdev "Wrong keyboard settings when console-settings has multiple layouts" [Undecided,In progress] https://launchpad.net/bugs/46032809:29
=== slangasek changed the topic of #ubuntu-devel to: Archive: Feature Freeze + Beta Freeze | MoM running (but use bzr!) | Development of Ubuntu (not support, not app development) | #ubuntu for support and general discussion for dapper-karmic | #ubuntu-app-devel for application development on Ubuntu | http://wiki.ubuntu.com/UbuntuDevelopment | See #ubuntu-bugs for http://wiki.ubuntu.com/HelpingWithBugs
cjwatsonI agree, the multiple layouts there are absolutely deliberate in the installer09:35
* popey wonders why he's just got an "Ubuntu 9.10 beta freeze now in effect" dated 24/09/2009 from slangasek 09:38
slangasekoh, sigh09:38
popeyah, my bad, slangasek replied to that mail :)09:38
popey*chuckle*09:38
* slangasek sends a better one09:39
pitticjwatson: libjpeg fix uploaded, FTR09:40
cjwatsonthanks09:40
persiaJust to make sure I remember correctly, with BetaFreeze, we're back to hard-freeze, where the release managers need to approve each upload, right?  Do we need special bugs for tracking each approval?09:46
YokoZarslangasek: one of the beta freeze emails you sent said 9.10 in the subject09:47
slangasekYokoZar: yep, that's why there were two instead of one :)09:48
seb128pitti, bug #460328, is that a g-s-d or gdm issue?09:48
ubottuLaunchpad bug 460328 in xserver-xorg-input-evdev "Wrong keyboard settings when console-settings has multiple layouts" [Undecided,In progress] https://launchpad.net/bugs/46032809:48
YokoZarslangasek: ahh ok I thought I got 2 cuz of different lists ;)09:48
slangasekpersia: please no - upload, let it be reviewed in queue09:48
slangasekpersia: yell on IRC if that's not working :)09:48
persiaslangasek: That's how it used to work, and I'm glad to see we haven't added more process.  Thanks.09:49
pittiseb128: if we need to support lists, it's both (and potentially -evdev as well, since that ships the udev rules)09:49
seb128pitti, should I add gdm and g-s-d tasks there, do you think it's likely fixable for lucid now?09:50
pittiseb128: not for beta-1, but for beta-209:50
pittiseb128: you are welcome to add tasks, and assign it to me09:50
seb128pitti, ok thanks, adding it to our lucid tasks09:50
seb128pitti, danke!09:50
seb128bah09:51
seb128retracers crashed on "lazr.restfulclient.errors.HTTPError: HTTP Error 500: Internal Server Error"09:51
* seb128 removes lock09:51
pittiagain? thanks09:51
seb128np09:52
ograso if i have a package using gksu, lintian screams at me to use su-to-root ... but su-to-root a) lacks functionallity and b) is only in unioverse09:52
ograwhats our policy on that ?09:52
persiaOur policy is undecided.09:54
persiaWe are not planning to start installing menu by default on every installation, so the Debian policy doesn't work.09:54
persiaTry to change your application to not need gksu because it uses policykit or something.09:54
dholbachcan somebody moderate my mail to ubuntu-devel-announce@09:59
cjwatsondone09:59
dholbachthanks cjwatson!10:00
=== jelmer_ is now known as jelmer
Chipzzlamont: fwiw, my opinion on https://launchpad.net/bugs/532587 is that the user/group should be removed on purge10:23
ubottuLaunchpad bug 532587 in puppet "removal of package does not stop daemon" [Medium,Fix released]10:23
ChipzzI expect (and I know that it doesn't hold right now anyway, but...) apt-get install foo; dpkg -P foo to be idempotent (if foo doesn't pull in extra dependencies)10:24
Chipzzimo, if I debootstrap 2 environments, and run 'apt-get install foo; dpkg -P foo' in one of them, a diff should show up no differences at all10:26
persiaChipzz: Why?  Can we be sure there are no logs or extra files that might have that user/group as owner?  Are we sure that the admin wouldn't prefer to keep the same UID/GID if later reinstalled?  Do we expect the admin to be running out of system UID/GIDs ?10:36
cjwatsonpersia: this is something that piuparts checks in Debian (and it certainly isn't at anywhere near 100% compliance)10:38
cjwatson--purge should remove the uid/gid; if the admin wants to keep configuration, they should use --remove10:38
persiacjwatson: Ah.  We were discussing this recently, and nobody could find the relevant bits in policy.10:38
persiamathiaz: You may also be interested in the above comment.10:39
cjwatsonI'm sure it's an interpretation thing, but given that uids/gids reside in /etc I would account them as configuration10:39
persiaPlus the idempotent argument above.10:40
cjwatsonobviously you have to be careful about existing files using those ids; I'm not claiming it's easy to comply with this10:40
cjwatsonparticularly in the case of a user shared among multiple packages10:40
cjwatsonand there may well be cases where complying with the letter of policy is worse than not doing so.  there's probably an extensive argument on this somewhere in the debian-policy list archives. :-)10:41
persiaI've always been a fan of leaving logs on --purge for later reference, and tend to like to run daemons as non-root, writing their own logs, which is probably why I had the opinion I did.10:41
cjwatsonChipzz: BTW I hope you're not counting /var/log/dpkg.log. ;-)10:41
cjwatsonpersia: policy is explicit that logs should be removed on purge10:41
cjwatson10.810:42
persiaThat defeats the last bastion of my support for my previous position.10:42
persiaThank you for the disabuse.10:42
cjwatsonbut of course if stuff is lying around in home directories or something ... gets complicated I'm sure10:42
persiaWell, aside from the shared UID/GID scenario, it ought be possible to know what is being done, and (mostly) clean up in the maintainer scripts.10:43
persiaFor shared UID/GID, I thought the maintainer was supposed to request allocation of a system-wide UID.10:43
cjwatsondepends how shared10:44
cjwatsonif it's among a group of cooperating packages maintained by the same people, that's not necessary10:44
cjwatsonin fact it's not really necessary in general; the only reason to require allocation of a static uid is if you actually care about the number10:44
persiaIs that because of the "same people" or because of the "cooperating packages"?10:44
cjwatsonotherwise in general packages should just use adduser --system10:45
cjwatsoncooperating> actually a red herring I think, thinking on the fly :)10:45
persiaOn an unrelated note, the debian-installer powerpc FTBFS confuses me.  It builds fine on a local powerpc.10:46
cjwatsonyou only really need static ids if the id is baked into binaries somehow that for some reason can't or won't use normal name lookup10:46
cjwatsonthat ftbfs is bug 53773310:46
ubottuLaunchpad bug 537733 in launchpad-buildd "/etc/apt/sources.list unreadable on powerpc" [Undecided,New] https://launchpad.net/bugs/53773310:46
persiaAha, so really we should be striving for a minimum of static UID/GID?10:46
cjwatsonyes - indeed my default response as base-passwd@packages.debian.org to such requests is to attempt to persuade the requestor that they can do things some other way. :)10:47
Chipzzpersia: imo it really doesn't matter - the admin requested purge, the package should be removed as complete as possible10:47
cjwatson/usr/share/doc/base-passwd/README <- very few package-specific ones have been allocated10:47
cjwatsonthe global static ones (0-99) are "shared" in a stronger sense, but it takes a lot to get me to add one of those10:48
persiaChipzz: Yes.  I now agree with you.10:48
cjwatsonplugdev was the last one, and even that was arguably a mistake10:48
cjwatsonand the reason that was static was that we needed to hardcode the gid in /etc/fstab from the installer10:49
cjwatson(at the time)10:49
persiaSo the static UID/GID registrations can be thought of as extremely low-priority bugs, in a way.10:49
cjwatsonkind of.  of course, once they've been allocated, that's final.10:50
cjwatsondeallocating them obviously wouldn't free up the numbers10:51
Chipzzcjwatson: does plugdev still get used these days?10:51
cjwatsonthe *uses* of the registrations are low-priority bugs10:51
cjwatsonChipzz: there are probably ghosts here and there, but mostly not10:51
Chipzzso the number can't be deallocated even if the package stops to use them, or the package is obsoleted?10:52
persiaChipzz: No, because some people have very long-lived systems (my last potato system is still at my desk, although I haven't turned it on in several months, and it was running intrepid or jaunty last I looked)10:53
siretart`fta: in any case, can you please rename the package chromium-codecs-ffmpeg-nonfree? I guess something like 'chromium-codecs-ffmpeg-extra' would be much clearer.10:53
Chipzzpersia: I mean in future releaese10:53
Chipzzobviously you can't deallocate them from a past release, duh ;P10:54
siretart`fta: the package description sounds like ffmpeg would contain 'nonfree' codecs, which isn't exactly true. In fact, some ffmpeg developers have expressed that they are very unhappy with that naming.10:55
persiaChipzz: Again, I have a machine that was first installed Debian potato at my desk, so it's been continuously upgraded for a decade or so (including HW upgrades).10:55
Chipzzpersia: but once you upgrade that potato system, if you have packages using static uids, and those migrate to a solution where they aren't needed anymore, or obsoleted...10:55
persiaChipzz: The point being that we can't ever know that a given UID or GID really isn't being used on any systems.10:55
persiaChipzz: I still have that UID in my /etc/passwd10:56
Chipzzpersia: uhm, yes you can?10:56
cjwatsonChipzz: the numbers will never, ever be deallocated.  live with it. :-)10:56
geseris using clean-la.mk from cdbs the prefered way when "fixing" .la files? (a .la files references an other .la file without a dependency on its -dev package)10:56
cjwatsonI don't care whether it's theoretically possible to work it out, maybe, sometimes.10:57
persiaChipzz: I can't because the new versions of the package that use dynamic methods to find out the UID or GID based on the name will get the old numbers and not run adduser --system10:57
Chipzzas a package maintainer you can fix your postinst etc scripts to migrate known files away from the static UID or GID for example10:57
Chipzzpersia: right, they can not be removed from an UPGRADED system10:57
Chipzzwhat I meant is that they are no longer part of the standard /etc/passwd etc on NEW installs10:58
cjwatsonthe allocations in /usr/share/doc/base-passwd/README are not part of /etc/passwd unless explicitly created by a package anyway.10:58
persiaChipzz: Sure.  You could probably do that, but you can't ever reuse a previously allocated static value.10:58
cjwatsonindeed we have sometimes removed entries from new installations, but as you say, reuse is forbidden.10:59
Chipzzon a related note10:59
Chipzzsomeone should probably beat some sense into Bernstein :P11:00
Chipzzqmail packages are ARGH11:00
seb128slangasek, still awake? are you working on the gtk-perl buildfix or should I do that?11:05
seb128slangasek, I can do it now11:05
geserwill the beta1 freeze get lifted after beta1 release?11:30
lamontpersia: I knew there were reasons I removed uids/gids11:46
persialamont: I think I preferred "tastefulness" to "well, policy says to do it that way", but yeah :)11:53
persialamont: Also, do you know who can fix bug 537733 ?11:54
ubottuLaunchpad bug 537733 in launchpad-buildd "/etc/apt/sources.list unreadable on powerpc" [Undecided,New] https://launchpad.net/bugs/53773311:54
lamontpersia: is it reproducible?11:54
cjwatsonyes, happened two or three times now11:54
persiaYes.  I just reproduced it.11:54
lamontbecause looking at builds, the file sure seems readable to me...11:55
persialamont: Look at the debian-installer build11:55
persiahttps://launchpad.net/ubuntu/+source/debian-installer/20081029ubuntu90/+build/155715811:55
* lamont forces the build down ross' throat to see if that changes anything11:59
lamont-rw------- 1 root root 48 Mar 12 11:58 /etc/apt/sources.list12:01
lamontI take back what I said12:01
lamontWTF?12:01
lamontOH.  &^$%)&*&^%)$^%)P TWISTED12:01
* lamont goes to beat on the right peopld12:01
persialamont: Thank you.12:01
lamontpersia: slapped around, fix live and testing on ross, will smack adare once its build finishes, and will be pushing code to close the bug shortly12:13
persialamont: Excellent.  Thank you very much.12:14
=== MacSlow is now known as MacSlow|lunch
lamontWARNING: The data in 'translation-status' is older than 2 weeks.12:16
lamont         Should it maybe be updated?12:16
lamontgiggle12:16
cjwatsonmakes slightly more sense in Debian :-)12:16
lamontheh12:16
cjwatsonooh.  I think I have console-setup working again12:17
* cjwatson fine-tunes against bootchart12:17
lamont2010-03-12 12:16:57+0000 [-] Unpacking anna (from udebs/anna.udeb) ...12:17
lamontI think that means it's going to work12:17
cjwatsonyep, looks good12:17
persiaAt least the failure we have been seeing isn't the issue.12:18
lamontso.. when my boot bails out to busybox with ZOMG-NO-ROOT-PARTITION literally < 5 seconds before the partition shows up from scsi, what package do I file that against>?12:26
lamontI suppose I'm magically supposed to know about rootdelay at install time so that I can fix it?12:27
lamontpersia: and built successfully12:44
persialamont: Wonderful.  I have renewed confidence in beta for powerpc.  Is there anything else I should add on the fpc bit?12:46
lamontdunno - do keep pestering me though12:50
persiaOK.  Please review the last comment in bug #67544 then, just to confirm I've added all the right bits.12:51
ubottuLaunchpad bug 67544 in fpc "PPC build of fpc fails" [Unknown,Fix released] https://launchpad.net/bugs/6754412:51
persiaAlso let me know if I should pester some nominated third party instead :)12:51
lamontpersia: the last 2 paragraphs are a nice restatement of the practice we've always followed12:52
persiaI figured, but given that the last set of instructions didn't work, I felt it wouldn't hurt to be overprecise.12:53
lamonttrue12:53
lamontwas kind of hoping for the expanded list of exactly which versions of which debs were fetched, since that apt-get command referencing ftp.debian.org?  not so functional behind the buildd firewall12:54
persialamont: I'm really only pulling those 5 debs from Debian.  Everything else is lucid.12:57
lamontawesome12:57
persiaThat's the bit about --download-only and then sed on sources.list with a new cache update before the install loop.12:57
lamontpersia: the other bit here is that we're using this as a perfect test case for another admin to validate my "how to bootstrap a package" instructions12:58
persialamont: That's why I keep volunteering to chase someone other than you about it :)12:59
Garfeildhi all13:05
GarfeildWhere can I found sources of Installation manager from LiveCD?13:06
cjwatsonthe installer, you mean?  apt-get source ubiquity13:08
Garfeildthanks13:08
=== MacSlow|lunch is now known as MacSlow
=== Tonio__ is now known as Tonio_
=== `Alessio` is now known as quadrispro
=== lus is now known as lu
=== lu is now known as lus
=== sconklin-gone is now known as sconklin
qensestatik: An idea for the Ubuntu One GSOC project idea: integrating Ubuntu One with a website, maybe something like Roundcube -- contacts -- or something else. It would be something great: data integration between the desktop and the web.14:25
doko_qt4-x11 is a 160MB source? insane ...14:26
=== robbiew_ is now known as robbew
=== robbew is now known as robbiew
emgenthttp://www.ns.umich.edu/htdocs/releases/story.php?id=755114:36
apwcjwatson, this dpkg change to add an fsync ... when does it add the fsync?14:42
Keybukapw: heh, I was just about to grab him too14:43
Keybukapw: http://git.debian.org/?p=dpkg/dpkg.git;a=commitdiff;h=62668eb14:45
Keybukthat's the patch14:45
apwKeybuk, ta14:45
cjwatsonright - there was another one upstream to do the same for status file writes14:46
Keybukthe one in tarobject would be the culprit I expect14:46
cjwatsonculprit?14:46
Keybukcjwatson: you've utterly killed dpkg performance from what we can tell14:47
Keybukit took over an hour to unpack the linux headers deb14:47
Keybukif it's doing an fsync() before every rename() for every single file in a deb ...14:47
apwthere are 11k files in there, so we are suspecting we have 11k fsync's now14:47
cjwatsonall I did was backport it, but possibly - I was more immediately worried about stemming the flow of correctness14:47
cjwatsonbugs14:47
cjwatsonbut yeah, an hour is ridiculous14:47
Keybukapw: which options are we mounting ext4 with by default at the moment?14:47
apwdata=ordered i believe14:48
cjwatsonI can take out that fsync and we can see if that helps; the bugs were more related to getting ENOEXEC on maintainer scripts14:49
* apw checks14:49
cjwatsonwe were getting flooded by bugs of that form14:49
apwcjwatson, i worry the one you need applies to all files14:49
Keybukcjwatson: that would only be true if people have changed their ext4 mount options though, no?14:49
cjwatsonapw: could you rephrase that?  I don't understand14:49
Keybukour defaults are sync metadata first14:49
cjwatsonKeybuk: I have no idea, feel free to debug14:50
apwcjwatson, if you need the rename on the maintainer sync, i won't be supprised if its the same one we don't want for non-maintainer14:50
cjwatsonbug 512096 is the master Ubuntu bug14:50
ubottuLaunchpad bug 512096 in dpkg "[MASTER] Exec format error : package failed to install/remove : installation/removal script returned error exit status 2" [High,Fix released] https://launchpad.net/bugs/51209614:50
smbKeybuk, apw Remember there has been the issue that the default was changed implicitely on Karmic14:50
cjwatsonnote the duplicate count14:51
smbEh forget it that was ext3 I thinkg14:51
cjwatsonapw: well, maintainer scripts are used rather more immediately14:51
* apw does not see how an fsync could fix any of these issues unless the filesystem is well broken14:52
Keybukapw: this is the whole O_PONIES problem in a nutshell14:52
KeybukTed would describe it as "but you didn't call fsync(), so why would you expect the data you write/permissions you applied to be visible on the filesystem yet?"14:53
Keybukif one process opens file, writes, set permissions, closes14:53
Keybukthere's no guarantee that a separate process will see that14:53
apwfsync only guarentees it will survive a crash14:53
apwas far as i know there is no ordering issue between threads14:53
Keybukwell, that's a different argument14:53
Keybukat least the bug colin quoted explicitly says "crash"14:54
apwhrm14:54
Keybukactually, no14:54
apwyou'd think a sync at the end of the extract would do the trick14:54
KeybukI think there *are* ordering issues between threads14:54
* Keybuk is recalling presentations14:54
apwbut yeeks ... well we don't need to worry about the time it takes to compress the initramfs any more :)14:54
KeybukPOSIX provides no guarantees about the contents of files between threads14:54
Keybukof their metadata14:54
cjwatsonsomebody did suggest a single sync()14:54
Keybukor of their metadata, that should say14:55
cjwatsonapw: as I said in the comments, we can address the performance, I wasn't particularly expecting it to stay this way for lucid14:55
cjwatsons/comments/changelog/14:55
apwcjwatson, that seems more reasonable, but ...14:55
Keybukso if one thread writes, the other isn't guaranteed to actually see the written data until fsync()14:55
apwKeybuk, hrm, ok ...14:55
Keybukfsync() is not "guarantee data hits disk"14:55
Keybukfsync() is "guarantee data is available for other processes"14:55
Keybukso in fact, fsync() doesn't necessarily make you safe from crashing <g>14:56
apwfsync really is 'to disk'14:56
=== Pici` is now known as Pici
sistpoty|workKeybuk: I beg to differ14:56
apwDESCRIPTION14:56
apw       fsync() transfers ("flushes") all modified in-core data of (i.e., modi‐14:56
apw       fied  buffer cache pages for) the file referred to by the file descrip‐14:56
apw       tor fd to the disk device (or other  permanent  storage  device)  where14:56
Keybuk       Calling  fsync()  does  not  necessarily  ensure  that the entry in the14:56
Keybuk       directory containing the file has  also  reached  disk.   For  that  an14:56
Keybuk       explicit fsync() on a file descriptor for the directory is also needed.14:56
apw       that  file  resides.14:56
Keybuksistpoty|work: I'm reading slides presented by the ext4 filesystem maintainer here14:56
Keybukif you have more authorative notes on the behaviour with fsync on ext4, please do share14:57
sistpoty|workKeybuk: I'm using common sense :P14:57
cjwatsonthe problem reported here was not, though, that the directory entry didn't exist14:57
Keybuksistpoty|work: fsync does not guarantee the data has reached disk, because ATA and SCSI do not provide any such barrier command14:57
apwKeybuk, i think with ordered mode, the updates may ben ensured14:57
Keybukyou can send the writes to the disk, and the disk can acknowledgfe14:57
Keybukbut there's no guarantee the disk has done anything with them other than store the need to write in its memory14:58
sistpoty|workKeybuk: the disk guarantees that the data in the cache gets written14:58
cjwatson(FWIW, I did test an upgrade before upload, and while it was slower, I didn't see anything like that order of slowdown or I probably wouldn't have uploaded it)14:58
Keybuksistpoty|work: not according to Ted14:58
apwKeybuk, that may be true, but the disk is lying if it says yes when its not written yet14:58
Keybukcjwatson: the killer seems to be "packages with thousands of small files"14:58
Keybukapw: apparently the disk is permitted to lie14:58
Keybukanyway14:58
Keybukthat's a little sliding off topic14:58
Keybukthe key point is:14:58
Keybukprocess #1 writes14:58
Keybukprocess #2 reads14:58
apwKeybuk, i suspect its not allowed to, but they do14:58
Keybukthere's no guarantee in POSIX that process #2 can see what process #1 wrote14:59
Keybukunless process #1 happened to call fsync()14:59
Keybukand since dpkg uses separate processes to unpack14:59
Keybukthat would explain the bug14:59
apwthat leaves us in a hole14:59
Keybukdpkg unpacks the tarfile, writing maintainer scripts14:59
sistpoty|workKeybuk: a proper disk will write the data. if power goes out power to do the write is gained from the still rotating disc ;)14:59
Keybukand calls rename()14:59
Keybukat the rename() point, there's no guarantee that the metadata is sync'd15:00
Keybukthough fwict, ext4 data=ordered *is* supposed to guarantee that15:00
Keybuksistpoty|work: again, please cite references15:00
cjwatsonwhat are the guarantees on sync()?15:00
sistpoty|workKeybuk: please cite references that it's not the case15:00
Keybuksistpoty|work: for a start, the fsync man page15:00
Keybuk       If the underlying hard disk has write caching enabled,  then  the  data15:00
Keybuk       may  not  really  be  on  permanent  storage when fsync() / fdatasync()15:00
Keybuk       return.15:00
cjwatsonsistpoty|work: I would appreciate it if we could stay on the topic of this bug, and not go off onto a tangent about how it should be (which we had at great length when the whole ext4/rename/fsync saga came up last summer)15:00
Keybukalso see Ted Tso's presentation given at the Linux Filesystem Summit last year15:00
apwKeybuk, does that mean not another thread will be ok15:01
apwie can we only sync the maintainer scripts15:01
apwie a process which is not a thread15:01
cjwatsonwe do need to sync other things at *some* point - the maintainer scripts will use the contents of the package15:01
Keybukcjwatson: I *think* sync() on a filesystem is intepreted as "fsync all files currently open"15:01
Keybukbut, reading my notes and Ted's notes here15:02
Keybukthat won't be right15:02
Keybukthe problem is that15:02
apwcjwatson, yeah that was what i was angling at too15:02
Keybukopen ()15:02
Keybukwrite ()15:02
cjwatsonvoid sync(void); # of course15:02
Keybukfstat ()15:02
Keybukclose ()15:02
Keybukrename ()15:02
Keybukthere's no guarantee that the rename() actually copies the metadata15:02
Keybukwhich is, I suspect, what you're seeing15:02
cjwatsonKeybuk: that's the problem discussed at enormous length last year, and I was under the very strong impression that ext4 had been modified to consider rename() a barrier15:02
Keybukcjwatson: only depending on mount options15:03
cjwatsoneven if Ted didn't like it, and didn't put it in his presentation ;-)15:03
Keybukwhich is why I'm wondering if most of the reporters have changed their ext4 mount options15:03
Keybukperhaps related to the whole bruaha about the fact we changed the default on them in karmic15:03
cjwatson200 bugs?  I suppose it's possible but this is a *lot*15:03
Keybukpossibly ... but otoh, I've *never* seen this issue15:03
Keybukand I upgrade a *lot*15:03
cjwatsonand I'm not sure it's an excuse for dpkg to fall over in a smelly heap anyway15:03
Keybukcjwatson: right, so this was the whole O_PONIES thing15:04
apwwe cirtinaly changed the default to be sensible now15:04
Keybukthe response from Ted was "use fsync() if you really want the data there ... but I'll add a data mode to provide the guarantee that ext3 did"15:04
apwto err on the side of safety15:04
apwi guess the issue is not that we have fsync'd but that we wait for it to finish before moving on to the next file15:05
KeybukI think you have to wait for it to finish before you can rename()15:05
apwperhaps so, but none of that stops you moving on to the next file per-see15:06
apwas in using a thread per file in some sense and overlapping N files then each could fsync15:06
cjwatsonis the file *permanently* truncated if you don't fsync before rename?15:06
apwand likely not break things15:06
Keybukcjwatson: I thiiiiiink so15:07
cjwatsonI didn't think that was the case15:07
Keybukalso permanently without its metadata15:07
cjwatsonI thought it merely broke assumptions that the file was atomically in-place after rename15:07
KeybukTed sadly seems asleep right now15:07
apwKeybuk, now that i find hard to believe15:07
apwyeah i can believe there might be a window, but permenantly ... i doubt15:07
Keybukit may be "shows up later" of course15:07
apwi would assume at least expec the next pdflush run to make it right15:07
apwand likelyt he window is smaller than that15:08
cjwatsonof course, that is what dpkg is trying to achieve by its "write to .dpkg-new, rename" thing15:08
cjwatsonit's deliberately trying to ensure that the window where you don't have full contents is *zero*15:08
cjwatsonnot just "oh, not a lot, pdflush will get to it"15:08
apwyeah fsync is not mad conceptually15:08
cjwatsonbecause otherwise you end up with unreliable applications, etc.15:08
apwits that its blocking necesarily that its an issue15:08
Keybukyeah, dpkg is using ian's ancient and wholly sensible that "write over there, rename to where you want it" is a very big and obvious clue about atomicity15:08
Keybukand that was basically the crux of the argument against Ted15:09
apwi wonder how hard it would be to have multiple paralell writeres15:09
cjwatsonit's news to me that ext4 only gained this guarantee on data=ordered, but reading git log I see that you're right15:09
Keybukyou have to do this rename() to provide atomicity of contents *anyway*15:09
apwso that each can fsync as long as they like15:09
cjwatsonapw: in dpkg?  *swallow* don't go there15:09
apwshame15:09
apwaccording to the sync() manual page that isn't guarenteed to wait for the sync to complete15:10
Keybukapw: yes it is15:10
apwthough it is believed to for current versions15:10
Keybukapw: see BUGS15:10
apwthats what i just presee'd15:10
KeybukLinux always waits for sync() to finish15:10
apwsync does here, but not everywhere where sync is15:10
cjwatsonKeybuk: on another note, I almost hate to ask, but is the plymouth stuff likely to land in time that I can say it's done in the release meeting this afternoon? :)15:10
apwso its not a portable solution15:11
Keybukcjwatson: we hit other bugs in testing15:11
Keybukhave you tested it to see whether it works for you?15:11
cjwatson"it" - your plymouth stuff?15:11
Keybukyes15:11
Keybukcjwatson: ppa:scott/ppa15:11
cjwatsonI didn't know you'd published it :)15:11
cjwatsonaha15:11
sgallaghKeybuk: Who's handling SSSD in Ubuntu these days?15:11
Keybuknope, can't decode that one?15:12
Keybuksuper secret squirrel detector?15:12
KeybukSQUIRREL!15:12
sgallaghKeybuk: System Security Services Daemon15:13
Keybuksgallagh: nope, still drawing a blank there15:13
KeybukPrior to Ted Ts'o's session on fsync() and rename(), some joker filled the room with coloring-book pages depicting ponies. These pages reflected the sentiment that Ted has often expressed: application developers are asking too much of the filesystem, so they might as well request a pony while they're at it.15:13
Keybuk...15:13
Keybukheh15:13
Keybukthe "joker" was Ted!15:13
Keybukhttp://blahg.josefsipek.net/?p=36415:13
sgallaghKeybuk: I was wondering who was the Ubuntu maintainer. We (upstream) are working on releasing 1.1.0 next week, and I wanted to get them to pull down the nightlies and make sure we haven't broken anything on Ubuntu15:14
Keybuksgallagh: Ubuntu doesn't have maintainers15:14
Keybuk(mostly)15:14
sgallagh...15:14
Keybukwe use the time honoured tradition of "who touched it last"15:14
sgallaghKeybuk: Ok, so "Who touched it last"? :)15:14
Keybuksgallagh: dunno, never heard of it15:15
Keybuksgallagh: what does Launchpad say?15:15
sgallaghKeybuk: I have discussed it with you on at least three separate occasions :-/15:15
Keybuksgallagh: I have literally hundreds of discussions per day15:16
sgallaghLooks like Mathias Gug15:16
Keybukand am right now devoting 95% of my brain to reading about ext4's issues with rename()15:16
sgallaghOuch15:16
Keybuknow is not a good time for me to pretend to be google for you15:16
sgallaghKeybuk: no problem. I understand.15:17
sgallaghI'm not familiar with Ubuntu at all, really. A simple "It's in launchpad" would have been all the direction I needed :)15:17
Keybuksgallagh: everything is in Launchpad15:18
sgallaghGood to know15:18
cjwatsonsgallagh: I have a browser keyword for https://launchpad.net/ubuntu/+source/%s15:18
cjwatsonsubstitute in a source package name and that gets you everything about that source package - very handy15:19
sgallaghcjwatson: Thanks15:19
sgallaghI mostly develop in Fedora, so my knowledge of other distros' build environments is... limited.15:19
cjwatsonKeybuk: trying that out in conjunction with my console-setup work, thanks15:19
tjaaltonsgallagh: hi, yeah mathias uploaded 1.0.2 on january, and it probably deserves an update since that version is known to be broken ;)15:20
cjwatsonthough it'll be a "works/doesn't-work for me" at best, I have too many other things to do as well15:20
sgallaghtjaalton: Yeah, that's rather old.15:21
sgallaghtjaalton: We're aiming to launch 1.1.0 sometime next week, but I'd like to know ahead of time if we're going to break the build on a non-Red Hat-based build-system.15:21
Keybukcjwatson: of those 200-odd bugs, don't suppose you have a rough idea how many were "after a crash ..." and how many were "dpkg went wrong all on its own!"15:21
cjwatsonKeybuk: do apparmor and brltty need to be migrated to udev/upstart at all for lucid?  they're still on the list, but I'm wondering if they should be postponed at this point15:21
sgallaghtjaalton: So if you have some free time...15:21
cjwatsonKeybuk: unfortunately not, somebody else was dealing with triaging them and I talked to that guy rather than doing most of the legwork myself15:21
cjwatsonKeybuk: it was jibel, I believe15:22
tjaaltonsgallagh: I managed to get winbind to work, and haven't had time to play with sssd for awhile15:22
sgallaghI'd like to collaborate with whomever is going to do the build, because a few things changed (of note, we're producing quite a few additional shared libraries)15:22
Keybukcjwatson: I would like to, if I find the time15:22
tjaaltonsgallagh: I can try if it builds15:22
sgallaghtjaalton: That would be great.15:22
sgallaghtjaalton: What's in our nightly right now is pretty close to the final build (unless of course we've broken it for other distros)15:23
tjaaltonsgallagh: ok, I'll try 1.0.99 first, or is it too old to bother?15:24
cjwatsonKeybuk: beta-2, then?15:24
Keybukcjwatson: yeah15:24
sgallaghtjaalton: Better to use the latest nightly.15:24
cjwatsonok, updating metadata15:24
Keybukit's one of those "they should have been done by now, but too many other things that should have been done by are taking too long" things15:24
Keybuke.g. I've been saying "Plymouth will be uploaded today" all week15:25
sgallaghtjaalton: I made several build-system changes after 1.0.99 (not that I had originally planned to...)15:25
tjaaltonsgallagh: where can I find the nightly build?15:25
Keybukcjwatson, apw: ok, so my understanding is that after open() write() close() rename(), there is a period during which there's no guarantees what the file might actually contain15:25
Keybukand that in practice, this period tends to be "up to 5s"15:25
cjwatsonKeybuk: we should probably revisit the dpkg discussion after beta-1/15:25
cjwatson?15:25
Keybukso writing out maintainer scripts, renaming them, then trying to exec() them may fail15:25
Keybukbecause they're not executable15:25
Keybukand because they don't have any data in them15:26
sgallaghtjaalton: git clone git://git.fedorahosted.org/sssd.git15:26
KeybukI'll need to talk with Ted to make sure I'm right though15:26
cjwatsonthough I suppose it wouldn't hurt to check that d-i doesn't take unreasonably long15:26
tjaaltonsgallagh: got it, thanks15:26
sgallaghtjaalton: There's an RPM repository available at http://jdennis.fedorapeople.org/ipa-devel/fedora/12/x86_64/os/ if you want to compare to the Fedora packages15:26
tjaaltonsgallagh: is the packaging in git or svn?15:27
sgallaghtjaalton: I don't understand the question15:27
tjaaltonsgallagh: the spec file etc15:27
tjaaltonlike in cvs.fp.org15:28
sgallaghtjaalton: We have a reference spec file in the contrib/ directory in the source15:28
tjaaltonalright15:28
sgallaghThat forms the basis for what goes into cvs.fp.org15:28
sgallagh(Right now cvs.fp.org is still building SSSD 1.0.5)15:28
tjaaltonthe spec file in contrib/ is older :)15:29
sgallaghtjaalton: Huh?15:29
tjaaltonat least the version says 0.6.015:29
sgallaghThat doesn't seem right. Hang on.15:30
sgallaghOh, ignore the changelog15:30
tjaaltonok15:30
sgallaghWe don't usually keep that up to date in that spec file15:30
sgallaghWe should, though15:31
sgallaghAt some point I'm going to make that autogenerated from the git commit list.15:31
tjaaltonok I'll give it a go and will post the result on #freeipa :)15:32
sgallaghtjaalton: Thanks much!15:33
jibelKeybuk, cjwatson, hi, to answer your question above. nearly 90% are due to a system crash.15:42
gnumdkHello15:43
gnumdkIs there any firefox packager in the place?15:43
jibelKeybuk, I reviewed a large part of them  http://paste.ubuntu.com/394082/15:43
Keybukjibel: that's good to know15:45
Keybukit's a shame we don't know which ext3/4 mount options they're using15:45
Keybukor if they're using XFS, etc.15:45
tjaaltonmathiaz: hey, sgallagh asked to test-build the upcoming sssd 1.1.0. I did that, seemed to build fine, though it probably needs some packaging changes15:47
mathiaztjaalton: hi - good to know15:47
tjaaltonhad to comment out the patches, and the final packaging phase fails, but upstream-wise it builds fine15:47
mptmvo, bug 53812915:48
ubottuLaunchpad bug 538129 in software-center "UI freeze exception: Remove stars and reference to non-existent "reviews"" [Undecided,New] https://launchpad.net/bugs/53812915:48
jibelKeybuk, from the type of reporter, most of them are using the standard setup.15:48
mathiaztjaalton: I was planning to upload the latest 1.0.X to lucid15:48
mathiaztjaalton: It seems that 1.1.0 has new features, which is too late for lucid IMO15:48
sgallaghtjaalton: I suspect that the patches in your build-system were the ones that we got pushed upstream a few months ago15:48
jibelKeybuk, the problem appeared in Jaunty, with the release of ext415:48
tjaaltonsgallagh: actually they just touched the config, and Makefile.am to change some paths15:49
tjaaltonmathiaz: well, I'll let sgallagh comment on that :)15:49
sgallaghoh, ok. I thought it was the linking bug we fixed a while ago15:49
tjaaltonsgallagh: nah it never got to the package..15:49
Keybukjibel: the "standard setup" has changed many times15:49
tjaaltoncould've uploaded it myself but.15:50
sgallaghmathiaz: Is lucid in feature freeze?15:50
mathiazsgallagh: yes15:50
mathiazsgallagh: that's why I was planning to upload the latest 1.0.x (1.0.4) IIRC15:51
tjaaltonit's 1.0.515:51
sgallaghmathiaz: It's 1.0.5, but there are no functional changes between them. We just discovered that we were missing license attribution on several files.15:51
sgallaghAnd we removed some dead code15:52
tjaaltonthe package is in universe though, and because of the linking bug was practically unusable :)15:52
tjaaltonso maybe no-one used it in the meantime15:52
tjaalton(other than me)15:53
tjaaltonno wait, some Finn thanked on the bug for the linking patch :)15:54
sgallagh:)15:54
sgallaghSo, yeah, there are some new features in 1.1 (https://fedorahosted.org/sssd/wiki/Releases/Notes-1.0.99 has a list of pretty much all of them, we've mainly just been stabilizing since then)15:55
sgallaghThe three biggest are full IPv6 support, support for ldap referral tracking and we substantially improved performance when enumerate=false (so it's now the better solution for 99% of all deployments)15:57
psusiKeybuk: got some questions for you about ureadahead... does --dump list the files in the order they were accessed?  Is that the order they are read in, or are they read in inode order or something else to attempt to speed it up?16:08
=== beuno is now known as beuno-lunch
Keybukpsusi: depends on --sort ;-)16:10
psusiKeybuk: which part?  the dumping or the reading?16:10
Keybuk--dump usually dumps files in the order that they'll be opened16:10
psusiok... and when they are read, are they read in that order, or some other order to attempt to minimize seeks?16:11
Keybukno16:11
Keybukureadahead doesn't read files ;-)16:11
Keybukfiles are merely a method of getting to blocks16:11
psusiwell, it calls readahead() on the files in question ;)16:12
Keybukno it doesn't16:12
=== Tonio_ is now known as Tonio__
=== Tonio__ is now known as Tonio_
psusiit doesn't?  that's what the man page said I could have sworn16:12
Keybukthat's the kind of thing that dumb-arse entirely-un-über readahead implementations do ;-)16:12
psusiohh, goody.... so you do it better?  I was thinking that calling readahead() was sub-optimal16:13
psusiso what does ureadahead do?16:13
Keybukdepends on whether you're using an SSD or HDD :-)16:14
* psusi is trying to use defrag to pack the files in the most optimal way16:14
psusiwell let's start with HDD then go into SSD since I just ordered one yesterday and my wife says it arrived an hour ago ;)16:14
KeybukHDD16:14
Keybukgiven a set of files that were opened during boot16:15
Keybukwe query the kernel to find out what segments of those files are in the page cache16:15
Keybukthen, for each of those segments, we query the kernel to break them into lists of on-disk extents16:15
psusiohh, it doesn't use blocktrace to see what is actually being read and in what order?16:15
Keybukwe take the big list of on-disk extents, and sort that16:15
Keybukthat gives us the "blocks to be read"16:15
Keybukwe can't read blocks directly though, we need file descriptors16:16
Keybukso we retain the list of opened files (which is sorted by ext inode number, so roughly on disk position)16:16
Keybukwe open all files in one pass16:16
Keybukthen, with all the files open, we iterate the blocks list16:16
Keybukthis means that as far as files are concerned, our reading is entirely random16:16
Keybukwe might read 4k from the end of the file16:16
Keybukthen 4k from the middle of another file16:16
Keybukthen 4k from the start of the first file16:16
Keybukthen 16k from another file16:16
Keybuketc.16:16
psusiaye, so you read in actual block order to minimize seeks?16:17
Keybukcorrect16:17
Keybukureadahead under blktrace looks like two (well three) passes16:17
psusiand what method do you actually do the reading by if not readahead()?16:17
Keybukyou have a pass to open the files from start to end of the disk16:17
Keybukthen a pass across the disk to readahead16:17
Keybukwe use readahead, just not "on [whole] files"16:17
psusiright, that's what I thought, you specifically readahead only the parts of the files that ar eneeded16:18
Keybukyes16:18
Keybukin a random order with other files interspersed16:18
psusiaye, in the order the blocks actually appear on disk16:18
Keybukon SSD, this is slightly different16:19
Keybukwe don't break file segments by on disk extents16:19
Keybukthe files list is sorted by access order16:19
Keybukthe block list is "collapsed" files list16:20
Keybukwe iterate the blocks list without opening files16:20
Keybukso effectively, we read all the blocks for each file in turn, in the order the file was accessed16:20
Keybukopening files at the first point we have a block for that file16:20
Keybukthis gives a *very* scattered, random read profile under blktrace16:20
KeybukSSDs like that16:20
psusihrm... well ok... so having defrag pack the files at the start of the disk should help some since you won't have to do any seeking at all, but ureadahead already eliminates any backwards seeking16:22
psusiso it won't help a whole lot16:22
Keybukit'll eliminate the seeks16:23
Keybukthe seeks are a big part of the loss of throughput16:23
Keybukif we had all the data we want to read, at the start of the disk, contiguously16:23
Keybukwe could slam the kernel quickly with it16:23
Keybukand hope the I/O elevator goes "oh, you want the first 100MB, I can do that" *reeeeeeeeeeeeeeeeeeeeeeeead*16:24
psusiright, but ureadahead already eliminates any  backwards seeking so you are only left with some forward seeks to slow you down, so there is still some room for improvement, just not a whole lot16:24
Keybukforward seeks are still a lot16:24
Keybukreading data from disk is like shopping with your granny16:24
Keybuksure, it's very helpful keeping her in a straight line16:24
psusihehehe16:24
psusiyea16:24
Keybukif she turns around, you're going to be there for weeks16:24
Keybukbut you're still going to be spending a lot of your time staring at your feet, wondering how slow it's actually possible for you to walk, and experimenting with games of feet placement16:25
psusiit's a shame that there isn't a system call where you could force the kernel to populate the buffer cache with data that you read from a contiguous pack file16:25
Keybukyou'd need to know which file it was16:26
psusii.e. rather than just put the block trace info in the pack file, actually copy the needed data pages there, so you can read them all in at once and in order from that file at boot16:26
Keybukwhich means your pack could go out of date every time the filesystem shifted about a bit16:26
psusieven if the files themselves are scattered all over hell and back16:26
psusiright... true...16:26
Keybukkernel block cache is mostly along the lines of "N pages at sector X"16:26
Keybukit'd be nice if we didn't have to open() files to readahead() blocks from them16:26
Keybukthe kernel team are vaguely playing with that16:26
mvobdmurray: did we get dupes of #369951 in recent history? can you see that with your magic LP superpowers :) ? the empty VarLogDistupgrade200xxx - do we get those on more recent releases like lucid or karmic?16:27
psusiwould also be nice if you didn't have to block on readahead, then have the disk idle for a split second while you issue the next readahead16:27
Keybukwe don't have to block on readahead16:27
Keybukwe can use posix_fadvise (WILLNEED)16:27
Keybukbut I didn't find that helped any16:27
psusiwhat do you mean we don't have to block on readahead?  it's a blocking call isn't it?16:27
Keybukreadahead() is, posix_fadvise() isn't16:28
psusiis that actually implemented?16:28
Keybukin kernel, yes16:28
psusiohh.. hrm... wonder how that works16:28
psusiideally you want to keep the disk io queue from being empty ever, which it is for a moment between calls to readahead()16:29
Keybukthat we don't have a problem with16:30
psusiand I seem to remember something about IO plugging where the disk driver decides to plug up when the queue goes empty, and when the first request comes in from the next readahead(), it waits like 20 ms before servicing it to see if any further requests enter the queue and give the elevator a chance to coalese them16:30
psusiwhy not?16:30
nxvldholbach: ping16:31
=== doko_ is now known as doko
Keybukcause we spent a long time staring at blktrace output to make sure we were always getting merges with contiguous blocks16:31
Keybukit's quite cute16:31
Keybukwhen you read 4K from one file, and 4K from another16:31
Keybukbut the blocks are actually contiguous from disk16:31
Keybukthe kernel does a single read16:31
psusiright...16:31
Keybukand ureadahead on HDD is like IO_PRIO_IVANOVA and CPU_PRIO_GOD16:32
psusibut you don't read 4k from the second file until the 4k from the first file has been read16:32
Keybuksure we do16:32
dholbachnxvl: pong16:32
Keybukreadahead() doesn't seem to actually block :p16:32
psusilol, really?16:32
psusithe man page seems to indicate that it does not return until the data is actually in the page cache16:32
nxvldholbach: about GSoC, i'm participating as community member, where should i send the proposal of my idea? To you or write it somewhere in the wiki?16:32
nxvldholbach: and until when do i have to send the proposal16:33
Keybukpsusi: pfft, manpages :p16:33
psusibut if it just puts the read request in the queue then returns... then yea. that's fantastic16:33
dholbachnxvl: can you join #ubuntu-gsoc16:33
=== yofel_ is now known as yofel
Keybukpsusi: I didn't see any difference between readahead() and posix_fadvise(WILLNEED)16:34
psusiso then it doesn't matter what order the files are in, as long as defrag packs them all at the start of the disk. ureadahead will read them in order... hrm... I gotta try this...16:34
Keybukstart or end16:34
Keybukor middle16:34
psusiwell, start is usually fastests16:35
Keybukor in interesting places somewhere across the sector boundaries16:35
Keybukstart's usually around the outside of a cylinder isn't it? :p16:35
psusiit's usually wherever the drive is fastest ;)16:35
psusiup to the drive to figure that out16:35
Keybukbut yeah, sounds good16:36
apwKeybuk, i don't think that can be right, there is no way that i edit source, and then it may or may not be in the file if i open it for 5 s16:36
apwthat is mental semantics16:36
Keybukfor added bonus, ureadahead was always intended to be able to output its pack file in a "format ready for defrag"16:36
Keybukapw: reading back, I don't think I am right - I think a crash has to apply between16:36
KeybukI may have confused NFS with reality there16:36
psusiwell, I stripped the output of --dump down to the bare file names last night... will have to have ls translate that into inode numbers tonight and pass the list to e2defrag and see what happens16:36
apwKeybuk, ok phew16:36
Keybukpsusi: inode numbers are in the pack file16:36
Keybukwould it help if I told you the pack file format? :p16:37
psusilol... no, I'd rather not write any C code if I can do it with some shell ;)16:37
Keybukyou can do it with python16:37
Keybukit means you get correct results16:37
psusiI don't know python16:37
Keybukor you could tell me what data you actually want, in what order16:37
Keybukand I can knock you up some code in a few minutes ;)16:37
psusiwell e2defrag just wants a list of inode numbers and you can tag them with a priority16:38
Keybukok, two secs16:38
psusiit then uses that list to alter the standard order it packs the files in, which is normally just inode number order16:41
Keybukpsusi: http://people.canonical.com/~scott/inodes.pl16:58
=== deryck is now known as deryck[lunch]
jpdsKeybuk: 404!17:02
Keybukshouldn't be now17:02
unggnuhi all17:08
KeybukI so just thought I saw ubuntulog saying "hi all"17:08
unggnu:D17:09
unggnuAre there plans to switch from bz2 to lzma for the repository files? Afaik for some packages lzma is already used so it shouldn't be a big deal. I mean the files are downloaded nearly every day and are quite big I think.17:09
unggnuAlso the decompression should be faster than with bz2. :)17:09
cjwatsonit's a package-specific decision17:10
cjwatsonthe default remains gz and is likely to stay that way17:10
unggnucjwatson: I don't mean for the packages itself but for the information about the packages.17:10
cjwatsonoh, ask the launchpad team, not something we control17:10
unggnucjwatson: something like that: http://archive.ubuntu.com/ubuntu/dists/lucid/universe/binary-i386/17:11
cjwatsonthough that said apt might not support it yet17:11
unggnucjwatson: afaik packages like openoffice and similar are already compressed with lzma so dpkg should be able to do it, at least with Lucid and most likely Karmic17:12
unggnuI don't know, I just thought it would be great especially for people with slower connections.17:12
cjwatsonwhy does that follow?  package decompression and index acquisition is completely different code, and dpkg doesn't do that decompression anyway.17:13
unggnuEven with six megabit they take some time.17:13
unggnucjwatson: Ok, but some parts are able to use lzma that's why I thought it shouldn't be a big deal17:13
cjwatsonunggnu: I didn't say it would be a big deal17:14
* Keybuk hands cjwatson the "patches welcome" button17:14
cjwatsonanyway, adding it to the dists tree on archive.ubuntu.com is still something the Launchpad team would need to do17:14
unggnuOf course incremental update information would be better but until then :)17:15
ograit is a big deal for arches that already have issues to handle the current uncompressing though17:15
* ogra points to armel17:15
unggnuogra: afaik lzma decompresses faster than bz2, it only uses more mem17:15
ograunggnu, right, which is a problem on armel :)17:16
unggnuBut this shouldn't be a problem for ~six MB files17:16
ograits limited in both, CPU and memory17:16
cjwatsonthis conversation belongs in a bug report or something17:16
unggnuogra: they can use bz2 or gz (I suppose there is a reason why the reps are still shipped with gz)17:17
Caesarlucas: so can I reassign that bug back to Ruby then?17:17
unggnucjwatson: Would it make sense? I mean it is considerable? That's what I am mainly asking. :)17:17
unggnu*possible17:18
cjwatsonunggnu: I thought I'd answered that.  I don't see why it would be infeasible17:18
cjwatsonit might not be *straightforward* for reasons you haven't considered, but I don't see why it would be *infeasible*17:18
unggnuThat's the point why I am asking here :=)17:19
=== MacSlow is now known as MacSlow|capoeira
lucasCaesar: I think it's still assigned to it17:36
unggnucjwatson: btw. this is/was the blueprint for the packages https://wiki.ubuntu.com/dpkg-lzma17:36
Caesarlucas: it is, I'm asking if I should reassign it back to ruby17:36
cjwatsonunggnu: thanks, I was aware of that17:37
lucasCaesar: I meant: it is still assigned to ruby. (ruby-defaults, while it should be ruby1.8). Anyway, it's on my radar, and on my todo list17:38
Caesarok17:39
=== beuno-lunch is now known as beuno
=== mnepton is now known as mneptok
=== deryck[lunch] is now known as deryck
dokoRiddell, kees: why is qt4-x11 built with -fno-stack-protector  ?18:28
nixternalcjwatson: just got an email about dmb joining cli/mono...did I miss something there?18:57
cjwatsonnixternal: requested and approved delegation from the technical board18:58
cjwatsonI'm in the process of setting it up, with the DMB as team admin18:58
nixternalgotcha..just wanted to make sure something silly wasn't going on :)18:58
nixternali get spam emails from time-to-time that are similar in nature18:59
cjwatsonah, no, this was legit18:59
nixternali got one the other day that said the ubuntu france loco team was now the admin of ubuntu-devel :)19:00
cjwatsonmaybe I'll change it to "uploaders"19:01
macoare all the amd64 buildd's broken?19:03
macoi just had one package on yellow and one on osmium fail with "chroot problem"19:03
james_wwhat particular problem?19:04
james_wntp?19:04
macojames_w: yep19:05
macoboth systems19:05
ScottKmaco: lamont is giving back the in archive ones.  You'll have to retry any PPA builds yourself.19:07
macoScottK: ok well im leaving for the airport in an hour, so if amarok in kubuntu experimental fails can you retry it for me?19:07
maco(i386 is done)19:08
ScottKmaco: Link me.19:08
macoScottK: https://edge.launchpad.net/~kubuntu-ppa/+archive/experimental/+build/155855719:08
ScottKGot it.19:08
macoScottK: thanks19:08
rzrcjwatson: hi i am reading your email about parted19:26
rzrcjwatson: as fatresize maintainer ,  how can I help ? BTW I plan to move it to some team19:27
rzrcjwatson: will try to rebuild it this W/E19:30
rzrback19:36
Roblobwhy are the menus on the left?19:44
rzrcjwatson: i applied to parted debian team19:44
KeybukRoblob: because Ubuntu comes from the UK19:44
Keybukif it came from Europe or the US, they'd be on the right19:44
vishlol19:44
Keybukit's a bit like driving an import19:44
macoKeybuk: :P19:45
RoblobKeybuk, doesnt ubuntu come from ZA? South Africa?19:46
macoRoblob: canonical is based in london19:46
macoRoblob: though mark originally comes from ZA19:46
zygamanjo: ping19:48
zygamarjo: ping19:48
zyga(sorry manjo)19:48
cjwatsonrzr: I'll send you a reference to the patch - it's fairly straightforward19:50
keesdoko: I don't know -- I find that highly upsetting.19:53
keesdoko: anything with such exceptions is supposed to be listed here: https://wiki.ubuntu.com/CompilerFlags#Problems19:54
jdonghmmm do we have a procedure for archive removals (completely), like what we did with sun-java*?19:55
jdongthe upstream Sagemath guys are pretty irate about our packages19:56
yannickhey guys how can i get kdelibs >= 4.4. ?19:56
jdongdebian bug 57353819:56
ubottuDebian bug 573538 in sagemath "Please remove the sagemath package" [Grave,Open] http://bugs.debian.org/57353819:56
ScottKI think there's already a removal bug for sagemath.19:57
sebnerdoko: MOTU-MONO hasn't been active for years anyways but would it be a good idea to close it as we now finally have our cli-package-set?19:58
ScottKjdong: sagemath is already removed from Lucid.19:59
jdongScottK: can we backpropagate that removal to Karmic?20:00
ScottKNot a lot we can do about stuff that's already released.20:00
cjwatsonjdong: no, sorry20:00
jdong*nods*20:00
jdongok, I'll let the Debian maintainer know.20:00
Chipzzsigh20:02
Chipzzthat looks like a very poor way of handling things20:02
Chipzz(on account of upstream)20:02
Chipzzthey should have worked with the debian maintainer to get a more recent version included, or have the bugs fixed20:03
Chipzzbut encouraging users to compile it themselves... where did I leave my cluebat? :P20:03
jdongwith regards to sagemath, if in the future a proper package shows up, would it be okay to send it through the SRU process to karmic-updates?20:04
zygamvo: hi!20:05
zygamvo: how are you? I heard you are ill20:06
james_wjdong: worth a go if there is a significant improvement IMO. No-one's going to pre-approve an unseen package though.20:07
mvohey zyga - indeed, good to see you! how are you doing?20:07
jdongjames_w: oh definitely. Just making sure there's no *SLAP* BAD JDONG CRACK initial reaction to the idea :)20:08
Chipzzreading the discussion further... shipping forked copies of other libraries... another facepalm :P20:08
mvozyga: I'm much better now, I was sick with a stomach bug, but I'm much better now20:08
cjwatsonRiddell: is bug 538231 the same as bug 538142?20:08
ubottuLaunchpad bug 538231 in ubiquity "[Lucid]Ubiquity appears to crash in Kubuntu Live CD environment but then runs successfully after error dialogs closed." [Undecided,New] https://launchpad.net/bugs/53823120:08
ubottuLaunchpad bug 538142 in ubiquity "kconfig permissions errors starting kubuntu ubiquity" [Undecided,New] https://launchpad.net/bugs/53814220:08
zygamvo: I released c-n-f 0.2.4120:09
zygaa minor update since previous ubuntu package20:09
mvozyga: sweet, does it fix bug #507760?20:09
ubottuLaunchpad bug 507760 in command-not-found "c-n-f does not suggest commands with numbers ('bzip' does not suggest 'bzip2')" [Low,Fix released] https://launchpad.net/bugs/50776020:09
mvozyga: it appears it does \o/20:09
mvozyga: I sposnor it tonight!20:09
zygamvo: thanks20:11
zygamvo: I'll make a few more releases with less critical fixes20:11
zygamvo: but this one is targeted for lucid20:11
mvozyga: excellent, much appreciated20:11
mvozyga: keep me updated at irc, I will immediately sponsor20:11
zygamvo: thanks! :-)20:11
mvowell, thank *you* :)20:12
zygathat's all from me, I'm going back to coding20:12
mvohappy hacking20:12
* mvo will also do a data-updated while at it20:12
zygaoh20:12
zygathat reminds me20:12
zygawhere can I find scan.data?20:12
zygaI found one in ubuntu source package20:12
zygamvo: https://edge.launchpad.net/~zkrynicki/+archive/command-not-found (PPA with release)20:15
mvozyga: http://people.canonical.com/~mvo/command-not-found/20:15
mvozyga: I assume you have the code in a bzr branch as well?20:15
mvoready for merging20:15
zygamvo: yes20:16
zygamvo: it's in lp:command-not-found20:16
zygatrunk20:16
zygamvo: there are +3 new strings I think, I don't know if that's a problem20:16
zygaif so I can work around that by removing some features20:16
zygamvo: I was going to ask about #53303120:21
GheRiverohi everyone20:21
zygabug #53303120:21
ubottuLaunchpad bug 533031 in command-not-found "command-not-found fails to work on ports architectures" [Low,Triaged] https://launchpad.net/bugs/53303120:21
mvozyga: its a bit of a problem because we are in UI (string) freeze, but we can mail the translators list if its important20:21
* hyperair wonders if jdstrand is around.20:21
mvozyga: port> oh, right. its currently not crawling those as the server I run it on has only the normal archive mirrored20:22
zygamvo: it's not critical, if you want I can work on that to remove the requirement20:22
mvozyga: I have a look and let you know20:22
zygathanks20:22
zygamvo: I integrated ubuntu translations into trunk so hopefully we can have a better state of translations the next time, translations can happen upstream for a change20:23
nxvlbryceh: ping20:27
lucaspitti: can you clarify why you switched ruby1.8 to libreadline-dev instead of libreadline5-dev? according to #553843 it is a license violation20:40
lucaspitti: ruby1.8 is "ruby license or GPLv2". readline6 is GPLv320:45
Keybuklucas: ruby doesn't appear to specify which GPL version, actually20:46
Keybukit just says "the terms of the GPL"20:46
lucasKeybuk: next line20:47
lucas:-)20:47
Keybukwhat next line?20:47
lucasin COPYING?20:47
micahglucas: I think the plan was to drop libreadline5-dev from Lucid20:47
KeybukI was reading debian/copyright20:47
lucasnever trust the debian maintainer20:47
Keybuklucas: I'm quoting you on that next time I follow one of your talks at a conference ;-)20:48
Keybukthough that being said20:48
KeybukCOPYING was changed years after debian/copyright was written20:48
lucas    * COPYING: explicitly note GPLv2.  [ruby-talk:187922]20:49
lucasDate:   Sun Apr 9 16:10:40 2006 +000020:49
Keybukright, and debian/copyright was written 2003!20:49
Keybukbut yes, I agree with you20:49
Keybukruby1.8 is GPLv2 only20:49
Keybukso cannot link with GPLv3 code, or LGPLv3 code20:49
=== MacSlow|capoeira is now known as MacSlow
lucasthere's another, more serious problem with ruby1.8, actually. we link to openssl, so we basically choose the ruby license, not the GPLv2 one. and then we link to readline5 (in Debian), which is GPLv2 or later20:51
Keybukdoes that problem exist in Debian too? :p20:53
lucasKeybuk: yes20:53
lucasKeybuk: (I'm one of the maintainers)20:53
Keybukhmm, just checking20:53
Keybukdoesn't only libopenssl-ruby1.8 end up linked with libopenssl?20:53
Keybukand doesn't get linked to readline?20:53
Keybukthat's not _technically_ in violation then <g>20:53
lucasthat's correct20:54
slangasektechnical violations are the only ones that matter ;)20:54
Keybukeach binary package is individually redistributable without breaking licence20:54
Keybukso they can be distributed together too20:54
Keybuk(aggregate argument)20:54
lucasmmh, what happens if a ruby app uses both the openssl and readline libraries?20:55
Keybukexcept for the libreadline6 link, obviously - that's a definite violation20:55
cjwatsonis it possible to use libedit?20:55
Keybuklucas: emacs and python argument => scripting languages can load plugins that are otherwise licence contradictory20:55
cjwatsonit's not quite as good, but the *point* of readline being GPL is that the good stuff is restricted to GPLed programs :)20:55
zygaKeybuk: o_O ?20:55
zygaKeybuk: can you expand that statement, it's quite interesting20:56
Keybukzyga: it's the FSF's position20:56
Keybukgo look it up on fsf.org ;)20:56
zygammm, I will20:56
lucasok, then we are fine, and just need to revert the ubuntu-specific change20:57
zyga(so a scripting language inside the kernel... ;-)20:57
slangasekKeybuk: I don't think that argument holds water if the ruby app is in our archive20:57
cjwatsonlucas: this is still a problem, though, we don't want multiple readline versions in main if we can avoid it20:57
lucasI'll request a sync of the debian version, which also fixes the ruby+threads+timeout/puppet bug20:57
cjwatsonand indeed libreadline5 is currently in universe, although presumably that's only once pitti rebuilt ruby against libreadline620:58
lucascjwatson: I don't see a way to avoid it, except dropping readline support in ruby. you don't want to do that, because all ruby developers use irb, which uses readline AFAIK20:58
cjwatsonlucas: 20:55 <cjwatson> is it possible to use libedit?20:59
cjwatsonit has a readline wrapper, and it's BSD-licensed20:59
cjwatsonas I say, it's not quite as good, but it's not that bad either20:59
siretart`while discussing this subject, there is popular request to compile ffmpeg against opencore-amr. however, since the latter uses apache license, this would require us to distribute libavcodec under GPLv3. My conclusion is that this would cause problems for ubuntu. Is that right?20:59
lucascjwatson: it's a drop-in replacement?21:00
cjwatsonto some extent21:01
lucas:-)21:01
cjwatsonit has a wrapper which attempts to emulate at least a decent chunk of the readline API21:01
cjwatsonI'm not saying it will definitely meet your needs, but it's possible that it might get you out of a hole so it seems worth a look21:01
lucasthat might be a long term solution, but I don't see this happening before the lucid release (especially if I'm the one doing it)21:03
cjwatsonfor lucid, it does seem like going back to readline5, biting our tongues, and accepting two readline versions in main is what it'll have to be21:04
cjwatsonat least it isn't on the CD21:04
cjwatsonpitti: ^-21:04
siretart`to make matters more complicated, would enabling opencore-amr for the ffmpeg-extra package acceptable? We could then advice users of GPLv2 applications to avoid the ffmpeg-extra package...21:06
mvozyga: could you add in the debian/changelog what bugs are fixed with the release please?21:12
zygamvo: such as the stuff listed in the release notes for this version on launchpad? (I'm searching for a link)21:13
zygahttps://launchpad.net/command-not-found/trunk/0.2.4121:14
zygashall I add that stuff to the changelog below '* new upstream release' ?21:14
mvozyga: yes, exactly this :) just below new upstream version is fine. and please include the bugnubmers as LP: #bugnr - then they will get auto closed on upload21:15
zygaokay just a moment21:16
mvosure21:16
zygaI branched from tag 0.2.41ubuntu121:16
* zyga is pleased to see vim is aware of LP: #[0-9]+21:17
zygamvo: shall I bump version to ubuntu2?21:19
mvozyga: its not uploaded yet, so we can keep ubuntu121:21
zygak21:21
mvozyga: you could also use a NEWS file (that would be more upstreamish) and I copy the content into debian/changelog when making releases. but both is fine really21:21
zygamvo https://code.launchpad.net/~zkrynicki/command-not-found/lucid21:24
zygamvo: I'll keep the NEWS file up-to-date since .42 :-)21:24
zygathis branch can be used for lucid if we need to cut strings and patch other stuff21:24
mvozyga: if we can avoid the new strings somehow that would be nice, at least for the beta-1 upload, we need a UI freeze exception for new strings at this point21:30
mvozyga: thanks for the changelog, that looks good now :)21:30
ccheneyanyone here familiar with gtk?21:43
zygamvo: I'll can revert features that add new strings but this will make version ackward21:43
ccheneyi am having a problem linking to it21:43
ccheneyhttp://pastebin.ubuntu.com/394262/21:43
zygamvo: basically new strings are for auto-install feature21:43
ccheneyduring the epiphany browser backport for hardy21:43
mvozyga: ok, I think we have two option a) file UI freeze exception (should be ok, just one string) and upload on monday b) create lucid branch 2.40ubuntu2 that cheery picks all but the string21:45
zygamvo: pick the one you like, I'm fine with either since it's my fault it is soo late again21:47
mvozyga: I would say b) for now, then I can upload tonight :) otherwise a) is fine as well21:47
zygahmmm, a) would mean less messing with the history, I'll try to fix all the issues in the next few days so that once lucid+1 is around this will not happen again21:50
mvozyga: yeah, I like a) better too, https://wiki.ubuntu.com/FreezeExceptionProcess has the details (if its ok for you to write the exception)21:51
zygaokay I'm on it21:51
zyga#UserInterfaceFreeze Exceptions ?21:52
zygaor new upstream release?21:53
zygaokay so I'm filing a new bug on /ubuntu/+source/command-not-found about FreezeExceptionProcess21:56
RoAkSoAxjcastro, does the summit sponsorship website still has the bug showing a blank page when finishing requesting the sponsorship?22:12
jcastroRoAkSoAx: yep, pm me your lp username and I can make sure it's in there22:14
* jcastro likes to doublecheck22:14
RoAkSoAxjcastro, done :)22:15
mvozyga: yes, and please subscribe ubuntu-release when the bug is there22:17
mvozyga: thanks .)22:17
mvozyga: I'm off to bed now!22:18
zygamvo: thanks, bye!22:22
jpdsKeybuk: bug #538292 just came up.22:42
ubottuLaunchpad bug 538292 in plymouth "Latest plymouth update makes lucid stop at startup" [Undecided,New] https://launchpad.net/bugs/53829222:42
chrisccoulsonheh, i just saw people talking about that in #ubuntu+1 too22:44
Keybukjpds: it works for me22:44
Keybukoh, that22:45
Keybuk*shrug*22:45
Keybukthey need to update mountall too22:46
chrisccoulsonKeybuk - i'm not sure that's published yet22:46
jpdschrisccoulson: It is.22:47
Keybukwell, people shouldn't be so eager on the update button, should they <g>22:47
chrisccoulsonyeah, probably ;)22:47
chrisccoulsonjpds - there's no 2.8 in the archive yet: http://archive.ubuntu.com/ubuntu/pool/main/m/mountall/22:48
cjwatsondiscussion in #ubuntu-release indicated that we were going to have new libplymouth2 Breaks: old mountall, but I don't see that in the package?22:48
=== andreasn_ is now known as andreasn
jpdschrisccoulson: Oh, the source is published, right.22:49
Keybukcjwatson: one had to be built before the other22:49
Keybukor the chroots would have removed upstart22:50
Keybukand killed themselves22:50
cjwatsonoh, I see we're waiting for mountall before going round with the Breaks, for reasons I didn't follow but you and slangasek seemed to be on top of it22:50
cjwatsonright, I didn't attach that to missing Breaks the first time22:50
slangasekjpds: just replied to bug #538292 with explanation, sorry22:52
ubottuLaunchpad bug 538292 in plymouth "Latest plymouth update makes lucid stop at startup" [Undecided,Fix released] https://launchpad.net/bugs/53829222:52
slangasekcjwatson: you're a buildd admin?22:53
slangasekmountall/{ia64,sparc} need rescored22:53
slangasekonce they start building, I can accept the fixed plymouth22:53
slangasekand it would be nice if that happens sooner than 7h from now22:54
cjwatsonslangasek: yup, sec22:59
cjwatsonI've taken the precaution of putting the publisher on manual23:00
cjwatsonslangasek: both scored up, but I can't do anything about the existing builds running on ia6423:00
cjwatsonso it's still nearly an hour away23:01
jpdscjwatson: amd64 was about to be published and i386 binaries are on the archive.23:01
cjwatsonyeah, I've taken it off manual again since there's no benefit with ia64 an hour out23:02
cjwatsonjpds: but that wasn't what the precaution was for - if the ia64/sparc builds were going to arrive quickly, I could have got them published faster with the publisher on manual23:02
slangasekoh pah, we got stuck behind eucalyptus and openjdk?23:08
cjwatsonslangasek: if you're truly desperate, I think lamont can kill jobs23:10
* Caesar discovers mountall and throws up in his mouth a bit23:11
slangasekcjwatson: if the builds were still at the unpack phase I might worry about dpkg+fsync and the accuracy of the estimate... I think we might as well let this run its course now23:13
CaesarWow, this mountall thing is a total black box23:14
wgrantThe LP estimate is solely based on the previous build times.23:14
sistpotyfta: the name of the binary packages are left to your discretion for bug #537617, just if that was not clear from my comment. Do you have any ETA for landing it in lucid?23:15
ubottuLaunchpad bug 537617 in chromium-browser "[FFe] chromium-codecs-ffmpeg for lucid" [Undecided,New] https://launchpad.net/bugs/53761723:15
slangasekwgrant: yep - but eucalyptus is already at least halfway done now23:17
=== rzr is now known as rZr
=== slangasek changed the topic of #ubuntu-devel to: don't reboot with libplymouth2 0.8.0~-13 without mountall 2.8! | Archive: Feature Freeze + Beta Freeze | MoM running (but use bzr!) | Development of Ubuntu (not support, not app development) | #ubuntu for support and general discussion for dapper-karmic | #ubuntu-app-devel for application development on Ubuntu | http://wiki.ubuntu.com/UbuntuDevelopment | See #ubuntu-bugs for http://wiki.
=== slangasek changed the topic of #ubuntu-devel to: don't reboot with libplymouth2 0.8.0~-13 without mountall 2.8! | Archive: Beta Freeze | Development of Ubuntu (not support, not app development) | #ubuntu for support and general discussion for dapper-karmic | #ubuntu-app-devel for application development on Ubuntu | http://wiki.ubuntu.com/UbuntuDevelopment | See #ubuntu-bugs for http://wiki.ubuntu.com/HelpingWithBugs
slangasekmountall publishing23:47
slangasekcjwatson: and plymouth accepted again, could use rescoring on ia64/sparc23:51
cjwatsonslangasek: dodne23:55
cjwatson*done23:55
slangasekcheers23:55
cjwatsonshould be quicker this time23:55
cjwatsonslangasek: they're taking their time about it.  should I put the publisher in manual in the hope of getting all architectures into this hour, or would you rather get i386 in ASAP?23:59
cjwatson(amd64 is waiting as well, or I would just assume the latter)23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!