=== cpg is now known as cpg|away === matsubara is now known as matsubara-afk [00:54] Daviey: I'm not sure I expect a spec from that one.. being a roundtable, its more to gather the interested parties in the room and do a checkup on where we're at [01:03] What's the easiest way to set up a virtual machine server with Ubuntu? I host all my stuff on my box, but a lot of the stuff hosted is for friends. I'd rather just give them a virtual machine rather than a user account. Any ideas? [01:04] AaronMickDee: qemu/kvm is pretty awesome. [01:14] SpamapS: I want a drafter that is the person responsible for driving the roundtable then :) === cpg|away is now known as cpg === cpg is now known as cpg|away === cpg|away is now known as cpg === n0ts_off is now known as n0ts [04:26] New bug: #1030276 in mysql-5.5 (main) "package mysql-server-5.5 5.5.24-0ubuntu0.12.04.1 failed to install/upgrade: tiến trình con đã cài đặt văn lệnh post-installation trả lại lỗi, trạng thái thoát 1" [Medium,Expired] https://launchpad.net/bugs/1030276 [04:26] New bug: #1030342 in mysql-5.5 (main) "package mysql-server-5.5 5.5.24-0ubuntu0.12.04.1 failed to install/upgrade: subproces installed post-installation script gaf een foutwaarde 1 terug" [Undecided,Expired] https://launchpad.net/bugs/1030342 === dendrobates is now known as dendro-afk [06:34] Daviey: around === eshlox_ is now known as eshlox [07:38] what would i use for spider/search engine for a small intranet site ? [07:38] like a local google [07:40] brontosaurusrex: http://www.searchblox.com/ ? [07:41] brontosaurusrex: or well "Google Mini" [07:42] $5000 per server? [07:42] it must be free === mcclurmc_away is now known as mcclurmc [08:03] koolhead17: hey [08:03] brontosaurusrex, you could try yacy [08:42] tested searchblox, its messy [08:43] chris|, p2p part can be disabled i hope? [09:01] zow/w 157 [09:01] meh [09:17] Hi there. I just got an ubuntu 12.4 server to my hands and I'm seeking somekind of a handbook, or server guide. I don't find this https://help.ubuntu.com/12.04/serverguide/index.html guide pretty informative. Can you suggest me any good guides? Or wikis? [09:25] frojnd: what do you actually want to learn / know? [09:28] !ask [09:28] Please don't ask to ask a question, simply ask the question (all on ONE line and in the channel, so that others can read and follow it easily). If anyone knows the answer they will most likely reply. :-) See also !patience [09:30] xnox_: everything :) [09:30] Currently I'm adding users that will do some programming on the server [09:30] I'd like to create a user that has admin access so I can disable root login [09:32] frojnd: by default root is disabled on ubuntu. the first account has sudo rights. and it looks like you are after "linux CLI" instead of server tasks.... [09:32] I've put the user to sudo group (if it will want to do some maintainance work) like this: # usermod -aG sudo newuser [09:32] xnox_: ok so I can safely read "debian handbook" for tasks like this [09:33] xnox_: I got ssh access with only root [09:33] frojnd: yes. debian handbook, debian-administrator website, http://ubuntu-manual.org/ [09:33] you can turn off root login over ssh in /etc/ssh/sshd_config [09:34] The problem is that when I login with this newuser and try to do sudo something it gives me incorrect password attempt [09:34] xnox_: tnx [09:34] RoyK: but first I have to put some users into admin group I persume [09:34] don't wanna lock myself out [09:34] frojnd: sudo prompts for the *user's* password, not the root password [09:34] RoyK: exactly [09:34] and it tells me it's wrong [09:34] let me check if I'm in sudo group [09:35] with that user [09:35] * frojnd is apologizing for multiple lines - won't happen again [09:36] Ok. So it was my wrong password :/ :) [09:38] time to disable root login [09:48] zul: keystone and python-keystoneclient minor fixes proposed through merge proposal in LP, fyi. [09:52] hi guys [09:52] I'm trying to setup ntpd on 12.04 on ec2. [09:52] Hm.. I have 2 hard drivs: sda and sdb. Both are 250GB. Now / boot swap etc (system) is innstalled on sda and I've assign 200GB from sdb for /home. But I think 250GB for / is too much? [09:52] as far as I can tell, it's install ntp package, set the servers, then enable independent_wallclock [09:53] 12.04 seems to have moved the /proc/sys/xen dir. any idea where I should be looking for indepenent_wallclock now? === remix_auei is now known as remix_tj === cpg is now known as cpg|away === n0ts is now known as n0ts_off [11:00] Hi, I just want to understand where the recovery kernel argument in grub.cfg coming from or documented? or is it ubuntu specific? [11:04] edgy: for grub 2, try /etc/grub.d and /etc/default/grub [11:08] rbasak: may be you didn't understand my question, isn't ubuntu has an entry that would allow you to go to recovery mode? [11:12] rbasak: : grub.cfg contains linux /boot/vmlinuz-3.5.0-16-generic root=/dev/mapper/vg00-lv_root ro recovery ... What's recovery here referes to? [11:14] edgy: it signals to the initramfs that recovery is requested. See /usr/share/initramfs-tools/init [11:16] rbasak: but there is no kernel option called recovery, where is this documented? the init file you refer me to contains recovery=y, so what? [11:17] edgy: userspace can make use of kernel options too. It's common for bootstrapping to pass things into userspace from the bootloader this way. Userspace bootstrap programs examine /proc/cmdline to see all arguments that the kernel received, and the kernel ignores arguments that it doesn't recognise. [11:17] edgy: /usr/share/initramfs-tools/init parses /proc/cmdline and sets its variable recovery=y if recovery was on the cmdline [11:18] rbasak: ok so the recovery option is passed to which user space program? [11:18] hi guys. anyone know how I enable independent_wallclock in 12.04 on EC2? /proc/sys/xen doesn't seem to exist [11:18] edgy: the initramfs init script, which comes from /usr/share/initramfs-tools/init [11:20] rbasak: and how the initramfs init script would handle it? the code there is not enough for me to understand [11:21] maruq: try, sysctl -w xen.independent_wallclock=1 [11:21] rbasak: it's just saying for x in $(cat /proc/cmdline); do recovery) recovery=y [11:21] edgy: not sure, sorry. I recover my systems by hand so never used the recovery feature. I would read the code to find out [11:21] edgy: so look for where else it uses the recovery variable [11:21] Daviey: just tried. I get 'error: "xen.independent_wallclock" is an unknown key' :( [11:22] rbasak: exactly that was the question I grepped the whole initramfs and no where else used this variable [11:22] rbasak: how do you do it manually? [11:22] maruq: Ah, HVM instances won't have it. [11:22] maruq: I think you already get it for free. I assume you have ntpd running? [11:23] Apart from on the "exec run-init" line? [11:23] Looks like it gets upstart to fire a "recovery" event. The next place to look is in upstart's configuration for jobs that fire on that event. [11:23] I use a recovery disc [11:24] Daviey: yeah, I installed ntp package, went with default settings & restarted the service [11:24] rbasak: I used to do it by passing init=/bin/bash which gives me a recovery shell, too [11:24] Daviey: 'less /sys/devices/system/clocksource/clocksource0/current_clocksource' says "xen" [11:24] Usually if something's wrong it just drops down to a recovery shell anyway [11:25] I haven't had to use init=/bin/sh in years [11:25] Daviey: Is there a way I can confirm that it's actually using the timeservers? [11:25] maruq: Sorry, i don't know. Maybe someone else will have a better answer [11:26] New bug: #1061537 in lxc (universe) "invalid syntax in apparmor profile abstractions/lxc/container-base" [Undecided,New] https://launchpad.net/bugs/1061537 [11:27] maruq: syslog should contain ntpd info [11:29] Daviey: this is what I'm seeing in syslog: https://gist.github.com/f4f927d94e5dec938e06 is that correct? [11:30] rbasak: there seems to be a loop here? ls -l /lib/recovery-mode/recovery-mode/recovery-mode [11:30] lrwxrwxrwx 1 root root 18 Jun 22 15:54 /lib/recovery-mode/recovery-mode/recovery-mode -> /lib/recovery-mode [11:31] Probably useful when working with chroots [11:34] rbasak: don't know [11:36] rbasak: ok thanks for you help [11:57] hi [11:58] after the latest updates something went wrong [11:58] one of the bridge interfaces wont come up [11:58] configuration is as follows [11:58] two nics [11:58] with lacp bond0 [11:58] vlan interface vlan40 with bridge to bond0.40 [11:59] a few other vlan interfaces as well [11:59] but the bond0.40 wont come up [12:01] vlan100 interface with bridge to bond0.100 comes up and cat /proc/net/vlan/config shows that everything is working fine with that one [12:02] problem being here that atm four servers that have the vlan 40 attached wont start [12:03] running xen on the server === doko__ is now known as doko === dendro-afk is now known as dendrobates [12:30] SpamapS, stgraber, So I got one more iteration to fix bug 1021471. Probably SpamapS could have a look at the latest (and now only) packages at people~smb/clonetst [12:31] Launchpad bug 1021471 in linux "clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)" [High,Triaged] https://launchpad.net/bugs/1021471 [12:31] New bug: #1061565 in tomcat7 (main) "package tomcat7 7.0.26-1ubuntu1.1 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1" [Undecided,New] https://launchpad.net/bugs/1061565 [12:33] zul: what is the difference between nova-novncproxy and nova-vncproxy? [12:36] Daviey: im not 100% sure [12:37] zul: it's a change after f3 [12:39] Daviey: no difference in my opinon it still uess novnc [12:39] Daviey, one is to use with horizon, the other with a java client. [12:40] ohh, may be i m confusing with novnc.. [12:41] from http://docs.openstack.org/trunk/openstack-compute/admin/content/faq-about-vnc.html : [12:41] zul / melmoth: There difference is the package namees. :).. It seems we switched package names after f3 [12:41] nova-vncproxy was removed from the nova source tree. The Essex analog for this process is nova-novncproxy, which is provided by an external project. [12:42] so it looks like there has been some name changed from diable to essex. [12:42] Daviey: bah sorry i didnt notice [12:42] hmm [12:42] we still build it from nova tho? [12:43] zul: The thread on the OS mailing list.. I'm trying to work out if it's a trivial doc fix [12:43] i must admit i was really confused finding the right package for the right kind of proxy (novnc for horizon and nova-vncproxy for the java client) [12:44] Daviey: ok ill try to reproduce the upgrade issue though and double check things [12:44] melmoth: yeah, i don't want to give poor advice [12:44] zul: i did just reproduce it [12:44] zul: it's not an upgrade issue, a plain install issue [12:45] grrr [12:45] zul: I am about to reply with, "In your apt-get install line, can you replace nova-vncproxy with nova-novncproxy. This was a change made after Folsom-3, and the documentation hasn't been updated to reflect." - but i want to make sure that is accurate [12:45] FWIW, it does /install/ [12:45] but is it what the user wants :) [12:46] Daviey: right [12:46] * Daviey adds some ubiquity [12:48] Daviey: right you are more awake :) [12:50] hey zul [12:50] koolhead17: hi [12:50] Daviey: which doc you are talking about sir? Do i need to modify something :) [12:53] koolhead17: yeah, possibly [12:54] koolhead17: It's not your fault. [12:56] * xnox ponders if Daviey meant English noun "ubiquity" or the Ubiquity - Ubuntu Installer.... [12:56] Daviey: just let me know what changes are needed will do. In a meanwhile with new quantum pkg in place we will push quantum doc too :) [12:56] in the same doc [12:56] xnox: not the installer [12:57] * xnox is back in the installer then [12:57] koolhead17: rocking ! [13:29] good morning all.. What is the meaning of this first part of a cronjob "root [ -O /tmp/dir.cache]" I'm used to seeing if statements as in "root if [-x " but i can't find any reference to this on a web search. [13:45] smb: downloading your latest fixed kernel now [13:46] SpamapS, Great. :) [13:49] hey all, i am looking for an easy to configure mail server distro i can build and run in a vm for our company... any ideas? [13:53] skrite: http://www.turnkeylinux.org/search/luceneapi_node/mail%20type:appliance ... these would probably work [13:53] skrite: Zimbra in particular is pretty nice. [13:54] SpamapS: thanks [14:45] Daviey: based on andrew's comment on the ec2 bug https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/migrate_repo/versions/107_add_instance_id_mappings.py it doesnt happen when the table is created and migrated [14:51] New bug: #1060404 in lxc (main) "update-grub runs and fails in containers" [High,Confirmed] https://launchpad.net/bugs/1060404 [15:04] New bug: #1061665 in nova (main) "Filter scheduler not respecting the force_hosts hint" [Undecided,New] https://launchpad.net/bugs/1061665 [15:25] i see Daviey live :) [15:26] smb: you going to be around for a bit longer? Just now about to test that kernel [15:26] denyhosts has started blocking localhost on a handful of machines in the last 24 hours. Any idea what's going on? [15:26] I'm not aware of anything that's changed on our setup. === dendrobates is now known as dendro-afk [15:40] chmac: sounds like a bug.. localhost should be whitelisted [15:41] SpamapS: Right, sounds odd, and what caused it to flare up now, on 3 servers, within 24 hours of each other, all with similar configs... [15:41] I'll double check the whitelisting. [15:41] I only noticed the issue because monit can't connect on localhost, so it thinks sshd is down, restarts it a few times, then times out. Meanwhile, it's running all the time. [15:52] hey [15:53] has anyone compared chroot to virtualbox? [15:56] hello? [15:56] moose: hey.. you can just ask.. if anyone knows they will answer [15:57] ok [15:57] i have only used Vbox, and its arguably "easier" i would say.. thought the chroot might be less overhead if thats what you want/need.. theres Vbox headless (text mode) [15:58] what are the pros and cons of chroot vs [3~[3~[3~[3~[F[3L:/ok [15:58] which one is more secure? [15:59] i wouldnt trust any casual answer on the IRC about that... i would say if you are experience, either can be as secure as you need [16:01] how much resources does a virtual box need compared to chroot? [16:01] moose: i have only used Vbox, but i would just set both up and see.. [16:02] ok [16:02] thank u [16:04] moose: chroot and virtualbox are like a bicycle and a car... pretty hard to compare [16:04] holstein: and don't be silly, chroot cannot be as secure as a VM. [16:05] my server has only 500mb of m, [16:05] moose: heh, thats not a server then :) [16:05] you might be using it to serve things, but its not a server computer :) [16:05] well, not a sver for virtual box maybe, but chroot might be ok [16:05] SpamapS: i still think it would depend on the use case and the skill level.. but like i said, i use Vbox.. [16:06] smb: initial result seems positive! [16:06] hallyn: ^^ smb's newest kernel seems to address the issue [16:07] is 500 RAM not enough for a server? min is only 125mb [16:07] crap [16:07] [ 455.352556] unregister_netdevice: waiting for lo to become free. Usage count = 1 [16:07] hallyn: spoke too soon [16:08] what did his newest kernel do? [16:08] No idea he hasn't been sharing patches [16:08] i wonder how hard it woudl be to 'just' yank the routing cache :) [16:08] just posting kernels which I try ;) [16:08] root 16118 0.0 0.0 27532 1032 ? Ds 09:07 0:00 lxc-start --daemon -n clint-local-ci-u1-0 -l DEBUG -o /home/clint/.juju/data/clint-local-ci/units/u1-0/container.log [16:08] dead [16:08] smb: n/m, still broken [16:08] SpamapS: i meant what approach did that kernel take to trying to fix it [16:08] hallyn: *no idea* [16:09] ok [16:09] hallyn: you'd have to ask smb [16:09] [ 577.079821] rtdbg: fib_disable_ip(lo/ffff880164917000/ffff880073e68000, -1) [16:09] seems to be printing that out a lot [16:09] i did, implicitly :) irc is a wonderful thing [16:10] how do i supress [D[D[D[D[D[D[D[D[D[3~[3~[3~[3~[3~[3~[3~[D[D[D[D[D[D[D[D[3~[3~[3~[3~[3~[3~[3~[3~[F[A[A[A[B[B[B[B[B[B[3~[3~[3~[3~[3~ [16:10] hallyn: could this be avoided at all by restarting the lxc-net service between lxc-stop/lxc-destroy and lxc-start ? [16:11] moose: use the right $TERM setting [16:12] SpamapS: no [16:12] yeah just tried that [16:12] hallyn: anything we can put in the instances to clear out the route cache right before halt? [16:12] SpamapS: what we could try, [16:13] at this point, I'm not really confident that we'll have a solution for 12.10's release [16:13] what we could do is stash away /proc/self/ns/net for the open container [16:13] or actually, mnt [16:13] then use that after container shuts down to flush the route cache [16:13] but really, smb's earlier kernel tried to do that from th ekernel, and it didn't work [16:14] so my guess would be that your write to the 'flush' file would hang, waiting for a mutex to P [16:14] i still think that despite assumptions we've made, it would be worth bisecting upstream kernel both for the commit breaking it, and teh commit fixing it [16:15] noone has AFAIK *verified* that dropping the route cache fixed it [16:15] if need be i'll spin up a bigmem.xlarge or whatever amazon instance and start the bisection, but i've been waiting to hear whether smb is doing that already [16:15] hallyn: right, there is a lot of change between here and there [16:16] hallyn: how does that work, bisecting on amazon? [16:16] SpamapS: does an upstream kernel havethe needed supprot to boot inamazon? i figure it would work the same way as installing a new kernel .deb [16:17] i.e i was assuming EBS instances can boot whatever grub says to [16:17] hallyn: you'd have to ask smoser and utlemming.. I'm just not sure how it would work [16:17] still going to wait for smb. i dont' want to duplicate work [16:17] meanwhile i have to piss off upstart :) [16:17] I admit that I usually put my hands on my ears and sing "Camp town ladies" whenever people talk about the kernel [16:18] (that's an option? :) [16:18] yes, but your punishment is dealing with php :) [16:18] hallyn: ooh, that's cold. [16:19] hallyn, ebs (or instance store) boot with "pvgrub" [16:19] which reads /boot/grub/menu.lst [16:20] as far as upstream kernels having the right stuff, i suspect that current upstream can be configured to boot correctly. === dendro-afk is now known as dendrobates [16:20] smoser: "boot with pvgrub" - where do i specify that? [16:21] hallyn: that happens automatically with AWS [16:22] pvgrub is specific to Xen [16:23] cool [16:23] thx [16:24] it happens automatically with our images in pvgrub [16:24] you register with a kernel [16:24] our images are registered with the pvgrub "kernel" [16:24] (since 10.04) [16:49] hm... apt-btrfs-snapshot looks like a jolly good idea, but does it integrate with grub to allow booting from the previous snapshot somehow? === PreciseOne is now known as IdleOne === mcclurmc is now known as mcclurmc_away [17:28] RoyK: initramfs does not support booting of any subvolumes bug @ [17:28] RoyK: so, no. You can change @ to achive the same I believe. [17:29] but I have not tried. [17:29] i stated earlier that something was broken with the latest updates [17:29] dont know if its the devs fault or whoevers [17:30] but specifying in the /etc/network/interfaces a vlan40 interface and a line with bridge_ports bond0.40 does not create a sub interface bond0.40 [17:31] it created a bond0.100 interface which was the first specified [17:31] in interface vlan100 [17:32] manually specifying bond0.100 bond0.40 etc with vlan-raw-device bond0 works [17:32] after that stuff works like it used to [17:33] dont know if the problem lies with ubuntu [17:33] package vlan or ifenslave [17:34] can anyone say if ubuntu has the lacp function built-in nowadays or is the ifenslave still required [17:34] ? [17:34] ifenslave package* [17:50] any suggestions about sys admin blogs i should read? [17:54] Hello. Has anyone here created a dhcp server? If so, if I have a network such as [modem] -> dhcp server -> [switch] -> client .... and the client can talk to the dhcp server... what would be stopping the client from accessing the internet? I tried to open some ports through iptables but it doesnt seem to like me. Any thoughts? [17:55] howdy: if you're assigning RFC 1918 non-routable addresses to your clients, you'll also need a network address translation firewall: http://en.wikipedia.org/wiki/Network_address_translation [17:56] dhcp server has nothing to do with accessing internet [17:57] Well, I know it's to assign ips. But I guess I'm misunderstanding something. [17:59] sarnold: Thanks. [18:12] Everytime I try to restart my network I get this error message http://paste42.de/4195/ is there another way to restart the network? [18:16] Poapfel: No. They broke networking restart while porting it to upstart [18:17] zul: do you have any ideas on bug 1057024 ? i don't... [18:17] Launchpad bug 1057024 in libvirt "internal error Process exited while reading console log output: char device redirected to /dev/pts/1 error when creating a vm" [High,Confirmed] https://launchpad.net/bugs/1057024 [18:17] i can't reproduce it. everythign looks kosher [18:17] it sure looks like libvirt-qemu user simply can't access /dev/kvm. but perms are correct [18:18] hallyn: any AA rejects? [18:19] sarnold: hm, i haven't asked for that info, as i don't see how it's possible :) but i'm getting desparate enough... [18:20] hallyn: i havent seen that before but this looks suspicious: [18:20] http://pastebin.ubuntu.com/1260491/ [18:20] zul: i know! but /dev/kvm is owned by kvm group, with group write perms [18:20] psivaa: hi [18:20] hallyn, hi [18:21] psivaa: sarnold was just suggesting maybe there's apparmor perms problem. [18:21] can you pastebin the tail end of /var/log/syslog? [18:21] hallyn: im asking for the dmesg output as well [18:21] sure, 1 sec [18:21] zul: psivaa is the bug submitter [18:21] psivaa: oh hi [18:22] hallyn: can you re-load the module [18:22] and then restart libvirt [18:22] zul: note *i* can't reproduce the bug [18:23] hallyn: yeah googling doesnt have anything interesting [18:23] hallyn, zul https://pastebin.canonical.com/75924/ is the syslog [18:23] wait a sec [18:24] psivaa: jinkeys, that requires 2-factor auth for me to read [18:25] hallyn, ohh yea, what other form could i paste? [18:25] psivaa: dmesg please [18:26] psivaa: oh hey. do you by chance have vmware or virtualbox installed? [18:26] hallyn, yes, i do have it installed [18:26] zul, is canonical pastebin ok for you? [18:26] gah! [18:27] psivaa: prefer not :) [18:27] psivaa: can you unload its kernel modules? [18:27] hallyn, not sure how to do that :) [18:27] we may want to call this a linux kernel (kvm module) bug, but that'll be the problem [18:27] psivaa: can you pastebin 'lsmod ' output? [18:27] or just apt-get purge virtualbox, if you don't actually use it [18:28] but for testing we should be able to just rmmod the module (once we know its name) [18:28] hallyn, SpamapS, Not sharing patches is a lie. You should for a change read the bug report. It basically now does yank the route cache as it is supposed to [18:28] smb: ? who is not sharing patches? [18:28] With the debug kernel you should actually see it in the logs [18:28] zul, hallyn: https://pastebin.canonical.com/75926/ is the dmesg, sorry i dont have anyother means now :$ [18:29] hallyn, Though SpamapS was telling that I would not ;) [18:29] though [18:29] *thought [18:29] gah [18:29] smb: im' 99% sure he didn't mean whatever he said quite like that [18:29] Jeeves_: ? [18:29] so there is no way to restart it? [18:29] smb: are you able to/have you been doing a bisect to determine where the bug was introduced or fixed? should i be trying that? [18:29] smb: indeed I was a liar. :) [18:30] (bisecting upstream, not ubuntu kernel) [18:30] lsmod https://pastebin.canonical.com/75927/ [18:30] hallyn, I am 100% sure I am overstating the fact ;) [18:30] The problem with net is that they a) replaced the whole route cache by something different between 3.5 and 3.6 [18:31] That makes bisecting a major pain in the rectum [18:31] smb: I'm still running the affected machine so, do you need any more dmesg's or such? [18:31] smb: right, but i was thinking of bisecting 3.2 .. 3.5 to figure out where it was introduced [18:31] smb: hey do you know offhand the name of the virtualbox kernel module? [18:31] Plus they have some fixes in the pipe (linux-next) that also targeted a similar sounding issue [18:31] Poapfel: You can ifdown, but that will probably disconnect you [18:32] screen , ifdown ; ifup mght work [18:32] hallyn, hm no. Some dkms thing... [18:32] smb: yeah, finding the commit that fixes it is IMO less likely to work :) [18:32] ok thx, [18:34] psivaa: drat, i can't find the virtual box kernel module in your lsmod list. Do you mind going through software center and removing virtualbox, to see if that fixes it? [18:34] hallyn, seems there is 4 of them [18:34] hallyn, vboxpci, vboxnetadp vboxdrv and vboxnetflt [18:34] oddly those aren't apparently loaded though [18:35] Neither here apparently. I even forgot I installed it once [18:35] hallyn, i have purged virtualbox now but still its occurring [18:35] psivaa: after a reboot? [18:35] hallyn, No this time I am lying [18:36] Or I cannot type the grep all the times I am trying [18:36] smb: but if you'd like me to try the bisect (starting tonight) i'm happy to try [18:36] hallyn, is that ok if we continue a little later or tomorrow :), i need to urgently go out [18:36] psivaa: of course - thanks! [18:36] hallyn, sorry aboutt that [18:36] SpamapS, When things fail for you. Is it always a 1 reference left? [18:36] talk to you tomorrow [18:37] smb: yes, though I think that number goes up with the number of containers stopped [18:37] SpamapS, I believe it was 2 when the route cache is involved (probably a factor of two) but maybe there is another leak left now [18:37] my ipv6 connections breaks everytime a few minutes after a reboot, how I am suppose to fix this if I am not able to restart the network? [18:38] smb: agreed, I think it was 2 before as well [18:39] smb: with #24~smb1 it was 2 [18:40] smb: and with #24~smb2 it was 1, and has been 1 ever since [18:40] SpamapS, Right that also seemed to be consistent with the testcase for which I do not see a problem anymore. [18:40] woot! progress :) [18:41] ok, so what else bumps the refcount? [18:41] SpamapS, Could you please post a complete /var/log/syslog file to the bug report [18:41] smb: sure, doing that now [18:41] SpamapS, Everything that uses the netdev [18:41] SpamapS, Ok, then I can look at it tomorrow [18:45] smb: attached [18:46] SpamapS, thanks! [18:47] SpamapS, Oh and btw, with the test case and without patches the problem would go away after somethimes up to 5 minutes [18:47] SpamapS, It would be a valuable info if that also happens for this case [18:48] smb: it has not gone away in 5 minutes for me.. but I may be screwing it up by doing another lxc-start (which then gets stuck in disk wait) [18:49] smb: I'd swear that this time, with your current patch, it took longer for the unregister_netdevice messages to pop up [18:50] SpamapS, Yeah, that would add to the theory that we now hit another problem which was hidden by the previous fail. [18:50] hey all .. I've got a server process I'm running and I've launched it through a SSH connection .. I would like the process to persist after I've closed the terminal [18:51] Though I need to carefully go through the log there and compare addresses [18:51] how can I do this? ... i thought $ bundle exec trinidad & might do it [18:51] that is not the case [18:51] smb: are you reproducing locally still btw? [18:52] delinquentme: investigate screen, tmux, and nohup. nohup is easiest IFF it works.\ [18:52] delinquentme: if you just want it to keep running and you don't care much about being able to interact with it.. 'nohup programname &' does it [18:52] actually I think i got it :D [18:52] SpamapS, Well for me the problem was sort of fixed. But I only use the test C code and not too many times. So no [18:52] smb: ok .. its fairly simple for me to reproduce with lxc-create/lxc-start/lxc-stop [18:54] SpamapS, I guess I will have to try those steps on further debugging or see what would happen when modifying the test case a bit [18:57] smb: sounds like something during the actual machine boot bumps the refcount and then the tear-down is missing that === Skaag_ is now known as Skaag [18:59] SpamapS, Sounds like I should definitely see to be able to reproduce this locally and then enable the ugly warn_on on every get and put. [19:00] SpamapS, Anyway what is interesting is that stgraber is less likely hitting that but would be doing the same thing... [19:00] smb: the dreaded race condition [19:01] stgraber: ^^ are you testing on a system w/ SSD or slow disk? [19:01] My SSD box definitely reproduces 100% while my older laptop sometimes doesn't.. I think.. its all me guessing [19:02] The disk would be a less likely suspect but who knows. [19:02] well... [19:02] if things happen in a different order.. [19:02] and there is a missing lock somewhere [19:03] would explain a counter skew [19:03] smb: I'm thinking the boot and/or shutdown of the container and its network configuration might be racing something else. [19:04] like, lxc-wait .. which I realize now is in the mix, I just haven't been considering it part of the equation [19:05] SpamapS, I would not completely rule it out, its just one suspect that rather comes later to your mind. First with how those refcounts are handled and net involved you would think of rcu and cpu based races... === dendrobates is now known as dendro-afk [19:11] I'm considering mv'ing production resources to ubuntu-server. Been exploring what's "in the release", as well the whole PPA infrastructure. General question re: kernel -- how "vanilla" upstream are the kernels u-s uses & makes available? Are they typically UN-patched upstream releases? more in line with Opensuse-esque franken-kernels? Or something in-between? [19:11] For my usecase, I'd *prefer* to be as close to upstream kernel + upstream Xen (virtualization is mission-critical here) as possible ... [19:12] aresby, I don't know anything about suse kernels [19:12] should be just like redhat kernels [19:12] a kernel version is picked, and that version is stuck to, and security patchs are backported to it [19:13] there are some custom stuff, but not much [19:13] the custom stuff I know of, is attempting to be ported into the normal kernel [19:13] Aresby, Quite upstream + stable patches. There were one or two patches but those are gone or are not really changing much. [19:14] (or being separate drivers) [19:15] patdk-lap: ok, thanks. I'll continue to read-up. How amenable to DIY-build/use of newer kernels is U-S? I assume there's likley PPAs that already do this --- but, if i DIY, I'd like the process to be less filled with distro-specific "gotchas". [19:15] smb: ARe thos patches Ubuntu-community generated/maintained? From/thru Canonical? or from Upstream itself? [19:16] I normally just download the source, add my patch into the build [19:16] and push it to a ppa :) [19:16] simple [19:17] patdk-lap: Heh, sure *that* part is. It's the "Oh, btw, your custom-built kernel is gonna smoke your box" stuff that I'm worried abt ;-) [19:17] plus the "and don't let the door hit you in the ass on the way out of #irc" Centos-isms ... [19:18] Aresby, Community maintained in some sense I would say. Like aufs/overlayfs, some dm-raid45 one. Probably community in a wider sense. [19:19] Aresby, If you look at our public git trees there is a ubuntu subdir which contains all those. Everything else is more or less like a current upstream stable kernel of the same version [19:19]