/srv/irclogs.ubuntu.com/2016/06/27/#ubuntu-server.txt

=== Bray90820_ is now known as Bray90820
=== pleia2_ is now known as pleia2
allquixoticAnyone know of a simple solution for remote desktop into an Ubuntu 16.04 server in a container? (For general desktop usage, web browser, etc.)03:50
Slingallquixotic: ssh with x11 forwarding03:56
compdocallquixotic, x2go04:28
compdocbut you need a 2d desktop. cant use unity04:29
allquixoticcompdoc: Sounds much better than X11 forwarding; nice efficiency for going over a slower link. And nice clear install steps on their wiki. Thanks!04:32
compdocallquixotic, I have ubuntu server, a minimal mate desktop, and x2go server on all my servers. and connect from my windows desktop04:33
compdocclipboard and sound work04:33
lordievaderGood morning.06:16
=== athairus is now known as afkthairus
cpaelzerrbasak: the formerly blocking bug 1286882 is now migrated09:13
ubottubug 1286882 in mpm-itk (Ubuntu Trusty) "libapache2-mpm-itk postinst failed" [Medium,Fix released] https://launchpad.net/bugs/128688209:13
cpaelzerrbasak: that means bug 1495988 would be ready for upload now09:13
ubottubug 1495988 in apache2 (Ubuntu Trusty) "ProxyErrorOverride leads to slow 404 responses" [Medium,Triaged] https://launchpad.net/bugs/149598809:13
cpaelzerrbasak: I also prepped a valid test environment to verify in proposed09:13
cpaelzerrbasak: could you (re)take a look at 1495988 to upload?09:14
=== _degorenko|afk is now known as degorenko
cpaelzermagicalChicken: hi, as I currently pass my old ntp bugs I cam by bug 1582767 and wanted to ask if you already looked into it09:48
ubottubug 1582767 in ntp (Ubuntu) "apparmor permissions missing for winbind" [Medium,Triaged] https://launchpad.net/bugs/158276709:48
cpaelzermagicalChicken: especially if you decided if that should be a Ubuntu delta or if you want (have?) provided a debian fix for it?09:49
=== NegativeFlare_ is now known as NegativeFlare
=== jelly-home is now known as jelly
=== iberezovskiy|off is now known as iberezovskiy
jamespagecpaelzer, hey did you start work on the 2.6 snapshot for ovs yet?11:20
cpaelzerjamespage: I trained myself in git-buildpackage but was blocked on a kernel bug on friday11:21
cpaelzerjamespage: not much work done yet other than learning on the git-buildpackage side of things11:21
cpaelzerjamespage: next step would be trying to isolate your post import-tgz changes, and doing kind of a rebase inside that - but well as I'm not familiar yet I can't make any esimationes11:22
cpaelzeralso this morning a zillion of other bugs seem to attack me11:22
cpaelzerso it got ont the "postponed" list11:22
jamespagecpaelzer, I'll take a run at it today11:22
jamespagecpaelzer, all of that stuff is handled by gbp11:23
cpaelzerI almost thought on waiting with dpdk/ovs things until DPDK 16.07 was released in two weeks11:23
cpaelzerjamespage: that would be great11:23
cpaelzerjamespage: I could then pick up whatever you create and prep modding it for dpdk 16.0411:23
cpaelzerjamespage: I have a preliminary version in a ppa11:23
cpaelzerwith all the new libs and such11:23
cpaelzerjamespage: just drop me a note or link of a ppa or wherever you upload things so I can pick it up then11:24
jamespagecpaelzer, hmm no 2.6 branch as yet - will have to work from master for now11:25
cpaelzerjamespage: just in case it turns out the recent ovs git "needs" dpdk 16.04 feel free to use my interim ppa at https://launchpad.net/~paelzer/+archive/ubuntu/deb-dpdk-16.0411:25
cpaelzerjamespage: yeah no early snapshot yet11:25
cpaelzerjamespage: one question11:25
cpaelzerjamespage: I've thought a lot about what you "might" do now :-)11:25
cpaelzerjamespage: if you have no offending content in it afterwards, it would be great if you could just dump the full console log or so of the session where you up to this new version11:26
cpaelzerjamespage: that way I could quickly verify if you followed more or less the stages I thought should happen11:26
cpaelzerrbasak: sometimes some subpages hide from me :-) I thought I could get from https://launchpad.net/ubuntu/+source/apache2 to the currently running build for the apache upload you did for me13:16
cpaelzerrbasak: could you help me navigating by pointing to a better entry point?13:17
cpaelzerhttps://launchpad.net/ubuntu/+source/apache2/2.4.7-1ubuntu4.11 is not existing (yet?)13:18
rbasakcpaelzer: it's in the unapproved queue, so is pending review and won't be built until that is done.13:27
rbasakcpaelzer: https://launchpad.net/ubuntu/trusty/+queue?queue_state=1 is the only place it'll appear until the SRU team accept it.13:27
cpaelzerrbasak: I thought I'd see a not yet building one before that - thanks for the clarification13:28
cpaelzermagicalChicken: I passed over all my open ntp bugs, and I need a merge and to add some delta anyway - if you not yet have worked on it do you mind if I "steal" bug 1582767?14:01
ubottubug 1582767 in ntp (Ubuntu) "apparmor permissions missing for winbind" [Medium,Triaged] https://launchpad.net/bugs/158276714:01
jayjoIs there a way to profile the disk to see if data is being stored somewhere irregular? I have a mongodb instance, and after droping the database, which shows the database has dropped in the console, my startup still shows the disk space occupied and it doesn't go down. Is that normal?14:02
cpaelzerjayjo: which tool are you using to check it?14:04
cpaelzerjayjo: there was some stuff like http://sysunconfig.net/aixtips/df_du_diff_out.txt so I'd like to understand "how you check" first14:04
jayjoIn this instance I'm just meaning the startup log14:04
cpaelzerjayjo: so all your question is "inside" mongodb then - right?14:05
jayjoAnd it's less that its inconsistent, its that if there is 1GB/30GB being used normally, I put about 10-15GB into the DB and dropped it and it still shows about 15GB/30GB used of drive spae14:06
jayjoI guess it's more broadly a 'linux' question. Is there a way to profile the disk to see if that startup log is correct at all?14:06
cpaelzerjayjo: plenty of tools depending on what exactly we are looking for, but IIRC mongodb doesn't always recalim on drop as well14:07
cpaelzerjayjo: for some of the most basic "where on my disk is space consumed" you can use "du --max-depth=1 | sort -n"14:08
cpaelzerjayjo: if it is inside mongodb look at https://docs.mongodb.com/manual/faq/storage/#faq-disk-size14:09
jge_sarnold: good morning, just in case you're still interested in the output of slabtop on that box I had a problem with on friday with high memory usage with a fresh install of 16.04: http://pastie.org/private/z6fygvppfo8ruop43xzs7w14:10
jge_:)14:10
cpaelzerjayjo: http://stackoverflow.com/questions/2966687/reducing-mongodb-database-file-size14:10
coreycbjamespage, do you what the purpose of this patch is?  https://git.launchpad.net/~ubuntu-server-dev/ubuntu/+source/keystone/tree/debian/patches/add-version-info.patch14:11
jayjocpaelzer: thanks for your help, this is what I was looking for14:15
cpaelzerjayjo: if you don't like searching where space is with du you could try the ncurse based ncdu if you want14:15
cpaelzerjayjo: ah nice - good luck with that14:15
smoserrbasak, if i have uvt-kvm somewhere, and want to get newer images (and i want them from daily) what do i run ?14:21
smosersorry if i just didn't rtfm14:21
cpaelzersmoser: sudo uvt-simplestreams-libvirt sync release=yakkety arch=amd64 label=daily14:22
cpaelzeryou might know the simplestreams syntax :-)14:22
smoserare you sure ?14:22
smoseri think somehow i have to tell it to look in the daily strema14:23
cpaelzerthat was it a while ago - let me check (this came from bash history)14:23
cpaelzersmoser: sudo uvt-simplestreams-libvirt sync --source http://cloud-images.ubuntu.com/daily release=xenial arch=amd614:23
rbasaksmoser, cpaelzer: you also need --source http://cloud-images.ubuntu.com/daily14:23
cpaelzerand similar14:23
rbasaksmoser: because we couldn't agree on how to unify that use case with the non-daily one ;-)14:24
smoserrbasak, cpaelzer thanks.14:24
cpaelzermagicalChicken: if you are ok with it just reassign it to me14:33
magicalChickencpaelzer, just reassigned to you, thanks for taking that14:47
=== huh is now known as Guest28823
smoserrbasak, i just filed15:35
smoser https://bugs.launchpad.net/ubuntu/+source/uvtool/+bug/159657715:35
ubottuLaunchpad bug 1596577 in uvtool (Ubuntu) "chown: invalid user: ‘root.libvirtd’" [Undecided,New]15:35
smoserdont know if that is a dupe of something15:35
smoseralso...15:35
smoser http://paste.ubuntu.com/17975188/15:36
smoseri think it might hvae been luser error (smoser as the luser) that produced the messed up system on digget15:36
smoserbut it seems like a bug that root can't do that.15:38
rbasaksmoser: I don't think I've seen that before. Thanks!15:40
=== devil is now known as Guest9208
=== iberezovskiy is now known as iberezovskiy|off
sarnoldjge_: how long had that machine been active? those numbers all seem sane enough.16:16
jge_sarnold: I ran that slabtop command on friday, box had been up for 8-9 hours16:19
sarnoldjge_: aha; how about now?16:21
jge_sarnold: turned it off this morning, memory was the same though16:26
jge_I can turn it back on and let it build up again and run some more commands if you would like16:27
sarnoldjge_: well, I had honestly expected to see something more like an obvious memory leak :/ oh well16:36
jge_yeah me too, sounds like it needs more digging.. not sure whats up, went back to 14.04 for the time being16:40
=== degorenko is now known as _degorenko|afk
smoserrbasak fyi, 'supported' is now in data (for quite a while) so you can do:16:56
smoser uvt-simplestreams-libvirt -vv sync --source http://cloud-images.ubuntu.com/daily 'supported=True' arch=amd6416:56
smoserand i've added that to ubuntu's crontab16:56
rbasaksmoser: what does 'supported' mean?17:18
smoserrbasak, that it is currently supported17:21
smoseras in right now that is precise, trusty, wily, xenial, yakkety17:22
rbasakOh, I see. OK, thanks.17:27
jge_sarnold: so strange, fresh copy of 14.04 lts same problem.. I'm starting to think is me not reading memory usage correctly or something is really screwed up18:23
jge_I've tripled checked my commands, making sure I understand their output.. nothings adds up!18:23
jge_what the hell..18:24
jge_something might be up with the hypervisor18:24
sarnoldjge_: strange. I'n not used to not being able to account for where memory goes :/18:25
jge_yes, make it very frustrating18:26
jge_makes*18:26
jge_jge_: any chance you could just the output of my 'free -h' command just to confirm i'm not crazy18:28
jge_check18:28
=== n2deep_ is now known as n2deep
jge_sarnold: ^ sorry18:30
sarnoldjge_: sure18:32
jge_sarnold: http://pastie.org/private/lj6evcvl7yrobnpoqamvg18:37
jge_thank you18:37
sarnoldjge_: and how about the processes? top M output..18:40
jge_sarnold: http://pastie.org/private/rzqaeykpcaykkj5cyw6shw18:45
jge_I just noticed the hypervisor ballooning for that vm is very high.. 600MB18:46
jge_I'm reading more about it now.. not sure that's normal18:46
sarnoldi've got zero expereince with the ballooning things.. is that stable?18:46
jge_don't know, reading more about it now18:47
jge_I just checked another vm which doesn't have that problem, balloon values are 018:48
* nacc lacks context, what's the problem statement?\18:48
naccmemory being taken away from a VM but not accounted?18:49
jge_yea18:49
sarnoldnacc: roughly his systems are using more memory than can be accounted for18:49
skyinstalled ubuntu 16.04  with postfix. my mail logs are showing up in /var/log/syslog but not /var/log/mail.log (in fact that file doesnt exist)18:49
naccjge_: is your host overcommitted?18:50
jge_nacc: almost but not there yet, resources show I'm using 15.6GB of the 16G18:51
jge_think that could be it?18:51
naccjge_: i know some hypervisors can be (or can be tuned to be) more aggressive at ballooning memory to satisfy VM requests. So if you're getting low in the host, and either the host needs memory, or another VM does, I think it could be 'ballooning' memory in/out accordingly.18:52
naccjge_: is this KVM?18:52
sarnoldvmware18:52
jge_yep vmware esxi18:52
naccah18:53
rharperone way to be hostile is to launch a userspace process to malloc ram, typically page faults in a guest are a trigger for the hypervisor to ease-up on the balloon; that's not always going to happen; but in general from a hypervisor perspective, it's hard to know the difference in how memory in a guest is used.18:53
rharperfilling /dev/shm/XX with random data also helps defeat any dedup efforts , but if it's your host, it's likely to then trigger action in the other shared VMs (ie, their balloons may be inflated to compensate;18:55
naccrharper: yeah, we had a test that did that at IBM, it was ugly18:56
rharperI'm not 100% sure about vmware, but ballons are guest-cooperative efforts in KVM, likely in vmware as well, in which case if you blacklist the balloon module, you can't give any memory back cooperatively18:56
rharpernacc: heh, alternatively you could just launch a jvm with a large heap18:57
naccrharper: yeah, i think that's what they were trying to simulate18:57
jge_probably getting out of topic for this channels, since it sounds like that could be the issue... but should I look into tuning how agressive balooning is on this host or add more RAM?18:57
rharperjge_: depends on your goals;  more memory is always useful if you can afford the cost;  if you're trying to work with what you have and balance it, then you may need to look at some sort of active monitory of esxi and tuning the balloons based on other workload criteria18:58
rharperthis is a *really* hard problem without intimate knowledge of your workload, it's highs and lows and acceptable response (quality of service)18:58
naccovercommit in general gets you into racy/tricky situations, IME :)18:59
rharpereven then, the typically available feedback knobs tend to be too late,  ie, seeing swap activity in the guest is likely too late to free up memory18:59
rharperwithout taking workload or qos18:59
naccyep18:59
* patdk-lap just depends on vmotion :)19:00
jge_hmm ok19:00
patdk-lapif a host is running out of memory, move some to another host19:00
jge_thank you rharper nacc and sarnold19:00
rharperif it can happen fast enough19:00
rharperjge_: sure19:00
rharperthere's always a trade off in response time/downtime vs. bandwidth to migrate19:01
patdk-lapjge_ should be able to, unless every vm you have has 10's of gigs of ram19:01
jge_some of these vms have been assigned too much memory for what I use it for really..19:01
patdk-lapvmware should balloon them instantly then19:01
patdk-lapit will balloon, the os will just drop caches19:02
patdk-lapshouldn't be an issue19:02
rharperjge_: it's possible that there is a for-pay addon to esix or upgrade to vsphere or other vmware produces that do active balloon management19:02
rharperthat seems like a typical "Value Add" path for corps to do19:02
rharpers/esix/esxi19:02
jge_rharper: and what does this add on do?19:03
jge_that I can't do manually.. if any19:03
rharperjge_: I don't know; I'm guessing here; I;m not familiar with vmware offerings19:03
jge_home lab here, nothing corporate19:03
patdk-lapI dunno why you would want to get hostile though19:03
patdk-lapjust unload the balloon driver, and esxi will never steal ram from it19:03
jge_patdk-lap: is that recommended?19:04
patdk-lapheh?19:04
patdk-lapdefine recommended19:04
patdk-lapthat is something that is up to you19:05
patdk-laphow do they know what your doing19:05
patdk-lapif you have a vm that should never loose memory (say, mongodb)19:05
jge_I mean is it an accepted solution19:05
naccyeah, i mean if you don't want to balloon, disable ballooning seems like the best recommendation19:05
patdk-lapyou would be insane to run the balloon driver in it19:05
naccthat seems true regardless of platform even, it's more of a server deployment/design19:05
patdk-lapbut for most vm's, balloon is useful19:05
patdk-lapcould cause issues on a webserver, that has lots of files/inodes cached in ram19:06
patdk-lapand something balloons, and now that webserver dropped caches, and is slow as crap19:06
patdk-lapthe best system would be don't overcommit, and don't use balloon driver19:06
patdk-lapbut that isn't how people really design things these days, often19:07
jge_I don't know if it is really, the system is unusable.. if ballloning was working fine and by that I mean manage ballooning in/out as needed it would be transparent19:07
jge_wouldnt it?19:07
patdk-lapyes19:07
patdk-lapbut vmware is guessing how much to balloon19:07
patdk-lapbased on how it active it sees the vm memory19:07
patdk-lapit doesn't know if that memory is really needed, and will cause a huge swap to happen19:08
patdk-lapor if it is just a simple drop caches, operation and the vm didn't really need that ram19:08
patdk-lapif the vm has to swap out all that ram, vs just release it, so the balloon can happen, big difference in performance19:09
jge_hmm19:10
jge_ok19:10
jge_could the balloon driver be disable per guest or is a system wide setting19:10
patdk-lapit must be installed per guest19:10
patdk-lapthe idea is19:11
patdk-lapthe guest os knows if that memory is in use or not19:11
jge_got it, I never installed anything though.. guessing it comes enabled by default19:11
patdk-lapif you cannot get enough ram using balloon19:11
patdk-lapthen it will have to swap the vm itself, and it has to assume ALL memory is used, so that is really painful19:11
patdk-lapit does not come installed by default19:11
patdk-lapyou had to have installed the vm tools19:11
jge_it does it automatically19:12
jge_I didnt install anything but I see it running19:13
patdk-lapno, it has never installed automatically, ever19:13
patdk-lapif you do a full install everything, it's likely installed19:13
patdk-lapand then if found, would be used19:13
jge_hmm let me check if it's installed19:13
jge_thought I saw it running19:14
jge_let me see19:14
patdk-lapps ax | grep vmw19:14
jge_if what is found?19:14
patdk-lapactually, that isn't right19:14
patdk-laplsmod | grep vmw19:14
jge_http://pastie.org/private/64d1zctsgfpkkkxgpfh8q19:15
jge_I guess it is?19:15
patdk-lapyep19:15
patdk-lapyou can just blacklist vmw_balloon19:15
jge_hmm wondering how it got there.. I never installed it19:15
patdk-lapyou even have vmwgfx isntalled19:16
patdk-lapnever seen all that other stuff19:16
patdk-lapyou didn't happen to use vmwares install iso method did you?19:16
patdk-lapvmware probably installed it for you19:16
jge_yeah, i mounted the iso on the virtual cd-rom19:17
jge_and connected on boot19:17
jge_not a fan of stuff that hides the real picture19:19
jge_took me 3 days, countless fresh installs and many wtfs19:19
jge_:(19:19
jge_vmware should just let people install it19:20
patdk-lapthey do19:21
patdk-lapatleast I never use the vmware iso installer19:21
patdk-lapI make the vm19:21
patdk-lapthen afterwards, mount the iso to the cdrom and boot19:21
patdk-lapnever select the iso during vm creation19:21
jge_not sure we are talking about the same thing.. I downloaded the ISO from ubuntu.com then mounted to virtual rom19:22
patdk-lapthen you should isntall it just fine, manually19:22
patdk-lapbut vmware also has an, install automatically from iso during creation19:22
jge_so you provision the vm, usually a wizard.. click finish then go back and mount the iSO?19:24
patdk-lapyes19:24
jge_not the same as doing it during the wizard?19:24
patdk-lapdepends on the wizard19:24
patdk-lapthe wizards I have in esxi don't let you select an iso at all19:24
patdk-lapusing workstation it does, but that causes the auto-install19:24
jge_before you click finish, I usually go to let me edit setting before finishing.. some option like that19:24
jge_then mount iso there19:24
patdk-lapI never use that, as it always says for years, do not do this :)19:25
jge_the process is identical, the only difference is clicking edit settings before provisioning19:26
patdk-lapyou could say they are, but vmware claims they are not19:27
jge_not sure how vmware thought that could be helpful19:27
patdk-lapI'll perfer to believe them19:27
jge_yeah i guess19:27
patdk-lapI do sometimes do the edit, but not often19:27
patdk-lapI normally end up editing a lot of things19:27
jge_how would I blacklist ballooning, you don't happen to know do you :D19:28
patdk-lapedit the blacklist file or make a new one in /etc/modprobe.d19:28
jge_ok will do, thank you patdk-lap19:28
jge_patdk-lap: sounds like vmware does not recommend disabling the balloon driver19:40
jge_https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=100258619:40
jge_warning at the top.. :\19:40
patdk-lapperformance issues19:41
patdk-lapya, can't share ram19:41
=== Zhao is now known as Guest49592
=== afkthairus is now known as athairus
=== Bray90820_ is now known as Bray90820
coreycbddellav, jamespage: ci should be back to blue shortly.  fixed up cinder for mitaka and the following for newton: heat (fixed by new python-aodhclient 0.5.0), swift, keystone, nova/neutron (fixed by new python-fixtures 3.0.0).20:17
LaserAllanhmm20:35
LaserAllanAnyone in here using Python 2.7.11?20:35
=== Tegu_ is now known as Tegu
=== mwhudson_ is now known as mwhudson

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!