/srv/irclogs.ubuntu.com/2017/04/19/#ubuntu-server.txt

darkzekHey, anybody know how to make my 16.04 Ubuntu Server auto-login? Its a test server in vmware.04:53
YankDownUnderdarkzek: Did you read what I posted in #ubuntu?04:53
darkzekYankDownUnder Yes, I would really prefer not to install a dm to save server resources.04:57
YankDownUnderdarkzek: There is going to be no real logical or practical solution to having Ubu server "automagically login" - as it's not part of the "model" of the whole. However, that being said - and as I've had to do in the past, I've installed a very lightweight DM (XDM) and set it up for autologin...only had to install something nice and small like WindowMaker or twm or olvwm or such...which was nothing, really.04:57
darkzekSo my options are install a dm, use a super hacky method that will take ages to configure. Or have to copy my very long password each boot04:58
YankDownUnderSo, again, that being said, you're not the only one that has wanted to accomplish this task...trust me...04:58
YankDownUnderdarkzek: Actually, it takes minutes...at the most...04:58
YankDownUnderOn a VM over the weekend (Ubuntu Server 16.04.2) I got Dovecot/IMAP/POP3, lightdm and WindowMaker setup in, er, what, 10 minutes tops?04:59
darkzekYankDownUnder Haha ok, I guess i'll install xfce then :)05:00
darkzekThanks for your help :)'05:01
YankDownUnderXFce is actually heavier than WindowMaker, AfterStep or whatever...HOWEVER, that being said, it's your VM, not mine. I prefer "less than" on servers...XFce *USED* to be very light, but it's grown a bit "thick" around the edges...ahem...05:01
darkzekYankDownUnder Yeah im not the best with Linux knowledge so I don't really feel comfortable installing my own window manager right now. Thanks again :)05:04
YankDownUnderdarkzek: Fair enough. Just remember - it's EASY if you THINK IT'S EASY. Otherwise, it's a nightmare. Simple stuff: apt-get install -y lightdm && apt-get install -y xfce-desktop => pretty much all there is to it.05:06
YankDownUnderAfter you get lightdm installed, you can check the /etc/lightdm/lightdm.conf and edit it to suit for your autologin schmutz05:06
darkzekYankDownUnder I'll do that then, time to get out of my shell haha.05:22
YankDownUnderdarkzek: Cool bananas...it's not so bad "outside the box" you know...05:23
cpaelzernacc: rbasak: actually do we have another USBSD today or next week?05:47
cpaelzerSince it seems to work to encourange community and to get a grip on more issues I think we should give it a wiki page with like "next date" people can always check05:48
cpaelzerannouncing on ML is fine, but as me being away last week I just missed it in the truckload of mails - so a page to check just as we have with the IRC meeting would be great IMHO05:49
cpaelzerlet me know what you think about that05:49
lordievaderGood morning06:11
=== vamiry_ is now known as vamiry
zioprotohello all. I have a question about neutron-server ubuntu packaging. I had to do an ugly hack to /etc/init.d/neutron-server08:50
zioprotoin xenial08:50
zioprotobecause I have some plugins, I had to hardcode more --config-file options08:51
zioprotoI have an ugly line that looks like08:51
zioproto[ -n "$NEUTRON_PLUGIN_CONFIG" ] && DAEMON_ARGS="--config-file=$NEUTRON_PLUGIN_CONFIG --config-file=/etc/neutron/l2gw_plugin.ini --config-file=/etc/neutron/neutron_lbaas.conf"08:51
zioprotobut this variable $NEUTRON_PLUGIN_CONFIG08:52
zioprotoI dont understand it08:52
zioprotoit is not like we have a file with all the configs for all the plugins08:52
zioprotois this a bug in the packaging ?08:52
zioprotowhat would be the clean way to start the daemon with these extra --config-file statements ?08:58
cpaelzerzioproto: the variable lives in /etc/default/neutron-server09:10
cpaelzerzioproto: by default it points to /etc/neutron/plugins/ml2/ml2_conf.ini09:10
cpaelzerzioproto: I don't know nova enough would it allow to list them comma separated, or create amaster conf file that includes multiple others?09:13
cpaelzerzioproto: I'd consider any of those "cleaner" if they are possible09:13
cpaelzerrbasak: is not finding /var/lib/libvirt/dnsmasq/default.leases a known uvtool issue?09:17
cpaelzerany bells ringing?09:17
cpaelzerrbasak: bug 1420142 seems like what I see, yet it is closed as dup of a fixed bug09:18
ubottubug 1428674 in uvtool (Ubuntu) "duplicate for #1420142 uvt-kvm: error: no IP address found for libvirt machine" [High,Fix released] https://launchpad.net/bugs/142867409:18
* cpaelzer checking versions09:18
cpaelzerseems my trusty version is too old to work with UCA level libvirts, looking for the uvtool backports now09:20
cpaelzerrbasak: going to ppa:uvtool-dev/master fixed it09:23
cpaelzerrbasak: imho as far as I see this is broken for e.g. Trusty+UCA-Mitaka - would it be reasonable to ask the UCA Team to get Xenial version of uvtool into the UCA as well to let it work?09:23
cpaelzerjamespage: ^^ thoughts?09:24
jamespagecpaelzer: context?09:25
cpaelzerjamespage: the lines above, TL;DR I've found that with Trusty+UCA-Mitaka uvtool fails09:25
cpaelzerjamespage: not sure on the exact details to trigger, but the the root cause seem on old uvtool vs newer libvirt behaviour09:26
cpaelzernewer uvtool has it fixed already09:26
jamespagecpaelzer: is this something that we want to support?09:26
jamespagecpaelzer: UCA is really for OpenStack support, rather than just picking up a new virt stack09:26
cpaelzerjamespage: true, and people can - as I did - pull in the backport ppa that exists to get going09:27
cpaelzerI'll update the bug thou to help anyone else running into that case09:27
cpaelzerjamespage: thanks for quickly tihnking this through, I updated the bug and agree that there is no reason to pull into UCA09:31
jamespagecpaelzer: yw - we've had similar breaks in the past (newer django broke MAAS for example) and decided that was outside of the scope of the UCA purpose09:31
kotVaskahi, Why not installed ubuntu server on fujitsu celsius w370? Installation hangs..11:22
cpaelzerkotVaska: what way are you installing (ISO, Maas, ...) which release and at what point is it hanging?11:52
cpaelzerkotVaska: depending on that you likely have to select the right entry on https://wiki.ubuntu.com/DebuggingProcedures#Installation_and_Upgrades and provide further info than "hangs on install"11:55
kotVaskathanks11:56
patsTomsmorning12:45
patsTomssomeone have any idea why could screen have some artifacts?12:45
patsTomsit renders Ubuntu 16 server terminal randomly12:45
patsTomsoh, it works well on different monitor12:48
=== caribou_ is now known as caribou
cpaelzerjamespage: do you (without rereading the code) remember how DPDK_OPTS in openvswitch init handling are read&passed to the ovs-ctl script?13:09
cpaelzerjamespage: I try to test something on T+UCA-Mitaka but the lack of systemd kind of lets me stumble13:09
cpaelzermost seems fixed, but the path from init -> ovs-lib -> ovs-ctl -> ovs_vswitch isn't exatly straight :-)13:10
cpaelzerso I miss the DPDK_OPTS to be set for now13:10
cpaelzerjamespage: I'll read through the scripts, but if you happen to remember let me know13:10
cpaelzerok, so theory confirmed DPDK_OPTS are not set while ovs-ctl is running in that system setup13:14
cpaelzerjamespage: found the issue, as FYI on trusty it is running the upstart bits pre-start and that lacks an export of DPDK_OPTS13:26
cpaelzerjamespage: not a real issue as it was never meant to work ther I'd guess right?13:26
jamespagecpaelzer: no I think we agreed that the baseline was xenial right? due to kernel feature requirements13:27
cpaelzerjamespage: yeah I think we agreed on that13:27
cpaelzerjamespage: I'm running hwe-x anyway13:27
cpaelzerso the kernel dep won't kill me for now, but still I think it is not meant to run on T - so the fixes I make for my tests won't become your bugs13:29
cpaelzerjamespage: that is what I wanted to check13:30
cpaelzerjamespage: wow after understanding the whole picture the fix is super-easy since the /etc/default/openvswitch-switch is sourced13:32
cpaelzerjamespage: it comes down to add "export DPDK_OPTS" in that config file13:33
cpaelzerno "code" change needed13:33
ahasenackcpaelzer: $1 to add the oneliner13:43
ahasenackcpaelzer: $999 to know which one liner and where13:43
cpaelzerahasenack: exactly13:54
cpaelzerahasenack: but it already is in a git commit to be found by the search engine of your choice some day13:55
cpaelzerso price drops from $999 to just $499 for the next 5 hours13:55
ahasenackit's like a zero-day13:55
Aisonwhy do I get a network interface name p22p1? I expected that ethernet devices are prefixed with en?14:11
Aisonso why not enp22p114:11
tewardthis will sound like a stupid question, but I have a server on a subnet of my network that uses a VPN tunnel outbound.  I need to route traffic from my local networks via the local network and not send them across the VPN tunnel; is there any way to setup such custom routing?14:50
compdocdont assign a gateway to the tunnel14:56
nacccpaelzer: argh, it should be this week, but with everything else, i dropped the ball15:33
nacccpaelzer: i'll set it up for next week and maybe every two weeks after that, with a header thing and link to a wiki page describing it15:34
dpb1nacc: the bug party?15:34
dpb1err15:34
dpb1bug squashing day15:34
naccdpb1: yeah15:34
dpb1k15:34
* dpb1 was looking forward to that15:34
nacci mean, there's nothing preventing us from doing it today :)15:34
naccjust forgot to announce it on the ML15:34
dpb1I can look forward to it next week too15:35
dpb1:)15:35
naccdpb1: true )15:39
nacc:)15:39
ahasenackteward: you need to look up "source routing", the "ip" tools can do that just fine16:21
ahasenackteward: something like this: http://www.tldp.org/HOWTO/Adv-Routing-HOWTO/lartc.rpdb.simple.html16:22
ahasenackthere may be ubuntu docs about it too16:22
ikoniawin 1416:42
tewardikonia: confirmed: LOSS 14 recorded.  (Just kidding, and poking fun, sorry)17:09
tewardahasenack: thanks, I'll take a look.17:10
tewardgot a question for the server team people.  NGINX in 14.04, a request came through to have the 'geoip' module added to the nginx-naxsi flavor.  Unlike in Xenial and later we can't just use dynamic modules, that'd be a feature change that I'd need approval to get in, what're your thoughts?  Noting of course that nginx-naxsi is deprecated and no longer supported in any other releases, except maybe Precise and I that'll die soon enough.17:13
tewardhow would you suggest I proceed?17:13
naccteward: just tell the user no? :)17:15
tewardlol17:15
naccteward: without knowing more about nginx, how would you add geoip support without dynamic module support?17:15
tewardnacc: change the build rules to static-compile17:16
tewardwe already static-compile in Trusty17:16
naccteward: ah ok17:16
tewardwe just have to change what modules are included17:16
tewardthe old style way of things, though we had to do that for Xenial and still do17:16
naccteward: i'm not sure the request satisifies the SRU rules17:16
naccteward: maybe in backports?17:16
tewardnacc: i'm not sure it does either, and the backports team has too much of a backlog on their plate17:17
naccyeah :/17:17
tewardi would know i've had three backport requests sitting for two years gathering inordinate amounts of dust17:17
tewardthey're so old I don't even have the packaging for them anymore lol17:17
tewardnacc: Won't Fix'd the bug, and referenced that it doesn't meet SRU criterion17:20
tewardi'm so tired lol17:20
tewardnacc: send me $450 worth of allergy meds and solve my misery for the next six months lol17:20
naccteward: i think that's totally reasonable17:20
teward(allergies *suck*)17:20
naccteward: and sorry for your allergies!17:20
tewardif it were economically feasible I'd have a O2 container here, or at least a respirator that filters out the allergens.17:21
tewardtoo bad i'm in debt.17:21
tewardand too bad i can't afford a new computer, this one's startin to fall apart17:21
tewardI'd *like* to get this $3000 business line workstation grade laptop from Dell, but I'm poor :P17:23
teward(yay for fifty simultaneous build envs if i had it lol)17:23
drabhi, just trying my hand at running kvm manually17:26
drabI'd like to use iommu and eventually use pci passthrough17:27
drabvt-d is enabled on the machine and iommu option loaded in grub17:27
drab[    0.000000] DMAR: IOMMU enabled17:27
drabhowever when I run sudo qemu-system-x86_64 -enable-kvm -machine type=pc,accel=kvm -device intel-iommu ....17:27
compdockvm is awesome, but Ive never found a good use for passthru17:28
drabI get an error,  qemu-system-x86_64: Option '-device intel-iommu' cannot be handled by this machine17:28
compdocsome motherboards are better than others at that17:28
drabI was planning on giving it a harddisk to write through directly and a network card. Is not the expected way to use it to speed things up?17:28
compdocsee if theres a bios update17:28
drabI'm enw to it so maybe misunderstanding basic concepts still17:28
drabalso I'm having a really hard time on figuring out how to run it manually, the entirely web just talks about libvirt17:29
drabbut I don't want to run libvirt/virt-manager/virsh17:29
naccyeah, runnnig qemu manually is a PITA17:29
naccdrab: any reason why not?17:29
sarnoldxml phobia? :)17:29
naccheh17:30
drabheh, in part17:30
drabalso compelxity-phobia, it looks like a lot of stuff to learn to do right, and I just want *1* instance17:30
drabeverything else is lxd containers17:30
drabmight need one more later, but to deploy libvirt to a node just to run one container seems not a good idea17:30
drabespecially since it seems to want to do its own thing17:30
nacci don't think you'd see a huge bump from hard disk passthru, but not sure17:30
drabie create its own bridge etc17:30
naccand the network card could be solved (better) with SR-IOV if you have it17:31
nacc(or more naturally, i mean)17:31
drabI have the host pretty "clean" with the main bridge for containers and I'd like to just add 1 kvm (for nfs)17:31
drabnacc: I'll look into SR-IOV, thanks for the tip17:31
compdocI find qcow2 files are easier to copy, etc17:31
naccdrab: it requires hw support on the NIC17:31
drabso yeah, I'm trying to figure out how to spin up just this instance with pure qemu, but having a hard time especially since I need to pxe boot and have output to console...17:32
drabthe host has a ZFS pool for lxd and planning to carve out a ZVOL to feed to kvm17:32
drabas root device17:33
drabbut need to figure out the booting part first...17:33
drabcan't even get it to start and give me output in console to run through installation right now17:33
naccdrab: so does `qemu-system-x86_64 --device help 2>&1 | grep intel-iommu` list it as supported?17:33
drabnacc: name "intel-iommu", bus System17:34
naccdrab: ok17:35
naccdrab: https://lists.gnu.org/archive/html/qemu-devel/2016-06/msg03548.html maybe?17:35
__Yiotahow do I check disk read latency?17:35
__YiotaI'm trying to figure out why our reads on aws are slower17:35
naccdrab: fwiw, this is where libvirt can be handy17:36
naccdrab: as the XML is the same regardless (ideally) of qemu parameters17:36
naccdrab: i also believe libvirt can use existing bridges, etc.17:37
sarnold__Yiota: I understand that's basically aws's business model. iops are slow enough that people want to pay for the faster backends17:39
sarnold__Yiota: there's a huge load of measurement tools at https://github.com/iovisor/bcc17:40
drabnacc: I'm absolutely sure it can, and I don't question its usefuless, but I've tried to look at it and it struck me as *really* complex17:40
drabnacc: so I thought maybe it was gonna be quicker/simpler to just do straight qemu since I don't plan more tha a  couple instances17:40
drabbut maybe not17:40
drabgiven how much of a nightmare it's been to figure qemu out so far17:41
naccdrab: right 'simpler' in that there are fewer layers17:42
naccbut those layers make the end-user experience sane :)17:42
tewardsarnold: nacc: rbasak: just to keep you in the loop, once 17.10 is open (and after I get off my lazy butt) we're going to be putting nginx 1.12.* in.  That's been released, by the way :P17:51
tewardi would have said this at the meeting yesterday but i was otherwise detained in a meeting17:51
sarnoldteward: nice :)17:53
naccteward: np, thanks!17:53
__Yiotasarnold thank you17:53
ppetraki__Yiota, hdparm -tT [bdev] isn't a bad place to start. Cached number tells you how fast your line speed is and the bufferred read from disk should be pretty close to what it says in the spec sheet.17:55
__Yiotabdev?17:57
ppetraki__Yiota, /dev/sda17:57
__Yiotaah17:57
__Yiotagotcha17:57
tewardnote to self: set up a script to initiate LXD containers with the standard utility sets lol17:57
teward(no `ping` on the LXD container that got started for Xenial o.O)17:58
ppetrakiit's easy and it's always there, so quick example17:58
naccteward: are you not using the cloud images remote?17:59
ppetraki__Yiota, http://pastebin.ubuntu.com/24415194/17:59
tewardnacc: i was, but i think something fubar'd in the download lol17:59
naccteward: yeah, i just checked and `lxc launch ubuntu:xenial` definitely has ping :)18:00
ppetraki__Yiota, That's a micron M600 attached to a 7 year old thinkpad18:00
teward*shrugs* it's working now.18:00
tewardnacc: well, I still need to 'configure' the container with what I need on a standard system.  So a utility script will still be useful DO NOT JUDGE ME18:00
__Yiotathank you so much ppetraki now I have something to show my CTO18:00
ppetraki__Yiota, it has a 3G link, which is what I'm getting for cached reads. The drive can do almost 500 MB/s ... so my system's bus is the problem.18:00
tewardstandard utils for Ubuntu and "standard Ubuntu utils for teward's container" aren't the same ;)18:00
naccteward: heh,sure :)18:01
naccteward: cloud-init them?18:01
ppetrakisarnold, that's a sweet set of utilities . Thanks!18:01
=== JanC_ is now known as JanC
c0mradeHow can I make mongodb automatically start at boot time on Ubuntu 16.x ?18:03
__Yiotac0mrade system d?18:03
sarnoldppetraki: it's wonderful stuff. if you haven't found brandon gregg's homepage yet, it's worth finding. there's days of wonderful reading there ;)18:03
c0mradeYiota: How?18:03
naccc0mrade: didn't you ask this yesterday and were answered?18:03
ppetrakisarnold, I have not :)18:03
sarnoldc0mrade: where did you get stuck?18:03
c0mradeI asked but I either didn't get an answer or I didn't see the answer.18:04
dpb1c0mrade: https://askubuntu.com/questions/61503/how-to-start-mongodb-server-on-system-start18:04
naccc0mrade: specifically by sarnold :)18:04
sarnoldppetraki: oh bother I knew I'd butcher his name http://brendangregg.com/18:04
c0mradeOne more thing which is a bit more complex, see if the server restarts, there's a script that I want to run when it boots first cd to a dirctory that I want then run ./bin/dev once that command executes it puts me into another shell where command 'run' has to be run.18:05
c0mradeHow could I go about that?18:05
tewardnacc: I will make one note: Debian's images, they have *nothing* on them lol18:06
teward(cross-OS testing lol)18:06
naccc0mrade: you can't run the first script with an absolute path?18:07
naccc0mrade: write a wrapper script for the wrapper for the wrapper18:07
naccteward: yeah, they are very different18:07
c0mradenacc: I can...18:07
tewardoh hey exactly nine days to precise EOL.18:08
ppetrakisarnold, oh, he wrote the dtrace toolkit. ok :)18:08
c0mradeI mean would it run like ./lila/bin/dev ?18:08
tewardguess I can go delete the nginx PPA packages now lol18:08
Aisonis there a way to use systemd 233 on ubuntu 16.04?18:08
naccteward: :)18:08
nacc!info systemd xenial18:08
ubottusystemd (source: systemd): system and service manager. In component main, is required. Version 229-4ubuntu16 (xenial), package size 3713 kB, installed size 18844 kB (Only available for linux-any)18:08
dpb1Aison: sounds painful!18:08
naccAison: not in  supported way18:08
c0mradenacc: wrapper script for the wrapper fo the wrapper o.O ?18:08
naccAison: and i don't know why you'd want to do that?18:08
naccc0mrade: you said you needed to run a script at a given path at boot18:08
Aisonnacc, I can life if it is unsupported :P18:09
naccc0mrade: so write a script that cds to the path and runs the script18:09
Aisonit's for a testing machine18:09
naccAison: ok, build systemd yourself :)18:09
tewardc0mrade: how about a wrapper script for all the wrapper scripts which are wrapping for another wrapper script which are wrapping for more wrappers which wrap for backends..  *shot*18:09
naccAison: and enjoy that fresh hell18:09
tewardsorry i couldn't help it :)18:09
naccteward: :)18:09
sarnoldppetraki: yeah. he's an insanely productive guy. :)18:09
teward(hey we all need a little silliness sometimes :P)18:09
c0mradenacc: Guys can you give me an asnwer with some code, I don't know what a wrapper script is anyway.18:10
naccc0mrade: wrapper script == a script that calls something else18:10
naccc0mrade: so a trivial shell script18:10
Aisonnacc, I have a strange problem here. Systemd is not starting the network device exactly on one ubuntu server18:10
naccc0mrade: i'm not going to write it for you18:10
naccAison: 'starting the network device' -- kernel sees it, but not getting an IP?18:11
AisonI always have to login locally and systemctl stop systemd-networkd.service  and then start18:11
naccAison: and then it works?18:11
Aisonyes18:11
naccAison: 17.04?18:11
Aisonno, 16.0418:11
AisonLTS18:11
naccAison: what is the error, if any, in the logs when it doesn't work at boot?18:11
Aisonthere is nothing in the logs. All errors I can see come from network drives that cant be mounted18:12
naccAison: 'nothing' in the logs? So it isn't indicated as failing?18:12
naccsystemd-networkd is a unit, so it has logs18:13
c0mradeBut the thing is that when I execute the first command I get into another shell, how would that shell accept commands using that script?18:14
Aisonhmm, how do I show the isolated systemd-networkd logs only?18:15
ppetraki__Yiota, have you used fio?18:15
naccc0mrade: you need to interact with commands?18:15
naccAison: something like systemctl status systemd-networkd18:15
Aisonnacc, that was always monitored as started, even though there was no network device up18:16
nacchrm18:16
naccAison: ok, that's what i was asking before -- so systemd doesn't detect there is any issue?18:16
c0mradenacc: Interact? How's that, your answer is very broad, can you be more specific?18:16
naccc0mrade: i know nothing about your scripts18:16
naccc0mrade: let's say you could start your scripts automatically at boot18:16
naccc0mrade: do you need to send input to them?18:16
__Yiotappetraki never18:16
ppetraki__Yiota, OK :) let's start with my cheatsheet18:17
ppetraki__Yiota, http://tfindelkind.com/2015/08/24/fio-flexible-io-tester-part8-interpret-and-understand-the-resultoutput/18:17
rharperAison: journalctl -o short-precise --unit systemd-networkd18:18
naccrharper: thanks, i knew there was a journalctl version too, but couldnt find it18:18
* rharper knows it all too well 18:18
rharper=/18:18
naccheh18:18
sarnoldppetraki: holy cow18:19
ppetraki__Yiota, he does a really good job of explaining what all the fields mean. In your case. I would devise a test that did 100% reads with a queuedepth of 1 and note where the latency histogram is accumulating the most hits18:19
c0mradenacc: That's what I need to do, after system reboot execut the following: cd lila; ./bin/dev when I execute ./bin/dev I get a specific shell where I type 'run' and hit enter and that's it18:19
ppetrakisarnold, he nailed it18:19
naccc0mrade: can't you just adjust to run the commands that are in ./bin/dev (I'm not sure why it spawns a shell) and run the 'run' command there?18:21
Aisonrharper, nacc that's all what I get: systemd-networkd[296]: eth0: Renamed to enp2s018:21
Aisonthen I restart this service18:21
naccand then what does it say after restart?18:22
c0mradenacc: I don't know.18:22
rharpernetworkd doesn't apply network config if the interface is already up or touched18:22
ikoniac0mrade: you said you had this all working and %90 automated18:22
ikoniait seems that you don't have the first step automated at all18:23
naccikonia: glad you have more context than I :)18:23
ikoniaread up on "how to write a systemd unit"18:23
Aisonrharper, the network device is not up after reboot. ifconfig  lists only the lo device. just ifconfig -a lists the device correctly18:23
ppetraki__Yiota, http://pastebin.ubuntu.com/24415321/18:23
ikonianacc: sadly yes, he's been asking this for days how to build a lichess server on an ubuntu EC2 instance18:23
naccikonia: ah i see18:23
naccAison: how is your network device configured? /etc/network/interfaces?18:24
ikoniahowever he's screwed the install putting it under root account and the root directory which adds complexity, and doesn't understand the difference between say a cloud-init step and an systemd unit, so it's all a bit pointless18:24
c0mradeShould I put my script at /etc/rc.local?18:24
ikoniano18:24
rharperwell, on 16.04 systemd-networkd isn't enabled by default, so that's going to be a problem;  if you want to use networkd then you need to enable it via systemctl enable systemd-networkd;  you'll need to write networkd configuration files (.link .network) files in /etc/systemd/network/* for your interfaces18:24
ppetraki__Yiota, save that to a file like config-fio-100-read.ini. and run it like this: $ sudo DISK=/dev/XXXX fio  config-fio-100-read.ini18:24
ikonialook at writing a systemd unit c0mrade18:24
rharperlearn how to apply the Match parameter to target the interfaces you want18:24
Aisonnacc, no, in interfaces there is only the lo device. Else I use systemd/network18:24
rharperand disable ifupdown networking18:24
c0mradeikonia: systemd unit?18:25
rharperif you're still using /etc/network/interfaces then you won't be using systemd-networkd; rather only the 'networking' service script which calls out to ifup and friends (from the ifupdown package)18:25
naccrharper: is all tht documented somewere (wiki?) or is that one of your tasks for the release notes?18:25
ikoniac0mrade: yes, as you've been told quite a few times18:25
Aisonrharper, how can I disable network/interfaces completely?18:25
rharpernacc: no, we've not released an Ubuntu with networkd enabled by default18:25
rharperremove them from /etc/network/interfaces ?18:26
c0mradeikonia: Also I've read this "To execute a script at startup of Ubuntu, simply edit /etc/rc.local, and add your commands. " at this link http://ccm.net/faq/3348-execute-a-script-at-startup-and-shutdown-on-ubuntu18:26
Aisonrharper, I did that (except the loopback device)18:26
c0mradeikonia: I just don't know what a systemd unit is.18:26
naccrharper: ah right18:26
ppetraki__Yiota, so most of my 4K ios complete in just under 764us18:26
ikoniac0mrade: so that would be the first thing you research18:26
Aisonthe funny thing is, on two other ubuntu serveres it is working perfectly this way18:27
rharperAison: and reboot; next reboot any interface that's not in /etc/network/interfaces won't get configured18:27
c0mradeikonia: okay, i'll research that18:27
Aisonrharper, yes, I tried, but it is still not configured by systemd18:27
rharperyou have to write systemd network configuration18:27
Aisonrharper, I did, that's why it is working after restart the netword service18:28
ppetraki__Yiota, also... I'm going straight to the block device, no middle man :) you can tell file to use a file and just point it at the mount point you're interested in. You want to start from the bottom up, how fast is my backend, *then* introduce the filesystem and see how much performance you loose.18:28
ppetrakier lose18:28
rharperand then disable ifupdown service 'systemctl disable networking';  write your new configs and enable networkd 'systemctl enable systemd-networkd'18:28
Aisonok, maybe that's the problem18:28
c0mradeikonia: Just for your information, I've installed lichess on my home server, it's a physical server with 8GBs of RAM and a 2.4GHz Xeon 4 core CPU. It's online at http://www.instagramika.com/ and it's up and running.18:28
AisonI did not disable networking18:28
ikoniac0mrade: I don't care18:28
naccAison: ah yes, so maybe they are competing18:29
c0mradeikonia: I know you don't care but you just made a comment up there that sadly I've been trying to install it on EC2 and this time that's not the case so I just wanted to correct things.18:29
ppetraki__Yiota, I don't know how big your reads are, you'll have to find that out. In the meanwhile, you can sweep the range using fio from 4K to say 512K and compare the completion times, see where they blow up18:29
ikoniac0mrade: you have - there is nothing incorrect in what I said, you've just told me it's running on a physical server, I said you've been trying and failed to get it running on an ec2 instance for days18:29
__Yiotappetraki thank you so much18:29
c0mradeikonia: Yeah but just to let you know it's no longer the case, it's not like am still doing that. I have it on my server now and trying to improve things.18:30
ppetraki__Yiota, you're welcome. performance instrumentation is hard work, just hang in there.18:31
ikoniac0mrade: and you've already told me days ago you had it running on your own server, and I explained I wasn't interested18:31
c0mradeikonia: Yeah you know that but not everyone in here.18:31
ikoniaI suspect no-one is that interested, they just want your problem solved so you stop asking the same thing every day18:32
c0mradeikonia: I am like everyone else trying to ask a normal question, yes I asked this yesterday and waited a long time until I gave up and asked in another channel and also didn't get an answer, maybe after some long time someone answered I don't know, by that time I turned off my system and fell asleep hehe.18:34
ikoniac0mrade: it was answered for you yesterday, and the day before, and in multiple channels18:34
ppetraki__Yiota, If reads are your problem, I would also run htop and turn on the R/W bandwidth column to see who the big contributors are. It could be something as dumb as too much competition for the same volume.18:34
ikoniareally try to focus on the information people are giving you, rather than the information you think you want18:34
c0mradeikonia: This exact question? I told you maybe it was but after half a day?18:35
ikoniac0mrade: the exact question18:35
__Yiotappetraki it's insane, the amazon SSD is slower than my google standard persistent disk18:35
ppetraki__Yiota, how slow is slow?18:35
sarnoldc0mrade: I know I explained that you ought to investigate writing a systemd unit file yesterday18:35
compdocsomethings wrong with that18:36
sarnoldc0mrade: .. and today you appear to have not done any reading about systemd unit files.18:36
sarnoldc0mrade: therefore it's hard to want to help you any further. I hope you can understand this.18:36
c0mradeikonia: All right, maybe I just missed it, but I didn't just ignore some answer on intention, that's the first time I get an answer quickly, I will be reading about systemd units and thanks for that.18:36
sarnoldc0mrade: this explains ikonia's frustration18:36
__Yiotappetraki https://bpaste.net/show/38df3b69ca0118:36
c0mradesarnold: I really didn't see any answer yesterday, I told you I didn't like ignore it on intention, I just totally missed it by accident.18:37
ikoniasarnold: not fully as he's cross-posting it in about 4 other channels at least that I'm in, and ignoring the same info there too18:37
ppetraki__Yiota, so if it fits in cache you're basically on a 12G SATA link, if not... you're getting spinning disk sata perf18:37
sarnoldc0mrade: that helps, a bit. time to investigate /lastlot -hilight in your irc client, too. :)18:37
ppetraki__Yiota, I found your problem :)18:37
sarnoldikonia: cross-posting is a quick way to exponentially grow frustration. :)18:37
__Yiotacan you expand on that?18:37
ikoniahence why I'm tired of it18:38
c0mradeikonia: First time I asked my question on here I assure you 100% that many hours passed without it being answered.18:38
ikoniayou've just been told you asked it yesterday and was given the answer18:39
ikoniaso how can it be "the first time"18:39
ikoniayou're even telling yourself lies now18:39
c0mradeThat's why if someone maybe answered my question I could've totally just missed it after waiting for hours I thought it won't even be answered.18:39
ppetraki__Yiota, if you have a cache miss you're going to pay for it dearly. I don't know how big the cache is, apparently big enough to move 10GB/s easy18:39
ppetrakiI meant 20G18:39
c0mradeikonia: You said I've been asking this for the past two days, I am not talking about yesterday but the day before that. The first time I asked it.18:39
ikoniaso "days" then18:40
ppetraki__Yiota, so what application is the problem? Do you have htop setup?18:40
__Yiotayes, I have htop18:40
c0mradeAll right thanks for the hint about systemd I'll be checking that out and see where I can get.18:41
__Yiotappetraki, we haven't pinpointed the problem yet18:42
__Yiotawe have comparable speeds to our google cluster18:42
c0mrademulti-user.target specifies what?18:45
ppetraki__Yiota, when you get into fio, enable the disk_read, disk_write, io_rbytes, and io_wbytes columns. and just sort by disk_reads for starters.18:45
ppetraki__Yiota, I meant htop, so many tools!18:45
__Yiotayeah no kidding18:45
ppetrakiduh even simpler18:45
ppetrakidstat18:45
ppetraki__Yiota, sudo dstat -d[bdev]18:46
naccc0mrade: `man systemd`18:47
sarnoldc0mrade: the main systemd boot 'goal', most of the time18:47
ppetraki__Yiota, and it's stupid it just wants the name e.g. "sdb" not the whole path18:47
c0mradeOkay thanks.18:47
ppetraki__Yiota, if it looks like you're sinking a total of 100MB/s of R and W then you're probably out of bandwidth, if you're within 80% of that you still have a problem18:48
ppetraki__Yiota, "SSD" doesn't mean crap in the cloud. If you're app really does have a random IO pattern, this fake SSD may not have what it takes to give you uniform completion times, it could actually perform like a spinning disk.18:49
c0mradePfff systemd documentation seems complicated18:50
naccc0mrade: well it's an init system for your entire macine, so it's complicated )18:50
nacc:)18:50
ppetraki__Yiota, ugh, it's -D not little d18:51
ppetraki__Yiota, http://pastebin.ubuntu.com/24415455/18:51
c0mradeI only need a couple of lines of code to make this thing work and am ending up reading complex stuff, which is a bit of pain :P18:51
sarnoldc0mrade: chances are really good that your systemd unit files will just be one or two files, ten lines long. but knowing what to put in those files means you have to know what you want the file to accomplish.18:52
sarnoldc0mrade: and that means reading.18:52
c0mradeOh I found this useful link http://www.tecmint.com/create-new-service-units-in-systemd/18:52
* c0mrade reading..18:53
c0mradeSomeone with a similar issue like mine.18:53
sarnoldmost of that looks alright but he goes off the deep end writing a new unit for bringing up a specific network interface18:55
c0mradesarnold: He's wasy of explaining is pretty cool, he makes it look pretty easy.18:56
naccyeah systemd blog posts are almost always ... misinformed it feels like18:56
naccor out of date at this point18:57
c0mradeI mean okay...It could be easy for someone working with linux everyday but for someone who might stumble upon this like once every half a year that's a problem, it's like there's no light you're in total darkness.18:57
c0mradenacc: The link I mentioed is not good or incorrect?18:58
naccc0mrade: i haven't read it, so i don't know18:58
naccc0mrade: i'm sorry, but setting up a process to start at boot to spawn a service at every boot does require you to educate yourself18:58
naccc0mrade: you're making a choice to do that in the first place18:58
naccc0mrade: so just pay the cost of learning how to do it right :)18:59
c0mradenacc: It'll take 10 seconds with you, just tell me how to do it :P18:59
c0mradeGemme them codes and lines... :P19:00
naccc0mrade: right, not my job )19:01
nacc)19:01
nacci'm not used to using my laptop keyboard clearly!19:02
c0mradeyou can understand that the booting procedure reaches the targets with a defined order. so how do I know the order, the example shows to execute the script after network.target which is when the boot process reaches the network service and starts it, but I need the boot process to complete and start my script19:07
c0mradeOh, it looks easy to me now :P from what I read...19:08
c0mradefirst step is to create a file.service in cd /etc/systemd/system/multi-user.target.wants/19:09
c0mradeWrite some code in that ExecStart= specifies what to execute and WantedBy= specifies multi-user.target (runlevel or whatever)19:10
sarnoldno, just /etc/systemd/system/19:10
Aisonrharper, still not working, so old networking service was not the problem19:11
naccc0mrade: you use symlinks in each target to specify what should run for that target19:11
rharperand what does networkctl show ?19:11
rharperare you sure your .link and .network file are accurate?19:12
naccc0mrade: e.g., (iirc) systemctl add-watns <target> <service name>19:12
nacc*add-wants19:12
Aisonrharper, I have no .link file, only .network and .netdev (for vlan)19:12
Aisonrharper, networkctl show enp2s0 degraded19:13
c0mradesarnold, nacc: Yeah I got it, I thought it's going to be difficult, because I've read some documenation about systemd and got overwhelmed but it looks pretty easy :)19:13
rharperok and what's your device section in .network look like, are you matching via mac or some other property ?19:13
c0mradeBut all I gotta do now is just worry about how am going to sun the command 'run' after I execute the first script...19:13
c0mradeMaybe use expect?19:13
c0mradeThe prompt will look like (lila)$19:14
c0mradeSo I would just use 'expect' with that stuff and send 'run'?19:14
sarnoldwhere does the prompt come from?19:14
c0mradesarnold: After I execute ./bin/dev which I think executes a JVM with -Xms and -Xmx args, that's what's inside the file some long command with many arguments related to java.19:16
ThiagoCMCHey guys... Under MaaS Next (fully upgraded and recently installed), my PXE subnet have 0% "Available IPs"! But the subnet is a /23 and I only have 11 baremetal servers! How to clean it up?19:17
sarnoldThiagoCMC: iirc maas brings up nodes into a 'holding tank' of some sort, that also needs some spare ips -- do you have a network or a zone or something set aside for this? does it have enough ips?19:18
sarnoldc0mrade: is '(lila)$' coming from bash? or from the java program?19:18
ThiagoCMCyes, O have other fabrics / subnets...19:19
ThiagoCMCI mean, /O/I/19:19
c0mradesarnol: From the java.19:19
sarnoldc0mrade: eww.19:19
ThiagoCMCI also have an extra DNS zone19:19
c0mradesarnold: But how do I make sure, maybe am mistaken.19:19
c0mradesarnold: But won't my idea of using 'expect' work?19:20
sarnoldc0mrade: maybe you can just do "echo run | ./bin/dev"19:20
sarnoldbut that sounds like really gross software19:20
c0mradesarnold: Heard of sbt?19:21
sarnoldno19:21
c0mradesomething used for building apps19:21
c0mradehttp://www.scala-sbt.org/19:21
sarnoldc0mrade: oh. hrm. https://en.wikipedia.org/wiki/Sbt_(software)#Example_use19:23
sarnoldc0mrade: try "sbt run" as the command rather than using the interactive thing.19:23
ThiagoCMCNever mind... Figured it out! It was reserved for some reason...19:24
c0mradesarnold: What about ./bin/dev ?19:25
c0mradeahh you mean inside ./bin/dev script add that line?19:25
c0mradesbt run?19:25
sarnoldc0mrade: maybe. I have no idea what that tool does.19:25
c0mradeBut I think I'll hit something a loop hh.19:26
c0mradesomething like a loop*19:26
c0mradesarnold: After= should be what? Most of the examples use network.target but what do you recommend using?19:28
sarnoldc0mrade: do you need to wait for your mongo server to be up first? or just networking?19:29
c0mrademongo server should be up before executing that command yes19:29
sarnoldthen be sure to put its unit in there too19:30
c0mradeI've already made mongo start automatically without doing any of this manual stuff19:31
c0mradejust executed systemctl then something and mongo.service19:31
c0mradeI forgot the command19:31
c0mradeyeah19:31
naccc0mrade: yes, because mongo ships a unit already19:31
c0mradesystemctl enable mongo.service19:31
naccc0mrade: so all you did was 'enable' it19:31
c0mradesorry19:31
c0mradesystemctl mongod.service19:31
c0mradesystemctl enable mongod.service19:32
c0mrade:P19:32
c0mradeAfter=mongod.service ?19:32
c0mradeBut then the question is that is that accurate? What if it needs some other services to be running? Is there a way that I just don't specify after= and just wait for boot process to complete and then run the script?19:33
sarnoldc0mrade: you've got a few choices.. https://www.freedesktop.org/software/systemd/man/systemd.unit.html#Requires=19:34
sarnoldc0mrade: Requires= if it just requires it and startup order doesn't matter; Requires= and After= if you have to wait19:34
bindihow come I have to do 'sudo iptables-apply' each time I reboot to have my rules take effect?19:35
bindiApplying new iptables rules from '/etc/network/iptables.up.rules'... done.19:35
bindi16.0419:35
c0mradebindi: I know how to fix this now :D create a systemd unit file! :D19:36
c0mradeHehe kidding there should be anothe way.19:36
c0mradeanother*19:36
axisysgot a alert on cve-2009-2410, but do not see anything on ubuntu usn19:38
ikoniac0mrade: you understand that "the run" part is an interactive shell19:38
axisysany suggestion how to address this19:39
naccaxisys: https://people.canonical.com/~ubuntu-security/cve/2009/CVE-2009-2410.html19:40
c0mradeikonia: Yeah it's some sort of shell but I don't know if it's created by java or what... So I want a script that will execute ./bin/dev then execute 'run', that's why I mentioned to use expect. But I think I didn't get what you're trying to say?19:40
axisysnacc: hmm.. i could not find it..19:40
axisysnacc: thanks though.. so I will just answer that19:41
naccaxisys: i usually start at https://people.canonical.com/~ubuntu-security/cve/19:41
naccaxisys: and go off the cve itself19:41
axisysnacc: thanks for the tip.. I will just create a function with that lookup..19:42
c0mradeikonia: I know that everyone might get annoyed from be because of my noobness but yeah...19:42
c0mradefrom me*19:42
naccaxisys: yw19:43
sarnoldaxisys: a moment..19:43
axisyssarnold: k19:43
sarnoldaxisys: when we triaged that initially sssd wasn't in ubuntu https://people.canonical.com/~ubuntu-security/cve/2009/CVE-2009-2410.html19:44
sarnoldaxisys: so there's a really good chance that it was fixed before sssd was added19:44
sarnoldaxisys: but I'd like to double-check when we triaged that19:44
sarnold.. and bzr log is sooo slow. heh.19:44
naccsarnold: ah! yeah, i wasn't sure on the message format19:44
naccsarnold: if it was "not present in ubuntu's sssd" or "sssd is not present in ubuntu"19:48
sarnoldnacc: in this case, sssd wasn't present in ubuntu at the time19:49
sarnoldnacc: in the case of 'not present in ubuntu's sssd' the report would look more like https://people.canonical.com/~ubuntu-security/cve/2016/CVE-2016-10249.html19:50
axisyssarnold: so how do I check if it is present on 12.04 LTS ?19:50
naccsarnold: ah right19:51
sarnoldaxisys: apt-cache search sssd or dpkg -l sssd19:51
sarnoldaxisys: sorry I've got to run and this bzr log hasn't gotten to the check in that added that cve yet :/ back in an hour or so19:51
ikoniac0mrade: created by java ?19:51
ikoniac0mrade: it IS scala19:51
ikoniac0mrade: no-one is annoyed because you are new, people get frustrated because you don't listen, you admit you're too lazy to even describe problems properly and you spam channels with no respect for their rules and then try to evade bans19:52
ikoniac0mrade: thats why people get annoyed with you19:52
ikoniac0mrade: the bottom line is you need to understand the scala environment and not just cut and paste the commands blindly from lichess wiki into a script19:52
ikoniayou need to understand how to setup the environment needs, how to launch non-interactive and how to trap and manage errors19:53
ikoniaI suggest you focus on that19:53
ikoniathen once you understand how to do this, you can then translate that into a systemd unit file19:53
axisysun  sssd                    <none>                  (no description available)19:54
c0mradeikonia: Thanks for the info.20:12
c0mradeThat will require some time. To run the lichess app two commands are required, the ./bin/dev then inside the interactive shell running 'run'.20:13
c0mradeOnly these two, now I do agree with you that I'd have to dig deep into understanding the scala environment but I'll leave that for another time which won't be too long.20:14
c0mradeBut for the time being am thinking of a simple (might be dirty) solution which is just run this ./bin/dev then send it the word run and put it in a systemd unit file.20:15
Aisonhello, anybody an idea what can cause smbd to use almost 100% CPU usage (one core)?21:12
Aisonsmbstatus says "No locked files" and just two users21:13
naccAison: you could strace it, maybe?21:13
sarnoldaxisys: sure enough CVE-2009-2410 was added in 2009. Debian agrees that it was fixed before being added https://security-tracker.debian.org/tracker/CVE-2009-241021:14
Aisonnacc, 10s strace of smbd generates 4mb log file21:16
naccAison: :) yeah sounds busy! -- i'm guessing it's in a loop somewhere21:17
naccAison: can you pastebin it?21:17
sarnoldmaybe strace -c21:18
sarnoldor .1 seconds of strace :)21:18
naccyeah, less of it woould be fine, esp. if it's repetitive21:18
dpb1| head -500 :)21:18
Aisondirect link to the 3mb log file https://people.alvhaus.ch/~ivost/smbd.log21:18
Aison:P21:18
sarnolddoes /var/run/samba/msg.lock exist?21:19
naccit appears like it can't grap a lock21:19
nacc*gravb21:19
nacc/var/run/samba/msg.lock/*21:19
Aisonno, does not exist21:20
sarnoldAison: do you have any apparmor DENIED messages in dmesg or auditd logs?21:21
Aisonno, just this one (but that's mysqld): audit: type=1400 audit(1492628668.583:17): apparmor="DENIED" operation="open" profile="/usr/sbin/mysqld" name="/proc/5983/status" pid=5983 comm="mysqld" requested_mask="r" denied_mask="r" fsuid=102 ouid=10221:22
* nacc thinks you could try creating that directory and seeing if smbd calms down, but you'd need to make sure to get ownership/permissions right. I think it'd match /var/run/samba but not sure21:23
sarnoldthe mysqld issue is probably 165823921:23
sarnoldyeah, I think i'd pick the same owner/group as /var/run/samba and set mode to 75521:28
sarnoldI got the 755 from lib/param/util.c in one of the samba sources21:28
naccyeah, i think that should be fine21:28
nacci'm not sure why that directory doesn't exist, it seems like it should by default21:28
naccAison: what version of ubuntu?21:28
sarnoldyeah, I can't figure out why it doesn't exist either. I half-expected an apparmor denial to explain it..21:29
naccor i guess i would have expected the service wrapper to ensure it exists, or a postinst, or something ...a though if it's in /var/run ... that a tmpfs, so it needs to be a runtime thing21:30
nacc(iirc, /var/run is by default -> /run which is by default a tmpfs)21:30
Aisonnow these files exists (/var/run/samba/msg.lock/*)21:32
Aisonbut still high cpu load21:32
sarnoldtry a new strace?21:32
Aisonsamba is still trying to lock some files inside /var/run/samba/msg.lock/21:35
sarnolddoes this mean anything to you Aison?21:42
sarnoldaccept(36, {sa_family=AF_INET, sin_port=htons(45332), sin_addr=inet_addr("10.1.1.1")}, [16]) = 1721:42
naccAison: you might need to restart smbd as well, if it's trying to use existing lock file it couldn't create before21:42
=== jasondotstar_ is now known as jasondotstar
Aisonnacc, ok21:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!