/srv/irclogs.ubuntu.com/2017/04/27/#ubuntu-server.txt

=== JasonMc92 is now known as CodeMouse92__
lordievaderGood morning06:29
wretchedspiritsup06:33
lordievaderDoing good here, how are you wretchedspirit ?06:36
wretchedspiritsame here, playing some rocket league before I start working :006:39
pitastrudlwhat is there more to having a dedicated server at a company compared to a VPS? i know, if you get the real deal, you have your own resources to deal with07:38
pitastrudlbut what more can i do?07:38
pitastrudli am not sure what more is there to configure, speficifally im looking on getting one from online.net07:39
JanCpitastrudl: depends on how online.net implements "VPS"07:45
JanCbut in general, the provider should have documentation about whatever configuration you need (sometimes they have a wiki for such things)07:48
pitastrudlJanC: ah ok07:49
pitastrudlwell i was mostly referring to a VPS like they have at digitalocean07:50
JanCin most cases you probably don't need any special setup07:50
pitastrudli see07:50
JanCthe main setup is probably about how you configure IPv4 and/or IPv607:57
pitastrudli see07:59
JanCbut I would expect them to set that up by default08:05
=== JanC is now known as Guest35192
=== JanC_ is now known as JanC
aruli want host my odoo application in in ubuntu server.. anyone please give the details about low ubuntu-servers in low cost10:14
arulsorry ubuntu servers in low cost10:15
TafThornearul: are you looking to hose in house and want advice on buying hardware or are you asking for a cloud solution?10:24
arulTafThorne, yes. cloud solution like digital ocean10:25
arulfor deploying my odoo application10:27
TafThornearul: I cannot provide that recommendation.  Thank you for clarifying though.  Hopefully someone can help.  You see a little more activity in this channel once the US wakes up.10:29
arulTafThorne, thanks for ur reply.10:29
=== HoloIRCUser2 is now known as omps
rickardo1How fast should network between webserver and mysql be.. is it necessary with 1 Gbit?11:41
ikoniathat depends on what you are doing11:42
ikoniaand your system and application needs11:42
ikoniayou're not doing enterprise stuff so "no"11:42
andolrickardo1: Might also be that the latency matters more than the bandwidth.11:54
rickardo1andol: ok, I think I need to measure the data flow get a better picture.. The service I provide shall handle maximum 50 requests per second11:55
ikoniarickardo1: I really think you don't need to do that11:59
ikoniait really sounds like you don't understand capacity planning or networking at this stage, yet you're trying to "provide a service"11:59
rickardo1ikonia: I am no sysadmin, that's right.. I am a backend developer..12:00
JanCreally depends whether that's 50 req/s average or peak  :)12:01
rickardo1peak12:01
JanCand what sort of requests those are12:02
rickardo1JanC: A rest api, consume and respond with json12:03
rickardo1JanC: An algorithm with cpu heavy combinatorial optimization is the heart of the application.12:05
JanCthe "form" isn't very relevant; the amount of work and/or the amount of results is12:06
JanCif you aren't sure, measure12:07
rickardo1JanC: Everything is on a 8 core 8 GB VPS distributed in docker containers in the moment.. and the bottleneck is mysql therefor I want to move it to it's own server without docker so it can utilize all of the hardware.12:08
rickardo1*) at the moment12:08
JanCso, the first thing you want to do is check if you can optimise the database queries and/or move more work from the app to the DB12:09
JanCand/or maybe figure out how to spread queries to multiple databases12:11
JanC(depending on what the real issue is)12:12
ppetrakirickardo1, is mysql bound on the compute or io side? htop with additional columns to show disk R/W would tell you which side your problem is on pretty quickly.12:48
rickardo1ppetraki: io side12:49
ppetrakirickardo1, are you writing more than you're reading?12:49
ppetrakirickardo1, how much is hiting the backend relative to mysql's contribution? (dstat)12:50
cpaelzerrbasak: the next version of squid tests is submitted to debian 500LOC instead of 2.5k and many cleanups12:56
ubottuError: Debian bug 500 could not be found12:56
cpaelzerrbasak: do you already have plans for the squid merge (schedule wise)12:57
cpaelzerit might be worth to wait if they accept it the next few weeks12:57
rizonzis someone preseeding against an 64bit only mirrir ?13:05
rizonzmy preseed finishes but cannot find some packages which are there in 64bit13:07
rbasakcpaelzer: \o/13:19
rbasakcpaelzer: no plans. We should work out a plan (for all the merges).13:19
cpaelzerrbasak: yeah for now I'm dropping those that come to my mind into the blueprint as-is13:20
cpaelzerrbasak: but I wanted to invite for a shrot daily sync anyway - that would be a perfect place13:20
* cpaelzer is doing so now13:20
rbasakAgreed13:26
cpaelzernacc: It seems we officially have no overlapping times :-/, please get in touch if that is too early for you13:29
cpaelzernacc: we might create a more interesting schedule that bites each of us in alternating patterns or so13:30
rizonzis someone able to do some testst against a 64bits mirror only ?13:40
patdk-wkwhat is a 64bit only mirror?13:55
cpaelzerwithout i386 packages mirrored I assume?14:02
patdk-wkdunno14:02
patdk-wkand no idea it is even a mirror of packages14:03
patdk-wkit's just a mirror, could be 64bit glass14:03
jamespagecpaelzer: btw I have ovs 2.7.0 prepped and ready to push to artful alongside openstack pike-114:54
jamespagehttps://bileto.ubuntu.com/#/ticket/2732 to track14:54
=== Poster|w is now known as Poster
cpaelzercool thanks jamespage15:02
cpaelzerI'd wish to get a chance on vhost-client mode then this cycle15:02
=== RoyK is now known as RoyK_Home
nacccpaelzer: ok -- that's fine, in the future, it makes me grumpy to wake up to be told i missed a meeting scheduled while i was asleep. Old IBM manager trick :)15:12
=== RoyK_Home is now known as RoyK
=== RoyK^ is now known as RoyK_Home
cpaelzernacc: so you are ok with the time as is atm?15:18
cpaelzernacc: and to be clear, I expected you to not be around today for you hopefully still sleeping fine15:19
nacccpaelzer: ack, yeah it's fine15:24
nacccpaelzer: and the grumpiness was at gcal, not you :)15:24
cpaelzernacc: ok thanks15:26
cpaelzernacc: I ran into a few usd issues when I wanted to push a few more easy ones15:26
cpaelzernacc: if you need something from me for that please let me know15:27
cpaelzernacc: oh I see mail replies15:27
cpaelzerlet me read :-)15:27
nacccpaelzer: ack15:27
rizonzanyone mirroring debian with debmirror ? I can't get main/installer-amd64 in16:56
=== stgraber_ is now known as stgraber
CodeMouse92__I've got two scripts scheduled to run on @reboot on my server's user-cron (crontab -e), but they don't seem to run. Ever.18:42
CodeMouse92__I know (a) the scripts themselves work - I can run them manually, and they're fine. They're marked +x18:43
sarnoldCodeMouse92__: can you pastebin the crontab in question?18:43
CodeMouse92__(b) I am not finding any errors in the system logs, unless I'm looking in the wrong place18:43
sarnoldcron emails errors18:43
CodeMouse92__sarnold: Sure. Did you want the scripts too?18:43
CodeMouse92__sarnold: Yeah, no mails either18:43
sarnoldCodeMouse92__: not immediately but if the crontab looks fine, then yeah, that's the next step :)18:43
CodeMouse92__sarnold: https://bpaste.net/show/230a4ba6d0f0 <-- NOTE: I added the ### COMMENTS ### *just now in pasting*. Those are not in the file18:44
naccCodeMouse92__: and you know @reboot runs at startup, right?18:45
CodeMouse92__I know some things can't run right off after reboot, thus why I have it wait two minutes18:45
CodeMouse92__nacc: Yup.18:45
CodeMouse92__My server has hours (for multiple reasons I am not discussing)18:45
naccCodeMouse92__: you might want to use absolute paths18:45
naccin general in crontabs18:45
CodeMouse92__nacc: Uhm...I am.18:45
nacc"sleep 120"18:45
sarnoldthat was my expectation but the VBoxManage line apparently works fine :)18:45
nacc /bin/sleep 12018:45
drabCodeMouse92__: do you see no messages in the logs at all about the cront running or the script seems to not be doing its job?18:46
CodeMouse92__nacc: Ah, well, I can. Although that works elsewhere.18:46
sarnoldhuh I thought that was a shell built-in. guess not.18:46
CodeMouse92__drab: Absolutely nothing weird.18:46
drabI had a cron recently that actually was running, but not doing its job for other reasons18:46
CodeMouse92__sarnold: It *is*. My root cron works great18:46
drabCodeMouse92__: so you don't see a CRON line in the logs saying the job ran, correct?18:46
CodeMouse92__And it has 'sleep 60' commands18:46
sarnoldCodeMouse92__: I'd just blindly try removing the 'sleep 120;' bits and put them into the script, if they only ever get run via this file..18:46
CodeMouse92__drab: I don't see either way for this file. Only for the root one18:46
CodeMouse92__sarnold: I can. Although, i actually added those as a *result* of the script not seeming to run18:47
sarnoldCodeMouse92__: oh. odd.18:47
sarnoldCodeMouse92__: ok, I guess then time to pastebin the scripts :)18:47
sarnoldmaybe they are running but just not doing what you expect18:47
drabok, one way I've debugged things before was to add a touch /tmp/test_cron && my_original_command18:47
naccso there's another hack you could do18:47
naccif the second line works18:47
CodeMouse92__(BTW, adding the sleep to the scripts would be BAD - I need to use the same scripts to start them on cue WITHOUT waiting18:47
naccmake it that scirpt && line3 && line418:47
naccand see what happens18:47
CodeMouse92__sarnold: https://bpaste.net/show/a969fee8b09e <-- both files are in the same paste for brevity, so I used the ############# long comments to separate the files18:49
CodeMouse92__NOTE: both scripts do EXACTLY what I expect if I run them manually18:49
CodeMouse92__From the same user as what the cron is running as18:49
CodeMouse92__nacc: I can try that if we find nothing - I'd have to restart the server is the only gotcha, but I can try18:50
drabCodeMouse92__: have you tried a simple one liner? like /usr/bin/touch /tmp/reboot_cron ?18:50
draband see if that runs at all18:50
sarnoldI'd change both those to #!/bin/bash and /usr/bin/screen and a direct path to supybot too..18:50
CodeMouse92__drab: That would do some very bad things to my system. >.>18:50
CodeMouse92__Doubling some processes, etc. yeah, I'd just need to reboot18:50
CodeMouse92__sarnold: I was told NOT to use #!/bin/bash by someone. I actually prefer your shebang18:51
drabeh? I don't see what very bad thing it'd do to your system...18:51
sarnoldthe PATH in cron is very very short. so either set PATH to what you want, or just use full paths..18:51
sarnoldCodeMouse92__: the env thing is usually used by people who have python or ruby scripts or something and want them to work on windows and os x and linux and can't rely on them being the same paths, or want to use virtualenv or rvm or something to install a dozen different versions of ruby or python at once18:52
CodeMouse92__Want to see something weird, though? let me show you the startup_sparrowsgate script, which IS working....18:52
sarnoldCodeMouse92__: I think shell scripts that are meant to run on linux should just be simple and not require starting up another pointless process. you knwo the path :)18:52
CodeMouse92__This one works: https://bpaste.net/show/ad97c4dbf763 (weirdly, I forgot the shebang)18:53
CodeMouse92__sarnold: Well, good to know. changing THAT back18:53
sarnoldCodeMouse92__: heh, iirc linux just uses /bin/sh if a script is missing a shebang18:53
CodeMouse92__sarnold: Regardless, the relative path of 'screen' is used in that one without a problem18:54
sarnoldyeah, so you can probably skip that change then18:55
CodeMouse92__I did set the absolute paths and added the touch commands to the scripts, just to see if they run at all18:55
CodeMouse92__So, let me try going for a quick reboot, ensure nothing explodes18:55
CodeMouse92__slash-make sure it works18:55
CodeMouse92__While I'm waiting, I have one other theory.18:58
CodeMouse92__Could the second line in the cron be somehow NOT releasing something, and thus the cron doesn't continue?18:59
CodeMouse92__Or does cron not work that way?18:59
CodeMouse92__Oh! Hey! It's working now!19:00
* genii makes more coffee19:00
CodeMouse92__Okay. NEXT PROBLEM: both scripts are now running, but according to the log for one, it isn't finding node.js, which IS installed....19:01
CodeMouse92__Probably a path thing again, but I'm not sure.19:01
CodeMouse92__node.js exists in /opt/nodejs, and if I manually run the /opt/scripts/other/start_etherpad script, it works fine. but from the crontab, no dice....19:02
naccCodeMouse92__: when run manually is /opt in your PATH?19:03
CodeMouse92__nacc: OH. MY. GOSH. Am I really that silly???????19:03
* CodeMouse92__ checks19:03
CodeMouse92__Oh.19:03
CodeMouse92__Yes19:03
naccCodeMouse92__: that's why i said earlier use absolute paths :)19:03
CodeMouse92__It is - https://bpaste.net/show/20b16452cfaf19:03
naccright when run manually19:04
naccbut not when run via cron?19:04
CodeMouse92__(I actualy ran echo $PATH, but I typo'd19:04
naccyou cannot assume your path is anything in a crontab19:04
nacc*shouldn't19:04
drabyou can assume it's nothing :)19:04
naccdrab: :)19:04
CodeMouse92__nacc: I see. Okay, so, how can I ensure that's doing what it's supposed to? Etherpad's start script isn't something I wrote19:04
naccCodeMouse92__: any invocation of any binary should use absolute paths19:04
naccCodeMouse92__: in the crontab script path up until the last exec19:05
sarnoldyour PATH in cron is probably just /bin:/sbin:/usr/bin:/usr/sbin. That's usually it.19:05
naccsarnold: yeah19:05
drabanybody knows with qemu how to tell it to disable floppy and cdrom? I don19:05
drab't have them called out as parameters and the devices are still created19:05
draband it's erroring on the floppy19:05
naccdrab: can you pastebin the qemu line and output?19:05
naccdrab: you need -nodefaults usually19:06
CodeMouse92__nacc: Is there a good way to add to cron's PATH? Changing the etherpad scripts will be a nightmare19:06
naccdrab: floppy and cdrom are always there 'by default'19:06
sarnolddrab: I think -nodefaults is what you're looking for19:06
naccCodeMouse92__: i think you can set PATH at the top of a crontab, check `man 5 crontab`19:07
sarnoldCodeMouse92__: set the PATH in your script there19:07
naccCodeMouse92__: the way cron parses it is weird19:07
nacc"Note  in particular that if you want a PATH other than "/usr/bin:/bin", you will need to set it in the crontab file."19:07
CodeMouse92__sarnold: Now, changing the path variable IN my script...that won't ultimately cause it to have ten thousand instances of it in PATH by running that script every day, right?19:07
drabhttp://dpaste.com/3Q6NM7119:07
CodeMouse92__nacc: Right...I'll do that.19:08
drabsarnold: ah! I think that's a winner, I recall seeing it in some virt-manager generated line19:08
drabtrying that19:08
sarnoldnacc: hah so it's even half the size I expected? typical cron.19:08
naccsarnold: yeah19:09
naccsarnold: basically if you need PATH to be something, always set it19:09
naccto exactly what you need19:09
CodeMouse92__nacc: Well, all this definitely makes sense now. You've demystified cron for me, TY :319:12
CodeMouse92__I'll reboot and see if this works now19:12
drabsarnold: mmmh, that seems to have also done something else I did not want...19:12
drabsarnold: I no longer get curses output19:12
drabinstance doesn't look like booting19:12
naccdrab: nodeaults turns off the display19:12
naccdrab: read `man qemu-system-x86_64` :)19:13
drabyeah just stuck there19:13
naccdrab: or19:13
drabwell, it's not booting tho19:13
naccdrab: use libvirt! :)19:13
drablol19:13
naccdrab: like i said ... a week ago? :)19:13
naccit feels like a week ago19:13
naccand you'd be up and running by now19:13
drabyou're right and when you're right you're right :)19:14
sarnoldnacc: bah don't discourage the guy I want him to finish his work and then publish it somewhere so I can steal it :D19:14
drabhowever I'd probably understand close to nothing about qmeu19:14
naccdrab: being able to run qemu does not equate to understanding it :)19:14
drabnow I feel I have a reasonable enough understand of the options, how stuff connects to what etc19:14
naccit's the craziest code i've seen in a long time19:14
naccbut yeah, it's a good point19:14
drabyeah, well, I can't run things I don't understand, at least at a minimum level19:15
nacchonestly, we need a tool between qemu and libvirt19:15
nacci think it's kvmtool19:15
naccbut i can't recall19:15
drabthere is such a thing, but I didn't try it19:16
CodeMouse92__And it ALL works! Thanks drab, nacc19:16
drabtbh I spent the first 2 days trying to figure out what the difference between qemu and kvm was...19:16
drabsome ppl use the names interchangeably19:17
draband whatnot19:17
naccdrab: kvm is a qemu mode19:17
naccdrab: technically it's a technology19:17
naccfor linux, using qemu is so rare these days -- only for cross-arch19:17
nacc(imo)19:17
drabor for when you need to run things like zfs and nfs-kernel-server that you don't want to run on the host19:18
drab:)19:18
naccdrab: but you'd be using kvm for that, presumably19:18
naccdrab: by qemu i meant unaccelerated qemu19:18
draboh, doh, you got me :)19:18
drabsee, I got it now19:18
naccdrab: kvm is accelerated qemu19:18
drabright19:18
nacc(hardware accelerated that is)19:18
drabok, answer was "-nodefaults -vga std19:25
drab"19:25
drabno more silly floppy19:25
draband I got my console back19:25
naccdrab: yep, that feels familiar19:26
naccas to why everyone uses -nodefaults and yet -defaults are still the default...19:27
naccno answer :)19:27
drabbtw for whatever reason I'm not getting, zfs performances are higher on the KVM with a ZVOL than ton the host on the pool the ZVOL comes from19:28
drabsame test file with fio and all19:28
drabthe VM has even less mem theoretically19:29
naccdrab: could it be less contention for the cpu in the vm itself for zfs? i'm not sure how cpu bound zfs is, but if the vm is pinned (which you might want to do for performance), then it might be ok19:30
naccdrab: if you are performance-focused, you might want to look at hugepage backing your guest19:30
sarnolddrab: time to fiddle with the caching flags for your disks ;) some are for fvery-fast-very-lossy and some are for slow-and-safe. :)19:32
naccyeah that's true too19:33
=== Serge is now known as hallyn
drabnacc: good point about pinning, it's not, I need to look at that whole chapter for both kvm and lxc20:43
naccdrab: esp. if you are doing something like using a vm for backing storage to other vms20:44
naccdrab: you really don't want the storage to get swapped out20:44
drabnacc: yeah no, I don't want that. however "pinning" the way I've done it before is about CPU, not mem, bit from what you said it sounds like that's what you're talking about20:45
drabif the mem is already assigned to the guest tho, won't that be "reserved"20:45
drabother than oom kicking in ande deciding that qemu must die20:46
naccdrab: you can pin a vcpu to a lcpu so that it doesn't encounter thrashing at the cache level20:46
naccdrab: but then you also, probably, want to lock your vm into memory20:46
naccdrab: there is mlock to do that, or you can use hugepages (which will be evne better, presuming you set it up right )20:46
drabok, the cpu part I get, the second one I'm not familiar with. but maybe google is, I'll ask it :)20:46
naccdrab: tuning vms is a rather complicated topic20:47
drabso I looked into hugepages briefly and sort of put it off to later20:47
naccdrab: yep it shouldn't be a huge deal20:47
drabone of the thing I found was this idea of rtansparent hugepags20:47
naccbut it will eventually potentially be an issue20:47
drabwhich seemed to imply you didn't need to set up hugepages anymore20:47
naccdepending on how overcommitted your host is20:47
naccdrab: thp works, generall20:47
naccbut pre-allocating hugepages performs better20:47
drabok20:47
naccas the kernel doesn't have to scan to figure out what base pages can be promoted to hugepages (whih takes cpu cycles and time)20:47
drabfair enough20:48
naccdrab: so often, my recommendation would be to use thp20:48
naccdrab: but if you have a specific use-case, being explicit an maximize  performance20:49
naccthp helps everything -- which means some thing that maybe don't need to be inhugepages can be there20:49
naccand on some level, due to fragmentations, hugepages are a resource20:49
nacc*precious* resource20:49
drabnacc: all I'm finding about pinning is using taskset on the host. I've seen some posts about some vcpu argument to qemu, but it seems a patch from way back when that was not applied afaics21:07
drabhttps://patchwork.kernel.org/patch/9361617/21:09
pcnHi everyone.  Is there documentation on the linux-aws packages?  I'd like to understand how these are maintained and how I'm supposed to use them21:19
=== jdstrand_ is now known as jdstrand
sarnoldpcn: I suspect you just apt-get install linux-aws, that will bring in the other aws-specific kernels. you may need to edit grub or use the grub interface to test it out and if you like it, maybe uninstall the other linux-generic or other metapackages22:04
=== jeremy_carroll_ is now known as jeremy_carroll
=== OliPicard_ is now known as OliPicard
pcnOK, thanks.22:18
=== JanC_ is now known as JanC
naccdrab: i'd have to go look23:05

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!