| Pinkamena_D | Hello, I am having some performance issues with my NFS mount. Server is 14.04 and client is 17.04 I am trying to take a backup of the client using backintime program. The client has a 1tb ssd to backup and the server saves this to a 4tb 5400 HDD. The process starts out at a good 200+ mbps but after about 15 minutes or so drops to ~50kbps which will make it take many days to finish. I used to perform the backup using SFTP with the same setup | 02:03 |
|---|---|---|
| Pinkamena_D | however the CPU usage on the server for the sshd process was becoming a bottleneck. The speed was much better than this though. With the NFS there does not seem to be a cpu or disk bottleneck on either machine. I have tried the async mount option. Any other immediate suggestions what could be wrong? | 02:03 |
| Pinkamena_D | Also both computers with gigabit cards are connected to one gigabit router in the middle in a home LAN | 02:04 |
| RoyK | Pinkamena_D: check iops usage | 02:13 |
| RoyK | Pinkamena_D: usually nfs is sync, meaning it requires a committed write to the drive before something else can go on | 02:14 |
| RoyK | Pinkamena_D: you can export/mount it as async, it'll help a lot for speed, but you might lose data in case of a power loss | 02:14 |
| Pinkamena_D | yeah, I have tried to use async but it does not seem to help much | 02:15 |
| RoyK | try to monitor disk I/O | 02:15 |
| RoyK | something like munin is nice | 02:15 |
| RoyK | or sysstat | 02:15 |
| RoyK | sysstat is easy - just install it and enable it - munin is a web thing and may take a wee bit of more effort | 02:16 |
| RoyK | I'd recommend trying munin, though | 02:17 |
| RoyK | it'll probably take half an hour to get some useful data out from it, since it only runs every five minutes | 02:17 |
| Pinkamena_D | I can see disk IO in glances - just trying to rm the files now, I get about 1.5M read and 0 write. | 02:17 |
| RoyK | Pinkamena_D: https://munin.malinux.no/ | 02:17 |
| Pinkamena_D | running the command on the server itself is much faster | 02:18 |
| RoyK | anything in dmesg? | 02:18 |
| RoyK | run dmesg -T | pastebinit | 02:18 |
| Pinkamena_D | theres no errors | 02:19 |
| Pinkamena_D | heres a few lines that are relevant: https://bpaste.net/show/1c325288d9a0 | 02:19 |
| Pinkamena_D | One other thing I can think of, though I dont think it should be this drastic, is that I am using btrfs | 02:20 |
| RoyK | not sure if it's relevant. but again, I'll use btrfs when it's stable as in stable, same thing goes to visiting the US, I'll go there again when it's a working democraty there. Nonoe of those seem to happen very soon | 02:23 |
| === Guest69707 is now known as db | ||
| === db is now known as db` | ||
| === ZipSplat- is now known as ZipSplat | ||
| pankaj | I copied a file to my pendrive using command line. I noticed that if I had copied using the graphical interface then it would have been a lot more faster. What is the reason? | 06:12 |
| pankaj | I copied a file to my pendrive using command line. I noticed that if I had copied using the graphical interface then it would have been a lot more faster. What is the reason? | 06:16 |
| pankaj | ping | 06:18 |
| pankaj | pingit | 06:18 |
| pankaj | I copied a file to my pendrive using command line. I noticed that if I had copied using the graphical interface then it would have been a lot more faster. What is the reason? | 06:19 |
| pankaj | Hello. | 06:22 |
| pankaj | I copied a file to my pendrive using command line. I noticed that if i had copied using graphical interface then it would have been a lot more faster. What is the reason? | 06:24 |
| pankaj | Hello. Is anybody there? | 06:28 |
| pankaj | I coied a large file to my pendrive using command line. I noticed that the process of copying was very slow as compared to that if I had done in command line. Why? | 06:32 |
| * RoyK waes | 07:02 | |
| * RoyK waves | 07:02 | |
| RoyK | pankaj: it doesn't help to repeat the question ;) | 07:03 |
| RoyK | !patience | 07:03 |
| ubottu | Don't feel ignored and repeat your question quickly; if nobody knows your answer, nobody will answer you. While you wait, try searching https://help.ubuntu.com or http://ubuntuforums.org or http://askubuntu.com/ | 07:03 |
| RoyK | pankaj: do you have a GUI on your server? | 07:05 |
| pankaj | RoyK: I am using desktop version. | 07:05 |
| pankaj | RoyK: I was doing it for fun and noticed that it was copying too slow. What might be the reason? | 07:06 |
| RoyK | no idea, I don't use a GUI for moving large data | 07:06 |
| pankaj | RoyK: Is this due to different file system? But I have never noticed it before. | 07:06 |
| RoyK | if it's faster on the commandline, no | 07:07 |
| RoyK | the GUI is just a wrapper | 07:07 |
| pankaj | RoyK: I was just asking that when I was copying the file why it was slow ( I did it using command line). I just wanted to know that what might have been the reason for this? | 07:10 |
| RoyK | pankaj: ok, it's slow on the commandline? | 07:11 |
| pankaj | RoyK: Yes, It was slow in command line. If I had done on GUI then I would have done faster. | 07:12 |
| pankaj | RoyK: I know that GUI is just a wrapper so that is why I am asking that why it was slow in cmd instead. | 07:13 |
| RoyK | pankaj: no, it wouldn't. the gui would definetely not be faster, probably slower, because of the overhead, but then, the gui may have some buffering | 07:13 |
| RoyK | so if you copy something over to that usb thing and then unmount it, perhaps you'll see it'll be sitting quite a while before it's unmounted | 07:14 |
| pankaj | RoyK: I told you that what it was noticing. | 07:14 |
| pankaj | RoyK: Somebody told me told me that the problem may have been due to buffering. | 07:15 |
| RoyK | what? the whole process being slower on the commandline compared to the gui including umounting or syncing in the gui? | 07:16 |
| pankaj | RoyK: Just copying the file was slower. | 07:17 |
| RoyK | I don't know what fancy styff they add in the gui to make things more comfortable, but it's not related to an ubuntu server | 07:17 |
| RoyK | pankaj: the I/O speed is the same | 07:17 |
| pankaj | RoyK: OK. what is the use od sync command | 07:18 |
| RoyK | man sync | 07:18 |
| RoyK | but seriously, there's no way a gui can speed up disk I/O compared to the commandline | 07:19 |
| pankaj | RoyK: ok | 07:19 |
| RoyK | I work a lot with linux and data storage and have done so for 20+ years, a fancy gui doesn't speed things up | 07:20 |
| RoyK | it may have buffering, though, which makes things look and feel faster, which is good in a desktop environment | 07:20 |
| RoyK | backgrounding the writing to the device | 07:20 |
| pankaj | RoyK: I wanted to learn C++ in linux but it is very different from what I did in windows world . Is their any good book or any good resource that you would suggest me for c++ in linux or some tips will be helpful. | 07:21 |
| RoyK | c++ is the same all over, it's just different libraries | 07:22 |
| RoyK | but C++ is the same across all platforms | 07:23 |
| pankaj | RoyK: Please sir any tips for it in linux world and where to find help for it for learing purposes. perhaps some of the best books you suggest. | 07:24 |
| RoyK | for c++? | 07:25 |
| pankaj | RoyK: Yes. I want to learn because I love programming. ABsolutely in favour of open source in this way. | 07:26 |
| RoyK | google is usually a fine place to start ;) | 07:26 |
| pankaj | RoyK: I know but sometimes I get mixed with so much resources and ideas. | 07:27 |
| RoyK | Bjarne Stroustrup's books on C++ are good | 07:27 |
| RoyK | seems "the bible" is available online now, for free, if I'm not mistaken https://github.com/BestSonny/materials/blob/master/The%20C%2B%2B%20Programming%20Language%20%5B4th%20Edition%5D%20-%20Bjarne%20Stroustrup.pdf | 07:28 |
| pankaj | pankaj: I read that book and I also used to practise a lot in my highschool. But beyond the basics I want to learn more. | 07:28 |
| pankaj | RoyK: I have learned till pointers and file handling and pointers. | 07:29 |
| RoyK | pankaj: Bjarne Stroustrup designed C++ ;) | 07:32 |
| pankaj | RoyK: Thanks for the link. I wanted to learn more but many books in c++ end after pointers, file handling, classes and inheritance. What after that? | 07:32 |
| RoyK | just read that book - it's long, but thorough | 07:33 |
| pankaj | RoyK: OK. | 07:34 |
| pankaj | RoyK: I want to tell you something. | 07:35 |
| RoyK | go on :) | 07:36 |
| pankaj | I dropped out from the collage 1 and half year ago because I love programming and I was sure that I could not learn it in the best way if I study there because programming and collage admissions has become busness here. | 07:38 |
| pankaj | pankaj: I love programming and really want to learn more about languages like c++ and web development. I have studied from many of the possible sources available free on the internet. So, I think that you can help me and guide on how can I study better. | 07:41 |
| RoyK | c++ for web? | 07:41 |
| pankaj | RoyK: No, I my extra time I learn HTML, CSS, bootstrap etc. But I am really interested in System like linux. I want to learn c++ mainly and want to help open source society by what I learn. | 07:43 |
| RoyK | nice | 07:44 |
| pankaj | pankaj: Just wanted a guide. | 07:44 |
| RoyK | keep in mind that a lot of OSS stuff on linux are written in C | 07:44 |
| RoyK | not C++ | 07:44 |
| pankaj | RoyK: OK. So, I have already learn the basics of c. I will surely practise more day and night to improve. But I do not know that how to get in the world of real development. A lot of this stuff is hidden from the basics that we used to do in schools. | 07:46 |
| pankaj | RoyK: I wanted to learn more then these file handling and pointers. | 07:47 |
| pankaj | RoyK: Hello | 07:48 |
| pankaj | I know that how to make small programs specially in linux by placing the file in /usr/local/bin and executing directly as on the path. But I want to learn more. | 07:50 |
| RoyK | pankaj: there's a lot of sources for learning things online - just google it - scripting bash etc | 07:56 |
| pankaj | RoyK: Hello | 07:57 |
| pankaj | RoyK: Hello | 08:03 |
| ybaumy | moin | 10:40 |
| === ashleyd is now known as ashd | ||
| else- | trying to use the ubuntu cloud image in virtualbox. can anyone tell me how to instrument cloud-init in order to set a password? i tried adding a floppy disk with user-data, but it doesn't seem to take effect. | 11:04 |
| else- | ah, so apparently floppy disk does not work and i need to use a disk instead. | 11:39 |
| gunix | my first ubuntu server tutorial is done: https://help.ubuntu.com/community/HALAMP | 12:31 |
| gunix | i feel proud :D | 12:31 |
| ducasse | gunix: fyi, that would belong in #ubuntu-discuss or #ubuntu-offtopic, not in the support channels | 13:00 |
| gunix | ducasse: thank you. i didn't know #ubuntu-discuss exists. what's the differance between discuss and offtopic? | 13:01 |
| ducasse | gunix: in practice, not much :) | 13:02 |
| === compdoc_ is now known as compdoc | ||
| === JanC_ is now known as JanC | ||
| Kyoku | Can anyone help with this please? http://paste.ubuntu.com/25510458/ my /boot is full and I can't purge old kernels | 22:13 |
| Ussat | https://askubuntu.com/questions/89710/how-do-i-free-up-more-space-in-boot | 22:19 |
| med_ | jamespage, dosaboy good to see you guys are out and about enjoying the Mile High City. | 22:19 |
| med_ | Welcome. | 22:19 |
| Kyoku | Ussat none of those methods are working | 22:31 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!