=== Guest8607 is now known as westor [00:13] Ubuntu 20.04 on a VPS. Where is an appropriate place to put self-compiled binaries that act as daemons (recieve connections from the internet). These programs don't require root, so I'd prefer to run them as their own user, but I'd like them to be able to be automatically started if the server reboots or goes down. What's the best way to go about accomplishing this for a complete noob? [00:18] /usr/local/bin is the traditional place for user complied stuff not managed by package distributions [00:42] tsapien perfect thank you. What's the best way to re-run them on server restart? Can I just 'sudo adduser --disabled-password --home /home/username username' then 'sudo su username' then 'crontab -e' and add the process I'd like to run as that user with @restart and it will start as that user after a reboot? [00:42] QuickBASIC_: create a systemd unit [00:42] ( .service file) [00:45] leftyfb Ah, thank you. I was struggling with search terms, so you've likely pointed me in the right direction. Can a systemd service start a .sh so I can pass parameters or can I include them in the 'ExecStart=' line? [00:45] yes [00:46] you pass the parameters in the ExecStart [00:46] Ah makes so much sense. Are systemd services running as root though? [00:47] QuickBASIC_: they can be, or you can run them as a user [00:49] Cool. Thank you so much. Now that I have some search terms I think I can figure out what I'm doing. === keypushe- is now known as keypusher [01:07] hey all [01:35] hi fella [01:41] When installing ubuntu on a 2 monitor setup, is there a way to tell ubuntu to prefer a monitor and to rotate it? I have the same issues with grub details on boot when all the userland settings are correct === [_] is now known as [itchyjunk] [01:51] @noarb have you messed with the Display settings already? [01:57] I haven't done anything before editing userland display settings after the machine has booted. Do I need to pass a boot param or something to get grub2 boot info on the right monitor and rotated correctly? I have a 2 monitor setup, 1 horizontal 1 vertical. Right now grub and installation are on the wrong monitor and rotated incorrectly [02:05] @noarb: go in `etc/default/grub`, check your resolution settings. comment out and/or edit what you need and then run `sudo update-grub` when you're done [03:31] tomreyn: things are back to being screwy [03:31] the resolv.conf got overwritten [03:32] maybe there was another systemd thing I had to disable [03:32] well anyhow it turned back into a symlink [03:32] * fmlatghor sighs [03:32] maybe I should just learn how to use systemd-resolved [03:33] What is cloud init and should I just disable it? [04:27] I am trying to build my own .deb packages for plymouth. So I downloaded the source (plymouth_0.9.4git20200323.orig.tar.xz and plymouth_0.9.4git20200323-0ubuntu6.debian.tar.xz) from packages.ubuntu.com. Then extracted plymouth_0.9.4git20200323-0ubuntu6.debian to ~/pbuilder and copied the other to ~/pbuilder. After that I ran `debuild -S -d -us -uc` [04:27] and `pbuilder-dist focal build ../plymouth_0.9.4git20200323-0ubuntu6.dsc`. But it is not generating any deb file. The first command generated lots of `ignored for deletion` warning. and the second one generated `pbuilder dependency error`. I am where I went wrong. [04:28] *correction I am unsure where I went wrong [04:31] Also If this is not the correct place to place this question, please refer me the correct channel. [04:50] Hey Guys! [05:31] webchat60: are you trying to contribute to ubuntu, or whats your endgoal? [05:47] webchat60: can't you just use checkinstall? [06:45] hi. i am the budweiser official monkey man of nigeria [06:45] i selling beers [06:45] pertho: welcome to FartLand [06:46] i sell bears [06:46] your mother has fungus in her cooch [06:47] much diseased [06:47] very smelly vagina [06:48] lotuspsychje Sorry for the delayed response. I am trying to make a customized ubuntu for persoanl use [06:49] Croran Can you please tell me the command [06:49] ? [06:50] I got an old Ivy Bridge laptop with a discrete Nvidia GeForce GT 650M card. In the old days, I used bumblebee/optirun (primus?) to use it. However it seems now you have to use prime-switch and a new nvidia driver. Only that it doesn't work on my old card. Any ideas? Is bumblebee still available? [06:51] !ops | sniffable bad news [06:51] sniffable bad news: Help! Channel emergency! (ONLY use this trigger in emergencies) - Pici, Myrtti, jrib, Amaranth, tonyyarusso, Nalioth, lamont, CarlK, elky, mneptok, Tm_T, jpds, ikonia, Flannel, wgrant, stdin, h00k, IdleOne, Jordan_U, popey, Corey, ocean, cprofitt, djones, Madpilot, gnomefreak, lhavelund, phunyguy, chu [06:52] The Holocaust is hoax [06:52] tnx [06:53] pertho: these these its nvidia-prime taking care of optimus cards, ubuntu-drivers list to see the drivers for your card [06:54] thanks lotuspsychje. Where's that list to be found? [06:54] pertho: in your terminal; ubuntu-drivers list [06:54] it's an older card and prime-switch nvidia makes the screen just go completely black when it boots.. I have to use the built-in intel chipset but the nvidia just for off rendering? [06:55] prime-select on-demand is useless.. nvidia-smi just says "not supported" [06:55] pertho: can you pastebin; sudo lshw -C video please? [06:56] sure hang on [06:57] lotuspsychje: https://pertho.net/pb/fDC5lfmo [06:58] 404 [06:59] sorry .. one sec [07:00] https://pertho.net/pb/avjxTDZ3 [07:01] pertho: yeah unclaimed means driver failed to load, lets have a look in your dmesg please? [07:02] when I 'modprobe nvidia' I get: modprobe: ERROR: ../libkmod/libkmod-module.c:838 kmod_module_insert_module() could not find module by name='off' [07:03] ah.. prime-select query is set to 'intel' [07:03] if I set it to 'nvidia' I get a black screen when I boot.. only way to fix is to ssh in and set it back to intel as root [07:03] on-demand does work though.. I think [07:05] when it creates the new initram disk, I see lots of these messages: W: Possible missing firmware /lib/firmware/i915/skl_guc_49.0.1.bin for module i915 [07:05] I'm guessing that's a linux-firmware packaging problem or something [07:05] Is there a GUI application that I can use to burn a windows ISO to USB? Googling lead me to WoeUSB, but I can't get it to run. [07:05] pertho: your intel graphics do get loaded, its only your nvidia module failing [07:06] pertho: more clues in your dmesg [07:06] I used to use an app called 'toaster', I think. But it isn't in the repos anymore. Maybe it doesn't exist anymore. [07:06] lotuspsychje: if I use prime-select on-demand and reboot, the nvidia module does load then [07:06] gparted is another option. But it's just overkill and too complicated [07:06] bobdobbs: woeusb [07:07] lotuspsychje: it won't run on my setup. I've tried to install it, but can't find the binary. If it installed, it didn't install in my PATH. [07:07] bobdobbs: try the snap woeusb [07:08] ah, ok [07:08] lotuspsychje: cool! snap search found it. I'll install it from there. [07:08] lotuspsychje: lshw output with 'prime-select on-demand' (after rebooting) https://pertho.net/pb/3sxQ3bfm and here's the dmesg of prime-select ondemand: https://pertho.net/pb/04KVCJqm [07:09] lotuspsychje: installing it from it's own repo is annoying. I couldn't find the command for it, and couldn't find the command to start it by googling. So frustrating! [07:09] pertho: ubuntu-drivers list please too? [07:11] lotuspsychje: https://pertho.net/pb/QYBf7i5b [07:12] nvidia-390 is what's installed [07:13] webchat60: well do everything to the normal build process except don't run make install [07:13] webchat60: run `sudo checkinstall` instead [07:13] webchat60: of course you need to install checkinstall itself first. it's in the ubuntu repos. [07:18] lotuspsychje: here's output of nvidia-smi: https://pertho.net/pb/BDRqiysN [07:19] Croran I already ran `dpkg-checkbuilddeps` and it returned `NULL`. [07:19] Seriously how do i get rid of these stupid pop-ups in Ubuntu. "! Software Updates Available" "Important OS and application updates are ready to be installed" "[Not Now] [View] [Cancel] [OK]" [07:20] webchat60: i don't know what that's supposed to do, and that's not part of the process as far as I'm aware. [07:21] hmm I wonder if I need to toggle on persistence mode [07:21] pertho: do you still have a previous non 5.11 kernel in your booting list? [07:22] lotuspsychje: I have a 5.8.0-43-generic [07:22] lets try that pertho [07:23] ok I'll try booting that up.. what should I look for afterwards? [07:23] ok, now that I'm running woe-usb, I'm not liking it. What alternatives are there? [07:23] pertho: that your 390 module is loaded correctly, sudo lshw -C video [07:24] bobdobbs: rufus [07:24] webchat60: do the recommended build process for your software. look at the README included with the tarfile. The last step described there is probably to do a 'sudo make install'. Instead of that do a 'sudo checkinstall'. You should end up with a .deb file. [07:24] Croran When I ran `dpkg-buildpackage -b -nc -tc` i am getting the following outputs https://termbin.com/mnkj [07:24] EriC^^: thanks! I'll check that out, [07:24] webchat60: I told you to use checkinstall, not dpkg-buildpackage. [07:25] bobdobbs: no problem [07:26] EriC^^: oh, it looks like rufus is a windows application. I'm looking for an app that runs on ubuntu. [07:26] lotuspsychje: https://pertho.net/pb/zxh6pHvn (5.8 kernel lshw -C video) [07:26] yeah seems like its working there pertho [07:26] EriC^^: like, I've downloaded a windows iso to my ubuntu machine, and I want to turn it into a bootable USB [07:27] lotuspsychje: in 5.11, nvidia-smi produced output, in 5.8, it gives an error: Failed to initialize NVML: Driver/library version mismatch [07:27] bobdobbs: i see, are you going to use it for UEFI or legacy MBR booting? [07:28] The ubuntu tarfile does not come with a readme. [07:28] uhm, I actually don't know. I guess it's been a while since I've done this. [07:28] NVRM: API mismatch: the client has the version 390.144, but this kernel module has the version 390.141. (on 5.8 kernel).. 5.11 does not produce this error [07:28] bobdobbs: will you be using it on your current pc? [07:29] pertho: could be due, your latest 390 mismatches and older kernel [07:29] EriC^^: ah, I see what you mean, I think. I want to make the USB so I can install windows on another machine [07:29] lotuspsychje: I'll boot back into 5.11.. the nvidia driver did load then [07:29] pertho: what i assume is your issue, we notice a lot of 5.11 bugs recently, might be a fault there [07:30] is there a way to fix the driver so it matches properly on 5.8? I'm just not sure how to tell whether it's actually using the nvidia discrete GPU [07:30] bobdobbs: how old is the hardware roughly? like 2010+ ? [07:30] (brb 10-15 min) [07:31] EriC^^: that I'm installing to? maybe about 2015. Relatively recent. [07:32] pertho: booting an older kernel was just for testing purposes, not adviced to daily driver anymore [07:33] bobdobbs: ah great, it should have UEFI support, what you want to do is create a fresh GPT partition table on the usb, and create a single FAT32 partition, mount it, then double click on the iso so the contents show, and copy the files to the FAT32 partition, it'll be bootable on UEFI, you'll have to enter the BIOS and switch the booting to UEFI enabled, or CSM legacy disabled [07:33] EriC^^: kk. From memory I can do that partitioning with gparted? [07:33] correct [07:33] :D [07:34] Croran With `sudo checkinstall` i got this [07:34] ========================= Installation results =========================== [07:34] make: *** No rule to make target 'install'. Stop. [07:34] **** Installation failed. Aborting package creation. [07:36] webchat60: what happens if you run 'sudo make install' instead? [07:42] webchat60: read the 'INSTALL' file that comes with plymouth. excerpt: "Plymouth isn't really designed to be built from source and get installed by end users. For it to work correctly, it needs integration with the distribution. Because it starts so early, it needs to be packed into the distribution's initial ram disk, and the distribution needs to poke plymouth to tell it how boot is progressing." [07:42] so probably no point in making a .deb file regardless. [07:45] I have read this. But my question is how Ubuntu creates the deb packages for plymouth and related? [07:47] lotuspsychje: will nvidia-prime work with my card or will I have to install bumblebee to get it working? [07:47] it is an older card/intel chipset (circa 2012).. laptop got a new lease on life when I installed a new SSD on it :) [07:47] EriC^^: oh crap. I think I did something to my main HDD [07:48] pertho: bumblebee is a depraced method, its nvidia-prime these days [07:48] bobdobbs: can you pastebin the output of "sudo parted -ls" ? [07:48] I closed gparted, but just before I closed it, I noticed that I was operating on a drive that isn't the USB [07:48] http://pastie.org/p/49RlfxDLvqIt4GPsVVxiMx [07:49] lotuspsychje: ok well, prime-select on-demand is the config that seems to enable both cards (prime-select intel just enables the intel chipset only, and prime-select nvidia just gives me a black screen) [07:49] but I have no way to know whether if I run, say, glxgears whether it's actually using the nvidia gpu === cacti is now known as ice [07:50] bobdobbs: the 2000gb one looks good, the 500gb one is empty, did you have stuff on it? [07:50] with bumblebee, at least I could do: optirun glxgears and it would run on the nvidia discreete graphics card [07:50] pertho: you need nvidia-settings to pick performance mode or powersaving mode [07:51] EriC^^: Yes, I did. I think I just accidently nuked it. However, that's ok. That was just a media bucket [07:51] EriC^^: serves me right for not taking a breath and being careful [07:51] EriC^^: I think I got off really lucky [07:51] I'd forgotten how risky this stuff was [07:52] I used to use an app called "toaster" it's main purpose was burning to CD and DVD's. I guess it doesn't exist anymore, cos nobody uses that old tech. But it was so easy to make bootable usb's with it. [07:53] you could probably track it down somewhere [07:54] bobdobbs: hmm so you have backups of the stuff, no problem? [07:54] EriC^^: yeah, it's no problem. Nothing really important there. [07:55] bobdobbs: actually it doesn't look like anything was formatted, you could probably get it right back to where it was at as if nothing happened easily [07:55] bobdobbs: do you happen to have an older pastebin of parted's output or fdisk/gdisk? [07:55] lotuspsychje: nvidia-settings can't save my settings.. if I select one, it prompts for authentication.. I put in my password and it fails [07:56] what is prime-offload? [07:57] EriC^^: I'm probably being a bit irrational, but I don't care abot that nuked data. I get fixated on stuff. Right now I'm fixated on making the bootable/installable USB. Probably because I remember that this used to be easy for me, and now I feel like I'm unfamiliar territory, so I feel like a clueless idiot. [07:57] No, unfortunately I didn't save a copy of the formatting information. [07:59] bobdobbs: ok, if you want let's get the USB ready, then restore the partitions on the 500gb [08:00] :) [08:00] bobdobbs: first, type "sudo gdisk /dev/sdc" [08:01] you have to recreate the partition table as GPT since it's msdos right now, and windows has a problem booting uefi if it's not GPT [08:01] http://pastie.org/p/6MN2VWLLsaOT2mqd52420X [08:01] bobdobbs: ok, type "o" and press enter [08:01] lotuspsychje: is /sbin/prime-offload meant to run when X starts? I see a script in /usr/lib/ubiquity/dm-scripts/oem/00-prime-offload and also /usr/share/lightdm/lightdm.conf.d/90-nvidia.conf .. so it seems to try to run prime-offload, but when I run it by hand I get: https://pertho.net/pb/rMFG9kd2 [08:01] bobdobbs: that should create a fresh gpt partition table [08:02] EriC^^: ok, 'p' now produces this: http://pastie.org/p/0qUQBzMAcp8oiec1eHpbB0 [08:03] bobdobbs: great, type "n" to make a new partition [08:03] "partition number" I guess I accept the default? 1? [08:03] yup [08:04] same for first sector and last so it uses all the space [08:04] EriC^^: ah, I was just about to ask that [08:04] bobdobbs: when it asks for the hexcode, put "ef00" [08:04] what does that mean? Is that an address? [08:05] bobdobbs: it's the partition type, in this case ef00 is for efi partitions [08:05] ah, I see. [08:05] this is the output of 'p': http://pastie.org/p/1CtPSfFA6ToTZ991lMPVmy [08:05] bobdobbs: great, type "w" to write it [08:06] cool. that's done [08:06] bobdobbs: ok exit the program with "q" iirc [08:07] then type "sudo partprobe /dev/sdc" so that the kernel reloads the new partition table [08:07] It dumped me out automatically after 'w'. The exit message: http://pastie.org/p/5Fh5nZYZZz5PXOqlUirDXR [08:07] looks good [08:08] so that's interesting: the kernal will still remember the previous data describing this drive? [08:09] yeah i guess it loads the partition table earlier, and after writing the new one to disk it has to re-read it [08:09] google tells me that partprobe informs the kernel of updates. Should I run partprobe? [08:09] yeah [08:10] http://pastie.org/p/6LGntkw3h4RP4raTqACkFS [08:10] that's the output from partprobe [08:10] I wonder if it would help if I just ejected the drive [08:10] bobdobbs: ah, it might be mounted, try "sudo umount /dev/sdc1" [08:11] from 'mount': "/dev/sdc1 on /media/mantis/7022-B1F2 type vfat" [08:11] so yeah, unmounting... [08:11] ok, try partprobe again [08:11] I also pulled the drive and and stuck it back in [08:12] k, partprobe returns with no message [08:13] bobdobbs: ok, type 'sudo mkfs.fat /dev/sdc1' [08:13] After re-inserting, my os makes a noise. But 'mount | grep sd ' doesn't show sdc* [08:13] and I can't see the drive in the GUI file manager [08:14] oh wait... but fdisk can see it [08:14] bobdobbs: what's the output of "lsblk"? [08:14] that mkfs command returned without error. [08:15] lsblk shows sdc/sdc1 [08:15] great, mount it and double click on the windows iso, and copy all the files to it [08:16] there should be a dir called 'efi' there so you know it supports uefi booting [08:16] sorry, silly question... where should I mount it to/ [08:16] anywhere? [08:16] bobdobbs: any place will do, i'd just click on the filemanager [08:16] kewl kewl [08:16] really appreciate this, btw [08:16] no problem [08:18] gaaaaah! [08:18] ? [08:19] EriC^^: As root, I mounted it at '/media/mantis'. Mantis is my username when I'm not root. Then I did 'chown -R /media/mantis'... [08:19] I did this as root. But the return from chown is "chown: changing ownership of 'mantis/': Operation not permitted" [08:20] bobdobbs: you don't want to change the permission of /media/user cause it has extra acl's there and stuff [08:21] oh. acl's. I've heard of those [08:21] access control lists? [08:21] bobdobbs: you dont need to chown anything, fat32 won't save the permissions anyways [08:21] yeah [08:21] ah, ok [08:22] lol. now I have to remember where I downloaded Windows to [08:22] ah, found it :) [08:23] :) [08:23] EriC^^: ok, as root I'm now copying windows to the device at the mount point. [08:23] now... inhaaaaaaaaaaaaling [08:24] breath bob. breath. [08:24] k, now what were you saying about enabling certain boot options on the target lappy? [08:25] yeah, enter the bios, set it to use UEFI and/or disable CSM legacy [08:26] bobdobbs: what kind of laptop is it, which brand? [08:29] It's an Asus. I'm hunting around for the model, but the light is kinda crappy in the zone it's in. [08:29] bobdobbs: my electricity just went out, running on the UPS currently so if i stop responding it's cause i disconnected, my nick won't though cause i'm using a bouncer, if it's an hp when the pc boots hit "f9" to get the boot options and choose UEFI usb, lenovo is f12 [08:29] bobdobbs: use f8 for asus [08:29] you really know your stuff [08:30] nah i googled asus :D [08:30] oh no! USB not big enough! That's weird: the file is 5.4G and I'm sure the USB is over 7G [08:30] doh [08:31] odd [08:31] I do have another unopened USB though. And I think I've got enough of a handle on the process to step though it myself [08:31] what's the output of 'df -h /dev/sdc1' ? [08:32] http://pastie.org/p/7CFYLM4GTXGaD9Ys1ihTYS [08:32] ls -alh says that the windows file is 5.5G [08:32] looks good it's just half full [08:33] hmm, that's odd [08:33] the cp operation errored out, saying "File too large". That is odd [08:34] bobdobbs: oh i see, you need to double click the windows iso to show its contents and then copy the individual files [08:34] the error is cause fat32 only supports 4gb max individual files [08:34] df -h returns http://pastie.org/p/758RPl0dzPDRvcrhmozYOt [08:35] hey, isn't there a block copy operation I can use? [08:35] is this a job for dd ? [08:35] bobdobbs: i'd erase the contents of /media/mantis first then copy the iso contents [08:35] ok [08:35] bobdobbs: no [08:35] ok [08:36] k, I've cleared out that USB [08:36] copy the contents of the iso? [08:36] you might need to open the filemanager with root permission to be able to copy/paste the contents [08:36] yeah [08:36] sudo -H should do the job [08:37] ok. lets give this a shot... [08:38] as for the 500gb lost partitions, it can be recovered pretty easily using testdisk, hopefully the electricity comes back in a few and we could do that if you want [08:38] that could be good :) [08:38] just for the learning in it [08:38] yup [08:41] EriC^^: ok, coping that iso file to /media/mantis now [08:41] sounds good [08:41] EriC^^: where are you at anyway? why is your power failing? [08:43] gah. The file manager is giving me the same error as cp did: "file too large". [08:44] I think nautilus must be using cp under the hood anyway [08:45] bobdobbs: electricity is back, im from lebanon [08:46] bobdobbs: did you double click the iso and show its individual files? [08:46] ah, no [08:46] doh! [08:47] ok, I'm gonna rm the usb contents and copy the iso contents [08:47] geez, I'm bumbling cos I'm so impatient tonight [08:47] too much coffee mayb [08:47] xD [08:49] uhm, I think I might have found the gui that makes this easy... [08:50] I right-clicked on the iso and the list of apps included something called 'brasero' [08:50] from memory, brasero is a tool that might be able to make bootable usb's [08:50] but I'm going ahead just copying the iso files anyway [08:55] EriC^^: I'm having trouble opening the iso. If I extract the file, only two files are extracted: a readme.txt and an empty folder [08:55] bobdobbs: i think it's for burning iso's to cds and stuff [08:56] I mean - I'm trying to extract the files using the file manager [08:57] bobdobbs: i think double clicking should mount it for you and you can open it as if it were the usb [08:57] should appear at the left of the file manager [08:57] double-clicking just opens up a new nautilus window showing the readme and the empty folder [08:58] ok, right-click gives me the option of opening the iso in the "disk image mounter". lets see what that does... [08:59] absolutely nothing [09:00] bobdobbs: ok, open a terminal and type "sudo losetup -f /path/to/windows.iso" [09:01] that command returns without errors or messages [09:01] bobdobbs: type "lsblk" you should see a loop at the bottom that has the same size as the iso [09:02] huh. I see three [09:02] loops 32, 33, 34 [09:03] bobdobbs: ok type 'sudo mount /dev/loop34 /cdrom' [09:03] done. returned without errors [09:04] cool! [09:04] try 'ls /cdrom' does it look like the windows iso? [09:04] I can see the files! [09:04] yep! [09:04] efi.. etc? [09:04] yes [09:04] ok great, type 'sudo rsync -av /cdrom /media/mantis/' [09:05] kewl [09:06] ok! copying in progress! [09:06] #feelsgoodman [09:06] :D [09:07] what a journey [09:09] still copying... [09:11] bobdobbs: after it's done, type 'sync' so it writes everything in cache to the usb then unmount and unplug the usb if you want [09:12] kewl. will do [09:12] hi [09:12] What is this? [09:12] I'm new to the whole linux thing [09:12] irc chat [09:12] ubuntu support channel on irc [09:13] Awesome [09:14] loop34 o_O [09:14] lots of snaps i guess :D [09:15] What are tar.gz files? [09:17] sapphire: compressed file archives. you're welcome to ask anywuestions here which a simple web search doesn't answer. [09:18] EriC^^: lol. rsync errored out with "file too large". lolololol [09:18] EriC^^: I've got a fresh usb in my drawer that is 16G. I'll just use that [09:19] bobdobbs: something's amiss [09:19] bobdobbs: type "ls -l /cdrom /media/mantis" [09:19] yeah? [09:19] the first fear that comes to mind: eroding hardware [09:20] nah earlier it was due to copying a single file, the error sounds like it, nothing about out of space [09:21] http://pastie.org/p/5v59M805kyUfZ7h2OnL999 [09:21] lotuspsychje: NVIDIA (Performance Mode) gives me a black screen when I boot up, Intel (Power Saving Mode) disables the nvidia driver.. the only time both GPUs are enabled is NVIDIA On-Demand [09:22] bobdobbs: try 'sudo cp -a /cdrom/!(sources) /media/mantis' [09:22] EriC^^: I've already put the new USB in [09:23] wait.. [09:23] ok [09:23] If I put the original one it, it will probably mount automatically [09:24] yeah [09:24] clicking in the filemanager and then lsblk should show the new mountpoint [09:28] lotuspsychje: something got kinda messed up.. glxgears now gives: Error: couldn't get an RGB, Double-buffered visual [09:29] lsblk shows those loops again [09:29] but the file manager isn't showing the USB. looks like it didnt mount automatically [09:30] I'll mount it manually [09:30] ok [09:30] oh no! sdc isn's showing under /dev [09:40] darnit, my os can't see either of the USB drives now [09:42] and gparted can only see the drive that we nuked earlier. It can't see anything else. [09:45] Hey all [09:46] Does anyone know to backup a directory from the command line in a way that does a snapshot? So like, I start backing up a directory that contains a database, and the database is being to written to while I am backing it up, but the backup I receive is the snapshot from when I started doing the backup. [09:52] Kolusion: you'll need a special file system (zfs, btrfs, others) or block device layer (LVM) to do this. [09:53] How is it done from there on? [09:53] LVM rings a bell [09:54] I read it is done with rsync [09:54] My understanding is rsync does not protect the files from being written to during backup. [09:55] I need something like shadow copy [09:58] Kolusion: even with a block-level snapshot, there is no guarantee the file-system is in a consistent state if there is active writing to open files at the same time [09:58] TJ: That's not true, such technology exists, on Windows at least. [10:01] Basically I just need to make a snapshot copy of a few directories while they are being written to during the backup process. [10:02] I checked out LVM, it doesn't seem to be the solution. From what I have so far read, it's for backing up entire volumes. I only need to backup a few directories. [10:03] Kolusion: Microsoft's VSS requires all applications to use the VSS APIs to achieve that; it isn't 'just' a block device level tool [10:03] ZFS or BTRFS are the prime candidates for file-level snapshots [10:04] Damn [10:04] That means needing to reinstall Ubuntu [10:04] That is not an option. [10:04] I take it then it's not possible on an default Ubuntu install? [10:07] you can create a BTRFS file-system inside a file via loopdev if it really is necessary. For databases though we usually run master/slave replicas (we use Postgresql with streaming WAL) to the secondary [10:18] TJ: That is too much effort for me. Yes, I am doing the same backup for my PostgreSQL as well. WAL allows for this. But I need a solution for my web and mail server files. [10:18] I want to snap all three at the same time. [10:18] Well no, with the database I am simply going to copy over the database directory. Not sure if this is a great idea. [10:18] stop the service, or make it stop writes, snapshot, restart the service / make it write again. [10:18] Exactly. [10:18] https://www.postgresql.org/docs/12/backup-file.html [10:18] i was speaking generally, not postgresql [10:18] Was hoping for a live way using some snapshot technology that isn't too hard for me to use. [10:18] yes; flush and freeze writes [10:18] Yes, generally as well. [10:18] TJ: What is flush freeze writes? [10:18] Kolusion: the actions required to safely snapshot the underlying files/block device [10:18] TJ: Yeah I get you. Kind of like that 'sync' tool yeah? [10:18] Kolusion: Flush all pending writes and finalise metadata, freeze any further writes until the snapshot is taken [10:18] Yes! [10:18] but in DB cases the DBMS needs to be told to do that [10:18] What is a DBMS? [10:18] DataBase Management System [10:18] https://www.postgresql.org/docs/12/server-shutdown.html [10:18] as in Postgresql [10:18] What is your opinion of the pg_dump tool? [10:18] that's the preferred method for single databases [10:18] Yes [10:18] Thing is, I want the time exact for the web and mail server as well. [10:18] mail shouldn't be a big issue, if the SMTP process creates 1 file per email [10:18] Yes, I will get big though one day. I want to be ready for it now. :) [10:18] and web-servers generally are read-only, leaving data storage to a database via whatever web application is in use [10:18] Yep === Exagone313 is now known as Exa === Nebraskka_ is now known as Nebraskka [10:18] we use things like DRBD to have real-time cross-network RAID mirrors for vital file-systems, Ceph is another choice there [10:18] It all sounds great, thing is it's too complicated for me and I don't have the time to learn it. [10:19] I was hoping rsync could do it but it can't, [10:19] rsync is a piece of cake [10:21] for mysql, there's innobackupex which you can use to reate hot backups using binary logs, then do PIT recovery from those (to the same mysqld version only) [10:21] i assume something similar will exist for postgresql [10:22] PostgreSQL pg_dump can do this, but the problem is I want to backup file directories of web and mails at the same exact time. [10:22] So I need something that executes outside of it so it can snap all of them together. [10:22]