[00:02] <conrmahr> yes it's UEFI
[00:02] <conrmahr> there's even a UEFI guide that you can run
[00:04] <conrmahr> my UEFI version is H97M Pro4 P2.00
[00:04] <conrmahr> by ASRock
[00:07] <JanC> I think meant GPT instead of UEFI
[00:08] <JanC> I think bekks meant GPT instead of UEFI
[00:08] <sarnold> conrmahr: normally "raid array" means "two or more disks"
[00:09] <conrmahr> yes
[00:10] <conrmahr> i had 2 WD 4TB HDDs Raided together
[00:10] <conrmahr> on a Synology NAS
[00:11] <conrmahr> Can I delete one of them on Ubuntu Server so I can transfer the backup HDD from the NAS to the Ubuntu Server HDD over the network?
[00:12] <nacc> conrmahr: your question is very confusing
[00:12] <nacc> coreycb: you had a 2-disk RAID array
[00:12] <nacc> coreycb: sorry
[00:12] <nacc> conrmahr: you had a 2-disk RAID array
[00:12] <conrmahr> yes
[00:13] <nacc> conrmahr: you have broken that array
[00:13] <nacc> conrmahr: and you want to install one of those 2 disks as an external drive on your server?
[00:13] <conrmahr> yes, but internal drive
[00:13] <nacc> conrmahr: ok
[00:14] <nacc> conrmahr: so to make the formerly RAID disk visible to your new system, you should just need to format it (partition table and all) and put a fs on it
[00:14] <conrmahr> i'm sick of Synology. I want to use Ubuntu Server.
[00:14] <nacc> conrmahr: but then I really don't understand the last question: "Can I delete on of them on Ubuntu Server so I can transfer the backup HDD from the NAS to the Ubuntu Server HDD over the network?"
[00:15] <nacc> conrmahr: a) delete one of "what" on Ubuntu Server?
[00:15] <nacc> conrmahr: b) transfer a HDD over the network?
[00:15] <conrmahr> ok I have about 3 TBs of data on HDD 1
[00:15] <conrmahr> and HDD 2 is a backup
[00:15] <JanC> backup?
[00:16] <nacc> conrmahr: RAID mirror or backup?
[00:16] <conrmahr> exact mirror
[00:17] <nacc> conrmahr: so ideally, you'd just plug in HDD2 (or 1) into your server and it would work, but it's formatted as RAID member?
[00:17] <conrmahr> so I want to take HDD2, delete everything and format it for Ubuntu Server, then over the network copy all the files from HDD1 with a network mount.
[00:17] <nacc> conrmahr: so if it's plugged into your server now, I'd expect you to be able to edit the partition table (fdisk, cfdisk, parted) and delete all partitions and create a new one
[00:18] <nacc> *new partition
[00:18] <conrmahr> I tried that but it didn't reconize because of the format that Synology uses.
[00:18] <JanC> Synology uses standard linux RAID AFAIK
[00:18] <nacc> conrmahr: why would you need to recognize the format that Synology uses?
[00:18] <conrmahr> ok
[00:19] <nacc> conrmahr: you're deleting all the partitions, afaict
[00:19] <sarnold> recognizing the format might allow skipping the repartition and reformat steps :)
[00:19] <conrmahr> when i do "sudo fdisk -l"
[00:19] <nacc> sarnold: that's true, but conrmahr seemed ok/resigned to that :)
[00:19] <JanC> actually, I guess his server recognizes the raid mirror & automatically starts it as a degraded RAID
[00:20] <JanC> or something
[00:20] <nacc> JanC: oh that could be ...
[00:20] <sarnold> JanC: ooh
[00:20] <JanC> that would explain the "in use"
[00:20] <nacc> JanC: didn't think of that
[00:21] <nacc> conrmahr: need to step away, sorry, but if JanC is right, you'll need to stop that case (possibly with mdadm)
[00:21] <conrmahr> what do i do after
[00:21] <conrmahr> actually looks like i got it removed
[00:21] <conrmahr> i don't see /dev/md127 anymore
[00:22] <conrmahr> i do i create a new primary partition after i type
[00:22] <conrmahr> $sudo parted /dev/sbd
[00:26] <conrmahr> so i did "(parted) print"
[00:26] <conrmahr> and it says the Partition Table: gpt
[00:26] <conrmahr> with no partition
[00:28] <sarnold> alright, now you've got to decide what you want the disk to do on ubuntu -- if you want to use mdadm to create a mirror, then format ext4, then copy data.. or use zfs to create a degraded mirror, add a filesystem, then copy data over..
[00:29] <conrmahr> So I just want it to store media files
[00:29] <Velus-universe> what is happening here E: Sub-process /usr/bin/dpkg returned an error code (1)
[00:29] <conrmahr> i have a 60GB SDD for just the Ubuntu OS
[00:31] <conrmahr> I"m just wanting to set up these 2 WD Red 4TB HDDs as secondary drives for a NAS.
[00:32] <JanC> conrmahr: you want to create a new RAID?
[00:32] <sarnold> Velus-universe: it means "look higher in the log to find out what the error is"
[00:32] <conrmahr> no, I just want to get this working and not lose my data.
[00:33] <Velus-universe> in what log
[00:33] <JanC> so you want both drives as separate disks in the end?
[00:33] <conrmahr> yes
[00:34] <conrmahr> Install them like they are fresh out of the box
[00:34] <conrmahr> with  nothing on it
[00:34] <JanC> well, if there is nothing on it, you also can't put files on it  ;)
[00:35] <sarnold> Velus-universe: the apt-get run
[00:35] <conrmahr> ha, true. But I was hoping to clean one, transfer the data over the network, then clean the next one and install it.
[00:35] <Velus-universe> ok its hissing about a folder missing
[00:36] <JanC> you'll need a partition & a filesystem, but you could also make it such that you have one filesystem spread over both, etc. (there are lots of options...)
[00:37] <Velus-universe> http://pastebin.com/e0Jk8GcX that is the log with it
[00:37] <conrmahr> when you say file system, you mean like OS?
[00:37] <JanC> no, the filesystem is what remembers which file, directory, etc. is where on the disk
[00:37] <JanC> like ext4, NTFS, FAT32, etc.
[00:38] <sarnold> Velus-universe: check dmesg to see if you have errors, from the scsi layer or memory problems..
[00:38] <conrmahr> oh right
[00:38] <sarnold> Velus-universe: something like dmesg | tail -30   ought to be enough to give you an idea if there's anything serious
[00:38] <conrmahr> so would you recommend NTFS if I was sharing it with other Mac and PC computers?
[00:39] <JanC> if you mean sharing over the network, then no
[00:39] <sarnold> what do you mean by "sharing it with"?
[00:39] <conrmahr> yeah sharing over the network
[00:39] <conrmahr> i want to make the device a NAS/Media Server
[00:39] <Velus-universe> http://pastebin.com/wJ7Y88i1
[00:40] <sarnold> Velus-universe: good
[00:40] <sarnold> Velus-universe: check df -h  -- are any filesystems at 100%, or close to it?
[00:41] <Velus-universe> nope all 1 or 2 %
[00:41] <Velus-universe> or 0 %
[00:41] <sarnold> Velus-universe: alright, try apt-get install -f
[00:42] <Velus-universe> http://pastebin.com/TQ62TRZB
[00:42] <JanC> might also be useful to check df -i
[00:43] <Velus-universe> same all 1%
[00:44] <sarnold> JanC: definitely good idea, it's something I overlook all the time..
[00:44] <conrmahr> so any recommendations on the filesystem for NAS?
[00:45] <JanC> conrmahr: it all depends on how you want to use it, how much RAM you have, what Ubuntu version this is, etc.
[00:45] <JanC> and the type of files too
[00:45] <conrmahr> only 8GB DDR3 now
[00:45] <sarnold> conrmahr: i'm partial to zfs; it provides compression, mirroring, snapshots, and other cool features; see https://pthree.org/2012/12/04/zfs-administration-part-i-vdevs/ for a great series of blog posts that describe it well
[00:46] <conrmahr> but will upgrade to 16GB later
[00:46] <JanC> and you could later add the second drive to the same filesystem with ZFS
[00:46] <conrmahr> basically a lot of mpg, mkv files for TV and Movies
[00:46] <Velus-universe> i wonder why this aint working then
[00:46] <conrmahr> that I will run Plex Media Server over
[00:47] <sarnold> Velus-universe: I'm not sure. the next step is to save aside your dovecot configuration if you hve any, apt-get purge the docvecot package, then apt-get install the package again
[00:47] <Velus-universe> hwo do i patget purge
[00:48] <Velus-universe> and also i got rid of the dovecot to start again
[00:48] <sarnold> "apt-get purge dovecot" should do it
[00:48] <Velus-universe> im still getting the problems
[00:50] <Velus-universe> ok i rmeoved dovecot-lmtpd and it worked now
[00:50] <conrmahr> so is zfs easy to use for a noob?
[00:51] <sarnold> conrmahr: I think it's easier than mdadm or lvm
[00:52] <sarnold> probably nothing comes close to the ease of the synology
[00:53] <conrmahr> well once i have it set up i should be golden
[00:54] <conrmahr> I worked on RHEL and Ubuntu VPSs for web development
[00:55] <conrmahr> but never had to install hardware
[00:57] <conrmahr> where's the zfs ubuntu repo? This looks like Debian.
[00:57] <sarnold> heh, I know the feeling, I've used linux for years, but only installed it a few times. the installer ...
[00:57] <sarnold> conrmahr: in xenial, zfs is included; in wily, it's done via dkms packages. earlier than that, and you'll want to use some pakages from a PPA instead
[00:59] <conrmahr> i have 14.04.4, is that xenial?
[00:59] <conrmahr> so i can just do apt-get?
[00:59] <sarnold> that's trusty
[00:59] <conrmahr> what's PPA?
[01:00] <sarnold> a personal package archive; in this case, darik horn has zfs packages built for precise, trusty, and wily here https://launchpad.net/~zfs-native/+archive/ubuntu/stable
[01:01] <conrmahr> gotcha
[01:03] <JanC> alternatively, you could try installing Ubuntu 16.04 (xenial) beta instead
[01:03] <sarnold> that's what I did last week with my new computer
[01:03] <sarnold> so far so good
[01:04] <JanC> final release of 16.04 should be in two weeks, I think
[01:04] <sarnold> it only took two or three minutes to set up my nine-drive zfs array
[01:05] <JanC> nice  :)
[01:12] <conrmahr> which zfs package should i install for trusty
[01:12] <conrmahr> zfs-fuse?
[01:12] <sarnold> no, skip that
[01:12] <conrmahr> i installed the ppa repo
[01:12] <conrmahr> don't i have to install the package?
[01:13] <sarnold> you do, but zfs-fuse is an ancient and terrible thing
[01:13] <conrmahr> oh
[01:13] <sarnold> install zfs-linux -- hopefully that'll install whatever else it needs
[01:13] <conrmahr> how about ubuntu-zfs?
[01:15] <sarnold> that might install everything from his repository in one go; using zfs for the / filesystem is a bit difficult, I wonder if that packge exists to help the zfs root case..
[01:16] <conrmahr> i did a apt-cache search
[01:16] <conrmahr> and it says
[01:16] <conrmahr> ubuntu-zfs - Native ZFS filesystem metapackage for Ubuntu.
[01:17] <conrmahr> zfs-dkms - Native OpenZFS filesystem kernel modules for Linux
[01:18] <sarnold> might as well go with ubuntu-zfs. it'll probably do the right thing.
[01:19] <conrmahr> done
[01:20] <conrmahr> so can you walk me through how to create a new filesystem and partition?
[01:20] <conrmahr> with parted right?
[01:20] <sarnold> zpool create -n /dev/disk/by-id/.... --- pick the device name for the 4tb drive
[01:20] <sarnold> zpool create will know how to partition and format the disk
[01:21] <conrmahr> oooh
[01:21] <conrmahr> i like i like
[01:21] <sarnold> dang, i've got to take off in a minute..
[01:21] <sarnold> the -n is a no-op mode, to make sure it looks fine
[01:21] <sarnold> take it off if you like the way the command output looks
[01:21] <sarnold> and re-run it..
[01:21] <conrmahr> FRIDAY NIGHT!
[01:22] <conrmahr> ok
[01:22] <sarnold> ah I got the command wrong, "zpool create -n poolname /dev/disk/by-id/..."
[01:23] <conrmahr> so if the disk is /dev/sdb
[01:24] <conrmahr> it would be "zpool create -n poolname /dev/sdb"
[01:24] <conrmahr> do i have to create a poolname?
[01:25] <sarnold> the downside to the shortname /dev/sdb rather than /dev/disk/by-id/ata-WD_..... is that the long name shouldn't change; hte short name can change based on which drives are brought up first by the bios or os
[01:25] <sarnold> yeah, a lot of people pick 'tank' or 'pool' or 'srv'
[01:25] <patdk-lap> heh
[01:25] <patdk-lap> aggr :)
[01:25] <sarnold> aggr? never seen that one before :)
[01:25] <patdk-lap> netapp
[01:25] <sarnold> ahh
[01:26] <conrmahr> i can find the long name right?
[01:26] <patdk-lap> export and import it
[01:26] <sarnold> conrmahr: alright, after that, "zfs set compression=lz4 poolname  ; zfs set atime=off poolname ; zfs set checksum=sha256 poolname ; zfs create poolname/movies ;  zfs list"    :)
[01:26] <sarnold> patdk-lap: good point.
[01:26] <sarnold> conrmahr: time to run, have fun :)
[01:27] <patdk-lap> why checksum sha256?
[01:27] <patdk-lap> that would make it slow
[01:27] <sarnold> because I trust it more than fletcher4
[01:27] <conrmahr> i like trust
[01:27] <patdk-lap> sure, it's *better*
[01:27] <patdk-lap> but the level of difference is really small :)
[01:27] <sarnold> actually
[01:28] <patdk-lap> have to have an ecc error from the disk first
[01:28] <conrmahr> i do need my p0rn fast though
[01:28] <sarnold> ... conrmahr if you're not going to have any redundancy anyway, you don't need the better checksum. heh.
[01:28] <sarnold> patdk-lap: hmm. I hadn't thoght about that.
[01:28] <conrmahr> so like later
[01:28] <patdk-lap> I would keep with default checksum, unless your going attempt dedup
[01:28] <conrmahr> when i add the 2nd drive
[01:28] <conrmahr> and i just want to clone it
[01:28] <sarnold> patdk-lap: .. is that why pool scrub runs at only 400 MB/s? :)
[01:29] <conrmahr> would i just do an rsync?
[01:29] <patdk-lap> sarnold, no
[01:29] <patdk-lap> that more has to do with iops
[01:29] <patdk-lap> and well, transaction sizes
[01:29] <patdk-lap> so much metadata to read and verify per block of data
[01:30] <patdk-lap> well, figured out why some of my disks are going so slow :(
[01:30] <patdk-lap> 3 bad bbwc
[01:30] <sarnold> conrmahr: you'll use "zpool attach". DO NOT USE ZPOOL ADD. write that down.
[01:30] <patdk-lap> and 4 bbwc without any ram installed
[01:30] <sarnold> patdk-lap: awwww
[01:30] <sarnold> ouch
[01:31] <patdk-lap> I never put any workloads on them before I setup this test
[01:31] <patdk-lap> so didn't notice or really care
[01:31] <conrmahr> where does it say zpool add?
[01:31] <sarnold> conrmahr: the zpool manpage.
[01:31] <patdk-lap> zpool add = making raid0's
[01:31] <sarnold> conrmahr: it's way too easy for people to screw this up :) I've seen three people make that mistake already...
[01:32] <patdk-lap> had an l2arc die monday :(
[01:32] <patdk-lap> caused the server to panic
[01:32] <sarnold> patdk-lap: awwwww :(
[01:32] <sarnold> yikes
[01:33] <patdk-lap> but that was illumos though
[01:34]  * patdk-lap wonders if it is worth attempting to use luster
[01:34] <patdk-lap> so far, gluster has been horrible
[01:34] <patdk-lap> or, lustre
[01:36] <conrmahr> so i ran everything
[01:36] <conrmahr> i get cannot open 'data1'; dataset does not exist
[01:36] <conrmahr> that was my poolname
[01:36] <conrmahr> oh creat
[01:36] <conrmahr> crap
[01:36] <conrmahr> i didn't remove the -n
[01:37] <conrmahr> what's this command?
[01:38] <conrmahr> zfs set attime=off data1 ;
[01:38] <conrmahr> it errors out
[01:38] <patdk-lap> one t
[01:38] <patdk-lap> atime, not at time
[01:38] <conrmahr> beautiful
[01:41] <conrmahr> now i just need to transfer the files!
[01:41] <patdk-lap> rm does that good, really quick too
[01:41] <conrmahr> that's a joke right?
[01:41] <patdk-lap> :)
[01:42] <conrmahr> how about rm *
[01:47] <conrmahr> oops, meant to put it here
[01:48] <conrmahr> would you use "$ cp" to move 3TBs of data?
[01:48] <patdk-lap> what is it?
[01:48] <conrmahr> media files
[01:48] <conrmahr> i mounted the network drive to /mnt
[01:48] <patdk-lap> rsync -avwP --inplace, should do it nicely
[01:49] <patdk-lap> the v and P are optional
[01:49] <conrmahr> what's the directories look like
[01:49] <patdk-lap> two directories?
[01:49] <conrmahr> i mean which is first and second
[01:49] <patdk-lap> source dest
[01:49] <patdk-lap> put a / on the end, if you don't want it to copy the source folder itself
[01:49] <patdk-lap> but just stuff in it
[01:50] <conrmahr> and what are the v and P do?
[01:50] <patdk-lap> v shows you the files as it copies
[01:50] <patdk-lap> P gives you progress per file
[02:57] <Velus-universe> patdk-lap, i have not got soem of it working by my dovecot wont start and i get nothing in the logs
[04:31] <wsirccc__> can anybody help which preseed scenarios are possible. Managed a working cl with virt-install, local preseed.cfg and remote network install. 1) Do not know if preseeding is possible with local iso and 2) do not know, what if in front of a physical computer. tia
[05:06] <wsirccc__> can anybody help which preseed scenarios are possible. Managed a working cl with virt-install, local preseed.cfg and remote network install. 1) Do not know if preseeding is possible with local iso and 2) do not know, what if in front of a physical computer. tia
[08:46] <ratrace> Hello. Alt-tab between windows. Which program/package is responsible for that behavior? Unity or Compiz?
[08:46] <ratrace> eh... sorry, wrong chan.
[09:57] <mohanadvoxo> hello can anyone help me ?
[10:00] <mohanadvoxo> http://paste.ubuntu.com/15706982/
[17:01] <conrmahr> JanC: Thanks a million for your help.
[17:02] <JanC> helping is what we are here for  :)
[17:02] <conrmahr> Currently ryncing data to drive
[17:05] <conrmahr> patdk-wk: thank you too.
[17:25] <wsirccc__> is there anybody with any experience with unintended install?
[17:48] <ratrace> wsirccc__: unintended? or unattended?
[18:16] <wsirccc__> ratrace
[18:16] <wsirccc__> ratrace: the latter.
[18:22] <ratrace> wsirccc__: does this help? https://help.ubuntu.com/lts/installation-guide/armhf/apb.html
[18:22] <ratrace> wsirccc__: oops, sorry, this link: https://help.ubuntu.com/lts/installation-guide/amd64/apb.html
[18:28] <wsirccc__> well one could discuss differences with debian https://wiki.debian.org/DebianInstaller/Preseed#Adding_the_preseed_file_to_the_installer.27s_initrd.gz
[18:28] <wsirccc__> What is different to debian? Then I understand easier.
[18:28] <wsirccc__> ratrace
[18:28] <wsirccc__> ratrace:
[18:28] <ratrace> I don't know what is different to debian.
[18:30] <ratrace> Unless you were referring to this? https://help.ubuntu.com/community/AutomaticSecurityUpdates
[18:30] <ratrace> unattended upgrades...
[18:33] <wsirccc__> no I want to atomate the install for any use cases, under standing the methods and unittest them,
[18:35] <wsirccc__> https://github.com/qemu-buro-point-dpkg/qemu-buro-point-dpkg/tree/master/qemuburo
[18:35] <wsirccc__> really
[23:28] <FManTropyx> ok, I tried to reboot my virtual server, but after disconnecting me it just hanged