/srv/irclogs.ubuntu.com/2018/10/29/#ubuntu-server.txt

cpaelzer_good morning05:54
=== cpaelzer_ is now known as cpaelzer
=== admcleod_away is now known as admcleod
=== elsheepo is now known as beatzz
ahasenackgood morning11:21
kstenerudahasenack o/11:30
ahasenackhi kstenerud11:30
fricklercan someone remind me of the URL for the version check matrix for UCA packages? somehow this has dropped from my list of bookmarks11:57
ahasenackcpaelzer: did you see my last comment on https://code.launchpad.net/~ahasenack/ubuntu/+source/cyrus-sasl2/+git/cyrus-sasl2/+merge/357779 ? Probably lost somewhere in your inbox storm11:59
cpaelzerahasenack: I didn't see that yet12:26
cpaelzerhmm12:26
cpaelzerlet me check if I see it in the ppa conf where I thought it was in the past12:26
ahasenackit's what prompted my emailing about bileto usage12:26
cpaelzerI'm sure I have seen valid xenial tests12:26
ahasenackwell, they pass with other packages12:26
ahasenackbut if you look there, they are also including the phone ppa12:27
cpaelzeroh, I see12:27
ahasenackit just so happens that none of the needed packages come from there12:27
ahasenackthese two tests that are failing use qt packages12:27
ahasenackand apparently the phone has/had such packages at a higher version than xenial12:27
cpaelzersince most of the overlay was UI centric it makes sense that it is qt12:27
cpaelzerbut OTOH most of our cases don't hit those bits12:28
ahasenackcorrect12:28
cpaelzerso unless most tests have issues I'd go on and consider this one an unlucky special case that needs manual tests12:28
cpaelzeras said on the mail thread12:28
cpaelzerbut I'm still pretty much in favor of testing pre-upload12:28
=== Pici` is now known as Pici
smoserhttps://code.launchpad.net/~smoser/usd-importer/+git/usd-importer/+merge/35782615:08
smoserrbasak: ^15:08
rbasaksmoser: it is merged, but Launchpad is behind15:32
rbasakhttps://git.launchpad.net/usd-importer/log/15:32
rbasaksmoser: it should be in edge15:32
smoserhm. i'd never seen launchpad behind.15:42
kklimondais there some documentation on running ubuntu core on bare metal servers, or is it not at that point yet, and still mostly focused on IoT?16:59
ahasenackcpaelzer: are you still looking at https://code.launchpad.net/~ahasenack/ubuntu/+source/cyrus-sasl2/+git/cyrus-sasl2/+merge/357779 ?17:01
GumaI just reinstalled my server and desktops to 18.04. I was wondering if there is a way to point all my desktops to my server for updates? The ideas is that I want all my desktops update to latest what is on server in order to keep my desktops on same level.17:53
josefigHi, I have installed Ubuntu server 18.04 for LTSP server, I already installed everything but there's left the dnsmasq  someone has information how to set it up with 2 NICs ?17:56
lotuspsychjeGuma josefig idle here a bit ok, we having a bit of timezone glitch atm :p18:10
josefighehe no worries, in the meanwhile i'm reading you know18:15
josefigI think it has to be with the second NIC, the first is connected to internet properly18:15
=== nacc_ is now known as nacc
RoyKGuma: setup an apt mirror on the server and configure the desktops to use that server as an apt source18:25
RoyKGuma: or if your internet connection is good, just use unattended-upgrades to have them upgraded automatically as often as you wish18:26
GumaRoyK  I never done this. Do you have some link to document waling me through it? Thank you so much18:26
RoyKGuma: first hit on google https://www.howtoforge.com/local_debian_ubuntu_mirror18:27
GumaGreat. I will try. Thank you for getting me started18:28
RoyKgood luck :)18:29
GumaOne more thing. I have my own deb packages that I am creating. This is for company I am working on. They are private deb packages and also looking at hosting them privately18:29
RoyKGuma: again - google says https://wiki.debian.org/DebianRepository/Setup18:30
GumaOk that will get me going. :)18:30
RoyKGuma: http://jfgi.herokuapp.com/images/bart.gif ;)18:31
GumaRoyK Fair enough. I always do. But in this case I was not sure where to start. Now I know. Cheers18:32
sarnoldGuma: you can also set up a squid-deb-proxy if you don't want to spend a terabyte of disk space on a mirror18:39
cpaelzerahasenack: I was fine with the cyrus fix given that you tested locally where the bileto test failed18:41
ahasenackcpaelzer: ok18:44
JanCnowadays a terabyte isn't all that much, of course  :)18:47
lotuspsychjeJanC: did you buy that 15tb WD? :p18:49
JanCno18:50
josefigIf I'm trying to boot PXE and I get  "DHCP packet received on enp3s0f1 which has no address" could be because of the network card has not IP assigned, even if I did a static declaration when I do a ip addr i don't see the ip. Why is that? or How is the correct procedure to do this ?19:24
RoyKjosefig: do you have a dhcp server on that thing?19:28
ahasenackyeah, check if the server actually offered an ip19:28
ahasenacki.e., server logs are also useful19:28
tomvolekHI : I am trying to install Ubuntu from USB on a HP proliant server , I get a message "parition /de/sda1 assigned to / starts an offset 565248 bytes from minimum alignment for this disk" ,     is this a question for this group or the Ubuntu channel ?19:33
tomvolekEntire install disk is partitioned to one partition / and a swap .19:34
sarnoldheh, that's a funny number.. 8192 * 6919:36
xnoxtomvolek, with UEFI or eithout UEFI?19:37
tomvoleksarnold: Some folks on the net mention you need to format the USB to make sure it does not use 512 byte sectors by default and increse it to 2048 , So I did that, used disk utility on mac to increase sectors on usb to 2048 so it would match linux.19:37
xnoxtomvolek, also there should be either grub-bios slice inserted or an UEFI ESP partition.19:37
tomvolekxnox Sorry where does UEFI comes into play ?19:38
tomvolekxnox  what do you mean by grub-bios slice inserted ?  inserted where ?19:38
xnoxtomvolek, well, if the server is booting using UEFI, you also need an ESP partition formatted as EFI.19:39
tomvolekI tried to keep thigns simple and created only one parition with swa19:39
xnoxtomvolek, are you using automatic partitioning, or manual?19:39
tomvolekmanual sir19:39
xnoxtomvolek, and if you are booting using BIOS one needs to create a grub-bios partition (not sure if that is done automatically, even in manual mode)19:39
tomvolekon the ubuntu install screen, it allows you to reparition and I remove all previous partitions and recreate a root and a swap19:40
xnoxwell, without ESP (UEFI) or grub-bios (BIOS) you will not be able to install grub, and will fail to boot.19:40
xnoxtomvolek, can you first try to use automatic partitioning to wipe and install? before playing with manual?19:41
tomvolekxnox, i certainly did not create a seperate parition grup-bios ...   how much space should allocate tot that... I never had to do that on my other installs :)19:41
tomvolekxnonx .. sure, how do i do that ?19:41
xnoxtomvolek, i know the details because that's what the backend code does. But i'm not sure if we actually show this in the UI or not. Cause it is fairly minor details, the grub-bios is very tiny, like a few kB after mbr19:42
tomvolekxnox.. I am booting from a usb stick , ubuntu 16.04 ...  on an older HP DL 365 proliant ..19:42
xnoxtomvolek, reboot installer, hit enter, until done.19:42
xnoxtomvolek, at partitioning choose to "automatically partition the whole disk" or some such.19:42
xnoxtomvolek, when done boot and checkout what partitioning layout is created, start/alignment, etc.19:43
xnoxtomvolek, most likely first partitionin does not start at 0. And it's safer if one starts it at like 4MB to be honest.19:43
xnox(if one is manually partitioning things)19:43
tomvolekxnox,  installer will detect whatever partition its on the disk already and present it,  interesting it does not present me with option to partition automatically or manully,  it displays the error I mentioned above and forces me to go back and try to delete the partions it detects on disk and recreate ....hence i get into this loop :)19:44
xnoxah19:44
xnoxeven when you reboot the installer, right? (it can mess up its own state machine)19:44
tomvolekits very intereting, i have installed lots of Ubunut , never seen this before19:45
xnoxtomvolek, can you drop to shell, and delete things manually? the drive might have odd things leftover which installer fails to clean maybe?19:45
xnoxlike incomplete signatures of incomplete LVM groups, or parts of RAID, etc?19:45
tomvolekI do a hard reboot,  recycle power on BIOS I set to boot from USB,  it detects USB, boots inot instller . i take option to install, it asks for my time zone and then comes into this parition issue and stops19:45
xnoxctrl-alt-f4 should give you a terminal, or something19:45
xnoxhm, sad.19:46
tomvolekxnox , ok i will try, I can go into a command line and start gparted ,, and remove all partitions, then reboot and come back into installer and see if this time i can do automatic partitioning ...19:47
tomvolektoo much of my time is getting waisted on this one lab server :)19:47
xnoxtomvolek, yeap.19:47
ahasenacksgdisk -Z <device>?19:47
ahasenackthat erases it19:47
tomvolekok let me try ..tx for suggestion .. stand by :)19:47
xnoxif there is sgdisk available.....19:47
xnoxtomvolek, also why use 16.04? and not 18.04?19:47
xnoxthe installer in 18.04 is well lit.19:47
tomvoleknot sure, i am using ubuntu 16.04 stock on the USB19:47
ahasenackthat is two years old19:48
xnox18.04 has less screens, asks less things, does the installer quicker, and can even import ssh keys from launchpad or github.19:48
tomvolekxnox, reason is there is a bug in 18.04 with a graphich device driver :)  , so i have to install 16.04 and then upgrade to 18.04 ... thats another long story :)19:48
ahasenackis this a desktop?19:49
tomvolekyes sir19:49
xnoxoh19:49
xnoxtomvolek, given the channel, i assumed you are trying to install Ubuntu Server19:50
xnoxtomvolek, do you have internet? whilst you are in this broken state, could you please do $ ubuntu-bug ubiquity ?19:50
xnoxand open a bug report, that would give me all the right logs.19:50
xnoxtomvolek, and yeah sgdisk should work to unbreak you.19:50
xnoxtomvolek, i typically use $ wipefs --all /dev/disk/by-id/*19:52
tomvolekxnox,  i wasnt sure where to post my question thats why i asked at the start. Let me try sgdisk and report back . thanks guys19:52
xnoxor use the disks app to format the drive.19:52
xnoxtomvolek, it's all good =)19:52
tomvolekok i back out of install and on the screen which says try Ubuntu , from here I should be able to get gparted or cmdtool started19:53
tomvolekFYI: this host has Raid 1+0  , two 146 G drives ..19:53
xnoxhmmmm19:54
xnoxtomvolek, but what raid is it? hardware raid? intel matrix raid? does it need drivers?19:54
xnoxtomvolek, it's a bit odd installing desktop on a server =)19:54
xnoxtomvolek, i would go the other way around, of using server installer, and then installing desktop with $ apt install ubuntu-desktop19:55
tomvolekxnonx  ok thats a great suggestion,19:55
xnoxlet's just say desktop installer, might not be expecting raid devices =)19:55
tomvolekok it has gdisk ...19:55
tomvolekcould be ...19:55
xnoxif you can bring networking up; you can use $ apt update; apt install19:56
xnoxto get whatever you need.19:56
tomvolekyes, I am conected to network .. dhcp ..19:56
tomvolekwhat shoudl i say to gdisk options19:56
tomvolekgdisk -Z /dev/sda19:57
tomvolekinteresting when I start gparted , it displays a message saying "The driver descriptor says teh physical block size is 2048 but Linux says its 512 bytes "20:00
xnoxand /dev/sda ... is that usb stick you are booted from?20:02
xnoxor the drive you are trying to install onto?20:02
xnoxi typically check $ ls -latr /dev/disk/by-id/*20:02
xnoxto make sure i know for sure who is who20:02
tomvolek@xnox @ahasenack : reporting back,  I used gdisk , wiped out the hard drive, tried to reinstall, this time I selected LVM vs manually partitioning.  Install is going forward at the moment, seemed like this worked :)  thanks again for your suggestions.20:59
Glorfindelhey all, ubuntu server 16.04 running on my vps, I'm having issues with some of my applications not running, complaining of no storage space left. I have 50gb and ncdu shows 16gb has been used. is there a limit to what percentage of storage can be used in the /home/ dir?22:47
Glorfindelif I try to install anything it also complains of no storage space left... weird :/22:50
cryptodan_mobileRun df -h22:51
tomreynand df -i22:51
cryptodan_mobileCopy to dpaste.com share link22:52
RoyKGlorfindel: check cat /proc/sys/fs/file-max and cat /proc/sys/fs/file-nr22:53
Glorfindelcryptodan_mobile, tomreyn: here's each http://dpaste.com/0208Y7W22:54
RoyKsome applications open a *lot* of files and thus the max can be reached22:54
GlorfindelRoyK: pretty new to linux, check them for what?22:54
tomreyninodes are full on /22:54
JanCyou might be out of inodes...22:55
tomreynsudo find / -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n22:55
RoyKbetter use xfs next time ;)22:55
Glorfindelso basically I have too many folders?22:56
RoyKfolders are files22:56
Glorfindel*dirs22:56
JanCyou can configure inodes when creating the FS22:56
RoyKan inode points to a files or a folder and you have three millions of them22:56
JanCthe number of inodes22:57
RoyKusually 3M files won't happen with such a small fs22:57
JanCI don't think you can change it afterwards for ext3/ext4?22:57
RoyKyou can't22:57
tomreynyou'd use the line i posted above to identify what consumes them mostly, then move those files to a new file system (optionally one with extra inodes)22:58
JanCit might be email or something like that...22:59
Glorfindeltomreyn: ahh, I see. I actually know what is using them up... the ls -R stream it generates almost lagged me out22:59
Glorfindelit's the tileserver I installed22:59
JanCah, that seems a possibility too if it stores each tile in a separate file22:59
tomreynit should probably not be on /, and maybe be backed by a DB.23:00
JanCa filesystem is a database too  :)23:00
tomreynif a file system then most likely a separate file system with different mount options and extra reserved space23:01
Glorfindelok, so if I understand this correctly; an inode is what stores the data about what files to show if a user is looking in a specific directory, right? and I ran out of those somehow?23:01
JanCno23:01
RoyKGlorfindel: what are you storing on this to get that amount of inodes?23:01
GlorfindelRoyK: I am hosting a minetest server, and I installed a tileserver that reads the minetest database and generates a real-time map of the world23:02
Glorfindeland it created a lot of directories to store tiles in I guess, not 100% on that23:02
RoyKGlorfindel: ok - so millions of small files?23:02
Glorfindelyeah23:02
JanCinodes describe the file23:02
RoyK(or dir)23:03
tomreynor other file system object23:03
JanCmultiple names in multiple directories can point to the same inode23:03
Glorfindelso it's metadata?23:03
JanCe.g. in case of hardlinks23:03
JanCpart of the metadata for a file, yes (not the filename)23:03
RoyKGlorfindel: the "database" that holds filenames etc23:03
Glorfindelbe back in a few minutes23:04
JanCinodes don't contain filenames23:04
JanCdirectories contain filenames  :)23:04
RoyKJanC: and directories are inodes, since they're basically files containing the names of the files inside them23:05
RoyKwell, inodes point to directories23:05
JanCright, the latter23:05
RoyKyes23:08
JanCwell, in theory on-disk "inodes" could contain filenames on some filesystems if they refer to a directory that contains only a small number of files where they store the file (directory) data in the inode record itself, I guess23:12
RoyKdoesn't matter much for Glorfindel - (s)he needs a new filesystem to make this work - I'd guess XFS would be better - no hard limits on the inodes23:15
sarnoldouch running out of inodes on /23:15
JanCeither that or set the inode limit for ext* high enough23:15
sarnold"this is a usenet server thanks"23:16
JanCand probably best to store such data on a separate filesystem indeed23:16
RoyKJanC: and preferably not on ext4 :þ23:16
sarnolddoubleyes :) hehe23:17
JanCwell, you can set the limits on ext4 if you want23:17
JanCbut using XFS or such might be easier23:18
sarnoldthese files have an average size of ~5k.. given how huge the binaries are going to be, I assume the actual data files are likely to be <4k..23:18
RoyKdd if=/dev/zero of=somexfsfs.img bs=1M count=10k ; mkfs -t xfs …23:19
sarnoldlol23:19
sarnold(seriously that's probably a good way out of this)23:20
JanCnot going to work if you have no inodes left  ;-)23:20
RoyKthat's why I wrote that ;)23:20
RoyKJanC: well, you can probably release one inode for the image file23:21
RoyKand another for the mount point23:21
sarnoldprobably there's a useless kernel image.. :)23:23
JanCand hopefully mkfs doesn't need temporary files  ;)23:23
JanCor something like that23:23
RoyKJanC: I doubt it - otherwise - just delete some old log files23:24
RoyKit should be doable23:24
GlorfindelI can release 3 million of them...23:25
Glorfindeland regenerate the tileserver stuff after23:25
RoyKthen do so23:25
JanCif you can, (re-)install the VPS with a separate filesystem for that stuff23:26
RoyKGlorfindel: but you'll need a filesystem supporting a lot of more inodes for that than what you hve now23:26
RoyKJanC: if the provider allows you to choose fs…23:26
GlorfindelJanC: at this point I'm going to make that the last solution, as I have quite a bit of data and no good place to migrate it to23:27
Glorfindelwell this is the longest I've seen rm take to delete anything23:27
RoyKit'll take some time to remove 3M files23:27
sarnoldyeah rm isn't going to go quick :)23:28
JanCwell, if you can create a new VPS for a month or so and copy everything over...23:28
RoyKbut you can just background it and start creating an image file and putting xfs on it23:28
GlorfindelRoyK: can you explain what that command you sent earlier will do?23:28
sarnold(if it were ZFS, then you could delete the dataset, but that would also have required a different setup from the start, too. :)23:28
RoyKGlorfindel: the dd command just creates an empty file, 10GB in size - the mkfs -t xfs, creates a filesystem23:29
JanCwell, booting from ZFS would be even more of a problem maybe23:29
RoyKGlorfindel: after it's created, mount it somewhere, add it to /etc/fstab and it should be fine23:29
Glorfindelah, so it would be like a virtual disk?23:29
RoyKGlorfindel: yes23:30
RoyKJanC: I've used ZFS for almost a decade - not at home anymore, though - I prefer the flexibility of md ;)23:30
GlorfindelJanC: also I don't think this vps provider gave me the option for what fs to use23:30
JanCbooting a linux VPS from ZFS, I mean23:31
JanCGlorfindel: you can't install a custom OS on it?23:31
RoyKJanC: I doubt most VPS providers support ZFS on the guest23:31
JanCwell, it's Ubuntu, so ZFS support is included23:31
sarnoldyeah pretend I didn't mention zfs.. it was just an aside that *some* filesystems offer way faster ways to remove three million files than rm :)23:32
GlorfindelJanC: it offers ubuntu 16.04 or windows server (forget what year) for an additional fee23:32
JanCthe problem is more the booting, depending on the type of VPS this is23:32
Glorfindelmay have been other distros too, I don't remember23:32
GlorfindelI'll check23:32
RoyKGlorfindel: just create that big, empty file and place a filesystem on it23:33
JanCmy VPS provider allows me to install my own OS if I prefer (they won't give support on how to do that though)23:33
GlorfindelI was misremembering, you can install other disrtos via iso23:34
RoyKnever mind zfs - it's not what you need here23:34
GlorfindelRoyK: "dd if=/dev/zero of=somexfsfs.img bs=1M count=10k ; mkfs -t xfs"?23:35
RoyK# dd if=/dev/zero of=somexfsfs.img bs=1M count=10k23:35
RoyKyes - just put that img file under /var/something23:36
RoyKsomewhere it may belong23:36
RoyKperhaps /var/lofs23:36
RoyKor whatever23:36
Glorfindelany reason to not put it in ~/ ? I only ask because it's easier for me to remember the path if I keep everything in /home23:37
RoyKthen mkfs -t xfs /path/to/that/file23:37
Glorfindels/put it in/mount it in/23:37
RoyKplace it where you like, but filesystems don't really belong in /home23:37
JanCusing an image file might have a small impact on FS speed though...23:37
Glorfindelok23:37
RoyKJanC: it will, but it'll work23:37
RoyKGlorfindel: if you can get a new vdisk for the VPS, it'll probably be best23:38
JanCwell, depending on how important FS speed is (maybe not if this is just for some personal test setup)23:38
GlorfindelRoyK: I just added an additional 20gb of ssd storage as "block storage" from 1and123:39
GlorfindelI'll check and see where it got put23:39
JanCah, 1and123:39
RoyKGlorfindel: lsblk?23:39
Glorfindelrm is still going at it lol23:39
GlorfindelRoyK: sdb23:39
Glorfindelthat was easy, thanks23:40
RoyKwell, put xfs on it23:40
JanCGlorfindel: that also depends on how directories are structured  :)23:40
Glorfindelso mkfs -t /dev/sdb ?23:41
RoyKmkfs -t xfs /dev/sdb # or perhaps put lvm on it first - just in case23:41
Glorfindelhow do I put lvm on it and what is the purpose?23:42
RoyK!lvm23:42
ubottuTips and tricks for RAID and LVM can be found on https://help.ubuntu.com/community/Installation/SoftwareRAID and http://www.tldp.org/HOWTO/LVM-HOWTO - For software RAID, see https://help.ubuntu.com/community/FakeRaidHowto23:42
Glorfindelthanks23:43
sarnoldbah are those links actually usfeul here?23:43
JanCI wonder if/how filesystems optimize stuff like removing all files from a directory...23:43
RoyKGlorfindel: lvm is a nice abstraction layer on top of a 'physical' device  - just vgcreate myvolumegroup /dev/sdX ; lvcreate -l 100%FREE -n myvolume myvolumegroup23:43
RoyKJanC: xfs does it quite quickly - ext4 doesn't23:44
JanCyou'd need something like temporarily disabling index updates which some databases support23:44
RoyKzfs has a massive backlog so it seems to do it quickly, but yet, it takes some time23:44
JanCright, it would say ready, and then start doing the work  ;)23:45
JanC(well it would record the fact that it will do that first)23:45
JanCstill doesn't seem easy though, as the application uses a syscall for each file, I assume?23:46
JanCunless there is a syscall to delete a whole tree?23:47
RoyKJanC: the way ext4 works, you'll need a systemcall or five for each file, yes23:47
RoyKI doubt such a systemcall exists23:48
RoyKperhaps in zfs - certainly not in ext423:48
JanCit's useless if rm doesn't use it anyway23:49
JanCit seems like something that would be useful in some cases...23:49
Glorfindeloh hey it finished23:49
Glorfindelnow maybe I can tab-complete23:50
RoyK:)23:50
Glorfindelok, so should I put lvm on it? do the benefits outweigh the complexity?23:50
RoyKGlorfindel: did you stop the process holding those files open?23:50
Glorfindelno, but it crashed when it ran out of inodes23:51
Glorfindelyesterday23:51
RoyKI'd say put lvm on it23:51
RoyKbut that's up to debate, I guess23:51
JanCcan you resize that block storage without losing data?23:52
GlorfindelJanC: I just added it half an hour ago, there isn't any data on it yet23:52
JanCit might already be using something like lvm on the supervisor level23:52
JanCGlorfindel: I mean, if you ever want to in the future23:52
RoyKthe only issue with xfs AFAIK is that it can't be shrunk23:53
RoyKbut then - who shrinks a filesystem?23:53
Glorfindelohhh.. no, I don't think so. when I look at the level I'm at in regards to resources they don't allow downsizing plans due to storage size changing23:53
JanCwell, that might be because they can't guarantee your filesystem can downsize  ;)23:54
RoyKGlorfindel: anyway - try 'vgcreate somevolumenme /dev/sdb'23:54
Glorfindelseems lvm is installed, but the command didn't work as I didn't sudo23:55
JanCbut if they down allow upsizing either, lvm would allow you to increase the filesystem over 2 (or more) such "block storage" devices23:55
JanC*if they don't allow*23:56
RoyKJanC: or PVs23:56
JanCthe "block storage" they provide to the VPS would be the PVs, of course23:57
JanCnot sure they provide _real_ _physical_ volumes23:57
RoyKprobably some hierarchical storage23:58
RoyKkeep the old data on spinning rust and sell it all as 'ALL SSD'23:58
sarnold:)23:58
JanCmight be storage on some SAN too23:58
RoyKyou don't get hierarchical storage on anything but on a SAN23:59
RoyKthere have been some OSS projects, but I don't think any has landed yet23:59
JanCoh yes you do; you can buy SSHDs everywhere  ;)23:59
RoyKnot quite the same ;)23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!