/srv/irclogs.ubuntu.com/2018/09/12/#ubuntu-server.txt

=== cpaelzer_ is now known as cpaelzer
cpaelzergood morning04:57
lordievaderGood morning06:12
zzarrHello!07:55
zzarrIs it possible to cluster 2 or more nodes (computers) as a SSI (Single System Image)?07:55
tomreynzzarr: this lists multiple Linux based solutions https://en.wikipedia.org/wiki/Single_system_image#Examples but most of them seem to not have received updates in a while.07:56
zzarrthe only relevant info I find is http://www.popcornlinux.org/07:57
tomreynreading the wikipedia article which states "The interest in SSI clusters is based on the perception that they may be simpler to use and administer than more specialized clusters. Different SSI systems may provide a more or less complete illusion of a single system." makes me suspect that maybe there are now fewer people interested in creating this illusion than there used to be in the past.08:00
tomreyn(at least in linux lands)08:01
tomreynhave you considered other HA models?08:01
tomreynzzarr: ^08:02
zzarrI just wanted to build a cluster as an experiment for own use08:02
zzarrI was thinking about buying 2 https://www.pine64.org/?product=rockpro64-4gb-single-board-computer08:03
zzarrand cluster them08:03
tomreynwhat would this cluster then do?08:04
zzarrwhile the CPU's on the boards are strong but nothing special, they have something called a NPU (neural network processor) which would be nice to have 2 of so to speak08:06
zzarrother whys it's just to learn and have fun :)08:06
tomreynmy (surely subjective) perception is that in the end you always want to create / provide a highly available application / service. so, for example, you want a HA web or database server. to do this, you don't need classic server clustering, but just service / application level clustering, and this can actually make more sense.08:07
zzarrnice idea08:08
tomreynregarding the NPU i'd assume something similar to distcc to exist, i.e. a small service layer running on all nodes which then allows you to address an abstraction of these as a single entity.08:10
zzarrI think so08:10
tomreyni can't seem to find much on clustering NPUs, maybe the concept is not applicable to this kind of processor, or it has just not yet been done (or not in open source software)08:14
zzarrdo you know if it is possible to make 2 kernels communicate over PCIe?08:14
zzarrwell, I could write my own software once I know how to use the NPU08:15
* tomreyn does not know08:15
tomreyni assume you're loking for a fast link and DMA08:16
zzarrwhat is DMA?08:16
tomreyndirect memory access08:16
zzarrsure, a fast link yes08:16
zzarrthat is correct08:17
tomreynan external process writing to memory normally controlled by the kernel08:17
tomreynyou usually dont want DMA because it means abandoning security, but for low latency processes and clustering it can the the only option08:18
zzarrI see08:18
tomreynthere are several standard interfaces which can do DMA. i think pci and thunderbolt at least. bluetooth provides a mode which allows for it.08:20
tomreynmaybe that's also a ##hardware and ##linux question08:20
zzarrI was thinking of buying some FPGA as a switch between the two boards (and possibly expandable), but the frequency if PCIe is 8GHz08:21
zzarrso it might not be possible08:21
zzarrI'll ask in those channels08:22
zzarrbut it might be possible to just hook PCIe -> PCIe (Tx -> Rx)08:23
cpaelzerrbasak: you should be the first to be around, would you have some time for https://code.launchpad.net/~paelzer/ubuntu/+source/qemu/+git/qemu/+merge/354695 as the automated tests will conclude in a few hours and I'd want to be ready then08:23
tomreynzzarr: https://serverfault.com/questions/336649/pci-e-connection-between-two-servers  - infiniband actually can do RDMA (remote direct memory access), too, IIRC08:25
zzarrcool, I'll have a look08:40
zzarrvery interesting, thanks tomreyn08:44
tomreynyou're welcome, but i'm really not knowledgable in this area, it'd be better to talk to someone who is.08:45
cpaelzerrbasak: thanks for the check I have the edit for the SRU tempalte open already :-)09:46
cpaelzeraskring rharper is a good idea I'll do so privately09:47
cpaelzerand on the dep3, I'll extend my template to differ between the two09:47
halvors1Hi! I'm experiencing some network issues with my server, seems to appear when i clone the mac address. (It's only used by the server).11:18
halvors1The problem is that connections drops once in a while ahen the mac address is cloned, my network contoller is 82566DM-2.11:19
halvors1Running the e1000e driver.11:19
halvors1I'm cloning the mac address in systemd-networkd, should this be done in udev? How to do that in 18.04?11:20
rbasaksmoser: could you add SRU information to bug 1781039 please?11:36
ubottubug 1781039 in cloud-init (Ubuntu Trusty) "GCE cloudinit and ubuntu keys from metadata to ubuntu authorized_keys" [Medium,Confirmed] https://launchpad.net/bugs/178103911:36
rbasaksmoser: in particular Regression Potential. Looks like the entire cloudinit/sources/DataSourceGCE.py file has been rewritten or wholesale backported?11:36
blackflowhalvors1: "cloning"?  you mean spoofing? cloning would imply multiple NICs with teh same MAC, which would explain issues.11:56
ChainsawHello. Attempting to install Ubuntu Server Lts 18.04.1 in a multipath FibreChannel environment using LPFC (Emulex) adapters. I am unable to enable any sort of multipath support, as the documentation seems outdated (for 16.04, which has a different kernel command line on the install media).12:40
ChainsawTrying an LVM2 installation without any multipath, thinking it could be enabled later, results in duplicate LVM2 PV ID reports and a failed boot. Any attempt to install to the same disk(s) also fails, as it cannot umount/disengage from the flawed LVM2 configuration that results.12:41
ChainsawThoughts?12:41
ChainsawI mean besides using a rescue CD to dd /dev/zero to the disk to try again, which is what I'm doing.12:43
stukdevHi, i've setup a samba share, everytimes i create a new directory the default permission are drwxr-sr-x , how can i force to disable the 's' permission in samba conf?12:51
halvors1blackflow: Yeah mean spoofing, the reason is that only a specifid mac is allowed by the upstream switch.12:51
rbasakstukdev: see "inherit permissions", "force directory mode" and "directory mask".12:53
stukdevrbasak: i just set the force directory mode 0775 but don't work12:54
rbasakstukdev: do you have "inherit permissions" set?12:54
smoserrbasak: i'll ask shaner to do that. sorry for not having asked that before uploading. this was me just sponsoring someone elses review.12:55
smosererr... work.12:55
stukdevrbasak: this is what i'm seraching, becouse in webmin i don't find it..12:55
jellyChainsaw: are you trying to put root fs and boot from mpth?12:55
jellympath*12:55
stukdevrbasak: ok, i setup inherit permission = yes, force directory mode = 0775, directory mask = 0755, but new fdirecoty always create 's' permission13:02
rbasakstukdev: have you actually read the definition of "inherit permission"? I didn't suggest that you set it to "yes".13:03
stukdevrbasak: yes, but using no, its the same, so i try using yes13:05
rbasakI'm not sure then, sorry.13:05
Chainsawjelly: Correct.13:30
Chainsawjelly: These are boot-from-SAN systems with no local storage of any kind. (HP ProLiant BL460c Gen 8 on a 3PAR 8440)13:30
DammitJimhow do I google for a reason why a log.jcifs* get created in /var/log/samba ?13:54
sdezielDammitJim: samba creates logs in there with the client machine suffix13:59
DammitJimthanks sdeziel14:00
DammitJimweird! but these files are empty!14:00
sdezielDammitJim: yeah, some of mine are empty as well.14:01
DammitJimsearching for: samba log.jcifs* access denied doesn't turn up anything on google14:01
DammitJimthat's why I was trying to get some ideas on what to search for14:01
sdezielDammitJim: jcifs is probably the name of the client machine so I'd remove this part from the google search as it's really specific to your environment14:02
DammitJimit says: log.jcifs255_105_ac14:03
DammitJimI'm verifying 255.105 are the last 2 octects of the IP of the client machine14:03
ahasenacklet's say I removed a file that belongs to a package, how can I get it back? apt install --reinstall <pkg> doesn't work, it doesn't restore the file14:05
DammitJimhow did you remove the file?14:25
ahasenackit wasn't me, someone made a mistake, I don't know the details14:25
ahasenackbug report14:25
ahasenackit's easier to just restore it instead of investigating how he managed to remove the file14:25
DammitJimwhat's the name of the file?14:26
ahasenackhttps://bugs.launchpad.net/ubuntu/+source/postfix/+bug/179140314:26
ubottuLaunchpad bug 1791403 in postfix (Ubuntu) "postfix 3.3.0 unable to create missing queue directories" [Undecided,Incomplete]14:26
ahasenack /etc/postfix/postfix-files14:26
ahasenackI told him to extract the file from the package manually14:26
ahasenackmaybe because it's in /etc --reinstall didn't work as expected14:27
ahasenacki.e., a config file14:27
ahasenackkstenerud: to which ppa did you say you pushed a new postfix upload?14:34
ahasenackthe mp description now only lists https://launchpad.net/~kstenerud/+archive/ubuntu/cosmic-postfix-mysql-config-179113914:35
ahasenackand that one isn't using the ~ppaN suffix14:35
ahasenackI *think* you can delete the packages in there and upload new ones using -1ubuntu2~ppa1, but the ppa might reject it as being lower, even after the deletion14:36
ahasenackI've had conflicting experiences with that. My mantra is "PPAs remember"14:36
UssatOK, this is totally off topoic, but to lighten things up a bit. Today14:38
UssatOK folks, today is a HISTORIC day, today in history:   https://www.youtube.com/watch?v=hcJAWKdawuM14:38
kstenerudahasenack: OK I'll push a ppa version14:42
kstenerudahasenack: How do I delete the bad upload to the PPA and replace it with a new one?14:47
ahasenackkstenerud: view package details -> then you should see a delete option in the top right next to a copy packages one14:48
kstenerudhmm it still won't let me upload14:49
kstenerudPackage has already been uploaded to ppa on ppa.launchpad.net14:49
kstenerudNothing more to do for ../postfix_3.3.0-1ubuntu2~ppa1_source.changes14:49
ahasenackthat's from dput14:50
ahasenacknot a server response, right?14:50
ahasenackeverytime dput uploads a package, it creates a *.upload(ed?) file, and that is what it looks for14:50
ahasenackyou can dput -f14:50
ahasenackor remove that upload file14:51
kstenerudah ok14:51
ahasenackyou can tell by how quickly dput complained that it wasn't a server response :)14:51
ahasenackafaik beside this particular condition, dput always succeeds14:51
ahasenackit's async. If it actually worked or not, an email will tell you14:52
Chainsawjelly: You've successfully understood the question. Are you able to help please?14:53
mustmodifyMy ubuntu instance on EC2 suddenly became unresponsive. I tried to restart it from the EC2 console. For 10 minutes, nothing happened. I then tried to stop it and EC2 offered to "force-kill" it. That took another 10 or so minutes. What logs can I check or other tests can I perform to see what caused it to go down and then to be so hard to restart?15:02
ahasenackI would try to check it's console15:02
ahasenackalso, if its root is an ebs volume, maybe mount it from another working instance to inspect it15:03
masonI'm curious - in RHEL/CentOS, "systemctl restart cryptsetup.target" will reparse /etc/crypttab and make additional volumes available. This appears not to be the case in Ubuntu 18.04. Is there a preferred way to reparse crypttab in Ubuntu, without a reboot or manual set-up?16:09
masonAh, EL didn't want systemctl daemon-reload first, but Ubuntu does, after which restarting cryptsetup.target works.16:19
blackflowmason: you don't need daemon-reload for changes in crypptab as that's not systemd file. I guess you're seeing the generator being retriggered with daemon reload16:34
blackflow(as cryptsetup is handled by a generator)16:34
blackflowuhh... crypttab.16:35
masonblackflow: That sounds right, yeah.16:35
masonThe odd difference is that evidently EL runs the generator without daemon-reload16:35
blackflowafaik RH does some changes to their systemd that's not upstreamed, like that 0day issue, RH specifically allows usernames starting with a number. that's something I remembered.    yeah, that's my pet peeve with it.... so much for one, standardized interface across all distros.16:39
masonMy pet peeve is largely "here's an ever-growing project that stifles opportunities for people to invent novel standards-based components to drop into a modular system".16:42
blackflowstifles how?16:45
kstenerudis /var/log/daemon.log gone from ubuntu?16:52
blackflowkstenerud: iirc that was defined through rsyslog, so yes. you can always define it yourself.16:56
masonblackflow: rsyslog is still there by default17:10
masonblackflow: My 'Net cut out due to maintenance, but in short, systemd disincentivizes new development in the spaces it occupies, since it's got fairly complex interdependencies on its components.17:11
masonThe previous model was far more modular, with standards-based modules being drop-in-compatible with each other.17:12
blackflowthe previous model was a shell script :)17:13
masonNo, think of rsyslog, MTAs, MDAs, all sorts of server software, DNS, etc.17:15
masonIn short, everything we do that defines the field.17:15
=== InfoTest1 is now known as InfoTest
kstenerudahasenack: I think logwatch needs a bit of an overhaul. It's referring to a bunch of logfiles that haven't been present since precise17:39
nacckstenerud: upstream or in our package?17:39
naccnote that if it's upstream, that's because it is meant to be installable everywhere, even on ancient systems probably. General OSS cruft :)17:40
kstenerudI'd have to check upstream. Not sure of debian has things in dist.conf or not17:40
kstenerudThe basic idea is to leave default.conf alone, and for distributions to add config files to dist.conf, and users to modify /etc/logwatch.d17:40
kstenerudbut ubuntu dist.conf is pointing to old things that are no longer true17:41
nacckstenerud: ah i see17:41
nacckstenerud: yeah, it probably needs love :)17:41
kstenerudwhich is the root cause of most of the logwatch bugs in lp17:41
kstenerudIn particular, we have no daemon.log or messages in /var/log17:42
nacckstenerud: to old things? i thought most of the bugs we were getting were missing new things :)17:42
kstenerudSome are from getting new unexpected log entries, and others are from things that stopped working in 14.0417:42
kstenerudI think it coincided with the move to rsyslogd17:43
naccah could be17:43
kstenerudrsyslogd has a very restricted set of logfiles (auth.log, kern.log, mail.log, and syslog)17:44
kstenerud* in ubuntu config17:44
naccah that makes sense17:45
naccyeah, by default17:45
kstenerudlogwatch, on the other hand, is still looking for daemon.log and messages, which aren't configured in rsyslogd17:45
naccright17:46
kstenerudSo I think I can fix this in dist.conf. The only thing is that once I point things to where they're supposed to go, logwatch is going to choke on a lot of the new messages it hasn't been updated to handle (I did some preliminary tests and got quite a few unexpected message warnings)17:48
nacckstenerud: yeah, it probably needs two sets of updates17:49
kstenerudBut at least it will be processing what it's supposed to be processing17:49
nacckstenerud: that ends up being the hard decision -- how much should we be fixing, vs. upstream should be fixing17:49
kstenerudWell, unless dist.conf is being driven by debian, it's our problem. The unexpected messages will be something that should be fixed upstream ideally17:49
nacckstenerud: right, that's what i meant --  you're right to fix dist.conf for our distro configuration; but the unexpected messages should be fixed upstream, if they are new formats, etc.17:51
nacckstenerud: iirc, logwatch upstream was pretty responsive17:51
blackflowmason: I think you're making the common mistake of assuming that systemd the project defines what a distro should or shouldn't include. one can still have _just_ the pid1 and process manager, and use all the other components from before.17:59
blackflowmason: including crypttab generator which is strictly speaking not needed, but is a good thing to have so it benefits from dependency triggers if systemd knows about it18:00
* mason sips the Kool-Aid.18:01
blackflowmason: patches welcome ;)18:02
masonblackflow: I can think of places I'd rather spend time.18:03
masonPatches would require excessive time and attention in this case.18:04
naccsarnold: lovepopsickle in #ubuntu points out no torbrowser-launcher AA profile exists, though it is listed here: https://wiki.ubuntu.com/SecurityTeam/KnowledgeBase/AppArmorProfiles18:28
naccsarnold: could you reply/follow-up? (or i can redirect them to a better channel)18:28
aroonianyone know how to address this issue of getting php-dev installed on ubuntu 16.04 server?  https://gist.github.com/arooni/f535d32c8fb8c0a74c73e6c4425c44da19:09
naccarooni: you are using ondrej's ppa19:19
naccarooni: if you want to use it, use it for everythign and seek support there, or just us ubuntu's packages19:19
aroonii think i must have been ;  https://askubuntu.com/questions/813788/cant-install-libpcre3-dev  i followed that and i think hopefully downgraded to the official repos19:19
naccarooni: if you don't intend to use ondrej's ppa, you should ppa-purge it19:20
arooninacc: thats a good call;  so is there any advantage to using it at all?19:20
naccarooni: ondrej's ppa lets you use non-ubuntu version of php, e.g. 7.1/7.2 on 16.0419:25
arooniand is that recommended? or not so much19:31
keithzgI mean, it's recommended if necessary ;) That is to say, one might need PHP 7.1 or higher and also have to be running 16.04. But with 7.2 officially in the 18.04 repos, the use-case is currently not high. As the LTS goes on that will probably change. But if you don't expressly need a version of PHP other than the one in main, it's better to stick with the officially-packaged version.19:36
aroonithanks for that explanation19:39
aroonii remember seeing perf benefits to php 7.1 and 7.2 over 719:39
aroonibut i also think i remember that 7 is a big step up from 5.x19:39
keithzgYeah and there were some missing features in 7.0 that were in 5.x, that were re-added finally with 7.1 (which is why I'm still using ondrej's PPA on the Phabricator server at work, which I haven't yet updated to 18.04).19:40
arooniwhat are you missing in 7.0 that you have in 7.1?19:41
aroonibr19:41
keithzgarooni: Not 100% sure, just stuff Phabricator needed, heh. Looking at https://secure.phabricator.com/T9640 I guess it was primarily "asynchronous signal handling".19:42
tobias-urdincoreycb: I updated this bug with some details https://bugs.launchpad.net/cloud-archive/+bug/175809420:24
ubottuLaunchpad bug 1758094 in Ubuntu Cloud Archive "ironic-conductor fails to start in Pike" [Undecided,New]20:24
tobias-urdinwe are still hitting this issue in CI https://review.openstack.org/#/c/602059/20:24
tobias-urdincould you please look at it when you are back20:25
tobias-urdinjamespage: fyi ^20:25
jamespagetobias-urdin: looking20:27
aroonii think my packages are broken;  cant seem to install pmp-memcahced22:07
aroonihttps://gist.github.com/arooni/f1efd9f1db704732eea104318784617022:07
naccarooni: i can help you once i'm off the phone22:07
aroonino rush ; just a noob here trying his best lol ;)22:08
naccarooni: your php-common is i think from ondrej still22:08
naccarooni: `apt-cache policy php-memcached php-common` ?22:08
arooniahh ha; i did run ppa-purge as recommended earlier22:08
aroonibut i think it didnt remove all the old ppa packages22:08
naccok22:09
naccit should have22:09
aroonihttps://gist.github.com/74d4b80b76cf8df5690710bcf5e3474922:09
naccarooni: right, your php-common is still wrong :/22:13
naccarooni: you can satisfy it manually with (on the apt-get line php-common=...)22:14
arooniso do i just need to uninstall it22:14
arooniwhat about uninstalling php-common and reinstalling it22:14
aroonishouldnt it pull from official repos?22:14
naccalso would owrk22:14
arooniReinstallation of php-common is not possible, it cannot be downloaded.22:15
aroonii really butchered this didnt i22:15
arooniuninstalled all my php packages  and reinstalled them22:23
arooniseems to have fixed it22:23
naccarooni: :)22:28
arooniis apxs something that runs only on apache or on nginx too22:30
jamespagetobias-urdin: update for oslo.utils now in pike-proposed22:50
jamespagehopefully that will resolve your issue22:50

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!