[00:00] actually, that could work. landscape has an api, so just stick a script on something that polls the free ram, and kicks ipmi if it's got silly again [00:00] but the only other computer that's always on is my appletv. it'd be quite funny using that as a watchdog for my server [00:01] or setup watchdog to do it [00:01] lmao [00:01] shauno: Hasn't your machine got a builtin watchdog [00:04] no idea, it's that little hp microserver [00:04] wouldn't be surprised if it did and it's probably easy to enable; and you just have to wire the watchdog to actually check on your service [00:06] hm, outta curiousity, the appletv doesn't have uptime installed, but system_profiler shows the last boot as being the 30th of june, 2012 [00:07] well, for now I'm trying to leave it "broken" expecting them to come back with questions to my bug report, eventually [00:08] the ram usage is growing by 3GB a day, so it's not just "this is a piddly server", but enough to cause problems for most. if not this week, next [00:10] oh leaks like that are normally easy to find; it's the 1M/day that are hard [00:10] oh it's not leaking, it's just never ending cron jobs [00:10] so one starts, 10 minutes later the next starts, then the next .. [00:10] oh, any idea why they don't end? [00:11] nadda. in the logs they're complaining they can't connect to something (doesn't say what) [00:11] if I run them in bash, they make exactly the same complaint but terminate [00:11] strace or ltrace on the hung one to see what it's waiting for? [00:14] looks like it's just going around in circles trying to connect to localhost, but never giving up [00:15] 5672, apparently somethign rabbitmq should be listening on [00:16] shauno: I'd try and get a core dump or backtrace from teh hung process to see exactly where it's hung [00:17] it doesn't appear to be hung, it's just retrying forever [00:24] hm, rabbit does appear pretty stuffed up though. it launched loads of processes named get_inethost that don't seem to move at all [00:26] dns hang? [00:29] hm, it seems to be hating something in /etc/hosts [00:29] (of which there is not a lot) [00:30] I just put every alias I could think of on 127.0.0.1 and restarted, and everything just went through at once [00:30] so I've put it back as it was, will wait for it to break again, and then add them one by one tomorrow and see which one it was [00:30] problem resolving it's own hostname perhaps? [00:31] it shouldn't do [00:31] or maybe it was triyng to connect to rabit on a firewalled external interface rather than the localhost? [00:32] yeah, that's what I'm looking at right now. host (myhostname) returns my public IP [00:32] despite /etc/hosts having the short & fqdn on 127.0.1.1 [00:33] hostname && hostname -f [00:33] double check that it has the right hostname comparing to /etc/hosts [00:33] and you reboobed since setting the hostname? [00:34] -f has localhost, hostname alone gives fqdn [00:34] and yes, I've reboobed lots. and lots lol [00:34] :-) [00:34] rabbit isn't configured wonkily to think it's not itself? [00:35] yey negative soup [00:35] you want double negative? hah, I see that and raise you a triple! [00:40] hm, I can't find any config file for rabbit at all, so no idea what name it's looking for [00:42] oh, nope, wild goose chase. the queue emptied becaue the processes that are trying to talk to rabbit do bail if it's not running [00:42] but the log for rabbit is 12G of http://paste.ubuntu.com/12258866/ [00:46] which probably means it's hating my ssl keys. I think that can wait until tomorrow. [00:46] (although I think the bug stands as entered, the complete lack of locking shouldn't bring down the machine) [00:50] right there's too separate problems; 1) Why the cron took so long 2) Why it ran multiple [02:52] I really should sleep [05:25] morning === Lcawte|Away is now known as Lcawte [06:55] morning all [08:42] * DJones looks at monitor prices, 27" LG £159, 27" Apple £739....., possibly different resolutions, but thats a hell of a difference [08:43] It's coz it has the word APPLE on it, it's that 5 letter word that costs £700 :) monitor is about £39 :D [08:43] but one is made of kittens and unicorns and rainbows [08:43] You forgot that the apple one is shiny [08:44] now with 10% more rainbows [08:48] or you could actually try to compare like to like and see where it gets you [08:52] morning boys and girls. [09:14] morning brobostigon [09:14] morning MooDoo [09:25] well, I figured out what was choking up landscape. if LDS and rabbit aren't using the same hostname, things get ugly. moving LDS into a vhost caused said ugly. [09:26] those in London - canonical presenting at a meet up https://www.eventbrite.com/e/containercamp-day-zero-tickets-18239147782 [09:34] morning [09:34] popey: howdy [09:50] morning popey [10:21] Hey all, boss has asked me what spec I'd like for a server to run 6-7 minimal linux vm's ( used for testing / basic rpm builds etc ) no stressful work at all. Anyone recommend a small cheap box [10:22] I think a tower is preffered and something that is not like a 747 [10:23] http://www.serversdirect.co.uk/HP_Tower_Servers/prod.asp [10:23] ML range seem to be the one to go for I'm guessing [10:23] one with RAID [10:24] what hypervisor? [10:24] yeah, although none of these VM's are critical and can be re-created easily [10:24] esxi probably [10:24] ok, should probably check their compatibility matrix [10:25] hardware compatibility is not a given [10:25] Good point [10:25] I've had that issue before [10:25] i have issues with my emulex iscsi when it comes to host profiles [10:25] I'm not against using kvm or something though [10:25] also had network card issues and SAS controllers [10:25] playing up, causing purple screens [10:26] Seems the ml310 is support ok [10:39] Also.... [10:40] I've got to write a document explaining why we need to upgrade CentOS 4 boxes in simple terms [10:40] Struggling apart from right, because we're stupid not to [10:40] :D [10:40] Got to be in layman terms [10:40] E O L [10:42] yeah done that part, we have serious issues with emails etc as well [10:43] Our customers won't upgrade and basically after me explaining to our staff the reasons they want something to push customers to upgrade [10:43] Not supporting TLS etc, shellshock... [10:43] Trying to google something along the lines of why not use a EOL OS [10:44] costs in cleaning up centos4 systems after pwning could run to many 100s of thousand pounds [10:44] yeah I've mentioned that, also asks my bosses who are liable [10:44] "You are out of support, you will not get any updates, you will be vulnerable to many attacks, you are negligent in not upgrading and may well find yourself on the wrong-end of a lawsuit" [10:44] We've had two sites pwned already [10:44] "In the event that customer data leaks, you have no redress" [10:44] Doesn't seem to sink in [10:44] think you need a new job [10:44] I like that [10:45] I do!!!! [10:45] I made that decision whilst in these meetings [10:45] If they process credit cards, the CPA (or whatever it's called) may revoke their status [10:45] The ICO will have a monumental hissy-fit if there's a leak [10:45] nah no CC stuff done at all [10:45] The ICO is toothless, but they'll make a lot of noise. [10:45] But still ssh access and stuff [10:46] They just don't see the implications [10:46] Any information they have can (and probably will) end up with a competitor [10:46] i am looking for a new sysadmin [10:46] amongst other jobs [10:47] foobarry: we've talked before but seriously debating working distance now [10:47] TwistedLucidity: I like that too! [10:47] We use CISAM db, it's not very hard to get info out :P [10:48] Kinda hard to know what to say without knowing the business, but they could well be in breach of contract with partners/customers [10:48] Half our email servers run sME Server 7 that are EOL ( CentOS 4 based ) as well, I spend most of my time massaging them to work, explained that too [10:49] Work in wholesaling with ERP software [10:49] sounds like they aren't willing to learn [10:49] centos 4 is ancient now [10:49] We're the software company selling the ERP but also do networks/servers for them [10:49] Yeah was EOL 3 years ago [10:49] diplo: You host that or sell the hardware? [10:49] And no they're not willing to learn, "It works" [10:50] All of the above TwistedLucidity [10:50] Hello breach on contract. [10:50] we got pwned by anonymous a while back [10:50] can't tell you how, or why [10:50] but i think you can guess [10:51] you did something bad to kittens on the internet?! [10:51] TwistedLucidity: but customers won't upgrade [10:51] they rolled a dice [10:51] and made 1+1 = 75 [10:51] probably one of their last acts [10:51] misplaced activism [10:52] Aren't people deprecating support for CentOS _5_ now? [10:52] judge and jury doesn't really work when you're wrong [10:52] diplo: Well, that all depends on the customers' businesses. [10:52] do i686 and 64 bit libs both get installed by default? [10:52] I mean, it is on version 7 now [10:52] seem to have loads of 32 bit packages on a server (alongside 64 bit ones) [10:53] diplo: You should have come to the LBW, there was a story similar to this where a customer wouldn't increase their disc quota. Their entire enterprise went down, so the called up screaming. Not one finger did the provide lift. [10:53] Customer had had the order which simply required a signature for 6 months. [10:53] But "It worked" so they didn't bother [10:53] Until it no longer worked [10:54] We had that a couple of weeks ago [10:54] And the provider didn't have the order and couldn't magic X TB out of thin air with zero notice [10:54] Customer had been emailed/quoted multiple times citing no space on server and being 8 years old [10:54] We didn't have space for backups [10:55] They got infected with crypto, lost most of their samba shares [10:55] + all their backup tapes with 7+ years old [10:55] Huh....there is one way to make them change. Alter your pricing. [10:56] Support for CentOS 7....£ X. Support for CentOS 4 £ Y. Where Y >>> X. [10:56] oh great, whatsapp spam. thats a new one [10:56] I've told my bosses we need a clause in our contracts about OS age and space issues after they've been alerted and something happens they get charged the earth [10:56] I like that TwistedLucidity, will suggest that [10:56] Although can't do CentOS7 yet.... [10:56] Well, 6 or whatever [10:56] 64bit only, we can't get hold of Cisam 64bit binaries yet :/ [10:57] yeah [10:57] what happens if the support for centos 4 involves security, are you then liable? [10:57] When they say "Why?" say that, due to CentOS 4 being so old you have to now pay people squillions to try and back-port the updates. But it's best effort and you guarantee nuthin' [10:57] I've asked this question... bosses don't answer or know.. [10:57] "Guys remember to be careful when buying a new laptop for University! There is the terrible thing called "UBUNTU" which comes pre-installed on some Dell laptops. This may look like windows, but is far from it. You will not be able to access things like Internet explorer and Microsoft word. You will probably not be able to gain a college degree with i" [10:57] in an ideal world, you could just say "because we say so. that's what you pay us for" :/ [10:58] foobarry: Huh? [10:58] foudn on a student facebook group [10:58] shauno: yeah pity it's not an idea world [10:58] no kidding :) [10:58] We have one customer with a 15 year old server, won't upgrade because it works [10:58] foobarry: Well, of course. Although both those can be made to work if absolutely needed. [10:58] Runnign RH 8 [10:59] diplo: This like that are sometimes needed, but they tend to be connected to finicky equipment and air-gapped. I know loads of labs have to run that way. [11:00] The MasSpec will only accept XP and only XP will be accepted. [11:01] That sucks, I take it that it's not networked anymore to outside network ? [11:02] we're not allowed xp on the internal network, let alone external [11:02] Nope, air gapped like I say. Any transfer has to be by floppy (or USB in some cases) [11:02] Yes, I typed "floppy" [11:03] And yes, I know the USB could contain malicious executables but there's nothing they can do...supplier won't upgrade it - they want them to buy an entirely new piece of kit [11:03] 3.5" or 5.25"? :-) [11:03] 3.5. [11:03] 720k or 1.44mb :-D [11:04] 1.44 [11:04] then what are you complaining for :-P [11:04] Oh, I don't give a crap about it. I was just pointing out that people sometimes have reasons for using out-of-date software. [11:15] Our old HR system at the last place I worked had to be upgraded by floppies :D [11:15] It was excruciating [11:18] I used to update BMW dealership parts databases via floppy [11:18] The parts PC (IBM PS/2 Model 50Z) was usually out in the service room, so caked in dust/smoke/crap [11:18] At once dealership it wouldn't read the floppy, so we took it out and chased it around the floor with an air line to get the crud out [11:18] worked perfectly after that [11:18] I have zero nostalgia for floppies. even my amiga has replaced it with a drive emulator [11:29] we had a pc in office above engineering works. pcs kept blowing due to metal dust getting into power supply. we put pc in pair of tights with hole for floppy. worked grand [11:32] hah [11:36] i remember working for dixons support when a lady phoned up wondering why her machine wouldn't take disk 9 of her windows 95 insallation, when the engineer got there, the back of the floppy had bust off, she was just pushing more disks into the machine and the empty space in the computer just got full :D [11:37] lolz. [11:38] * brobostigon makes a note of that, for future reference. [11:42] :) [11:46] i did find money had been pushed into a video point of sales system by some staff members. luckily 5 pound notes didn't catch fire on motherboard [11:49] slot that looks like a note slot ?! [11:50] space between floppy drive and blanking plate for device below it [11:51] i also had someone try to install ram in their system by pushing ram through the same space on their system [11:51] ?! [11:52] what type of place is it you work in? [11:52] some people are not smart [11:52] penguin42: Ireland ;) [11:52] the ram install specialists were just average home users who thought they could save money by installing it themselves [11:55] or downloading more === alan_g is now known as alan_g|lunch [11:56] i think one of my proudest moments was when the slowest but busiest system in the office used by a secretary wasn't going to be updated when i realised the case for the managers computer (fastest and least used) and swapped the cases :-) [11:56] shauno: Well...technically downloading more ram is (was) possible. [11:57] IIRC one could download a tool that allowed you to compress in RAM (maybe as a ramdisc? I'm talking ages ago), thus giving more in-RAM storage. [11:58] right, time to have a look at that urlwatch [11:58] Which was more objectionable? The compression/decompression or the swap? [11:58] (osx actually does this) [11:58] there were ram compressing tools, and the DID work but lost most of the gains by the bottle neck of the cpu utilisation [11:58] so it ended up as fast as virtual memory [11:59] Could probably off-load it to bespoke chips these daya [11:59] ex-wifelet had to use floppies to transfer data off a hospital radiology system [11:59] can I somehow get more results of ctrl-r search on command line than just the latest? [11:59] * zmoylan-pi seems to remember that hospital systems used 2.88mb ibm floppies [12:00] This was standard 1.44 HD ones [12:00] at least here in ireland for some reason [12:00] Hospital IT is a giant seething mess of evil [12:00] And I say that as someone who works in the sector [12:00] yeah, they have electronic records here in ireland but the doctors prefer paper as it works and doesn't crash [12:01] of course that means that i am the index to the huge bunch of paper that gets dragged out every time i go in [12:01] It's the perfect storm of : enterprise level needs, risk aversity, and budget constraints [12:02] IMHO all the records systems on the market are focussing on the wrong things [12:02] They focus on the "clever" that computerizing records can bring to the table [12:02] Myrtti: I've always done 'grep foo .bash_history' be great if there was a way to scroll up/down the hits [12:02] Pretty graphs, structured records, data mining etc. [12:02] What they really need to focus on is the core use case of medical records - communication [12:03] they all focus on wanting to builld a monopoly (their monopoly) on storing records [12:03] You are communicating with other clinicians, or yourself (in the future) [12:03] zmoylan-pi, Yeah, totally agree with that [12:03] Aided and abetted by government policy wilfully ignoring the problems this causes and instead mandating "interoperability". [12:05] awilkins: You should listen to the episode of "Skeptic's Guide to the Universe" where Steve Novella goes off on one about hospital IT (he's an MD in the USA). [12:05] their have been times when it got close to me having to fix the pc/showing the consultant how to use it to get my records [12:06] zmoylan-pi: Be fair though, you did change you name by deed poll to "; Drop tables;" [12:06] TwistedLucidity, Ta, will do that (might even punt it around the workforce for link karma if it's good) [12:07] Basically, it was "The UI offers every option the developer could think of, rather than the ones the nurse/doctor/whomever actually needed" [12:07] that and i always have a swiss army knife on me and knew the crap compaq mini towers they were using back to front as we used them [12:07] Arrgh, anyone got a greasemonkey script that kills all Taboola content?!? [12:08] * awilkins hate hate hate hate hate hates it [12:08] Never seen it [12:08] It's those links at the bottom of pages [12:08] NoScript/Disconnect/etc [12:09] "World's 10 Most Beautiful Women! 14 Times Kate Middleton was a Normal Person and Gosh Isn't That Terrible!" etc [12:09] Err...can't say I see those. [12:09] I really should trim down the number of blocks I have; it's a bit OTT [12:09] Maybe they're scripted in.. [12:09] Got an example link to a page? [12:10] http://www.theskepticsguide.org/podcast/sgu [12:10] Everyone has them now [12:10] It seems to have taken over as the primary way to monetize your web content [12:11] I just see an episode list [12:11] same her [12:11] You're doing something right! [12:11] *here [12:11] are you using a lenovo? :-P [12:11] Firefox 40 / Ubuntu 14.04 [12:12] I run Disconnent, uBlock, NoScript, Ghostery and FlashBlock in FF; plus network blocks in DNSMasq on the router. [12:12] Homebuilt gaming rig, definitely no Chinese malware in it [12:12] (malware may be from Taiwan) [12:12] Really need to tone down the blocking add-ons in FF; totally overdoing it [12:12] ghostery and privacy badger on firefox on win8 [12:12] ON a lenovo :-D [12:13] I love Lenovo hardware [12:13] I'd probably still buy them [12:13] Which is sad [12:13] their recent malware preinstalls are a little sad [12:13] Recurring malware rootkit [12:13] which left a backdoor for windows malware [12:14] The thing that uses a bona-fide actual in-there-by-design rootkit feature in Windows is just mental. [12:14] i really must linux this laptop... [12:14] compared to win10 it's great :-/ [12:14] They're backporting the snoopware from Win10 to Win7 and 8 now [12:15] Damned if you do, damned if you don't. [12:15] which makes it more and more imperative that i bump this laptop up to linux [12:15] I only use WIndows for playing games now [12:15] awilkins: Disconnect kills Taboola [12:15] And compulsory corporate activities that require Windows-only apps [12:16] Which is basically "MS Office" now [12:16] Ghostery too [12:16] i only left windows on this as i needed a nokia sync bit of software to transfer 700+ contacts from one phone to another and no other software would do it [12:16] Hah, the same with mum's WindowsPhone [12:16] You can only patch the OS via zTunes or whatever it's called [12:17] I did it by installing it in a VM and passing through the USB port [12:17] microsoft knackered the csv handling of the nokia software which used to be excellent so i had to write a perl script to convert from outlook.com csv to nokia csv [12:17] "CSV" is just a terrible design [12:17] CSV isn't designed [12:17] There's no standard behaviour [12:18] There's no standard implementation [12:18] That's what I just said [12:18] csv is terrible... until you compare it with the alternatives [12:18] And it's not simple enough - too many edge cases [12:19] The Unix way is, of course, better [12:19] Three characters - one escape char, one field separator, one record separator [12:19] i like csv but i do like when the software i'm dealing with isn't stupid [12:19] > http://www.catb.org/esr/writings/taoup/html/ch05s02.html [12:20] I've been using cookie-jar for a lot of data conversions recently after writing a small Python program that can grok it one afternoon [12:20] Or "record-jar" [12:20] Just turns each record into a dict and lets you iterate over them [12:21] Easy to write, easy to process, easy to hack around not-quite-proper data with a text editor or shell tools [12:22] JSON and XML are nice when the data is well curated, but for quick and dirty, you want things you can manipulate with grep sed and awk [12:25] With CSV the thing that causes trouble is the way that various implementations quote text fields [12:28] it can get /messy/ but as long as they don't make a complete haims of it you can usually make it work [12:36] hi;] === alan_g|lunch is now known as alan_g [14:00] awilkins++ for record-jar === alan_g is now known as alan_g|EOD === Lcawte is now known as Lcawte|Away [18:43] daftykins: looks like you're atracting the crazies today [18:43] heh [18:44] somehow this user lost their /home/username entirely so my attempts to ask for a pastebin of ls -al ~/ failed [18:44] yeah, he/she seems rather lost [18:46] grr, I hate that "I got ubuntu 15 installed" [18:46] 15 isn't a valid release [18:46] or 14.4 [18:46] :> [18:46] yeah that's horrid [18:47] worse is 14.1 [18:50] I'm a bad nerd :( I went to Maplin [18:50] hehehe [18:50] do you have many things you don't need, now? [18:51] nah, they price themselves out of spree territory [18:53] ah [18:54] i remember popping in the one in Brighton once or twice and being horrified at the ridiculous kinds of things you get in there [18:54] contraptions that solve problems for folk who are doing it wrong to begin with :D [18:54] yes, that's why I go there :) [18:54] XD [18:55] think i saw a £90 Pi starter kit once [18:55] it's good to look around and have a delve in their junk bins [18:56] yeah they have that fuze one in there, which is the wrong side of 200e [18:57] which is a pretty uninspired kit but mounted into a metal chassis that makes it look like the kinda computer zmoylan would pine for [18:58] :D [19:00] * penguin42 remembers a bunch of us in a Pizza express in ~2000 saying that if it were run by Maplin we'd have to assemble the pizza from 3 different stores to get all the bits we needed [19:03] of course, now that I've finally bothered to go pick up some blank cds, I can't find my burner anywhere [19:05] Evening [19:08] shauno: Above your zip drive [19:20] hm. that cheap, ancient mac mini I picked up. I'd never thought to test the cd drive in it [19:20] it works, but I'm sure the neighbours can hear it working [19:54] what do you do with the mac mini shauno ? runit like a rasp pi? [19:59] where i taught was a nightmare with optical drives for the training network [19:59] if it wasn't them dying, it was the old hard disks [20:00] then you'd get a student pranking another by flicking the 110/230V PSU switch [20:01] trying to install amigaos on it foobarry, so I just needed anything that was ppc and common [20:03] i have one too [20:04] do the games all work? [20:06] I'm nowhere near that yet. still trying to get it to use the bootloader off a harddrive :/ [20:07] are you following a howot? [20:07] howto? [20:07] not really. I haven't found a whole lot useful [20:07] there's people discussing how to get the bootloader onto the CD so that you can boot into the installer [20:07] oh [20:08] https://www.youtube.com/watch?v=Hx3uszPPARA [20:08] he talks too much [20:08] and then it just goes quiet. so for what goes next, "fumbling" [20:08] should be 10 mins long [20:08] yeah. and he's got it on supported hardware, so it's point and click [20:08] oh its MONEY [20:09] non free [20:09] but those amigaone boxes are silly expensive [20:10] 2125 gbp for the supported hardware. [20:10] did you buy the OS? [20:10] as in 2 grand? [20:10] O_O [20:11] yes, as in 2 grand. or 3 in euro. [20:11] for a 500MHz g4. [20:11] had more fun putting riscOS on a pi [20:11] heh [20:11] which is why I'm trying to force it onto the mini instead :) [20:11] i have an old gnatbox gb1000 firewall, rackmountable etc. might put pfsense on it [20:12] (and no, I haven't bought the OS. I likely will if I can get it to boot, because I'm weird. but no boot, no moneys) [20:14] i don't begrudge buying software, since i buy games. [20:14] but as a long time acorn, then linux guy, with solaris in betwen, buying an OS feel wrong [20:15] ah i had acorns at secondary school [20:15] obviously using a paid OS without paying feels wrong too [20:15] you'd have 4 banks of ~5 or 6 machines in a room, with a SCSI hard disk per bank that all of them ran the software off [20:16] yeah, it was great [20:16] "econet" [20:16] amusingly said HDDs were shared off the slowest ones they had [20:16] ooh yeah that's funkynuts [20:16] and naturally, being used directly they crawled even more [20:16] I've been fiddling with cygwin [20:16] I dunno. I think amiga's niche enough that it has to come from somewhere if we want anything new [20:16] right at the end there were a couple of A7000s which were quite nippy [20:16] I mean, it's not like they're going to be able to survive of corporate support contracts for it [20:16] I've managed to got X running seamlessly and now it autostarts with no indication that it's running [20:17] for sure, i don't begrudge them asking money. baby needs shoes etc [20:17] so my X clients appear seamlessly in my windows desktop and I have no evidence that they're X [20:17] but usually they are pet honny projects [20:17] diddledan: i did that once [20:17] then found xming [20:18] then found mobaxterm which works even better [20:19] diddledan: Yeh I remember that from years ago, neat setup [20:20] that's the big problem I guess. it pretty much is a hobby project, except the folks that hold the amiga licence are still trying to milk it [20:20] oh, i think there was a simliar thing with riscos [20:20] diddledan: what provides that o0 [20:20] until recently [20:20] oh cygwin [20:20] i thought that was an oft hated thing :D [20:20] life's too short for cygwin :p [20:20] get ye to the putty [20:20] https://www.riscosopen.org/content/downloads [20:21] shauno: mobaxterm is putty on steroid [20:21] nay, KiTTY! :) [20:21] URL parsing \o/ [20:21] see I want more than just an ssh client [20:21] it features a x server and graphical sftp [20:21]