| zmoylan-pixi | just 1 toe | 00:04 |
|---|---|---|
| diddledan | I shall now call you hop-a-long | 00:05 |
| zmoylan-pixi | and 6 weeks of iv antibiotics | 00:05 |
| diddledan | dang, that's a lot of infection | 00:05 |
| daftykins | yep the toe got a whole case of zmoylan for years ;D | 00:06 |
| zmoylan-pixi | then had to wait a few days for picc line to be removed... pic.twitter.com/83m6d42Ari | 00:07 |
| diddledan | when I see a link: https://www.youtube.com/watch?v=TTUQyEr-sg0 | 00:51 |
| diddledan | must. click. the. link. | 00:52 |
| daftykins | mm falling asleep here, g'night \o | 01:26 |
| shahin | Hi, anyone can suggest about linux free course via online?? | 02:58 |
| SuperMatt | hey hey hey | 08:11 |
| diplo | Morning all | 08:47 |
| zmoylan-samj3 | yayyyy | 09:02 |
| brobostigon | morning boys and girls. | 09:38 |
| foobarry | what do i ask the in-laws for for xmas? | 09:48 |
| foobarry | they will buy something i don't need unless i give an idea | 09:48 |
| brobostigon | can i ask my in-laws to clear my credit cards? | 09:49 |
| foobarry | leecowdrey: its on an HPC cluster. so the machine has 48 cores, but the job requests only 1 core so instead of 48 threads (confined into 1 cpu lol) i want it to use 1. other apps manage it, not java | 09:50 |
| leecowdrey | foobarry: ok so following `number of threads = total virtual memory / (stack size*1024*1024)` then determine current virtual memory `ulimit -v` and apply at the process level of the user running java with `ulimit -s newvalue` for soft limit and `ulimit -v newvalue` for the hard limit. This constrains maximum available not maximum used, so given it is java then you manage maximum used from in Java within your | 11:34 |
| leecowdrey | code (i.e. limits specified in ExecutorService) | 11:34 |
| leecowdrey | foobarry: you can though set machine wide rather than process specific; to retrieve it: `sudo cat /proc/sys/kernel/threads-max`, to set it: `sudo echo 123456789 > /proc/sys/kernel/threads-max` | 11:36 |
| foobarry | leecowdrey: fogive my java ignorance, but is there an easy way to limit to 1 thread? because what i see happening is lots of unecessary threads when the user just requested 1 core. more threads lowers the performance because the scheduler (and cgroups) has limited the user to the 1 core they requested although the compute node has 48 cores. | 11:51 |
| foobarry | hence he gets 11mins runtime instead of 3mins on his desktop because of these many threads constrained to 1 cpu | 11:52 |
| foobarry | he's running java -Xmx10G , requesting 1 core and 15G from the job scheduler | 11:54 |
| foobarry | gonna play with ulimit | 12:12 |
| SuperMatt | Christ, I am so bored. I'm WFH today, spent the last hour napping, and didn't have a single email or message waiting for me. The new job couldn't start soon enough | 12:13 |
| foobarry | learn tensorflow! | 12:14 |
| foobarry | ther's good tutorials on youtube | 12:14 |
| foobarry | i am literally doing 3 things at once today | 12:14 |
| TwistedLucidity | foobarry: Seeing Java mentioned, reminded me of this - https://www.humblebundle.com/books/java-books | 12:21 |
| TwistedLucidity | leecowdrey: ^ | 12:21 |
| TwistedLucidity | foobarry: You want to limit Java to only ever run one thread on one core? | 12:22 |
| leecowdrey | foobarry: if you want to limit to 1 thread then dont use threads | 12:24 |
| foobarry | TwistedLucidity: yeah, or at least one thread PER core | 12:24 |
| TwistedLucidity | foobarry: Is the code yours (i.e. you can edit/configure it) or third party? | 12:24 |
| foobarry | how to not use threads? | 12:25 |
| foobarry | its a user's code, and he's using some 3rd party bits | 12:25 |
| TwistedLucidity | Hah. Game over then, the third party code could start as many threads as it sees fit. | 12:25 |
| foobarry | i seeem to be having some success with ulimit | 12:26 |
| TwistedLucidity | Limiting it to n threads, sure; that should be doable | 12:26 |
| foobarry | need to benchmark to see impact on the speed though | 12:26 |
| foobarry | i'm doing ulimit -v as per lee | 12:26 |
| TwistedLucidity | "ulimit -u <number processes>"? | 12:27 |
| TwistedLucidity | Must confess, this isn't something I've had to worry about. Mostly I've sobbed over GC issues. | 12:27 |
| TwistedLucidity | You've probably read this (and it looks simialr to Lee's suggestion) https://stackoverflow.com/questions/17341883/limiting-number-of-threads-used-by-the-jvm | 12:28 |
| foobarry | i wish irc showed visited links in red :P | 12:28 |
| foobarry | java is the worst code for HPC | 12:29 |
| foobarry | it's not H or P | 12:29 |
| TwistedLucidity | It's a tool for a job | 12:30 |
| TwistedLucidity | Your user /might/ be able to do something with "Executors.newSingleThreadExecutor();" | 12:31 |
| foobarry | the other threads don't seem to do anything | 12:35 |
| foobarry | sit at 0% cpu even when i allow more cores | 12:35 |
| foobarry | https://imgur.com/a/I9IYg | 12:37 |
| twinsen^wee | ++ | 12:40 |
| foobarry | they are in S state | 12:41 |
| diddledan | why do we have /bin AND /usr/bin ?! http://lists.busybox.net/pipermail/busybox/2010-December/074114.html | 14:10 |
| daftykins | diddledan: now i'm killing disks in the builders laptops, sandybridge i3 acer with 202 bad sectors today | 16:43 |
| leecowdrey | ....When UNIX was first written, /bin and /usr/bin physically resided on two different disks: /bin being on a smaller faster (more expensive) disk, and /usr/bin on a bigger slower disk. Now, /bin is a symbolic link to /usr/bin: they are essentially the same directory. | 16:43 |
| leecowdrey | well not linked on ubuntu but other platforms (UNIX not Linux) were | 16:45 |
| leecowdrey | so historical hangups..... there was some plans to tidy it all up as does not just apply to /bin and /usr/bin - plenty of other examples | 16:47 |
| diddledan | daftykins: you complete barsteward | 16:47 |
| daftykins | diddledan: he said his granddaughter went to use it and it didn't boot anymore! | 16:47 |
| diddledan | what kind of "help" do you call killing a disk?! | 16:47 |
| leecowdrey | daftykins: well it wont boot now, i know, you just making sure right ? | 16:48 |
| daftykins | diagnosis, then popping in an old spare + upgrading it to win10 | 16:48 |
| daftykins | leecowdrey: haha, it's just a joke - i didn't kill it really - just identified it was bad in the SMART data | 16:49 |
| daftykins | me and diddledan just have a long running joke | 16:49 |
| * daftykins winks | 16:49 | |
| diddledan | I'm finally catching up on stranger things | 16:51 |
| diddledan | up to episode 6 | 16:51 |
| daftykins | \o/ | 16:52 |
| daftykins | i've been moving slow on season 2 myself | 16:52 |
| diddledan | I'm on s1 :-o | 16:53 |
| diddledan | yey for netflix meaning I get to watch at my leisure though | 16:54 |
| diddledan | broadcast is so passé | 16:54 |
| daftykins | i much prefer download :P | 17:01 |
| daftykins | consistent quality, higher bitrate... #1 | 17:02 |
| diddledan | is that "download" or "download ;-)" | 17:02 |
| daftykins | although i did just pay £150 to an aerials guy to put a brand new antenna on my roof and leave a drop cable in my eaves corner, so i'll wire things up internally later | 17:02 |
| leecowdrey | daftykins: punny | 17:11 |
| diddledan | besides the chief, is there only two other policemen? (the ones in uniform) | 17:24 |
| diddledan | they seem to be the only two you ever see, at least | 17:25 |
| daftykins | small town! | 17:25 |
| daftykins | secretary counts in a way, too ;D | 17:25 |
| diddledan | lol | 17:25 |
| daftykins | i am really tempted to pull the trigger on a 55" LG OLED B7 and a new 4K capable AV receiver given these sale prices | 17:28 |
| diddledan | :-o | 17:28 |
| daftykins | TV is down to £1,250 to rock dwellers now! | 17:29 |
| diddledan | I think we should impose special rock-duty on you lot | 17:35 |
| daftykins | our government shall tell you your fortune! | 17:36 |
| daftykins | we already get royally *cough* inconvenienced by your gov on a regular basis | 17:36 |
| diddledan | I'd rather they give me my fortune | 17:36 |
| daftykins | if they demanded tax from us we'd have to dump, er, not tea but maybe our actual lovely exports into the harbour | 17:37 |
| diddledan | even that gorgeous butter?! | 17:38 |
| diddledan | that'll make a mess | 17:39 |
| daftykins | swimming in the harbour might become a varied experience | 17:39 |
| daftykins | maybe the butter will set off any further WW2 bombs that haven't been found, (one was just the other day) | 17:40 |
| daftykins | the ferries had been going over the top of it all those years | 17:40 |
| diddledan | eep | 17:40 |
| diddledan | I love the synthesized sounds on the stranger things intro | 17:42 |
| daftykins | :D ja | 17:43 |
| daftykins | nice and bassy too | 17:43 |
| diddledan | they're building a sen-dep tank | 18:06 |
| diddledan | what's the salt for? | 18:06 |
| diddledan | bouyancy? | 18:06 |
| daftykins | shh spoilers to anyone present who has not seen :P | 18:06 |
| diddledan | nice bat! | 18:21 |
| diddledan | I think they forgot the cheese though | 18:22 |
| diddledan | looks like zimbabwe has a new president | 18:25 |
| diddledan | http://www.bbc.co.uk/news/live/world-africa-42063744 | 18:25 |
| diddledan | of course it was an entirely consensual accession that mugabe agreed to willingly | 18:26 |
| diddledan | https://i.imgur.com/bkfZ02p.mp4 | 18:30 |
| daftykins | absolutely | 19:42 |
| diddledan | https://cdn.vox-cdn.com/thumbor/vUGrr0nycaelcE_s2ZSR6g4Hlh8=/0x211:2288x1498/1600x900/cdn.vox-cdn.com/uploads/chorus_image/image/50821489/spam-wall.0.0.jpg | 19:43 |
| diddledan | SPAM! | 19:43 |
| daftykins | don't think i've ever tried any | 19:45 |
| diddledan | it's a mainlander thing :-p | 20:01 |
| diddledan | you scurvy scum aren't likely to have such things there | 20:01 |
| daftykins | ;] nah i've seen it! | 20:02 |
| diddledan | lol @ episode 2's closing music | 20:48 |
| diddledan | s2 | 20:48 |
| * diddledan binging | 20:48 | |
| diddledan | cat. | 22:17 |
| diddledan | that's all I'm saying | 22:17 |
| diddledan | cat. | 22:17 |
| daftykins | mrow. | 22:18 |
| zmoylan-pi | *bark* | 22:23 |
| diddledan | baa | 22:46 |
| daftykins | diddledan: back in Wales? ;) | 23:08 |
| daftykins | bed time \o | 23:08 |
| diddledan | nah, out on a date | 23:08 |
| daftykins | diddledan: these are not one and the same? | 23:09 |
| daftykins | zmoylan-pi: yay for home! :) | 23:09 |
| zmoylan-pi | the pi is alive, i repeat the pi is alive :-) | 23:09 |
| diddledan | mmm, pi | 23:09 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!
