barrydk | Mornings | 06:21 |
---|---|---|
inetpro | good mornings | 06:32 |
GnikLlort | Morning everyone | 06:42 |
thatgraemeguy | mornings | 08:19 |
kulelu88 | . | 10:14 |
gremble | o/ | 12:07 |
kulelu88 | \o | 12:22 |
Padroni | hola | 13:04 |
thatgraemeguy | http://www.linuxjournal.com/issue/16, Linux Journal from the same month that win 95 was released | 14:19 |
thatgraemeguy | in other news, what's a good irc client nowadays that isn't quassel? it's been locking up randomly as soon as i paste copied text and i think i've had enough | 14:20 |
kulelu88 | i think I am slowly murdering my PC with this text processing | 15:27 |
kulelu88 | thatgraemeguy: XChat | 15:27 |
kulelu88 | superfly: how do I check what processes are running in a docker container while an ipython notebook is running? | 15:39 |
superfly | kulelu88: docker exec -it <container name> bash | 15:51 |
superfly | ps -ef | 15:51 |
superfly | *shrug* that's what I would do | 15:51 |
kulelu88 | superfly: it worked, but I'm worried that maybe I should stop my script. It is running for 3 odd hours now | 15:54 |
Kilos | evening all, meds for a month first yay | 15:59 |
Kilos | ohi superfly inetpro gremble kulelu88 MaNI octoquad theblazehen_ Xethron and others | 16:00 |
kulelu88 | superfly: 5625 root 20 0 2484112 1.377g 2444 R 99.5 38.8 243:03.63 python :D | 16:04 |
kulelu88 | man, I now know why high-performance CPUs are important | 16:09 |
gremble | Hey Kilos | 16:26 |
gremble | Everything good? | 16:26 |
gremble | Hey kulelu88 | 16:26 |
gremble | thatgraemeguy: irssi or weechat is nice as well | 16:27 |
kulelu88 | Heyo gremble | 16:27 |
Kilos | yes ty gremble meds for a month for prostate and 22nd next month hospital for hernia | 16:27 |
gremble | Good | 16:27 |
Kilos | very tiring business going through that rigmarole though | 16:28 |
gremble | kulelu88: sure your script isn't looping somewhere where it shouldnt? | 16:28 |
gremble | I can imagine Kilos | 16:28 |
kulelu88 | gremble: it is the exact same code that worked on a subset of the data. | 16:29 |
kulelu88 | The biggest bottleneck is the way I am putting the data into Pandas. row-by-row doesn't work, but I have to do this to get the CSV (my end-goal) | 16:29 |
kulelu88 | *doesn't work quickly | 16:30 |
gremble | Ah alright | 16:30 |
gremble | Would it not be possible to do csv conversion with sed, ie. might that not be quicker? | 16:31 |
kulelu88 | quite possible gremble . I can wait it out this once, as the csv output will be a 1-time thing that I can import back all the time | 16:33 |
gremble | Because if you get it csv, the reading is in O(1) or something like that, so it should be quick | 16:35 |
gremble | I'm just guessing though. I've never attempted a large project like that | 16:35 |
kulelu88 | me neither, so I am expecting screw ups all the way to outputting just 1 graph :D | 16:36 |
gremble | :p | 16:40 |
kulelu88 | Imposter syndrome hitting me hard with this project gremble | 16:42 |
gremble | How because you feel you should be able to get it right? | 16:46 |
kulelu88 | gremble: Due to the fact that I cannot even wrangle the data slightly, whereas doing it in excel would make me super-fast | 16:48 |
kulelu88 | I guess there is a deep(er) learning curve than I expected | 16:48 |
gremble | You had to learn excel too. | 16:50 |
gremble | I'll probably be in your shoes next semester. | 16:50 |
gremble | I have statistics again. So I will be trying my hand at modelling in python and R in addition to SAS | 16:51 |
kulelu88 | gremble: SAS will be a breeze for you | 16:54 |
superfly | I try to stay away from maths. We don't get along. | 16:56 |
gremble | SAS is the worst programming environment invisioned ever | 16:57 |
gremble | Like it is literally the worse | 16:57 |
kulelu88 | superfly: you are my defacto SA mentor :P | 16:57 |
gremble | worst | 16:57 |
kulelu88 | gremble: I believe it is quite fast for computation though | 16:57 |
kulelu88 | Possibly written in C/C++ | 16:57 |
superfly | kulelu88: eish, poor you. Couldn't you find anyone better? | 16:58 |
kulelu88 | SAS lang itself is a DSL I'm guessing? | 16:58 |
gremble | superfly: You do my kind of maths every day though :D | 16:58 |
kulelu88 | superfly: your knowledge of Python is deep | 16:58 |
gremble | I'm not sure. but it is so hard to debug that shit | 16:58 |
gremble | You have to beg it for output | 16:58 |
gremble | or debugging info | 16:58 |
gremble | Unless it crashes to begin with, then you get really vague arrors | 16:59 |
gremble | errors* | 16:59 |
gremble | It was made for people to have to buy training | 16:59 |
gremble | It really doesn't need to exist anymore. | 16:59 |
gremble | We've got python (written in C, so your speed should be fine) and R. R is just difficult with big data sets because it loads it into memory | 16:59 |
gremble | But that can me worked through | 16:59 |
superfly | gremble: at the moment, I mostly click buttons. Don't know how that is maths 😉 | 17:00 |
gremble | Programming is mathematics :P | 17:00 |
gremble | I assumed that that is what you do | 17:00 |
gremble | xD | 17:00 |
superfly | It's supposed to be. | 17:00 |
superfly | Recently I haven't done a huge amount of that, been working on setting up tools for automating stuff | 17:01 |
superfly | kulelu88: I know more python than you, but that doesn't mean my knowledge is deep. | 17:01 |
kulelu88 | man, I'd sure love to be dockops and stick with containers :D | 17:02 |
kulelu88 | superfly: I bet you know how to optimize python code, doing that already makes your knowledge deep | 17:02 |
superfly | Well, I know a few tricks. | 17:04 |
kulelu88 | the deeper into the rabbit-hole though, the more I learn how stackoverflow is a programmers best tool | 17:05 |
kulelu88 | :D | 17:05 |
gremble | those stackexchange sites are an invaluable resource | 17:05 |
gremble | the few times that I've asked questions, I got punted pretty hard, but reading other answers and adapting from that has helped me more often than not | 17:06 |
gremble | Hey Cryterion | 17:08 |
Cryterion | Hi | 17:08 |
superfly | Hey Cryterion | 17:15 |
kulelu88 | superfly: what CRUD frameworks do you know of using python? | 17:30 |
superfly | CRUD? | 17:30 |
superfly | oh, you mean like an ORM? | 17:31 |
superfly | SQLAlchemy. | 17:31 |
kulelu88 | superfly: CRUD like "build me an application that keeps track of my fleet" | 17:41 |
superfly | kulelu88: Django has a bunch of stuff built in, if you want to try it. I personally prefer a combination of SQLAlchemy, Flask and AngularJS | 17:42 |
superfly | I prefer a minimalist approach, but if you're happy with the kitchen sink, Django apparently includes it. | 17:45 |
kulelu88 | thanks superfly | 18:05 |
Kilos | night all. sleep tight | 18:13 |
kulelu88 | gremble: from a couple of hours to a 30 second solution :D | 18:16 |
gremble | That is rad | 18:21 |
gremble | What did you do? | 18:21 |
magespawn | good evening | 18:21 |
kulelu88 | i stored everything into a list of lists and initiated with the list of lists | 18:22 |
gremble | Nice | 18:22 |
kulelu88 | noob level just dropped below 9000 gremble :P | 18:23 |
superfly | kulelu88: https://wiki.python.org/moin/PythonSpeed/PerformanceTips | 18:24 |
magespawn | having caught only the tail end of that i am not too sure what is going on | 18:24 |
kulelu88 | magespawn: paradigms of making code run faster | 18:25 |
magespawn | ahh right | 18:26 |
gremble | :P | 18:28 |
magespawn | so much to learn and so little time | 18:29 |
inetpro | good evenings | 18:31 |
magespawn | hi inetpro | 18:32 |
inetpro | magespawn: how you doing? | 18:33 |
inetpro | please note that we have a meeting here tomorrow | 18:34 |
inetpro | hope pieter[tab] will be there | 18:34 |
magespawn | good and you inetpro? yup i see so | 18:34 |
inetpro | his first time to chair | 18:34 |
=== magespawn_ is now known as magespawn | ||
magespawn | is there a way to get hold of him? | 18:41 |
gremble | Very carefully? | 18:42 |
magespawn | hah | 18:45 |
gremble | We're not talking about catching a porcupine, are we? | 18:45 |
magespawn | using only the thumb and forefinger, grasp firmly behind the jaw | 18:45 |
gremble | That is how I got my first girlfriend | 18:46 |
kulelu88 | was she human? :P | 18:47 |
gremble | I have to prove an equivalence relation on a database for my one subject. Sometimes math meets weird | 18:47 |
inetpro | magespawn: I sent him an email | 18:49 |
magespawn_ | random disconnect night i see | 18:52 |
kulelu88 | darn, matplotlib is not showing me graphs. fecking hell | 18:52 |
inetpro | magespawn_: and he responded positively, he will be here tomorrow | 18:53 |
=== magespawn_ is now known as magespawn | ||
magespawn | this is going to drive me nuts good night all | 18:59 |
magespawn | see you tomorrow | 18:59 |
=== kulelu88 is now known as kulelu88_afk | ||
superfly | kulelu88_afk: https://www.airpair.com/python/posts/optimizing-python-code | 19:23 |
=== kulelu88_afk is now known as kulelu88 | ||
Squirm | DONE | 21:23 |
Squirm | Home time :) | 21:23 |
melodie | hi | 21:24 |
melodie | what time is it in your place. | 21:24 |
melodie | ? | 21:24 |
kulelu88 | 23.30 | 21:27 |
Squirm | Hi melodie | 22:06 |
Squirm | Yeah, just gone 12pm now | 22:06 |
Squirm | hmm, I mean 12am | 22:06 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!