=== sparkle_history is now known as sparklehistory
[04:40] <Takyoji> Trying to remember, is there a way to have output of a command save to a file, but still display on the command prompt as it's running as well?
[04:40] <kermit> Takyoji: tee
[04:40] <Takyoji> ahh
[04:40] <kermit> cmd | tee file
[04:42] <kermit> sometimes i'll do:  tar czf - /|tee out.tar.gz|md5sum|tee out.tar.gz.md5
[04:42] <kermit> so you dont have to pass the file twice
[04:42] <kermit> pass/process
[04:43] <Takyoji> ahh
[04:43] <Takyoji> Hopefully my little script works..
[04:43] <kermit> i cant think of an example but i often find myself teeing into a >(cmd) too
[04:45] <Takyoji> Yay, it seems to be working
[04:45] <kermit> yay!
[04:45] <Takyoji> I've written a bot to download all attachments on a forum that I don't have direct filesystem access to
[04:46] <kermit> usenet?
[04:46] <Takyoji> But can backup the database and get the attachment table to go by
[04:47] <Takyoji> Actually it's a phpBB forum. I used to have filesystem access to the website, but the owner updated the credentials, and didn't give me the new credentials, and is completely inactive. And I'm migrating the forum to a different server.
[04:47] <Takyoji> It's the ugliest crap I've done, but it absolutely works.
[04:47] <kermit> some wget command wouldnt do it?
[04:47] <kermit> something with -r
[04:47] <Takyoji> It has to authenticate
[04:47] <Takyoji> via HTTP POST
[04:48] <kermit> you can pass cookies to wget
[04:48] <kermit> and post
[04:48] <kermit> you login with your browser, look at your cookeis, then manually give the cookie to wget
[04:48] <Takyoji> and take hidden input fields into account as well
[04:48] <Takyoji> I've done that before in the past.
[04:48] <Takyoji> But actually it doesn't work that easily when you have two session IDs with one of them having potential variance.
[04:49] <kermit> oh hm
[04:49] <Takyoji> I've backed up all avatars using it.
[04:49] <Takyoji> I've mass deleted a long list of spambots using it
[04:50] <Takyoji> one-by-one, since I don't even have access to the database anymore either
[04:50] <Takyoji> And the list was built by doing various queries against a backup file of the users table
[04:51] <Takyoji> while asserting that no valid users were accidentally deleted in the process as well
[04:51] <Takyoji> I've done all of this purely with cURL in PHP and regular expressions
[04:52] <kermit> i really don't know how people survive without knowing regex
[04:52] <Takyoji> I have no idea how that's possible
[04:53] <kermit> if i had to choose betweer regex, or my car, i'd take regex.
[04:53] <Takyoji> However at the same time I've also been able to use simple string search functions to make something like an XML parser.
[04:53] <Takyoji> Not the most efficient method in a high-level language however.
[04:53] <kermit> parsing predictable XML isnt bad, but an actual XML parser needs a real XML library
[04:54] <Takyoji> I'm talking about any XML. Not like "find the <meta> tag"
[04:54] <kermit> #bash will flame you for trying to parse XML without an XML library
[04:54] <kermit> i do it in awk though
[04:55] <kermit> my old broker, interactivebrokers, let you download your transactions and statements in XML :D
[04:56] <Takyoji> Yay, it worked perfectly.
[04:56] <Takyoji> Ooo
[04:56] <Takyoji> I would love if there were more developer-friend companies out there
[04:56] <Takyoji> developer-friendly*
[05:03] <kermit> there's a TED lecture with a guy ranting about how we all need to demand to be just given the raw data
[05:04] <kermit> so then we can assemble various sets as we please and create new information
[05:08] <Takyoji> I may or may not have seen it
[05:35] <Takyoji> One thing I've always be curious of: what's the difference between SSH tunneling and a VPN?
[05:39] <kermit> i think VPN is an ipv6 feature
[05:39] <kermit> probably ipv6 tunneled through ipv4
[05:39] <kermit> ssh wouldnt be appropriate for a real vpm because everything would be subject to tcp restrictions
[05:39] <kermit> vpn
[05:40] <Takyoji> or even, 'what is a VPN?' for that matter
[05:41] <kermit> i think its like an ethernet bridge over an encrypted point to point connection via ip tunneling?
[05:41] <kermit> but thats just a wild guess
[05:42] <kermit> but, for example, i imagine you could exchange arp and broadcast rather than a mere point to point tunnel
[05:42] <kermit> and share the same subnet
[05:46] <_diablo> kermit: Takyoji http://www.schumi.ch/partner/SSHvsVPN.htm
[08:31] <Takyoji> oh the suspense of bulk operations..
[08:31] <Takyoji> Executing a 150MB file of SQL
[08:59] <_diablo> lol
[09:00] <Takyoji> I think it's been at least half an hour now
[09:00] <Takyoji> And mysqld is only operating at like up to 9% CPU usage
[09:00] <Takyoji> on the remote server
[09:04] <Takyoji> Bah, it's not even half-way done. I guess I'm going to sleep then
=== exigraff_ is now known as exigraff