lewman.blog
Parsing 500 GB of Logs with Ruby Every Day
I’m working on a research project where we’re parsing 500-750GB of log data per day. Initially, the hack was to use fish shell scripts to automate grep, awk, etc. Quickly, we realized t…