Ask HN: Working with Twitter Decahose

I have been following this discussion [1] & challenges on using datahose came up in few places. That leads me to earnestly ask:We are a brand new research group with just a few hands. This Twitter data is enormous (45-50GB/day for E Asia in JSON).
W…