Also why don't you dump the log data into a NoSQL like dynamoDB instead of S3 ?

Athena looks cool. Didn't know about it. It probably describes what I'm trying to do.

> Also why don't you dump the log data into a NoSQL like dynamoDB instead of S3 ?

Price.

If your data storage requirement is semi-constant at 1.5TB and is ephemeral, have you looked at just using your own replicated servers ?

That would probably turn out to be cheaper than using S3 - https://github.com/minio/minio