SAMI needs to ingest, serve and take realtime decisions at a large scale. In this talk he shows briefly:
* How to build scalable queries using Cassandra, Redis and Elastic search.
* High performance batch jobs using Apache parquet columnar storage format.
* Trade offs between idempotent writes and Streaming counters real time.