July 16, 2015 Updated January 8th, 2024
This content was authored by Qubole and originally published on the AWS Big Data Blog.
Amazon Kinesis is a scalable and fully managed service for streaming large, distributed data sets. As applications (particularly on mobile and wearable devices) start to collect more and more data, Amazon Kinesis is becoming the starting point for data ingestion into AWS. However, all that data is only useful when it can be analyzed and used to influence business decisions. Many solutions can consume Kinesis streams for processing in various ways, but none of them offered near real-time querying of Kinesis using SQL. We at Qubole realized this and worked on the Presto connector for Kinesis.
