Structured Streaming API, introduced in Apache Spark version 2.0, enables developers to create stream processing applications. These APIs are different from DStream-based legacy Spark Streaming…
Structured Streaming (SS) is one of the core components of Apache Spark. As part of the Spark on Qubole offering, our customers can build and…
AWS recently announced Managed Streaming for Kafka (MSK) at AWS re:Invent 2018. Apache Kafka is one of the most popular open source streaming message queues.…
Introduction In the first blog post of the series, We gave an overview of the data pipeline required to find the trending topics in Wikipedia. In…
Select your cloud provider:
See what our Open Data Lake Platform can do for you in 35 minutes.