Enabling Spark SQL MERGE via optimized ACID Data Source v0.6.0
|September 15, 2020
We are pleased to announce the 0.6.0 release of the ACID Data source for Apache Spark. This release should further empower Data lake users in…
Vikram Agrawal
Introducing Apache Spark 3.0 on Qubole
|September 2, 2020
We are pleased to announce the availability of Apache Spark 3.0 in the Qubole environment. Spark 3.0 release comes with a lot of exciting new…
Qubole launches Pipelines Service to democratize streaming analytics
|August 18, 2020
Data Engineers and Enterprises continue to struggle with Stream Processing at scale. In our extensive discussions with customers and partners, we repeatedly found the following…
Introducing Kinesis Connector for Structured Streaming
|March 21, 2019
Structured Streaming API, introduced in Apache Spark version 2.0, enables developers to create stream processing applications. These APIs are different from DStream-based legacy Spark Streaming…
Reliable Structured Streaming on the Cloud with Direct Write Checkpointing
|March 5, 2019
Structured Streaming (SS) is one of the core components of Apache Spark. As part of the Spark on Qubole offering, our customers can build and…
Amazon Managed Streaming for Kafka (MSK) with Apache Spark on Qubole
|January 15, 2019
AWS recently announced Managed Streaming for Kafka (MSK) at AWS re:Invent 2018. Apache Kafka is one of the most popular open source streaming message queues.…
Qubole Demo : Analysis and Export
|September 26, 2013
Introduction In the first blog post of the series, We gave an overview of the data pipeline required to find the trending topics in Wikipedia. In…
