Corporate Blog

Data Lake Essentials, Part 3 – Data Lake Data Catalog, Metadata and Search In this multi-part series we will take you through the architecture of… The post Data Lake Essentials, Part 3 – Data...

This is an abridged version of the article that appears on NewStack BI tools have been the go-to for data analysts who help business track… The post Cloud Data Lakes – Best Practices appeared...

Apache Airflow is one of the most powerful platforms used by Data Engineers for orchestrating workflows. Airflow was already gaining momentum in 2018, and at… The post Apache Airflow Tutorial –...

Data Lake essentials, part 2 – file formats, compression and security In this multi-part series we will take you through the architecture of a Data… The post Data Lake Essentials, Part 2 – File...

Data Lake essentials, part 1 – storage and data processing In this multi-part series we will take you through the architecture of a Data Lake.… The post Data Lake Essentials – Part 1 – Storage and...

This blog covers new benchmark tests to better understand Autoscaling behaviour of concurrent Apache Spark applications. We believe that this will help in advancing research… The post Apache Spark...

Guest authors: Jerry Xu, Co-founder and CEO Datatron; Lekhni Randive, Product Manager, Datatron Qubole author: Jorge Villamariona, Sr. Product Marketing Manager, Qubole In today’s world,… The post...

The sixth release of Apache Sqoop i.e. 1.4.7 is out! This is one of the most significant updates to the Sqoop platform. We give you… The post Apache Sqoop 1.4.7 – 9 reasons why you need it...

Data scientists use Notebooks for data exploration, interactive data analytics, machine learning, and collaboration. Once set up, a Notebook provides a convenient way to save,… The post Analytics...

Introduction Presto can access S3 Buckets using one of the following options: IAM roles provided in the configuration Access-key/Secret-key provided in the configuration Credentials fetched… The...

Introduction Qubole provides powerful automation that optimizes underlying cloud compute management for data lakes. Qubole cluster management continuously optimizes both performance and cost by...

Introducing Qubole Support Qubole processes over 250 Petabytes of data in a month, and the diversity of data we process, clouds platforms we run on,… The post Qubole: The Super Powers of Support...

Data lakes are at the heart of digital transformation in the enterprises. As more organizations run analytics, machine learning, and ETL workloads on the data… The post Addressing Regulatory GDPR...

Introduction Enterprises are today becoming more data-driven as their data is the fuel to their innovation engine to build new products, outmaneuver the competition and… The post Practical Guide...

This post is a guest publication written by Saba El-Hilo, a Senior Data Engineer at Mapbox. A version of this post first appeared as a… The post Calculating 30 billion speed estimates a week with...

Introduction ETL workloads form a major component of big data processing at any data-driven organization – from SMBs to enterprises, and ETL data pipelines at… The post Hive on Qubole runs 4x...

Introduction In an earlier blog post, we presented a secure, multi-tenant, reliable, and scalable service that provides access to logs and history for MRv2 applications.… The post Scaling Tez...

Qubole now supports efficient updates and deletes for data stored in Cloud data lakes. Users can make inserts, updates and deletes on transactional Hive Tables—defined… The post Qubole...