QDS - Big Data Platform

Home > Products > Qubole Data Service

The First Autonomous Big Data Platform

A SELF-MANAGING AND SELF-OPTIMIZING DATA PLATFORM.

Constantly analyzes and learns about your big data platform’s usage through a combination of heuristics and machine learning.

Provides actionable Alerts, Insights, and Recommendations (AIR) to optimize reliability, performance, and costs.

Automatically enacts policies through a number of Cloud Agents to eliminate the need for repetitive manual actions

Learn more

Product Overview

Qubole Data Service (QDS) is the first Autonomous Big Data Platform. The leader in big data platforms, Qubole self-manages, self-optimizes, and learns from your usage, allowing the data team to focus on business outcomes rather than on managing the platform.

Built for anyone who uses data

Data Engineers,
Data Ops,
Analysts,
Data Scientists

Works the way you do

Access insights through web interface,
Notebooks,
APIs and 3rd party BI tools

Single Platform for every use case

ETL and Reporting,
Ad-hoc,
Stream Processing,
Machine Learning

Open-source Engines, optimized for the Cloud

Spark, Hadoop, Presto, Hive and others

Cloud Native, Cloud Agnostic and Cloud Optimized

Takes full advantage of the elasticity and scale of the Cloud and eliminates the risk of vendor lock-in
Runs on AWS, Microsoft Azure and Google Cloud

Learn how to make you more productive

Comprehensive Security, Governance and Compliance

SOC2 Type II
End-to-end Encryption
Global Availability Zones
VPCs
Role-based Access Control

The Best Big Data Platform in the Cloud

Cloud-Native

Decouples compute and storage

Ephemeral clusters minimize cost by running only when needed

Use Cloud object storage for persistent data storage

Leverages the individual strengths of each public Cloud provider

Cloud-Agnostic

The broadest choice of popular public Cloud providers

Common platform and API enables workload portability by changing one line of code

Cloud-Optimized

Performance optimizations between the clusters and Cloud object store

Packaged machine images reduce cluster startup times by 40%

Why It Matters


Cost efficiency	Cloud-optimized to pay for only what you use Granular control of cost vs SLAs Spot Shopper Agent shops for lowest cost resources (AWS Only) 30%-50% lower cost than other Cloud solutions and up to 80% lower TCO than on-premise deployments
SLAs & performance	Control performance and SLAs using Workload Aware Auto-scaling to add/subtract compute nodes dynamically
Productivity	Cloud based big data platform enables collaboration and sharing between data teams, analysts and data scientists Built-in collaboration features help analyst and data scientist share their work Persistent metastore reduces cluster uptime
Ease of scale	Turnkey solution: minimizes manual configuration and management Scale compute and storage independently
Eliminate vendor and technology lock-in	Cloud-agnostic: deploy your big-data platform on your Cloud of choice or distribute your workloads across multiple Clouds Choose the optimal big-data engine for your workload and take advantage of new versions instantly Uses your Cloud object store so data can be shared with non-Qubole tools

Architecture

Qubole Data Service orchestrates resources on the customer’s Cloud account based on dataops-defined security policies and target workload SLAs. Separation of compute and storage ensures that compute resources can be scaled as needed without being constrained by storage costs and limitations. Clusters are automatically activated, scaled and terminated in response to user queries submitted via Workbench, Notebooks, API requests from external applications, or third-party Business Intelligence tools, via ODBC/JDBC integration.

Get started with qubole

Qubole Data Service

The First Autonomous Big Data Platform

A SELF-MANAGING AND SELF-OPTIMIZING DATA PLATFORM.