Automated Cluster Lifecycle Management

Start test drive

Auto-start, auto-terminate and intelligently rebalance clusters safely without data loss. Eliminate idle cluster cost.

Configure

Configure resources – clusters, workspaces, user accounts, and more with an intuitive graphical interface.

Fine-tune cluster configuration with cluster instances comparison using cluster based metrics such as performance, scale, startup time and cost of job.

Use customizable cluster dashboards to view workload statistics, notebook console, current composition and activity logs.

Manage

Auto-start, auto-terminate and intelligently rebalance clusters safely without data loss. Eliminate idle cluster cost

Qubole, makes decisions based on granular-level details such as task progression and completion time. Cluster management occurs autonomously in real time to avoid overpaying for compute, interruption of active jobs, or missed SLAs

Govern

Get visibility and usage tracking of cluster and cluster instances by user and workload. Use Life-cycle Manager status to measure spend with respect to business outcomes.

Qubole also provides information about various software package versions and AMIs associated with cluster and cluster instances to easily visualize and speed up debugging and comparative analysis.

We had very large datasets and had to run queries every day to populate smaller normalized tables so that we could analyze data over time. This required writing Python scripts, which can be time-consuming for our business analysts. Making our business users self-sufficient got us where we wanted to be. - Adam Rose, Head of Engineering - Adobe Advertising Cloud
Five Ways to Optimize Big Data Processing Costs in the Cloud
How to Scale New Products with a Data Lake using Qubole
Big Data Engineering for Machine Learning