Selecting the right big data solution for your business is critical to ensuring a successful big data project.
Considerations on where data must be stored or migrated to, how the big data solution scales, and the amount of time required before a big data analytics project can begin must all be taken into account.
With such vast options of big data analytics solutions, identifying key difference between vendors is difficult. The chart below provides a side-by-side comparison of all major on-premise and cloud big data vendors.
Try Qubole, get started now.
 | Hortonworks | Cloudera | HDInsight | Databricks | AmazonEMR | Qubole | ||||||
| Deployment Model  |  On-Premises/Hosted | On-Premises/Hosted |  Cloud | Cloud | Cloud |  Cloud | ||||||
| Product Summary | 100% open Source Hadoop | OpenSource Hadoop with proprietary management | Big Data Infrastructure as a Service in the Azure Cloud | Standalone Spark Service | Big Data Infrastructure as a Service in the AWS Cloud | Cross-platform Big Data Service with Unified Metadata | ||||||
| Autonomous | NO Limited insight | NO Limited insight | NO | NO | NO | YES Alerts, Insights, Recommendations and Agents | ||||||
| Out-of-the-box Data Processing Engines | Installation required | Installation required | MapReduce, Hive, Pig, Spark, HBase, Storm | Spark | MapReduce, Hive, Pig, HBase, Cascading, Impala, Spark, Presto | MapReduce, Hive, Pig, HBase, Cascading, Spark, Presto | ||||||
| Must Migrate Data To Platform | YES | YES | NO* | NO** | NO** | NO*** | ||||||
| Data Store | On-Premises | On-Premises | Azure | AWS | AWS | AWS, GCP, Azure | ||||||
| Setup |  Manual | Manual |  Automatic | Automatic | Automatic |  Automatic | ||||||
| Management | Support and 3rd Party Consulting | Support and 3rd Party Consulting | No Big Data-specific Support | Full Management and Support | No Big Data-specific Support | Full Management and Support | ||||||
| Economic Structure | Software License and Support, Infrastructure Purchase and Personnel | Software License and Support, Infrastructure Purchase and Personnel | Elastic compute pricing | Elastic compute pricing | Elastic compute pricing | Elastic compute pricing | ||||||
| Scalability | Fixed Cluster | Fixed Cluster | Manual scaling, elastic, on-demand, no graceful downscaling | Manual scaling, elastic, on-demand, no graceful downscaling | Manual scaling, elastic, on-demand | Automatic, elastic, on-demand |
