Shefali Aggarwal
You Need a Cloud-Native Platform to Succeed with Big Data
A recent article from McKinsey claimed that on average only 15 percent of big data projects meet expectations. For all the promise that big data…
Exploiting AWS Spot Instance Termination Notifications in Qubole
The seamless use of AWS Spot Instances for Apache Spark, Hive, and Presto has been a marquee feature of Qubole’s AWS offering since 2015. We…
Package Management, or: How I Learned to Stop Worrying and Love Dependencies
Qubole just launched its Package Management feature, which is available on all of its Spark clusters. Package management makes it easy for data scientists to…
An Introduction to Apache Spark Optimization in Qubole
With the increasing adoption of big data for various business processes, cloud expenditure is growing increasingly more important and, in some cases, becoming a limiting…