Cost Optimization and Self-Service Reporting for a Data Lake Ecosystem - MiQ

October 28, 2020

Presented by Rohit Srivastava, Engineering Manager, MiQ & Bitanshu Das, Lead Data Engineer, MiQ This talk is about MiQ's journey to maintain a sustainable, efficient, and cost-effective Data Lake solution. It covers cost optimization initiatives taken in the space of data pipeline as well as infrastructure. A deep dive into the recent approaches to make cost reporting and debugging automated and self-served.

Previous Video
Why Nextdoor Ditched a Data Warehouse for a Centralized Data Lake - Ivan Peng, Nextdoor
Why Nextdoor Ditched a Data Warehouse for a Centralized Data Lake - Ivan Peng, Nextdoor

Presented by Ivan Peng, Software Engineer - Data Platform, Nextdoor Qubole and Nextdoor have been partners...

Next Video
Managing Transactions in Data Lakes - Joydeep Sen Sarma, CTO & Co-founder, Qubole
Managing Transactions in Data Lakes - Joydeep Sen Sarma, CTO & Co-founder, Qubole

An enterprise data analytics and reporting platform typically runs data pipelines with long and complex job...