A Hub and Spoke Approach to Scaling Storage - Mark Senerth & Mohan Naidu, The Walt Disney Company

November 25, 2020

Today’s modern distributed data platforms are expanding at a quadratic rate in both size and complexity. It is more important than ever to define clear lines of delineation between compute and storage which allows both to scale independently. Scalability is becoming more and more important - both handing volume for a single data source as well as adding collections of disparate data sources into the data catalogue. Ultimately it is inevitable that data sources will be shared outside the platform to inside the platform and vice versa. In this presentation we will discuss the challenges with scaling storage and delve into the approach we have taken in The Walt Disney Company’s DTCI Data Platform to solve these complex issues in an easily maintainable, governable, audit-able, and simplistic way.

Previous Video
Analytics on Analytics: Leveraging Metadata in the Big Data Landscape - Kent Buboltz, Expedia Group
Analytics on Analytics: Leveraging Metadata in the Big Data Landscape - Kent Buboltz, Expedia Group

Advancements in the data and analytics space are commonplace nowadays, with the latest features and product...

Next Video
Decentralized Data Platform at Bukalapak - Hafiz Badrie Lubis, Bulkalapak
Decentralized Data Platform at Bukalapak - Hafiz Badrie Lubis, Bulkalapak

Businesses make many decisions to deliver values to their customers or users. As the key component of makin...