Meta manages an extensive video catalog with over a trillion videos across various products, and this number is growing daily with more than one billion new videos added each day. The challenge lies in maintaining an efficient storage footprint while accommodating this continuous influx of new content. The goal is to achieve Pareto efficiency, optimizing the storage space without compromising the quality of the videos delivered. This balance is crucial for sustaining scalability and efficiency in Meta’s Video Infrastructure.

This talk will delve into an innovative method for addressing the problem at hand. It will discuss the fundamental concepts underpinning this approach and share valuable insights gained during its development and implementation. In particular, it will highlight effective strategies that have proven successful in enhancing storage efficiency without negatively impacting video quality. Furthermore, the presentation will touch upon the ongoing evolution of the system, showcasing how it is continually being improved to better tackle the challenge of managing an ever-growing video catalog while maintaining optimal storage usage. By sharing these learnings with others facing similar challenges, the hope is to contribute to the collective knowledge base and ultimately facilitate the development of more efficient and effective systems for managing large-scale video repositories. This talk was presented at Demuxed 2024, a conference by and for engineers working in video. Every year we host a conference with lots of great new talks like this in San Francisco. Learn more at https://demuxed.com