Trying to automatically test what the end user actually sees and hears on their streaming device is hard – very hard. Automated testing methods often rely on unreliable data from player APIs, leading to inaccurate results. This talk aims to showcase our journey of how we experimented with content encoded with visual and audio queues to validate that our player APIs are really telling the truth about what the user is seeing.

This talk was presented at Demuxed 2024, a conference by and for engineers working in video. Every year we host a conference with lots of great new talks like this in San Francisco. Learn more at https://demuxed.com