Skip to content
  • SVTA University Calendar
  • Courses
    • In-Person Training
  • Hot Topics
  • Education Resources
    • Conferences
      • Demuxed
      • Mile High Video
      • NAB Streaming Summit
      • SEGMENTS
      • Streaming Tech Sweden
    • Industry Resources
    • Media Samples
    • SVTA Webinars
  • Instructors
  • Register
  • Log In
  • SVTA University Calendar
  • Courses
    • In-Person Training
  • Hot Topics
  • Education Resources
    • Conferences
      • Demuxed
      • Mile High Video
      • NAB Streaming Summit
      • SEGMENTS
      • Streaming Tech Sweden
    • Industry Resources
    • Media Samples
    • SVTA Webinars
  • Instructors
  • Register
  • Log In
$0.00 0 Cart

Conference Proceedings

  • Home
  • Decoder Complexity Aware AV1 Encoding Optimization
Decoder Complexity Aware AV1 Encoding Optimization

Description

AV1 has included more than 100+ coding tools compared to its predecessor VP9. AV1 hence left an impression to the community that yes, it is more coding efficient, but it is slow, fairly slow. Indeed, great thanks to our open source communities, AV1 encoders have been constantly optimized w.r.t. both its coding efficiency and encoding speed. To date, there are three well known open-source AV1 encoders: SVT-AV1 initiated by the joint effort between Intel and Netflix, and has also been specified by AOM SIWG as the version-0 codebase; rav1e initiated by Mozilla, as well as libaom initiated by AOMedia. For instance, from January 2019 through April 2020, just checking libaom by example, the AV1 encoder has been speedup by more than10x (not 10%), and the coding efficiency, quantified by the well acknowledged BD-rate figures, has also been improved by more than10% concurrently. Also, sincere thanks to the AOMedia funded dav1d endeavor, an open AV1 software decoder initially jointly developed by VideoLan, Mozilla, and Two Orioles, the launching of AV1 as real products within 2 years of the finalization of the standard is not a far-fetched dream anymore, before the wide availability of hardware decoders in the market. The continuous optimization of dav1d opens the door to AV1, and feasible user scenarios are being identified where software decoding solutions can be deployed and accepted. In this talk, we will address the AV1 encoding optimization from a different angle, namely decoder complexity aware AV1 encoding optimization. As we hone our strategies and algorithms to optimize AV1 encoders, in general, we are all trying on more superior coding efficiency well outperforming existing solutions, and meanwhile accelerating the encoding speed ready for a real product. Indeed, the awareness of the decoder complexity can in return collect valuable feedbacks to the AV1 encoder design, so that an AV1 encoder not only can achieve a sufficient good tradeoff between coding efficiency and encoding speed, but also help release the burden on the decoder side, to make the deployment of AV1 to an even wider community. We will first have a brief overview on current performance for dav1d, including stats collected specifically regarding its decoding speed and power consumption. The decoding speed of dav1d has been consistently confirmed to outperform all other existing AV1 software decoders. To check its performance over mobile phones, we have evaluated dav1d against the ffmpeg-h.264 software decoder and the openhevc software decoder, in terms of CPU usage [%], memory using [MB], current [mA], consumed power[mW], voltage [mV], and temperature [℃], over several typical mobile devices. Our results demonstrate that power consumption wise, dav1d is ranked between the aforementioned two decoders, worse than ffmpeg-h.264 but better than openhevc. Furthermore, we worked with our collaborators, to collect extensively the decoding speed stats running dav1d particularly over low end mobile devices. For instance, our collaborator selected 18 common test sequences, used SVT-AV1 Preset 6 to generate AV1 bitstream, and decoded them on XiaoMi 4, with Qualcomm Snapdragon 801 Quad-core processor. The test set of videos include resolution of 720×536, 960×536, 960×480, 1024×576, and 2024×536. It can be observed that at higher encoding bitrate, the use of decoder on such types of devices would be very challenging to decode in real time. Then we will address several coding tools that may directly affect the performance of the decoder complexity. We will then demonstrate the results that for specific content, certain coding tools may incur a large complexity at the decoder side whereas the encoding efficiency may only suffer a minimum degradation if such tools are skipped at the encoder side. For instance, AV1 includes block sizes ranging from 4×4 all the way to 128×128. By turning off extremely large partitions or the smallest partitions, a good trade-off may be achieved for a sufficiently good coding efficiency while incur not too much decoder side computational complexity, thus to have the decoder more capable of decoding in real time even over low end devices. The decoder complexity aware encoding design concept would further help drive the launching of AV1 forward. Presented at Demuxed 2020.

Conference

Demuxed 2020

Speakers

Zoe Liu

Co-Founder and CEO

Learning Categories

Encoding
Operations
Streaming
AV1
AVC
HEVC
Workflows

Other Proceedings

Here are some other proceedings that you might find interesting.

What Codec Should I Use?

Alan Resnick

Doing Server-Side Ad Insertion on Live Sports for 25.3M Concurrent Users

Ashutosh Agrawal

Is now the time to solve the deepfake threat?

Roderick Hodgson

Super Resolution: The scaler of tomorrow, here today!

Nick Chadwick

The do's and don'ts about Streaming security

Javier Brines Garcia

Modeling the conceptual structure of FFmpeg in JavaScript

Ryan Harvey

Objectionable Uses of Objective Quality Metrics

Richard Fliam

RTMP: web video innovation or Web 1.0 hack… how did we get to now?

Sarah Allen

Large-Scale Media Archive Migration to the Cloud

Konstantin Wilms

HEVC Upload Experiments

Chris Ellsworth

Related Courses

Below are some courses that might interest you based on the learning categories and topic tags of this conference proceeding.

What Codec Should I Use?

Alan Resnick

Doing Server-Side Ad Insertion on Live Sports for 25.3M Concurrent Users

Ashutosh Agrawal

Is now the time to solve the deepfake threat?

Roderick Hodgson

Super Resolution: The scaler of tomorrow, here today!

Nick Chadwick

The do's and don'ts about Streaming security

Javier Brines Garcia

Modeling the conceptual structure of FFmpeg in JavaScript

Ryan Harvey

Objectionable Uses of Objective Quality Metrics

Richard Fliam

RTMP: web video innovation or Web 1.0 hack… how did we get to now?

Sarah Allen

Large-Scale Media Archive Migration to the Cloud

Konstantin Wilms

HEVC Upload Experiments

Chris Ellsworth

Follow

Twitter Linkedin-in

User Area

  • Account
  • FAQs
  • Orders
  • Registration
  • Account
  • FAQs
  • Orders
  • Registration

Resources

  • About
  • FAQs
  • Legal Hub
  • Support
  • How-To Take A Course
  • How-To Navigate the Interface
  • About
  • FAQs
  • Legal Hub
  • Support
  • How-To Take A Course
  • How-To Navigate the Interface

SVTA Sites

  • Diversity and Inclusion
  • LABS
  • OATC
  • Open Caching
  • SEGMENTS
  • Streaming Video Wiki
  • SVTA Fellows
  • SVTA University
  • Diversity and Inclusion
  • LABS
  • OATC
  • Open Caching
  • SEGMENTS
  • Streaming Video Wiki
  • SVTA Fellows
  • SVTA University

© Copyright Streaming Video Technology Alliance (SVTA).

About the SVTA University

The SVTA University (SVTAU) is an educational arm of the Streaming Video Technology Alliance, providing courses and other instructional content related to understanding and working with components within the streaming video stack.

About the SVTA

The Streaming Video Technology Alliance is a global technical association committed to bringing video streaming companies together to help build a better viewer experience at scale. Find out more at www.svta.org.

Payment Forms

Stay In-the-Know!

Enter your email address below to subscribe to our newsletter for the latest in available courses and other Institute news. Note that by doing so, you agree to our privacy policy.

Loading...

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.