Eagerly awaited across the tech industry, this week the Alliance for Open Media (AOMedia) has published the first complete version of the bitstream and decoding process specification for their royalty-free AV1 video codec. The release of the AV1 1.0 spec will enable backers of AOMedia to add support for the technology to their products or services, including taking the all-important step of finalizing the designs for the low-power hardware decoders critical for driving the codec's adoption. At least initially, AV1 will be used primarily for streaming video and user-generated content as an alternative to HEVC and its ongoing royalty disputes, but eventually adoption of AV1 may expand to other applications.

The AV1 open-source video codec was developed with 4K+ ultra-high-def resolutions, HDR, and wide color gamut in mind. Among the key features the new codec, AOMedia mentions a 30% more efficient compression algorithm compared to existing methods, predictable requirements for computational capabilities of hardware, and maximum flexibility and scalability. The backers of the AV1 want the codec to be ubiquitous across devices and platforms, therefore expect it to be supported not only by major chipmakers, software designers, and service providers, but also by leading makers of consumer electronics.

AOMedia does not disclose key technological peculiarities of the AV1 video codec in a short whitepaper form, meanwhile parsing through a 600-page bitstream and decoding spec for developers does not necessarily help to explain all the peculiarities of the tech in general. Therefore, I am going to limit technical details about the AV1 to a necessary minimum here.

On a high level, the AV1 is conceptually similar to existing codecs, such as H.264 or H.265. AV1 uses the same basic elements as various codecs have used for well over a decade: block-based coding, variable block sizes (up to 128x128 pixels), block motion compensation, intra-frame compression, forward-integer transform and so on. Meanwhile, since we are talking about compression algorithms more efficient than existing ones, it is natural that the AV1 has a number of advantages over contemporary codecs.

The AV1 performs internal processing in 8, 10 or 12 bits per sample precision, it also supports all three widespread types of chroma subsampling (4:2:0, 4:2:2, 4:4:4), and virtually all major color gamuts and formats (sRGB, BT.2020 (both 10-bit and 12-bit), BT.2100, etc.). The BT.2020 and the BT.2100 recommendations include support not only for 3840×2160, but also for 7680×4320 (8K) resolution, so the AV1 is technically ready for the next-gen monitors and TVs.

AV1 Profiles
seq_profile Bit Depth sRGB Gamut Support Chroma Subsampling
0 8 or 10 No YUV 4:2:0
1 8 or 10 Yes YUV 4:4:4
2 8 or 10 No YUV 4:2:2
2 12 Yes YUV 4:2:0
YUV 4:2:2
YUV 4:4:4

Speaking of displays, it is necessary to note that the AV1 was designed to be compatible with existing interconnections, such as DisplayPort, eDP, HDMI and so on. That said, the technology should also be compatible with contemporary content protection technologies.

The publication of the AV1 spec 1.0 is merely the first step towards adoption of the technology by the market. AOMedia expects content creation tools and desktop browsers to begin to roll out support for AV1 later this year. To ensure this, AOMedia released an unoptimized/experimental AV1 software decoder and encoder for use in software applications. Then, sometimes in 2019, the consortium anticipates select chips and programs to support the tech. More widespread support of the AV1 along with adoption by software is projected for 2020.

Speaking of adoption, the list of AOMedia members includes a variety of influential companies, including Apple, Amazon, AMD, Arm, Broadcom, Facebook, Google, Hulu, Intel, IBM, Microsoft, Netflix, NVIDIA, Realtek, Sigma and many others. These companies either control huge ecosystems themselves, or develop chips that are used by hundreds of millions of customers worldwide. Their support will ensure widespread adoption of the AV1 in the next decade. In the meantime, AOMedia has already started R&D for the AV2, which is to succeed the AV1 codec.

Related Reading:

Source: AOMedia

Comments Locked

71 Comments

View All Comments

  • ZolaIII - Saturday, March 31, 2018 - link

    The real modern SoC's use DSP's for it & modern DSP's are also re programmable (at least those good designed one's from CEVA and Tensilica) which mens new commands & algorithms can be entered. All tho the DSP's aren't as efficient as the fixed single use/purpose hard fixed ASICS they really aren't that far behind & when you take in consideration their actual multi purpose use & (still limited & not so easy to do) programmable nature they are much better fitted for the job. AMD Radeon UVD contains also a Tensilica DSP but a small one & for audio only. On the smartphones all current generation SoC's use DSP for that purpose (QC QDSP, HiSilicon, Samsung & now MTK use Tensilica P6), on the desktop Intel is jumping in the same bandwagon with new announced generations.

    I hope now you feel a bit more educated on the topic.
  • sonicmerlin - Sunday, April 1, 2018 - link

    You should probably define DSP at least once before using the abbreviation multiple times throughout your paragraph.
  • ZolaIII - Sunday, April 1, 2018 - link

    To define Digital Signal Processor? I think you got lost coming hire.
  • peevee - Tuesday, April 3, 2018 - link

    Your google is broken?
  • entity279 - Monday, April 2, 2018 - link

    Though we fell far less educated on the syntax of plurals
  • ZeDestructor - Monday, April 2, 2018 - link

    *ahem* "GM206’s decoder was a major upgrade from GM204’s. Importantly, it added full HEVC fixed function decoding. And not just for standard 8bit Main Profile HEVC, but 10bit Main10 Profile support as well"

    pls2educate yourself

    Source: https://www.anandtech.com/show/10325/the-nvidia-ge... around middle of page
  • ZeDestructor - Monday, April 2, 2018 - link

    wait.. wrong parent
  • ZolaIII - Tuesday, April 3, 2018 - link

    To late. Btx process terminated.
  • ZolaIII - Tuesday, April 3, 2018 - link

    Lol how about 10 bit HEVC real time recording at S845 QDSP @30 FPS or Exunos 9810 Tensilica P6 MP @60 FPS & double those on 8 bit main profile. All this wile staying in 1W limit for DSP & 2~2.5W for whole SoC. Still those do & great variety of other V/A formats (including Vp9 8~10 bit) and staying open to support any future implementations no matter is it a codec improvement or a new codec. In the mean time they also do; audio processing, VC, CNN... So just try to stick that against bad implementation of an ASIC fixed function which is still partial as it employs & CUDA core's implementation in Nv encoder and idles doing absolutely nothing on more than 30W.
    And a simple explanation how & why adding ASICS fixed functions isn't exactly the best solution other than it's stiff.
    https://www.semiwiki.com/forum/content/6797-cpu-gp...
    It's for CNN but it also reflects pretty much everything else. ASICS will stay best solution for fast fixed IO switches and nothing else.
  • eddman - Monday, April 2, 2018 - link

    You really need to read more about these stuff before posting.

Log in

Don't have an account? Sign up now