High-dynamic-range television

High-dynamic-range video (HDR video) is video having a dynamic range greater than that of standard-dynamic-range video (SDR video). HDR video involves capture, production, content/encoding, and display. HDR capture and displays are capable of brighter whites and deeper blacks. To accommodate this, HDR encoding standards allow for a higher maximum luminance and use at least a 10-bit dynamic range (color depth, compared to 8-bit for non-professional and 10-bit for professional SDR video) in order to maintain precision across this extended range.

While technically "HDR" refers strictly to the ratio between the maximum and minimum luminance, the term "HDR video" is commonly understood to imply wide color gamut as well.

Technology

Capture

Example of HDR time-lapse video

In February and April 1990, Georges Cornuéjols introduced the first real-time HDR camera combining two successively or simultaneously-captured images.

In 1991, the first commercial video camera using consumer-grade sensors and cameras was introduced that performed real-time capturing of multiple images with different exposures, and producing an HDR video image, by Hymatom, licensee of Cornuéjols.

Also in 1991, Cornuéjols introduced the principle of non linear image accumulation HDR+ to increase the camera sensitivity: in low-light environments, several successive images are accumulated, increasing the signal-to-noise ratio.

Later, in the early 2000s, several scholarly research efforts used consumer-grade sensors and cameras. A few companies such as RED and Arri have been developing digital sensors capable of a higher dynamic range. RED EPIC-X can capture time-sequential HDRx images with a user-selectable 1–3 stops of additional highlight latitude in the "x" channel. The "x" channel can be merged with the normal channel in post production software. The Arri Alexa camera uses a dual gain architecture to generate an HDR image from two exposures captured at the same time.

With the advent of low-cost consumer digital cameras, many amateurs began posting tone mapped HDR time-lapse videos on the Internet, essentially a sequence of still photographs in quick succession. In 2010, the independent studio Soviet Montage produced an example of HDR video from disparately exposed video streams using a beam splitter and consumer grade HD video cameras. Similar methods have been described in the academic literature in 2001 and 2007.

Modern movies have often been filmed with cameras featuring a higher dynamic range, and legacy movies can be converted even if manual intervention would be needed for some frames (as when black-and-white films are converted to color). Also, special effects, especially those that mix real and synthetic footage, require both HDR shooting and rendering. HDR video is also needed in applications that demand high accuracy for capturing temporal aspects of changes in the scene. This is important in monitoring of some industrial processes such as welding, in predictive driver assistance systems in automotive industry, in surveillance video systems, and other applications. HDR video can be also considered to speed image acquisition in applications that need a large number of static HDR images are, for example in image-based methods in computer graphics.

OpenEXR was created in 1999 by Industrial Light & Magic (ILM) and released in 2003 as an open source software library. OpenEXR is used for film and television production.

Display

Display devices capable of greater dynamic range have been researched for decades, primarily with flat panel technologies like plasma, SED/FED and OLED.

TV sets with enhanced dynamic range and upscaling of existing SDR/LDR video/broadcast content with reverse tone mapping have been anticipated since early 2000s. In 2016, HDR conversion of SDR video was released to market as Samsung's HDR+ (in LCD TV sets) and Technicolor SA's HDR Intelligent Tone Management.

As of 2018, high-end consumer-grade HDR displays can achieve 1,000 cd/m² of luminance, at least for a short duration or over a small portion of the screen, compared to 250-300 cd/m² for a typical SDR display.

Production

Academy Color Encoding System (ACES) was created by the Academy of Motion Picture Arts and Sciences and released in December 2014. ACES is a complete color and file management system that works with almost any professional workflow and it supports both HDR and wide color gamut. More information can be found at https://www.ACESCentral.com (WCG).

Video interfaces that support at least one HDR Format include HDMI 2.0a, which was released in April 2015 and DisplayPort 1.4, which was released in March 2016. On 12 December 2016, HDMI announced that Hybrid Log-Gamma (HLG) support had been added to the HDMI 2.0b standard. HDMI 2.1 was officially announced on 4 January 2017, and added support for Dynamic HDR, which is dynamic metadata that supports changes scene-by-scene or frame-by-frame.

The Society of Motion Picture and Television Engineers (SMPTE) created a standard for dynamic metadata: SMPTE ST 2094 or Dynamic Metadata for Color Volume Transform (DMCVT). SMPTE ST 2094 was published in 2016 as six parts and includes four applications from Dolby, Philips, Samsung, and Technicolor.

Standards

Perceptual quantizer

The perceptual quantizer (PQ), published by SMPTE as SMPTE ST 2084, is a transfer function that allows for the display of high dynamic range (HDR) video with a luminance level of up to 10,000 cd/m² and can be used with the Rec. 2020 color space. PQ is a non-linear electro-optical transfer function (EOTF). On 18 April 2016, the Ultra HD Forum announced industry guidelines for UHD Phase A, which uses Hybrid Log-Gamma (HLG) and PQ transfer functions with a bit depth of 10-bits and the Rec. 2020 color space. On 6 July 2016, the ITU announced Rec. 2100, which uses HLG or PQ as transfer functions with a Rec. 2020 color space.

The PQ inverse EOTF is as follows:

$V=\left({\frac {c_{1}+c_{2}\cdot L_{o}^{m_{1}}}{1+c_{3}\cdot L_{o}^{m_{1}}}}\right)^{m_{2}}$

where

• $V$ is the signal value, with a range of $\left[0,1\right]$.
• $L_{o}$ is the normalized linear optical luminance, with $L_{o}=1$ representing the peak luminance of 10,000 cd/m² (minimal luminance is 0.0001 cd/m²)
• $c_{1}=c_{3}-c_{2}+1={\frac {107}{128}}=0.8359375$
• $c_{2}={\frac {2413}{128}}=18.8515625$
• $c_{3}={\frac {2392}{128}}=18.6875$
• $m_{1}={\frac {1305}{8192}}=0.1593017578125$
• $m_{2}={\frac {2523}{32}}=78.84375$

VESA DisplayHDR

The DisplayHDR standard from VESA is an attempt to make the differences in HDR specifications easier to understand for consumers, with standards mainly used in computer monitors and laptops. VESA defines a set of HDR levels, all of them must support HDR10, but do not need to have 10-bit displays for some of them. The most recent standard is DisplayHDR 1400, which was introduced in September 2019. Monitors meeting that standard have been announced, to be released in the first quarter of 2020.

	Minimum peak luminance	Range of color	Typical dimming technology	Maximum black level luminance	Maximum backlight adjustment latency
	Brightness in cd/m2	Color gamut		Brightness in cd/m2	Number of video frames
DisplayHDR 400	400	sRGB	Screen-level	0.4	8
DisplayHDR 500	500	WCG*	Zone-level	0.1	8
DisplayHDR 600	600	WCG*	Zone-level	0.1	8
DisplayHDR 1000	1000	WCG*	Zone-level	0.05	8
DisplayHDR 1400	1400	WCG*	Zone-level	0.02	8
DisplayHDR 400 True Black	400	WCG*	Pixel-level	0.0005	2
DisplayHDR 500 True Black	500	WCG*	Pixel-level	0.0005	2

*Wide Color Gamut

HDR10

HDR10 Media Profile, more commonly known as HDR10, was announced on 27 August 2015, by the Consumer Technology Association and uses the wide-gamut Rec. 2020 color space, a bit depth of 10-bits, and the SMPTE ST 2084 (PQ) transfer function – a combination later also standardized in ITU-R BT.2100.

HDR10 generally is not the best looking HDR format. It is based on Static HDR. In the Static HDR, metadata for Dynamic Range is provided to the display, and that setting remains constant for the entire video/movie. HDR10 has a single metadata for things like MaxFALL and MaxCLL applied across the entire video/content. This means the video cannot have specific settings for specific scenes. It isn’t the most wonderful scene every time, but it is far superior to SDR every time.

It also uses SMPTE ST 2086 "Mastering Display Color Volume" static metadata to send color calibration data of the mastering display, such as MaxFALL (Maximum Frame Average Light Level) and MaxCLL (Maximum Content Light Level) static values, encoded as SEI messages within the video stream.

HDR10 is an open standard supported by a wide variety of companies, which include monitor and TV manufacturers such as Dell, LG, Samsung, Sharp, VU, Sony, and Vizio, as well as Sony Interactive Entertainment, Microsoft and Apple which support HDR10 on their PlayStation 4, Xbox One video game console and Apple TV platforms, respectively. It is the most wide spread of the HDR formats.

HDR10+

Main article: HDR10+

HDR10+, also known as HDR10 Plus, was announced on 20 April 2017, by Samsung and Amazon Video. HDR10+ updates HDR10 by adding dynamic metadata that can be used to more accurately adjust brightness levels up to 4,000 nits maximum brightness on a scene-by-scene or frame-by-frame basis and supports up to 10-bit colour depth and 8K resolution. This function is based on Samsung application SMPTE ST 2094-40 Application #4. HDR10+ is an open standard and is royalty-free; it is supported by Colorfront's Transkoder and MulticoreWare's x265. A certification and logo program for HDR10+ device manufacturers will be made available with an annual administration fee and no per unit royalty. An authorized test center conducts a certification program for HDR10+ devices.

On 28 August 2017, Samsung, Panasonic, and 20th Century Fox created the HDR10+ Alliance to promote the HDR10+ standard. HDR10+ video started being offered by Amazon Video on 13 December 2017. On 5 January 2018, Warner Bros. announced their support for the HDR10+ standard. On 6 January 2018, Panasonic announced Ultra HD Blu-ray players with support for HDR10+. On 4 April 2019, Universal Pictures Home Entertainment announced a technology collaboration with Samsung Electronics to release new titles mastered with HDR10+. It is considered to have most of the advantages of Dolby Vision over HDR10, despite being fee free.

Dolby Vision

Dolby Vision is an HDR format from Dolby Laboratories that can be optionally supported by Ultra HD Blu-ray discs and streaming video services. Dolby Vision is a proprietary format and Dolby SVP of Business Giles Baker has stated that the royalty cost for Dolby Vision is less than $3 per TV. Dolby Vision includes the Perceptual Quantizer (SMPTE ST 2084) electro-optical transfer function, up to 8K resolution, and a wide-gamut color space (ITU-R Rec. BT.2020 in YC_BC_R or IC_TC_P). Some Dolby Vision profiles allow for 12-bit color depth and 10,000 cd/m2 maximum brightness (as of 2018, according to the Dolby Vision white paper, professional reference monitors, such as the Dolby Vision HDR reference monitor, are currently limited to 4,000 cd/m2 of peak brightness). It can encode mastering display colorimetry information using static metadata (SMPTE ST 2086) but also provide dynamic metadata (SMPTE ST 2094-10, Dolby format) for each scene.

This dynamic metadata or Dynamic HDR allows adjusting of brightness and contrast on the scene by scene or even frame by frame bases as and when required and adjusts it many times during the video/movie

Examples of Ultra HD (UHD) TVs that support Dolby Vision include LG, TCL, VU, Sony and Vizio. MulticoreWare's x265 encoder supports Dolby Vision as of version 3.0. Dolby Vision IQ is an update designed to optimise Dolby Vision content according to the brightness of the room (ambient light). It is considered to be future proof.

Hybrid Log-Gamma

Main article: Hybrid Log-Gamma

Hybrid Log-Gamma (HLG) is a royalty-free HDR standard jointly developed by the BBC and NHK. HLG is designed to be better-suited for television broadcasting, where the metadata required for other HDR formats is not backward compatible with non-HDR displays, consumes additional bandwidth, and may also become out-of-sync or damaged in transmission. HLG defines a non-linear optical-electro transfer function, in which the lower half of the signal values use a gamma curve and the upper half of the signal values use a logarithmic curve. In practice, the signal is interpreted as normal by standard-dynamic-range displays (albeit capable of displaying more detail in highlights), but HLG-compatible displays can correctly interpret the logarithmic portion of the signal curve to provide a wider dynamic range. In contrast the other HDR formats it does not use metadata.

HLG is defined in ATSC 3.0, Digital Video Broadcasting (DVB) UHD-1 Phase 2, and International Telecommunication Union (ITU) Rec. 2100. HLG is supported by HDMI 2.0b, HEVC, VP9, and H.264/MPEG-4 AVC. HLG is supported by video services such as the BBC iPlayer, DirecTV, Freeview Play, and YouTube.

Technicolor Advanced HDR AHDR

A HDR format which aims to be backwards compatible with SDR. As of 19 December 2020 there is no content in the this format.

SL-HDR1

SL-HDR1 (Single-Layer HDR system Part 1) is a HDR standard that was jointly developed by STMicroelectronics, Philips International B.V., and Technicolor R&D France. It was standardised as ETSI TS 103 433 in August 2016. SL-HDR1 provides direct backwards compatibility by using static (SMPTE ST 2086) and dynamic metadata (using SMPTE ST 2094-20 Philips and 2094-30 Technicolor formats) to reconstruct a HDR signal from a SDR video stream that can be delivered using SDR distribution networks and services already in place. SL-HDR1 allows for HDR rendering on HDR devices and SDR rendering on SDR devices using a single layer video stream. The HDR reconstruction metadata can be added either to HEVC or AVC using a supplemental enhancement information (SEI) message.

The below table gives a complete comparison for Dolby Vision vs HDR 10 vs HDR 10+ vs HLG vs AHDR

	HDR10	HDR10+	Dolby Vision	HLG	AHDR
Peak Brightness	1k-4k Nits	1k-4k Nits	10k Nits	1k Nits	–
Bit Depth	10 Bit	10Bit	12 Bit	10Bit	10Bit
Resolution	4k	8k	8k	–	–
Content Availability	Great	Good	Good	Scanty	Non Existent
HDR Type	Static HDR	Dynamic HDR	Dynamic HDR	Dynamic HDR	Dynamic HDR
Cost	$	$$	$$$	$	–
Platform Availability	Almost every Platform supports it	Netflix, Vudu, and Apple TV 4k isn’t supported	Almost Every Platform with exception of NVIDIA Shield	Majorly some content for BBC is the only available content	No Content Available
Backward compatibility	No compatibility	No compatibility	No compatibility	Full Support	No compatibility

Guidelines and recommendations

ITU-R Rec. 2100

Main article: Rec. 2100

Rec. 2100 is a technical recommendation by ITU-R for production and distribution of HDR content using 1080p or UHD resolution, 10-bit or 12-bit color, HLG or PQ transfer functions, and wide color gamut using the Rec. 2020 (in YC_BC_R or IC_TC_P) color space.

UHD Phase A

UHD Phase A are guidelines from the Ultra HD Forum for distribution of SDR and HDR content using Full HD 1080p and 4K UHD resolutions. It requires color depth of 10-bits per sample, a color gamut of Rec. 709 or Rec. 2020, a frame rate of up to 60 fps, a display resolution of 1080p or 2160p, and either standard dynamic range (SDR) or high dynamic range that uses Hybrid Log-Gamma (HLG) or Perceptual Quantizer (PQ) transfer functions. UHD Phase A defines HDR as having a dynamic range of at least 13 stops (2¹³=8192:1) and WCG as a color gamut that is wider than Rec. 709. UHD Phase A consumer devices are compatible with HDR10 requirements and can process Rec. 2020 color space and HLG or PQ at 10 bits.

Mastering display metadata

For consumers displays that have limited color volume (i.e. do not provide peak brightness/contrast and color gamut required by the standards), SMPTE defines metadata for describing the scenes as they appear on the mastering display. SMPTE ST 2086 "Mastering Display Color Volume Metadata Supporting High Luminance and Wide Color Gamut Images" describes static data such as MaxFALL (Maximum Frame Average Light Level) and MaxCLL (Maximum Content Light Level). SMPTE ST 2094 "Content-Dependent Metadata for Color Volume Transformation of High Luminance and Wide Color Gamut Images" includes dynamic metadata that can change from scene to scene. This includes ST 2094-10 (Dolby Vision format), Colour Volume Reconstruction Information (CVRI) SMPTE ST 2094-20 (Philips format) and Colour Remapping Information (CRI) defined in ST 2094-30 (Technicolor format), and HDR10+ ST 2094-40 (Samsung format).

History

The HEVC specification incorporates the Main 10 profile on their first version that supports 10 bits per sample.

On 8 April 2015, The HDMI Forum released version 2.0a of the HDMI Specification to enable transmission of HDR. The Specification references CEA-861.3, which in turn references the Perceptual Quantizer (PQ), which was standardized as SMPTE ST 2084. The previous HDMI 2.0 version already supported the Rec. 2020 color space.

On 24 June 2015, Amazon Video was the first streaming service to offer HDR video using HDR10 Media Profile video.

On 17 November 2015, Vudu announced that they had started offering titles in Dolby Vision.

On 1 March 2016, the Blu-ray Disc Association released Ultra HD Blu-ray with mandatory support for HDR10 Media Profile video and optional support for Dolby Vision.

On 9 April 2016, Netflix started offering both HDR10 Media Profile video and Dolby Vision.

On 6 July 2016, the International Telecommunication Union (ITU) announced Rec. 2100 that defines two HDR transfer functions—HLG and PQ.

On 29 July 2016, SKY Perfect JSAT Group announced that on 4 October, they will start the world's first 4K HDR broadcasts using HLG.

On 9 September 2016, Google announced Android TV 7.0, which supports Dolby Vision, HDR10, and HLG.

On 26 September 2016, Roku announced that the Roku Premiere+ and Roku Ultra will support HDR using HDR10.

On 7 November 2016, Google announced that YouTube would stream HDR videos that can be encoded with HLG or PQ.

On 17 November 2016, the Digital Video Broadcasting (DVB) Steering Board approved UHD-1 Phase 2 with a HDR solution that supports Hybrid Log-Gamma (HLG) and Perceptual Quantizer (PQ). The specification has been published as DVB Bluebook A157 and will be published by the ETSI as TS 101 154 v2.3.1.

On 2 January 2017, LG Electronics USA announced that all of LG's SUPER UHD TV models now support a variety of HDR technologies, including Dolby Vision, HDR10, and HLG (Hybrid Log Gamma), and are ready to support Advanced HDR by Technicolor.

On 12 September 2017, Apple announced the Apple TV 4K with support for HDR10 and Dolby Vision, and that the iTunes Store would sell and rent 4K HDR content.

On 13 October 2020, Apple announced the iPhone 12 and iPhone 12 Pro series, the first smartphone that can record and edit video in Dolby Vision right in the camera roll.

See also

• High dynamic range
• Gamma correction
• Rec. 2100