Instagram's HDR Revolution: Unlocking Cinematic Quality on iOS with Dolby Vision
The Problem: Instagram's iOS app lacked support for Dolby Vision and ambient viewing environment (amve), resulting in a subpar video experience. But here's where it gets technical...
HDR videos shot on iPhones contain crucial Dolby Vision and amve metadata. This data ensures the video looks consistent across various displays and viewing conditions. However, Instagram's initial HDR implementation didn't support these features, leading to inaccurate representations, especially at low screen brightness.
The Solution: Meta's engineering team tackled this issue head-on. By preserving the iOS-generated amve and Dolby Vision metadata, they significantly enhanced the HDR viewing experience on iOS devices. But the real challenge was yet to come.
Meta's Video Journey: Understanding Meta's video processing is key. Most uploaded videos undergo three stages: Client Processing, Server Processing, and Consumption.
Client Processing: The creator's device encodes HDR videos with HEVC Main 10 profile, generating amve and Dolby Vision metadata, which is then uploaded to Meta's servers.
Server Processing: Meta's servers create multiple video versions for different devices. For HDR uploads, this includes SDR, VP9, and AV1 versions, ensuring optimal playback across various devices and network conditions.
Consumption: The viewer's device selects the best version for smooth playback. For iOS, HDR playback uses Apple's AVSampleBufferDisplayLayer (AVSBDL), which consumes amve and Dolby Vision metadata.
Amve Support: In 2022, Meta aimed to support amve. Their decoupled architecture allowed them to inspect the metadata, revealing that every frame had the same values. This led to a temporary fix, but it wasn't ideal. In 2024, they collaborated with the community to add amve support to FFmpeg, ensuring future-proof compatibility.
Dolby Vision Integration: Enabling Dolby Vision was more complex. Firstly, the existing specification was for HEVC, which Meta doesn't deliver. iPhone HDR uses Dolby Vision Profile 8.4, combining HEVC and HLG. To overcome this, Meta worked with Dolby to implement Profile 10 for AV1, ensuring metadata delivery. They also collaborated with FFmpeg developers to support Dolby Vision Profiles 8 and 10, enabling transcoding from HEVC to AV1.
Challenge 2: Integrating with AVSampleBufferDisplayLayer: AVSBDL natively supports Dolby Vision with HEVC. However, Meta needed to decode formats Apple doesn't support, like AV1 on older iPhones. They manually extracted Dolby Vision metadata and packaged it for AVSBDL, ensuring seamless playback.
Testing and Validation: Meta A/B tested Dolby Vision metadata by creating two versions of each video. The test group received the new metadata, while the control group experienced the existing setup. Surprisingly, videos with Dolby Vision metadata received less watch time due to longer load times, attributed to the metadata's size.
The Fix: Dolby provided a compressed metadata format, reducing overhead by 75%. Meta implemented this in FFmpeg and added client-side decompression. Subsequent A/B testing showed increased watch time, especially in low-light environments, where HDR videos with proper metadata were easier on the eyes.
The Result: As of June 2025, all AV1 encodings derived from iPhone HDR videos on Instagram for iOS include Dolby Vision metadata. Meta is now working on extending this support to Facebook Reels and other platforms.
The Future: Meta has addressed the HDR metadata preservation challenge and made it accessible to the community. They aim to expand Dolby Vision across their apps, promising an even more immersive visual experience. But will this truly revolutionize the way we consume content on social media? Share your thoughts below!
