JND-Aware Two-Pass Per-Title Encoding Scheme for Adaptive Live Streaming

Adaptive live video streaming applications utilize a predefined collection of bitrate-resolution pairs, known as a bitrate ladder, for simplicity and efficiency, eliminating the need for additional run-time to determine the optimal pairs during the live streaming session. These applications do not i...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2024-02, Vol.34 (2), p.1281-1294
Main Authors: Menon, Vignesh V., Rajendran, Prajit T., Feldmann, Christian, Schoeffmann, Klaus, Ghanbari, Mohammad, Timmerer, Christian
Format: Article
Language:English
Subjects:
Bit rate
Coding
CRF prediction
Discrete cosine transform
Encoding
just noticeable difference
live streaming
Per-title encoding
Predictive models
Quality of experience
rate control
Rate-distortion
Reduction
Spatial resolution
Streaming media
two-pass encoding
Video transmission
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Adaptive live video streaming applications utilize a predefined collection of bitrate-resolution pairs, known as a bitrate ladder, for simplicity and efficiency, eliminating the need for additional run-time to determine the optimal pairs during the live streaming session. These applications do not incorporate two-pass encoding methods due to increased latency. However, an optimized bitrate ladder could result in lower storage and delivery costs and improved Quality of Experience (QoE). This paper presents a Just Noticeable Difference (JND)-aware constrained Variable Bitrate (cVBR) Two-pass Per-title encoding Scheme ( JTPS ) designed specifically for live video streaming. JTPS predicts a content- and JND-aware bitrate ladder using low-complexity features based on Discrete Cosine Transform (DCT) energy and optimizes the constant rate factor (CRF) for each representation using random forest-based models. The effectiveness of JTPS is demonstrated using the open source video encoder x265, with an average bitrate reduction of 18.80% and 32.59% for the same PSNR and VMAF, respectively, compared to the standard HTTP Live Streaming (HLS) bitrate ladder using Constant Bitrate (CBR) encoding. The implementation of JTPS also resulted in a 68.96% reduction in storage space and an 18.58% reduction in encoding time for a JND of six VMAF points.
ISSN:1051-8215
1558-2205
DOI:10.1109/TCSVT.2023.3290725