Automatic Audiovisual Asynchrony Measurement for Quality Assessment of Videoconferencing

Audiovisual asynchrony is a significant factor im-pacting the Quality of Experience (QoE), especially for interactive communication like video conferencing. In this paper, we propose a client-side approach to predict the delay between an audio and a video signal, using only the media signals from bo...

Full description

Saved in:
Bibliographic Details
Main Authors: Braun, Florian, Ramachandra Rao, Rakesh Rao, Robitza, Werner, Raake, Alexander
Format: Conference Proceeding
Language:English
Subjects:
audio-visual asynchrony
Delays
Feature extraction
Measurement
Media
Quality assessment
quality of experience
Streaming media
Video conferencing
videoconferencing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Audiovisual asynchrony is a significant factor im-pacting the Quality of Experience (QoE), especially for interactive communication like video conferencing. In this paper, we propose a client-side approach to predict the delay between an audio and a video signal, using only the media signals from both streams. Features are extracted from the video and audio stream, respectively, and analyzed using a cross-correlation approach to determine the actual delay. Our approach predicts the delay with an accuracy of over 80% in a time frame of ±1s. We further highlight the potential drawbacks of using a cross-correlation-based analysis and propose different solutions for practical implementations of a delay-based QoE metric.
ISSN:2472-7814
DOI:10.1109/QoMEX58391.2023.10178438