Adaptive Frame Skipping With Screen Dynamics for Mobile Screen Sharing Applications

The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of...

Full description

Saved in:
Bibliographic Details
Published in:IEEE systems journal 2018-06, Vol.12 (2), p.1577-1588
Main Authors: Lim, Keun-Woo, Ha, Jisu, Bae, Puleum, Ko, JeongGil, Ko, Young-Bae
Format: Article
Language:English
Subjects:
Adaptive frame rate control
Batteries
codecs
Commercialization
communications technology
Electronic devices
Empirical analysis
Energy consumption
Luminous intensity
Microprocessors
Miracast
Mobile communication
Mobile communication systems
Mobile handsets
mobile video compression
Multimedia
Multimedia communication
Personal computers
Platforms
Real-time systems
Streaming media
Time sharing
video codecs
Video transmission
Weight reduction
Wireless communication
Wireless communications
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of multimedia (or a mobile device's screen contents) with neighboring devices via wireless connection. However, unlike PC-scale computing platforms, use-case expansions on mobile devices face an additional technical challenge. Specifically, while the improved computation power is capable of handling processor-hungry applications, battery limitations hold back their full utilization. This paper acknowledges the fact that screen sharing on mobile devices can be attractive, but empirically show that minimizing the energy consumption is crutial, and introduces enhancements to the widely used H.264 encoder on mobile devices. Specifically, our enhancements target to minimize the transmission size of multimedia contents by analyzing the screen's dynamics. For contents with high dynamics, our scheme tries to maintain the video quality, while aggressively skipping frames for regions with minimal motion intensity. Our empirical evaluations show that the proposed light-weight enhancements reduce the size of a typical multimedia file by ~42%, while maintaining a high user-perceived quality (e.g., Structural SIMilarity measure) of 0.925. Wirelessly sharing this video results in ~31% lower frame transmission rate and up to ~21% power savings in less dynamic regions.
ISSN:1932-8184
1937-9234
DOI:10.1109/JSYST.2016.2589238