Answers are grounded in this paper and cite their sources.
Modern adaptive video streaming must jointly optimize perceptual quality, bitrate efficiency, latency, and energy consumption across heterogeneous client devices. However, existing bitrate-ladder design approaches, whether fixed, per-title, or machine-learned, typically assume that decoded video is directly consumed, overlooking the increasing use of client-side Video Super-Resolution (VSR) and its associated computational and energy costs. Moreover, while the Versatile Video Coding (VVC) standard achieves substantial compression gains, its increased decoding complexity further complicates energy-efficient deployments. To address these challenges, we introduce E2-Stream, a fully measurement-driven framework that integrates VVC encoding, multi-model VSR enhancement, and client-side decoding and enhancement energy profiling for enhancement-aware bitrate-ladder construction. Instead of relying on predictions or heuristics, E2-Stream exhaustively evaluates each resolution–bitrate–VSR configuration on real hardware to capture the true rate–quality–energy behavior, and selects representations that balance perceptual quality and client-side energy consumption. A Just Noticeable Difference (JND)-aware pruning strategy further removes perceptually redundant representations, yielding compact ladders with reduced storage overhead. Unlike prior work focusing solely on spatial super-resolution, we evaluate both lightweight frame-wise SISR models (FSRCNN, ESPCN) and a temporally-aware VSR model (EDVR), enabling direct comparison of quality gains, temporal consistency, and inference cost. We further evaluate E2-Stream on two heterogeneous client devices: (i) a CPU-only system with software VVC decoding and CPU-based inference, and (ii) a GPU-enabled system with hardware-accelerated decoding and GPU-accelerated VSR. Experiments on the Inter-4K dataset show that enhancement-aware ladders preserve sub-JND perceptual quality while achieving 12%–28% bitrate savings. On the CPU-only device, decoding and VSR inference increase energy consumption by up to 85%, highlighting the cost of software-based enhancement. In contrast, on the GPU-enabled device, the same configurations reduce total client-side energy by 25%–60% due to efficient hardware acceleration, while maintaining strong bitrate reductions (up to 40%). Additionally, JND-based pruning reduces storage requirements by up to 58.98% without compromising perceptual quality. These results demonstrate that VSR fundamentally reshapes the rate–quality–energy trade-off and that optimal bitrate ladders are inherently device-dependent. E2-Stream provides a principled and reproducible framework for energy- and enhancement-aware streaming in the VVC era.
No takes yet. Share an insight, caveat, or question.
Premkumar et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: