全景视频压缩与质量评价综述
A Survey on Omnidirectional Video Compression and Quality Assessment
-
摘要: 随着移动互联网和视频处理技术的快速发展,虚拟现实技术在现代信息社会逐渐占据重要地位,在近年来得到了广泛应用。全景视频是虚拟现实技术的关键载体,用户佩戴头盔观看全景视频时可调整视窗以观看感兴趣内容。与平面视频的视野不同,全景视频全方位覆盖,对分辨率和帧率要求较高,引入了庞大数据量。在带宽受限场景下,海量全景视频需要减小数据冗余,因此全景视频压缩是关键研究方向。然而,压缩过程不可避免地引入压缩失真。此外,在真实场景的视频处理链路中,编辑和转码等过程还会进一步叠加多类型失真。上述叠加失真影响观看者感知体验,并桎梏下游视频处理任务的发展。质量评价技术能够提供有效的评价指标,同时为质量增强技术提供优化目标。本文围绕全景视频压缩与质量评价关键技术展开,首先,从传统和深度学习两方面回顾全景压缩方法,其中包括最新的全景视频神经编码研究进展,以及常用数据集和指标;随后,本文回顾了全景视频的主观和客观质量评价方法,在主观质量评价回顾实验流程与合成/真实场景失真数据集;在客观质量评价详细回顾了无参考质量评价方法,涵盖了面向真实场景失真的深度模型;最后,对全景视频压缩和质量评价核心技术以及未来发展方向进行总结和展望,以推动全景视频处理技术的应用和发展。Abstract: With the rapid development of mobile Internet and video processing technologies, virtual reality has become an essential component of modern information society, with widespread applications in recent years. Omnidirectional video is a key medium in virtual reality, allowing viewers wearing headsets to adjust their viewports and explore content of interest. In terms of the field of view, unlike conventional planar videos, omnidirectional videos provide 360° coverage and impose higher requirements on resolutions and frame rates, producing substantial amounts of data. In bandwidth-constrained environments, the transmission and storage of massive omnidirectional videos require reducing data redundancy, making omnidirectional video compression a critical research area. However, the compression process inevitably introduces distortions. Furthermore, in real-world video processing pipelines, multiple types of distortions are further compounded by operations such as editing and transcoding. These compounded distortions degrade the quality of experience and constrain the development of downstream video processing tasks. Quality assessment techniques provide effective evaluation metrics and optimization objectives for quality enhancement technologies. This paper focuses on key technologies for omnidirectional video compression and quality assessment. First, we review both traditional and deep learning methods for omnidirectional video compression, including the latest advancements in neural omnidirectional video codecs, as well as commonly used datasets and evaluation metrics. Next, we review subjective and objective quality assessment methods for omnidirectional videos. For subjective quality assessment, we review experimental protocols and datasets involving synthetic and real-world distortions. For objective quality assessment, we provide a detailed review of no-reference quality assessment methods, including deep learning models designed for real-world distortions. Finally, we summarize the core technologies in omnidirectional video compression and quality assessment and discuss future directions to promote the application and development of omnidirectional video processing technologies.
下载: