基于纹理特性的全景视频球域旋转编码算法

Spherical Rotation for Omnidirectional Video Coding Based on Texture Analysis

  • 摘要: 作为虚拟现实技术(Virtual Reality,VR)和增强现实技术(Augmented Reality,AR)的核心,全景视频因360°全覆盖视角数据量巨大,给存储和传输带来严峻挑战。因此,优化全景视频的编码效率,并在提升效率的同时平衡编码复杂度,对推动该技术在医疗、教育等领域的广泛应用至关重要。为适配现有编码框架,需要将全景视频从三维球体投影到二维平面,这一过程不可避免地导致过采样和不连续边界,从而引发失真问题,影响编码效率。考虑到球形域的旋转可通过优化纹理分布来减轻上述失真,进而提升编码性能,本文就此展开深入研究。研究通过系统性的编码率失真性能比较,确定等角立方体(Equi-Angular Cubemap,EAC)投影格式作为后续实验的基础投影格式。在此基础上,通过详尽的球域旋转遍历实验,深入分析不同旋转角度与编码性能之间的关联,证实了球域旋转提升编码性能的可行性,且总存在一个最优旋转角度。鉴于此,本文设计了一套基于纹理特性的高效球域旋转算法。首先,该算法利用Scharr梯度算子提取投影面的纹理特性;随后,通过分层筛选机制获取主导纹理方向:第一级采用动态阈值筛选剔除平坦子块,并统计各平面有效子块比例以排除整体平坦面;第二级引入直方图包络分析,通过梯度角度分布的峰谷特征筛除纹理方向杂乱的平面;最后,对有效平面进行加权梯度角度统计以确定最优旋转角度。实验结果表明,通过将识别出的主要纹理方向旋转至水平方向,所提算法对特定视频序列最高可实现3.15%的比特率节省,平均实现0.56%的比特率节省,且几乎不增加额外的编码复杂度。当与最优旋转轴预测算法相结合使用时,平均比特率节省可达0.66%。

     

    Abstract: As the core of virtual reality and augmented reality technologies, omnidirectional video offers a 360° full-coverage perspective. However, this immersive experience generates massive data volumes, posing severe challenges in terms of storage and transmission. Therefore, optimizing the coding efficiency of omnidirectional video, while balancing the associated coding complexity, is crucial for advancing its widespread application in fields such as healthcare and education. To adapt to existing coding frameworks, omnidirectional video must be projected from a three-dimensional sphere onto a two-dimensional plane, which inevitably leads to oversampling and discontinuous boundaries, introducing distortion that degrades the coding efficiency. Rotating the spherical domain can mitigate such distortion by optimizing the texture distribution and thereby improving the coding performance. Based on this, in this work, we conduct an in-depth study on spherical-domain rotation for omnidirectional video. Through a systematic comparison of the encoding-rate-distortion performance, the equiangular cubemap is identified as the basic projection format for the subsequent experiments. Exhaustive spherical-rotation traversal experiments are performed to analyze the correlation between rotation angles and encoding performance. The results confirm the feasibility of enhancing the encoding performance through spherical rotation and establish the existence of an optimal rotation angle. Based on these findings, this work proposes an efficient spherical-rotation algorithm leveraging texture characteristics. The algorithm first extracts texture features from projection planes using the Scharr gradient operator. Subsequently, it determines the dominant texture orientation through hierarchical screening. This mechanism operates in two stages: The first stage employs dynamic thresholding to filter out flat blocks and exclude entirely flat planes, based on the proportion of valid blocks. The second stage introduces histogram envelope analysis to eliminate planes with disordered texture orientations by examining the peak-valley characteristics of the gradient-angle distribution. Finally, the dominant orientation is determined based on the weighted gradient-angle statistics of the remaining valid planes. Experimental results show that, by rotating the identified dominant texture orientation to the horizontal direction, the proposed algorithm achieves up to 3.15% bitrate savings for specific sequences, with an average bitrate saving of 0.56%, while introducing almost no additional encoding complexity. Furthermore, when combined with an optimal rotation-axis-prediction algorithm, the average bitrate saving reaches 0.66%.

     

/

返回文章
返回