面向沉浸式交互的触觉信号高效编码算法

Efficient Haptic Signal Coding for Immersive Interaction

  • 摘要: 随着扩展现实、元宇宙和数字孪生等应用发展,人机交互正由传统视听感知向融合多模态感知与实时交互的沉浸式体验演进。触觉交互作为连接物理世界与元宇宙的纽带,其多自由度、多接触点及高采样率特性在实时交互中产生大量数据,并对毫秒级端到端时延高度敏感,使高效编码与传输成为系统交互效率与用户体验的瓶颈。然而,现有触觉信号编码方法易导致感知抖动、预测失效或编码延迟过高的问题。本文结合信号统计特性与人类触觉感知效应,提出一种触觉动态局部线性预测编码方法(Haptic Dynamic Local Linear Prediction Coding, HDPC)。首先,HDPC对幅值较小的原始信号进行自适应放大预处理,以提升量化效率;其次,利用触觉信号在时间域的局部线性与全局连续性特征,通过动态局部线性预测有效去除时间冗余;再次,结合人类触觉感知效应进行自适应量化,在削减感知冗余的同时保证交互感知的高保真度;最后,通过游程编码与熵编码进一步提升压缩性能。在IEEE P1918.1.1标准触觉交互数据集测试结果表明,HDPC通过灵活调节放大因子、分段长度及感知量化参数,能够在保持极高信号保真度的同时,实现显著优于现有主流触觉编码方法的压缩性能,保障异构网络环境下沉浸式媒体交互系统中触感信号的传输效率与交互质量。该研究为沉浸式媒体中多模态交互信号的高效信号处理与系统实现提供了重要技术支撑。

     

    Abstract: With the rapid development of extended reality, the metaverse, and digital twin applications, human-computer interaction is evolving from conventional audiovisual perception toward immersive experiences that integrate multimodal perception and real-time interaction. As a critical bridge between the physical world and the metaverse, haptic interaction is characterized by multiple degrees of freedom, multiple contact points, and high sampling rates, which generate massive data volumes and exhibit stringent sensitivity to end-to-end latency at the millisecond level. Consequently, efficient haptic signal encoding and transmission have become major bottlenecks limiting interaction efficiency and user experience. However, existing haptic coding methods often suffer from perceptual jitter, prediction mismatch, or excessive encoding latency. To address these issues, this paper proposes a Haptic Dynamic Local Linear Prediction Coding (HDPC) method by jointly exploiting the statistical properties of haptic signals and human haptic perception mechanisms. HDPC first applies an adaptive amplitude scaling to low-magnitude signals to improve quantization efficiency. It then removes temporal redundancy through dynamic local linear prediction by leveraging the local linearity and global continuity of haptic signals in the time domain. Furthermore, a perception-driven adaptive quantization strategy is employed to reduce perceptual redundancy while preserving high-fidelity haptic perception. Finally, run-length coding and entropy coding are applied to further enhance compression performance. Experimental results on the IEEE P1918.1.1 standard haptic interaction dataset and a visuo-haptic integrated interaction platform demonstrated that, by flexibly adjusting the scaling factor, segment length, and perceptual quantization parameters, HDPC achieved significantly higher compression efficiency than existing mainstream haptic coding methods while maintaining very high signal fidelity. The proposed method effectively improves haptic signal transmission efficiency and interaction quality in immersive media systems under heterogeneous network conditions, providing valuable technical support for the efficient signal processing and system implementation of multimodal interaction in immersive media.

     

/

返回文章
返回