基于MGGD变换的三维模型有示例颜色传递方法
Example-Based Color Transfer for 3D Model via MGGD Transformation
-
摘要: 三维模型颜色传递技术在影视编辑、游戏制作以及医学图像处理等多个领域具有关键应用价值。这项技术通过将示例模型的颜色特征准确传递到输入模型中,不仅可以实现三维模型的艺术风格迁移与融合,还可以有效提升三维模型的视觉效果。然而,当前基于统计学的颜色传递方法在处理过程中通常仅考虑色彩风格的均值、方差等简单统计特征,而忽视了色彩风格与几何结构之间的深层次联系,继而导致颜色传递过程中无法保持模型的整体颜色一致性与细节的完整性。特别是在处理复杂场景或精细模型时,传统方法容易引发颜色失真、伪影等问题。针对上述问题,本研究提出了一种基于多元广义高斯分布的三维模型色彩传递方法。该方法在常见统计特征的基础上,进一步深入考虑了输入模型与示例模型在颜色和几何结构信息上的相互关联性。具体而言,借助多元广义高斯模型强大的泛化能力,实现了对输入数据集真实概率密度的更为精确的拟合,从而能够更加全面地捕捉到颜色分布的复杂性与几何结构的相互作用。在此基础上,研究采用了最优传输理论中的Monge-Kantorovich变换,基于多元广义高斯分布散布矩阵的方式实现了不同模型之间颜色信息的精确映射,确保了颜色传递过程中模型整体色彩的一致性。此外,本研究还进一步引入了基于多元广义高斯分布形状参数的随机变换机制。通过适当增加颜色传递过程中的随机性,在保证颜色一致性的同时,增强了模型对复杂场景和细微差异的适应能力。数值实验结果显示,所提出的基于多元广义高斯分布的颜色迁移方法在视觉效果上表现优异,能够更好地保持色彩的整体一致性与细节完整性。同时,在七种常用的定量评估指标(包括结构相似性指标、学习感知图像块相似度、Wasserstein距离等)上,本方法均显著优于传统方法。Abstract: The 3D model color transfer technique holds significant value across various fields, such as film editing, game development, and medical image processing. This technique allows artists and researchers to enhance the visual quality and realism of 3D models by transferring the color characteristics of real-world materials and environments onto virtual objects, enabling artistic style transfer and fusion. Traditionally, these techniques consist of two primary steps: extracting color features from an example model, such as hue and saturation, and transferring these features to an input model using specific methods, often based on optimal transport theory. These transformations aim to achieve artistic style transfer while enhancing the overall visual quality of 3D models. By utilizing optimal transport, traditional methods facilitate precise mapping of color distributions from the example to the input model, resulting in visually compelling and aesthetically pleasing outputs. However, conventional color transfer methods primarily focus on simple features, such as the mean and variance of color styles, often neglecting the intricate relationships between color styles and geometric structures. This limitation can result in color distortion and artifacts, particularly when applied to complex scenes or detailed models, compromising color consistency and detail integrity. To address these challenges, this study proposes a novel color transfer method for 3D models based on the multivariate generalized Gaussian distribution (MGGD). By extending traditional statistical approaches, the proposed method incorporates the interdependence between color and geometric structure information in both the input and example models. Leveraging the robust generalization capability of MGGD, this method achieves a precise fit of the true probability density of the input dataset, effectively capturing the complexity of color distributions and their interaction with geometric structures. Building on this framework, the Monge-Kantorovich transformation from optimal transport theory is employed to map color information between models using the MGGD scatter matrix approach. This ensures consistency in overall model color during the transfer process. Furthermore, a stochastic transformation mechanism, based on the shape parameters of the MGGD, introduces controlled randomness to the color transfer process, enhancing adaptability to complex scenes and subtle variations while maintaining color consistency. Numerical experiments demonstrate that the proposed method significantly outperforms traditional techniques in preserving color consistency and detail integrity. Across seven commonly used quantitative evaluation metrics, including Structural Similarity Index Measure (SSIM), Learned Perceptual Image Patch Similarity (LPIPS), and Wasserstein distance, the MGGD-based approach achieves superior visual performance.