基于自组织映射网络的微表情运动规律分析方法
Micro-expression Movement Law Analysis Through SOM Network
-
摘要: 表情是人类情感交互的重要方式。神经生理学研究表明:微表情很难由主观意识所控制,是人类真实情感的流露。与宏表情不同,微表情发生常常伴随着面部左右和上下的不对称移动,运动模式复杂。但由于微表情运动幅度小,人眼难以直接观察,微表情运动规律尚未被深入解析。在公共安保等领域,对微表情识别算法的可靠性与可解释性有很高要求。因此,本文旨在研究微表情运动规律分析方法,实现微表情运动规律的系统性解析。本文工作包括:研究基于自组织映射网络(Self-Organizing Maps, SOM)的微表情特征无监督聚类方法,得到微表情运动模式及其概率。定义微表情运动相似度指标,它从面部14个感兴趣区域运动趋势的角度来衡量两个微表情运动特征的差异程度,并作为调节SOM网络权值的依据。本文对CASMEII、SAMM、SMIC和MMEW数据集的微表情样本进行分析,并根据SOM网络的聚类结果总结微表情运动规律,该规律可以指导微表情识别算法特征提取,提升可靠性。Abstract: Expression is an important way of human emotional interaction. Neurophysiological studies show that micro-expressions (MEs) are not controlled by subjective consciousness and reflect people's real emotions. Unlike macro-expressions, micro-expressions are often accompanied by asymmetric facial movements with complex movement patterns. However, due to the small amplitude of micro-expression, it is difficult to be directly observed by humans. The ME movement law has not been deeply analyzed. The reliability and interpretability of ME recognition algorithms are highly required in public security. Therefore, this paper aimed to study the micro-expression movement law analysis method. The main work of this paper is as follows. We studied the unsupervised clustering method for ME features through self-organizing maps (SOM) network to obtain micro-expression movement patterns. The micro-expression movement distance (DME) was defined, which measured the difference between two micro-expression features in terms of movement in the fourteen regions of interest on the face and served as a basis for adjusting the weights of the SOM network. In the experimental part, we analyzed micro-expression samples from CASMEII, SAMM, SMIC and MMEW datasets and summarized micro-expression movement law based on the learning results of the SOM network. This law can effectively guide the feature extraction of micro-expression recognition algorithm and improve the reliability.