全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

人机交互中的人脸表情识别研究进展

DOI: 10.11834/jig.20090503

Keywords: 表情识别,情感表情,人脸表情数据库

Full-Text   Cite this paper   Add to My Lib

Abstract:

随着人机交互与情感计算技术的快速发展,人脸表情识别已成为人们研究的热点。为了阐明人机交互中人脸表情识别的研究方向及进展,该文从人脸表情数据库、表情特征提取、表情分类方法、鲁棒的表情识别、精细的表情识别、混合表情识别、非基本表情识别等方面对人脸表情识别的研究现状进行了分析。最后总结了人脸表情识别研究的热点及趋势,同时指出了人脸表情识别研究存在的局限性,并对人脸表情识别的发展进行了展望。

References

[1]  Darwin C. The Expression of the Emotions in Animals and Man [M]. London, UK: John Murray, 1872.
[2]  Mehrabian A. Communication without words [J]. Psychology Today, 1968, 2(4) : 53-56.
[3]  Picard R W. Affective Computing [M]. Cambridge, MA, USA: MIT Press, 199%
[4]  Gross R. Face databases [A]. In. Li S, Jain A, eds. Handbook of Face Recognition [M]. New York: Springer, 2005.
[5]  Ekman P, Friesen W. Constants aeross cultures in the lace and emotion [J]. Journal of Personality and Social Psychology, 1971, 17(2) : 124-129.
[6]  Black M J, Yacoob Y. Recognizing facial expressions in image sequences using local parameterized models of image motion [J]. International Journal of Computer Vision, 1997, 25 ( 1 ) : 23-48.
[7]  Lyons M, Akamatsu S, Kamachi M, et al. Coding facial expressions with Gabor wavelets [ A ] . In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition [C], Nara, Japan, 1998: 200-205.
[8]  Kanade T,Cohn J ,Tian Y L. Comprehensive database for facial expression analysis [ A ]. In: Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition [C]. Grenoble, France, 2000: 46-53.
[9]  Belhumeur P N, Hespanha J P, Kriegman D J. Eigenfaces: vs. fisherfaces: recognition using class specific linear projection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7) : 711-720.
[10]  Sire T, Baker S, Bsat M. The CMU pose, illumination, and expression (PIE) database [ A ] . In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition [C] , Washington, DC, USA, 2002: 46-51.
[11]  Martinez A M, Benavente R. The AIR face database [R]. Technical Report 24, The Computer Vision Center (CVC), Barcelona, Spain, 1998.
[12]  Hwang B W, Rob M C, Lee S W. Performance evaluation of face recognition algorithms on Asian face database [ A ]. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition [C], Seoul, South Korea, 2004 : 278-283.
[13]  吴丹 林学?.人脸表情视频数据库的设计与实现[J].计算机工程与应用,2004,40(5):177-180.
[14]  薛雨丽 毛峡 张帆.BHU人脸表情数据库的设计与实现[J].北京航空航天大学学报,2007,33(2):224-228.
[15]  Gau W, Cao B, Sban S, et al. The CAS-PEAL large-scale chinese face database and baseline evaluations [J]. IEEE Transactions on Systems, Man and Cybernetics, Part A, 2008, 38( 1 ) : 149-161.
[16]  Pantic M, Rothkrantz L J M. Automatic analysis of facial expressions: the state of the art [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22 ( 12 ) : 1424-1446.
[17]  Fasel B, Luettin J. Automatic facial expression analysis: a survey [J]. Pattern Recognition, 2003, 36 ( 1 ) : 259-275.
[18]  Essa I, Pentland A. Coding, analysis, interpretation, and recognition of facial expressions [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 757-763.
[19]  Yacoob Y, Davis L. Recognizing human facial expressions from long image sequences using optic flow [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(6) : 636-642.
[20]  Cohn J, Zlochower A, Lien J J, et al. Automated face coding: a computer-vision based method of facial expression analysis [ A ]. In : Proceedings of the 7th European Conference on Facial Expression Measurement and Meaning [C], Salzburg, Austria, 1997: 329-333.
[21]  更多...
[22]  Zhu Z, Ji Q. Robust pose invariant facial feature detection and tracking in real-time [ A], In: Proceedings of the 18th International Conference on Pattern Recognition [C], Hong Kong, China, 2006: 1092-1095.
[23]  Tong Y, Wang Y, Zhu Z W, et al. Facial feature tracking using a multi-state hierarchical shape model under varying face pose and facial expression [ A ] . In: Proceedings of the 18th International Conference on Pattern Recognition [C], Hong Kong, China, 2006: 283 -286.
[24]  Cristinacce D, Cootes T, Scott I. A multi-stage approach to facial feature detection [ A]. In: Proceedings of the 15th British Machine Vision Conference [C], London, UK, 2004: 277-286.
[25]  Tang F Q, Deng B. Facial expression recognition using AAM and local facial features [ A ]. In: Proceedings of the Third International Conference on Natural Computation [C], Haikou, China, 2007: 632-635.
[26]  Hammal Z, Couvreur L, Caplier A, et al. Facial expression classification: an approach based on the fusion of facial deformations using the transferable belief model [J]. International Journal of Approximate Reasoning, 2007, 46 (3) : 542-567.
[27]  Yu J G, Bhanu B. Evolutionary feature sYnthesis for facial expression recognition [J] . Pattern Recognition Letters, 2006, 27 ( 11 ) : 1289-1298.
[28]  Liao S, Fan W, Chunga C S, et al. Facial expression recognition using advanced local binary patterns, Tsallis entropies and global appearance features [ A ] . In: Proceedings of the 2006 IEEE International Conference on Image Processing [C], Atlanta, GA, USA, 2006: 665-668.
[29]  Kotsia I, Zafeiriou S, Pitas L. Texture and shape information fusion for facial expression and facial action unit recognition [J]. Pattern Recognition, 2008, 41(3 ) : 833-851.
[30]  Zhou X, Huang X, Xu B, et al. Real-time facial expression recognition based on boosted embedded hidden markov model [ A ]. In: Proceedings of the Third International Conference on Image and Graphics [C], Hong Kong, China, 2004 : 290-293.
[31]  Miners B W, Basir O A. Dynamic facial expression recognition using fuzzy hidden Markov models [ A ] . In: Proceedings of the International Conference on Systems, Man and Cybernetics [C], Hawaii, USA, 2005 : 1417-1422.
[32]  Tian Y, Takeo K, Cohn J F. Recognizing Facial Actions by Combining Geometric Features and Regional Appearance Patterns [R]. CMU-RI-TR-01-01, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA, 2001.
[33]  Seyedarabi H, Aghagolzadeh A, Khanmohammadi S. Recognition of six basic facial expressions by feature-points tracking using RBF neural network and fuzzy inference system [ A ]. In: Proceedings of the 2004 IEEE International Conference on Multimedia and Expo [C] , Taipei, Taiwan, China, 2004 : 1219-1222.
[34]  Ma L, Khorasani K. Facial expression recognition using constructive feedforward neural networks [ J]. IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, 2004, 34 (3) : 1588-1595.
[35]  Soyel H, Demirel H. Facial expression recognition using 3D facial feature distances [ A ]. In: Proceedings of the 4th International Conference on Image Analysis and Recognition [C], Montreal, Canada, 2007: 831-838.
[36]  Littlewort G, Bartlett M S, Fasel I, et al. Analysis of machine learning methods for real-tlme recognition of facial expressions from video [R]. MPLab TR 2003.05, Machine Perception Laboratory Institute for Neural Computation, University of California, San Diego, CA, USA, 2003.
[37]  Xu Q Z, Zhang P Z, Yang L X, et al. A facial expression recognition approach based on novel support vector machine tree [ A ]. In: Proceedings of the 4th International Symposium on Neural Networks [C], Nanjing, China, 2007: 374-381.
[38]  Wang Y B, Ai H Z, Wu B, et al. Real time facial expression recognition with adaboost [ A ] . In: Proceedings of the 17th International Conference on Pattern Recognition [C] , Cambridge, UK, 2004: 926-929.
[39]  Jung S U, Kim D H, An K H, et al. Efficient rectangle feature extraction for AdaBoost [ A ] Conference on Canada, 2005 real-time facial expression recognition based on In: Proceedings of the 2005 Ieee/Rsj International Intelligent Robots and Systems [C], Edmonton, 3634-3639.
[40]  Guo G, Dyer C R. Simultaneous feature selection and classifier training via linear programming: a case study for face expression recognition [ A ]. In: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision Madison, Wisconsin, USA, 2003 and Pattern Recognition [C] 1 : 346-352.
[41]  Gokturk S B, Bouguet J Y, Tomasi C, et al. Model-based face tracking for view-independent facial expression recognition [ A ]. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition [C], Washington, DC, USA, 2002 : 287-293.
[42]  Ebine H, Nakamura O. The recognition of facial expressions considering the difference between individuality [J]. Transactions of the Institute of Electrical Engineers of Japan, 1999, 119-C(4) : 474-481.
[43]  Matsugu M, Mori K, Mitari Y, et al. Facial expression recognition combined with robust face detection in a convolutional neural network [ A ]. In : Proceedings of the International Joint Conference on Neural Networks [C] , Portland, OR, USA, 2003 : 2243-2246.
[44]  Shan C F, Gong S G, Mcowan P W. Robust facial expression recognition using local binary patterns [ A ]. In: Proceedings of the 2005 International Conference on Image Processing [C], Genoa, Italy,2005: 2225-2228.
[45]  Bourel F, Chibelushi C C, Low A A. Recognition of facial expressions in the presence of occlusion [ A ]. In : Proceedings of the 12th British Machine Vision Conference [C], Manchester, UK, 2001: 213-222.
[46]  Bourel F, Chibelushi C C, Low A A. Robust facial expression recognition using a state-based model of spatially-localised facial dynamics [ A ]. In: Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition [C], Washington, DC, USA, 2002: 113-118.
[47]  Gross R, Matthews I, Baker S. Active appearance models with occlusion [J]. Image and Vision Computing, 2006, 24 (6) : 593-604.
[48]  Buciu I, Kotsia I, Pitas I. Facial expression analysis under partial occlusion [ A ]. In: Proceedings of the 2005 IEEE International Conference on Acoustics, Speech, and Signal Processing [C], Philadelphia, PA, USA, 2005, V: 453-456.
[49]  Towner H, Slater M. Reconstruction and recognition of occluded facial expressions using PCA [ A ]. In: Proceedings of the Second International Conference on Affective Computing and Intelligent Interaction [C], Lisbon, Portugal, 2007 : 36-47.
[50]  刘晓?.[D].北京:清华大学,2006.
[51]  Lien J-J J. Automatic Recognition of Facial Expression Using Hidden Markov Models and Estimation of Expression Intensity [D]. Pittsburgh, PA, USA: Carnegie Mellon University, 1998.
[52]  Cohn J F, Zlochower A J, Lien J J, et al. Feature-point tracking by optical flow discriminates subtle differences in facial expression [ A ]. In: Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition [C] , Nara, Japan, 1998 : 396-401.
[53]  Donato G, Bartlett M S, C. Hager J, et al. Classifying facial actions [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999, 21(10): 974-989.
[54]  Pantic M, Rothkrantz L J M. Expert system for automatic analysis of facial expressions [J] . Image and Vision Computing, 2000, 18(11): 881-905.
[55]  Tian Y I, Kanade T, Cohn J F. Recognizing action units for facial expression analysis [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(2) : 97-115.
[56]  Kapoor A, Qi Y, Picard R W. Fully automatic upper facial action recognition [ A ] . In: Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures [C] , Nice, France, 2003 : 195-202.
[57]  Matsumoto D, Kasri F, Kooken K. American-Japanese cultural differences in judgements of expression intensity and subjective experience [J]. Cognition and Emotion, 1999, 13 (2) : 201-218.
[58]  Niedenthal P M, Halberstadt J B, Margolin J, et al. Emotional state and the detection of change in facial expression of emotion [J]. European Journal of Social Psychology, 2000, 30 (2) : 211-222.
[59]  Ghent J, Mcdonald J. Photo-realistic facial expression synthesis [J]. Image and Vision Computing, 2005, 23(12) : 1041-1050.
[60]  Kobayashi H, Hara F. Recognition of six basic facial expressions and their strength by neural network [ A ]. In: Proceedings of the IEEE International Workshop on Robot and Human Communication [C], Tokyo, Japan, 1992: 381-386.
[61]  Kimura S, Yachida M. Facial expression recognition and its degree estimation [ A]. In: Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition [C], San Juan, Puerto Rico, 1997 : 295-300.
[62]  Lien J J J, Kanade T, Cohn J F, et al. Subtly different facial expression recognition and expression intensity estimation [ A]. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition [C], Santa Barbara, CA, USA, 1998 : 853-859.
[63]  Wang M, Iwai Y, Yachida M. Recognizing degree of continuous facial expression change [ A ] . In: Proceedings of the 14th International Conference on Pattern Recognition [C] , Brisbane, Australia, 1998 : 1188-1190.
[64]  Yang D, Kunihiro T, Shimoda H, et al. A study of real-time image processing method for treating human emotion by facial expression [ A ]. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics [C], Tokyo, Japan, 1999:360-364.
[65]  Lee K K, Xu Y. Real-time estimation of facial expression intensity [A]. In: Proceedings of the IEEE International Conference on Robotics & Automations [C], Taipei, Taiwan, China, 2003: 2567-2572.
[66]  李燕.[D].长沙:湖南大学,2006.
[67]  Kobayashi H, Hara F. Recognition of mixed facial expressions by neural network [ A ] . In: Proceedings of the IEEE International Workshop on Robot and Human Communication [C], Tokyo, Japan, 1992 : 387-391.
[68]  Ralescu A, Iwamoto H. Recognition of and reasoning about facial expressions using fuzzy logic [ A ]. In: Proceedings of the 2nd IEEE International Workshop on Robot and Human Communication [C], Tokyo, Japan, 1993 : 259-264.
[69]  金辉 高文.人脸面部混合表情识别系统[J].计算机学报,:.
[70]  武宇文.[D].北京:北京大学,2005.
[71]  左坤隆.[D].天津:天津大学,2004.
[72]  Zhao H, Wang Z L, Men J H. Facial complex expression recognition based on fuzzy kernel clustering and support vector machines [ A]. In: Proceedings of the Third International Conference on Natural Computation [C], Haikou, China, 2007 : 562-566.
[73]  El Kaliouby R, Robinson P. Real-time inference of complex mental states from facial expressions and head gestures [ A ]. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop [C], Washington, DC, USA, 2004: 154-159.
[74]  Littlewort G C, Bartlett M S, Lee K. Faces of pain: automated measurement of spontaneous facial expressions of genuine and posed pain [ A]. In: Proceedings of the 9th International Conference on Muhimodal Interfaces [C], Nagoya, Aichi, Japan, 2007 : 15-21.
[75]  Ashraf a B, Lucey S, Cohn J F, et al. The painful face: pain expression recognition using active appearance models [ A ]. In: Proceedings of the 9th International Conference on Muhimodal Interfaces [C], Nagoya, Aichi, Japan, 2007: 9-14.
[76]  Saradadevi M, Bajaj P. Driver fatigue detection using mouth and yawning analysis [J]. International Journal of Computer Science and Network Security, 2008, 8 (6) : 183-188.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133