全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...
电子学报  2013 

基于多模态视觉特征的自然人机交互

DOI: 10.3969/j.issn.0372-2112.2013.11.017, PP. 2223-2229

Keywords: 人机交互,多模态视觉特征,非穿戴,机器学习

Full-Text   Cite this paper   Add to My Lib

Abstract:

针对目前人机交互中存在的问题与不足,提出了一种基于多模态视觉特征的人机交互新方法.采用二维Gabor小波提取全局人脸朝向视觉特征,克服人脸显著特征提取困难,以及不同人脸朝向特征区分的难度性;基于人脸几何分布特征,快速定位人眼中心,无需考虑人脸图像分辨率和人眼闭合及其配戴情况;通过对视觉特征的重要性评价,选取分类特性显著的多模态视觉特征进行机器学习与训练,确定用户所指目标,实现非穿戴自然人机交互,用户无需佩戴任何标记,且其活动不受约束,便于充分发挥其日常技能.通过实验对比,验证了文中所提方法有效、可行,可应用于实时非穿戴自然人机交互中.

References

[1]  A H Sadka,D Crookes.Multimodal biometric human recognition for perceptual human-computer interaction[J].IEEE Transactions on Systems,Man,and Cybernetics-Part C:Applications and reviews,2010,40(6):676-681.
[2]  Z Cernekova,N Nikolaidis,I Pitas.Single camera pointing gesture recognition using spatial features and support vector machines[A].Proceedings of European Signal Processing Conference[C].Poznan,Poland:European Signal Processing Conference,2007.130-134.
[3]  陈明炫,邓昌智,任磊,田丰,戴国忠.一种基于模型驱动的笔式界面开发框架研究[J].电子学报,2011,39(2):268-274. CHEN Ming-xuan,DENG Chang-zhi,REN Lei,TIAN Feng,DAI Guo-zhong.Research on a model driven development framework for pen-based user interface[J].Acta Electronica Sinica,2011,39(2):268-274.(in Chinese)
[4]  A Kaiser,W Schenck,R M? ller.Stereo matching and depth perception by visual prediction[A].Proceedings of SAB Workshop on Artificial Mental Imagery[C].Odense,Denmark:IEEE,2012.7-10.
[5]  S W Chin,K P Seng,L-M Ang.Audio-visual speech processing for human computer interaction[A].Proceedings of International Conference on Advances in Robotics and Virtual Reality[C].Istanbul,Turkey:IEEE,2012.135-165.
[6]  A Mehrabian.Communication without words[J].Psychology Today,1968,2(4):53-56.
[7]  C Colombo,A D Bimbo,A Valli.Visual capture and understanding of hand pointing actions in 3-D environment[J].IEEE Transactions on Systems,Man and Cybernetics-Part B:Cybernetics,2003,33(4):677-686.
[8]  C C Chang,H Aghajan.Linear dynamic data fusion techniques for face orientation estimation in smart camera networks[A].Proceedings of IEEE International Conference on Distribution Smart cameras[C].Vienna,Austria:Institute of Electrical and Electronics Engineers Computer Society,2007:44-51.
[9]  Y Zhang,L Wu,Z Dong,S Wang,Z Zhou.Face orientation estimation by particle swarm optimization[A].Proceedings of International Conference on Information Science and Engineering[C].Shanghai,China:IEEE Computer Society,2009.399-391.
[10]  张闯,迟健男,张朝晖,王志良.一种基于立体视觉的视线估计方法[J].电子学报,2010,38(5):1008-1013. ZHANG Chuang,CHI Jian-nan,ZHANG Zhao-hui,WANG Zhi-liang.A novel gaze estimation method based on stereo vision[J].Acta Electronica Sinica,2010,38(5):1008-1013.(in Chinese)
[11]  H Gunes,M Piccardi.Assessing facial beauty through proportion analysis by image processing and supervised learning[J].International Journal of Human-Computer Studies,2006,64(12):1184-1199.
[12]  C H Han,K B Sim.Real-time face detection using Adaboost algorithm[A].Proceedings of International Conference on Control,Automation and Systems[C].Seoul,South Korea:IEEE,2008,10:1892-1895.
[13]  贾新丽,管业鹏,成晓晴.基于运动变化的指势行为实时判别方法[J].电视技术,2011,35(1):129-132. JIA Xinli,GUAN Yepeng,CHENG Xiaoqing.Real-time pointing gesture discrimination based on motion variation[J].Video Engineering,2011,35(1):129-132.(in Chinese )
[14]  L Malagón-Borja,O Fuentes.Object detection using image reconstruction with PCA[J].Image and Vision Computing,2009,27(1):2-9.
[15]  N Sharma,P Sharma,D Irwin,P Shenoy.Predicting solar generation from weather forecasts using machine learning[A].Proceedings of IEEE International Conference on Smart Grid Communications[C].Brussels,Belgium:IEEE Computer Society,2011.528-533.
[16]  L M Reeves,J Lai,J A Larson,et al.Guidelines for multimodal user interface design[J].Communications of the ACM,2004,47(1):57-59.
[17]  G R S Murthy,R S Jadon.Computer vision based human computer interaction[J].Journal of Artificial Intelligence,2011,4(4):245-256.
[18]  Z Li,R Jarvis.A multi-modal gesture recognition system in a human-robot interaction scenario[A].Proceedings of IEEE International Workshop on Robotic and Sensors Environments[C].Lecco,Italy:IEEE Instrumentation and Measurement Society,2009.41-46.
[19]  A Karpov,A Ronzhin,I Kipyatkova.An assistive bi-modal user interface integrating multi-channel speech recognition and computer vision[A].Proceedings of HCI[C].Orlando,United States:Springer Verlag,2011.454-463.
[20]  S Carrino,A Péclat,E Mugellini.Humans and smart environments:a novel multimodal interaction approach[A].Proceedings of International Conference on Multimodal Interaction[C].Alicante,Spain:Association for Computing Machinery,2011.105-112.
[21]  N Jojic,B Brumitt,B Meyers,S Harris,T Huang.Detection and estimation of pointing gestures in dense disparity maps[A].Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition[C].The Hague,Netherlands:IEEE,2000.468-475.
[22]  N J Enfield,S Kita,J P de Ruiter.Primary and secondary pragmatic functions of pointing gestures[J].Journal of Pragmatics,2007,39(10):1722-1741.
[23]  Y-P Guan.Uncalibrated camera vision pointing recognition for HCI[A].Proceedings of IEEE International Conference on Computational Science and Engineering[C].Hong Kong,China:IEEE Computer Society,2010.204-207.
[24]  X Wang,H Huang,Z Ruan,Z Lu.Fast face orientation estimation from an uncalibrated monocular camera[A].Proceedings of Congress on Image and Signal Processing[C].Sanya,China:Institute of Electrical and Electronics Engineers Computer Society,2008.186-190.
[25]  A V Puri,H Kannan,P Kalra.Coarse head pose estimation using image abstraction[A].Proceedings of Conference on Computer and Robot Vision[C].Regina,Canada:IEEE Computer Society,2012.125-130.
[26]  Y Jefferson.Facial beauty:establishing a universal standard[J].International Journal of Orthodontics,2004,15(1):9-22.
[27]  X Zhao,X Chai,Z Niu,C Heng,S Shan.Context constrained facial landmark localization based on discontinuous Haar-like feature[A].Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition and Workshops[C].Santa Barbara,United States:IEEE Computer Society,2011.673-678.
[28]  J P Papa,A X Falc o,V H C de Albuquerque,J M R S Tavares.Efficient supervised optimum-path forest classification for large datasets[J].Pattern Recognition,2012,45(1)512-520.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133