全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

与语速相关的人脸语音动画合成及其评估

DOI: 10.11834/jig.20090725

Keywords: 语速,皮肤-肌肉组织,语音动画,感知学评估实验

Full-Text   Cite this paper   Add to My Lib

Abstract:

为了有效地合成人脸语音动画,根据对唇区肌肉收缩力与语速关系的分析,以及在对皮肤肌肉组织的粘弹性力学进行研究的基础上,提出了一种新的基于不同语速的唇动模型,并将其应用在了汉语人脸语音动画系统中。该模型根据获得的肌肉收缩力与语速的关系,并通过对皮肤肌肉组织的粘弹性分析,首先得到了语速、唇动速度与唇动位移三者之间的关系,并建立了不同语速下的唇动模型;然后通过这个唇动模型合成了不同语速状态下的具有较高自然度和个性化的人脸语音动画;最后,通过设计感知学评估实验,对合成的语音动画的效果和可理解性进行了评估。实验结果表明,该模型可以合成较高可接受性和可理解性的不同语速状态下的人脸语音动画。

References

[1]  Waters K,Levergood T M,DECface:An Automatic Lip-Synchronizationn Algorithm for Synthetic Faces,DEC Cambridge Research Laboratory,UK,1993.
[2]  Cohen M,Masssro D,Modeling eoarticulation in synthetic visual speech,Tpkyo,Japan:SpringerVerlag,1993.
[3]  Bregler C,Covell M,Slaney M,Video Rewrite:driving visual speech with audio,Los Angeles,CA,USA,1997.
[4]  Kshirsagar S,Magnenat-thalmann N,Lip synchronization using linear predictive analysis,New York,USA,2000.
[5]  Song Ming-Li,Cheu C,Bu J,3D realistic talking face sodriven by text and speech,Washington,DC USA,2003.
[6]  Kuehn D P,Moll K L,A eineradiogrsphic study of VC and CV articulatory velocities,JOURNAL OF PHONETICS,1976.
[7]  Ostry D J,Munhall K G,Coutral of rote and duration of speech movements,Journal of the Acoustical Society of Amerina,1985(2).
[8]  De Luca C J,The use of sudece electromyography in bio-mechanics,Join\'hal Application Biomechanics,1997(2).
[9]  Wohlert A B,Hammen V L,Lip muscle activity related to speech rate and loudness,Journal of Speech,Language,and Hearing Research,2000(5).
[10]  Fung Y,Biomechanics:Mechanical Properties of Living Tissues,New York,USA:Springer Verlag,1993.
[11]  Basmajian J V,De Luca C J,Muscles Alive:Their Functions Revealed by Electro-myography,Baltimore,Maryland,USA:Williams & Wilkins,1985.
[12]  Zhang Y,Prakush E C,Sung E,A new physical model with multilayer architecture for facial expression animation using dynamic adaptive mesh,IEEE Transactions on Visualization and Computer Graphics,2004(3).
[13]  Zhou Wei,Wang Zeng-fu,Speech animation based on Chinese mandarin triphone model,Melbourne,Australia,2007.
[14]  Watens K,A muscle model for animating three dimensional facial expression,Computers and Graphics,1987(4).
[15]  周维.鲍远律.於俊.邓明之 改进的光流法及其在云爆弹研究中的应用 [J].-光电工程2006(2)
[16]  Li Z,Tan E C,McLoughlin I,Teo T T,Proposal of standards for intelligibility test of Chinese speech,IEE Proceedings Vision,Image & Signal Processing,2000(3).
[17]  Wang Zhi-ming,Cai Lian-hoag,Ai Hai-zhou,Text-to-visual speech in Chinese based on data-driven approach,Journal of Software,2005(6).

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133