全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

基于表情传输的交互式照片编辑

DOI: 10.11834/jig.20151013

Keywords: 表情映射,特征点检测,二次光照,泊松融合

Full-Text   Cite this paper   Add to My Lib

Abstract:

目的生活中照片拍摄时难以捕捉到所有人脸表情最佳的时刻,多次摆拍不仅费时,而且可能会错过某些场景,传统的后期编辑软件不具备针对性,且操作复杂。针对人物照片中部分人脸表情不佳的情况,提出一种基于表情传输的交互式照片编辑算法。方法首先将包含源人脸的照片与具有目标表情人脸的照片进行特征点检测,通过交互将指定人脸部分选出并将其姿态归正为眼睛在同一水平线上,如果目标人脸与源人脸身份相同,将目标人脸区域根据源人脸的轮廓以及左右半脸分布以扫描线变形得到替换目标;不相同时根据目标人脸特征点分布的几何特征计算源人脸中特征点的新位置,通过基于特征点变化的网格变形得到替换目标,最后利用二次光照与泊松融合将其无缝拼接到源图中。结果实验表明算法可以对人脸五官清晰且在宽容度内的人物照片进行表情编辑,处理结果只改变了人物的脸部表情,并且无明显拼接痕迹。结论提出了一种新型针对目标人脸不同身份信息的交互式表情传输模型,该模型可以适应不同的编辑条件与要求,效果出色。

References

[1]  Agarwala A, Dontcheva M. Interactive digital photomontage[J]. ACM Transactions on Graphics, 2004, 23(3): 292-300. [DOI: 10.1145/1186562.1015718]
[2]  Bitouk D, Kumar N, Dhillon S, et al. Face swapping: automatically replacing faces in photographs[J]. ACM Transactions on Graphics, 2008, 27(3):15-19. [DOI: 10.1145/1399504. 1360638]
[3]  Gao Y, Xu J Z, Wang C B, et al. Algorithm for human face fusion under constraints[J].Journal of Image and Graphics, 2010,15(3):502-506.[高岩,许建中,王长波,等.约束条件下的人脸五官替换算法[J].中国图象图形报,2010,15(3):502-506.] [DOI: 10.11834/jig.20100322]
[4]  Li C X. Automatically replacing faces in images and videos[D]. Beijing: Beijing Institute of Technology, 2011.[李传学. 图像/视频中自动人脸替换研究[D].北京:北京理工大学,2011.]
[5]  Yu T L, Ran Y. A face based image processing device and method. Zhejiang: CN103593870A[P].2014-02-19.[俞天力,冉阳. 一种基于人脸的图像处理装置及其方法. 浙江CN103593870A[P],2014-02-19. ]
[6]  Zhang Q, Liu Z, Guo B, et al. Geometry-driven photorealistic facial expression synthesis[J]. IEEE Transactions on Visualization & Computer Graphics, 2006, 12(1):48-60. [DOI: 10. 1109/tvcg.2006.9]
[7]  Song L M, Wang H Q, Chen C. A laplacian differential approach for face detail transfer[J].Journal of Computer-aided Design&Computer Graphics, 2008, 20(1):50-54.[宋明黎,王慧琼,陈纯. 基于拉普拉斯微分的脸部细节迁移[J]. 计算机辅助设计与图形学学报,2008,20(1):50-54.]
[8]  Zhao N. Automatic tagging of facial feature points and expression generation[D]. Beijing:Beijing Institute of Technology,2011 [赵宁. 人脸特征点自动标注及表情生成[D]. 北京:北京理工大学, 2011.]
[9]  Vlasic D, Brand M, Pfister H, et al. Face transfer with multilinear models[J]. ACM Transactions on Graphics, 2005, 24(3): 426-433. [DOI: 10.1145/1186822. 1073209]
[10]  Yang L.A practical editorial system for facial customization and expression animation[J]. Journal of Image and Graphics,2002,7(4):325-331.[梅丽. 一个实用的人脸定制和表情动画编辑系统[J]. 中国图象图形学报,2002,7(4):325-331.][DOI: 10.11834/jig.200204117]
[11]  Umenhoffer T, Tóth B. Facial animation retargeting frameworkusing radial basis functions[C]//Proceedings of 6th Hungarian Conference on Computer Graphics and Geometry.New York: ACM, 2012: 195-204.[DOI: 10.1145/2019406.2019433]
[12]  Stoiber N, Seguier R, Breton G. Facial animation retargeting and control based on a human appearance space[J]. Computer Animation and Virtual Worlds, 2010, 21(1): 39-54. [DOI: 10.1002/cav.331]
[13]  Zhou E, Fan H, Cao Z, et al. Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]//Proceedings of IEEE International Conference on Computer Vision Workshops. Sydney, NSW:IEEE,2013:386-391.[DOI:10.1109/ICCVW.2013.58]
[14]  Fan H, Cao Z, Jiang Y, et al. Learning deep face representation [DB/OL].2014-03-12[2015-04-01]. http://arxiv.org/abs/1403.2802v1.
[15]  Chen J, Su G, He J, et al. Face image relighting using locally constrained global optimization[C]//Computer Vision-ECCV 2010. European, Berlin Heidelberg:Springer 2010: 44-57. [DOI:10.1007/978-3-642-15561-1_4]
[16]  Yu X C, Li Z M, Yu G B. An image deformation algorithm based on scan line[J]. Journal of Engineering Graphics, 2006, 3: 92-96.[于学春,李宗民,于广斌. 一种基于扫描线的图像变形算法[J].工程图学学报,2006,3:92-96.][DOI: 10.3969/j.issn.1003-0158. 2006.03.016]
[17]  Yang J Z, Liu Z K, Yu N H, et al. An Image warping method based on control points and its applications[J]. Journal of Image and Graphics,2001,6(11):26-30.[杨金钟,刘政凯,俞能海,等. 基于控制点的图象变形方法及其应用[J]. 中国图象图形学报,2001,6(11):26-30.][DOI: 10.3969/j.issn.1006-8961.200111005]
[18]  Zhan Q, Li B B, Wei X P. Facial expression synthesis based on feature points. Liao Ning: CN103035022A[P]. 2013-04-10.[张强,李蓓蓓,魏小鹏.基于特征点的人脸表情合成方法.辽宁:CN103035022A[P].2013-04-10 ]
[19]  Chen Y,Zhang L Y,Yi X B.Bilinear regression based expression face neutralization preserving person-specific characters[J].Pattern Recongnition and Artificial Intelligence,2014,10;949-953.[陈莹,张龙媛,仪晓斌. 基于双线性回归的个体人脸表情图像归正方法[J]. 模式识别与人工智能,2014,10:946-953.][DOI: 10.3969/j.issn.1003-6059.2014.10.012]

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133