|
|
- 2018
深度卷积神经网络嵌套fine-tune的图像美感品质评价
|
Abstract:
摘要： 针对使用卷积神经网络对图像美感品质研究中图像数据库过小的问题,使用fine-tune的迁移学习方法,分析卷积神经网络结构和图像内容对图像美感品质评价的影响。在按图像内容进行美感品质评价研究时,针对图像数据再次减小的问题,提出连续两次fine-tune的嵌套fine-tune方法,并在数据库Photo Quality上进行试验。试验结果表明,嵌套fine-tune方法得到的美感品质评价正确率比传统提取人工设计特征方法平均高出5.36%,比两种深度学习方法分别平均高出3.35%和2.33%,有效解决了卷积神经网络在图像美感品质研究中因图像数据库过小而带来的训练问题。
Abstract: The image database was not big enough for using convolutional neural networks to research the image aesthetic quality. Aiming at this problem, a fine-tune transfer learning method was used to analyze the effect of convolutional neural networks architecture and image contents on image aesthetic quality evaluation. During the research of image aesthetic quality evaluation by image contents, the problem of image data decrease rose again. The embedded fine-tune method using fine-tune twice continuously was proposed to solve the problem. The experiments were performed on Photo Quality, a small image database, and got a good effect. The results indicated that the accuracy of image aesthetic quality evaluation by embedded fine-tune was an average of 5.36% higher than by traditional artificially designed feature extraction method, 3.35% and 2.33% higher than by the other two deep learning methods respectively. The embedded fine-tune deep convolutional neural networks solved the problem of small database in image aesthetic quality evaluation research effectively and accurately
| [1] | LUO W, WANG X G, TANG X OU. Content-based photo quality assessment [J]. IEEE Transaction on Multimedia, 2013, 15(8): 1930-1943. |
| [2] | SHAO J, ZHOU Y. Photo quality assessment in different categories [J]. Journal of Computational Information Systems, 2013, 9(8): 3209-3217. |
| [3] | OBRADOR P, SCHMIDT-HACKENBERG L, OLIVER N. The role of image composition in image aesthetics[C] //IEEE International Conference on Image Processing. Hong Kong, China: IEEE Xplore, 2010:3185-3188. |
| [4] | WANG C, PU Y, XU D. Evaluating aesthetics qualities in portrait images[J]. Journal of Software, 2015, 26(S2): 20-28. |
| [5] | GUO L, LI F, LIEW W C. Image Aesthetic Evaluation Using Parallel Deep Convolution Neural Network[C] //International Conference on Digital Image Computing: Techniques and Applications. Gold Coast, Australia: IEEE Computer Society, 2016:1-5. |
| [6] | WANG L, OUYANG W, WANG X, et al. Visual tracking with fully convolutional networks[C] //IEEE International Conference on Computer Vision. Santiago, Chile: IEEE Computer Society, 2015:3119-3127. |
| [7] | GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C] //IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA: IEEE Computer Society, 2014:580-587. |
| [8] | SUN Y, WANG X, TANG X. Deep learning face representation from predicting 10 000 classes[C] //IEEE Conference on Computer Vision and Pattern Recognition. Hong Kong, China: IEEE, 2014:1891-1898. |
| [9] | JIA Y, SHELHAMER E, DONAHUE J, et al. Caffe: convolutional architecture for fast feature embedding[EB/OL].(2014-6-20)[2018-3-22]. https://arxiv.org/abs/1408.5093 |
| [10] | LECUN Y, BOSER B, DENKER J, et al. Back propagation applied to handwritten zip code recognition[J]. Neural Computation, 2014, 1(4):541-551. |
| [11] | CHATFIELD K, SIMONYAN K, VEDALDI A, et al. Return of the devil in the details: delving deep into convolutional nets[C] //Proceeding of British Machine Vision Conference. Nottingham, UK: BMVA Press, 2014. |
| [12] | DHAR S, ORDONEZ V, BERG T L. High level describable attributes for predicting aesthetics and interestingness[C] // Computer Vision and Pattern Recognition. Colorado, USA: IEEE Computer Society, 2011:1657-1664. |
| [13] | HINTON G E, OSINDERO S, TEH Y W. A fast learning algorithm for deep belief nets[J]. Neural Computation, 2006, 18(7):1527-1544. |
| [14] | KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C] //International Conference on Neural Information Processing Systems. Nevada, USA:Curran Associates Inc, 2012:1097-1105. |
| [15] | KARAYEV S, TRENTACOSTE M, HAN H, et al. Recognizing image style[EB/OL].(2014-7-23)[2018-3-22]. https://arxiv.org/abs/1311.3715. |
| [16] | DATTA R, JOSHI D, LI J, et al. Studying aesthetics in photographic images using a computational approach[C] //European Conference on Computer Vision. Graz, Austria: Springer-Verlag, 2006: 288-301. |
| [17] | WANG C H, PU Y Y, XU D, et al. Evaluating aesthetics quality in scenery photo[C] //Proceeding of National Conference on Multimedia Technology. Beijing, China: Machinery Industry Press, 2015:141-149. |
| [18] | LU X, LIN Z, JIN H, et al. Rapid: rating pictorial aesthetics using deep learning[C] //Proceedings of the ACM International Conference on Multimedia. Orlando, USA: ACM, 2014:457-466. |
