We propose a technique to enhance emotional expressiveness in games and animations. Artists have used colors and painting techniques to convey emotions in their paintings for many years. Moreover, researchers have found that colors and line properties affect users' emotions. We propose using painterly rendering for character sequences in games and animations with a knowledge-based approach. This technique is especially useful for parametric facial sequences. We introduce two parametric authoring tools for animation and painterly rendering and a method to integrate them into a knowledge-based painterly rendering system. Furthermore, we present the results of a preliminary study on using this technique for facial expressions in still images. The results of the study show the effect of different color palettes on the intensity perceived for an emotion by users. The proposed technique can provide the animator with a depiction tool to enhance the emotional content of a character sequence in games and animations. 1. Introduction The expressiveness of character-based animations heavily relies on their success in conveying emotions to their viewers. In order to achieve high levels of expressiveness, today's game character sequences not only rely on the animation techniques, but also on other elements such as lighting and scene composition. The latter not only enhances the emotional content of the scene, but also draws attention to the specific regions designed for conveying the message. In a similar way, painters use color, various brush strokes, and painting techniques to emphasize certain features of a scene while leaving out unnecessary details. Edward Munch and Vincent Van Gogh are two exemplary artists that used colors to depict emotions in their work [1]. The use of texture for inducing mood is also evident in different brush stroke styles used by artists [2]. The emotional effects of art and paintings on users point to the importance of visual style on users' perception and emotional responses. Some past psychological studies demonstrated that there are links between rendering style and one's perception and feelings about a rendered object [3–5]. Furthermore, some other studies investigated people's association between colors and emotion [1, 5, 6]. Painterly rendering, a subset of Nonphotorealistic Rendering (NPR) simulates the work of illustrators and portrait artists and is commonly reported as an expressive style [7–9]. We propose using the expressive style of painterly rendering to enhance the emotional content of facial character sequences in games
References
[1]
O. da Pos and P. Green-Armytage, “Facial expressions, colours and basic emotions,” Colour: Design and Creativity, vol. 1, no. 1, p. 2, 2007.
[2]
M. Shugrina, M. Betke, and J. Collomosse, “Empathie painting: interactive stylization through observed emotional state,” in Proceedings of the 4th International Symposium on Non-Photorealistic Animation and Rendering, pp. 87–96, 2006.
[3]
D. J. Duke, P. J. Barnard, N. Halper, and M. Mellin, “Rendering and affect,” Computer Graphics Forum, vol. 22, no. 3, pp. 359–368, 2003.
[4]
N. Halper, M. Mellin, C. S. Herrmann, V. Linneweber, and T. Strothotte, “Psychology and non-photorealisticrendering: the beginning of a beautiful relationship,” Mensch & Computer 2003: Interaktion in Bewegung, pp. 277–286, 2003.
[5]
K. Hevner, “Experimental studies of the affective value of colors and lines,” Journal of Applied Psychology, vol. 19, no. 4, pp. 385–398, 1935.
[6]
P. Valdez and A. Mehrabian, “Effects of color on emotions,” Journal of Experimental Psychology, vol. 123, no. 4, pp. 394–409, 1994.
[7]
J. Hays and I. Essa, “Image and video based painterlyanimation,” in Proceedings of the 3rd International Symposium on Non-Photorealistic Animation Andrendering, pp. 113–120, 2004.
[8]
A. Hertzmann, Algorithms for rendering in artisticstyles, Ph.D. thesis, New York University, New York, NY, USA, 2001.
[9]
J. Lansdown and S. Schofield, “Expressive rendering: a review of nonphotorealistic techniques,” IEEE Computer Graphics and Applications, vol. 15, no. 3, pp. 29–37, 1995.
[10]
A. Mehrabian, “Pleasure-Arousal-Dominance: a general framework for describing and measuring individual differences in temperament,” Current Psychology, vol. 14, no. 4, pp. 261–292, 1996.
[11]
S. DiPaola, C. Riebe, and J. T. Enns, “Rembrandt's textural agency: a shared perspective in visual art and science,” Leonardo, vol. 43, no. 2, pp. 145–151, 2010.
[12]
A. Santella and D. DeCarlo, “Visual interest and NPR: an evaluation and manifesto,” in Proceedings of the 3rd International Symposium on Non-Photorealistic Animation and Rendering (NPAR '04), pp. 71–78, 2004.
[13]
D. O'Regan and A. C. Kokaram, “Skin-aware stylization of video portraits,” in Proceedings of the 6th European Conference for Visual Media Production (CVMP '09), pp. 35–44, November 2009.
[14]
S. DiPaola and C. Akai, “Blending science knowledge and AI gaming techniques for experiential learning,” in Proceedings of Canadian Gaming Studies Association, York University, Toronto, Canda, 2006.
[15]
S. DiPaola, “Exploring a parameterised portraitpainting space,” International Journal of Arts and Technology, vol. 2, no. 1, pp. 82–93, 2009.
[16]
A. Arya, L. N. Jefferies, J. T. Enns, and S. DiPaola, “Facial actions as visual cues for personality,” Computer Animation and Virtual Worlds, vol. 17, no. 3-4, pp. 371–382, 2006.
[17]
P. N. Juslin and J. A. Sloboda, Music and Emotion:Theory and Research, Oxford University Press, Oxford, UK, 2001.
[18]
A. J. Cohen, “Music as a source of emotion in film,” in Music and Emotion: Theory and Research, P. N. Juslin and J. A. Sloboda, Eds., pp. 249–272, 2001.
[19]
C. de Melo and A. Paiva, “Expression of emotions in virtual humans using lights, shadows, composition and filters,” in Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction (ACII '07), vol. 4738, pp. 546–557, 2007.
[20]
J. Birn, Digital Lighting and Rendering, New Riders, Thousand Oaks, Calif, USA, 2005.