Creativity or creative thinking are often viewed as intangibles that we can observe in their impact and consequences, but that in itself is hard to define and assess. Some would even argue that assessments, which generally look for the capacity of students to find and refine pre-defined answers, stand in direct opposition to efforts to strengthen creativity. However, what we cannot see is hard to improve and what we cannot measure will not get attention. For this reason, the OECD Programme for International Student Assessment (PISA) is making efforts to build a novel assessment that can capture elements of creative thinking. The approach is based on evidence-centred design which involves documented, explicit linkages among the test purposes, the assumptions made about the test takers and that the test seeks to measure among them, and the evidence supporting the claims. This paper summarises the rationale and design of this assessment.
References
[1]
Amabile, T. (1983). The Social Psychology of Creativity: A Componential Conceptualization. Journal of Personality and Social Psychology, 45, 357-376.
https://doi.org/10.1037/0022-3514.45.2.357
[2]
Amabile, T. (1996). Creativity in Context: Update to the Social Psychology of Creativity. Westview Press.
[3]
Amabile, T. (1997). Motivating Creativity in Organizations: On Doing What You Love and Loving What You Do. California Management Review, 40, 39-58.
https://doi.org/10.2307/41165921
[4]
Amabile, T. (2012). Componential Theory of Creativity. No. 12-096, Harvard Business School. http://www.hbs.edu/faculty/Publication%20Files/12-096.pdf
[5]
Amabile, T., & Pratt, M. (2016). The Dynamic Componential Model of Creativity and Innovation in Organizations: Making Progress, Making Meaning. Research in Organizational Behavior, 36, 157-183. https://doi.org/10.1016/j.riob.2016.10.001
[6]
Baer, J. (2011). Domains of Creativity. In M. Runco, & S. Pritzker (Eds.), Encyclopedia of Creativity (2nd ed., pp. 404-408). Elsevier Inc.
https://doi.org/10.1016/B978-0-12-375038-9.00079-0
[7]
Baer, J. (2016). Creativity Doesn’t Develop in a Vacuum. Perspectives on Creativity Development: New Directions for Child and Adolescent Development, 2016, 9-20.
https://doi.org/10.1002/cad.20151
[8]
Bandura, A. (1997). Self-Efficacy: The Exercise of Control. Worth Publishers.
https://books.google.fr/books/about/Self_Efficacy.html?id=eJ-PN9g_o-EC&redir_esc=y
[9]
Barbot, B., & Heuser, B. (2017). Creativity and Identity Formation in Adolescence: A Developmental Perspective. In The Creative Self (pp. 87-98). Elsevier.
https://doi.org/10.1016/B978-0-12-809790-8.00005-4
[10]
Barbot, B., Lubart, T., & Besancon, M. (2016). “Peaks, Slumps, and Bumps”: Individual Differences in the Development of Creativity in Children and Adolescents. In B. Barbot (Ed.), Perspectives on Creativity Development: New Directions for Child and Adolescent Development, No. 151 (pp. 33-45). Jossey-Bass. https://doi.org/10.1002/cad.20152
[11]
Batey, M., & Furnham, A. (2006). Creativity, Intelligence, and Personality: A Critical Review of the Scattered Literature. Genetic, Social and General Psychology Monographs, 132, 355-429. https://doi.org/10.3200/MONO.132.4.355-430
[12]
Beghetto, R. (2006). Creative Self-Efficacy: Correlates in Middle and Secondary Students. Creativity Research Journal, 18, 447-457. https://doi.org/10.1207/s15326934crj1804_4
[13]
Beghetto, R. (2010). Creativity in the Classroom. In J. Kaufman, & R. Sternberg (Eds.), The Cambridge Handbook of Creativity (pp. 447-464). Cambridge University Press.
https://doi.org/10.1017/CBO9780511763205.027
[14]
Beghetto, R., & Kaufman, J. (2007). Toward a Broader Conception of Creativity: A Case for “mini-c” Creativity. Psychology of Aesthetics, Creativity, and the Arts, 1, 73-79.
https://doi.org/10.1037/1931-3896.1.2.73
[15]
Beghetto, R., & Kaufman, J. (2010). Nurturing Creativity in the Classroom. Cambridge University Press. https://doi.org/10.1017/CBO9780511781629
[16]
Beghetto, R., & Plucker, J. (2006). The Relationship among Schooling, Learning, and Creativity: “All Roads Lead to Creativity” or “You Can’t Get There from Here”? In J. Kaufman, & J. Baer (Eds.), Creativity and Reason in Cognitive Development (pp. 316-332). Cambridge University Press.
https://doi.org/10.1017/CBO9780511606915.019
[17]
Beghetto, R., & Karwowski, M. (2017). Toward Untangling Creative Self-Beliefs. In M. Karwowski, & J. Kaufman (Eds.), The Creative Self: Effect of Beliefs, Self-Efficacy, Mindset, and Identity (pp. 3-22). Academic Press.
https://doi.org/10.1016/B978-0-12-809790-8.00001-7
[18]
Beghetto, R., Baer, J., & Kaufman, J. (2015). Teaching for Creativity in the Common Core Classroom. Teachers College Press.
[19]
Bereiter, C., & Scardamalia, M. (1987). The Psychology of Written Composition. L. Erlbaum Associates.
[20]
Berzonsky, M., & Sullivan, C. (1992). Social-Cognitive Aspects of Identity style. Journal of Adolescent Research, 7, 140-155. https://doi.org/10.1177/074355489272002
[21]
Brown, T., & Wyatt, J. (2010). Design Thinking for Social Innovation. Stanford Social Innovation Review. https://doi.org/10.1596/1020-797X_12_1_29
https://ssir.org/articles/entry/design_thinking_for_social_innovation
[22]
Bruner, J. (1979). On Knowing: Essays for the Left Hand. Belknap Press of Harvard University.
[23]
Carter, J. (2001). Creating Writers: A Creative Writing Manual for Schools. Routledge/ Falmer. https://doi.org/10.4324/9780203252031
https://epdf.tips/creating-writers-a-creative-writing-manual-for-schools.html
[24]
Cropley, A. (1990). Creativity and Mental Health in Everyday Life. Creativity Research Journal, 13, 167-178. https://doi.org/10.1080/10400419009534351
[25]
Cropley, A. (2006). In Praise of Convergent Thinking. Creativity Research Journal, 18, 391-404. https://doi.org/10.1207/s15326934crj1803_13
[26]
Csikszentmihalyi, M. (1996). Creativity: Flow and the Psychology of Discovery and Invention. Harper Collins Publishers.
https://books.google.fr/books/about/Creativity.html?id=K0buAAAAMAAJ&redir_esc=y
[27]
Davis, G., & Rimm, S. (1985). Education of the Gifted and Talented. Prentice Hall.
https://books.google.fr/books/about/Education_of_the_gifted_and_talented.html?id=2AEmAQAAIAAJ&redir_esc=y
[28]
DeCoker, G. (2000). Looking at U.S. Education through the Eyes of Japanese Teachers. Phi Delta Kappan, 81, 780-781.
[29]
DeYoung, C. (2014). Openness/Intellect: A Dimension of Personality Reflecting Cognitive Exploration. In M. Cooper, & R. Larsen (Eds.), APA Handbook of Personality and Social Psychology: Personality Processes and Individual Differences (pp. 369-399). American Psychological Association. https://doi.org/10.1037/14343-017
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.725.2495&rep=rep1&type=pdf
[30]
Eisenberger, R., & Shanock, L. (2003). Rewards, Intrinsic Motivation, and Creativity: A Case Study of Conceptual and Methodological Isolation. Creativity Research Journal, 15, 121-130. https://doi.org/10.1207/S15326934CRJ152&3_02
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.615.6890&rep=rep1&type=pdf
[31]
Essex, C. (1996). Teaching Creative Writing in the Elementary School. ERIC Digest.
https://files.eric.ed.gov/fulltext/ED391182.pdf
[32]
Feist, G. (1998). A Meta-Analysis of Personality in Scientific and Artistic Creativity. Personality and Social Psychology Review, 2, 290-309.
https://doi.org/10.1207/s15327957pspr0204_5
[33]
Gajda, A., Karwowski, M., & Beghetto, R. (2017). Creativity and Academic Achievement: A Meta-Analysis. Journal of Educational Psychology, 109, 269-299.
https://doi.org/10.1037/edu0000133
Getzels, J., & Csikszentmihalyi, M. (1976). The Creative Vision: A Longitudinal Study of Problem Finding in Art. John Wiley & Sons.
[36]
Glaveanu, V. et al. (2013). Creativity as Action: Findings from Five Creative Domains. Frontiers in Psychology, 4, Article 176. https://doi.org/10.3389/fpsyg.2013.00176
[37]
Grivas, C., & Puccio, G. (2012). The Innovative Team: Unleashing Creative Potential for Breakthrough Results. Jossey-Bass.
[38]
Guastello, S. (2009). Creativity and Personality. In T. Rickards, M. Runco, & S. Moger (Eds.), The Routledge Companion to Creativity (pp. 267-278). Routledge/Taylor & Francis. http://psycnet.apa.org/record/2009-03983-022
[39]
Guilford, J. (1950). Creativity. American Psychologist, 5, 444-454.
https://doi.org/10.1037/h0063487
[40]
Guilford, J. (1956). The Structure of Intellect. Psychological Bulletin, 53, 267-293.
https://doi.org/10.1037/h0040755
[41]
Hatano, G., & Inagaki, K. (1986). Two Courses of Expertise. In H. Stevenson, H. Azuma, & K. Hakuta (Eds.), Child Development and Education in Japan (pp. 262-272). Freeman. https://doi.org/10.4324/9780203888841.ch22
[42]
Hennessey, B., & Amabile, T. (2010). Creativity. Annual Review of Psychology, 61, 569-598.
https://doi.org/10.1146/annurev.psych.093008.100416
[43]
Higgins, S. et al. (2005). A Meta-Analysis of the Impact of the Implementation of Thinking Skills Approaches on Pupils. Eppi-Centre, University of London.
http://eppi.ioe.ac.uk
[44]
Hoover, S. (1994). Scientific Problem Finding in Gifted Fifth-Grade Students. Roeper Review, 16, 156-159. https://doi.org/10.1080/02783199409553563
[45]
Hwang, S. (2015). Classrooms as Creative Learning Communities: A Lived Curricular Expression. https://digitalcommons.unl.edu/teachlearnstudent/55
[46]
Irish National Teacher Association (INTO) (2009). Creativity and the Arts in the Primary School. INTO. http://www.into.ie
[47]
Kashdan, T., & Fincham, F. (2002). Facilitating Creativity by Regulating Curiosity. The American Psychologist, 57, 373-374. http://www.ncbi.nlm.nih.gov/pubmed/12025769
https://doi.org/10.1037/0003-066X.57.5.373
[48]
Kaufman, J., & Baer, J. (2012). Beyond New and Appropriate: Who Decides What Is Creative? Creativity Research Journal, 24, 83-91.
https://doi.org/10.1080/10400419.2012.649237
[49]
Kaufman, J., & Beghetto, R. (2009). Beyond Big and Little: The Four C Model of Creativity. Review of General Psychology, 13, 1-12. https://doi.org/10.1037/a0013688
[50]
Kaufman, J. et al. (2009). Personality and Self-Perceptions of Creativity across Domains. Imagination, Cognition and Personality, 29, 193-209. https://doi.org/10.2190/IC.29.3.c
[51]
Kaufman, S. et al. (2016). Openness to Experience and Intellect Differentially Predict Creative Achievement in the Arts and Sciences. Journal of Personality, 84, 248-258.
https://doi.org/10.1111/jopy.12156
[52]
Kim, Y., Almond, R., & Shute, V. (2016). Applying Evidence-Centered Design for the development of Game-Based Assessments in Physics Playground. International Journal of Testing, 16, 142-163. https://doi.org/10.1080/15305058.2015.1108322
[53]
Long, H., & Plucker, J. (2015). Assessing Creative Thinking: Practical Applications. In R. Wegerif, L. Li, & J. Kaufman (Eds.), The Routledge International Handbook of Research on Teaching Thinking (pp. 315-329). Routledge.
[54]
Lubart, T. (1998). Creativity across Cultures. In R. Sternberg (Ed.), Handbook of Creativity (pp. 339-350). Cambridge University Press.
https://doi.org/10.1017/CBO9780511807916.019
[55]
Lucas, B. (2016). A Five-Dimensional Model of Creativity and Its Assessment in Schools. Applied Measurement in Education, 29, 278-290.
https://doi.org/10.1080/08957347.2016.1209206
[56]
Lucas, B., & Spencer, E. (2017). Teaching Creative Thinking: Developing Learners Who Generate Ideas and Can Think Critically. Crown House Publishing.
https://bookshop.canterbury.ac.uk/Teaching-Creative-Thinking-Developing-learners-who-generate-ideas-and-can-think-critically_9781785832369
[57]
Mayer, R. (1989). Cognitive Views of Creativity: Creative Teaching for Creative Learning. Contemporary Educational Psychology, 14, 203-211.
https://doi.org/10.1016/0361-476X(89)90010-6
[58]
McCrae, R. (1987). Creativity, Divergent Thinking, and Openness to Experience. Journal of Personality and Social Psychology, 52, 1258-1265.
http://psycnet.apa.org/buy/1987-28199-001
https://doi.org/10.1037/0022-3514.52.6.1258
[59]
McCrae, R., & Costa, P. (1987). Validation of the Five-Factor Model of Personality across Instruments and Observers. Journal of Personality and Social Psychology, 52, 81-90.
http://www.ncbi.nlm.nih.gov/pubmed/3820081
https://doi.org/10.1037/0022-3514.52.1.81
[60]
Mislevy, R., Steinberg, L., & Almond, R. (2003). On the Structure of Educational Assessments. Measurement: Interdisciplinary Research and Perspective, 1, 3-62.
https://doi.org/10.1207/S15366359MEA0101_02
[61]
Moravcsik, M. (1981). Creativity in Science Education. Science Education, 65, 221-227.
https://doi.org/10.1002/sce.3730650212
[62]
Nakamura, J., & Csikszentmihalyi, M. (2002). The Concept of Flow. In C. Snyder, & S. Lopez (Eds.), Handbook of Positive Psychology (pp. 89-105). Oxford University Press.
[63]
National Advisory Committee on Creative and Cultural Education (1999). All Our Futures: Creativity, Culture and Education. National Advisory Committee on Creative and Cultural Education.
[64]
Newell, A., Shaw, J., & Simon, H. (1962). The Processes of Creative Thinking. In H. Gruber, G. Terrell, & M. Wertheimer (Eds.), Contemporary Approaches to Creative Thinking (pp. 63-119). Atherton Press.
[65]
Ng, A. (2003). A Cultural Model of Creative and Conforming Behavior. Creativity Research Journal, 15, 223-233. https://doi.org/10.1207/S15326934CRJ152&3_12
[66]
Nickerson, R. (1999). Enhancing Creativity. In R. Sternberg (Ed.), Handbook of Creativity (pp. 392-410). Cambridge University Press.
https://doi.org/10.1017/CBO9780511807916.022
[67]
Nickerson, R. (2010). How to Discourage Creative Thinking in the Classroom. In R. Beghetto, & J. Kaufman (Eds.), Nurturing Creativity in the Classroom (pp. 1-5). Cambridge University Press. https://doi.org/10.1017/CBO9780511781629.002
[68]
Niu, W., & Sternberg, R. (2003). Societal and School Influences on Student Creativity: The Case of China. Psychology in the Schools, 40, 103-114.
https://doi.org/10.1002/pits.10072
[69]
OECD (2010). The OECD Innovation Strategy: Getting a Head Start on Tomorrow. OECD. https://doi.org/10.1787/9789264083479-en
[70]
OECD (2017). PISA 2021 Creative Thinking Strategic Advisory Group Report. Organisation for Economic Co-Operation and Development.
https://one.oecd.org/document/EDU/PISA/GB(2017)19/en/pdf
[71]
Plucker, J., Beghetto, R., & Dow, G. (2004). Why Isn’t Creativity More Important to Educational Psychologists? Potentials, Pitfalls, and Future Directions in Creativity Research. Educational Psychologist, 39, 83-96.
https://doi.org/10.1207/s15326985ep3902_1
[72]
Prabhu, V., Sutton, C., & Sauser, W. (2008). Creativity and Certain Personality Traits: Understanding the Mediating Effect of Intrinsic Motivation. Creativity Research Journal, 20, 53-66. https://doi.org/10.1080/10400410701841955
[73]
Prather, C. (2010). Manager’s Guide to Fostering Innovation and Creativity in Teams. McGraw-Hill.
[74]
Reiter-Palmon, R., & Robinson, E. (2009). Problem Identification and Construction: What Do We Know, What Is the Future? Psychology of Aesthetics, Creativity, and the Arts, 3, 43-47. https://doi.org/10.1037/a0014629
[75]
Rinne, T., Steel, G., & Fairweather, J. (2013). The Role of Hofstede’s Individualism in National-Level Creativity. Creativity Research Journal, 25, 126-136.
https://doi.org/10.1080/10400419.2013.752293
[76]
Runco, M. (1997). The Creativity Research Handbook.
[77]
Sawyer, R. (2011). What Makes Good Teachers Great? The Artful Balance of Structure and Improvisation. In R. Sawyer (Ed.), Structure and Improvisation in Creative Teaching (pp. 1-24). Cambridge University Press. http://www.cambridge.org
https://doi.org/10.1017/CBO9780511997105.002
[78]
Scardamalia, M. (2002). Collective Cognitive Responsibility for the Advancement of Knowledge. In B. Smith (Ed.), Liberal Education in a Knowledge Society (pp. 67-98). Open Court.
[79]
Schwartz, D., Bransford, J., & Sears, D. (2005). Efficiency and Innovation in Transfer. In J. Mestre (Ed.), Transfer of Learning from a Modern, Multidisciplinary Perspective (Vol. 3, pp. 1-51). Information Age Publishing.
[80]
Shute, V. et al. (2016). Advances in the Science of Assessment. Educational Assessment, 21, 34-59. https://doi.org/10.1080/10627197.2015.1127752
[81]
Shute, V., Hansen, E., & Almond, R. (2008). You Can’t Fatten a Hog by Weighing It—Or Can You? Evaluating an Assessment for Learning System Called ACED. International Journal of Artificial Intelligence in Education, 18, 289-316.
https://dl.acm.org/citation.cfm?id=1497126
[82]
Smith, J., & Smith, L. (2010). Educational Creativity. In J. Kaufman, & R. Sternberg (Eds.), The Cambridge Handbook of Creativity (pp. 250-264). Cambridge University Press. https://doi.org/10.1017/CBO9780511763205.016
[83]
Spencer, E., & Lucas, B. (2018). Understanding the Role of Creative Self-Efficacy in Youth Social Action. University of Winchester.
[84]
Sternberg, R. (2006). The Nature of Creativity. Creativity Research Journal, 18, 87-98.
https://www.cc.gatech.edu/classes/AY2013/cs7601_spring/papers/Sternberg_Nature-of-creativity.pdf
https://doi.org/10.1207/s15326934crj1801_10
[85]
Sternberg, R., & Lubart, T. (1991). An Investment Theory of Creativity and Its Development. Human Development, 34, 1-31. https://doi.org/10.1159/000277029
[86]
Sternberg, R., & Lubart, T. (1995). Defying the Crowd: Cultivating Creativity in a Culture of Conformity. Free Press. http://psycnet.apa.org/record/1995-97404-000
[87]
Tanggaard, L. (2014). Fooling Around: Creative Learning Pathways. Information Age Publishing.
[88]
Tanggaard, L. (2018). Content-Driven Pedagogy: On Passion, Absorption and Immersion as Dynamic Drivers of Creativity. Springer.
http://vbn.aau.dk/en/publications/contentdriven-pedagogy(96d07758-fcbe-490c-b090-426c6e096466).html
https://doi.org/10.1007/978-3-319-99163-4_9
[89]
Tanggard, L., & Glaveanu, V. (2014). Creativity Assessment as Intervention: The Case-Study of Creative Learning. Academic Quarter, 9, 18-30.
[90]
Thompson, L., & Choi, H. (2005). Creativity and Innovation in Organizational Teams. Taylor & Francis Group, Psychology Press.
https://www.taylorfrancis.com/books/e/9781135612382
https://doi.org/10.4324/9781410615732
[91]
Tompkins, G. (1982). Seven Reasons Why Children Should Write Stories. Language Arts, 59, 718-721. https://www.jstor.org/stable/41405103
[92]
Torrance, E. (1959). Current Research on the Nature of Creative Talent. Journal of Counseling Psychology, 6, 309-316. https://doi.org/10.1037/h0042285
[93]
Torrance, E. (1988). The Nature of Creativity as Manifest in Its Testing. In R. Sternberg (Ed.), The Nature of Creativity: Contemporary Psychological Perspectives (pp. 43-75). Cambridge University Press. http://psycnet.apa.org/record/1988-98009-002
[94]
Warhuus, J. et al. (2017). From I to We: Collaboration in Entrepreneurship Education and Learning? Education + Training, 59, 234-249.
https://doi.org/10.1108/ET-08-2015-0077
[95]
Werner, C. et al. (2014). The Chinese Version of the Revised Creativity Domain Questionnaire (CDQ-R): First Evidence for Its Factorial Validity and Systematic Association with the Big Five. Journal of Creative Behavior, 48, 254-275.
https://doi.org/10.1002/jocb.51
[96]
Wong, R., & Niu, W. (2013). Cultural Difference in Stereotype Perceptions and Performances in Nonverbal Deductive Reasoning and Creativity. The Journal of Creative Behavior, 47, 41-59. https://doi.org/10.1002/jocb.22
[97]
Zhou, J., & Su, Y. (2010). A Missing Piece of the Puzzle: The Organizational Context in Cultural Patterns of Creativity. Management and Organization Review, 6, 391-413.
https://doi.org/10.1111/j.1740-8784.2010.00192.x
