This study aims at reviewing the published scientific literature on the topics of a game development-based learning (GDBL) method using game development frameworks (GDFs) with the perspective of (a) summarizing a guideline for using GDBL in a curriculum, (b) identifying relevant features of GDFs, and (c) presenting a synthesis of impact factors with empirical evidence on the educational effectiveness of the GDBL method. After systematically going through the available literature on the topic, 34 relevant articles were selected for the final study. We analyzed the articles from three perspectives: (1) pedagogical context and teaching process, (2) selection of GDFs, and (3) evaluation of the GDBL method. The findings from the 34 articles suggest that GDFs have many potential benefits as an aid to teach computer science, software engineering, art design, and other fields and that such GDFs combined with the motivation from games can improve the students’ knowledge, skills, attitudes, and behaviors in contrast to the traditional classroom teaching. Furthermore, based on the results of the literature review, we extract a guideline of how to apply the GDBL method in education. The empirical evidence of current findings gives a positive overall picture and can provide a useful reference to educators, practitioners, and researchers in the area of game-based learning. 1. Introduction Computer games and video games have become very popular in children and adolescents’ life and play a prominent role in the culture of young people [1]. Games can now be played everywhere in technology-rich environments equipped with laptops, smart phones, game consoles (mobile and stationary), set-top, boxes and other digital devices. From this phenomenon, it is believed that the intrinsic motivation that young people shows towards games can be combined with educational content and objectives into what Prensky calls “digital game based learning” [2]. Besides of an abundant appearance of games in young students life, game development technology has matured and became more advanced than before [3]. Based on various existing game development software, the whole duty of game development process can be divided into several domains and roles such as game programmers, 3D model creators, game designers, musicians, animators, and play writers. Under this situation, some web resources and game engines can simplify the game development process. For instance, Microsoft’s XNA game development kit provides the game loop function to draw and update the game contents, and it also provides
References
[1]
S. M. Dorman, “Video and computer games: effect on children and implications for health education,” Journal of School Health, vol. 67, no. 4, pp. 133–138, 1997.
[2]
M. Prensky, “Digital game-based learning,” Computers in Entertainment, vol. 1, no. 1, pp. 21–24, 2003.
[3]
J. Blow, “Game development: harder than you think,” Queue, vol. 1, no. 10, pp. 28–37, 2004.
[4]
A. I. Wang and B. Wu, “An application of a game development framework in higher education,” International Journal of Computer Games Technology, vol. 2009, Article ID 693267, 12 pages, 2009.
[5]
K. Sung, C. Hillyard, R. L. Angotti, M. W. Panitz, D. S. Goldstein, and J. Nordlinger, “Game-themed programming assignment modules: a pathway for gradual integration of gaming context into existing introductory programming courses,” IEEE Transactions on Education, vol. 54, no. 3, pp. 416–427, 2010.
[6]
G. Sindre, L. Natvig, and M. Jahre, “Experimental validation of the learning effect for a pedagogical game on computer fundamentals,” IEEE Transactions on Education, vol. 52, no. 1, pp. 10–18, 2009.
[7]
B. A. Foss and T. I. Eikaas, “Game play in engineering education—concept and experimental results,” International Journal of Engineering Education, vol. 22, no. 5, pp. 1043–1052, 2006.
[8]
A. I. Wang, T. ？fsdahl, and O. K. M？rch-Storstein, “Lecture quiz—a mobile game concept for lectures,” in Proceedings of the 11th IASTED International Conference on Software Engineering and Application (SEA '07), pp. 305–310, 2007.
[9]
A. I. Wang, T. ？fsdahl, and O. K. M？rch-Storstein-Storstein, “An evaluation of a mobile game concept for lectures,” in Proceedings of the IEEE 21st Conference on Software Engineering Education and Training, pp. 197–204, 2008.
[10]
M. S. El-Nasr and B. K. Smith, “Learning through game modding,” Computers in Entertainment, vol. 4, no. 1, pp. 45–64, 2006.
[11]
G. Lukas, “Uses of the LOGO programming language in undergraduate instruction,” in Proceedings of the Association for Computing Machinery Annual Conference (ACM '72), vol. 2, pp. 1130–1136, Boston, Mass, USA, 1972.
[12]
M. Micco, “An undergraduate curriculum in expert systems design or knowledge engineering,” in Proceedings of the 15th Annual Conference on Computer Science (CSC '87), pp. 36–39, St. Louis, Mo, USA, 1987.
[13]
J. P. Higgins and S. Green, Front Matter, John Wiley & Sons, New York, NY, USA, 2008.
[14]
K. S. Khan, et al., Undertaking Systematic Reviews of Research on Effectiveness: CRD'S Guidance For Carrying Out or Commissioning Reviews: CRD Report, Number 4, NHS centre for revies and lissemination, University of York, 2nd edition, 2001.
[15]
M. Papastergiou, “Exploring the potential of computer and video games for health and physical education: a literature review,” Computers and Education, vol. 53, no. 3, pp. 603–622, 2009.
[16]
J. Kirriemuir and A. McFarlane, “Literature review in games and learning,” Tech. Rep. 8, 2004.
[17]
E. Ye, C. Liu, and J. A. Polack-Wahl, “Enhancing software engineering education using teaching aids in 3-D online virtual worlds,” in Proceedings of the 37th Annual Frontiers In Education Conference—Global Engineering: Knowledge Without Borders, Opportunities Without Passports (FIE' 07), pp. T1E-8–T1E-13, Milwaukee, Wis, USA, October 2007.
[18]
B. Wu, A. I. Wang, and Y. Zhang, “Experiences from implementing an educational MMORPG,” in Proceedings of the 2nd International IEEE Consumer Electronic Society's Games Innovation Conference (GIC '10), pp. 1–8, December 2010.
[19]
A. Baker, E. O. Navarro, and A. van der Hoek, “Problems and programmers: an educational software engineering card game,” in Proceedings of the 25th International Conference on Software Engineering, pp. 614–619, May 2003.
[20]
F. McCown, “Teaching a game programming class for the first time: tutorial presentation,” Journal of Computing Sciences in Colleges, vol. 25, no. 5, pp. 131–132, 2010.
[21]
C. Leska and J. Rabung, “Learning O-O concepts in CS I using game projects,” in Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, vol. 36, p. 237, June 2004.
[22]
E. Ferguson, B. Rockhold, and B. Heck, “Video game development using XNA game studio and C#.Net,” Journal of Computing Sciences in Colleges, vol. 23, no. 4, pp. 186–188, 2008.
[23]
R. H. Seidman, “Alice first: 3D interactive game programming,” ACM SIGCSE Bulletin, vol. 41, no. 3, p. 345, 2009.
[24]
X. Fu, S. Doboli, and J. Impagliazzo, “Work in progress—a sandbox model for teaching entrepreneurship,” in Proceedings of the 40th IEEE Annual Frontiers in Education Conference (FIE '10), pp. F2C-1–F2C-2.
[25]
M. Kolling, “Greenfoot: introduction to Java with games and simulations,” Journal of Computing Sciences in Colleges, vol. 25, no. 3, p. 117, 2010.
[26]
A. Azemi and L. L. Pauley, “Teaching the introductory computer programming course for engineers using Matlab,” in Proceedings of the 38th Annual Frontiers in Education Conference (FIE '08), pp. T3B-1–T3B-23, October 2008.
[27]
A. Pardo and C. D. Kloos, “Deploying interactive e-labs for a course on operating systems,” in Proceedings of the 6th Conference on Information Technology Education, pp. 71–78, Newark, NJ, USA, 2005.
[28]
P. Rooney, K. C. O'Rourke, G. Burke, B. Mac Namee, and C. Igbrude, “Cross-disciplinary approaches for developing serious games in higher education: frameworks for food safety and environmental health education,” in Proceedings of the Conference in Games and Virtual Worlds for Serious Applications (VS-GAMES '09), pp. 161–165, March 2009.
[29]
A. W. B. Furtado, G. D. de Andrade, A. R. G. do Amaral Leit？o, et al., “Cegadef: a collaborative educational game development framework,” in Proceedings of the Conference on Interaction Design and Children, Preston, UK, 2003.
[30]
H. C. Yang, “A general framework for automatically creating games for learning,” in Proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT '05), pp. 28–29, July 2005.
[31]
K. Kardan, “Computer role-playing games as a vehicle for teaching history, culture, and language,” in Proceedings of the Association for Computing Machinery's Special Interest Group on Computer Graphics and Interactive Techniques Symposium on Videogames, pp. 91–93, Boston, Mass, USA, July 2006.
[32]
S. Arakawa and S. Yukita, “An effective agile teaching environment for java programming courses,” in Proceedings of 36th Annual Frontiers in Education Conference, pp. 13–18, October 2006.
[33]
W. W. Y. Lau, G. Ngai, S. C. F. Chan, and J. C. Y. Cheung, “Learning programming through fashion and design: a pilot summer course in wearable computing for middle school students,” SIGCSE Bulletin Inroads, vol. 41, no. 1, pp. 504–508, 2009.
[34]
S. V. Delden, “Industrial robotic game playing: an AI course,” Journal of Computing Sciences in Colleges, vol. 25, no. 3, pp. 134–142, 2010.
[35]
P. H. Tan, C. Y. Ting, and S. W. Ling, “Learning difficulties in programming courses: undergraduates' perspective and perception,” in Proceedings of the International Conference on Computer Technology and Development (ICCTD '09), pp. 42–46, November 2009.
[36]
T. E. Daniels, “Integrating engagement and first year problem solving using game controller technology,” in Proceedings of the 39th IEEE Annual Frontiers in Education Conference (FIE '09), pp. 1–6, October 2009.
[37]
A. Striegel and D. van Bruggen, “Work in progress—development of a HCI course on the microsoft surface,” in Proceedings of the 40th Annual Frontiers in Education Conference (FIE '10), pp. S3F-1–S3F-6, October 2010.
[38]
A. Wang, “Interactive game development with a projector-camera system,” in Proceedings of the 3rd International Conference on Technologies for E-Learning and Digital Entertainment, pp. 535–543, Springer, 2008.
[39]
J. Dempsey, K. Rasmussen, and B. Lucassen, “The instructional gaming literature: implications and 99 sources,” Tech. Rep. 96-1, University of South Alabama, College of Education, 1996.
[40]
J. Dempsey, B. Lucassen, W. Gilley, et al., “Since Malone’s theory of intrinsically motivating instruction: what’s the score in the gaming literature?” Journal of Educational Technology Systems, vol. 22, no. 2, pp. 173–183, 1993-1994.
[41]
R. Hays, “The effectiveness of instructional games: a literature review and discussion,” Tech. Rep. 2005-004, Naval Air Warfare Center, Training Systems Division, Orlando, Fla, USA, 2005.
[42]
M. C. V. Langeveld and R. Kessler, “Two in the middle: digital character production and machinima courses,” SIGCSE Bulletin Inroads, vol. 41, no. 1, pp. 463–467, 2009.
[43]
W. L. Honig and T. Prasad, “A classroom outsourcing experience for software engineering learning,” SIGCSE Bulletin Inroads, vol. 39, pp. 181–185, 2007.
[44]
S. Hrastinski, “What is online learner participation? A literature review,” Computers and Education, vol. 51, no. 4, pp. 1755–1765, 2008.
[45]
S. Papert, Mindstorms: Children, Computers, and Powerful Ideas, Basic Books, New York, NY, USA, 1980.
[46]
S. Puntambekar and J. L. Kolodner, “Toward implementing distributed scaffolding: helping students learn science from design,” Journal of Research in Science Teaching, vol. 42, no. 2, pp. 185–217, 2005.
[47]
J. Dewey, Democracy and Education: An Introduction to the Philosophy of Education, 2005.
[48]
J. Dewey, Experience and Education, Simon and Schuster, New York, NY, USA, 1997.
[49]
E. Smeets, “Does ICT contribute to powerful learning environments in primary education?” Computers and Education, vol. 44, no. 3, pp. 343–355, 2005.
[50]
L. S. Vygotskij, Mind in Society: The Development of Higher Psychological Processes, Harvard University Press, Cambridge, Mass, USA, 1978.
[51]
H. S. Barrows, “A taxonomy of problem-based learning methods,” Medical Education, vol. 20, no. 6, pp. 481–486, 1986.
[52]
B. Lennartsson and E. Sundin, “Fronesis—the third dimension of knowledge, learning, and evaluation,” in Proceedings of the 31st Annual Frontiers in Education Conference, vol. 1, pp. T2B/14–T2B/19, October 2001.
[53]
W. M. Thomas, “What makes things fun to learn? Heuristics for designing instructional computer games,” in Proceedings of the 3rd ACM SIGSMALL Symposium and the 1st SIGPC Symposium on Small Systems, Palo Alto, Calif, USA, 1980.
[54]
A. I. Wang, “Extensive evaluation of using a game project in a software architecture course,” ACM Transactions on Computing Education, vol. 11, no. 1, article 5, 2011.
[55]
A. D. Ritzhaupt, “creating a game development course with limited resources: an evaluation study,” ACM Transactions on Computing Education, vol. 9, no. 1, pp. 1–16, 2009.
[56]
A. McGovern and J. Fager, “Creating significant learning experiences in introductory artificial intelligence,” SIGCSE Bulletin Inroads, vol. 39, pp. 39–43, 2007.
[57]
R. Angotti, C. Hillyard, M. Panitz, K. Sung, and K. Marino, “Game-themed instructional modules: a video case study,” in Proceedings of the 5th International Conference on the Foundations of Digital Games (FDG '10), pp. 9–16, Monterey, Calif, USA, June 2010.
[58]
G. Fesakis and K. Serafeim, “Influence of the familiarization with “scratch” on future teachers' opinions and attitudes about programming and ICT in education,” in Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE '09), pp. 258–262, Paris, France, July 2009.
[59]
Y. Rankin, A. Gooch, and B. Gooch, “The impact of game design on students' interest in CS,” in Proceedings of the 3rd International Conference on Game Development in Computer Science Education (GDCSE '08), pp. 31–35, Miami, Fla, USA, March 2008.
[60]
M. Al-Bow, D. Austin, J. Edgington, et al., “Using game creation for teaching computer programming to high school students and teachers,” ACM SIGCSE Bulletin, vol. 41, pp. 104–108, 2009.
[61]
M. Eagle and T. Barnes, “Experimental evaluation of an educational game for improved learning in introductory computing,” SIGCSE Bulletin Inroads, vol. 41, no. 1, pp. 321–325, 2009.
[62]
W. K. Chen and Y. C. Cheng, “Teaching object-oriented programming laboratory with computer game programming,” IEEE Transactions on Education, vol. 50, no. 3, pp. 197–203, 2007.
[63]
Yulia and R. Adipranata, “Teaching object oriented programming course using cooperative learning method based on game design and visual object oriented environment,” in Proceedings of the 2nd International Conference on Education Technology and Computer (ICETC '10), pp. V2-355–V2-359, June 2010.
[64]
R. Lawrence, “Teaching data structures using competitive games,” IEEE Transactions on Education, vol. 47, no. 4, pp. 459–466, 2004.
[65]
J. Huang, “Improving undergraduates' teamwork skills by adapting project-based learning methodology,” in Proceedings of the 5th International Conference on Computer Science and Education (ICCSE '10), pp. 652–655, August 2010.
[66]
B. Wu, A. I. Wang, J. E. Str？m, and T. B. Kvamme, “An evaluation of using a game development framework in higher education,” in Proceedings of the 22nd Conference on Software Engineering Education and Training (CSEET '09), pp. 41–44, February 2009.
[67]
J.-F. Weng, S.-S. Tseng, and T.-J. Lee, “Teaching boolean logic through game Rule tuning,” IEEE Transactions on Learning Technologies, vol. 3, no. 4, pp. 319–328, 2010.
[68]
R. Owston, H. Wideman, N. S. Ronda, and C. Brown, “Computer game development as a literacy activity,” Computers and Education, vol. 53, no. 3, pp. 977–989, 2009.
[69]
I. J. Timm, T. Bogon, A. D. Lattner, and R. Schumann, “Teaching distributed artificial intelligence with RoboRally,” in Multiagent System Technologies, vol. 5244, pp. 171–182, Springer, Berlin, Germany, 2008.
[70]
L. Werner, J. Denner, M. Bliesner, and P. Rex, “Can middle-schoolers use Storytelling Alice to make games? Results of a pilot study,” in Proceedings of the 4th International Conference on the Foundations of Digital Games (ICFDG '09), pp. 207–214, Orlando, Fla, USA, April 2009.
[71]
K. Wang, C. McCaffrey, D. Wendel, and E. Klopfer, “3D game design with programming blocks in StarLogo TNG,” in Proceedings of the 7th International Conference on Learning Sciences, pp. 1008–1009, Bloomington, Ind, USA, 2006.
[72]
C. H. Huang, P. C. Ho, and S. M. Chung, “Computer game programming course for art design students by using flash software,” in Proceedings of the International Conference on Cyberworlds (CW '08), pp. 710–713, September 2008.
[73]
B. Lennartsson and E. Sundin, “Experience from a course aiming at understanding system development with focus on system design and integration,” in Proceedings of the 32nd Annual Frontiers in Education, vol. 1, pp. T3G-1–T3G-6, November 2002.
[74]
J. Ryoo, F. Fonseca, and D. S. Janzen, “Teaching object-oriented software engineering through problem-based learning in the context of game design,” in Proceedings of the 21st Conference on Software Engineering Education and Training (CSEET '08), pp. 137–144, April 2008.
[75]
J. Robertson and C. Howells, “Computer game design: opportunities for successful learning,” Computers and Education, vol. 50, no. 2, pp. 559–578, 2008.
[76]
W.-C. Chang and Y.-M. Chou, “Introductory C programming language learning with game-based digital learning,” Advances in Web Based Learning, vol. 5145, pp. 221–231, 2008.
[77]
S. Kurkovsky, “Can mobile game development foster student interest in computer science?” in Proceedings of the 1st International IEEE Consumer Electronic Society's Games Innovation Conference (ICE-GIC '09), pp. 92–100, August 2009.
[78]
K. J. Bierre and A. M. Phelps, “The use of MUPPETS in an introductory java programming course,” in Proceedings of the 5th Conference on Information Technology Education (CITC5 '04), pp. 122–127, Salt Lake City, Utah, USA, October 2004.
[79]
B. Wu, A. I. Wang, J. E. Str？m, and T. B. Kvamme, “XQUEST used in software architecture education,” in Proceedings of the 1st International IEEE Consumer Electronic Society's Games Innovation Conference (ICE-GIC '09), pp. 70–77, August 2009.
[80]
B. Wu, A. I. Wang, A. H. Ruud, and W. Z. Zhang, “Extending google android's application as an educational tool,” in Proceedings of the 3rd IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning (DIGITEL '10), pp. 23–30, April 2010.
[81]
H. C. Jiau, J. C. Chen, and K. F. Ssu, “Enhancing self-motivation in learning programming using game-based simulation and metrics,” IEEE Transactions on Education, vol. 52, no. 4, pp. 555–562, 2009.
[82]
A. Garrido, J. Martinez-Baena, R. Rodriguez-Sanchez, J. Fdez-Valdivia, and J. A. Garcia, “Using graphics: motivating students in a C++ programming introductory course,” in Proceedings of the 20th European Association for Education in Electrical and Information Engineering Annual Conference (EAEEIE '09), pp. 1–6, June 2009.
[83]
A. Barella, S. Valero, and C. Carrascosa, “JGOMAS: new approach to AI teaching,” IEEE Transactions on Education, vol. 52, no. 2, pp. 228–235, 2009.
