DSpace Home
→
Електронні публікації
→
Фізико-математичний факультет
→
Кафедра інформатики та прикладної математики
→
View Item

A systematic review of gamification in software engineering education

Korniienko, Serhii S.; Zahorodko, Pavlo V.; Striuk, Andrii M.; Kupin, Andrey I.; Семеріков, Сергій Олексійович; Корнієнко, Сергій Сергійович; Загородько, Павло Володимирович; Стрюк, Андрій Миколайович; Купін, Андрій Іванович

URI: https://ceur-ws.org/Vol-3844/paper04.pdf
http://elibrary.kdpu.edu.ua/xmlui/handle/123456789/10951

Date: 2024-11-23

Abstract:

Background: Gamification is a promising approach for enhancing motivation and engagement in software engineering education, but its applications and effects are not yet well understood. Objective: To systematically review the use of gamification in software engineering education, focusing on the game elements utilized, the software engineering knowledge areas and skills targeted, and the reported impacts on learning outcomes and student perceptions. Methods: We searched Scopus for papers published in journals, conferences, or workshops that described empirical studies of gamification in software engineering courses. Study characteristics, gamification approaches, software engineering topics, research methods, and key findings were extracted and synthesized using a combination of quantitative and qualitative methods. Results: The 29 included studies most commonly employed points (17 studies), challenges (14 studies), leaderboards (11 studies), and badges (9 studies) to gamify the learning of software process (12 studies), design (9 studies), and professional practices (7 studies). The majority of studies (21) reported positive impacts on student engagement, motivation, and/or performance, but the quality of evidence was limited by the lack of validated measurement instruments and controlled study designs. Conclusions: Gamification appears to be a promising approach for enhancing software engineering education, but more rigorous empirical research is needed to understand its effects and boundary conditions. This review provides educators and researchers with an overview of current applications, evidence, and open questions to guide the design and study of gamified learning experiences in software engineering.

Description:

[1] M. R. d. A. Souza, L. Veado, R. T. Moreira, E. Figueiredo, H. Costa, A systematic mapping study on game-related methods for software engineering education, Information and Software Technology 95 (2018) 201–218. doi:10.1016/j.infsof.2017.09.014. [2] A. M. Striuk, S. O. Semerikov, Professional competencies of future software engineers in the software design: teaching techniques, Journal of Physics: Conference Series 2288 (2022) 012012. doi:10.1088/1742-6596/2288/1/012012. [3] S. Deterding, R. Khaled, L. Nacke, D. Dixon, Gamification: Toward a Definition, in: CHI 2011 Workshop Gamification: Using Game Design Elements in Non-Game Contexts, 2011. URL: http://gamification-research.org/wp-content/uploads/2011/04/02-Deterding-Khaled-Nacke-Dixon.pdf. [4] E. Polat, Gamification implementation for educational purposes: a scoping review (2013-2018), Educational Technology Quarterly 2023 (2023) 367–400. doi:10.55056/etq.589. [5] N.-Z. Legaki, M. Thibault, J. Hamari, Gamified Educational Software for Data Literacy - A Research Through Design Approach to GANDALF, in: Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG ’22, Association for Computing Machinery, New York, NY, USA, 2022. doi:10.1145/3555858.3555912. [6] K. Seaborn, D. I. Fels, Gamification in theory and action: A survey, International Journal of Human-Computer Studies 74 (2015) 14–31. doi:10.1016/j.ijhcs.2014.09.006. [7] A. Christopoulos, S. Mystakidis, Gamification in Education, Encyclopedia 3 (2023) 1223–1243. doi:10.3390/encyclopedia3040089. [8] A. Calderón, M. Ruiz, R. V. O’Connor, A multivocal literature review on serious games for software process standards education, Computer Standards & Interfaces 57 (2018) 36–48. doi:10.1016/j.csi.2017.11.003. [9] A. Calderón, M. Trinidad, M. Ruiz, R. V. O’Connor, Teaching Software Processes and Standards: A Review of Serious Games Approaches, in: I. Stamelos, R. V. O’Connor, T. Rout, A. Dorling (Eds.), Software Process Improvement and Capability Determination, volume 918 of Communications in Computer and Information Science, Springer International Publishing, Cham, 2018, pp. 154–166. doi:10.1007/978-3-030-00623-5_11. [10] G. Guigon, M. Vermeulen, M. Muratet, T. Carron, Towards an Integration of the Multi-role Dimension in the Design of Learning Games: a Review of the Literature, in: F. de Rosa, I. Marfisi Schottman, J. Baalsrud Hauge, F. Bellotti, P. Dondio, M. Romero (Eds.), Games and Learning Alliance, volume 13134 of Lecture Notes in Computer Science, Springer International Publishing, Cham, 2021, pp. 258–264. doi:10.1007/978-3-030-92182-8_26. [11] B. S. Akpolat, W. Slany, Enhancing software engineering student team engagement in a high-intensity extreme programming course using gamification, in: 2014 IEEE 27th Conference on Software Engineering Education and Training, CSEE and T 2014 - Proceedings, IEEE Computer Society, 2014, pp. 149–153. doi:10.1109/CSEET.2014.6816792. [12] K. Berkling, C. Thomas, Gamification of a Software Engineering course and a detailed analysis of the factors that lead to it’s failure, in: 2013 International Conference on Interactive Collaborative Learning (ICL), 2013, pp. 525–530. doi:10.1109/ICL.2013.6644642. [13] M. J. Page, J. E. McKenzie, P. M. Bossuyt, I. Boutron, T. C. Hoffmann, C. D. Mulrow, L. Shamseer, J. M. Tetzlaff, E. A. Akl, S. E. Brennan, R. Chou, J. Glanville, J. M. Grimshaw, A. Hróbjartsson, M. M. Lalu, T. Li, E. W. Loder, E. Mayo-Wilson, S. McDonald, L. A. McGuinness, L. A. Stewart, J. Thomas, A. C. Tricco, V. A. Welch, P. Whiting, D. Moher, The PRISMA 2020 statement: an updated guideline for reporting systematic reviews, BMJ 372 (2021). doi:10.1136/bmj.n71. [14] J. A. Sterne, M. A. Hernán, B. C. Reeves, J. Savović, N. D. Berkman, M. Viswanathan, D. Henry, D. G. Altman, M. T. Ansari, I. Boutron, J. R. Carpenter, A.-W. Chan, R. Churchill, J. J. Deeks, A. Hróbjartsson, J. Kirkham, P. Jüni, Y. K. Loke, T. D. Pigott, C. R. Ramsay, D. Regidor, H. R. Rothstein, L. Sandhu, P. L. Santaguida, H. J. Schünemann, B. Shea, I. Shrier, P. Tugwell, L. Turner, J. C. Valentine, H. Waddington, E. Waters, G. A. Wells, P. F. Whiting, J. P. Higgins, ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions, BMJ 355 (2016) i4919. doi:10.1136/bmj.i4919. [15] J. F. Vermeir, M. J. White, D. Johnson, G. Crombez, D. M. L. Van Ryckeghem, The Effects of Gamification on Computerized Cognitive Training: Systematic Review and Meta-Analysis, JMIR Serious Games 8 (2020) e18644. doi:10.2196/18644. [16] M. J. Page, J. P. T. Higgins, J. A. C. Sterne, Assessing risk of bias due to missing evidence in a meta-analysis, in: J. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. Page, V. Welch (Eds.), Cochrane Handbook for Systematic Reviews of Interventions, Cochrane, 2024. URL: https://training.cochrane.org/handbook/current/chapter-13. [17] G. H. Guyatt, A. D. Oxman, G. E. Vist, R. Kunz, Y. Falck-Ytter, P. Alonso-Coello, H. J. Schünemann, GRADE: an emerging consensus on rating quality of evidence and strength of recommendations, BMJ 336 (2008) 924–926. doi:10.1136/bmj.39489.470347.AD. [18] H. Schünemann, J. Brożek, G. Guyatt, A. Oxman (Eds.), GRADE Handbook, 2013. URL: https://gdt.gradepro.org/app/handbook/handbook.html. [19] A. Mora, E. Planas, J. Arnedo-Moreno, Designing game-like activities to engage adult learners in higher education, in: Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality, TEEM ’16, Association for Computing Machinery, New York, NY, USA, 2016, p. 755–762. doi:10.1145/3012430.3012603. [20] A. Iosup, D. Epema, An experience report on using gamification in technical higher education, in: Proceedings of the 45th ACM Technical Symposium on Computer Science Education, SIGCSE ’14, Association for Computing Machinery, New York, NY, USA, 2014, p. 27–32. doi:10.1145/2538862.2538899. [21] M. E. Morales-Trujillo, G. A. Garciá-Mireles, Gamification and SQL: An Empirical Study on Student Performance in a Database Course, ACM Transactions on Computing Education 21 (2021). doi:10.1145/3427597. [22] R. Hasan, S. Palaniappan, S. Mahmood, B. Shah, A. Abbas, K. U. Sarker, Enhancing the Teaching and Learning Process Using Video Streaming Servers and Forecasting Techniques, Sustainability 11 (2019) 2049. doi:10.3390/su11072049. [23] P. G. F. Matsubara, C. L. C. Da Silva, Game elements in a software engineering study group: A case study, in: Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering and Education Track, ICSE-SEET 2017, Institute of Electrical and Electronics Engineers Inc., 2017, pp. 160–169. doi:10.1109/ICSE-SEET.2017.8. [24] A. Bartel, G. Hagel, Gamifying the learning of design patterns in software engineering education, in: IEEE Global Engineering Education Conference, EDUCON, volume 10-13-April-2016, IEEE Computer Society, 2016, pp. 74–79. doi:10.1109/EDUCON.2016.7474534. [25] M. Fuchs, C. Wolff, Improving programming education through gameful, formative feedback, in: IEEE Global Engineering Education Conference, EDUCON, volume 10-13-April-2016, IEEE Computer Society, 2016, pp. 860–867. doi:10.1109/EDUCON.2016.7474653. [26] V. Uskov, B. Sekar, Gamification of software engineering curriculum, in: Proceedings - Frontiers in Education Conference, FIE, volume 2015-February, Institute of Electrical and Electronics Engineers Inc., 2015. doi:10.1109/FIE.2014.7044098. [27] O. Colteli, X. Grandi, R. Tosca, P. Latorre, J. S. Sánchez, L. V. Lizán, F. Ros-Bernal, C. Martínez-Cadenas, Designing serious games for learning support in medicine studies: A specific method to elicit and formalize requirements, in: Proceedings - Frontiers in Education Conference, FIE, volume 2015-February, Institute of Electrical and Electronics Engineers Inc., 2015. doi:10.1109/FIE.2014.7044156. [28] A. Knutas, J. Ikonen, D. Maggiorini, L. Ripamonti, J. Porras, Creating student interaction profiles for adaptive collaboration gamification design, International Journal of Human Capital and Information Technology Professionals 7 (2016) 47–62. doi:10.4018/IJHCITP.2016070104. [29] N. Unkelos-Shpigel, Ace That Game: Educating Students to Gamified Design Thinking, in: S. Kowalski, P. M. Bednar, I. Bider (Eds.), Proceedings of the 2nd International Workshop on Socio-Technical Perspective in IS Development co-located with 28th International Conference on Advanced Information Systems Engineering (CAiSE 2016), Ljubljana, Slovenia, June 14, 2016, volume 1604 of CEUR Workshop Proceedings, CEUR-WS.org, 2016, pp. 75–82. URL: https://ceur-ws.org/Vol-1604/Paper7.pdf. [30] J.-H. Huh, H.-B. Kim, K. Seo, A design of smart-based education gamification platform using mobile devices for digital content, International Journal of Multimedia and Ubiquitous Engineering 11 (2016) 101–114. doi:10.14257/ijmue.2016.11.12.10. [31] A. Calderón, M. Ruiz, A. Falcón, SmartProject: An environment for software engineering teaching based on serious games and social networks, in: L. Boyle, T. M. Connolly (Eds.), Proceedings of the European Conference on Games-based Learning, volume 2016-January, Dechema e.V., 2016, pp. 98–107. [32] C. M. C. Gomes, M. J. G. Figueiredo, J. Bidarra, J. D. C. Gomes, Project “Flappy Crab”: An edu-game for music learning, in: 11th International Conference on Cognition and Exploratory Learning in Digital Age, CELDA 2014, IADIS, 2014, pp. 257–260. [33] G. P. Gasca-Hurtado, M. C. Gómez-Alvarez, M. Muñoz, J. Mejía, Gamification Proposal for Defect Tracking in Software Development Process, in: C. Kreiner, R. V. O’Connor, A. Poth, R. Messnarz (Eds.), Systems, Software and Services Process Improvement, volume 633 of Communications in Computer and Information Science, Springer International Publishing, Cham, 2016, pp. 212–224. doi:10.1007/978-3-319-44817-6_17. [34] A. L. D. Buisman, M. C. J. D. van Eekelen, Gamification in educational software development, in: Proceedings of the Computer Science Education Research Conference, CSERC ’14, Association for Computing Machinery, New York, NY, USA, 2014, p. 9–20. doi:10.1145/2691352.2691353. [35] W.-Q. Qu, Y.-F. Zhao, M. Wang, B.-Q. Liu, Research on teaching gamification of software en- gineering, in: Proceedings of the 9th International Conference on Computer Science and Education, ICCCSE 2014, Institute of Electrical and Electronics Engineers Inc., 2014, pp. 855–860. doi:10.1109/ICCSE.2014.6926583. [36] M. Laskowski, Implementing gamification techniques into university study path - a case study, in: IEEE Global Engineering Education Conference, EDUCON, volume 2015-April, IEEE Computer Society, 2015, pp. 582–586. doi:10.1109/EDUCON.2015.7096028. [37] K. Berkling, Connecting peer reviews with students’ motivation onboarding, motivation and blended learning, in: M. Helfert, M. T. Restivo, S. Zvacek, J. Uhomoibhi (Eds.), CSEDU 2015 - 7th International Conference on Computer Supported Education, Proceedings, volume 2, SciTePress, 2015, pp. 24–33. doi:10.5220/0005410200240033. [38] M. M. Peixoto, C. Silva, Requirements for gamified educational software: A systematic literature review; [Requisitos para softwares educacionais gamificados: Uma revisão sistemática de literatura], in: S. Matalonga, E. Pimentel, I. S. Brito, J. Araujo, J. J. Miranda, S. Espana, E. Cuadros-Vargas, N. Bencomo, O. Pastor, M. Goulao, T. Oliveira, N. Condori-Fernandez, J. L. de la Vara, M. Kalinowski, L. Olsina, L. Antonelli, R. Guizzardi (Eds.), CIBSE 2015 - XVIII Ibero-American Conference on Software Engineering, Ibero-American Conference on Software Engineering, 2015, pp. 618–631. [39] R. McCrindle, Educational Inclusiveness through Ludic Engagement and Digital Creativity, in: C. Stephanidis, M. Antona (Eds.), Universal Access in Human-Computer Interaction. Applications and Services for Quality of Life, volume 8011 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, Berlin, Heidelberg, 2013, pp. 195–202. doi:10.1007/978-3-642-39194-1_2. [40] U. Schafer, Training scrum with gamification: Lessons learned after two teaching periods, in: IEEE Global Engineering Education Conference, EDUCON, IEEE Computer Society, 2017, pp. 754–761. doi:10.1109/EDUCON.2017.7942932. [41] S. Hof, M. Kropp, M. Landolt, Use of Gamification to Teach Agile Values and Collaboration: A multi-week Scrum simulation project in an undergraduate software engineering course, in: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE ’17, Association for Computing Machinery, New York, NY, USA, 2017, p. 323–328. doi:10.1145/3059009.3059043. [42] G. C. Diniz, M. A. G. Silva, M. A. Gerosa, I. Steinmacher, Using Gamification to Orient and Motivate Students to Contribute to OSS Projects, in: 2017 IEEE/ACM 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), 2017, pp. 36–42. doi:10.1109/CHASE.2017.7. [43] F. de Sousa Pinto, P. C. Silva, Gamification applied for Software Engineering teaching-learning process, in: Proceedings of the XXXI Brazilian Symposium on Software Engineering, SBES ’17, Association for Computing Machinery, New York, NY, USA, 2017, p. 299–307. doi:10.1145/3131151.3131186. [44] M. R. D. A. Souza, L. F. Veado, R. T. Moreira, E. M. L. Figueiredo, H. A. X. Costa, Games for learning: Bridging game-related education methods to software engineering knowledge areas, in: Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering and Education Track, ICSE-SEET 2017, Institute of Electrical and Electronics Engineers Inc., 2017, pp. 170–179. doi:10.1109/ICSE-SEET.2017.17. [45] L. Hernández, M. Muñoz, J. Mejía, A. Peña, N. Rangel, C. Torres, A systematic literature review focused on the use of gamification in software engineering teamworks; [Una revisión sistemática de la literatura enfocada en el uso de gamificación en equipos de trabajo en la ingeniería de software], RISTI - Revista Iberica de Sistemas e Tecnologias de Informacao (2017) 33–50. doi:10.17013/risti.21.33-50.

Show full item record