The Current State of the Gamification in E-Learning
A literature Review of Literature Reviews
Abstract
The aim of this article is to present a systematic literature review of literature reviews (a meta-study) of gamification topics in e-learning with a purpose to present a high-level overview of the state of the development of the selected field.
The systematic literature review of literature reviews (2010 - 2019) was performed. The academic papers (literature reviews) from several academic databases such as DOAJ, ScienceDirect, Google Sholar and WOS were examined and filtered for further study. The selected articles were analysed for sub-topics (e.g. the efficiency of gamification mechanisms) and summarized.
In last 5 years, the research of gamification in various fields (mobile apps, e-health, human resource management, business development, e-learning) is getting traction and the number of research articles and systematic reviews of research articles is increasing. After filtering literature review articles, we have found out that only a handful of them – 19, which summarizes 2631 studies, are directly related to gamification in e-learning.
This study shows that the following gamification mechanisms in e-learning proved themselves efficient in almost all underlying studies, but there is no broad consensus on terminology and how to group of different gamification related concepts.
The research is limited to the following scholarly databases: DOAJ, Elsevier, Google Scholar, and WOS. We are aware that there is a possibility we missed some systematic literature reviews on this topic, which was indexed in other well-known databases or published using different terminology in the title or abstract.
The article can serve as a starting point for the research for the scholars and especially post-graduate students who are getting familiar with the e-learning, gamification and performing systematic literature reviews. Also, developers of e-learning systems and course designers could benefit from this article by finding out which gamification mechanisms are most researched, most efficient and worth implementing.
To our knowledge, this kind of meta-analysis of the literature reviews hasn’t been done in the field of gamification in e-learning for the year 2019.
References
Ašeriškis, D. and Damaševičius, R. (2014) ‘Gamification of a Project Management System’, The Seventh International Conference on Advances in Computer-Human Interactions Gamification, (c), pp. 200–207. doi: 10.1145/2181037.2181040.
Bajdor, P. (2011) ‘the Gamification As a Tool To Improve Risk Management’, Annales Universitatis Apulensis Series Oeconomica, 13(2), pp. 574–583. Available at: http://oeconomica.uab.ro/upload/lucrari/1320112/38.pdf.
Baptista, G. and Oliveira, T. (2019) ‘Gamification and serious games: A literature meta-analysis and integrative model’, Computers in Human Behavior, 92, pp. 306–315. doi: https://doi.org/10.1016/j.chb.2018.11.030.
Bellotti, F. et al. (2013) ‘A gamified short course for promoting entrepreneurship among ICT engineering students’, Proceedings - 2013 IEEE 13th International Conference on Advanced Learning Technologies, ICALT 2013, pp. 31–32. doi: 10.1109/ICALT.2013.14.
Borges, R. P. et al. (2018) ‘A systematic review of literature on methodologies, practices, and tools for programming teaching’, IEEE Latin America Transactions. IEEE Computer Society, 16(5), pp. 1468–1475. doi: 10.1109/TLA.2018.8408443.
Bozkurt, A. and Durak, G. (2018) ‘A systematic review of gamification research: In pursuit of homo ludens’, International Journal of Game-Based Learning, 8(3), pp. 15–33. doi: 10.4018/IJGBL.2018070102.
Burke, B. (2014) Gartner Redefines Gamification, Gartner Blog Network. Available at: http://blogs.gartner.com/brian_burke/2014/04/04/gartner-redefines-gamification/.
Burke, B. B. (2013) ‘The Gamification of Business’, Forbes, pp. 2013–2015. Available at: http://www.forbes.com/sites/gartnergroup/2013/01/21/the-gamification-of-business/.
Dale, S. (2014) ‘Gamification’, Business Information Review, 31(2), pp. 82–90. doi: 10.1177/0266382114538350.
Deterding, S. et al. (2011) ‘From Game Design Elements to Gamefulness : Defining “ Gamification ”’, in Envisioning Future Media Environments, pp. 9–11. doi: 10.1145/2181037.2181040.
Deterding, S. and Dixon, D. (2011) ‘Gamification : Using Game Design Elements in Non-Gaming Contexts’, CHI 2011: Conference on Human Factors in Computing Systems, pp. 5–8. doi: 10.1145/1979742.1979575.
Dicheva, D. et al. (2015) ‘Gamification in Education: A Systematic Mapping Study Darina’, Educational Technology and Society, 18(3), pp. 3–20. Available at: http://www.academia.edu/download/39683102/Gamification_in_Education_A_Systematic_M20151104-8546-1cs0c99.pdf (Accessed: 13 November 2019).
Groh, F. (2012) ‘Gamification: State of the Art Definition and Utilization’, Research Trends in Media Informatics, pp. 39–46. doi: 10.1145/1979742.1979575.
Gundry, D. and Deterding, S. (2019) ‘Validity Threats in Quantitative Data Collection With Games: A Narrative Survey’, Simulation & Gaming, 50(3), pp. 302–328. doi: 10.1177/1046878118805515.
Hamari, J., Koivisto, J. and Sarsa, H. (2014) ‘Does gamification work?--a literature review of empirical studies on gamification’, System Sciences (HICSS), 2014 47th Hawaii International Conference on, pp. 3025–3034. doi: 10.1109/HICSS.2014.377.
Huotari, K. (2012) ‘Defining Gamification - A Service Marketing Perspective’, Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 17–22. doi: 10.1145/2393132.2393137.
Huotari, K. and Hamari, J. (2012) ‘Defining gamification’, Proceeding of the 16th International Academic MindTrek Conference on - MindTrek ’12, p. 17. doi: 10.1145/2393132.2393137.
Junior, E. et al. (2019) ‘Systematic literature review of Gamification and Game-based Learning in the context of Problem and Project Based Learning approaches’, in 11th International Symposium on Project Approaches in Engineering Education (PAEE) 16th Active Learning in Engineering Education Workshop (ALE). Hammamet, Tunisia.
Kappen, D. L. and Nacke, L. E. (2013) ‘The kaleidoscope of effective gamification: deconstructing gamification in business applications’, Proceedings of the First International Conference on Gameful Design, Research, and Applications - Gamification ’13, pp. 119–122. doi: 10.1145/2583008.2583029.
Kasurinen, J. and Knutas, A. (2018) ‘Publication trends in gamification: A systematic mapping study’, Computer Science Review. Elsevier, 27, pp. 33–44. doi: 10.1016/J.COSREV.2017.10.003.
Kim, B. (2015) ‘Understanding Gamification’, Library Technology Reports, 51(2), p. 37. doi: http://dx.doi.org/10.5860/ltr.51n2.
Kocakoyun, S. and Ozdamli, F. (2018) ‘A Review of Research on Gamification Approach in Education’, in Socialization - A Multidimensional Perspective. doi: 10.5772/intechopen.74131.
Koivisto, J. and Hamari, J. (2014) ‘Demographic differences in perceived benefits from gamification’, Computers in Human Behavior, 35, pp. 179–188. doi: 10.1016/j.chb.2014.03.007.
Lee, J. J. J. and Hammer, J. (2011) ‘Gamification in Education: What , How , Why Bother?’, Academic Exchange Quarterly, 15(2), pp. 1–5. Available at: http://dialnet.unirioja.es/servlet/articulo?codigo=3714308.
Looyestyn, J. et al. (2017) ‘Does gamification increase engagement with online programs? A systematic review’, PLoS ONE. Edited by F. Amblard, 12(3), p. e0173403. doi: 10.1371/journal.pone.0173403.
Majuri, J., Koivisto, J. and Hamari, J. (2018) ‘Gamification of education and learning: A review of empirical literature’, in CEUR Workshop Proceedings, pp. 11–19. Available at: http://ceur-ws.org/Vol-2186/paper2.pdf. (Accessed: 19 November 2019).
Mapplinks (2017) How To Use Gamification In Growth Hacking? Available at: http://mapplinks.com/use-gamification-growth-hacking/ (Accessed: 25 January 2018).
Marczewski, A. (2013) Game Mechanics in Gamification. Available at: https://www.gamified.uk/2013/01/14/game-mechanics-in-gamification/ (Accessed: 20 November 2019).
Mora, A. et al. (2017) ‘Gamification: a systematic review of design frameworks’, Journal of Computing in Higher Education. Springer New York LLC, 29(3), pp. 516–548. doi: 10.1007/s12528-017-9150-4.
Morschheuser, B. et al. (2017) ‘Gamified Crowdsourcing: Conceptualization, Literature Review, and Future Agenda’, International Journal of Human-Computer Studies, 106, p. 43. doi: 10.1016/j.ijhcs.2017.04.005.
Morschheuser, B., Hamari, J. and Koivisto, J. (2016) ‘Gamification in crowdsourcing: A review’, in Proceedings of the Annual Hawaii International Conference on System Sciences, pp. 4375–4384. doi: 10.1109/HICSS.2016.543.
Nazififard, S. et al. (2019) ‘A Model for Utilizing the Potential of Gamification in Learning’, in 2019 IEEE 5th Conference on Knowledge Based Engineering and Innovation, KBEI 2019, pp. 874–878. doi: 10.1109/KBEI.2019.8735001.
Newhouse, K. (2014) Introducing the Growth Hacking Strategy of ‘GAMIFICATION’... The HOTTEST Dental Web Marketing Strategy for 2014 and Beyond! - Get Clients Now - Dentaltown. Available at: http://www.dentaltown.com/blog/post/1129/introducing-the-growth-hacking-strategy-of-gamification-the-hottest-dental-web-marketing-strategy-for-2014-and-beyond#Comment (Accessed: 25 January 2018).
Nortvig, A. M., Petersen, A. K. and Balle, S. H. (2018) ‘A literature review of the factors influencing e-learning and blended learning in relation to learning outcome, student satisfaction and engagement’, Electronic Journal of e-Learning, 16(1), pp. 45–55. Available at: www.ejel.org (Accessed: 14 November 2019).
Orta, E. and Ruiz, M. (2012) ‘A Simulation and Gamification Approach for IT Service Management Improvement’, Communications in Computer and Information Science, 290, pp. 295–301. doi: 10.1007/978-3-319-38980-6_7.
Ortega-Arranz, A. et al. (2017) ‘How gamification is being implemented in MOOCs? A systematic literature review’, in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). doi: 10.1007/978-3-319-66610-5_40.
Ortiz, M., Chiluiza, K. and Valcke, M. (2016) ‘Gamification in higher education and stem: A systematic review of literature’, in EDULEARN16 Proceedings, pp. 6548–6558. doi: 10.21125/edulearn.2016.0422.
Prince, J. et al. (2013) ‘Gamification’, Business & Information Systems Engineering, 5(4), pp. 275–278. doi: 10.1007/s12599-013-0273-5.
Prince, J. D. (2013) ‘Gamification’, Journal of Electronic Resources in Medical Libraries, 10(3), pp. 162–169. doi: 10.1080/15424065.2013.820539.
Raymer, R. (2011) ‘Gamification: Using Game Mechanics to Enhance eLearning’, eLearn, 2011(9), p. 3. doi: 10.1145/2025356.2031772.
Rengifo, P. et al. (2017) ‘Motivational experiences of gamifications: a systematic literature review’, INNOVACION EDUCATIVA-MEXICO, 17(75), pp. 63–80.
Rodrigues, H. et al. (2019) ‘Tracking e-learning through published papers: A systematic review’, Computers & Education, 136, pp. 87–98. doi: https://doi.org/10.1016/j.compedu.2019.03.007.
Silva, R. J. R. da, Rodrigues, R. G. and Leal, C. T. P. (2019a) ‘Gamification in Management Education: A Systematic Literature Review’, BAR - Brazilian Administration Review. Associação Nacional de Pós-Graduação e Pesquisa em Administração (ANPAD), 16(2), p. e180103. doi: 10.1590/1807-7692bar2019180103.
Silva, R. J. R. da, Rodrigues, R. G. and Leal, C. T. P. (2019b) Gamification in Management Education: A Systematic Literature Review, BAR - Brazilian Administration Review. doi: 10.1590/1807-7692bar2019180103.
Simões, J., Redondo, R. D. and Vilas, A. F. (2013) ‘A social gamification framework for a K-6 learning platform’, Computers in Human Behavior, 29(2), pp. 345–353. doi: 10.1016/j.chb.2012.06.007.
Smith, V. et al. (2011) ‘Methodology in conducting a systematic review of systematic reviews of healthcare interventions’, BMC Medical Research Methodology. BioMed Central, 11(1), p. 15. doi: 10.1186/1471-2288-11-15.
Subhash, S. and Cudney, E. A. (2018) ‘Gamified learning in higher education: A systematic review of the literature’, Computers in Human Behavior, 87, pp. 192–206. doi: https://doi.org/10.1016/j.chb.2018.05.028.
Urh, M. et al. (2015) ‘The Model for Introduction of Gamification into E-learning in Higher Education’, Procedia - Social and Behavioral Sciences, 197, pp. 388–397. doi: https://doi.org/10.1016/j.sbspro.2015.07.154.
Wilson, R. C. et al. (2019) ‘The Eighty Five Percent Rule for optimal learning’, Nature Communications, 10(1), p. 4646. doi: 10.1038/s41467-019-12552-4.
The authors retain rights under the Creative Commons Attribution-ShareAlike 4.0 International CC BY-SA 4.0. Authors assign copyright or license the publication rights in their articles, including abstracts, to MIP=JIBM. This enables us to ensure full copyright protection and to disseminate the article, and of course MIP=JIBM, to the widest possible readership in electronic format. Authors are themselves responsible for obtaining permission to reproduce copyright material from other sources.