The Use of Learning Analytics Interactive Dashboards in Serious Games
A Review of the Literature
Keywords:Learning analytics, serious games, data visualization, interactive dashboards
The learning analytics in serious games, corresponds to a subject in increasing demand in the educational field. In this context, there is a need to study how data visualizations found in the literature are adopted in learning analytics in serious games. This paper presents a Systematic Literature Review (SLR) on how the evolution of studies associated with the use of learning analytics interactive dashboards in serious games is processed, seeking to investigate the characteristics of using dashboards for viewing educational data. A bibliometric analysis was carried out in which 75 relevant studies were selected from the Scopus, Web of Science, and IEEExplore databases. From the data analysis, it was observed that in the current literature there is a reduced number of studies containing the main actors in the learning process, as follows: teachers/instructors, students/participants, game developers/designers, and managers/researchers. In the vast majority of investigated studies, data visualization algorithms are used, where the main focus takes into account only actors, such as teachers/instructors and students/participants.
Ali, M., Shatabda, S., & Ahmed, M. (2018). Impact of learning analytics on product marketing with serious games in Bangladesh. 5th IEEE Region 10 Humanitarian Technology Conference 2017, R10-HTC 2017, 2018-Janua, 576–579.
Alonso-Fernández, C., Caballero Roldán, R., Freire, M., Martinez-ortiz, I., & Fernández-Manjón, B. (2019). Predicting students’ knowledge after playing a serious game based on learning analytics data: A case study (under review). Journal of Computer Assisted Learning, (November), 1–9.
Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Applications of data science to game learning analytics data: A systematic literature review. Computers and Education, 141(April), 103612.
Alonso-Fernandez, C., Calvo, A., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2017). Systematizing game learning analytics for serious games. In IEEE Global Engineering Education Conference, EDUCON, 1111–1118.
Alonso-Fernández, C., Cano, A. R., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Lessons learned applying learning analytics to assess serious games. Computers in Human Behavior, 99(June), 301–309.
Azcona, D., Hsiao, I. H., & Smeaton, A. F. (2019). Detecting students-at-risk in computer programming classes with learning analytics from students’ digital footprints. User Modeling and User-Adapted Interaction.
Birt, J., Clare, D., & Cowling, M. (2019). Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education. 2019 IEEE 7th International Conference on Serious Games and Applications for Health, SeGAH 2019.
Buenaño-Fernandez, D., Villegas-CH, W., & Luján-Mora, S. (2019). The use of tools of data mining to decision making in engineering education—A systematic mapping study. Computer Applications in Engineering Education, 27(3), 744–758.
Bull, S., & Wasson, B. (2016). Competence visualisation: Making sense of data from 21st-century technologies in language learning. ReCALL, 28(2), 147–165.
Callaghan, M., McShane, N., Eguíluz, A. G., & Savin-Baden, M. (2018). Extending the activity theory based model for serious games design in engineering to integrate analytics. International Journal of Engineering Pedagogy, 8(1), 109–126.
Calvo-Morata, A., Alonso-Fernández, C., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2019). Game Learning Analytics, Facilitating the Use of Serious Games in the Class. IEEE Revista Iberoamericana de Tecnologias Del Aprendizaje, 14(4), 1–1.
Calvo-Morata, A., Rotaru, D. C., Alonso-Fernandez, C., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2018). Validation of a Cyberbullying Serious Game Using Game Analytics. IEEE Transactions on Learning Technologies, 1382(c), 1–12.
Calvo, A., Rotaru, D. C., Freire, M., & Fernandez-Manjon, B. (2016). Tools and approaches for simplifying serious games development in educational settings. IEEE Global Engineering Education Conference, EDUCON, 10-13-Apri(April), 1188–1197.
Cano, A. R., Fernandez-Manjon, B., & Garcia-Tejedor, A. J. (2016). Downtown, a subway adventure: Using Learning analytics to improve the development of a learning game for people with intellectual disabilities. Proceedings - IEEE 16th International Conference on Advanced Learning Technologies, ICALT 2016, 125–129.
Cano, A. R., Fernández-Manjón, B., & García-Tejedor, Á. J. (2018). Using game learning analytics for validating the design of a learning game for adults with intellectual disabilities. British Journal of Educational Technology, 49(4), 659–672.
Capatina, A., Bleoju, G., Rancati, E., & Hoareau, E. (2018). Tracking precursors of learning analytics over serious game team performance ranking. Behaviour and Information Technology, 37(10–11), 1008–1020.
Cariaga, A. A., & Feria, R. (2016). Learning analytics through a digital game-based learning environment. IISA 2015 - 6th International Conference on Information, Intelligence, Systems and Applications.
Chaudy, Y., & Connolly, T. (2018). Specification and evaluation of an assessment engine for educational games: Empowering educators with an assessment editor and a learning analytics dashboard. Entertainment Computing, 27(September 2017), 209–224.
Chaudy, Y., & Connolly, T. (2019). Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool. Entertainment Computing, 30(November 2018), 100294.
Chaudy, Y., Connolly, T. M., & Hainey, T. (2014). EngAGe: A link between educational games developers and educators. 2014 6th International Conference on Games and Virtual Worlds for Serious Applications, VS-GAMES 2014.
Codish, D., Rabin, E., & Ravid, G. (2019). User behavior pattern detection in unstructured processes – a learning management system case study. Interactive Learning Environments, 27(5–6), 699–725.
De Oliveira, F. S., & Santos, S. (2016). PBLMaestro: A virtual learning environment for the implementation of problem-based learning approach in Computer education. Proceedings - Frontiers in Education Conference, FIE, 2016-Novem.
Forsyth, C. M., Graesser, A., & Millis, K. (2019). Predicting Learning in a Multi-component Serious Game. Technology, Knowledge and Learning.
Francis, P., Broughan, C., Foster, C., & Wilson, C. (2019). Thinking critically about learning analytics, student outcomes, and equity of attainment. Assessment and Evaluation in Higher Education, 1–11.
Freire, P. D. S. (2013). Aumente a qualidade e quantidade de suas publicações científicas: manual para elaboração de projetos e artigos científicos. Curitiba: Crv, 90.
Freire, M., Del Blanco, Á., & Fernańdez-Manjón, B. (2014). Serious games as edX MOOC activities. IEEE Global Engineering Education Conference, EDUCON, (April), 867–871.
Ganan, D., Caballe, S., Clariso, R., & Conesa, J. (2016a). A prototype of an elearning platform in support for learning analytics and gamification. Proceedings - 2016 International Conference on Intelligent Networking and Collaborative Systems, IEEE INCoS 2016, 362–369.
Ganan, D., Caballe, S., Clariso, R., & Conesa, J. (2016b). Analysis and Design of an eLearning Platform Featuring Learning Analytics and Gamification. Proceedings - 2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems, CISIS 2016, 87–94.
Georgiadis, K., Van Lankveld, G., Bahreini, K., & Westera, W. (2019). Learning analytics should analyse the learning: Proposing a generic stealth assessment tool. IEEE Conference on Computatonal Intelligence and Games, CIG, 2019-Augus.
Gibson, D., & de Freitas, S. (2016). Exploratory Analysis in Learning Analytics. Technology, Knowledge and Learning, 21(1), 5–19.
Hauge, J. B., Berta, R., Fiucci, G., Fernandez-Manjon, B., Padron-Napoles, C., Westra, W., & Nadolski, R. (2014). Implications of learning analytics for serious game design. Proceedings - IEEE 14th International Conference on Advanced Learning Technologies, ICALT 2014, 230–232.
Hauge, J. B., Kalverkamp, M., Bellotti, F., Berta, R., De Gloria, A., & Barabino, G. (2014). Requirements on learning analytics for facilitated and non facilitated games. IEEE Global Engineering Education Conference, EDUCON, (April), 1126–1132.
Hauge, J. B., Madeleine, J., Stanescu, I. A., Arnab, S., Moreno Ger, P., Lim, T., … Degano, C. (2015). Learning Analytics Architecture to Scaffold Learning Experience through Technology-based Methods. International Journal of Serious Games, 2(1).
Hubalovsky, S., Hubalovska, M., & Musilek, M. (2019). Assessment of the influence of adaptive E-learning on learning effectiveness of primary school pupils. Computers in Human Behavior, 92(March 2018), 691–705.
Kim, K., & Moon, N. (2018). A model for collecting and analyzing action data in a learning process based on activity theory. Soft Computing, 22(20), 6671–6681.
Klemke, R., Eradze, M., & Antonaci, A. (2018). The flipped MOOC: Using gamification and learning analytics in MOOC design—A conceptual approach. Education Sciences, 8(1).
Lapes (2017). Laboratório de Pesquisa em Engenharia de Software. Disponível em: <http://lapes.dc.ufscar.br/tools/start_tool/>. Acesso em: 04 set. 2019.
Liu, M., Kang, J., Zou, W., Lee, H., Pan, Z., & Corliss, S. (2017). Using Data to Understand How to Better Design Adaptive Learning. Technology, Knowledge and Learning, 22(3), 271–298.
Liu, M., Li, C., Pan, Z., & Pan, X. (2019). Mining big data to help make informed decisions for designing effective digital educational games. Interactive Learning Environments, 1–21.
Loh, C. S., & Li, I. H. (2016). Using players’ gameplay action-decision profiles to prescribe training: Reducing training costs with serious games analytics. Proceedings - 3rd IEEE International Conference on Data Science and Advanced Analytics, DSAA 2016, 652–661.
Martínez-Ortiz, I., Pérez-Colado, I., Rotaru, D. C., Freire, M., & Fernández-Manjón, B. (2019, April). From heterogeneous activities to unified analytics dashboards. In 2019 IEEE Global Engineering Education Conference (EDUCON) (pp. 1108-1113). IEEE.Massa, S. M., & Kuhn, F. D. (2019). Learning Analytics in Serious Games: A systematic review of literature. 2018 IEEE Biennial Congress of Argentina, ARGENCON 2018.
Mavroudi, A., Giannakos, M., & Krogstie, J. (2018). Supporting adaptive learning pathways through the use of learning analytics: developments, challenges and future opportunities. Interactive Learning Environments, 26(2), 206–220.
McCoy, L., Lewis, J. H., & Dalton, D. (2016). Gamification and multimedia for medical education: A landscape review. Journal of the American Osteopathic Association, 116(1), 22–34.
Melero, J., Hernández-Leo, D., Sun, J., Santos, P., & Blat, J. (2015). How was the activity? A visualization support for a case of location-based learning design. British Journal of Educational Technology, 46(2), 317–329. doi:10.1111/bjet.12238
Minović, M., Milovanović, M., Šošević, U., & Conde González, M. Á. (2015). Visualisation of student learning model in serious games. Computers in Human Behavior, 47, 98–107.
Montoro, M. A., Ortiz Colón, M. A., Moreno, J. R., & Steffens, K. (2019). Emerging technologies. Analysis and current perspectives. Digital Education Review, (35), 186–210.
Mora, N., Caballé, S., & Daradoumis, T. (2016). Providing a multi-fold assessment framework to virtualized collaborative learning in support for engineering education. International Journal of Emerging Technologies in Learning, 11(7), 41–51.
Morata, A. C., Fernandez, C. A., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2019). Game learning analytics for educators. IEEE Global Engineering Education Conference, EDUCON, April-2019, 1436–1442.
Nguyen, A., Gardner, L. A., & Sheridan, D. (2018). A framework for applying learning analytics in serious games for people with intellectual disabilities. British Journal of Educational Technology, 49(4), 673–689.
Ninaus, M., Kober, S. E., Friedrich, E. V. C., Neuper, C., & Wood, G. (2014). The potential use of neurophysiological signals for learning analytics. 2014 6th International Conference on Games and Virtual Worlds for Serious Applications, VS-GAMES 2014.
Park, K., Kihl, T., Park, S., Kim, M. J., & Chang, J. (2016). Narratives and sensor driven cognitive behavior training game platform. 2016 IEEE/ACIS 14th International Conference on Software Engineering Research, Management and Applications, SERA 2016, 125–131.
Pérez-Berenguer, D., & García-Molina, J. (2018). A standard-based architecture to support learning interoperability: A practical experience in gamification. Software - Practice and Experience, 48(6), 1238–1268.
Perez-Colado, I., Alonso-Fernandez, C., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2018). Game learning analytics is not informagic! IEEE Global Engineering Education Conference, EDUCON, 2018-April, 1729–1737.
Perez-Colado, I. J., Calvo-Morata, A., Alonso-Fernández, C., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Simva: Simplifying the scientific validation of serious games. Proceedings - IEEE 19th International Conference on Advanced Learning Technologies, ICALT 2019, 113–115.
Perez-Colado, I. J., Perez-Colado, V. M., Martinez-Ortiz, I., Freire-Moran, M., & Fernandez-Manjon, B. (2017). UAdventure: The eAdventure reboot: Combining the experience of commercial gaming tools and tailored educational tools. IEEE Global Engineering Education Conference, EDUCON, (April), 1755–1762.
Perez-Colado, I. J., Rotaru, D. C., Freire-Moran, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2018). Multi-level game learning analytics for serious games. 2018 10th International Conference on Virtual Worlds and Games for Serious Applications, VS-Games 2018 - Proceedings, (April), 1111–1118.
Perez-Colado, V. M., Rotaru, D. C., Freire, M., Martinez-Ortiz, I., & Fernandez-Manjon, B. (2018). Learning analytics for location-based serious games. 2018 10th International Conference on Virtual Worlds and Games for Serious Applications, VS-Games 2018 - Proceedings, 1192–1200.
Perez-Colado, V. M., Pérez-Colado, I. J., Freire-Morán, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). UAdventure: Simplifying narrative serious games development. Proceedings - IEEE 19th International Conference on Advanced Learning Technologies, ICALT 2019, 119–123.
Petrov, E. V., Mustafina, J., Alloghani, M., Galiullin, L., & Tan, S. Y. (2019). Learning analytics and serious games: Analysis of interrelation. Proceedings - International Conference on Developments in ESystems Engineering, DeSE, 2018-Septe, 153–156.
Rodríguez-Cerezo, D., Sarasa-Cabezuelo, A., Gómez-Albarrán, M., & Sierra, J. L. (2014). Serious games in tertiary education: A case study concerning the comprehension of basic concepts in computer language implementation courses. Computers in Human Behavior, 31(1), 558–570.
Rowe, E., Asbell-Clarke, J., Baker, R. S., Eagle, M., Hicks, A. G., Barnes, T. M., … Edwards, T. (2017). Assessing implicit science learning in digital games. Computers in Human Behavior, 76, 617–630.
Ruipérez-Valiente, J. A., Muñoz-Merino, P. J., Pijeira Díaz, H. J., Ruiz, J. S., & Kloos, C. D. (2017). Evaluation of a learning analytics application for open edX platform. Computer Science and Information Systems, 14(1), 51–73.
Santamaría-Bonfil, G., Escobedo-Briones, G., Pérez-Ramírez, M., & Arroyo-Figueroa, G. (2019). A learning ecosystem for linemen training based on big data components and learning analytics. Journal of Universal Computer Science, 25(5), 541–568.
Serrano-Laguna, Á., & Fernández-Manjón, B. (2014). Applying learning analytics to simplify serious games deployment in the classroom. IEEE Global Engineering Education Conference, EDUCON, (April), 872–877.
Serrano-Laguna, Á., Manero, B., Freire, M., & Fernández-Manjón, B. (2018). A methodology for assessing the effectiveness of serious games and for inferring player learning outcomes. Multimedia Tools and Applications, 77(2), 2849–2871.
Serrano-Laguna, Á., Martínez-Ortiz, I., Haag, J., Regan, D., Johnson, A., & Fernández-Manjón, B. (2017). Applying standards to systematize learning analytics in serious games. Computer Standards and Interfaces, 50(September 2016), 116–123.
Serrano-Laguna, Á., Torrente, J., Moreno-Ger, P., & Fernández-Manjón, B. (2014). Application of Learning Analytics in educational videogames. Entertainment Computing, 5(4), 313–322.
Seufert, S., Meier, C., Soellner, M., & Rietsche, R. (2019). A Pedagogical Perspective on Big Data and Learning Analytics: A Conceptual Model for Digital Learning Support. Technology, Knowledge and Learning,
Shoukry, L., & Göbel, S. (2019). Realizing a Mobile Multimodal Platform for Serious Games Analytics, 6(4), 19–48.
Skalka, J., & Drlík, M. (2019). Priscilla – Proposal of System Architecture for Programming Learning and Teaching Environment.
Slimani, A., Elouaai, F., Elaachak, L., Yedri, O. B., & Bouhorma, M. (2018). Learning analytics through serious games: Data mining algorithms for performance measurement and improvement purposes. International Journal of Emerging Technologies in Learning, 13(1), 46–64.
Staubitz, T., Willems, C., Hagedorn, C., & Meinel, C. (2017). The gamification of a MOOC platform. IEEE Global Engineering Education Conference, EDUCON, (January), 883–892.
Terras, M. M., Boyle, E. A., Ramsay, J., & Jarrett, D. (2018). The opportunities and challenges of serious games for people with an intellectual disability. British Journal of Educational Technology, 49(4), 690–700.
Vieira, C., Parsons, P., & Byrd, V. (2018). Visual learning analytics of educational data: A systematic literature review and research agenda. Computers and Education, 122(March), 119–135.
Villagrá-Arnedo, C., Gallego-Duran, F. J., Compan-Rosique, P., Llorens-Largo, F., & Molina-Carmona, R. (2016). Predicting academic performance from Behavioural and learning data. International Journal of Design and Nature and Ecodynamics, 11(3), 239–249.
How to Cite
Copyright (c) 2020 Robson Lemos, Thaís F. Scheneider
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Submission of an article implies that the work described has not been published previously (except in the form of an abstract or as part of a published lecture or academic thesis), that it is not under consideration for publication elsewhere, that its publication is approved by all authors and tacitly or explicitly by the responsible authorities where the work was carried out, and that, if accepted, will not be published elsewhere in the same form, in English or in any other language, without the written consent of the Publisher. The Editors reserve the right to edit or otherwise alter all contributions, but authors will receive proofs for approval before publication.
Copyrights for articles published in IJIER journals are retained by the authors, with first publication rights granted to the journal. The journal/publisher is not responsible for subsequent uses of the work. It is the author's responsibility to bring an infringement action if so desired by the author.