Using Multimodal Learning Analytics to Explore how Children Experience Educational Motion-Based Touchless Games

Abstract

Leveraging motion-based touchless games (MBTG) to support children’s learning is appealing and technically challenging. The application of multimodal learning analytics (MMLA) can help researchers to better understand how children experience learning through movement by providing insights into children’s cognitive, behavioural, interaction, and learning processes. However, there is limited knowledge about exploiting the integration of MMLA into the use of educational MBTG in children’s learning. We present an in-progress study in which we conducted an experiment with 55 children, playing three different educational MBTG centred on the development of math and English competencies. We collected multimodal data from 6 different sources: eye-tracking glasses, video, wristband, game analytics, Kinect point cloud, and questionnaires. Future analysis will explore relationships between the various multimodal data, in pursuit of establishing a more holistic understanding of children’s cognitive, behavioural, interaction, and learning processes experienced while engaged with MBTG for learning.