Engagement-Driven Differences in Acoustic Features During Online Reading Comprehension Conversations

Authors

Abstract

The prevalence of online reading platforms has surged along with improvements to automatic speech recognition (ASR) systems. These platforms facilitate personalized reading instruction, but like all learning systems, work best when students find them engaging. The Educational Data Mining (EDM) community has made great efforts to detect student engagement, but these efforts have largely been confined to school and lab environments without intentionally including neurodiverse populations. In the present study, we evaluate engagement levels in children with Attention Deficit Hyperactivity Disorder (ADHD, n=55), Autism (n=38), both Autism and ADHD (n=38) and with no known clinical diagnoses (n=22) as they interact with a digital literacy learning system from their homes. Engagement was measured using parent report, and acoustic features were extracted from audio recordings of the students while they interacted with the Amira literacy learning system. Our results indicate that acoustic measures related to temporal features, pitch, and vocal quality are related to engagement levels across all clinical groups. We also identify key temporal features that vary across different clinical groups. These findings demonstrate the validity of using non-invasive acoustic features to measure engagement levels during reading comprehension tasks at home. However, interaction effects also highlight the importance of taking into account children's clinical diagnosis when measuring engagement.

No cited bibliography is currently integrated for this reference. This does not necessarily mean that no bibliography exists.