Making autotutor agents smarter: Autotutor answer clustering and iterative script authoring
Abstract
AutoTutor uses conversational intelligent agents in learning environments. One of the major challenges in developing AutoTutor applications is to assess students’ natural language answers to AutoTutor questions. We investigated an AutoTutor dataset with 3358 student answers to 49 AutoTutor questions. In comparisons with human ratings, we found that semantic matching works well for some questions but poor for others. This variation can be predicted by a measure called “question uncertainty”, an entropy value on semantic cluster probabilities. Based on these findings, we propose an iterative AutoTutor script authoring process that can make AutoTutor agents smarter and improve assessment models by iteratively adding and modifying both questions and ideal answers.
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Recommended Citation
Cai, Z., Gong, Y., Qiu, Q., Hu, X., & Graesser, A. (2016). Making autotutor agents smarter: Autotutor answer clustering and iterative script authoring. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10011 LNAI, 438-441. https://doi.org/10.1007/978-3-319-47665-0_50
