Automated Scoring of a Summary Writing Task Designed to Measure Reading Comprehension

Authors

• Nitin Madnani, Educational Testing Service
• Jill Burstein, Educational Testing Service
• John Sabatini, Educational Testing Service
• Tenaha O’Reilly, Educational Testing Service

Abstract

We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach performs well on summaries written by students for two different passages.

Publication Title

Proceedings of the 8th Workshop on Innovative Use of Nlp for Building Educational Applications Bea 2013

Recommended Citation

Madnani, N., Burstein, J., Sabatini, J., & O’Reilly, T. (2013). Automated Scoring of a Summary Writing Task Designed to Measure Reading Comprehension. Proceedings of the 8th Workshop on Innovative Use of Nlp for Building Educational Applications Bea 2013, 163-168. Retrieved from https://digitalcommons.memphis.edu/facpub2/2356