Scalable and Explainable Automated Scoring for Open-Ended Constructed Response Math Word Problems

Scott Hellman, Alejandro Andrade, Kyle Habermehl

18th Workshop on Innovative Use of NLP for Building Educational Applications Paper

TLDR: Open-ended constructed response math word problems ("math plus text", or MPT) are a powerful tool in the assessment of students' abilities to engage in mathematical reasoning and creative thinking. Such problems ask the student to compute a value or construct an expression and then explain, potentia
You can open the #paper-BEA_19 channel in a separate window.
Abstract: Open-ended constructed response math word problems ("math plus text", or MPT) are a powerful tool in the assessment of students' abilities to engage in mathematical reasoning and creative thinking. Such problems ask the student to compute a value or construct an expression and then explain, potentially in prose, what steps they took and why they took them. MPT items can be scored against highly structured rubrics, and we develop a novel technique for the automated scoring of MPT items that leverages these rubrics to provide explainable scoring. We show that our approach can be trained automatically and performs well on a large dataset of 34,417 responses across 14 MPT items.