US 9,812,026 B2
Constructed response scoring mechanism
Jon D. Cohen, Washington, DC (US); Joseph L. Dvorak, Hampshire, IL (US); Larry E. Albright, Alexandria, VA (US); and Walid S. Saba, Dunn Loring, VA (US)
Assigned to AMERICAN INSTITUTES FOR RESEARCH, Washington, DC (US)
Filed by Jon D. Cohen, Washington, DC (US); Joseph L. Dvorak, Hampshire, IL (US); and Larry E. Albright, Alexandria, VA (US)
Filed on Jan. 30, 2009, as Appl. No. 12/320,631.
Claims priority of provisional application 61/193,252, filed on Nov. 12, 2008.
Prior Publication US 2010/0120010 A1, May 13, 2010
Int. Cl. G09B 3/00 (2006.01); G09B 7/02 (2006.01)
CPC G09B 7/02 (2013.01) 9 Claims
OG exemplary drawing
 
1. A system for scoring user responses to a test question, comprising:
a scoring engine for receiving a user response to a test question and evaluating the response against a scoring rubric, wherein the scoring rubric includes a binding stage, an assertion stage, and a scoring stage; and
a database for referencing elements used by the scoring engine which include at least one of objects, object sets, attributes of objects, and transformations of any elements;
wherein the system establishes at least one reference to one or more elements during the binding stage;
the system evaluates and stores at least one assertion about an element during the assertion stage;
the system builds a scoring rubric based on said assertions;
the system assigns a score to the response based on a result produced at the assertion stage during the scoring stage; and
the bindings and the assertions use a library of relatively low-level primitives that are combined to score an array of item and item types without the need for additional programming.