Popup window

Print this page

Open Response Statistics Report (Annotated Report Sample)

Open Response Statistics Report (Annotated Report Sample)
Test Field Number of Tests Taken Open-Response Items
Item 1 Item 2
Scorer Agreement Inter-rater Reliability Scorer Agreement Inter-rater Reliability
Percent Agreement Percent Exact Percent Adjacent Percent Agreement Percent Exact Percent Adjacent
01 TestName011,27298.767.431.30.8099.473.126.40.85
02 TestName0248799.477.222.20.8698.675.223.40.75

Test Field. The test field code and name.

Number of Tests Taken. The number of tests taken during the reporting period, including those tests retaken by the same candidate.

For Item 1 and Item 2:

  • Scorer Agreement. The following information is provided indicating rates of scorer agreement on the individual raw scores given to each open-response item: the percent of cases in which the first two scorers were in agreement (i.e., assigned identical or adjacent scores), the percent of exact scores, and the percent of adjacent scores.
  • Inter-rater Reliability. The inter-rater reliability indicates the correlation between the first and second score assigned to each response, corrected using the Spearman-Brown formula. This information is provided for each open-response item.