Popup window

Print this page

Pilot Test Outcomes

Sheltered English Immersion

Multiple-Choice Items (MCQs)
Number of MCQs Prepared185
Number of MCQs Piloted*117
Number of MCQs Identified for Further Review22
Number of MCQs Deleted Post Pilot Test Review3

*This chart includes information regarding multiple-choice items piloted prior to the first operational administration and may be a subset of all items developed. Additional items are piloted as non-scorable on operational test forms, until all items are piloted.

Open-Response Items

In consultation with the Massachusetts Department of Education and the Department of Justice review, the open-response item for the Sheltered English Immersion test was designed as a single, five-part open-response item requiring candidates to show their knowledge of sheltering content. Candidates use one of 10 mentor texts for the basis of their response. Each mentor text is an informational text that is representative of the kind of content and academic language features a student might encounter in texts in a given content area. Candidates are expected to spend about 20–30 minutes to prepare an adequate response to each of the five parts of the assignment, for a total of about 2–2 ½ hours for the section. The multiple-choice section counts for 60 percent and the open-response section counts for 40 percent of the candidate's total test score.

Piloting of the new open-response item type focused on evaluating the item format. Pilot test responses to the open- response item format were reviewed for the following characteristics:

A review of the data and item comments collected indicated that the candidates were able to appropriately and adequately respond to the new open-response item type and were able to produce a response within the targeted response time of 2 ½ hours, leaving sufficient time to respond to the multiple-choice questions. In addition, candidates were able to move throughout the various open-response item components with relative ease.