Preliminary research findings resulting from the collaboration of POST research efforts (SME groups, statistical analyses, review of entry-level peace officer exams from other states) and CSUS research efforts (statistical analyses, review of various types of cognitive tests) indicate that the ability of the PELLETB to meaningfully predict successful peace officer performance could be improved by the addition of components that assess problem awareness, reasoning ability, and judgment/decision making. In addition to facilitating research, automation of the PELLETB will result in improved test security, increased capacity for test development, and an expansion of test delivery options for agencies that use the PELLETB.
In April 2012, the final phase of the longitudinal study concluded an assessment of adding a new subtest to the PELLETB and possibly removing the CLOZE subtest. Results from the study suggest that POST should discontinue the CLOZE subtest and incorporate measures of reasoning abilities into the PELLETB. The addition of a reasoning ability subtest will allow assessment of a candidate’s decision-making, judgment and learning ability. This new subtest uses standard multiple choice options. The candidate analyzes information and uses patterns, commonalities, and relationships to answer questions about the information presented. This information includes groups or ordered series of facts, numbers, letters, or words.
Final recommendations are that the removal of the CLOZE subtest and addition of reasoning measures will add significant value in predicting student success in the academy. Additionally, revisions of the PELLETB should include contemporary testing practices by providing more alternate test forms to ensure a higher level of test security and reduce further overexposure of test content. Staff will begin work on the creation of a series of reasoning items for inclusion into the PELLETB. Actual inclusion of these items into the exam will occur upon the acquisition of a new testing system.
|