Meetings
 
 
Print
AGENDA ITEM REPORT

Title: Report on SPO A.08.08, Expand Entry-Level Cognitive Testing for Peace Officers
REPORT PROFILE
MEETING DATE
6/28/2012
BUREAU SUBMITTING THIS REPORT
Strategic Communications and Research Bureau
RESEARCHED BY (PRINT NAME)
Tammura Hathorne-Brown
REVIEWED BY (PRINT NAME)
Stephanie Scofield
REPORT DATE
05/15/2012
APPROVED BY
Paul Cappitelli
DATE APPROVED
06/12/12
PURPOSE
Information Only
FINANCIAL IMPACT
No

ISSUE:
Should Strategic Plan Objective A.08.08, Expand entry-level cognitive testing for peace officers be deleted as completed?
BACKGROUND:

In 1979, the Commission adopted POST Regulation 1002(b) (3) which requires every peace officer candidate to be able to read and write at the level necessary to perform the job of a peace officer.  Subsequently, POST developed the POST Entry-Level Law Enforcement Test Battery (PELLETB). The PELLETB is provided at no cost to agencies that participate in the POST program. The current PELLETB is a cognitive competency test that contains five reading and writing subtests. The exam, used by more than 300 agencies, is administered to approximately 50,000 peace officer candidates each year. While the existing test both predicts peace officer performance and has withstood court challenges, the PELLETB measures verbal skills but no other cognitive abilities (e.g., critical thinking, problem solving, spatial ability, situational judgment, reasoning, numeric functioning).

 

At its January 2007 meeting, the Commission directed staff to examine the feasibility of adding cognitive assessments to the PELLETB.  In September 2007, the Commission approved a contract with California State University, Sacramento (CSUS) to facilitate and enhance PELLETB research efforts.  Through the POST/CSUS collaboration, several extensive analyses of existing PELLETB data have been completed.  For example, IRT (Item Response Theory) analyses have been completed for all active test items.  These analyses allow researchers to determine if individual test items are providing valid, reliable, job-related information about candidates.
ANALYSIS:

Preliminary research findings resulting from the collaboration of POST research efforts (SME groups, statistical analyses, review of entry-level peace officer exams from other states) and CSUS research efforts (statistical analyses, review of various types of cognitive tests)  indicate that the ability of the PELLETB to meaningfully predict successful peace officer performance could be improved by the addition of components that assess problem awareness, reasoning ability, and judgment/decision making. In addition to facilitating research, automation of the PELLETB will result in improved test security, increased capacity for test development, and an expansion of test delivery options for agencies that use the PELLETB.

In April 2012, the final phase of the longitudinal study concluded an assessment of adding a new subtest to the PELLETB and possibly removing the CLOZE subtest. Results from the study suggest that POST should discontinue the CLOZE subtest and incorporate measures of reasoning abilities into the PELLETB.  The addition of a reasoning ability subtest will allow assessment of a candidate’s decision-making, judgment and learning ability. This new subtest uses standard multiple choice options. The candidate analyzes information and uses patterns, commonalities, and relationships to answer questions about the information presented. This information includes groups or ordered series of facts, numbers, letters, or words.

 

Final recommendations are that the removal of the CLOZE subtest and addition of reasoning measures will add significant value in predicting student success in the academy. Additionally, revisions of the PELLETB should include contemporary testing practices by providing more alternate test forms to ensure a higher level of test security and reduce further overexposure of test content. Staff will begin work on the creation of a series of reasoning items for inclusion into the PELLETB. Actual inclusion of these items into the exam will occur upon the acquisition of a new testing system.
RECOMMENDATION:
Research concludes that adding reasoning abilities to the PELLETB is a better predictor of student success in the academy. It is recommended that SPO A.08.08 be deleted from the Strategic Plan as completed.
 
ATTACHMENT(S):
Name: Type:
No Attachments Available