Meetings
 
 
Print
AGENDA ITEM REPORT

Title: Report on Request to Enter Into Vendor Contract for Online Test Development, Delivery, and Administration Software
REPORT PROFILE
MEETING DATE
3/2/2022
BUREAU SUBMITTING THIS REPORT
Strategic Communications and Research Bureau
RESEARCHED BY (PRINT NAME)
Tammura Brown
REVIEWED BY (PRINT NAME)
John Lowden
REPORT DATE
3/2/2022
APPROVED BY
Manny Alvarez
DATE APPROVED
02/09/22
PURPOSE
Decision Requested
FINANCIAL IMPACT
Yes

ISSUE, BACKGROUND, ANALYSIS, & RECOMMENDATION
ISSUE:
Should the Commission approve funding for the development of online test development and delivery software in an amount not to exceed $324,000.
BACKGROUND:

Efforts related to POST’s Strategic Plan Objective 2.E.6 (Procure an Examination Development and Delivery system) have been less than effective. It has become clear that POST requires features, capabilities, reliability, and a level of technical support that are not available through the current vendor. Therefore, several steps have been taken to lay the foundation for identifying and acquiring technology to develop, automate, and deliver POST’s tests in an online or virtual platform. 

First, staff drafted and released a Request for Quote (RFQ) and received two responses from potential vendors. One of the vendors who submitted a quote, Assessment Systems Corporation (ASC), currently holds a contract with Strategic Communications and Research Bureau (SCR) for examination development and item banking of the entry-level test batteries. ASC is currently on the California Multiple Awards Schedule (CMAS) list. ASC has provided evidence through their current package structure the ability to handle test registration, scheduling, and online test administration.

Next, staff met with ASC regarding their submitted quote and additional questions.

Third, staff entered discussions with ASC to explore the possibility of ASC providing a combination of POST specific customization and off-the-shelf test software to automate the entry-level test batteries.

Finally, staff presented the RFQ specifications, scope of work, and recommendations to contract with ASC.

ANALYSIS:

In an era of increasingly sophisticated technology, computer-based testing, and cyber-attacks, POST has fallen behind in the use of technology to develop, deliver, administer, and protect its substantial investment in testing. By continuing to develop and deliver tests using outdated tools and methods, POST is placing itself at risk for security breaches, costly and time-consuming testing interruptions, and litigation. The current technology is also limiting the quality and quantity of research that can be completed to effect policy changes and update/improve services. It is prudent to secure and procure testing technologies that can encompass POST’s testing and research needs.

Discussions have revealed that in addition to acquiring new software, POST may also need to invest in the hardware to support the new software. Options include the development of a customized system or the modification of an off-the-shelf system. SCR staff has taken several steps to research and acquire updated testing technologies that will fit POST’s testing needs. 

$10M in governor-directed funds were made available for an advanced distance learning platform (ADLP) initiative due to the COVID-19 pandemic. POST staff reported during the December 2, 2021 Finance Committee and Commission meetings that ADLP monies remained in the amount of $3,210,001. 

SCR staff worked with the Learning Technology Resources (LTR) in the Project Approval Lifecycle (PAL) process for a Learning Management System (LMS) modernization project and testing software. The analysis completed during stage 2 of the PAL process determined the need to require the new online exam solution be featured as its own separate entity by removing it from the LMS altogether. This is recommended to alleviate the reliance on an LMS to conduct test administration. Staff concluded online and virtual testing is better suited, exclusive of the LMS for system reliability and to minimize potential test registration and administration errors, caused by the interfacing of different software systems.

The PAL process is now in stage 3 and ASC was identified. The remaining $3,210,001, which has been redirected from unused ADLP funds will cover the LMS Modernization and testing software.

Staff presented the specifications, scope of work, and recommendations to contract with ASC to POST leadership with approval to move forward.

 
RECOMMENDATION:
Staff recommends the Commission authorize the Executive Director to enter into a contract with Assessment System Corporation (ASC) in an amount not to exceed $324,000. 
 
ATTACHMENT(S):
Name: Type:
Commission_Contract_Attachment_March_2022.docx Cover Memo