An audit of the test and its administration

The A*StarSM Audit is a comprehensive review of test score results to assure their suitability for their intended purpose. The review examines the psychometric characteristics of the test and the standardization of the test administration and scoring. Where the review finds limitations or problems, the source, nature, and significance are identified. The review may also be used to identify areas of exemplary performance, measures of achievement gain, correlates of performance and other characteristics.

Expected and observed test results

Test results are often influenced by the environment in which they are administered. Flaws in test design or misapplication of tests may become apparent only when administered under operational conditions. Further, errors or omissions in testing procedures and inattention to proctor training may significantly skew the results from the very best tests. These 'environmental' effects may be more pronounced among lower performing test takers, misdirecting the interpretation of test scores and the decisions based on them.

A tested, sophisticated program

The A*StarSM Audit is conducted by entering the detailed test results into a sophisticated software program, a program developed after years of on-site reviews, methodological development, and applications in school and industry settings. The passage of the data through the analysis is monitored by application specialists and interpreted by psychometricians.

Timely, confidential, non-intrusive

The A*StarSM Audit provides an offsite, confidential, timely review without intruding into classroom, test center, or office operations. The review results provide support for high quality assessment, direction for areas where improvement may be indicated, and, where necessary, identification of instances of improper influence on the test administration.

Major Benefits

Management control. The A*StarSM Audit identifies where the assessment process is well carried out and where it is not, confirming what works and identifying the source and significance of what doesn't. Managers may use examples from the successful practices to correct and improve assessment administration where problems are indicated.

Deters improper influence. The oversight provided by the Audit holds all assessment administrators to a single, high standard of performance. Experience has demonstrated that follow-up on identified instances of irregularities reinforces the standard, improves the qualify of test administration, and acts as a deterrent to future improper influence.

Non Intrusive. The Audit operates on data routinely collected in the assessment process. As a result, the Audit will not intrude on classrooms, test centers, or administrative offices, and will not interrupt instruction or administration schedules.

Real time evaluation. The Audit analysis may be completed within days of the scanning and scoring of the test, allowing immediate follow-up action where necessary. The quality of the test scores will be assured before decisions need to be taken based on them.

Prioritization and Guidance. Where problems are found, the Audit provides a measure of severity and an indication of the cause, allowing management prioritization and providing guidance for follow-up.

Proven Capability. The capability of the A*StarSM Audit to provide a comprehensive review, with accurate identification of significant problems, is supported by a history of test administration reviews in elementary and middle school classrooms and in the assessment centers of occupational training schools.