Job performance measurement is of critical importance to any organization's health. It is important not only to recognize and reward good performance, but also to groom future leaders. Developing effective assessment techniques that are valid, effective, and fair is an ongoing challenge. Assessing factual knowledge using multiple-choice test batteries is relatively inexpensive and is therefore widely used for performance evaluations. Hands-on assessment is the most effective way to assess task proficiency but is very resource intensive and expensive. Computer-based simulations provide an alternative where users can be assessed in the context of skill application under controlled conditions. However, simulations are expensive to produce and maintain. Validated guidelines and methodologies are needed to help organizations develop effective assessment simulations. Our research has the objective of developing a prescriptive methodology and a framework for rapidly creating and deploying simulations. Following up on our earlier report on the methodology itself, in this paper we present the results of applying this approach to assess the performance of light-wheeled vehicle mechanics. Further, we discuss the validity of the simulation developed using this methodology with respect to predicting job performance. We also discuss the benefits and limitations of this methodology and the class of tasks for which it may be best suited.
An Examination of the Effectiveness of Simulations as Performance Assessment Instruments
5 Views