A Team Mission Observation Tool (T-MOT) was developed to identify individual and team behavioral processes observed during a specialized, simulation-based program of Combat Mission Training (CMT) conducted for U.S. Air Force Special Operations Command (AFSOC) MC-130P Special Operations Forces (SOF) aircrew teams. The TMOT, its foundations, development, and purpose are described. Measurement is accomplished within the T-MOT using behaviorally anchored rating scales and subject matter expert observations of key behaviors tied to a complex CMT scenario. The T-MOT supports recording and analysis of both individual and aircrew team behaviors within five Crew Resource Management (CRM) subprocesses (time management; tactics employment; function allocation; situation awareness; and command, control, and communications) across critical mission phases. Additionally, the TMOT provides structure to direct observations of complex performances demonstrated during both mission preparation and mission execution. With this methodology, an internally consistent and reliable "record by exception" measurement philosophy for recording specific aircrew team mission behaviors demonstrated during CMT is provided.
The T-MOT is being used to address several research questions:
- Are team behaviors within one or more CRM subprocess areas related to overall mission performance?
- Which CRM subprocess areas have the greatest demonstrated impact on mission outcome?
- Is team performance related to mission outcome above the performance represented by each crew position?
- Do effective aircrew teams exhibit consistent sets of coordination behaviors that can be "captured" and designed into a CMT program?
With this assessment approach, team coordination process indices have been identified for emphasis using current CMT technologies; a schema for improving team coordination training within existing capabilities was identified; and CMT system effectiveness was assessed. Additionally, the T-MOT has demonstrated the potential to be expanded to other CMT environments with only modest modification, and can be viewed as the first step in the development of an overall team mission readiness assessment tool.