Army Research Institute's Aircrew Coordination Training Enhancement (ACTE) effort promotes applied research and development of a distance learning delivered, interactive aircrew coordination training system. The goal of this three-phase program is to provide Army aircrews deployed worldwide with the knowledge and skill-sets needed to increase safety and mission performance in daily operations. Research products from the two completed phases include prototype courseware and training materials. This paper describes Phase III research methods, performance measures and web-based data collection systems that were developed to evaluate the effects of distance learning delivered ACTE materials on safety and mission performance in operational units. The research design included three operational units: one receiving no training, the second receiving traditional classroom instruction, and the third receiving training using the Army's Classroom XXI linked to the unit's local Digital Training Facility. Measures included (1) reported completion, delay or aborted mission segments related to performance of crew coordination objectives and, (2) accident, incident or error reduction reports citing crew coordination as a factor. Data collection methods included a combination of Likert type scales, questionnaires, and a web-based mission performance and incident feedback program. The measures and methods used to quantify the effectiveness of distance learning delivery on operational unit safety and mission performance may be applied to other training systems.