Recognition of the need for aircrew coordination training has led to the development of a number of military and commercial aircrew coordination programs in recent years. The effectiveness of such programs is unclear, however, due to a general lack of training effectiveness data. The purpose of this paper is to present a set of guidelines and recommendations for evaluating aircrew coordination effectiveness in the military. The evaluation plan presented here is drawn from an effort by the Naval Training Systems Center to develop aircrew coordination training for Navy and Marine pilots. Drawing from past work in program evaluation, training effectiveness, and aircrew coordination, this evaluation plan has a number of distinguishing features, including: a) multiple levels of evaluation criteria, b) pre-training assessment, c) recognition of evaluation needs throughout the design cycle, and d) outcome data that can be used for multiple purposes. Such a comprehensive evaluation approach is necessary to ensure that mission safety and effectiveness are increased, and training resources optimized.