Researchers have attempted to measure pilot knowledge and changes in knowledge, in both simulated and live-fly events. However, measurement in these training environments has been more successful in measuring overall flight performance outcomes rather than on underlying changes in knowledge. Research to assess changes in pilots' knowledge as a result of training is underway at the Air Force Research Laboratory (AFRL) in Mesa, Arizona, using the Pathfinder Network Scaling technique. The Pathfinder method uses individual judgments of the relationships between concepts/constructs in a domain as a basis to develop an empirically derived representation of knowledge about the concepts/constructs. These representations can be compared and changes in representation can be quantified to assess the impact of an intervention on knowledge. Previous research has demonstrated the value of Pathfinder for assessing the impact of both education and training interventions in domains such as computer programming. At AFRL, pilots, as part of a week-long 4-ship F-16 Distributed Mission Operations (DMO) training research program, participated in a Pathfinder study to asses F-16 pilot understanding of complex combat mission constructs/concepts critical to mission performance. The objective was to assess training effects that are more fundamental and process-orientated. This paper will report findings from a sample of 71 F-16 pilots who vary in experience level. Our results will be discussed both in terms of practical utility of the Pathfinder technique as a measurement methodology and in terms of knowledge measurement as a criterion for evaluating training.