The evaluation of trainees and aircrews requires highly trained subject matter experts (SMEs) to assess current performance and recommend future training that is optimized for each individual. An increasing volume of data generated from today’s training environments makes a comprehensive and consistent trainee assessment impractical for the instructors, if not impossible. In addition, training facilities are faced with a shortage of qualified SMEs and instructors, which reduces time for properly assessing individual performance even more.
We fight as we train. Unsatisfactory trainee assessment and missing individual training recommendations inevitably yield warfighters that are not proficient enough for the 21st century military operating environment.
To relieve instructors from routine tasks and to support training facilities, we have designed the Fleet Operational eXercise Training for Warfighter Optimization (FOX TWO) system. FOX TWO ingests training data, calculates and visualizes predetermined Measures of Performance, and then provides individually adjusted training recommendations. The automated computation of performance metrics allows instructor to provide more immediate and consistent performance assessment, while freeing up time to focus on more advanced evaluation and feedback. FOX TWO includes a training data store that allows training facilities and instructors to track trainees throughout their career, and to identify when a skill is mastered and how often trainees need to practice that skill to stay proficient.
This paper presents results from working with Naval Aviation, including concept design for adaptive data storage and retrieval, flexible data analysis mechanisms and validation through prototype implementation and human subject experimentation. Human subject experimentation to verify FOX TWO’s capabilities to make individual training recommendations included 20 aircrew trained, 100+ simulator events executed with 700+ scenario executions that resulted in 7+ GB of training data collected.