In order to ensure the validity of a warfighting experiment, the experimenter must be able to detect change, isolate its cause, and relate experimentation results to real-world (combat) operations. Constructive simulation experiments (SIMEXps) with multiple runs are ideal to detect change and to isolate its cause. However, because modeling complex events requires many assumptions, critics often question the applicability of constructive simulation results to operational situations. This is juxtaposed by command-and-control human in the loop (HITL) experiments in which military staffs receive real-time, simulated sensor inputs, make real-time decisions and direct simulated friendly forces against simulated threat forces. The use of actual military operators and staffs allows this type of experiment to reflect warfighting decision-making better than purely closed-loop constructive experiments thus increasing the applicability to real world operations. However, when humans make decisions, variability increases, and changes are more difficult to detect. The Maneuver Battle Lab (MBL) uses a hybrid approach to SIMEXps to capitalize on the strengths of both the closed loop constructive and HITL approaches, while minimizing the weaknesses of each technique. The MBL uses operational force military role players (MRPs) to replicate staffs during HITL SIMEXps to ensure applicability to real-world operations. The tactics developed by these MRPs – during several replications per case – are then scripted into the simulation scenario and replicated in a constructive (or closed loop) manner for the required number of times to ensure statistical significance. The hybrid approach described in this paper provides a means for other organizations conducting military experimentation to increase the validity of their constructive experiments, while simultaneously increasing the real-world applicability of their experiments. Ultimately, this paper will provide a means to increase both qualitative and qualitative analysis to help substantiate outcomes. The paper will include previously conducted use cases, potential uses of the hybrid approach, and areas for continued development.

Keywords
ANALYTICS, BEST PRACTICES, CONSTRUCTIVE, EXPERTISE, FRAMEWORK, ROI, STATISTICS, VERIFICATION, VALIDATION AND ACCREDITATION (VV&A)

Additional Keywords