Keywords
BEST PRACTICES;M&S;VERIFICATION, VALIDATION AND ACCREDITATION (VV&A)Learning Objective 1
Identify the components required to accredit the models and simulations (M&S) for a Simulation-Based Experiment (SIMEXp) in accordance with the framework for the validation of a SIMEXpLearning Objective 2
Identify the components required to accredit the tactical and operational scenarios in accordance with the framework for the accreditation for a SIMEXpLearning Objective 3
Identify the components required to accredit the physical and computational environmentLearning Objective 4
Identify the components required to accredit the analytical process of a SIMEXp in accordance with the framework for the accreditation of a SIMEXpAbstract
The Department of the Army has no individual or organization that accredits a simulation-based experiment (SIMEXp). Army Regulations require that modeling and simulation (M&S) be accredited – but none of the other components required to execute a SIMEXp. Each of the Army’s Centers of Excellence (maneuver, fires, air maneuver, maneuver support, sustainment and heath readiness) conduct multiple SIMEXp annually- the Maneuver Battle Lab alone averages eight to ten per year, but no outside agency or regulation accredits the events. The purpose of this tutorial is to present a framework for SIMEXp accreditation and enable attendees to understand all of the areas which must be accredited for the overall accreditation of a SIMEXp. Accreditation of the M&S will be discussed, as it serves as the foundation for an overall accreditation, but there are other equally important components requiring separate accreditations. After participating in the tutorial, attendees will be able to identify the components of tactical and operational scenarios which must be validated by current warfighters – and that the person who accredits those aspects must have credible knowledge of the current state of doctrine, military organizations, and operational concepts (friendly and enemy) to be studied.
The tutorial will address that the US Army’s regulatory accreditation of the M&S does not addresses the accreditation of the physical and computational environment on which the SIMEXp is conducted. Not only must the M&S be accredited, but also the hardware and network on which they are running to ensure processors are robust enough to execute as required, the network transmission speeds are sufficient, and no packets are lost during execution.
Finally, attendees will learn how to design and assess the analytical methods used during a SIMEXp to ensure accreditation of the analysis of the SIMEXp. The analysis plan, data collection and reduction methodology, and computational methods for analyzing the data must all be documented and accredited in a peer-reviewed final report in order for the overall SIMEXp to be accredited. This tutorial is intended for those interested in gaining a better understanding of proper SIMEXp design and why more than just the M&S must be accredited. Following previous presentations of this tutorial at I/ITSEC, the methodology has been recommended for inclusion in the pending update to the US Army Pamphlet 5-11, Verification, Validation, and Accreditation of Army Models and Simulations, and presented as a block of instruction to the US Army Modeling and Simulation School Simulation Operations and VV&A Courses.