Keywords
AI;SIMULATIONS;VERIFICATION, VALIDATION AND ACCREDITATION (VV&A)Abstract
The processes of Verification and Validation, are foundational elements that underlie assessments of M&S credibility. Verification and Validation (V&V) activities serve to build an evidentiary chain of information upon which M&S Users and Accreditation Agents can assess the viability of an M&S for a particular application. Information derived from the V&V processes is used to shape the understanding of the conditions under which an M&S could and should be used.
While advancements in verification and validation methods for both stand alone and distributed simulations have been realized; new challenges exist as the focus shifts to AI driven simulation. This tutorial will explore these challenges and discuss both V&V solutions and gaps. Particular focus will be given to V&V issues associated with AI driven training simulations.
Topics to be covered by this tutorial will include:
- Defining basic verification and validation concepts
- Identifying verification test strategies (e.g., leveraging information, supplemental test activities) and adapting them to various development paradigms
- Building and applying validation referent data (what the simulation results will be compared to)
- Defining the simulation measures and metrics to be compared
- Selecting validation methods to apply when performing the results/referent comparison
- Defining V&V challenges associated with AI driven simulation
- Identifying applicable V&V methods and gaps for AI driven simulation
- Defining the unique V&V challenges associated with AI driven training simulations
The tutorial will enhance the learning experience by incorporating lessons learned derived from the many V&V applications with which the authors have been involved.