Keywords

AI;SIMULATIONS;VERIFICATION, VALIDATION AND ACCREDITATION (VV&A)

Abstract

The processes of Verification and Validation, are foundational elements that underlie assessments of M&S credibility. Verification and Validation (V&V) activities serve to build an evidentiary chain of information upon which M&S Users and Accreditation Agents can assess the viability of an M&S for a particular application. Information derived from the V&V processes is used to shape the understanding of the conditions under which an M&S could and should be used.

While advancements in verification and validation methods for both stand alone and distributed simulations have been realized; new challenges exist as the focus shifts to AI driven simulation. This tutorial will explore these challenges and discuss both V&V solutions and gaps. Particular focus will be given to V&V issues associated with AI driven training simulations.

Topics to be covered by this tutorial will include:

• Defining basic verification and validation concepts
  • Identifying verification test strategies (e.g., leveraging information, supplemental test activities) and adapting them to various development paradigms
  • Building and applying validation referent data (what the simulation results will be compared to)
  • Defining the simulation measures and metrics to be compared
  • Selecting validation methods to apply when performing the results/referent comparison
• Defining V&V challenges associated with AI driven simulation
• Identifying applicable V&V methods and gaps for AI driven simulation
• Defining the unique V&V challenges associated with AI driven training simulations

The tutorial will enhance the learning experience by incorporating lessons learned derived from the many V&V applications with which the authors have been involved.