Keywords: VERIFICATION, VALIDATION AND ACCREDITATION (VV&A)
Additional Keywords not in the list above: Models, Simulations, Distributed Simulation, Agile, Autonomous, AI
Learning Objective 1: Select between verification test strategies
Learning Objective 2: Construct an effective referent in non-ideal circumstances
Learning Objective 3: Recognize the key elements (metrics, methods) that support rigorous validation
Learning Objective 4: Match validation methods to the available referent
Learning Objective 5: Determine the unique V&V challenges applied to Agile and Autonomous based M&S
Abstract:
The processes of Verification and Validation, are foundational elements that underlie assessments of M&S credibility. Verification and Validation (V&V) activities serve to build an evidentiary chain of information upon which M&S Users and Accreditation Agents can assess the viability of an M&S for a particular application. Information derived from the V&V processes is used to shape the understanding of the conditions under which an M&S could and should be used.
While V&V is founded on basic software engineering principles, implementation is often constrained by resources, whether these resources be time, money, personnel, or information. This tutorial will address the key steps that can be taken to build strong V&V evidence while accounting for resource impacts. The tutorial will incorporate lessons learned derived from multiple V&V applications.
Topics to be covered by this tutorial will include:
- Requirements traceability that provides the link between requirements and V&V testing
- Identifying verification test strategies (e.g., leveraging information, supplemental test activities) and adapting them to various development paradigms
- Building and applying validation referent data (what the simulation results will be compared to)
- Defining the simulation measures and metrics to be compared
- Selecting validation methods to apply when performing the results/referent comparison
- Documentation templates and tools that provide efficiency of process to the V&V effort
- V&V as it applies to other A’s: Agile and Autonomous
The tutorial will enhance the learning experience by incorporating lessons learned derived from the many V&V applications with which the authors have been involved.