Modeling, Simulation, and Analysis (MS&A) supports a wide range of economic, academic and governmental efforts. Many MS&A communities have agreed on methodology within their field. However, there is little interaction among communities. As a result, best practices in one MS&A community may be unfamiliar to others. This paper describes the Modeling Best Practices Benchmarking Project – an effort to identify modeling practices among professionals who might not otherwise gain insight outside their own communities. Practitioners from many disciplines volunteered to describe their practices and learn from others. The goals were to understand best practices across industries and disciplines and define best practices as a set of standards which apply broadly. From the interview and survey topics, we developed a check list of 14 best practices for those doing MS&A. We also developed three other check lists of risk factors for some specific MS&A topics. Eventually we identified four best practitioners, all of whom impressively addressed the 14 best practices. Two agreed to be named in our work: The U.K. Metrology Office, and the U.S. Energy Information Agency. The paper will present a sample of the results along with the best practices identified. An example of the results: most respondents did not know regulatory or statutory standards applicable to their work; most did not use processes important to high integrity MS&A. This is a contrast to exemplars.
Best Practices in Modeling and Simulation; Multi-Community Benchmarking
6 Views