Model Verification and Validation for Rapidly Developed Simulation Models: Balancing Cost and Theory

Much of the model verification and validation (V&V) guidance and literature are useful for explaining the principles of V&V and how V&V is ideally integrated into the simulation model development life cycle. There is less information available, however, on how to execute V&V, especially, as is often the case, when the resource commitment for V&V is limited. There are few examples that illustrate concrete application of the available V&V techniques or discuss the tradeoffs between theory and cost that are often made. This paper describes the V&V approach used to develop several low-resolution multi-purpose simulations of integrated industrial facilities and industrial sectors for a government customer. These projects were characterized by: (i) the need to deploy each simulation model within a 60- or 120-day period; (ii) the need to utilize a commercial-off-the-shelf system dynamics software application; and (iii) heavy reliance on subject matter expert input to assess real-world fidelity. Furthermore, V&V had to be performed with little guidance at the outset as to what the acceptability criteria would be and V&V budgets of no more than 8 to 10 percent of the total project cost. Consequently, while the V&V efforts conducted for these projects were built upon the “what and why ” guidance outlined in the customer’s policies and in such documents as the Defense Modeling and Simulation Office’s Verification, Validation, and Accreditation Recommended Practices Guide, tradeoffs had to be made in developing an efficient “how to