Understanding the experimental design process is fundamental to conducting efficient and effective tests and model and simulation experiments. This tutorial aims to provide a comprehensive understanding of the test design process, with practical examples and demonstrations. Our goal is to provide you with the skills to create a good test design and effectively communicate statistical results in reports.

The tutorial begins with an introduction that explores the test design framework and explains the concept and purpose of experimental design. We then delve into the various aspects of planning, design selection and evaluation, and the analysis of an experimental design. Within the planning phase, we cover the essential elements such as identifying test objectives, response variables, and factor selection.  We then provide an overview of different types of experimental designs and their purpose. In evaluating a test design, we discuss important metrics like power and confidence that are used to ensure adequate data collection and assess the quality of the design. Lastly, we cover some best practices for analysis and reporting, such as avoiding data “roll-ups”, incorporating interval estimates, and utilizing high-level graphical summaries to effectively communicate the results.  

By the end of the tutorial, you will have gained a better understanding of the test design process and will be equipped with valuable insights and techniques for creating and analyzing experimental designs

Keywords