The standards for the interoperability of networked defense simulations, also known as the Distributed Interactive Simulation (DIS) standards, have been prototyped, implemented, and put to the test through interoperability demonstrations at I/ITSEC '92 and I/ITSEC '93 conferences as well as in military programs such as Warbreaker, BFTT, and CCTT. To achieve interoperability between the various DIS systems, all systems must implement the same agreed-to criteria. To ensure that this occurred for the demonstrations at the previous I/ITSEC conferences, the Institute for Simulation and Training (IST) was tasked with testing each system for its level of conformance with the criteria, i.e. parts of the DIS Protocol Data Unit (PDU) draft standard and the Communication Architecture for DIS (CADIS) draft standard. To perform this testing, IST created the DIS Testbed.
This paper describes the DIS Testbed, which consists of hardware equipment, test tools, and test documents, and the test methodologies used for testing. For the I/ITSEC DIS demonstrations a system could be tested in—house at IST, via long-haul connection over phone lines, or on-site at the organization's location. The test methodology used by IST uses a Capabilities Statement filled out for the System Under Test (SUT) and tests the SUT based on its stated capabilities. The tests are outlined in detail in the Test Procedures document. Data from tests is logged with data recording tools and then analyzed to determine if the data is correct. Results from the tests are recorded on a Results Sheet, which is updated for retesting or continuation of tests. A Summary Sheet is filled out when testing is completed and sent to the organization for their review.