At the Norwegian Defence Research Establishment (FFI) we have been experimenting with simulated Augmented Reality (AR) since 2006. We have used virtual environments to evaluate the benefit of AR functionality in combination with a Battlefield Management System (BMS) in combat vehicles. Three experiments have been carried out with professional combat-vehicle crews playing through relevant scenarios in virtual environments. The data collected from these experiments, including quantitative measurements, feedback from the users through questionnaires and after-action review, and observations of how the system was applied, is being used in the ongoing process of designing a real AR system for combat vehicles.

Initially our experiments with simulated AR were conducted using an in-house developed combat vehicle-simulator based on the commercial game Unreal Tournament 2004 (UT2004). Later, Virtual Battlespace 2 (VBS2) has taken over as our primary simulation platform for experimentation with simulated AR.

Our simulated AR system is designed for use in combat vehicles like infantry fighting vehicles and main battle tanks. It works in conjunction with an experimental BMS, also developed at FFI, and visualizes information like Blue-Force Tracking, observations and waypoints, in the form of graphical symbols in the sights and periscopes of the commander, gunner, and driver. This enables the vehicle crew to better exploit the BMS information while keeping their eyes fixed on what is going on in the battlefield. The AR system also makes the BMS information more intuitive. Basic input to the BMS can be given as simple voice commands.

In this paper we describe the simulated AR system and the experiments we have conducted. We also present the most important results from the experiments and the lessons learned from developing and working with a simulated AR system, which has served as a virtual prototype and a technology demonstrator.