Researchers at the Naval Air Warfare Center Training Systems Division (NAWCTSD) have developed multiple instructor aides for performance measurement hosted on hand-held computers. The initial prototype, Shipboard Mobile Aide for Training and Evaluation (ShipMATE), provides instructors with an automated tool for presenting pre-brief information, collecting data and conducting a debrief utilizing the Team Dimensional Training strategy. This tool was originally presented in 1997. Since then, additional training and evaluation software applications have been developed for Air, Surface, Ground, and Sub-Surface domains in both classroom and operational settings. We refer to the set of available performance measurement tools, which can be loaded onto a hand-held device in any combination, as MATE. The applications on MATE have been tailored to accommodate various performance measurement methodologies, including outcome and process measures, aimed at capturing individual and team performance. Examples of screen designs will illustrate how each software tool is a unique combination of tools such as embedded checklists, a scrolling scenario script window, data tagging buttons, organizational tabs, voice recording, digital handwriting, instructor cueing, links to embedded systems and networking of multiple hand-held devices.

This paper will review the multiple tools that have been developed and present suggested utilization of the optional screen functions. The value added by each function will be discussed as well as the viability of this technology in various operational settings including sea trials aboard AEGIS ships and field operations during Army exercises. Finally, guidelines for developing hand-held instructor aides for future training systems will be summarized.