U.S. Army Aviation organically teams rotary wing aircraft with Unmanned Aircraft Systems (UAS) as a force multiplier in combat operations. Clear and effective communications between the teamed airborne helicopter pilot and the UAS operator in the ground control station are critical for mission success. Current Army flight training for pilots vs. UAS operators reveals differences in the time spent on reconnaissance, surveillance, and target acquisition (RSTA) skills, contributing to variance in tactical communication proficiencies. Previous studies have recommended additional training in tactical communications for the UAS sensor operator in order to support communications accuracy, protocol adherence, and measured timeliness in teaming engagements.
This paper describes the architecture, development challenges, and usability assessment for a single player, browser-based game designed for UAS sensor operators to practice mannedunmanned team (MUM-T) communications skills. Speech recognition features utilizing natural language processing and communications performance measurement were developed. Real-time audio feedback was provided to soldiers during communications with virtual game entities. Access to remediation and cumulative performance scoring was available via after action reviews (AARs).
The training system is comprised of the following key elements: a UAS simulation platform, commercial speech recognition, natural language parsing system, human performance measurement system, communications performance measures, and UAS mission scenarios. Challenges addressed in this project include: management of the dialog state vs. scenario context between the trainee and synthetic entities during speech recognition; design and implementation of communications measures based on pattern and vocabulary matching synchronized to simulation events; and the development of context sensitive feedback to guide the trainee based on measurement results.
An initial user assessment was conducted at Ft. Huachuca AZ with eight Advanced Individual Training soldiers and qualified UAS course instructors. Subjective ratings related to usability and game applicability were collected. Preliminary results suggest perceived benefit from gameplay supplementing current methods of instruction.