The control and/or command of multiple Uninhabited Air Vehicles (UAVs) within an actual or simulated operational theater requires an interface that allows the user to direct the actions of these UAVs in real-time. The user must, at the very least, have the capability to issue commands that apply to whole UAV groups ("swarms"), as well as the ability to narrow commands to a few or even a single UAV. The user must have the ability to create UAV groups, select and assign targets, and interactively generate and assign routes.
This paper describes an innovative interface for operators to control multiple UAVs in a combat situation. Coupled with the latest off-the-shelf input and output hardware, the software will be an intuitive, real-time, graphical, 3D environment that enhances situation awareness as much as possible without perceptual overload. This system will also be fully compatible with the Mixed Initiative Control for Automa-teams (MICA) Open Experimental Platform (OEP) multiple UAV scenario system.
To control multiple UAVs, there are specific command requirements for the UAVMI system. Relevant issues include:
1. Where and how exactly does the UAV's autonomy interface with the higher level commands coming from the UAVMI? The solution is to create (or adopt an existing) command language for the individual UAVs.
2. Define a library of "swarm-level commands". These are commands that affect groups of UAVs.
3. Address the issue of how "swarm-level commands" translate into commands to individual UAVs. For example: if the swarm-level command is for group A to attack enemy group E, then what exactly should a1 (one UAV in group A) do? Attack e1? Attack the closest element in group E? What if that target is already covered by a3?
The areas addressed include group and individual commands, path generation, relative posture, selection methods, viewpoint navigation, and information displays.