Keywords: AUGMENTED AND VIRTUAL REALITY (AR/VR);COMMUNICATIONS;DATA;FUSION ;MIXED REALITY;RADIOS;SPATIAL ABILITY;VISUALIZATION
Additional Keywords not in the list above: spectrum, TSCM
Learning Objective 1: Understand challenges of existing tooling for RF data modeling and analysis.
Learning Objective 2: Comprehend fundamentals and usage of AR/VR/XR for signal intelligence, visualization, and military communications.
Learning Objective 3: Identify best practices and applied theory to the design of next-generation signal analysis user interfaces.
Abstract:
We are surrounded by invisible radio frequency signals used for communications, navigation, and even health. Traditionally, we see these signals through spectrum analyzers. However, the capabilities of existing analysis tools are being outpaced by the rapid modernization of wireless networks and topologies like 5G, IoT, Bluetooth, LoRa, Starlink, etc. RF is inherently multidimensional, but conventional analyzers display signals in 2D slices, limiting real-world applicability to highly technical users. Emerging technology that combines Mixed Reality displays and AI/ML algorithms is now capable of spatializing radio emissions at their natural 3D location for easier understanding and communication.
This tutorial will convey the evolution of RF visualization tools from flat interfaces to immersive ones that can be used to discover and map RF signals and networks. The audience will gain a broad understanding of the emergence of holographic interfaces and how they can be applied successfully to spatial data visualization. Building upon proven UI/UX principles, we will walk participants through challenges with the design and development process, theory behind decisions, and usability issues to overcome in actual deployments. Resulting best practices will be shared openly. Finally, the audience will learn about future applications of these tools and upcoming innovations in the emerging field.
