Next-generation tools have the potential to significantly enhance our abilities to perform tasks in the real world. However, since early prototypes of such tools are at an early experimental stage, they are not yet ready to be used or fully tested. Even when the prototypes are refined, it can be difficult to evaluate and optimize their use in the context for which they will be deployed. To propel tool development, evaluation, and usage, we are leveraging virtual reality (VR) technologies to efficiently test simulated prototypes of new tools in virtual environments that simulate the context in which they will be used.

Whereas consumer VR systems can support scenarios that are quite visually and aurally realistic, most of today’s VR hardware is lacking when it comes to using physical tools. This shortfall is especially critical when simulating real-world user interfaces and the real physical world we work in. We describe here how we are enhancing (and evaluating) VR interfaces and simulated immersive environments with realistic physical cues for firefighters, law enforcement, and paramedics. Work includes integrating physicality into VR simulations by building customized tracked devices and evaluating how adding such physicality to VR results in performance closer to real world performance.