Healthcare training utilizes a variety of educational techniques to impart the necessary knowledge, skills, and abilities, including classroom instruction, medical mannequins, part-task trainers, and recently mixed reality simulations. Simulations employing augmented and virtual reality (AR/VR), often called mixed reality, provide users with an engaging and immersive visual experience. Typically, computer models and animation are used to create the virtual component in these environments. However, these techniques often require extensive time, resources, and expertise to create virtual objects with sufficient visual and behavioral fidelity. A novel technique to augment existing computer graphics is the use of volumetric video. Volumetric video begins with the capture of an object or person from multiple viewing positions using multiple cameras. The output is a 3D, or volumetric, video which can be inserted into a mixed reality scene. Within this manuscript, a research effort integrating volumetric video with both virtual and augmented reality head-mounted displays will be discussed. The effort included the volumetric captures of tactical combat casualty care instruction, which were integrated into a series of virtual and augmented simulations. Results from an initial user test focusing on user perceptions of the volumetric video will be presented, as well as future research avenues and potential applications in other simulation and training domains. Healthcare training utilizes a variety of educational techniques to impart the necessary knowledge, skills, and abilities, including classroom instruction, medical mannequins, part-task trainers, and recently mixed reality simulations. Simulations employing augmented and virtual reality (AR/VR), often called mixed reality, provide users with an engaging and immersive visual experience. Typically, computer models and animation are used to create the virtual component in these environments. However, these techniques often require extensive time, resources, and expertise to create virtual objects with sufficient visual and behavioral fidelity. A novel technique to augment existing computer graphics is the
Volumetric Video and Mixed Reality for Healthcare Training
Conference
I/ITSEC 2021
Track
Emerging Concepts and Innovative Technologies
6 Views