A wide variety of emerging visual simulation applications require automated methods for digitizing the real-world in 3D form. Examples include movie/film production, architectural visualization, Internet-based electronic commerce, game development, and virtual reality mission rehearsal for military and emergency services operations. The DoD in particular requires systems capable of acquiring entire urban areas in 3D form within hours, versus the months required using conventional modeling techniques. This paper describes a developmental system designed to address these needs by processing video imagery of an object or scene into 3D graphics models suitable for insertion into a wide variety of standard modeling and simulation tools.
In its final form, the system will consist of a motion imager equipped with a miniature instrument package containing GPS and inertial sensors. Signal processing and image processing algorithms will process this combination of imagery and positional data into a complete 3D model of the imaged scene, tagged with geodetic metadata. The system will be suitable for ad-hoc use with a commercial camcorder, or for automated data collection using unmanned aerial vehicle platforms. It will make maximum use of emerging NIMA standards for imagery and metadata to facilitate integration within any application requiring high-resolution urban terrain digitization.
In order to maximize commercial applicability, the core algorithms are designed to function as a software pipeline without instrument assist, using camcorder imagery. This configuration was demonstrated in the R&D Rodeo at I/ITSEC 98, and a refined version intended for commercial sale will be demonstrated at I/ITSEC 99. The current implementation effectively captures fully textured 3D models of individual buildings and similar cultural features. A key conclusion reached to date is demonstrating that fully automated 3D capture using only passive imaging techniques is feasible.
The research and development effort described in this paper is supported by ongoing Phase II SBIR contracts awarded by US Marine Corps Amphibious Warfare Division/NAWCTSD, DARPA, and Air Force Rome Laboratories.