An Augmented Reality System for Military Operations in Urban Terrain

Many future military operations are expected to occur in urban environments. These complex, 3D battlefields intro-duce many challenges to the dismounted warfighter. Better situational awareness is required for effective operation in urban environments. However, delivering this information to the dismounted warfighter is extremely difficult. For example, maps draw a user's attention away from the environment and cannot directly represent the three-dimensional nature of the terrain. To overcome these difficulties, we are developing the Battlefield Augmented Reality System (BARS). The system consists of a wearable computer, a wireless network system, and a tracked see-through head-mounted display (HMD). The computer generates graphics that, from the user's perspective, appear to be aligned with the actual en-vironment. For example, a building could be augmented to show its name, a plan of its interior, icons to represent reported sniper locations, and the names of adjacent streets. This paper surveys the current state of development of BARS and describes ongoing research efforts. We describe four major research areas. The first is the development of an effective, efficient user interface for displaying data and processing user inputs. The second is the capability for collaboration between multiple BARS users and other systems. Third, we describe the current hardware for both a mobile and indoor prototype system. Finally, we de