Format

Send to

Choose Destination
Sensors (Basel). 2017 Feb 6;17(2). pii: E297. doi: 10.3390/s17020297.

Augmented Reality Tool for the Situational Awareness Improvement of UAV Operators.

Author information

1
Grupo de Tratamiento de Imágenes (GTI), Information Processing and Telecommunications Center (IPTC) and ETSI Telecomunicación, Universidad Politécnica de Madrid (UPM), ES-28040 Madrid, Spain. srs@gti.ssr.upm.es.
2
Grupo de Tratamiento de Imágenes (GTI), Information Processing and Telecommunications Center (IPTC) and ETSI Telecomunicación, Universidad Politécnica de Madrid (UPM), ES-28040 Madrid, Spain. ccr@gti.ssr.upm.es.
3
Robotics and Perception Group, University of Zurich, CH-8050 Zurich, Switzerland. guillermo.gallego@ifi.uzh.ch.
4
Grupo de Tratamiento de Imágenes (GTI), Information Processing and Telecommunications Center (IPTC) and ETSI Telecomunicación, Universidad Politécnica de Madrid (UPM), ES-28040 Madrid, Spain. narciso@gti.ssr.upm.es.

Abstract

Unmanned Aerial Vehicles (UAVs) are being extensively used nowadays. Therefore, pilots of traditional aerial platforms should adapt their skills to operate them from a Ground Control Station (GCS). Common GCSs provide information in separate screens: one presents the video stream while the other displays information about the mission plan and information coming from other sensors. To avoid the burden of fusing information displayed in the two screens, an Augmented Reality (AR) tool is proposed in this paper. The AR system has two functionalities for Medium-Altitude Long-Endurance (MALE) UAVs: route orientation and target identification. Route orientation allows the operator to identify the upcoming waypoints and the path that the UAV is going to follow. Target identification allows a fast target localization, even in the presence of occlusions. The AR tool is implemented following the North Atlantic Treaty Organization (NATO) standards so that it can be used in different GCSs. The experiments show how the AR tool improves significantly the situational awareness of the UAV operators.

KEYWORDS:

augmented reality; ground control station; situational awareness; tool; unmanned aerial vehicle

Supplemental Content

Full text links

Icon for Multidisciplinary Digital Publishing Institute (MDPI) Icon for PubMed Central
Loading ...
Support Center