Emergency, Pictogram-Based Augmented Reality Medical Communicator Prototype Using Precise Eye-Tracking Technology

Cyberpsychol Behav Soc Netw. 2019 Feb;22(2):151-157. doi: 10.1089/cyber.2018.0035. Epub 2019 Jan 7.

Abstract

This article details the process involved in the development of a new and revolutionary solution for medical communication. Our solution precisely tracks head and eye movement and allows the user to interact with an intuitive, pictogram-based interface. Around the world, many people rely on written instruction and verbal or nonverbal communication to accompany medication or provide additional information on a patient's symptoms. However, poor language skills and a host of health problems, psychological disorders, and trauma can limit a person's ability to speak or move. Our solution could drastically improve the quality of life of patients suffering from brain injury, hearing loss, and many other communication disorders and disabilities. They can begin to communicate with greater ease and fluency, feel connected to the world, and experience better and more accurate medical care. The potential applications have many incredible advantages, ranging from improved communication with family to emergency medical uses that can save the life of an affected individual. The use of augmented reality in our solution, as well as the secondary camera to improve accuracy in eye tracking, makes this solution for more accuracy, whereas the inclusion of a pictogram-based interface makes it a practical solution that cuts down on the error margins of traditional accessibility devices and makes it equally accessible to children and speakers of foreign languages. According to the data gathered, we confirm that the solution we propose has many possible practical applications in improving the health, safety, and quality of life of the user.

Keywords: communicator; eye tracking; pictograms.

MeSH terms

  • Adolescent
  • Adult
  • Aged
  • Child
  • Communication*
  • Disabled Persons*
  • Emotions
  • Eye Movements*
  • Female
  • Humans
  • Language
  • Male
  • Mental Disorders
  • Middle Aged
  • Quality of Life*
  • User-Computer Interface*
  • Young Adult