Other people's gaze encoded as implied motion in the human brain

Proc Natl Acad Sci U S A. 2020 Jun 9;117(23):13162-13167. doi: 10.1073/pnas.2003110117. Epub 2020 May 26.

Abstract

Keeping track of other people's gaze is an essential task in social cognition and key for successfully reading other people's intentions and beliefs (theory of mind). Recent behavioral evidence suggests that we construct an implicit model of other people's gaze, which may incorporate physically incoherent attributes such as a construct of force-carrying beams that emanate from the eyes. Here, we used functional magnetic resonance imaging and multivoxel pattern analysis to test the prediction that the brain encodes gaze as implied motion streaming from an agent toward a gazed-upon object. We found that a classifier, trained to discriminate the direction of visual motion, significantly decoded the gaze direction in static images depicting a sighted face, but not a blindfolded one, from brain activity patterns in the human motion-sensitive middle temporal complex (MT+) and temporo-parietal junction (TPJ). Our results demonstrate a link between the visual motion system and social brain mechanisms, in which the TPJ, a key node in theory of mind, works in concert with MT+ to encode gaze as implied motion. This model may be a fundamental aspect of social cognition that allows us to efficiently connect agents with the objects of their attention. It is as if the brain draws a quick visual sketch with moving arrows to help keep track of who is attending to what. This implicit, fluid-flow model of other people's gaze may help explain culturally universal myths about the mind as an energy-like, flowing essence.

Keywords: gaze; motion perception; social cognition; theory of mind; visual attention.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Attention / physiology*
  • Female
  • Fixation, Ocular / physiology*
  • Healthy Volunteers
  • Humans
  • Magnetic Resonance Imaging
  • Male
  • Middle Aged
  • Parietal Lobe / diagnostic imaging
  • Parietal Lobe / physiology*
  • Photic Stimulation
  • Social Behavior
  • Temporal Lobe / diagnostic imaging
  • Temporal Lobe / physiology*
  • Theory of Mind
  • Visual Perception / physiology*
  • Young Adult