Multimodal deep learning for Alzheimer's disease dementia assessment

Nat Commun. 2022 Jun 20;13(1):3404. doi: 10.1038/s41467-022-31037-5.

Abstract

Worldwide, there are nearly 10 million new cases of dementia annually, of which Alzheimer's disease (AD) is the most common. New measures are needed to improve the diagnosis of individuals with cognitive impairment due to various etiologies. Here, we report a deep learning framework that accomplishes multiple diagnostic steps in successive fashion to identify persons with normal cognition (NC), mild cognitive impairment (MCI), AD, and non-AD dementias (nADD). We demonstrate a range of models capable of accepting flexible combinations of routinely collected clinical information, including demographics, medical history, neuropsychological testing, neuroimaging, and functional assessments. We then show that these frameworks compare favorably with the diagnostic accuracy of practicing neurologists and neuroradiologists. Lastly, we apply interpretability methods in computer vision to show that disease-specific patterns detected by our models track distinct patterns of degenerative changes throughout the brain and correspond closely with the presence of neuropathological lesions on autopsy. Our work demonstrates methodologies for validating computational predictions with established standards of medical diagnosis.

Publication types

  • Research Support, Non-U.S. Gov't
  • Research Support, N.I.H., Extramural

MeSH terms

  • Alzheimer Disease* / diagnostic imaging
  • Alzheimer Disease* / psychology
  • Cognitive Dysfunction* / diagnosis
  • Cognitive Dysfunction* / pathology
  • Deep Learning*
  • Disease Progression
  • Humans
  • Neuroimaging / methods