Format

Send to:

Choose Destination
See comment in PubMed Commons below
Neuroimage. 2014 Aug 15;97:41-52. doi: 10.1016/j.neuroimage.2014.04.027. Epub 2014 Apr 13.

Reliability of functional magnetic resonance imaging activation during working memory in a multi-site study: analysis from the North American Prodrome Longitudinal Study.

Author information

  • 1University of California, Los Angeles, Los Angeles, CA, United States.
  • 2University of Calgary, Calgary, Alberta, Canada.
  • 3University of California, San Diego, San Diego, CA, United States.
  • 4Zucker Hillside Hospital, Great Neck, NY, United States.
  • 5University of California, San Francisco, San Francisco, CA, United States.
  • 6Yale University, New Haven, CT, United States.
  • 7University of North Carolina, Chapel Hill, Chapel Hill, NC, United States.
  • 8Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, MA, United States.
  • 9University of California, Irvine, Irvine, CA, United States.
  • 10Emory University, Atlanta, GA, United States.
  • 11Yale University, New Haven, CT, United States. Electronic address: tyrone.cannon@yale.edu.

Abstract

Multi-site neuroimaging studies offer an efficient means to study brain functioning in large samples of individuals with rare conditions; however, they present new challenges given that aggregating data across sites introduces additional variability into measures of interest. Assessing the reliability of brain activation across study sites and comparing statistical methods for pooling functional data are critical to ensuring the validity of aggregating data across sites. The current study used two samples of healthy individuals to assess the feasibility and reliability of aggregating multi-site functional magnetic resonance imaging (fMRI) data from a Sternberg-style verbal working memory task. Participants were recruited as part of the North American Prodrome Longitudinal Study (NAPLS), which comprises eight fMRI scanning sites across the United States and Canada. In the first study sample (n=8), one participant from each home site traveled to each of the sites and was scanned while completing the task on two consecutive days. Reliability was examined using generalizability theory. Results indicated that blood oxygen level-dependent (BOLD) signal was reproducible across sites and was highly reliable, or generalizable, across scanning sites and testing days for core working memory ROIs (generalizability ICCs=0.81 for left dorsolateral prefrontal cortex, 0.95 for left superior parietal cortex). In the second study sample (n=154), two statistical methods for aggregating fMRI data across sites for all healthy individuals recruited as control participants in the NAPLS study were compared. Control participants were scanned on one occasion at the site from which they were recruited. Results from the image-based meta-analysis (IBMA) method and mixed effects model with site covariance method both showed robust activation in expected regions (i.e. dorsolateral prefrontal cortex, anterior cingulate cortex, supplementary motor cortex, superior parietal cortex, inferior temporal cortex, cerebellum, thalamus, basal ganglia). Quantification of the similarity of group maps from these methods confirmed a very high (96%) degree of spatial overlap in results. Thus, brain activation during working memory function was reliable across the NAPLS sites and both the IBMA and mixed effects model with site covariance methods appear to be valid approaches for aggregating data across sites. These findings indicate that multi-site functional neuroimaging can offer a reliable means to increase power and generalizability of results when investigating brain function in rare populations and support the multi-site investigation of working memory function in the NAPLS study, in particular.

Copyright © 2014 Elsevier Inc. All rights reserved.

KEYWORDS:

G-theory; Multi-site; Reliability; Working memory; fMRI

PMID:
24736173
[PubMed - indexed for MEDLINE]
PMCID:
PMC4065837
[Available on 2015-08-15]
PubMed Commons home

PubMed Commons

0 comments
How to join PubMed Commons

    Supplemental Content

    Full text links

    Icon for Elsevier Science
    Loading ...
    Write to the Help Desk