Format

Send to

Choose Destination
Neuroimage. 2017 Mar 1;148:77-102. doi: 10.1016/j.neuroimage.2016.12.064. Epub 2017 Jan 11.

Longitudinal multiple sclerosis lesion segmentation: Resource and challenge.

Author information

1
Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA. Electronic address: aaron_carass@jhu.edu.
2
CNRM, The Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD 20892, USA.
3
Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA.
4
Department of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
5
Department of Biostatistics, The Johns Hopkins University, Baltimore, MD 21205, USA.
6
Translational Imaging Group, CMIC, UCL, NW1 2HE London, UK; NMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
7
Translational Imaging Group, CMIC, UCL, NW1 2HE London, UK.
8
Translational Imaging Group, CMIC, UCL, NW1 2HE London, UK; Dementia Research Centre, UCL Institute of Neurology, WC1N 3BG London, UK.
9
NMR Research Unit, UCL Institute of Neurology, WC1N 3BG London, UK.
10
VisAGeS: INSERM U746, CNRS UMR6074, INRIA, University of Rennes I, France.
11
Computational Radiology Laboratory, Boston Childrens Hospital, Boston, MA 02115, USA; Harvard Medical School, Boston, MA 02115, USA.
12
Biomedical Imaging Lab, Department of Engineering Design, Indian Institute of Technology, Chennai 600036, India.
13
Centre For Intelligent Machines, McGill University, Montréal, QC H3A 0E9, Canada.
14
Institute of Medical Informatics, University of Lübeck, 23538 Lübeck, Germany.
15
Bahçeşehir University, Faculty of Engineering and Natural Sciences, 34349 Beşiktaş, Turkey.
16
icometrix, 3012 Leuven, Belgium.
17
Institute for Computing and Information Sciences, Radboud University, 6525 HP Nijmegen, Netherlands.
18
Diagnostic Image Analysis Group, Radboud University Medical Center, 6525 GA Nijmegen, Netherlands.
19
Department of Electrical Engineering, Tel-Aviv University, Tel-Aviv 69978, Israel.
20
Department of Biomedical Engineering, Tel-Aviv University, Tel-Aviv 69978, Israel.
21
Department of Neurophysics, Max Planck Institute, 04103 Leipzig, Germany.
22
Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Electrical and Computer Engineering, University of Iceland, 107 Reykjavík, Iceland.
23
Department of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA; Translational Neuroradiology Unit, National Institute of Neurological Disorders and Stroke, Bethesda, MD 20892, USA.
24
Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA.

Abstract

In conjunction with the ISBI 2015 conference, we organized a longitudinal lesion segmentation challenge providing training and test data to registered participants. The training data consisted of five subjects with a mean of 4.4 time-points, and test data of fourteen subjects with a mean of 4.4 time-points. All 82 data sets had the white matter lesions associated with multiple sclerosis delineated by two human expert raters. Eleven teams submitted results using state-of-the-art lesion segmentation algorithms to the challenge, with ten teams presenting their results at the conference. We present a quantitative evaluation comparing the consistency of the two raters as well as exploring the performance of the eleven submitted results in addition to three other lesion segmentation algorithms. The challenge presented three unique opportunities: (1) the sharing of a rich data set; (2) collaboration and comparison of the various avenues of research being pursued in the community; and (3) a review and refinement of the evaluation metrics currently in use. We report on the performance of the challenge participants, as well as the construction and evaluation of a consensus delineation. The image data and manual delineations will continue to be available for download, through an evaluation website2 as a resource for future researchers in the area. This data resource provides a platform to compare existing methods in a fair and consistent manner to each other and multiple manual raters.

KEYWORDS:

Magnetic resonance imaging; Multiple sclerosis

PMID:
28087490
PMCID:
PMC5344762
DOI:
10.1016/j.neuroimage.2016.12.064
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Elsevier Science Icon for PubMed Central
Loading ...
Support Center