Format

Send to

Choose Destination
Bioinformatics. 2016 Jun 15;32(12):i52-i59. doi: 10.1093/bioinformatics/btw252.

Classifying and segmenting microscopy images with deep multiple instance learning.

Author information

1
Department of Electrical and Computer Engineering, University of Toronto, Toronto, M5S 2E4, Canada The Donnelly Centre for Cellular and Biomolecular Research, University of Toronto, Toronto, M5S 3E1, Canada.
2
Department of Electrical and Computer Engineering, University of Toronto, Toronto, M5S 2E4, Canada.

Abstract

MOTIVATION:

High-content screening (HCS) technologies have enabled large scale imaging experiments for studying cell biology and for drug screening. These systems produce hundreds of thousands of microscopy images per day and their utility depends on automated image analysis. Recently, deep learning approaches that learn feature representations directly from pixel intensity values have dominated object recognition challenges. These tasks typically have a single centered object per image and existing models are not directly applicable to microscopy datasets. Here we develop an approach that combines deep convolutional neural networks (CNNs) with multiple instance learning (MIL) in order to classify and segment microscopy images using only whole image level annotations.

RESULTS:

We introduce a new neural network architecture that uses MIL to simultaneously classify and segment microscopy images with populations of cells. We base our approach on the similarity between the aggregation function used in MIL and pooling layers used in CNNs. To facilitate aggregating across large numbers of instances in CNN feature maps we present the Noisy-AND pooling function, a new MIL operator that is robust to outliers. Combining CNNs with MIL enables training CNNs using whole microscopy images with image level labels. We show that training end-to-end MIL CNNs outperforms several previous methods on both mammalian and yeast datasets without requiring any segmentation steps.

AVAILABILITY AND IMPLEMENTATION:

Torch7 implementation available upon request.

CONTACT:

oren.kraus@mail.utoronto.ca.

PMID:
27307644
PMCID:
PMC4908336
DOI:
10.1093/bioinformatics/btw252
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Silverchair Information Systems Icon for PubMed Central
Loading ...
Support Center