Format

Send to

Choose Destination
J Eur Acad Dermatol Venereol. 2019 Sep 8. doi: 10.1111/jdv.15935. [Epub ahead of print]

Accuracy of a smartphone application for triage of skin lesions based on machine learning algorithms.

Author information

1
Department of Automatic Control and Systems Engineering, University Politehnica of Bucharest, Bucharest, Romania.
2
SkinVision BV, Amsterdam, The Netherlands.
3
Department of Dermatology, Erasmus Medical Center, Rotterdam, The Netherlands.
4
State University of New York Downstate Medical Center, Brooklyn, NY, USA.
5
Brooklyn Veterans Administration Medical Center, New York, NY, USA.

Abstract

BACKGROUND:

Machine learning algorithms achieve expert-level accuracy in skin lesion classification based on clinical images. However, it is not yet shown whether these algorithms could have high accuracy when embedded in a smartphone app, where image quality is lower and there is high variability in image taking scenarios by users. In the past, these applications were criticized due to lack of accuracy.

OBJECTIVE:

In this study, we evaluate the accuracy of the newest version of a smartphone application (SA) for risk assessment of skin lesions.

METHODS:

This SA uses a machine learning algorithm to compute a risk rating. The algorithm is trained on 131 873 images taken by 31 449 users in multiple countries between January 2016 and August 2018 and rated for risk by dermatologists. To evaluate the sensitivity of the algorithm, we use 285 histopathologically validated skin cancer cases (including 138 malignant melanomas), from two previously published clinical studies (195 cases) and from the SA user database (90 cases). We calculate the specificity on a separate set from the SA user database containing 6000 clinically validated benign cases.

RESULTS:

The algorithm scored a 95.1% (95% CI, 91.9-97.3%) sensitivity in detecting (pre)malignant conditions (93% for malignant melanoma and 97% for keratinocyte carcinomas and precursors). This level of sensitivity was achieved with a 78.3% (95% CI, 77.2-79.3%) specificity.

CONCLUSIONS:

This SA provides a high sensitivity to detect skin cancer; however, there is still room for improvement in terms of specificity. Future studies are needed to assess the impact of this SA on the health systems and its users.

PMID:
31494983
DOI:
10.1111/jdv.15935

Supplemental Content

Full text links

Icon for Wiley
Loading ...
Support Center