Research Letter
doi:10.2196/41657
Keywords
Introduction
Given the prevalence of keratinocyte carcinomas (KCs), it is imperative to identify accurate diagnostic tools for evaluating suspicious skin lesions [
, ]. Misdiagnosis carries significant harms, including unnecessary scarring, anxiety, and increased cost [ ].Methods
A 2018 Cochrane review [
] assessed dermoscopy as an adjunct to visual inspection (VI) for KC diagnosis among adults with skin lesions suspicious for malignancy or at risk of KC development [ ]. Diagnosis was verified by histology for all malignant lesions, while clinical follow-up or histologic diagnosis was required for at least 50% of participants with benign lesions to be included in the review [ ]. When these parameters were met, cancer registry and “expert opinion” were also allowed as reference standards, although this was considered less desirable [ ].Results
The review [
] included 24 studies conducted between 1987 and 2016, encompassing adult participants from North America, the Middle East, Europe, Oceania, and East Asia. presents further information about the included studies. Among the included studies, there were a total of 8805 visually inspected lesions and 6855 lesions inspected with dermoscopy and VI. Face-to-face and teledermatology settings were evaluated separately, although no clear difference was found between settings.For in-person basal cell carcinoma (BCC) diagnosis, the diagnostic odds ratio revealed dermoscopy and VI were 8.2 (95% CI 3.5-9.3) times more effective than VI alone (likelihood-ratio test P<.001), supporting the predicted sensitivity difference of 14% (79% vs 93%) at a fixed specificity of 80% and predicted specificity difference of 22% (77% vs 99%) at a fixed sensitivity of 80%. The predicted values for sensitivity and specificity were estimated using summary receiver operating characteristic (SROC) curves, which were constructed based on data points derived from individual studies included in the review [
]. It is crucial to note that secondary to substantial heterogeneity between studies, the reported differences in sensitivity and specificity are illustrative examples of the values that might be achieved based on the observed data and do not necessarily reflect how the tests might perform in specific settings.Sources of heterogeneity were unclear due to poor reporting and lack of available data, although the authors suggest that observer experience, type of dermatoscope used, and the case mix of included lesions may have contributed. Risk of bias and concerns regarding applicability were generally high or unclear across most domains assessed, particularly in participant selection, flow, and timing. Although the strength of the conclusions was limited, the addition of dermoscopy to in-person evaluations increased diagnostic accuracy on average. To estimate the impact of the predicted differences in specificity and sensitivity derived from the SROC curve for lesions inspected in person with VI alone versus VI and dermoscopy for the detection of BCC, they were applied to a hypothetical cohort of 1000 lesions. At the median prevalence of 17%, an additional 24 BCC would be identified and 183 fewer non-BCC would be treated unnecessarily with the use of dermoscopy and VI. This information is further illustrated in
. Insufficient data were available for thorough analysis of cutaneous squamous cell carcinoma detection, and it could not be determined whether evaluator expertise or use of a formal algorithm improved the accuracy of KC detection.Setting and test (number of studies) | Total lesions, n | Total cases, n | ||
Basal cell carcinoma quantity of evidence (n=21) | ||||
In person | ||||
VIa | 7017 | 1586 | ||
VI + Db | 4683 | 363 | ||
Image based | ||||
VI | 853 | 156 | ||
VI + D | 2271 | 737 | ||
Cutaneous squamous cell carcinoma quantity of evidence (n=4) | ||||
In person | ||||
VI | 2684 | 538 | ||
VI + D | —c | — | ||
Image based | ||||
VI | — | — | ||
VI + D | 717 | 119 | ||
Any skin cancer quantity of evidence (n=11) | ||||
In person | ||||
VI | 3618 | 2021 | ||
VI + D | 277 | 85 | ||
Image based | ||||
VI | 517 | 124 | ||
VI + D | 1526 | 847 |
aVI: visual inspection.
bVI + D: visual inspection and dermoscopy.
cNot applicable.
Sensitivitya | Fixed specificityb | Fixed sensitivityb | Specificityc | |||||||||
True positive, n | False negative, n | False positive, n | True negative, n | True positive, n | False negative, n | False positive, n | True negative, n | |||||
10% prevalence | —d | — | 180 | 720 | 80 | 20 | — | — | ||||
VIe | 79 | 21 | — | — | — | — | 207 | 693 | ||||
VI + Df | 93 | 7 | — | — | — | — | 9 | 891 | ||||
17% prevalence | — | — | 166 | 664 | 136 | 34 | — | — | ||||
VI | 134 | 36 | — | — | — | — | 191 | 639 | ||||
VI + D | 158 | 12 | — | — | — | — | 8 | 822 | ||||
53% prevalence | — | — | 94 | 376 | 424 | 106 | — | — | ||||
VI | 419 | 111 | — | — | — | — | 108 | 362 | ||||
VI + D | 493 | 37 | — | — | — | — | 5 | 465 |
aThe dermoscopy test had a sensitivity of 79%, and the visual inspection and dermoscopy test had a sensitivity of 93%.
bBoth tests had a fixed specificity and fixed sensitivity of 80%.
cThe dermoscopy test had a specificity of 77%, and the visual inspection and dermoscopy test had a specificity of 99%.
dNot applicable.
eVI: visual inspection.
fVI + D: visual inspection and dermoscopy.
Discussion
Recent advancements in learning algorithms using dermoscopic images, particularly deep learning techniques like convolutional neural networks (CNNs), have shown promise in improving diagnostic accuracy. In a systematic review [
] of 19 studies conducted between 2017 and 2021, CNNs demonstrated comparable or improved diagnostic accuracy compared to dermatologists. However, it is important to note that these studies primarily focused on melanoma due to its significant risk, leaving a gap in research specifically targeting KCs. Further research dedicated to KC diagnosis is crucial for a comprehensive evaluation of these conditions.The authors of the review [
] postulated that adjunctive dermoscopy may aid specialists in identifying BCC. However, the results should be considered suggestive rather than conclusive, given the marked heterogeneity and concerns about the methodological quality of the included studies. Further investigation is required to determine any definitive benefit of dermoscopy for BCC diagnosis. Clear identification of evaluator expertise is essential to ensure meaningful results. Moreover, additional evaluation of the use of formal algorithms may benefit clinicians in varying levels of care. The ubiquity of KCs and risks of misdiagnosis underscore the need for transparent reporting of future studies to optimize diagnostic tools and improve outcomes for patients with suspicious skin lesions.Conflicts of Interest
RPD is a joint coordinating editor for Cochrane Skin, a dermatology section editor for UpToDate, a social media editor for the Journal of the American Academy of Dermatology (JAAD), and a podcast editor for the Journal of Investigative Dermatology (JID). He is a coordinating editor representative on the Cochrane Council. He is editor in chief of JMIR Dermatology. TES is an editorial board member at large for JMIR Dermatology. RPD receives editorial stipends (JAAD and JID), royalties (UpToDate), and expense reimbursement from Cochrane Skin.
Editorial Notice
The views expressed in this paper are those of the author(s) and in no way represent the Cochrane Library or Wiley. This article is based on a Cochrane Review previously published in the Cochrane Database of Systematic Reviews 2018, Issue 12, DOI: 10.1002/14651858.CD011901.pub2 (see www.cochranelibrary.com for information). Cochrane Reviews are regularly updated as new evidence emerges and in response to feedback, and Cochrane Database of Systematic Reviews should be consulted for the most recent version of the review.
References
- Prieto-Granada C, Rodriguez-Waitkus P. Cutaneous squamous cell carcinoma and related entities: epidemiology, clinical and histological features, and basic science overview. Curr Probl Cancer. 2015;39(4):206-215. [CrossRef] [Medline]
- Cameron MC, Lee E, Hibler BP, Barker CA, Mori S, Cordova M, et al. Basal cell carcinoma: epidemiology; pathophysiology; clinical and histological subtypes; and disease associations. J Am Acad Dermatol. Feb 2019;80(2):303-317. [CrossRef] [Medline]
- Dinnes J, Deeks J, Chuchu N, Matin R, Wong K, Aldridge R, et al. Visual inspection and dermoscopy, alone or in combination, for diagnosing keratinocyte skin cancers in adults. Cochrane Database Syst Rev. Dec 04, 2018;12(12):CD011901. [FREE Full text] [CrossRef] [Medline]
- Jones CM, Athanasiou T. Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests. Ann Thorac Surg. Jan 2005;79(1):16-20. [CrossRef] [Medline]
- Haggenmüller S, Maron RC, Hekler A, Utikal JS, Barata C, Barnhill RL, et al. Skin cancer classification via convolutional neural networks: systematic review of studies involving human experts. Eur J Cancer. Oct 2021;156:202-216. [FREE Full text] [CrossRef] [Medline]
Abbreviations
BCC: basal cell carcinoma |
CNN: convolutional neural network |
KC: keratinocyte carcinoma |
SROC: summary receiver operating characteristic |
VI: visual inspection |
Edited by CC Chi; submitted 03.08.22; peer-reviewed by H Shakshouk, C Sibbald, J Solomon, V Long; comments to author 23.02.23; revised version received 18.07.23; accepted 03.02.24; published 07.03.24.
Copyright©Colleen M Klein, Torunn E Sivesind, Robert P Dellavalle. Originally published in JMIR Dermatology (http://derma.jmir.org), 07.03.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Dermatology, is properly cited. The complete bibliographic information, a link to the original publication on http://derma.jmir.org, as well as this copyright and license information must be included.