This study did not involve the recruitment of human participants or the collection of identifiable patient data. All experiments were conducted using the publicly available ISIC 2020 skin lesion dataset obtained from the Kaggle repository; therefore, institutional ethics committee approval and informed consent were not required. All the materials used in this study are in the Table of Materials.
Feature extraction and fusion
Skin lesion images were processed using multiple pretrained CNN models. Deep feature vectors extracted from the selected pretrained CNN architectures are concatenated to construct a unified feature representation for each skin lesion image. The adopted fusion strategy preserves complementary visual information learned by different CNN architectures, allowing the subsequent SVM classifier to exploit both low-level texture characteristics and higher-level semantic representations. Although dimensionality reduction techniques such as principal component analysis or mutual information-based feature selection may reduce feature dimensionality, the complete fused representation was intentionally retained because the fused feature space remains computationally tractable for the employed RBF-SVM classifier while preserving complementary diagnostic information extracted from the heterogeneous CNN backbones.
Classification
The fused feature vectors were used to train an SVM classifier with an RBF kernel. Hyperparameter optimization techniques were employed to determine the optimal classification settings. The classifier then categorized skin lesions into their respective classes.
Explainability
To improve interpretability, LIME was applied to generate visual explanations highlighting the image regions that contribute most significantly to the classification outcomes. These explanations would assist clinicians in understanding and validating the model's decisions.
Evaluation plan
The proposed framework was evaluated using a benchmark skin lesion dataset. Performance was assessed using Accuracy, Precision, Recall, and F1-Score. Comparative experiments were conducted against existing machine learning and deep learning approaches to demonstrate the effectiveness of the proposed framework.
Expected outcomes
The study was expected to produce an accurate and interpretable skin lesion classification system. Preliminary experimental results indicate that EDLF-SLC achieves an accuracy of 88.0%, precision of 89.0%, recall of 87.0%, and F1-score of 88.0%, outperforming several competing methods. The integration of LIME explanations was anticipated to enhance the trustworthiness and facilitate the adoption of AI-assisted diagnostic systems in clinical practice.
Significance
This research contributes to the growing field of explainable healthcare AI by addressing both performance and transparency challenges in skin lesion diagnosis. The proposed framework has the potential to support dermatologists in making more reliable and interpretable diagnostic decisions, ultimately improving patient care. Moreover, in this section, the authors provided information regarding materials and the methodology that has been applied within this research study. Specifically, the authors started with the description of the dataset used for the experiments and moved forward to the detailed discussion of the Explainable Deep Learning Framework for Skin Lesion Classification.
Dataset
The presented work relies on the publicly available ISIC 2020 dataset (International Skin Imaging Collaboration), which can be accessed on the Kaggle website (https://www.kaggle.com/datasets/fanconic/skin-cancer-malignant-vs-benign). The ISIC repository has been recognized as one of the best resources in the field of dermatological imaging, since it provides a large variety of dermoscopic images of different types of skin lesions, as shown in Figure 1. Importantly, the dataset includes images of both benign and malignant conditions, making it useful for performing binary classification tasks for skin cancer 46. There are 3,297 images in the current dataset, out of which 1,800 are benign and 1,497 are malignant. For more efficient experiments, the data had to be split into a training set and a testing set. In particular, there are 2,637 training images, including 1,440 benign and 1,197 malignant, while the testing set consists of 660 images, of which 360 are benign and 300 are malignant. A summary of the dataset is shown in Table 2.
The proposed EDLF-SLC model
In this paper, an efficient and understandable solution for classifying skin lesions into benign and malignant categories has been proposed, using a novel explainable deep learning technique based on a hybrid approach combining the advantages of multiple pre-trained convolutional neural network models. Convolutional neural networks have proven highly effective in extracting high-level semantic features from medical images. Using this capability, the proposed explainable deep learning framework for skin lesion classification (EDLF-SLC) exploits multiple pretrained CNN models to achieve superior performance. To ensure the necessary transparency of the medical decision-making process, LIME has been adopted in the proposed approach to generate local human-readable explanations for the output results. The complete framework can be broken down into three main stages, as illustrated in Figure 2, namely, (1) data preprocessing, (2) feature extraction and classification, and (3) interpretability.
Model architecture and integration
As a preliminary step, seven popular deep learning models (MobileNetV2, ResNet50, EfficientNetB0, Xception, InceptionResNetV2, NASNetLarge, and MobileNet) were selected and evaluated on the validation dataset separately, and the four most effective models (ResNet50, EfficientNetB0, MobileNet, and Xception) have been chosen for the feature extraction stage. In the proposed framework, each input image x has been independently passed through the selected pretrained models. The last fully connected layer has been removed from each of these models, and feature vectors have been obtained from the previous layers. fResNet50(x), fEfficientNetB0(x), fMobileNet(x), and fXception(x) refer to the output feature vectors from each of the above-mentioned models. By concatenating those feature vectors, a new aggregated feature vector F(xi) is obtained:
F(xi) = [f(ResNet50)(xi);f(EfficientNetB0)(xi);f(MobileNet)(xi);f(Xception)(xi)] (1)
Afterward, F(xi) has been passed through an SVM classifier with a radial basis function (RBF) kernel to obtain the classification result. The whole algorithm for the proposed framework is presented in Supplementary File 1.
The proposed framework adopts direct feature-level fusion because each pretrained CNN architecture captures different discriminative characteristics of skin lesions through its distinct network architecture and learned feature hierarchy. Consequently, concatenating these heterogeneous feature representations preserves complementary information that contributes to more comprehensive lesion characterization before classification. Although dimensionality-reduction techniques such as principal component analysis (PCA) or mutual information-based feature selection can reduce the dimensionality of the fused representation, the complete fused feature vector was intentionally retained because its dimensionality remains computationally tractable for the adopted RBF-SVM classifier while preserving complementary diagnostic information extracted by the different CNN backbones. This design, therefore, prioritizes retaining complementary deep representations rather than eliminating potentially informative features before classification.
Data preparation
Data preparation has included preprocessing and splitting the data set into training and testing sets. Preprocessing is aimed at enhancing the quality of data by eliminating inconsistencies, deleting duplicate elements, formatting input images, and performing feature scaling for stable training of a good model. All images have been normalized to the range of [−1, 1] by means of the Z-score normalization:
(2)
where µ and σ stand for the mean value and the standard deviation of the corresponding image, respectively. The data set has been divided into two subsets, i.e., a training set (70.0%) and a testing set (30.0%).
Data augmentation
To avoid overfitting and increase the generalization ability of the model, some augmentations have been used for the training set. Image augmentations involve modifying images in order to artificially expand the data set without changing essential features of medical conditions. The augmentation pipeline has been built using the Keras Sequential API. Such transformations as random horizontal flipping, rotation within a small angle, resizing, scaling, brightness/contrast adjustment, zooming, and some minor movements have been used. Representative examples of augmented images are illustrated in Figure 3.
Pretrained models
Several pretrained deep learning models have been adopted in the proposed framework for extracting features from input images. Those models include MobileNet, ResNet50, EfficientNetB0, Xception, NASNetLarge, Inception-ResNet-v2, and MobileNetV2. MobileNet and MobileNetV2 are lightweight deep learning models for efficient computations using depth-wise separable convolutions. ResNet50 employs the mechanism of residual connections for training the model, thus avoiding the problem of vanishing gradients during training. EfficientNetB0 strikes a balance between efficiency and precision through the approach of compound scaling. Xception extends the Inception network using depthwise separable convolutions. NASNetLarge involves the use of neural architecture search to build optimal deep neural network structures, and Inception-ResNet-v2 builds a hybrid of the Inception model and the residual connections mechanism. Feature vectors extracted from ResNet50 (1,024 features), EfficientNetB0 (1,280 features), MobileNet (1,024 features), and Xception (2,048 features) are concatenated to produce a unified 5,376-dimensional representation. This fusion strategy was selected to preserve complementary representations learned by the different CNN architectures rather than reducing the representation prior to classification. The resulting feature vector is subsequently supplied to the RBF-SVM classifier, which determines the optimal nonlinear decision boundary within the fused feature space.
Explainable AI model (LIME)
In order to provide some local interpretability of the model predictions, the authors adopt the method of generating localized human-readable explanations for each particular model prediction, called LIME47. For any input image, LIME first partitions it into smaller units called superpixels. Perturbations are then generated from the original image, and the predictions from the deep neural model are estimated for each of the perturbations. Then, a weighted linear model is fitted on the perturbations using weights depending on their proximity to the original input instance. After fitting the linear model, the feature importance scores are estimated, indicating the role of each superpixel in the prediction of the final label. Those importance scores are visually highlighted in the final explanation image. The LIME algorithm is shown in Supplementary File 2.