A Reproducible Experimental Protocol for Developing and Evaluating Explainable Artificial Intelligence Models in Healthcare Systems

Summary

This protocol presents a reproducible workflow for developing, evaluating, and interpreting explainable artificial intelligence models in healthcare. It integrates standardized data preparation, model development, explainability techniques, quantitative evaluation, and reproducibility practices to improve transparency, reliability, and clinical applicability.

Abstract

Artificial intelligence (AI) is increasingly being adopted as a valuable tool for clinical decision-making, disease prediction, medical diagnosis, and personalized healthcare. However, a lack of transparency, inconsistent implementation of explainable artificial intelligence (XAI) methods, and limited reproducibility remain major barriers to the trustworthy deployment of AI models in clinical settings. This paper proposes a systematic, reproducible, and transparent protocol for developing, evaluating, and interpreting explainable AI models for healthcare applications. The workflow begins with computational environment setup, followed by data acquisition and characterization, preprocessing, feature engineering, model development, hyperparameter optimization, predictive performance evaluation, explainability analysis, statistical validation, and reproducibility assessment. The protocol incorporates XAI methods such as SHapley Additive exPlanations (SHAP), Local Interpretable Model-agnostic Explanations (LIME), Gradient-weighted Class Activation Mapping (Grad-CAM), Integrated Gradients, attention visualization, and counterfactual explanations to generate both global and local model interpretations. The protocol emphasizes several key components, including the preparation of standardized healthcare datasets, the development of stable machine learning models, the evaluation of predictive performance, the generation of clinically relevant explanations, and the statistical assessment of reproducibility across repeated experiments. By integrating model development, explainability, quantitative and qualitative evaluation, statistical validation, and reproducibility assessment into a unified workflow, this protocol provides a comprehensive framework for developing transparent and reproducible AI models for healthcare applications.

Introduction

AI has become an integral component of modern healthcare by enabling intelligent analysis of complex clinical data and supporting evidence-based medical decision-making¹. The rapid digitization of healthcare through electronic health records, medical imaging systems, wearable devices, and genomic technologies has generated large volumes of heterogeneous data that require advanced computational approaches for effective interpretation².

Machine learning (ML) and deep learning (DL) algorithms have demonstrated remarkable capabilities in extracting meaningful patterns from multidimensional healthcare datasets, thereby improving diagnostic accuracy, disease prediction, and patient outcome assessment³. AI-based models have been successfully applied in radiology, pathology, cardiology, oncology, ophthalmology, and other medical specialties to assist clinicians in detecting diseases at earlier stages and recommending personalized treatment strategies⁴. These technologies have also contributed to workflow optimization, reduced diagnostic variability, and improved healthcare resource utilization⁵.

Recent developments in computational hardware, cloud computing, and open-source AI frameworks have accelerated the development and deployment of intelligent healthcare applications⁶. Consequently, AI has become a key enabling technology for precision medicine and clinical decision-support systems⁷. Despite these advances, the widespread adoption of AI in routine clinical practice remains limited because many high-performing models offer little insight into how their predictions are generated⁸.

Most deep learning algorithms function as complex black-box models in which the internal decision-making process is difficult for clinicians and researchers to understand⁹. Although these models often achieve excellent predictive performance, their lack of transparency undermines user confidence and poses challenges for clinical validation, regulatory approval, and patient safety¹⁰. Healthcare professionals must be able to justify AI-assisted decisions before incorporating them into routine clinical practice, particularly in high-risk medical environments¹¹.

XAI has emerged as an effective approach to improving the transparency and interpretability of machine learning models¹². Rather than treating prediction models as opaque systems, XAI techniques provide information about the features, image regions, or clinical variables that contribute to individual predictions¹³. Such explanations enable clinicians to better understand model behavior, identify potential biases, and determine whether AI-generated decisions are consistent with established medical knowledge¹⁴.

Several explainability techniques have been introduced for healthcare applications. SHapley Additive explanations (SHAP) measure the contribution of each feature to model prediction on the basis of cooperative game theory¹⁵. Local Interpretable Model-agnostic Explanations (LIME) create a simplified model and explain the predictions of the blackbox model¹⁶. For medical image tasks using deep learning models, Gradient-weighted activation maps (Grad-CAM) create heatmaps that visually indicate the regions of an image that contribute to classification decisions¹⁷. The combination of these methods has dramatically enhanced the transparency of AI systems across different healthcare domains¹⁸.

Despite the growing attention to explainability methods in healthcare settings, their use remains varied in the literature. Researchers differ not only in the use of preprocessing strategies but also in the design of model architecture, evaluation metrics, and even explanation techniques¹⁹. Also, many papers report high predictive accuracy but fail to provide a thorough assessment of the quality of explanations or their reproducibility²⁰.

Reproducibility is one of the major bottlenecks in modern AI science. Papers often do not disclose the software version, computational environment, preprocessing pipeline, hyperparameter settings, random seed initialization, and hardware configurations²¹. Because of this, independent researchers often fail to reproduce published results or to verify the published methods using other datasets or software platforms²². Lack of detailed documentation is one of the factors hampering benchmarking studies, collaborative research, and clinical translation of AI systems²³.

Recognizing these challenges, several organizations and regulatory agencies have emphasized the importance of transparent, trustworthy, and reproducible AI for healthcare applications²⁴. Existing reporting guidelines have improved methodological reporting but primarily describe what should be reported rather than providing standardized experimental procedures that researchers can directly implement²⁵. Consequently, there remains a need for a comprehensive protocol that integrates dataset preparation, model development, explainability analysis, statistical evaluation, and reproducibility practices into a single experimental workflow²⁶.

A standardized experimental protocol offers several advantages for the healthcare AI community. Moreover, it promotes methodological consistency, facilitates comparison of independent studies, increases the transparency of computational experiments, and enables reliable validation of published results²⁷. Standardized workflows also assist education/ training, collaborative research, and regulatory evaluation through clearly documented procedures that are reproducible across different laboratories and healthcare institutions²⁸.

A reproducible experimental protocol for training and evaluating AI models in healthcare systems was developed and tested. The protocol outlines standards for configuring the computational environment, preprocessing healthcare datasets, developing machine-learning models, applying XAI methods, evaluating predictive performance, performing statistical validation, and assessing reproducibility²⁹. Integration of such components into a coherent workflow is likely to boost the transparency, reliability, and reproducibility of healthcare AI research, as well as help develop trusted intelligent health systems³⁰.

Protocol

The worked validation experiment used the publicly available, de-identified Pima Indians Diabetes Dataset and did not involve identifiable patient records or new patient recruitment. Therefore, informed consent and institutional IRB/ethics approval were not required, and all analyses were conducted in accordance with applicable dataset terms and institutional research policies.

The worked validation example uses the publicly available Pima Indians Diabetes Dataset, which contains 768 records for binary diabetes prediction. The complete nine-stage core workflow was applied to this dataset. The nine core stages comprised dataset selection and validation, computational environment configuration, data preprocessing, dataset partitioning, model development and training, predictive and computational performance evaluation, explainability analysis, statistical validation, and reproducibility assessment. External validation and clinical expert evaluation were retained as optional validation modules and were not performed in the present worked example. Figure 1 illustrates the core protocol workflow, and Table 1 summarizes only the nine core stages implemented in the present worked validation; optional external validation and clinical expert evaluation are described separately within the Protocol and are not included among the nine experimental stages.

1. Select and validate the healthcare dataset

1. Select the Pima Indians Diabetes Dataset as the primary dataset for the worked validation example. Verify the dataset source, sample size, prediction target, class distribution, and data structure.
2. Apply the predefined inclusion, exclusion, and data-quality criteria. Remove duplicate and invalid records before model development.
3. Record the dataset source, characteristics, prediction task, class distribution, inclusion and exclusion criteria, and partitioning strategy in Table 2.
4. Apply decision criteria for dataset and model selection
   1. Define the prediction objective before selecting the dataset, model architecture, preprocessing strategy, or explainability method.
   2. Match the dataset modality to the prediction objective. Select tabular data for structured clinical variables, imaging data for medical images, time-series data for physiological signals, text data for clinical narratives, or multimodal data when complementary modalities are available for the same patient or study unit.
   3. Evaluate candidate datasets according to sample size, outcome availability, class distribution, missingness, annotation quality, clinical relevance, data completeness, and accessibility. Select the dataset that satisfies the predefined requirements.
   4. Select conventional machine-learning models for structured tabular data when the sample size, computational resources, or interpretability requirements limit the use of complex architectures. Select deep-learning architectures when sufficient training data and high-dimensional inputs, such as medical images, physiological signals, or clinical text, are available.
   5. Select multimodal architectures only when multiple modalities are available for the same patient or study unit and can be reliably aligned without introducing information leakage. Select preprocessing operations according to the characteristics of the selected data modality.
   6. Select explainability methods according to the model and data modality. Use model-agnostic methods such as SHAP or LIME for appropriate tabular models and modality-specific methods such as Grad-CAM for image-based models, when applicable.
   7. Document the rationale for the dataset, preprocessing strategy, model, and explainability-method selections. Preserve these decisions as part of the reproducibility record.

2. Configure the computational environment for XAI model development

1. Configure the operating system, CPU, RAM, storage, and GPU according to the selected model requirements. Create an isolated Python environment and install the required machine learning, deep learning, statistical, visualization, and XAI libraries.
2. Record the actual computational environment, model architecture, and hyperparameters used for the worked validation in Table 3. Specify the optimizer, learning rate, batch size, maximum number of epochs, loss function, regularization parameters, validation strategy, early-stopping configuration, random-seed configuration, explainability methods, hardware, operating system, Python version, and relevant software-library versions. Distinguish these experimentally used settings from general or recommended protocol settings.
3. Use the configuration reported in Table 3 when reproducing the Pima Indians Diabetes Dataset validation and the corresponding predictive, explainability, statistical, and reproducibility results.
4. Execute a validation script to confirm successful package import, dataset loading, model execution, and output generation. Preserve the finalized environment configuration for reproducibility.

3. Prepare and characterize healthcare datasets for XAI model development

1. Select and acquire the healthcare dataset
   1. Select a healthcare dataset appropriate for the defined clinical prediction task. Evaluate candidate datasets according to the research objective, data type, sample size, annotation quality, class balance, and clinical relevance.
   2. Prefer publicly available benchmark datasets when they adequately address the prediction task and facilitate independent validation.
   3. Obtain the required ethical approvals, institutional permissions, and data-access authorization before acquiring institutional or in-house datasets. Obtain the selected dataset from a verified repository or authorized institutional database.
   4. Preserve the original dataset files without modification and record the dataset provider, version, acquisition information, licensing conditions, inclusion criteria, exclusion criteria, and accompanying metadata. Organize the dataset into separate directories for raw data, annotations, metadata, and supplementary information.
2. Characterize the healthcare dataset
   1. Identify the predictor variables, outcome labels, feature types, data modalities, and class distributions. Determine the number of subjects, samples, feature dimensions, and available annotations.
   2. Confirm that the dataset characteristics are compatible with the selected AI method.
   3. Use the Pima Indians Diabetes Dataset as the sole worked experimental dataset for validating the nine-stage core protocol. Include the additional datasets listed in Table 2 only to demonstrate the applicability of the general protocol across clinical tabular data, electronic health records, dermoscopic images, physiological time-series data, and medical imaging. Do not use these additional datasets for model training, testing, statistical validation, or generation of the reported experimental results.
3. Assess dataset quality
   1. Inspect the dataset for duplicate records, corrupted files, missing values, annotation errors, and irregular data entries. Remove confirmed duplicate records and correct verified formatting irregularities. Document all dataset quality-control procedures.
   2. Verify the correspondence of imaging, clinical, laboratory, and physiological data through subject identifiers when using multimodal datasets.
   3. Remove duplicate or inconsistent records, handle missing values, standardize numerical features, encode categorical variables, and apply modality-specific preprocessing. Partition the dataset into independent training, validation, and test sets. Refer to Figure 2 for the workflow for healthcare dataset preparation, preprocessing, partitioning, and quality assessment.
4. Ensure data privacy and ethical compliance
   1. Remove direct identifiers from healthcare data. Apply anonymization or pseudonymization procedures when required. Handle patient health information in accordance with applicable ethical, data protection, informed consent, and institutional requirements.
   2. Record the applicable ethical approval, waiver, data-governance procedures, anonymization methods, and dataset-preparation workflow.
   3. Assess potential algorithmic bias by comparing model performance across relevant demographic or clinical subgroups when such information is available and ethically permissible.
   4. Document the intended use, target population, model limitations, potential failure modes, human-oversight requirements, and applicable ethical, data-protection, and healthcare regulatory requirements.
   5. Record identified fairness limitations and responsible-AI considerations as part of the final model documentation.
      NOTE: Obtain a standardized and documented healthcare dataset that is suitable for AI model development, ethically compliant, and free from major identified inconsistencies.

4. Preprocess and partition healthcare data for AI model training

1. Perform quality control
   1. Inspect the dataset for duplicate records, missing values, invalid values, inconsistent labels, outliers, and corrupted files.
   2. Remove or correct invalid observations according to predefined criteria and record all exclusions. Verify the consistency of predictor variables and outcome labels.
2. Handle missing data
   1. Quantify missingness for each variable. Apply the predefined imputation or exclusion strategy.
   2. Estimate imputation parameters using the training data only and apply the fitted transformation to validation and testing data.
3. Normalize and transform data
   1. Apply feature scaling, normalization, encoding, dimensionality reduction, or other transformations required by the selected model. Fit all data-dependent transformations using only the training data.
   2. Apply the fitted transformations unchanged to validation and testing data.
4. Quantify class imbalance in the training data. Apply class weighting, SMOTE, oversampling, or augmentation only to the training dataset. Preserve the original distribution of the validation and testing datasets.
5. Confirm that no subject, duplicate observation, augmented sample, preprocessing statistic, feature-selection criterion, or synthetic sample is shared between training and evaluation partitions.

5. Develop and configure the XAI model

1. Define the model architecture by specifying the input data modalities, preprocessing operations, modality-specific feature encoders, feature fusion mechanism, prediction layer, and explainability module.
2. Select the machine learning or deep learning architecture according to the prediction task and input modality. Configure the input layer, feature-extraction components, hidden layers, output layer, and activation functions. Define the optimizer, learning rate, batch size, loss function, epochs, regularization, dropout, early stopping, and learning-rate schedule.
3. Optimize hyperparameters using the training and validation data only.
4. Record the finalized architecture and hyperparameter configuration in Table 3.
5. Verify input-output dimensional compatibility before training.
   NOTE: Establish a fully configured XAI model containing an appropriate architecture, defined hyperparameters, and integrated explainability techniques.

6. Train, optimize, and preserve the XAI model

1. Load the predefined training and validation datasets and the finalized model configuration. Initialize the model using the predefined random seed and training parameters.
2. Train the model using the specified optimizer, loss function, batch size, and stopping criteria.
3. Monitor validation performance and retain the checkpoint corresponding to the predefined model-selection criterion. Evaluate the selected checkpoint on the independent testing dataset without further optimization.
4. Save the trained model, preprocessing configuration, hyperparameters, random seed, and training log.
   NOTE: Obtain an optimized XAI model trained and validated using the prepared healthcare dataset. Preserve the best-performing model, hyperparameters, training logs, preprocessing configuration, and computational environment for reproducibility.

7. Evaluate predictive and computational performance

1. Evaluate predictive performance
   1. Load the optimized model and independent testing dataset after completing model training and hyperparameter optimization. Keep the trained model parameters and preprocessing pipeline unchanged during testing.
   2. Generate predictions for all samples in the testing dataset. Compare the predicted outputs with the corresponding ground-truth labels.
2. Calculate performance metrics
   1. Select evaluation metrics according to the type of prediction task.
   2. Calculate accuracy, precision, recall, specificity, F1-score, balanced accuracy, Matthews correlation coefficient (MCC), and area under the receiver operating characteristic curve (AUC-ROC) for classification tasks, as applicable. Calculate mean absolute error (MAE), root mean square error (RMSE), coefficient of determination (R²), and other relevant measures for regression tasks, as applicable.
3. Evaluate model generalization and robustness
   1. Evaluate the model using an external dataset collected independently from the development dataset whenever such data are available.
   2. Prefer external datasets originating from a different healthcare institution, geographic region, or patient population to assess transportability.
   3. Perform temporal validation using data collected during a later period when longitudinal datasets are available.
   4. Perform multicenter validation by evaluating the finalized model separately across participating institutions when multicenter data are available.
   5. Perform geographic validation using an independent population from a different geographic region when feasible.
   6. Report performance differences and confidence intervals between the development and external datasets.
4. Evaluate computational performance
   1. Measure model training time under the predefined computational environment, inference and testing time under identical computational conditions, and memory consumption, model size, and hardware utilization.
   2. Repeat computational measurements across independent runs.
   3. Calculate the mean execution time to reduce the effect of experimental variability.
5. Compare model performance
   1. Select appropriate conventional machine learning or deep learning methods for comparative evaluation.
   2. Evaluate the proposed XAI model and comparator models using the same dataset. Apply identical preprocessing procedures and evaluation metrics to all comparative models.
   3. Perform all comparative experiments within the same computational environment.
      NOTE: Obtain experimental evidence of predictive stability and reproducibility under the tested computational conditions and dataset.

8. Generate and evaluate XAI outputs

1. Generate model explanations
   1. Load the optimized XAI model. Select evaluation samples that were not used for model training. Apply the predefined explainability methods without modifying the trained model or preprocessing pipeline.
   2. Generate global and local model explanations
      1. Generate global explanations to characterize the overall behavior of the predictive model.
      2. Generate local explanations to characterize individual model predictions.
      3. Apply SHAP to the Pima Indians Diabetes Dataset to generate global and local explanations of the tabular model predictions.
      4. Generate a SHAP summary plot to visualize the overall direction and magnitude of feature contributions.
      5. Generate a SHAP feature-importance plot using mean absolute SHAP values to rank features according to their overall contribution to model predictions.
      6. Generate a SHAP waterfall plot for a representative test-set prediction to illustrate patient-specific feature contributions.
      7. Generate a SHAP feature-dependence plot to examine the relationship between a selected feature and its contribution to the model output.
      8. Apply LIME to representative test-set predictions to generate local explanations of individual model predictions.
      9. Generate a patient-specific counterfactual explanation to illustrate the feature changes associated with a change in the predicted outcome.
      10. Select additional explainability techniques according to the data modality and model architecture.
      11. Use Grad-CAM or saliency maps for compatible image-based models, attention visualizations for transformer-based architectures, and Integrated Gradients for differentiable models when applicable.
      12. Treat Grad-CAM, saliency mapping, attention visualization, and Integrated Gradients as general, modality-dependent protocol options, and do not interpret or report them as experimental results from the Pima Indians Diabetes Dataset validation unless the corresponding analyses are actually performed.
   3. Apply explainability methods to the worked Pima validation
      1. Apply SHAP and LIME to the Pima Indians Diabetes Dataset to generate global and local explanations of the tabular model predictions.
      2. Generate SHAP summary, feature-importance, waterfall, and feature-dependence visualizations from the Pima validation results.
      3. Generate a LIME local explanation for representative test-set predictions.
      4. Generate a patient-specific counterfactual explanation to illustrate the feature changes associated with a change in the model prediction.
      5. Treat Grad-CAM, attention visualization, saliency mapping, and Integrated Gradients as modality-dependent explainability options for other healthcare data types and model architectures.
      6. Do not report Grad-CAM, attention visualization, saliency mapping, or Integrated Gradients as experimental findings from the Pima worked validation unless the corresponding analyses are actually performed.
2. Evaluate explanation quality
   1. Assess whether the generated explanations reflect the model's prediction process. Evaluate the stability of explanations across repeated experimental runs, and the consistency of explanation outputs under identical computational conditions.
   2. Assess the sensitivity of explanation outputs to changes in input data when applicable. Compare generated explanations with available domain knowledge or expert interpretations.
   3. Identify predictive features or anatomical regions that correspond with established medical knowledge when such comparisons are available.
   4. Record the level of agreement or disagreement between the generated explanations and the available clinical interpretation.
3. Quantify prediction uncertainty
   1. Generate prediction-confidence estimates for the evaluated samples using an uncertainty-estimation method appropriate to the selected model architecture and healthcare application.
   2. Apply Monte Carlo dropout, ensemble-based prediction, Bayesian inference, conformal prediction, or another validated uncertainty-estimation approach when appropriate.
   3. Repeat stochastic prediction passes when using Monte Carlo dropout and calculate the mean prediction and predictive variance for each evaluation sample.
   4. Report prediction confidence or uncertainty intervals together with the corresponding model predictions.
   5. Evaluate whether uncertainty estimates identify predictions associated with lower reliability or increased prediction error. Preserve the uncertainty estimation method, parameters, random seeds, and generated uncertainty outputs to ensure reproducibility.
4. Document and preserve explainability outputs
   1. Save all generated feature-importance scores, heatmaps, saliency maps, attention visualizations, and patient-specific interpretations. Store the explainability outputs using standardized file formats. Archive the outputs together with the trained model and preprocessing configuration.
   2. Record the computational settings, explanation parameters, execution time, and software versions used for explanation generation. Preserve the complete explainability documentation to facilitate independent review and reproducibility.
5. Quantitatively evaluate explanation quality
   1. Evaluate explanation faithfulness by systematically perturbing or masking the features identified as important and measuring the corresponding change in model output. Calculate an explanation-faithfulness score by comparing the magnitude of attribution with the resulting change in model prediction.
   2. Evaluate explanation stability by generating explanations for repeated runs, perturbed inputs, or clinically similar samples and calculating the similarity between the resulting attribution patterns. Calculate infidelity by measuring the discrepancy between the predicted output change and the change estimated from the explanation attribution under controlled input perturbations.
   3. For medical-image explanations, evaluate localization accuracy using an expert-defined region of interest when reference annotations are available. Assess clinical usefulness by obtaining independent evaluations from qualified clinical experts using predefined interpretation criteria.
   4. Calculate Cohen's kappa or Fleiss' kappa when multiple experts independently evaluate explanation relevance or agreement.
      NOTE: Generate global and local explanations that characterize the predictive behavior of the trained AI model. Preserve the explainability outputs and corresponding configurations for transparent interpretation and reproducible evaluation.

9. Perform statistical validation and reproducibility assessment

1. Perform statistical validation
   1. Select statistical methods according to the study objective, experimental design, data distribution, and characteristics of the evaluated variables.
   2. Report continuous variables as the mean ± standard deviation or as the median and interquartile range, as appropriate, and categorical variables as counts and percentages.
   3. Perform five-fold cross-validation on the training set to assess model performance stability and report accuracy, AUC-ROC, precision, recall, and F1-score as mean ± standard deviation across folds. Estimate 95% confidence intervals for the independent test-set performance metrics using 1,000 bootstrap resamples.
   4. Compare the proposed model with the CNN, Random Forest, and SVM baseline models using McNemar's test for paired accuracy comparisons, DeLong's test for correlated AUC-ROC comparisons, and paired bootstrap testing with 1,000 resamples for F1-score comparisons.
   5. Report the corresponding test statistic and exact p-value for each comparison and use a two-sided significance level of α = 0.05.
2. Compare model performance statistically
   1. Compare the proposed explainable AI model with the selected state-of-the-art machine learning and deep learning baseline models.
   2. Apply Student's t-test or the Mann-Whitney U test when comparing two groups, as appropriate. Apply one-way ANOVA for applicable parametric comparisons involving more than two groups. Apply the Kruskal-Wallis test for applicable nonparametric comparisons involving more than two groups.
   3. Consider p < 0.05 statistically significant, as specified in the original manuscript.
   4. Use a two-sided significance level of α = 0.05 for all predefined statistical comparisons and report the corresponding test statistics and p-values.
   5. Report 95% confidence intervals for the principal predictive performance metrics.
   6. Use bootstrap resampling to estimate confidence intervals for performance measures when appropriate. Use DeLong's test to compare correlated ROC-AUC values when the same subjects are evaluated by two models. Use McNemar's test to compare paired categorical classification outcomes generated for the same subjects. Use paired bootstrap procedures to compare F1-score or other derived performance metrics when appropriate.
   7. Evaluate calibration using calibration plots, calibration slope/intercept, and Brier score when probabilistic predictions are available.
   8. For the worked Pima Indians Diabetes Dataset validation, use the predefined paired statistical comparison specified for the proposed model and baseline models. Apply the selected test consistently to the paired test-set predictions or repeated-run performance measurements, as appropriate to the comparison. Use a two-sided significance level of α = 0.05 and report the test statistic and exact p-value. Do not report alternative statistical tests as having been performed unless their results are presented in the Results section.
   9. Apply two-sided tests and interpret statistical significance using a predefined threshold of p < 0.05.
3. Evaluate model robustness
   1. Repeat the complete training and evaluation procedure 10 times using different random seeds while maintaining the predefined dataset partitioning, preprocessing procedures, model architecture, hyperparameters, software environment, and evaluation protocol.
   2. Record the AUC-ROC, accuracy, and F1-score for each independent run and report the mean ± standard deviation across the 10 runs.
   3. Compare the resulting performance values across repeated runs to assess predictive stability and reproducibility under different random initializations.
4. Evaluate explainability reproducibility
   1. Generate feature attributions, attention maps, or other explanation outputs across multiple experimental runs when explanation-stability assessment is included. Compare the explanation outputs quantitatively across repeated runs using an appropriate similarity or rank-based agreement measure.
   2. For the present Pima Indians Diabetes Dataset worked validation, do not report quantitative explanation-stability metrics unless the corresponding repeated explanation outputs and analyses have been performed.
   3. Evaluate agreement between model-generated explanations and clinician interpretations when appropriate clinical evaluations are available. Calculate Cohen's kappa or Fleiss' kappa, as appropriate, to evaluate agreement between raters.
5. Document reproducibility
   1. Preserve the raw data, preprocessing procedures, source code, trained models, hyperparameter configurations, explainability outputs, statistical analysis scripts, and generated results.
   2. Record the software environment and hardware configuration used throughout the workflow. Re-execute the complete workflow independently using the archived files and configurations.
   3. Compare the replicated predictive performance with the original experimental results, and the replicated model explanations with the original explainability outputs.
   4. Record any differences observed during replication. Update the experimental documentation to reflect reproducibility observations identified during the independent execution.
      NOTE: Obtain statistically validated predictive-performance and explainability results that can be evaluated across repeated experiments. Preserve sufficient computational, analytical, and methodological documentation to enable independent verification of the complete workflow.
6. Reproducibility Checklist
   1. Record the dataset name, version, acquisition date, source, inclusion criteria, exclusion criteria, and final sample count. Record all preprocessing operations, transformation parameters, normalization settings, feature-selection procedures, and data-partitioning rules.
   2. Record the operating system, CPU, GPU, RAM, Python version, framework versions, and library versions. Record all model architecture specifications and hyperparameters.
   3. Record optimizer, learning rate, batch size, number of epochs, loss function, regularization, and early-stopping criteria. Record all random seeds and random-number-generator settings.
   4. Preserve trained model weights and preprocessing configurations. Preserve training logs, evaluation scripts, statistical-analysis scripts, and explainability outputs. Record model and software versions used for the final experiments.
   5. Preserve the complete computational environment required for independent replication.
   6. Document the availability of source code, datasets, model weights, and supporting materials subject to ethical, legal, licensing, and privacy restrictions.
   7. Re-execute the archived workflow independently and compare the replicated results with the original results.
   8. Document the complete reproducibility requirements using the standardized checklist.

Results

The proposed XAI framework was implemented using the Pima Indians Diabetes Dataset as the representative healthcare dataset. The Pima Indians Diabetes Dataset was used as the sole experimental validation dataset. All reported predictive, explainability, statistical, and reproducibility results were generated from this dataset. TCGA-BRCA, TCGA-UCEC, MIMIC-III, ISIC 2019, HAM10000, OhioT1DM, and BraTS 2021 were not experimentally evaluated and are included only as examples illustrating the general protocol's applicability ...

Discussion

The results demonstrate the utility of the proposed protocol as a standardized and reproducible workflow for developing and evaluating XAI systems across diverse healthcare datasets. As shown in Table 2 and Figure 3, systematic preprocessing produced standardized data and improved data quality through missing-value handling, data normalization, feature scaling, and dataset partitioning. These preprocessing steps are critical because variability in data preparation may introd...

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
Captum	Meta AI	Latest stable	PyTorch explainability
CUDA Toolkit	NVIDIA	12.2	GPU acceleration
cuDNN	NVIDIA	9.x	Deep learning backend
Git	Git SCM	Latest stable	Version control
GitHub	GitHub Inc.	Web platform	Source code repository
Grad-CAM	jacobgil	Latest release	CNN visualization
Jupyter Notebook	Project Jupyter	Latest stable	Interactive development
LightGBM	Microsoft	4.x	Gradient boosting
LIME	LIME Community	0.2.0	Local explainability
Matplotlib	Matplotlib Developers	3.9	Visualization
Microsoft Excel	Microsoft	Microsoft 365	Data organization
NumPy	NumPy Developers	1.26	Numerical computing
NVIDIA RTX 4090 GPU	NVIDIA	24 GB VRAM	Model training
OpenCV	OpenCV Organization	4.10	Image preprocessing
Pandas	Pandas Development Team	2.2	Data preprocessing
Pillow (PIL)	Python Imaging Library	10.x	Image processing
Plotly	Plotly Technologies	5.x	Interactive visualization
Python	Python Software Foundation	3.11	Programming environment
PyTorch	PyTorch Foundation	2.3	Deep learning
Scikit-learn	Scikit-learn Developers	1.5	Machine learning
SciPy	SciPy Developers	1.13	Scientific computing
Seaborn	Seaborn Developers	0.13	Statistical plots
SHAP	SHAP Community	0.46	Global explainability
SimpleITK	Insight Software Consortium	2.x	Medical image processing
Statsmodels	Statsmodels Developers	0.14	Statistical analysis
System RAM	Any manufacturer	32 GB or higher	Memory
TensorBoard	Google	2.15	Training monitoring
TensorFlow	Google	2.15	Deep learning
Ubuntu Linux / Windows 11	Canonical / Microsoft	22.04 LTS / 11	Operating system
Visual Studio Code	Microsoft	Latest stable	Code development
XGBoost	XGBoost Developers	2.1	Gradient boosting