Research Article

HMP-MUNet: A Hybrid Deep Learning Framework for Automated Skin Lesion Segmentation in Dermoscopic Images

DOI:

10.3791/69449

March 17th, 2026

* These authors contributed equally

In This Article

Summary

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

HMP-MUNet introduces a hybrid deep learning framework for automated skin lesion segmentation. By integrating State-Space Models with multi-scale attention mechanisms, it enhances segmentation accuracy while optimizing computational efficiency, offering a robust solution for skin cancer diagnosis in clinical settings.

Abstract

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Computer-aided diagnosis systems for cutaneous lesions face significant challenges in achieving both high diagnostic accuracy and computational efficiency. Current deep learning approaches often require substantial computational resources while struggling to capture the complex morphological variations inherent in skin lesions across different scales. High-order Multi-scale Parallel Vision Mamba U-Net (HMP-MUNet), a novel deep learning framework that addresses these limitations through an innovative architectural design combining State-Space Models with advanced multi-scale processing capabilities.

The approach described in this study integrates a hybrid U-Net framework that combines a high-order vision state-space module for global context modeling, a multi-scale dilated attention fusion network for hierarchical feature extraction across multiple receptive fields, and a parallel multi-depth flexible network for computational optimization. This architecture uses a modified U-shaped encoder-decoder with increased channel dimensions and advanced attention mechanisms to enhance feature learning.

Comprehensive evaluation on benchmark datasets shows a Dice Similarity Coefficient of 95.85% on PH2 and 90.44% on ISIC2018. The model accomplishes this superior accuracy using only 7.61M parameters, representing a remarkable 72.2% reduction compared to existing Vision Mamba architectures while maintaining high segmentation accuracy. The lightweight design shows potential for deployment across various clinical settings and imaging modalities, pending clinical validation, from specialized dermatology centers to primary care facilities.

HMP-MUNet provides an automated solution for skin lesion segmentation that improves diagnostic consistency and supports clinical workflows, with potential for further validation in clinical use. The integration of high-order modeling capabilities with practical deployment considerations offers a potential solution for improving skin cancer screening protocols and expanding healthcare accessibility in computer-aided diagnosis applications.

Introduction

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Computer-aided diagnosis (CAD) systems aim to improve medical imaging practices across clinical specialties, enhancing disease detection, diagnosis, and treatment planning approaches1. In dermatology, the integration of artificial intelligence (AI) and advanced imaging techniques has emerged as a critical tool for improving diagnostic accuracy and clinical outcomes, particularly in early detection of skin cancer, which accounts for approximately 90% of all skin malignancies2. The development of sophisticated algorithmic approaches for automated cutaneous lesion analysis contributes to the advancement of precision medicine, enabling standardized, reproducible diagnostic support that enhances clinical decision-making across diverse healthcare settings3,4.

Modern dermatological imaging encompasses multiple modalities, including dermoscopy, digital photography, optical coherence tomography, and multispectral imaging systems5. Medical professionals utilize dermoscopic images to manually diagnose skin cancer through labor-intensive and time-consuming methods that demand considerable expertise6. The challenge of maintaining diagnostic consistency across different clinical settings and imaging conditions has driven the development of CAD systems providing objective, quantitative analysis of cutaneous lesions. The segmentation of cutaneous lesions from dermoscopic images constitutes a fundamental preprocessing step that directly impacts subsequent classification accuracy and clinical utility7. Generally, computer-aided skin cancer diagnosis involves five steps: image acquisition, preprocessing, segmentation, feature extraction, and classification8. Precise boundary delineation is essential for accurate lesion characterization, enabling clinicians to assess morphological features such as asymmetry, border irregularity, color variation, and diameter—key parameters in established diagnostic criteria9.

The emergence of State-Space Models (SSMs), particularly the Mamba architecture, offers linear computational complexity, improving computational efficiency while maintaining superior long-range dependency modeling capabilities10. Recent advancements in skin lesion segmentation11, such as U-Net9, Att-UNet12, UTNetV213, and UNet++14 have demonstrated notable improvements in segmentation accuracy. For example, U-Net achieves a Dice Similarity Coefficient (DSC) of 87.55% on the ISIC2018 dataset, while UNet++ reaches 87.83%, and Att-UNet achieves 87.91%. On the PH2 dataset, U-Net reaches a DSC of 90.6%, while C2SDG15 and SCR-Net16achieve 90.3%and 89.89%, respectively. HMP-MUNet improves upon these models by integrating a multi-scale attention mechanism and parallel processing capabilities, reducing the parameter count by 72.2% while achieving superior accuracy with a DSC of 95.85% on the PH2 dataset and 90.44% on the ISIC2018 dataset. Given the importance of balancing visual representation learning capabilities with computing resource consumption, exploring generic medical image classification architectures that achieve optimal trade-offs is significant for intelligent clinical diagnosis system development17. The structured spatial SSMs framework enhances traditional Mamba architectures by optimizing state transition matrices, improving computational efficiency, and reducing memory overhead—characteristics essential for clinical deployment across diverse imaging modalities18.

Recent research demonstrates that Vision Mamba architectures, particularly those utilizing High-order Vision Mamba-based Switching Scheme (H-VSS), achieve superior performance with significantly reduced parameter counts compared to conventional transformers, making them particularly suitable for clinical workflow integration19. However, existing Vision Mamba implementations face challenges, including memory consumption limitations and scalability constraints under clinical deployment conditions20. Current medical image segmentation methods are generally divided into CNNs and transformer-based models, where traditional CNNs are limited by receptive field constraints, making long-range dependency capture challenging21. In medical imaging, distinguishing critical regions such as lesions from healthy skin requires high precision, necessitating the adoption of advanced technological solutions to address these challenges22. Contemporary segmentation architectures have evolved to address specific clinical requirements, including computational efficiency for real-time applications, accuracy for critical diagnostic tasks, and robustness across diverse imaging protocols23. Advanced U-Net variants incorporating attention mechanisms, multi-scale feature fusion strategies, and transformer-based encoders have demonstrated superior performance in complex medical imaging scenarios12,24. These architectural innovations directly enhance clinical applications by enabling accurate delineation of anatomical structures, identification of pathological regions, and extraction of quantitative biomarkers, all of which are crucial for evidence-based medicine25,26. However, integration challenges, including interface compatibility with existing electronic medical records (EMR), storage and retrieval of large images, and interoperability across different institutional systems, remain significant obstacles for widespread clinical adoption27.

This paper introduces High-order Multi-scale Parallel Vision Mamba U-Net (HMP-MUNet), a novel CAD system specifically designed for automated cutaneous lesion segmentation in clinical practice. The framework here addresses critical gaps in current medical imaging systems by incorporating innovative architectural components: the Multi-Scale Dilated Attention Fusion Network (MSDAFN) and the Parallel Multi-depth Flexible Network (PMFlex). The MSDAFN implements sophisticated feature extraction strategies combining spatial and channel attention mechanisms with multi-scale dilated convolutions, enabling enhanced detection of subtle lesion characteristics across different scales—crucial for accurate diagnosis of varied lesion types encountered in clinical practice28. The PMFlex introduces parallel processing capabilities enabling simultaneous analysis of multiple input streams, significantly improving computational efficiency while maintaining high-order modeling capabilities essential for clinical-grade accuracy29. HMP-MUNet, through its innovative segmentation techniques and computational strategies, aims to push the boundaries of skin cancer diagnosis, enabling real-time and accurate clinical diagnosis30,31.

The primary contributions of this research align with core objectives of advancing CAD in medical imaging: enhanced global context modeling through MSDAFN improving feature extraction and fusion efficiency for accurate lesion localization across diverse clinical presentations; efficient parallel processing via PMFlex reducing computational overhead while maintaining clinical-grade accuracy, facilitating deployment in resource-constrained clinical environments; clinical deployment optimization through hardware-aware design enabling efficient processing of high-resolution dermoscopic images supporting real-time clinical workflows; Clinical performance demonstrated through comprehensive evaluation on standard datasets with performance metrics suitable for clinical integration; and integrated diagnostic solution combining high-order modeling, multi-scale analysis, and parallel computation providing comprehensive solutions for precision dermatological diagnosis. This research advances computerized medical imaging by providing innovative, clinically applicable solutions addressing both technological and practical requirements for automated cutaneous lesion analysis in contemporary healthcare settings.

The framework is designed to handle high-resolution dermoscopic images, typically with input resolutions of 256 × 256, providing a balance between computational efficiency and image detail. However, variability in equipment and image quality, such as differences in lighting, skin tone, and the presence of hair, can affect segmentation performance. Despite these challenges, the system's design is optimized for real-time clinical workflows and is adaptable to different imaging devices, ensuring robust performance across diverse clinical environments.

Access restricted. Please log in or start a trial to view this content.

Protocol

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This research was performed in compliance with institutional guidelines for computational research and data processing. No human subjects or vertebrate animals were involved in this study.

Dataset preparation and preprocessing

Dataset collection and organization

Dermoscopic images were collected from the PH2, ISIC2018, and ISIC2017 datasets, with specific links provided in the Table of Materials. The PH2 dataset contains 200 high-resolution images (1000 × 1000 pixels), ISIC2018 includes 2,594 images with corresponding segmentation masks, and ISIC2017 includes 2,150 images with segmentation masks. The data were organized into training, validation, and testing sets following standard protocols, ensuring the images are in compatible formats (e.g., .jpg, .png, or .tiff) and include corresponding ground truth masks in binary format.

Data were organized into training, validation, and testing sets following standard protocols. The datasets were split as follows: for ISIC2018, 1,815 images were allocated for training, 259 for validation, and 520 for testing. For ISIC2017, 1,500 images were allocated for training, 220 for validation, and 430 for testing. For PH2, the dataset was divided into 160 training images, 10 validation images, and 30 test images. A consistent image resolution of 256 × 256 pixels was maintained throughout the preprocessing pipeline.

Data augmentation and normalization

Data augmentation techniques were applied to enhance model generalization. Horizontal flipping, vertical flipping, and random rotation within a ±15° range were implemented. Gamma correction and logarithmic transformation were applied with a probability of 0.3 each. Pixel values were normalized using ImageNet statistics (mean = [0.485, 0.456, 0.406], standard deviation = [0.229, 0.224, 0.225]).

Resize all input images to 256 × 256 pixels: To ensure computational efficiency, all input images were resized to a uniform resolution of 256 × 256 pixels. While high-resolution images, such as those in the dataset (1000 × 1000 pixels), contain fine-grained details and texture information crucial for accurate lesion boundary delineation, increasing the resolution did not significantly improve the model's performance. Therefore, the resolution was not increased to maintain a balance between computational efficiency and model accuracy. Future work may further investigate the effects of higher-resolution inputs to determine if the benefits in segmentation accuracy justify the increased computational cost. Images were converted to RGB format when necessary. The preprocessed data were saved in structured directories while maintaining the original dataset splits.

HMP-MUNet architecture implementation

Network architecture design

HMP-MUNet was configured following the hierarchical U-shaped encoder-decoder structure as shown in Figure 1. The network was configured with progressive channel expansion: 8→16→32→64→128→256 channels across encoder levels.

A significant architectural change was made by reducing the network depth from four hierarchical levels to two, which helps simplify the model and improve computational efficiency. Although the depth is reduced, the channel dimensions were increased at each level, enabling the network to capture richer and more expressive features. To further enhance the model's feature learning, attention mechanisms were introduced to focus the network on the most relevant features across multiple scales. These attention mechanisms effectively compensate for the potential loss of hierarchical feature abstraction due to the shallower architecture.

The encoder was initialized with dual Conv2D operations for initial feature extraction from input tensors X(C, H×W). The alternating configuration of three specialized modules was implemented: High-order Vision Mamba-based Switching Scheme (H-VSS), Parallel Multi-depth Flexible Network (PMFlex), and Multi-Scale Dilated Attention Fusion Network (MSDAFN).

The model uses ImageNet statistics (mean and standard deviation) for normalization, avoiding the need to recalculate for each dataset, thereby improving computational efficiency. It ensures stability and generalizability, leveraging ImageNet's extensive use in computer vision tasks. This choice simplifies design by reducing preprocessing complexity and enhances cross-dataset transferability, allowing the model to generalize effectively across diverse skin lesion images.

High-order vision mamba-based switching scheme (H-VSS) implementation                

The H-VSS module was implemented according to the architecture in Figure 2. Layer Normalization (LN) and Hardswish activation (HS) were configured with residual connections following Equation (1):

Non-linear equation Y=HS(LN(X))+X mathematical formula for scientific analysis.

The Local Spatial Descriptor (LSD) component was implemented to maintain spatial coherence. The Spatial Selective 2D Scanning (SS2D) module was configured with multi-directional scanning patterns following Equation (2):

Equation of static equilibrium, Y=Pro(SS2D[X⨀LSD(Y)]), shown as mathematical formula.

Multi-Layer Perceptron (MLP) processing was added with residual connections as specified in Equation (3):

Mathematical formula X = MLP(LN(Y)) + Y; used in statistical analysis calculations.

The High-order 2D Selective Scanning (H-SS2D) mechanism projects input features to 2C-dimensional space for enhanced contextual modeling.

Parallel multi-depth flexible network (PMFlex) implementation

The PMFlex module was configured according to Figure 3 specifications. Layer Normalization was applied to input feature maps X(C, H×W), then partition into four segments along the channel dimension following Equation (4):

Mathematical equations for LN(X) calculations; formulaic analysis in scientific research.

Each segmented feature Y_i was processed through shared Visual Mamba (VMamba) modules. Processed outputs were concatenated, and refinement was applied through Layer Normalization and projection as described in Equation (5):

Equation of variable transformation in neural networks, displaying mathematical function and symbols.

Multi-Scale dilated attention fusion network (MSDAFN) implementation

The MSDAFN module was implemented following the Figure 4 architecture. Parallel convolution operations were configured with dilation rates of 6, 12, and 18 for multi-scale feature extraction according to Equation (6):

Convolution process, equations; Conv2d and AvgPool2d operations, mathematical setup, neural networks.

Multi-scale features were integrated through channel concatenation as specified in Equation (7):

Equation depicting vector operation; Fc=concat(F1,F2,F3,F4,F5); mathematical formula.

Dual attention mechanisms were implemented for feature recalibration. Channel attention weights were calculated using global average pooling following Equation (8):

Equation for average pixel intensity; ΣΣFc,ij/(HxW); mathematical formula; research analysis.

Channel attention weighting was applied as described in Equation (9):

Equation showing neural network function for computational analysis with ReLU activation.

Spatial attention was configured through convolution operations following Equation (10):

Neural network equation, Fs=F·σ(Ws*F), formula for scientific computation studies.

Channel and spatial attention were combined as specified in Equation (11):

Neural network formula: F_out=F·σ(W₂·ReLU(W₁·Zc))·σ(Ws*F); mathematical equation.

Training configuration and optimization

Environment setup

The experimental environment was configured on an Ubuntu 20.04 system with a GPU (32 GB VRAM). Python 3.8, deep learning framework (RRID: SCR_018536), and CUDA 11.8 were installed. The input image size was set to 256 × 256 pixels for cutaneous lesion tasks.

Loss function and optimizer configuration

The BceDice loss function was implemented for training optimization. AdamW optimizer was configured with initial learning rate of 0.001, batch size of 8, and 250 training epochs. Weight decay of 1 × 10⁻5 was applied for regularization.

For the baseline configuration, this study refers to the work by Liu et al. (2024) on the Vmamba model, which was used as a visual state space model for the medical image classification task11. The exact configurations and scripts used to implement Vmamba are based on their published work and adapted for this study, with specific adjustments to better suit the medical imaging dataset.

Learning rate scheduling was set up using cosine annealing with warm restarts. Configure T_0 = 10 epochs for initial restart period, T_mult = 2 for period multiplication, and η_min = 1 × 10⁻6 for minimum learning rate.

Hyperparameter optimization

To ensure reproducibility and consistency, all experiments were conducted using a fixed random seed of 42. The systematic hyperparameter optimization was conducted focusing on batch size, learning rate, and drop path rate. Batch sizes of 4, 8, 16, and 32 were evaluated. The learning rates of 0.0005, 0.001, 0.0015, and 0.002 were tested. The validation performance was monitored using Dice Similarity Coefficient (DSC) as the primary metric. Batch sizes larger than 8 may lead to memory overflow on GPUs with less than 32 GB VRAM.

Model evaluation and performance assessment

Evaluation metrics configuration

Comprehensive evaluation metrics, including Mean Intersection over Union (mIoU), Dice Similarity Coefficient (DSC), Sensitivity (Sen), Specificity (Spe), and Accuracy (Acc), were implemented. The metrics were calculated according to the following formulations:

Mean Intersection over Union (mIoU) quantifies overlap between predicted and ground truth segmentation:

Segmentation metric mIoU equation, formula: mIoU = TP/(TP+FP+FN), used in data analysis.

Dice Similarity Coefficient (DSC) measures segmentation consistency. Values range from 0 to 1, with higher values indicating better performance:

Equation for Dice Similarity Coefficient (DSC), DSC = 2TP/(2TP+FP+FN), measuring overlap.

Sensitivity (Sen) measures the model's ability to detect positive samples:

Sensitivity formula, TP/(TP+FN), equation for calculating sensitivity in diagnostics.

Specificity (Spe) assesses correct negative sample recognition:

Specificity formula TN/(TN+FP), statistic measure, equation in research analysis.

Accuracy (Acc) measures overall prediction correctness:

Accuracy formula: (TP+TN)/(TP+TN+FP+FN); statistical analysis equation.

Parameters (M) reflect model complexity, measuring total trainable parameters:

Parameters equation \(M = \sum_{i=1}^{N} P_i\), summation notation, mathematical formula.

where Pi is the number of parameters in the i-th layer, and N is the total number of layers. Smaller parameter counts indicate more lightweight models suitable for clinical deployment.

Ablation study protocol

Comprehensive ablation studies were conducted to validate architectural component contributions following the experimental design in Table 1. Four architectural variants were evaluated: H-MUNet (baseline without MSDAFN and PMFlex), HP-MUNet (without MSDAFN), HM-MUNet (without PMFlex), and HMP-MUNet (complete model).

Identical training parameters were configured across all variants: learning rate 0.001, batch size 8, 250 epochs. Training convergence was monitored, and performance improvements were validated for each component addition.

Computational efficiency analysis

The computational efficiency metrics, including parameter count, FLOPs, and inference time across different architectures, were measured. The evaluation of the model's inference time on a standard clinical-grade GPU shows that, although it performs best on high-performance GPUs, the model is approximately 70% slower on more commonly used hardware. Nevertheless, it is still capable of efficient inference speeds, making it suitable for practical clinical deployment. Monitor GPU memory usage during training to ensure system stability. Recommended minimum 16 GB GPU memory for batch size 8.

Validation and analysis

Performance benchmarking

The performance of HMP-MUNet was compared against state-of-the-art methods on both datasets. All compared models were implemented and trained under the same data splits, preprocessing, data augmentation, and training protocols to ensure that performance differences were solely due to architectural differences. The quantitative results, including DSC improvements of 2.89% and 5.25% on the ISIC2018 and PH2 datasets, were documented respectively. The study validated that the parameter count is reduced by 4.55 times compared to the U-Net baseline.

Statistical analysis

Statistical significance testing was performed using paired t-tests for performance comparisons. Confidence intervals were calculated for the reported metrics. Reproducibility was ensured through multiple training runs with different random seeds.

The optimal hyperparameter configurations were recorded as batch size 8 and learning rate 0.001, achieving a peak DSC of 0.9585 on the PH2 dataset and 0.9044 on the ISIC2018 dataset, as documented in the experimental results. Sufficient validation data were ensured to prevent overfitting. Validation loss curves were monitored to apply early stopping criteria.

Access restricted. Please log in or start a trial to view this content.

Results

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

HMP-MUNet architecture design for medical image segmentation

The proposed HMP-MUNet architecture demonstrated exceptional performance in automated cutaneous lesion segmentation tasks. Figure 1 illustrates the complete network architecture, showcasing the hierarchical U-shaped encoder-decoder structure with progressive channel expansion from 8 to 256 channels. The integration of three specialized modules in alternating configuration proved highly e...

Access restricted. Please log in or start a trial to view this content.

Discussion

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This study presents HMP-MUNet (High-order Multi-scale Parallel Vision Mamba U-Net), a novel deep learning framework that addresses fundamental challenges in computer-aided diagnosis (CAD) for cutaneous lesion segmentation through innovative integration of State-Space Models (SSMs) with advanced architectural components1. The approach described here demonstrates that combining high-order feature interaction mechanisms with multi-scale attention and parallel processing can achieve superior diagnosti...

Access restricted. Please log in or start a trial to view this content.

Disclosures

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors declare that they have no conflicts of interest related to this research. No financial relationships exist between the authors and any commercial entities that could inappropriately influence the work presented in this manuscript. This research was conducted independently, and the findings and conclusions are solely those of the authors. The text of this manuscript was revised and polished with the assistance of ChatGPT, as English is not the authors' native language. The authors confirm that the use of AI assistance was limited to language editing and did not involve any content generation or analysis that would affect the scientific integrity of the work.

Acknowledgements

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors gratefully acknowledge the financial support provided by the Scientific Research Project of Liaoning Provincial Department of Education under Grant LJ212510149013 and General Program of National Natural Science Foundation of Liaoning Province 2024-MSLH-377, which made this research possible. We thank the research participants and institutions that contributed to the publicly available datasets used in this study, which enabled comprehensive validation of our proposed methodology.

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
CUDA 11.8NVIDIA Corporation, Santa Clara, CA, USASoftware
GPU (32 GB VRAM)NVIDIAOperating system
ISIC2017 DatasetISIC Challengehttps://challenge.isic-archive.com/dataDatasets
ISIC2018 DatasetISIC Challengehttps://challenge.isic-archive.com/dataDatasets
NVIDIA V100 GPUNVIDIA Corporation, Santa Clara, CA, USAHardware
PH2 DatasetUniversidade Do Portohttps://www.fc.up.pt/addi/ph2Datasets
Python 3.8PythonRRID:SCR_018536Software
PyTorch 1.13.0PyTorchRRID:SCR_018536Software
Ubuntu 20.04CanonicalHardware

References

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,
  1. Maurya, S., et al. A review on recent developments in cancer detection using machine learning and deep learning models. Biomed Signal Process Control. 80 (2), 104398(2023).
  2. Siegel, R. L., Miller, K. D., Wagle, N. S., Jemal, A. Cancer statistics, 2023. CA Cancer J Clin. 73 (1), 17-48 (2023).
  3. Esteva, A., et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 542 (7639), 115-118 (2017).
  4. Haenssle, H. A., et al. against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann Oncol. 29 (8), 1836-1842 (2018).
  5. Argenziano, G., et al. Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. J Am Acad Dermatol. 48 (5), 679-693 (2003).
  6. Naeem, A., et al. SNC_Net: skin cancer detection by integrating handcrafted and deep learning-based features using dermoscopy images. Mathematics. 12 (7), 1030(2024).
  7. Celebi, M. E., et al. A state-of-the-art survey on lesion border detection in dermoscopy images. Dermoscopy Image Anal. 10, 97-129 (2015).
  8. Nachbar, F., et al. The ABCD rule of dermatoscopy: high prospective value in the diagnosis of doubtful melanocytic skin lesions. J Am Acad Dermatol. 30 (4), 551-559 (1994).
  9. Ronneberger, O., Fischer, P., Brox, T. U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Interv. 9351, 234-241 (2015).
  10. Gu, A., Dao, T. Mamba:linear-time sequence modeling with selective state spaces. arXiv. , (2023).
  11. Liu, Y., et al. Vmamba: visual state space model. Adv Neural Inf Process Syst. 37, 103031-103063 (2024).
  12. Zhang, J., Zhu, H., Wang, P., Ling, X. ATT squeeze U-net: a lightweight network for forest fire detection and recognition. IEEE Access. 9, 10858-10870 (2021).
  13. U-net v2: rethinking the skip connections of U-net for medical image segmentation. Peng, Y., Chen, D. Z., Sonka, M. 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), Houston, TX, USA, , (2025).
  14. Zhou, Z., et al. UNet++: a nested U-net architecture for medical image segmentation. Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2018). 11045, 3-11 (2018).
  15. Hu, S., Liao, Z., Xia, Y. Devil is in channels: contrastive single domain generalization for medical image segmentation. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. , Springer. Cham. (2023).
  16. Xu, W., Wang, Z. SCRNet:spatial-channel regulation network for medical ultrasound image segmentation. arXiv. arXiv. , (2025).
  17. Yue, Y., Li, Z. MedMamba: vision mamba for medical image classification. arXiv. , (2024).
  18. Efficiently modeling long sequences with structured state spaces. Gu, A., Goel, K., Ré, C. Proc Int Conf Mach Learn, 162, 8098-8109 (2022).
  19. Wu, R., Liu, Y., Liang, P., Chang, Q. UltraLight VM-UNet: parallel vision mamba significantly reduces parameters for skin lesion segmentation. arXiv. , (2024).
  20. Wu, R., Liu, Y., Liang, P., Chang, Q. H-vmunet:high-order vision mamba unet for medical image segmentation. Neurocomput. 624, 129447(2025).
  21. Fully convolutional networks for semantic segmentation. Long, J., Shelhamer, E., Darrell, T. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, , (2015).
  22. Chen, J., et al. TransUNet: transformers make strong encoders for medical image segmentation. arXiv. , (2021).
  23. Cao, H., et al. Swin-unet:unet-like pure transformer for medical image segmentation. Lect Notes Comput Sci. 13803, 205-218 (2023).
  24. Ibtehaz, N., Rahman, M. S. MultiResUNet: rethinking the U-net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74-87 (2020).
  25. Aruk, I., Pacal, I., Toprak, A. N. A novel hybrid ConvNeXt-based approach for enhanced skin lesion classification. Expert Syst Appl. 283, 127721(2025).
  26. Pacal, I., et al. A novel CNN-ViT-based deep learning model for early skin cancer diagnosis. Biomed Signal Process Control. 104, 107627(2025).
  27. Zhang, D. Y., et al. Implementation of digital pathology and artificial intelligence in routine pathology practice. Lab Invest. 104 (9), 102111(2024).
  28. Malunet: a multi-attention and lightweight unet for skin lesion segmentation. Ruan, J., Xiang, S., Xie, M., Liu, T., Fu, Y. 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Las Vegas, NV, USA, , (2022).
  29. Wu, R., et al. Mhorunet:high-order spatial interaction unet for skin lesion segmentation. Biomed Signal Process Control. 88, 105517(2024).
  30. Pacal, I., Attallah, O. Hybrid deep learning model for automated colorectal cancer detection using local and global feature extraction. Knowl Based Syst. 319, 113625(2025).
  31. Pacal, I., Attallah, O. InceptionNeXt-transformer: a novel multi-scale deep feature learning architecture for multimodal breast cancer diagnosis. Biomed Signal Process Control. 110, 108116(2025).
  32. Vaswani, A., et al. Attention is all you need. Adv Neural Inf Process Syst. 30, 5998-6008 (2017).
  33. Phillips, M., et al. Assessment of accuracy of an artificial intelligence algorithm to detect melanoma in images of skin lesions. JAMA Netw Open. 2 (10), e1913436(2019).
  34. Wang, S., et al. Linformer:self-attention with linear complexity. arXiv. , (2020).
  35. A simple framework for contrastive learning of visual representations. Chen, T., et al. Proceedings of the 37th International Conference on Machine Learning, 119, Vienna, Austria. 1597-1607 (2020).
  36. Huang, S. C., et al. Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines. NPJ Digit Med. 3, 136(2020).
  37. Litjens, G., et al. A survey on deep learning in medical image analysis. Med Image Anal. 42, 60-88 (2017).
  38. Campanella, G., et al. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med. 25 (8), 1301-1309 (2019).
  39. Gulshan, V., et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 316 (22), 2402-2410 (2016).
  40. McKinney, S. M., et al. International evaluation of an AI system for breast cancer screening. Nat. 577 (7788), 89-94 (2020).
  41. Krizhevsky, A., Sutskever, I., Hinton, G. E. ImageNet classification with deep convolutional neural networks. Commun ACM. 60 (6), 84-90 (2017).

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

U Net ArchitectureState Space ModelsMulti Scale ProcessingAttention MechanismsComputer Aided DiagnosisFeature ExtractionVision Mamba

Related Articles