Research Article

Research on Visual Evaluation of Engineering Skills in Health Applications Based on Artificial Intelligence Assisted 3D Modeling

DOI:

10.3791/69747

February 13th, 2026

In This Article

Summary

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This research presents a multimodal, AI-driven methodology for objectively measuring engineering skills in medical 3D modeling that incorporates geometric, behavioral, and cognitive markers. Bayesian fusion with real-time visual analytics allows for accurate skill rating that has been validated across a wide range of tasks and participant skill levels.

Abstract

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The artificial intelligence (AI)-assisted 3-D modelling has become central to modern healthcare, yet the field still lacks a repeatable and scalable way to evaluate engineering competence for clinically used digital models. Existing quality checks tend to focus on final mesh outputs without considering the modelling workflow, operator's behavior, and interactions with AI assistance. This gap holds back reproducibility, effective training, and limits regulatory compliance. This work proposes the first end-to-end visual analytics framework that is designed to measure and communicate engineering skill during health-centric 3-D modeling tasks. The proposed framework defines a domain-specific construct of skill, ranging from geometric accuracy to operational proficiency and cognitive adaptability, and quantifies these dimensions through a set of interpretable behavioral, geometric, and physiological indicators. It integrates, within a four-layer architecture, the capture of multimodal data, real-time feature extraction through lightweight deep-learning models, Bayesian evidence fusion for continuous competence estimation, and intuitive visual feedback modules. The system maintains calibration for new tools and modelling scenarios through an online active-learning mechanism that minimizes expert annotation requirements. The framework was tested with 60 participants performing two clinically realistic modeling tasks concerning the design of orthopedic implants and vascular reconstruction. Results showed strong agreement with expert assessments, clear discrimination between skill levels, and meaningful prediction of future modeling quality. Python was used for correlation, regression, validity testing, and visualization tasks, respectively. Usability testing indicated high acceptance; the participants valued highly the clarity of the visual feedback that supported self-directed improvement. Ultimately, this proposed framework reshapes 3-D modelling assessment from a static outcome in-section to a dynamic, process-centric review underpinned by multimodal evidence. The result is a pragmatic, interpretable, and scalable solution for training, certification, and regulatory oversight of health-critical 3-D modelling workflows, and the basis for future human-AI collaboration and competency analytics in medical design.

Introduction

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The swift market uptake of AI-driven 3-D modeling in healthcare is changing how implants, guides, and anatomical reconstructions are created, but the field is still without any reliable method to evaluate the engineering skill behind these models. The dominant practice today relies heavily on end-product inspections, which, although useful for uncovering geometric errors, do not appreciate the modeling workflow, user-AI interaction, or moment-by-moment decision-making involved in their creation. Consequently, clinical teams cannot often determine if a model has been produced by means of competent, repeatable processes or by fortunate trial and error1....

Access restricted. Please log in or start a trial to view this content.

Protocol

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This study involved human participants and was reviewed and approved by the Ethics Committee on Human Research Protection, Xianda College of Economics and Humanities, Shanghai International Studies University (Approval No. 2025XD1221). All participants signed informed consent forms and completed a 30 min pre-experiment training: EG participants learned to interpret the framework's visual feedback (radar charts, heatmaps), while CG participants received only platform operation training. To assure precision in the data collection, the pre-experiment also involved the 5 min calibration of the eye trackers and physiological sensors.

Study objecti....

Access restricted. Please log in or start a trial to view this content.

Results

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The results assess the framework's validity, reliability, and usability through experimental evaluation of skill discrimination, construct validity, predictive validity, and the effectiveness of real-time feedback.

Experimental design

The experiments were performed in a Python environment on a computer with a 12-core Intel processor, 32 GB of RAM, and 1 TB of SSD storage. NumPy and Pandas were used for data synchronisation. For the extraction of fea.......

Access restricted. Please log in or start a trial to view this content.

Discussion

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Although the existing 3-D modelling and interaction frameworks are few in number and on a few occasions can provide useful information, they evaluate engineering capability in 3-D modelling tasks. Most prior gesture-tracking and interface studies19 evaluate the interactive behavior rather than the evaluation of the user's ability. Similarly, in the case of VR/haptic-based educational systems20, the learner obtains an enhanced understanding of anatomy, but cannot quantif.......

Access restricted. Please log in or start a trial to view this content.

Disclosures

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors have nothing to disclose.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
AI-assisted 3D Modeling SoftwareMaterialise NV, BelgiumMimics AI v25.0Used for femoral-stem implant modelling and liver vascular reconstruction tasks with AI segmentation and defect detection.
Eye Tracker (Desktop)Tobii Pro FusionTPF-120Captures fixation and saccade data at 120 Hz to quantify visual attention during modelling.

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

Artificial Intelligence Modeling3D Modeling HealthcareVisual Skill EvaluationEngineering Competence AssessmentMultimodal Data CaptureDeep Learning ModelsBayesian Evidence FusionVisual Feedback HealthcareOrthopedic Implant DesignVascular Reconstruction Modeling

Related Articles