Augmented Reality-Based Visualization of a Resected Tumor Specimen

Place a resected tumor specimen on a 3D scanning table connected to a computer. Scan the anterior and posterior surfaces to create a 3D image.

Once this 3D image matches the physical specimen, open it in augmented reality or AR software.

Wear a head-mounted display or HMD and connect it wirelessly to the AR software.

This allows visualization of the 3D image through the HMD device as a virtual hologram of the specimen.

Align and anchor the hologram to ensure spatial accuracy within the AR environment, then apply textures to enhance realism.

Use a voice command to open the hologram in a virtual environment and, with hand gestures, reposition, rotate, and adjust the size.

Alternatively, use voice commands for hands-free adjustments.

This augmented reality-based visualization generates a tumor hologram that aids in precise margin identification at the surgery site.

To begin, gently pat dry a rinsed, resected oncologic specimen. Take 2D photographs of the anterior and posterior surfaces of the specimen.

Place the specimen on a 3D scanner's plastic-covered turntable. Scan the specimen's anterior and posterior surfaces to obtain a 3D image.

Use three-point data cross-registration to alig