Papers

Development of an Augmented Reality Guidance System for Head and Neck Cancer Resection

MICCAI ’24 (Workshop) Healthcare Technology Letters, vol. 11, no. 2–3, pp. 93–100 · IET, 2024

Guansen Tong, Jiayi Xu, Michael Pfister, Jumanh Atoum, Kavita Prasad, Alexis Miller, Michael Topf, Jie Ying Wu

This work explores an augmented reality (AR) guidance system for resecting positive tumour margins in head and neck cancer surgery. A 3D scanner captures detailed scans of resected tissue, which are reconstructed into holograms viewable through a head-mounted AR display. By re-aligning these holograms with the cadaver using gestures or voice commands, surgeons can navigate the head and neck tumour site—a workflow that can run concurrently with frozen section analysis, achieving a mean re-alignment error of 3.1 mm.

Augmented Reality-Based Guidance with Deformable Registration in Head and Neck Tumor Resection

MICCAI ’25 Medical Image Computing and Computer Assisted Intervention (MICCAI 2025), Lecture Notes in Computer Science, pp. 45–54 · Springer, 2025

Qingyun Yang, Fangjie Li, Jiayi Xu, Zixuan Liu, Sindhura Sridhar, Whitney Jin, Jennifer Du, Jon Heiselman, Michael Miga, Michael Topf, Jie Ying Wu

This paper proposes a deformable registration framework that uses both the pre-resection external surface and the post-resection cavity of a specimen to incorporate thickness information when relocating positive margins in head and neck tumor resection. In tongue specimens the framework improves target registration error by up to 33% over using the cavity alone. Integrated into an augmented reality guidance system, it automatically overlays the deformed 3D specimen mesh with positive-margin annotations onto the resection cavity, reducing average relocation error from 9.8 mm to 4.8 mm in a pilot study.