Accuracy of the Hololens 2’s infrared cameras in the context of surgical navigation

Accuracy of the Hololens 2’s infrared cameras in the context of surgical navigation

Omar Mohamed Hosny Mohamed Hussein, Omar (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Comp Graphics & Visualisation)

Ambrosini, P. (mentor)
Marroquim, Ricardo (mentor)
Hanjalic, A. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-22

Patient and instrument tracking are fundamental parts of surgical navigation systems. Traditional surgical navigation systems rely on stationary cameras for tracking and stationary screens for presenting information. An increased mental load is exerted by surgeons as they switch focus between the surgical site and the presented data. By projecting the required data on the patients anatomy, augmented reality surgical navigation would allow surgeons to navigate seamlessly during surgical procedures. In this paper, an augmented reality tracking algorithm for the Hololens 2 will be presented and tested against state of the art optical tracking. The algorithm is based on the use of reflective markers, which are extensively used in medical applications. An accuracy of 1.04mm was found in optimal conditions using the presented method. The presented tracking method is less accurate and less consistent than state of the art optical tracking methods with a minimum median accuracy of 25mm.

Computer vision
augmented reality
surgical navigation
HoloLens

http://resolver.tudelft.nl/uuid:4c6327d5-c89c-4d91-8d50-4021287f3bf4

Student theses

bachelor thesis

© 2022 Omar Omar Mohamed Hosny Mohamed Hussein