Print Email Facebook Twitter HoloNav: HoloLens as a Surgical Navigation System Title HoloNav: HoloLens as a Surgical Navigation System: Detecting optical reflective spheres using YOLOv5 and the Hololens' grayscale cameras Author Tan, Ee Xuan (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Marroquim, Ricardo (mentor) Benmahdjoub, Mohamed (mentor) Ambrosini, P. (mentor) Hanjalic, A. (graduation committee) Degree granting institution Delft University of Technology Programme Computer Science and Engineering Project CSE3000 Research Project Date 2022-06-22 Abstract Surgical navigation is a tool that surgeons rely on everyday to perform accurate surgeries all over the world. However, this technology requires good hand-eye coordination and a high level of concentration. HoloNav is a project that inquires to see if using the HoloLens and augmented reality can replace the current surgical navigation methods. To do so, the HoloLens must be able to identify the patient and the location of the surgery instruments, which uses optical reflective spheres. This study focuses on using the grayscale cameras of the HoloLens and a deep learning algorithm YOLOv5 to test if it is possible to precisely detect optical reflective spheres. 3 models were trained with two different data sets, where the results show that the model trained on a data set would perform well on the validation set. However, they would perform far worse when exposed to a data set it was not trained on. Subject YOLODeep LearningSurgical Navigation To reference this document use: http://resolver.tudelft.nl/uuid:e046dfc3-9bc5-41c4-b638-174999abb8bd Part of collection Student theses Document type bachelor thesis Rights © 2022 Ee Xuan Tan Files PDF HoloNav_Ee_Xuan_Tan.pdf 1.52 MB Close viewer /islandora/object/uuid:e046dfc3-9bc5-41c4-b638-174999abb8bd/datastream/OBJ/view