Print Email Facebook Twitter Towards Robust Object Detection in Unseen Catheterization Laboratories Title Towards Robust Object Detection in Unseen Catheterization Laboratories Author Wang, Zipeng (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Dauwels, J.H.G. (mentor) Butler, R.M. (mentor) van den Dobbelsteen, J.J. (graduation committee) Degree granting institution Delft University of Technology Programme Electrical Engineering Date 2024-01-29 Abstract Deep-learning-based object detectors, while offering exceptional performance, are data-dependent and can suffer from generalization issues. In this thesis, we investigated deep neural networks for detecting people and medical instruments in the vision-based workflow analysis system inside Catheterization Laboratories (Cath Labs). The central problem explored in this thesis is the fact that the performance of the detector can degrade drastically if it is trained and tested on data from different Cath Labs. Our research aimed to investigate the underlying causes of this specific performance degradation and find solutions to mitigate this issue. We employed the YOLOv8 object detector and created datasets from clinical procedures recorded at Reinier de Graaf Hospital (RdGG) and Philips Best Campus, supplemented with publicly accessible images. An aggregated version of object detection metrics was created for multi-camera system evaluation. Through a series of experiments complemented by data visualization, we discovered that the performance degradation primarily stems from data distribution shifts in the feature space. Notably, the object detector trained on non-sensitive online images can generalize to unseen Cath Labs, outperforming the model trained on a procedure recording from a different Cath Lab. The detector trained on the online images achieved an mAP@0.5 of 0.517 on the RdGG dataset. Furthermore, by switching to the most suitable camera for each object, the multi-camera system can further improve detection performance significantly. An aggregated 1-camera mAP@0.5 of 0.679 is achieved for single-object classes on the RdGG dataset. Subject Object DetectionCatheterization LaboratoryDomain Generalization To reference this document use: http://resolver.tudelft.nl/uuid:c4b2d25c-0b2e-41e1-9d2b-32b9e0c88bb2 Part of collection Student theses Document type master thesis Rights © 2024 Zipeng Wang Files PDF MSc_Zipeng_Wang_Cath_Lab2.pdf 11.53 MB Close viewer /islandora/object/uuid:c4b2d25c-0b2e-41e1-9d2b-32b9e0c88bb2/datastream/OBJ/view