Print Email Facebook Twitter Modular Neural Network Navigation for Autonomous Nano Drone Racing Title Modular Neural Network Navigation for Autonomous Nano Drone Racing Author Magri, Federico (TU Delft Aerospace Engineering) Contributor de Wagter, C. (mentor) de Croon, G.C.H.E. (mentor) Ferede, R. (mentor) Bahnam, S.A. (mentor) Degree granting institution Delft University of Technology Programme Aerospace Engineering Date 2023-12-15 Abstract In this study, we present a first step towards a cutting-edge software framework that will enable autonomous racing capabilities for nano drones. Through the integration of neural networks tailored for real-time operation on resource-constrained devices. A lightweight Convolutional Neural Network, with the Gatenet architecture, is adjusted for reduced computational demand and is successfully deployed on a GAP8 processor at a rate of 16$Hz$. This network provides gates' size and location data for the subsequent positioning algorithm. A second neural network, trained through reinforcement learning, governs the drone's guidance and control systems, demonstrating a remarkable rate of 167$Hz$ on an STM32F405 processor. The attitude rates and thrust outputted by this network are then fed to an attitude rate PID controller.The research shows that state-of-the-art neural networks for drone racing can be deployed on nano drones, despite their limited processing power. Nonetheless, the study demonstrated specific limitations, such as the perception network's sensitivity to white pixels in the image reducing its effectiveness when light sources are present in the scene. These findings underscore the importance of dataset composition and the need for diverse training scenarios to enhance the neural network's generalizability and performance in real-world applications. Subject Reinforcement LearningConvolutional neural networkNano DronesQuantization To reference this document use: http://resolver.tudelft.nl/uuid:34213dbf-32ad-4f8d-b0f0-ed398608d682 Part of collection Student theses Document type master thesis Rights © 2023 Federico Magri Files PDF Thesis_Federico_Magri.pdf 69.6 MB Close viewer /islandora/object/uuid:34213dbf-32ad-4f8d-b0f0-ed398608d682/datastream/OBJ/view