Semantic Segmentation using Deep Neural Networks for MAVs

Semantic Segmentation using Deep Neural Networks for MAVs

Tran, Tommy (TU Delft Aerospace Engineering)

de Croon, G.C.H.E. (mentor)
Xu, Y. (mentor)
de Wagter, C. (graduation committee)
van Gemert, J.C. (graduation committee)

Delft University of Technology

Aerospace Engineering | Control & Simulation

2022-01-19

Semantic segmentation methods have been developed and applied to single images for object segmentation. However, for robotic applications such as high-speed agile Micro Air Vehicles (MAVs) in Autonomous Drone Racing (ADR), it is more interesting to consider temporal information as video sequences are correlated over time. In this work, we evaluate the performance of state-of-the-art methods such as Recurrent Neural Networks (RNNs), 3D Convolutional Neural Networks (CNNs), and optical flow for video semantic segmentation in terms of accuracy and inference speed on three datasets with different camera motion configurations. The results show that using an RNN with convolutional operators outperforms all methods and achieves a performance boost of 10.8% on the KITTI (MOTS) dataset with 3 degrees of freedom (DoF) motion and a small 0.6% improvement on the CyberZoo dataset with 6 DoF motion over the single-frame-based semantic segmentation method. The inference speed was measured on the CyberZoo dataset, achieving 321 fps on an NVIDIA GeForce RTX 2060 GPU and 30 fps on an NVIDIA Jetson TX2 mobile computer.

Micro Air Vehicle
Semantic Segmentation
Deep Learning
Convolutional Neural Network
Recurrent Neural Network
Optical Flow

http://resolver.tudelft.nl/uuid:7735d01c-b4cd-4173-a584-652f269c078c

Student theses

master thesis

© 2022 Tommy Tran