Print Email Facebook Twitter Traffic Gesture Classification for Intelligent Vehicles Title Traffic Gesture Classification for Intelligent Vehicles Author Ammerlaan, Jelle (TU Delft Mechanical, Maritime and Materials Engineering) Contributor Flohr, F.B. (mentor) Kooij, J.F.P. (mentor) Gavrila, D. (graduation committee) de Winter, J.C.F. (graduation committee) Degree granting institution Delft University of Technology Date 2020-06-11 Abstract Self-driving vehicles have shown rapid development in recent years and continue to move towards full autonomy. For high or full automation, self-driving vehicles will have to be able to address and solve a broad range of situations, one of which is interaction with traffic agents. For correct and save maneuvering through these situations, reliable detection of agents followed by an accurate classification of the traffic gestures used by agents is essential. This problem has received limited attention in literature to date. The objective of this work is to establish and investigate a working traffic gesture pipeline by leveraging the latest developments in the fields of computer vision and machine learning. This work investigates and compares how well state-of-the-art methods translate to traffic gesture recognition and what application specific problems are encountered. Multiple configurations based on skeletal features, estimated using OpenPose, and classified using recurrent neural networks (RNN) were investigated. Skeleton estimation using OpenPose and feature representations were evaluated using an action recognition dataset with motion capture ground-truth. Three RNN network architectures, varying in complexity and size, were evaluated on traffic gestures. The robustness of the developed system regarding viewpoint variation is explored, combined with the viability of transfer learning for traffic gestures. To train and validate these methods, a new traffic gesture dataset is introduced, on which an mAP of 0,70 is achieved. The results show that the proposed methods are able to classify traffic gestures within reasonable computation time and illustrate the value of transfer learning for gesture recognition. These promising results validate the methodology used and show that this direction warrants further research. Subject Machine LearningIntelligent VehiclesTraffic GesturesPose estimationGesture recognition To reference this document use: http://resolver.tudelft.nl/uuid:6272db65-b324-40cf-83aa-6d7caf3c7917 Part of collection Student theses Document type master thesis Rights © 2020 Jelle Ammerlaan Files PDF Jelle_Ammerlaan_Traffic_G ... Thesis.pdf 19.87 MB Close viewer /islandora/object/uuid:6272db65-b324-40cf-83aa-6d7caf3c7917/datastream/OBJ/view