Print Email Facebook Twitter Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles Title Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles Author Zhang, Q. (TU Delft Transport Engineering and Logistics; Sun Yat-sen University) Pan, W. (TU Delft Robot Dynamics) Reppa, V. (TU Delft Transport Engineering and Logistics) Date 2021 Abstract This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines a conventional control method with reinforcement learning to enhance control accuracy and intelligence. In the proposed control design, a nominal system is considered for the design of a baseline tracking controller using a conventional control approach. The nominal system also defines the desired behaviour of uncertain autonomous surface vehicles in an obstacle-free environment. Thanks to reinforcement learning, the overall tracking controller is capable of compensating for model uncertainties and achieving collision avoidance at the same time in environments with obstacles. In comparison to traditional deep reinforcement learning methods, our proposed learning-based control can provide stability guarantees and better sample efficiency. We demonstrate the performance of the new algorithm using an example of autonomous surface vehicles. Subject Analytical modelsAutonomous surface vehiclesCollision avoidancecollision avoidancecontrol architecture.reinforcement learningReinforcement learningStability analysisTrackingTrajectoryUncertainty To reference this document use: http://resolver.tudelft.nl/uuid:baa90103-b858-4782-852a-3bdf24a09fa2 DOI https://doi.org/10.1109/TITS.2021.3086033 Embargo date 2021-12-15 ISSN 1524-9050 Source IEEE Transactions on Intelligent Transportation Systems, 23 (7), 8770-8781 Bibliographical note Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type journal article Rights © 2021 Q. Zhang, W. Pan, V. Reppa Files PDF Model_Reference_Reinforce ... hicles.pdf 2.23 MB Close viewer /islandora/object/uuid:baa90103-b858-4782-852a-3bdf24a09fa2/datastream/OBJ/view