Improvement of Conflict Detection and Resolution at High Densities Through Reinforcement Learning

Improvement of Conflict Detection and Resolution at High Densities Through Reinforcement Learning

Ribeiro, M.J. (TU Delft Control & Simulation)
Ellerbroek, Joost (TU Delft Control & Simulation)
Hoekstra, J.M. (TU Delft Control & Operations)

Control & Operations

2020

The use of drones for applications such as package delivery, in an urban setting, would result in traffic densities that are orders of magnitude higher than any observed in manned aviation. Current geometric resolution models have proven to be very efficient. However, at the extreme densities envisioned for such drone applications, performance is hindered by unpredictable emergent behaviour of interacting traffic. This paper describes a study that intends to investigate how reinforcement learning techniques can be used to complement geometric methods, thus improving conflict detection and resolution at high traffic densities. Different hybrid approaches are discussed, and preliminary results are shown for a hybrid model that uses geometric methods in the training phase of a Deep Deterministic Policy Gradient (DDPG) model.

Conflict Detection and Resolution (CD&R)
reinforcement learning (RL)
Deep Deterministic Policy Gradient (DDPG)
Modified Voltage Potential (MVP)
U-Space
Unmanned Traffic Management (UTM)
Self-Separation
BlueSky ATM Simulator

http://resolver.tudelft.nl/uuid:d3bf3c0d-16bf-4ca4-b695-2868d761c129

ICRAT 2020

ICRAT 2020: International conference on research in air transportation, 2020-09-15, Virtual/online event due to COVID-19

Virtual/online event due to COVID-19

Institutional Repository

conference paper

© 2020 M.J. Ribeiro, Joost Ellerbroek, J.M. Hoekstra