The design of human oversight in autonomous weapon systems

The design of human oversight in autonomous weapon systems

Verdiesen, E.P. (TU Delft Information and Communication Technology)

Kraus, Sarit (editor)

2019

Autonomous Weapon Systems (AWS) can be defined as weapons systems equipped with Artificial Intelligence (AI). They are an emerging technology and are increasingly deployed on the battlefield. In the societal debate on Autonomous Weapon Systems, the concept of Meaningful Human Control (MHC) is often mentioned as requirement, but MHC will not suffice as requirement to minimize unintended consequences of Autonomous Weapon Systems, because the definition of ‘control’ implies that one has the power to influence or direct the course of events or the ability to manage a machine. The characteristics autonomy, interactivity and adaptability of AI in Autonomous Weapon Systems inherently imply that control in strict sense is not possible. Therefore, a different approach is needed to minimize unintended consequences of AWS. Several scholars are describing the concept of Human Oversight in Autonomous Weapon Systems and AI in general. Just recently Taddeo and Floridi (2018) describe that human oversight procedures are necessary to minimize unintended consequences and to compensate unfair impacts of AI. In my PhD project, I will analyse the concepts that are needed to define, model, evaluate and ensure human oversight in Autonomous Weapons and design a technical architecture to implement this.

http://resolver.tudelft.nl/uuid:01bb2cf4-38f2-4aa1-ac79-fe13325207eb

https://doi.org/10.24963/ijcai.2019/923

International Joint Conferences on Artificial Intelligence (IJCAI)

9780999241141

Proceedings of the 28th International Joint Conference on Artificial Intelligence, IJCAI 2019, 2019-August

28th International Joint Conference on Artificial Intelligence, IJCAI 2019, 2019-08-10 → 2019-08-16, Macao, China

Institutional Repository

conference paper

© 2019 E.P. Verdiesen