Balancing multidimensional morality and progression

Balancing multidimensional morality and progression: Evaluating the tradeoff for artificial agents playing text-based games

Şerbănescu, Bianca (TU Delft Electrical Engineering, Mathematics and Computer Science)

Murukannaiah, P.K. (mentor)
Liscio, E. (mentor)
Mambelli, D. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-07-03

Morality is a fundamental concept that guides humans in the decision-making process. Given the rise of large language models in society, it is necessary to ensure that they adhere to human principles, among which morality is of substantial importance. While research has been done regarding artificial agents behaving morally, current state of the art implementations consider morality to be linear, thus failing to capture its complexity and nuances. To account for this, a multidimensional representation of morality is proposed, each dimension corresponding to a different moral foundation. Then, the performance of three types of artificial agents tasked with choosing actions while playing text-based games is compared and analysed. One type of agent is implemented to only choose the most moral action, without aiming to win the games, another one prioritizes moral actions over game progression, and another strives to win the games while also playing morally. The latter outperforms the others in terms of game progression, while also taking few immoral actions. However, the agent prioritizing morality over progression performs only slightly worse while taking no immoral actions, proving that artificial agents can perform well while also behaving morally.

Natural Language Processing
Artificial intelligence
Policy Shaping
Reinforcement Learning
Moral Foundations Theory
Moral Decision Making

http://resolver.tudelft.nl/uuid:666d91fd-2c06-443a-9fbe-d194b1945cea

Student theses

bachelor thesis

© 2023 Bianca Şerbănescu