Abstract Personal ethical preferences are key enablers for the design of autonomous systems that respect humans’ moral rights and values. This goes beyond embedding ethical and legal principles in the design of the system once and for all. It requires the ability to elicit personal soft ethical preferences, represent them in a digitally useable format, and link them to the individual for use when interacting with digital systems. The aim of this paper is to represent soft ethical preferences through dispositions. Dispositions are properties that are instantiated by any kind of entity and that may manifest if properly triggered; we will focus on moral dispositions of individuals. The dispositional properties in which we are interested are ethical and behavioural ones. We propose a general and formal model to elicit and handle individual moral preferences. The model allows for the examination of real-life situations involving moral dilemmas. Users engage with these scenarios, respond based on how they would act, and provide justifications for their choices. Their responses are then analysed to identify tendencies toward certain actions, which are represented as dispositions. These dispositions can subsequently serve as the foundation for disposition manifestation mechanisms.
Donati et al. (Sun,) studied this question.