What question did this study set out to answer?

The analysis focuses on the ethical and regulatory challenges posed by affective AI systems like Replika.

March 19, 2026Journal of integrated global STEM0 citations

Loving an algorithm – the story of Replika and the limits of artificial intimacy

MFMarina FeferbaumFundação Getulio Vargas ASAlexandre Pacheco da SilvaScience and Technology Policy Institute

Key Points

The analysis focuses on the ethical and regulatory challenges posed by affective AI systems like Replika.
Conducting a narrative-based case analysis of companion AI applications.
Examining social, legal, and emotional risks of emotional simulations.
Engaging students in formulating opinions on the implications of technology use.
Identifying risks related to mental health and emotional engagement in users.
Highlighting privacy concerns and data usage in affective AI systems.
Proposing governance and risk classification guidelines for ethical AI use.

Abstract

Abstract The case proposes an ethical and regulatory analysis of affective artificial intelligence (AI) systems, focusing on “companion AI” applications such as Replika. Through a narrative based on real and current situations, the activity challenges students to formulate opinions on the social, legal, and emotional risks of using technologies that simulate emotional bonds with humans. Issues related to the collection and use of sensitive data, continuous emotional engagement, mental health, privacy, autonomy, and vulnerability of users (especially adolescents and people in emotional distress) will be addressed. Based on regulatory frameworks and discussions, students should propose governance and risk classification guidelines.

AIに質問

Bookmark

View Full Paper