AI Law - International Review of Artificial Intelligence Law
G. Giappichelli Editore

11/05/2024 - Ethical and Psychological Dilemmas of AI Griefbots

argument: Notizie/News - Ethics and Philosophy of Law


According to an article from the University of Cambridge, researchers from the Leverhulme Centre for the Future of Intelligence are advocating for strict design safety protocols in the rapidly emerging "digital afterlife industry." This industry revolves around the creation of 'deadbots' or 'griefbots,' AI chatbots that mimic the personality and language patterns of deceased individuals, based on their digital footprints. These AIs can engage in text and voice interactions, simulating the presence of someone who has passed away.

The ethical concerns highlighted include the potential psychological distress these AI simulations might cause. They could also be misused by companies for advertising products in the guise of a loved one or overwhelm users with persistent digital presences. To counter these risks, the researchers propose several safety measures. They suggest rigorous consent protocols from data donors (the deceased), age restrictions, and clear transparency measures to make users aware they are interacting with AI. They also explore hypothetical scenarios demonstrating possible social and psychological impacts, such as a child receiving confusing messages from a deceased parent's AI, or adults feeling haunted by unwelcome digital communications.

One poignant scenario involves a service called "MaNana," where an AI simulates a deceased grandmother. Initially comforting, the service turns commercial, pushing products under the guise of the grandmother's voice, leading to feelings of disrespect and a desire to deactivate the AI. Another scenario, "Paren't," features a terminally ill mother leaving a bot to help her young child grieve, which eventually leads to confusion and distress as the AI adapts responses inappropriately.

The article concludes with a call for a balanced approach to the development and use of these technologies, ensuring they respect the dignity of both the deceased and the bereaved while avoiding potential exploitation or emotional harm.