What is the impact of AI impersonation on family members and loved ones?

Question

Accepted Answer

The Psychological and Social Repercussions of AI Impersonation on Families

The circulation of AI-generated and manipulated images depicting an individual in fabricated relationships can inflict significant emotional distress on the targeted person and their family members. This form of digital impersonation, as experienced by a Singaporean man identified as Luke, involves not only the creation of false romantic narratives but also the misuse of personal photographs of relatives, leading to feelings of violation and fear. The psychological impact extends to loved ones who discover their own images being co-opted and presented in a misleading context, amplifying the sense of vulnerability and distress.
Emotional Distress from Fabricated Relationships and Family Image Misuse

Luke discovered in December 2025 that a former schoolmate, with whom he had minimal contact, was circulating AI-generated images portraying them as a couple with a baby. These doctored images evolved over months to include scenes of dates and implied pregnancies, creating a false reality. The distress intensified when the same individual used photographs of Luke's young nephew and niece, inserting herself into these images and presenting them as her own. Luke's sister reported that the family was deeply unsettled by this violation, particularly the exploitation of her children's images, leading to significant emotional turmoil.
Broader Implications of Impersonation and Online Harassment

The incident highlights a wider pattern of online impersonation, with several individuals contacting Luke's sister to report similar experiences with the same woman. These reports suggest that Luke's photos had been used for years to befriend others online, indicating a sustained effort to create false connections. This behaviour, according to a clinical psychologist, may stem from delusional thinking and a desire to construct an elaborate fantasy relationship. The ease with which AI can generate convincing false imagery exacerbates the potential for harassment and the erosion of trust in digital interactions.
Legal Recourse and Protective Measures

In response to the ordeal, Luke has lodged a police report, and legal avenues are being explored under Singapore's Protection from Harassment Act. This legislation offers recourse for impersonation, the creation of AI-generated images used for harassment, and the dissemination of false claims online. To mitigate further misuse of their personal data, Luke and his sister have responded by making their social media accounts private. This action underscores the growing need for individuals to actively manage their online presence and digital security in the face of sophisticated impersonation tactics.

Reading history

Hide →

This history is cleared when the page is closed.

What is the impact of AI impersonation on family members and loved ones?

Loading

Was this article helpful?

Helpful

Not helpful

Report an issue

2

0

0

Share with friends