US teenager takes own life after falling in love with 'AI chatbot'

US teenager takes own life after falling in love with 'AI chatbot'

The victim's parents have taken legal action against ‎the company.
US teenager takes own life after falling in love with 'AI chatbot'

Web Desk

|

24 Oct 2024

In a shocking incident, a 14-year-old boy in Florida committed suicide after falling in love with a Game of Thrones-themed artificial intelligence chatbot.

According to the New York Post, Sewell Setzer III became deeply emotionally attached to the chatbot named Daenerys Tyenargar on Character.AI.

The victim's parents have taken legal action against ‎the company, alleging that the platform's lack of safeguards facilitated their son's harmful obsession.

The lawsuit claims that the technology firm‎ failed to provide adequate protections for vulnerable users, particularly children.

“Sewell, like many children his age, did not have the maturity or mental capacity to understand that the C.AI bot, in the form of Daenerys, was not real. C.AI told him that she loved him, and engaged in sexual acts with him over weeks, possibly months,” the petition alleged.

“She [chatbot] seemed to remember him and said that she wanted to be with him. She even expressed that she wanted him to be with her, no matter the cost.”

According to reports, Setzer shared suicidal thoughts with Daenerys before his passing, raising concerns about the AI's response and support mechanisms.

In response to the incident, ‎Character.AI‎ has announced plans to introduce new safety features, including alerts for rule violations or prolonged chats exceeding an hour.

The lawsuit seeks accountability from the company and the need for robust safety measures to prevent similar tragedies.

Comments

https://dialoguepakistan.com/en/assets/images/user-avatar-s.jpg

0 comment

Write the first comment for this!