In an incident that took place in Orlando, USA, a 14-year-old ninth grade student was killed. Sewell Setzer III He committed suicide. The young man’s family blames the artificial intelligence called Character.AI for this suicide. According to the mother, the son When you start talking to chatbots He isolated himself.

Reportedly Setzer Character.AI especially with bots in a role-playing application “Dany” He developed an emotional bond with the bot and started sending him messages constantly. Over time, this situation began to alienate him from the real world.

He told the chatbot that he was thinking about suicide

Reportedly Setzer suicidal thoughts He also confessed to the chatbot and even continued to message with the bot until shortly before his death.

Character.AI solves similar situations so that it doesn’t happen again is in action. The company’s statement said it is working on features like “enhanced detection, response, and intervention” regarding chats that violate its terms of service and sending notifications when a user has been in a chat for an hour.

Chat and friendship bots for artificial intelligence a growing market appears as. A chatbot, on the other hand, is often designed to give people pleasant answers, and the effects of “friendships” formed with these bots on people’s mental health is an area that hasn’t been much studied.

What do you think of friendship bots based on artificial intelligence?