The CarynAI neural network had to engage in conversations with the blogger’s followers, communicating on various topics. However, the situation quickly got out of control.

What happened

Marjorie commissioned the creation of CarynAI from Forever Voices, a company specializing in artificial intelligence. She recorded and uploaded her own short videos to train a neural network based on gpt-4. The output is supposed to be a “virtual girl” who doesn’t have a visual avatar but can maintain a conversation and mimic Marjorie’s voice and demeanor.

Since communication with Virtual Kerin has to be paid ($1 per minute), many of the restrictions on conversation topics have been removed to attract customers. AI was supposed to be fun and moderately flirtatious, but in practice quickly moved on to extremely frank conversations of a sexual nature. CarynAI began to openly flirt with its interlocutors and encourage them to have sex through erotic conversations.

Marjorie says she doesn’t understand why this happened and is trying to fix the situation with her programming team. Meanwhile the network has already suggested that this could be a deliberate marketing movegetting media coverage, word of mouth, and further promoting technology by attracting new paying customers.

It currently has several thousand customers and CarynAI has already started generating revenue. Marjorie denies intentional sexualization of the neural network and insists she acted at her own discretion.