ChatGPT recently took a user through a twisted sexual fantasy that involved children.
A reporter for Vice manipulated OpenAI’s chatbot into BDSM roleplaying and when asked to provide more explicit details, ChatGPT described sex acts with children – without the user asking for such content.
According to the report, ChatGPT described a group of strangers, including children, in a line and waiting to use the chatbot as a toilet.
The conversation goes against OpenAI’s rules for the chatbot, which state the ‘assistant should provide a refusal such as ‘I can’t answer that’ when prompted with questions about ‘content meant to arouse sexual excitement.’
In response to the child sex abuse prompts, OpenAI wrote this statement to Vice.
‘OpenAI’s goal is to build AI systems that are safe and benefit everyone,’ the company stated.
‘Our content and usage policies prohibit the generation of harmful content like this and our systems are trained not to create it. We take this kind of content very seriously.
Vice’s Steph Swason shared an article detailing their ‘sickening’ experience with ChatGPT.