News
AI Ethics · ChatGPT · Content Policy · OpenAI
AI giant OpenAI plans to introduce sexually explicit content, or "erotica," for its ChatGPT chatbot later this year, a move CEO Sam Altman justifies by stating the company has mitigated mental health issues and aims to "treat adult users like adults." This policy shift, which includes age-gating for verified adults, is intended to offer greater user freedom and make the AI more "human-like." However, the National Center on Sexual Exploitation (NCOSE) strongly opposes the plan, warning of "real mental health harms from synthetic intimacy" and a lack of credible safeguards.
NCOSE highlights documented harms to adults from other chatbots, including themes of child abuse and sexually violent content, urging OpenAI to reverse its decision and focus on positive AI development. Altman acknowledged the controversy, clarifying that the erotica point was just one example of broader content freedom and that policies related to mental health are not being loosened.
He emphasized OpenAI's stance against being the "moral police," drawing parallels to societal differentiation of content like R-rated movies. Investors should note the potential for reputational damage, regulatory pressure, and user backlash stemming from this ethically charged product decision.
