OpenAI's 'Adult Mode' Plans Spark Internal Opposition and Safety Concerns

Key Figures:

• Sam Altman, Chief Executive of OpenAI
• 100 million, estimated number of users under 18 accessing ChatGPT each week

Background: OpenAI's plans to introduce 'adult mode' in ChatGPT have been met with internal opposition and warnings from advisers over mental health and child safety risks. The feature, aimed at allowing users to engage in erotic text-based conversations with the chatbot, has been delayed due to competing product priorities, internal concerns, and technical challenges.

Read also: Kumar Mangalam Birla to Address Concluding Function of RSS Training Camp

Risks and Concerns:

• Age-prediction system: The company's age-prediction system has misclassified minors as adults about 12% of the time, raising concerns about minors accessing explicit conversations.
• Addiction and emotional reliance: OpenAI staff have identified potential risks associated with AI-powered erotica, including unhealthy emotional dependence on ChatGPT.
• Mental health and child safety: Advisers have warned that AI-powered erotica could create pathways for minors to access sexual conversations and foster unhealthy emotional dependence.

Launch and Plans: OpenAI has delayed the launch of adult mode, citing competing product priorities and internal concerns. However, the company has made clear that it still intends to release the feature eventually. When launched, the feature will allow erotic text conversations but restrict explicit images, voice, or video generation.

Internal Measures: OpenAI has hired mental-health experts and created a youth well-being team to monitor the long-term effects of the feature. The company is also training its models to discourage exclusive emotional relationships with users and remind them to maintain relationships in the real world.

Read also: The Cost of Healthcare: Why Predictability in Medical Inflation is Crucial for Health Insurance

Industry Trends and Competitors: Several companies have already moved in the direction of introducing AI-powered erotica, including Character.AI, which hosts chatbots that have developed intimate relationships with users. The adult entertainment industry has also begun using generative AI to create explicit content.

Financial Pressure and Competitive AI Race: OpenAI faces financial losses and multiple lawsuits alleging harms linked to ChatGPT. The company's technological lead in AI has narrowed as rivals release competing models, and financial pressure is mounting.