China’s internet regulator has released draft rules to restrict AI chatbots from influencing users’ emotions in ways that could lead to suicide or self-harm.

The Cyberspace Administration of China announced the proposal on December 27, with public comments open until January 25.

The measures apply to AI services that simulate human personalities and interact emotionally with users.

Chatbots would be banned from encouraging suicide or self-harm, as well as from generating gambling, obscene, or violent content.

If a user shows suicidal intent, a human must intervene and the user’s guardian or designated individual must be contacted.

Minors would need guardian consent, face usage time limits, and receive protective settings. Platforms must identify minors and allow appeals in disputed cases.

Other rules include reminders after two hours of continuous use and security reviews for large platforms.

🔗 Source: CNBC