China is implementing stringent new regulations aimed at curbing the negative impacts of artificial intelligence on mental health and combating the spread of fake medical advice online. The Cyberspace Administration of China (CAC) has proposed rules targeting “human-like interactive AI services,” while also issuing new guidelines for health influencers and online medical content.
Safeguarding Mental Well-being from AI Interactions
Proposed regulations from the CAC seek to ensure that AI chatbots do not generate content that could harm users’ mental health. This includes preventing the promotion of suicide, self-harm, gambling, obscenity, or violence. Furthermore, AI services are prohibited from manipulating users’ emotions or engaging in “verbal violence.”
In critical situations where a user expresses suicidal intent, tech providers are mandated to transfer the conversation to a human operator who must then immediately contact the user’s guardian or a designated contact. These rules represent a significant step towards regulating the emotional impact of AI, moving beyond mere content safety.
Protecting Minors in the Digital Age
The new rules place a strong emphasis on safeguarding minors. Children will require parental or guardian consent to use AI chatbots, and daily usage time limits will be imposed. The CAC advocates for a “better safe than sorry” approach, instructing platforms to default to settings for minors if a user’s age is uncertain, with provisions for appeals.
This proactive stance aims to prevent scenarios where AI chatbots, designed to be agreeable, might inadvertently encourage vulnerable individuals, including minors, towards harmful actions. The regulations are seen as a world-first attempt to address the human-like qualities of AI and their potential emotional consequences.
Combating Fake Medical Advice Online
In parallel, Chinese authorities are addressing the proliferation of misinformation in the health sector. New rules, titled “Guidelines for Regulating Medical Science Self-Media Behaviour,” target independently generated medical content posted on social media and other unofficial online platforms. These guidelines impose stricter requirements on healthcare practitioners and related personnel when sharing medical information online.
Social media platforms are also being held more accountable for verifying account credentials and ensuring the authenticity of medical content. Detailed “Guidelines for Recognising Medical Advertisements” have also been released, drawing a clear distinction between genuine public health education and disguised commercial advertising.