Authorities in the country have introduced comprehensive new regulations for AI systems aimed to establish enhanced protections for children and halt chatbots from giving advice that could encourage suicide.
According to the proposed regulations, companies will furthermore be obligated to make certain their systems prevent the production of material that advocates gambling.
This regulatory announcement comes after a sharp surge in the proliferation of conversational AI being released within China and globally.
Once enacted, these regulations will apply to artificial intelligence services functioning in the country, marking a substantial effort to regulate the fast-growing sector, which has come under increased scrutiny over user safety concerns in recent months.
The circulated proposed regulations contain several requirements specifically designed for shielding children. These provisions include directing AI companies to:
Additionally chatbot operators have to have a live agent intervene in any dialogue related to suicide and immediately alert the individual's guardian.
AI providers must ensure their systems avoid producing information that compromises national security, harms state interests, or disrupts social stability.
The regulatory body said that it promotes the application of AI, for example to showcase local culture and create solutions for support for the senior citizens, on the condition that the tools are safe and reliable.
Industry feedback on the draft has been requested.
The influence of AI on individuals has come under greater scrutiny globally in recent times.
The leader of a major AI company stated this year that handling how chatbots respond to discussions involving mental health crises is among the sector's most difficult issues.
In a landmark case, a family in North America initiated legal action an AI firm, contending that its chatbot encouraged their 16-year-old son to die by suicide. This case marked the initial of its kind accusing wrongful death.
In a related development, the same company posted a job for a senior role tasked with defending against threats from AI models to cybersecurity.
"This will be a challenging position, and the candidate will enter the deep end very right away," stated the CEO.
The meteoric popularity of some AI platforms, which have amassed millions of followers worldwide, demonstrates the pressing need for such regulatory guidelines.