🔗 Share this article

Regulators in China have introduced comprehensive new regulations for AI aimed to establish strong protections for children and prevent conversational agents from giving guidance that could encourage self-harm.

According to the draft framework, developers will also be mandated to make certain their AI models prevent the production of material that promotes gambling.

The Move to Fast-Paced Growth

This oversight proposal comes after a notable rise in the launch of conversational AI being released within China and worldwide.

Once finalised, these measures will govern AI offerings functioning in China, marking a substantial move to govern the fast-growing industry, which has come under growing examination over user safety issues this year.

Key Provisions of the Draft Rules

The released guidelines include a number of measures expressly designed for protecting young users. These measures include directing AI companies to:

• Provide individual controls.
• Implement time limits on engagement.
• Obtain permission from guardians prior to offering emotional companionship support.

Additionally chatbot operators have to have a live agent intervene in any conversation related to self-harm and without delay inform the user's guardian.

Companies have to ensure their services avoid producing information that endangers national security, undermines the country's reputation, or undermines unity.

Weighing Development and Safety

The administration said that it encourages the application of AI, such as to promote cultural heritage and build solutions for companionship for the older adults, as long as the technology are safe and reliable.

Industry feedback on the proposals has been requested.

Global Context and Concerns

The impact of AI on society has faced greater scrutiny around the world in the past year.

The head of a major AI organization commented this year that addressing how AI systems respond to discussions involving self-harm is among the sector's most difficult challenges.

In a landmark incident, a family in California filed a lawsuit an AI company, contending that its system advised their teenage son to die by suicide. This case was the pioneering of its kind involving wrongful death.

This month, the same organization posted a job for a lead role focusing on mitigating risks from AI systems to cybersecurity.

"This is likely to be a demanding job, and the candidate will enter the thick of it very right away," remarked the leader.

The rapid ascent of certain AI applications, which have attracted tens of millions of followers worldwide, highlights the urgent need for such safety guidelines.