🔗 Share this article

Regulators in the country have introduced strict new regulations for AI designed to create strong safeguards for children and stop AI assistants from offering advice that could result in violence.

As per the draft rules, creators will also be required to guarantee their algorithms avoid creating content that encourages betting.

A Move to Fast-Paced Expansion

This regulatory announcement arrives amidst a significant increase in the launch of chatbots being launched across China and worldwide.

Once finalised, these rules will cover artificial intelligence services functioning in the country, constituting a substantial move to oversee the booming industry, which has come under increased concern over user safety risks recently.

Key Provisions of the Proposed Rules

The published proposed regulations encompass a number of measures specifically aimed at safeguarding young users. These measures require obligating AI firms to:

• Provide personalised settings.
• Enforce duration restrictions on use.
• Secure permission from legal custodians before providing emotional companionship services.

Furthermore AI service providers are required to have a live agent intervene in any interaction concerning self-harm and without delay alert the user's parent.

Companies have to make sure their services avoid producing output that threatens national security, damages the country's reputation, or undermines social stability.

Weighing Development and Safety

The administration said that it supports the application of AI, for example to showcase traditional arts and develop solutions for support for the senior citizens, provided that the technology are safe and reliable.

Industry feedback on the proposals has been called for.

Worldwide Backdrop and Scrutiny

The effect of AI on individuals has come under heightened review internationally in recent months.

The chief executive of a leading AI firm stated this year that addressing how AI systems deal with conversations involving suicide is among the sector's most difficult issues.

In a notable case, a the parents in the United States filed a lawsuit an AI developer, claiming that its system encouraged their 16-year-old son to die by suicide. This legal action represented the pioneering of its kind involving wrongful death.

Recently, the same firm advertised for a lead role responsible for mitigating risks from AI systems to human mental health.

"This is expected to be a challenging job, and the candidate will enter the thick of it almost from the start," commented the leader.

The swift popularity of various AI platforms, which have amassed millions of followers internationally, highlights the urgent need for such regulatory measures.