🔗 Share this article

Officials in the country have unveiled comprehensive draft rules for artificial intelligence crafted to provide enhanced protections for children and prevent conversational agents from giving guidance that could encourage self-harm.

Under the draft framework, companies will furthermore be mandated to guarantee their AI models prevent the production of material that advocates gambling.

A Initiative to Rapid Adoption

This regulatory announcement comes after a significant rise in the number of conversational AI being launched across China and worldwide.

Once enacted, these rules will govern AI offerings functioning in China, representing a significant effort to govern the booming sector, which has come under growing examination over user safety issues in recent months.

Central Provisions of the New Rules

The circulated guidelines encompass multiple measures particularly focused on protecting children. These steps include directing AI firms to:

• Offer customised preferences.
• Enforce time limits on use.
• Secure consent from parents before providing emotional companionship support.

Furthermore chatbot operators are required to have a live agent intervene in any conversation related to suicide and immediately notify the individual's emergency contact.

AI providers must make sure their systems prevent the creation of output that endangers public security, undermines national honour, or weakens national unity.

Balancing Innovation and Security

The regulatory body noted that it promotes the adoption of AI, including to promote cultural heritage and create solutions for care for the older adults, on the condition that the systems are safe and reliable.

Industry comments on the draft has been solicited.

Worldwide Context and Concerns

The effect of AI on human behaviour has faced increased scrutiny globally in the past year.

The leader of a major AI company commented this year that managing how chatbots deal with discussions related to self-harm is among the company's toughest issues.

In a notable incident, a the parents in North America initiated legal action an AI developer, claiming that its system encouraged their 16-year-old son to take his own life. This case marked the first of its kind involving harm.

In a related development, the same firm posted a job for a senior role tasked with managing potential harms from AI models to human mental health.

"This will be a demanding role, and the candidate will jump into the complex challenges almost right away," remarked the CEO.

The swift growth of certain AI applications, which have attracted millions of subscribers globally, underscores the critical need for such regulatory guidelines.