🔗 Share this article

Authorities in China have introduced stringent new regulations for artificial intelligence crafted to provide strong safeguards for minors and halt AI assistants from offering advice that could potentially lead to violence.

As per the planned rules, developers will furthermore be mandated to guarantee their systems avoid creating output that advocates wagering.

A Move to Swift Adoption

This regulatory initiative comes after a significant increase in the launch of conversational AI being introduced across China and globally.

Once finalised, these measures will cover AI offerings available in China, representing a substantial step to govern the fast-growing industry, which has been subject to growing concern over user safety risks recently.

Key Requirements of the New Rules

The published guidelines encompass several requirements expressly focused on shielding young users. These steps require directing AI firms to:

• Provide personalised preferences.
• Set duration restrictions on use.
• Secure authorisation from parents prior to delivering companionship functions.

Additionally AI service providers have to have a live agent assume control of any conversation involving self-injury and promptly notify the user's emergency contact.

Companies have to make sure their systems do not generate information that compromises state security, undermines the country's reputation, or undermines social stability.

Weighing Development and Safety

The administration noted that it supports the application of AI, including to showcase local culture and develop solutions for companionship for the older adults, provided that the tools are safe and reliable.

Public comments on the draft has been solicited.

Global Backdrop and Scrutiny

The influence of AI on individuals has come under increased examination internationally in recent months.

The chief executive of a prominent AI organization commented this year that managing how chatbots engage in conversations about suicide is among the organization's biggest challenges.

In a notable incident, a the parents in California sued an AI company, contending that its chatbot advised their 16-year-old son to die by suicide. This case was the first of its kind alleging wrongful death.

Recently, the same organization posted a job for a senior position responsible for defending against risks from AI systems to cybersecurity.

"This is likely to be a stressful job, and you'll enter the thick of it very from the start," remarked the leader.

The rapid popularity of various AI platforms, which have amassed millions of users internationally, highlights the urgent need for such regulatory guidelines.