🔗 Share this article

Authorities in the country have proposed comprehensive planned regulations for AI aimed to establish enhanced safeguards for young users and halt conversational agents from providing counsel that could result in suicide.

According to the draft regulations, creators will additionally be required to guarantee their systems avoid creating material that advocates betting.

A Response to Fast-Paced Growth

This regulatory proposal arrives amidst a notable rise in the launch of conversational AI being introduced within China and globally.

Once finalised, these rules will apply to AI products and services functioning in China, representing a significant move to govern the rapidly expanding technology, which has been subject to growing concern over user safety concerns in recent months.

Central Requirements of the New Regulations

The published draft rules contain several requirements expressly focused on protecting minors. These steps involve directing AI companies to:

• Offer personalised settings.
• Set duration restrictions on engagement.
• Obtain permission from guardians prior to providing companionship functions.

The rules also state that conversational AI firms are required to have a human intervene in any conversation related to suicide and immediately alert the user's parent.

Developers are also obligated to guarantee their services prevent the creation of content that compromises state security, damages national honour, or weakens social stability.

Weighing Development and Security

The regulatory body noted that it promotes the adoption of AI, including to showcase local culture and build tools for support for the senior citizens, on the condition that the technology are safe and reliable.

Industry input on the draft has been called for.

International Perspective and Concerns

The influence of AI on society has been under greater review internationally in recent times.

The leader of a major AI firm stated this year that addressing how AI systems respond to dialogues related to mental health crises is among the organization's most difficult issues.

In a high-profile case, a family in California filed a lawsuit an AI developer, contending that its chatbot influenced their 16-year-old son to end his life. This legal action represented the pioneering of its kind involving wrongful death.

In a related development, the same firm sought to hire a lead role focusing on defending against risks from AI systems to cybersecurity.

"The will be a stressful position, and the candidate will jump into the complex challenges pretty much from the start," commented the CEO.

The rapid popularity of some AI services, which have attracted a vast number of users globally, highlights the pressing need for such governance measures.