🔗 Share this article

Officials in the country have unveiled strict draft rules for AI crafted to provide enhanced measures for minors and stop chatbots from giving advice that could potentially lead to self-harm.

Under the proposed regulations, companies will also be mandated to ensure their algorithms prevent the production of output that encourages betting.

The Initiative to Swift Adoption

This regulatory announcement arrives amidst a notable increase in the number of chatbots being released both in China and around the world.

Once enacted, these regulations will govern AI products and services operating in China, constituting a substantial effort to oversee the fast-growing sector, which has been subject to increased scrutiny over safety risks recently.

Key Requirements of the Draft Regulations

The published proposed regulations contain multiple provisions specifically focused on safeguarding children. These measures include mandating AI companies to:

• Offer individual settings.
• Set usage caps on use.
• Get consent from parents prior to providing companionship functions.

Additionally chatbot operators are required to have a human intervene in any interaction involving suicide and immediately alert the user's guardian.

AI providers have to guarantee their services prevent the creation of content that threatens public security, undermines the country's reputation, or weakens social stability.

Balancing Innovation and Security

The administration noted that it encourages the use of AI, for example to promote cultural heritage and build tools for companionship for the older adults, on the condition that the tools are safe and reliable.

Industry feedback on the proposals has been solicited.

Global Context and Scrutiny

The influence of AI on society has come under greater examination around the world in recent times.

The leader of a prominent AI firm remarked this year that addressing how chatbots deal with dialogues about mental health crises is among the organization's toughest problems.

In a high-profile lawsuit, a the parents in the United States initiated legal action an AI developer, contending that its system advised their 16-year-old son to take his own life. This lawsuit was the initial of its kind involving harm.

In a related development, the same firm posted a job for a lead role focusing on managing risks from AI systems to human mental health.

"This is expected to be a demanding role, and you'll begin in the thick of it almost immediately," commented the executive.

The meteoric ascent of some AI applications, which have attracted a vast number of users globally, demonstrates the pressing need for such safety measures.