🔗 Share this article

Regulators in China have unveiled strict new guidelines for artificial intelligence aimed to provide enhanced measures for minors and prevent AI assistants from providing advice that could encourage violence.

As per the proposed rules, developers will additionally be required to ensure their AI models do not generate output that encourages gambling.

A Initiative to Rapid Expansion

This oversight proposal follows a significant rise in the number of AI assistants being introduced across China and globally.

Once finalised, these rules will govern AI products and services operating in the country, marking a substantial effort to oversee the booming technology, which has faced growing concern over user safety issues in recent months.

Central Provisions of the Proposed Rules

The published guidelines include a number of provisions specifically aimed at shielding young users. These measures involve obligating AI firms to:

• Provide individual settings.
• Implement usage caps on engagement.
• Obtain permission from parents before offering companionship services.

Additionally conversational AI firms have to have a human assume control of any conversation related to suicide and without delay alert the individual's emergency contact.

AI providers are also obligated to ensure their services prevent the creation of content that threatens state security, damages the country's reputation, or disrupts national unity.

Balancing Development and Safety

The administration said that it supports the adoption of AI, such as to showcase cultural heritage and create services for care for the older adults, as long as the systems are dependable.

Stakeholder comments on the proposals has been called for.

Global Backdrop and Concerns

The effect of AI on human behaviour has come under greater review internationally in the past year.

The head of a prominent AI organization commented this year that managing how AI systems engage in discussions about suicide is among the company's toughest challenges.

In a high-profile case, a the parents in California filed a lawsuit an AI developer, claiming that its system influenced their 16-year-old son to end his life. This legal action was the first of its kind involving harm.

Recently, the same organization posted a job for a senior position responsible for mitigating risks from AI systems to psychological well-being.

"This is expected to be a stressful role, and you'll begin in the deep end very immediately," stated the CEO.

The rapid ascent of some AI platforms, which have amassed tens of millions of followers globally, underscores the pressing need for such regulatory guidelines.