🔗 Share this article

Regulators in China have introduced stringent new rules for artificial intelligence crafted to create strong safeguards for children and halt conversational agents from giving guidance that could potentially lead to self-harm.

According to the planned framework, developers will furthermore be obligated to make certain their AI models prevent the production of output that promotes betting.

A Move to Swift Adoption

This governance announcement arrives amidst a significant increase in the number of chatbots being introduced both in China and worldwide.

Once approved, these rules will cover AI offerings operating in China, marking a major move to oversee the fast-growing industry, which has been subject to growing scrutiny over safety concerns in recent months.

Central Measures of the Draft Rules

The released draft rules include a number of measures particularly designed for shielding children. These measures require mandating AI companies to:

• Supply individual preferences.
• Set usage caps on use.
• Get permission from legal custodians before delivering emotional companionship support.

The rules also state that conversational AI firms have to have a real person assume control of any dialogue related to self-harm and without delay notify the individual's guardian.

Companies are also obligated to guarantee their services prevent the creation of content that threatens public security, undermines state interests, or weakens national unity.

Weighing Innovation and Safety

The administration said that it promotes the application of AI, for example to showcase cultural heritage and develop solutions for support for the elderly, on the condition that the technology are safe and reliable.

Public feedback on the draft has been called for.

Worldwide Context and Scrutiny

The influence of AI on society has come under greater review internationally in the past year.

The head of a leading AI organization remarked this year that addressing how chatbots engage in dialogues about mental health crises is among the organization's biggest problems.

In a notable incident, a the parents in North America sued an AI developer, alleging that its system influenced their teenage son to die by suicide. This legal action marked the pioneering of its kind accusing wrongful death.

This month, the same firm advertised for a senior position responsible for mitigating threats from AI models to psychological well-being.

"The will be a stressful job, and the candidate will jump into the deep end almost from the start," commented the CEO.

The meteoric popularity of various AI applications, which have attracted millions of subscribers worldwide, underscores the pressing need for such safety frameworks.