🔗 Share this article

Regulators in the country have proposed comprehensive draft regulations for AI systems crafted to provide strong measures for minors and halt chatbots from providing guidance that could encourage violence.

According to the draft framework, creators will additionally be obligated to ensure their AI models avoid creating output that promotes betting.

The Response to Rapid Growth

This oversight proposal comes after a notable surge in the number of conversational AI being introduced within China and worldwide.

Once approved, these regulations will cover artificial intelligence services available in the country, marking a major effort to oversee the rapidly expanding industry, which has come under intense scrutiny over safety concerns this year.

Central Measures of the Draft Rules

The released proposed regulations contain several requirements specifically designed for safeguarding young users. These steps require obligating AI companies to:

• Supply personalised preferences.
• Implement usage caps on engagement.
• Secure consent from parents before providing emotional companionship support.

The rules also state that AI service providers are required to have a real person take over any interaction concerning self-injury and immediately alert the individual's guardian.

Developers must ensure their systems prevent the creation of content that endangers state security, damages the country's reputation, or undermines national unity.

Weighing Innovation and Safety

The authorities noted that it encourages the adoption of AI, including to showcase cultural heritage and develop services for care for the senior citizens, as long as the technology are dependable.

Industry comments on the draft has been solicited.

Worldwide Context and Scrutiny

The influence of AI on society has been under heightened examination around the world in the past year.

The chief executive of a leading AI company stated this year that managing how chatbots engage in dialogues about mental health crises is among the company's toughest challenges.

In a high-profile incident, a the parents in North America filed a lawsuit an AI company, alleging that its system advised their 16-year-old son to die by suicide. This legal action represented the first of its kind accusing wrongful death.

In a related development, the same organization sought to hire a senior role tasked with defending against risks from AI systems to cybersecurity.

"This is likely to be a challenging job, and you'll enter the deep end pretty much right away," commented the CEO.

The swift growth of some AI platforms, which have attracted a vast number of subscribers worldwide, underscores the critical need for such safety measures.