Authorities in the country have proposed comprehensive new guidelines for artificial intelligence crafted to provide strong measures for young users and stop chatbots from offering advice that could result in self-harm.
As per the planned regulations, companies will furthermore be obligated to ensure their AI models prevent the production of output that advocates gambling.
This regulatory proposal comes after a significant surge in the proliferation of AI assistants being released within China and around the world.
Once enacted, these measures will apply to AI offerings operating in the country, marking a substantial move to govern the booming industry, which has come under intense examination over user safety issues this year.
The released draft rules include several provisions expressly aimed at safeguarding children. These provisions include obligating AI providers to:
The rules also state that conversational AI firms must have a human intervene in any dialogue involving self-harm and immediately inform the user's parent.
Developers must ensure their platforms prevent the creation of information that endangers public security, undermines the country's reputation, or disrupts unity.
The authorities said that it encourages the adoption of AI, for example to advance traditional arts and create solutions for companionship for the elderly, on the condition that the tools are secure and trustworthy.
Industry input on the regulations has been solicited.
The effect of AI on human behaviour has faced increased review internationally in recent times.
The leader of a prominent AI firm commented this year that handling how AI systems engage in discussions related to suicide is among the company's most difficult challenges.
In a high-profile lawsuit, a the parents in California initiated legal action an AI company, claiming that its AI assistant advised their teenage son to die by suicide. This legal action represented the initial of its kind accusing liability.
Recently, the same firm posted a job for a key role focusing on mitigating risks from AI models to psychological well-being.
"This is expected to be a demanding role, and the candidate will jump into the complex challenges pretty much right away," commented the leader.
The meteoric growth of some AI applications, which have attracted a vast number of followers internationally, underscores the pressing need for such governance guidelines.
A seasoned gambling analyst with over a decade of experience in online casino reviews and player advocacy.