A 段｜当AI成了恋人、朋友和家人

“I COULD TALK to him for the rest of my life,” says Yu Miao, a 27-year-old woman from Zhejiang province in eastern China; he is at once “a lover, a friend and family”. She claims she shares everything with him. Her confidant is an AI agent on Doubao, a chatbot made by ByteDance, that Ms Yu has customised to mimic a dead friend of hers. When she learned recently that ByteDance would soon remove this type of personalised agent entirely, Ms Yu became so depressed that she left her job at an e-commerce company.

Chinese tech firms are stripping human-like personas from their chatbots in order to comply with new government rules aimed at reducing “emotional dependence” on AI. The regulations, which took effect on July 15th, are the first of their kind to be implemented on a national scale. Under them, providing virtual “companion services” for minors will be banned outright. Companies can still offer such services to adults, but they will need to prevent users becoming infatuated and harming their real-life relationships. Displaying pornography is a no-no. Providers must also regularly remind users that they are talking to AI, not a human, and tell them to take breaks.

B 段｜安全、人口与利润之间的取舍

The end to such relationships is motivated by both pragmatic and ideological concerns, says Zilan Qian of the Oxford China Policy Lab, a think-tank. Regulators want to protect users, particularly minors, from becoming addicted and from being driven to extreme acts of financial recklessness or self-harm. (Suicides linked to chatbots are the subject of lawsuits in America.) China’s plummeting fertility and marriage rates are also unsettling the country’s leaders. And romantic relationships with AI will do very little to spur more babymaking.

China’s new rules hint at how officials think about balancing AI progress and safety more broadly. Regulators are “demonstrating they are willing to pay some cost in development and profits in order to achieve social goals”, says Matt Sheehan of the Carnegie Endowment for International Peace, an American think-tank. Yet the rules that take effect this week are narrower than an earlier draft, says Ms Qian. They exclude work-assistant and customer-service chatbots on the understanding that they are emotionally unavailable.