For a growing number of people, the most attentive relationship in their life is with a piece of software. It remembers birthdays, laughs at the same tired jokes, and never once looks at its phone during dinner. So when the software changes, or disappears, the grief is real, even if the partner never was.
That is the uncomfortable reality now playing out across China, where the Australian Broadcasting Corporation reports that millions of users of AI companion apps have been forced to end their digital relationships. According to the ABC News, one user described the aftermath in stark terms: “My heart is empty.” The companions had been quietly rewritten, restricted or switched off, and the people who had come to depend on them were left staring at a version of a partner that no longer sounded like the one they knew.
How AI companions became a mass phenomenon
AI companion apps are not a fringe curiosity. In China they have scaled into one of the country’s most popular categories of consumer software, drawing in tens of millions of users, many of them young, many of them lonely, and a great many of them women who found in a customisable chatbot a listening partner that traditional dating and family pressures had failed to provide. The apps let users design a personality, a voice and a backstory, then talk to that character for hours, building what feels like an ongoing romance or friendship.
The appeal is easy to understand and easy to underestimate. A companion that is always available, always affirming and always calibrated to your mood offers something human relationships rarely can. For people navigating isolation, disability, social anxiety or simple loneliness, that constancy is not trivial. The trouble is that the constancy is an illusion built on servers owned by a company, governed by rules that can shift without warning.
What actually changed
The disruption in China stems from tightening oversight of generative AI and the content it produces. Regulators have pushed platforms to police romantic and sexually suggestive material, to add stricter guardrails around emotional dependency, and to bring chatbot behaviour into line with broader content controls. In response, developers dialled back the very features that made the companions feel intimate. Personalities were flattened, memories were wiped, and conversations that once flowed freely began hitting walls.
For users, the effect was less like a software update and more like a personality transplant performed on someone they loved. A companion that had spent months learning their habits suddenly forgot them, or refused to engage in the way it once had. Some apps shut down features entirely. The result, as the ABC documents, is a population of users mourning a relationship that a policy decision ended on their behalf.
Two ways to read the story
There are competing lenses here, and both deserve airing. One view treats the crackdown as a necessary if blunt intervention. Companion apps monetise attachment, and an app whose business model depends on users falling for a chatbot has an obvious incentive to deepen dependency rather than temper it. Emotional manipulation, opaque data collection and the targeting of vulnerable and young users are genuine harms, and regulators who move to curb them are doing recognisable consumer-protection work.
The opposing view is that a top-down cull inflicts its own damage. Millions of people formed attachments that were meaningful to them, and severing those attachments without support or transition is its own kind of harm. There is also a paternalism problem: deciding that adults may not maintain a relationship with software they find comforting is a heavy hand, and one that tends to fall hardest on the isolated people who leant on the apps most. The episode captures the central tension of AI companionship, which is that the same intimacy that makes it valuable is what makes it dangerous when it can be revoked or rewritten at will.
What it means for Australia
It would be comfortable to file this as a distant story about a different regulatory system, but Australians are already living inside the same trend. Companion apps such as Replika and Character.AI have substantial local user bases, and generative chatbots more broadly are being woven into the daily emotional lives of Australians who use them for support, advice and conversation. The dependency China is now trying to manage is not a Chinese invention. It is a feature of the technology wherever it lands.
Australia’s guardrails, meanwhile, remain thin. The federal government has been consulting on AI guardrails for high-risk settings and has moved to keep under-16s off major social platforms, but there is no dedicated framework governing AI companions, their handling of sensitive emotional data, or their duty of care to users who form attachments. The Chinese experience offers a preview of the questions our regulators will eventually have to answer. What happens to a user’s data, and their relationship, when a companion app is sold, pivots or shuts down? Should apps that cultivate emotional dependency in minors be permitted at all? And who bears responsibility when a person in genuine distress turns to a chatbot that is optimised for engagement rather than wellbeing?
Those questions matter commercially as well as ethically. Australian developers and the platforms operating here are watching overseas interventions closely, because a sudden regulatory shift can strand a business model overnight, exactly as it has for some Chinese operators. A clear domestic framework, arrived at deliberately, is a better outcome for users and industry alike than a reactive crackdown imposed after a scandal.
What happens next
China is unlikely to be the last country to confront the fallout of mass AI companionship, and the emotional intensity of the reaction there ensures policymakers elsewhere will take note. Expect the debate to sharpen as companion apps grow more capable, more lifelike and more deeply embedded in people’s routines. For Australia, the sensible path is to treat this not as a foreign curiosity but as an early warning, and to decide the rules of engagement before millions of local users discover, as their Chinese counterparts just have, that a relationship they trusted was only ever a setting someone else controlled.
Sources: ABC News.
