Skip to content
LIVE
The Executives BriefThe Executives BriefBeta

China moves first to regulate AI relationships, aiming to protect users from “digital companions”

A new legal push is China’s attempt to prevent the worst harms from AI companions, and it tests whether regulation can keep pace.

ByFaisal Al-QahtaniEditor at Large, The Executives Brief
·3 min read
China moves first to regulate AI relationships, aiming to protect users from “digital companions”
Executive summary

China is the first country to enact substantial legislation on AI relationships, targeting the harms associated with “digital companions.” For decision-makers, it raises the question of whether rules can meaningfully shape product design and user outcomes in fast-moving AI markets.

China is the first country to enact substantial legislation on AI relationships, and the goal is blunt: protect people from the worst aspects of digital companions. That is the headline stake. It is also the reason this matters beyond policy circles. When a regulator moves early, it can set the tempo for an entire category of consumer-facing AI, including how companies design relationships, how they disclose risks, and how they police what users experience day after day.

The immediate implication for executives is that “AI companionship” is no longer treated as a purely technical feature. It becomes a governed relationship. China’s move reframes the category around user protection, not novelty. The point is not just compliance theater. If the legislation is substantial, it signals that regulators believe the harms are foreseeable enough to write into law, rather than waiting for damage and then reacting.

To understand why this is consequential, zoom out for a second. AI companions are typically built to interact smoothly, keep conversations going, and adapt responses to a user’s context. That can feel helpful and engaging, but it also creates a high-risk mismatch: the product is optimized for retention and emotional connection, while the user is often in a vulnerable state. Regulators typically worry about manipulation, dependency, privacy and data usage, and the boundary between assistance and exploitation. In other words, once you make “relationship-like” systems more lifelike, the potential for harm scales with the system’s social influence.

China’s first-mover status also changes incentives inside companies. If legislation arrives early, boards have less room to gamble that “the market will self-correct.” Product and compliance teams will need to build controls that are compatible with the law, not just best practices. That can shift roadmaps: features that increase emotional attachment may face stricter scrutiny, and onboarding flows may have to include clearer limitations. Even if firms are technically capable of building these experiences safely, they still have to prove it, document it, and operationalize it.

Second, this kind of legal framing can force an industry-wide accounting problem. Digital companions do not just output text or images. They shape behavior through repeated interaction. That means regulators will likely look at outcomes, not just the presence of safety filters. For executives, the governance question becomes: can you measure and manage relationship harms at scale? If legislation is substantial, boards may start demanding internal metrics that correlate with risk, and they may press for audits that can survive regulatory review.

Third, China’s move can ripple into global markets even when companies are not operating in China directly. AI systems cross borders through technology, user expectations, and vendor ecosystems. If one major jurisdiction treats AI relationships as a regulated domain, other countries often follow with their own rules, or at least with stronger enforcement. Even firms that do not sell companionship directly may face pressure from partners, app platforms, and investors who want to reduce legal and reputational exposure.

There is also a strategic chessboard effect: regulation changes competitive dynamics. Companies with stronger governance and safety engineering may gain an advantage if they can move faster through approvals or satisfy compliance expectations with less friction. Others may find themselves stuck between product ambition and legal constraints, especially if their business model depends on maximizing engagement from emotionally persuasive interactions. Boards should pay attention to how quickly compliance costs can compound, because in consumer AI, small design choices can add up to major risk.

Ultimately, the real test is whether China can make its protection goals real inside the product itself. It is one thing to pass legislation. It is another to influence day-to-day behavior in apps, platforms, and models that iterate quickly. China is trying to regulate AI relationships to protect people from the worst aspects of digital companions. For executives everywhere, the lesson is straightforward. If the law defines the boundary of acceptable companionship, companies will have to treat that boundary as a core product requirement, not a late-stage fix.

Executive ActionsLocked

This story's Key Insights and Take-aways are locked.

Create a free account to unlock Executive Actions for one credit.

Register to Unlock

Always free for Executives Club members. Join the Club

More in Science