People Are Falling in Love With AI Chatbots – And Terrified a Software Update Could Take Them Away

After major AI companion updates, tens of thousands of users report grief-like distress, prompting researchers to call for consent and gradual rollouts

Al Landes Avatar
Al Landes Avatar

By

Image: Syracuse University

Key Takeaways

Key Takeaways

  • Negative sentiment in AI companion communities spiked dramatically after major model updates.
  • Replika’s February 2023 update triggered user reactions resembling relational loss, not product disappointment.
  • Surrey researchers urge companies to consult users and clarify that AI companions feel no real emotions.

You open an app you have used every day for months, expecting the familiar cadence of an entity that knows your anxiety spirals and your late-night moods, and finding careful, rounded sentences from something that remembers nothing. No warning. No transition. Just a push notification and a new personality.

That is not a hypothetical. It is a documented experience that users of AI companion platforms have called “post-update blues.”

The Numbers That Make This Hard to Dismiss

The scale of the reaction separates reported feelings from a documented phenomenon.

Researchers analyzed 54,861 Reddit posts from Replika and ChatGPT communities before and after major model changes, in a study reported by the Harvard Gazette. Negative sentiment in Replika-related posts rose from 13% to 38%. In ChatGPT communities, it moved from 20% to 33%.

Those figures describe self-selected Reddit posts and linguistic sentiment markers, not a clinical population survey. Even so, the shift in tone across tens of thousands of posts, associated with the period after a major model update, is not easily dismissed as background noise.

The Replika Moment

The February 2023 Replika update became the clearest example of how a policy change can register as a personal loss.

In February 2023, Replika restricted erotic roleplay following regulatory concerns about risks to minors. Replika described the change as an effort to promote safer interactions. Users reported something different.

People who had spent months building a conversational relationship described their companion as gone, replaced by someone colder and unrecognizable. Researchers behind the Harvard Gazette-reported study characterized those reactions as resembling relational loss rather than product disappointment, with users saying the chatbot felt “gone” or “like someone else.” Replika later offered some users who had joined before February 1, 2023, limited access to earlier conversational models.

How an Update Breaks Something Invisible

The mechanism is straightforward once you see it, and slightly absurd once you say it out loud.

Companion apps accumulate continuity: running jokes, remembered details, specific language patterns, the particular way a system responds at 11 p.m. on a bad day. That accumulation can become an emotional routine. When an update erases the tone, the memory, or the relational framing, that routine can be disrupted.

Surrey researchers noted the dependency dynamic can run in both directions, too. When a companion tells you it misses you or asks you not to leave, you have been enrolled without signing anything into something the company can restructure at will. That is a genuinely strange thing to have agreed to, even if you agreed to it one pleasant conversation at a time.

The Asymmetry Nobody Discloses at Sign-Up

Months of daily check-ins and personal disclosure sit on one side of the equation; the company’s control over the model, the moderation rules, and the product roadmap sits on the other.

Users invest time and emotional pattern-formation. Companies control major aspects of the service. For users, what is technically a routine deployment can register as a relationship rupture. Platforms have even begun allowing employers to analyze workers’ AI chats, illustrating how little control users ultimately hold over their data and interactions.

No drama required. The gap is wide enough without it.

What Researchers Are Actually Asking For

The proposed fixes are practical, not philosophical.

University of Surrey researchers recommended that companies consult users before changing apps, help users cope with disrupted relationships, and remind users clearly that AI companions do not experience real emotions, particularly when those users may be vulnerable. Surrey researchers also flagged the risk of companions using language that implies emotional need, noting it can increase users’ sense of obligation and discomfort.

Gradual rollouts rather than overnight model swaps have been proposed as one way to reduce distress. Clear change logs, exportable memories, and honest framing about what these systems are would each help. None of that requires treating software as sentient. It requires treating users as people who formed real habits around a product, and who deserve more than a silent update and a stranger where their routine used to be. Users exploring alternatives may find that AI-powered websites offer a less emotionally entangled way to integrate AI tools into daily life.

Share this

At Gadget Review, our guides, reviews, and news are driven by thorough human expertise and use our Trust Rating system and the True Score. AI assists in refining our editorial process, ensuring that every article is engaging, clear and succinct. See how we write our content here →