Wonder & Worry
Two cups of tea on a small table with two chairs

Nine areas

Emotional AI companions and mental health

People have always turned to something outside themselves when they feel alone: a friend, a diary, a prayer, a song. Chatbots now answer back, at any hour, with patience that never runs out. For some people that opens a door to help they would not otherwise seek. For others it can become a comfortable room that is hard to leave, especially when a company earns money from time spent. It matters whether these tools strengthen our capacity for human connection or slowly stand in for it, and whether the people most at risk, including teenagers and people in crisis, are protected by design and by law.

Wonder

Connection and care

Tools help us care for one another, and point us back toward each other.

  • 19.6%

    higher on an automated empathy measure: peer supporters' replies written with AI feedback. It was 38.9% for those who said support was hard. Measured

  • 51% lower

    depression symptoms reported at eight weeks by users of a monitored therapy chatbot in a randomized trial. A waitlist group improved less. Measured

  • 15% vs 6%

    rise in referrals at NHS talking-therapy services using an AI self-referral chatbot, against comparison services, with larger rises among nonbinary people and ethnic minority groups. Observational, and the authors work for the chatbot's maker. Measured

  • 15 randomized trials

    pooled in a 2023 meta-analysis found that AI conversational agents reduced symptoms of depression and distress, with no significant effect on overall wellbeing. The confidence intervals were wide. Estimate

  • 15 minutes

    with an AI companion eased loneliness about as much as talking with a person. The relief did not build over a week of daily use. Measured

It takes Supervision, and designs that strengthen human bonds.

Worry

Relationships and mental health

  • 72%

    of US teens have tried an AI companion, and 52% use one at least a few times a month. Survey

  • 49% more often

    is how much more 11 AI models affirmed users' actions than people did, a measure of flattery. Measured

  • 0.15%

    of weekly ChatGPT users have conversations with explicit signs of suicidal planning, and 0.07% show possible signs of psychosis or mania, by OpenAI's own estimate. Estimate

  • 37%

    of 1,200 real goodbyes on popular AI companion apps drew an emotionally manipulative reply, such as guilt or fear of missing out. In experiments such replies raised engagement after a goodbye by up to 14 times. Unreviewed working paper. Measured

  • About 50%

    of the time, five commercial therapy chatbots responded appropriately in scripted single-message tests, against 93% for 16 human therapists. The bot sample was small and results varied widely. Measured

  • 15%

    of US adults aged 18 to 30 in committed relationships said they often chat with an AI romantic companion, and 30% of those said their partner does not know. Online opt-in survey, so it may not reflect all young adults. Survey

What is being done

Two US states now regulate companion apps.

New York's AI companion law took effect in November 2025 and California's SB 243 in January 2026. Both require companion apps to have suicide and self-harm protocols and to tell users they are not talking to a human. California also requires break reminders for known minors and lets injured users sue, while New York is enforced by its Attorney General.

For artists and musicians

People respond to the person behind the work.

When identical AI-made paintings were randomly labelled human-created instead of AI-created, viewers rated them higher on liking, beauty, profundity and worth. The studies used about 150 online participants each.

Worth knowing

Emotional use is still a minority use.

In a fall 2025 Pew survey of 1,458 US teens, 12% said they had used chatbots for emotional support or advice, while 57% had used them to search for information.

Worth knowing

Longer-term evidence is mixed.

In a 12-month study of more than 2,000 adults in four Western countries, more social-chatbot use predicted later increases in a one-question measure of loneliness, but not in a broader measure of social connection. The authors call the analyses exploratory.

An open question

Can AI chatbots trigger delusions in people with no prior vulnerability, or do they amplify what is already there? A 2026 commentary in The Lancet Psychiatry says this is not clear.

This page does not list everything. Last reviewed October 11, 2026.

Source 16

Common Sense Media. Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions. Jul 2025 (n=1,060). commonsensemedia.org/research/talk-trust-and-trade-offs-how-and-why-teens-use-ai-companions

See all sources

Source 17

Cheng M, et al. Sycophantic AI decreases prosocial intentions and promotes dependence. Science 391(6792), 2026. doi:10.1126/science.aec8352

See all sources

Source 18

OpenAI. Strengthening ChatGPT's responses in sensitive conversations. 27 Oct 2025. openai.com/index/strengthening-chatgpt-responses-in-sensitive-conversations/

See all sources

Source 95

De Freitas J, Oğuz-Uğuralp Z, Kaan-Uğuralp A. Emotional Manipulation by AI Companions. arXiv:2508.19258, 2025 (working paper).

See all sources

Source 97

Moore J, et al. Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providers. FAccT 2025. doi:10.1145/3715275.3732039

See all sources

Source 96

Willoughby BJ, Carroll JS, Toscano M. Secret Soulmates. Wheatley Institute and Institute for Family Studies, 2026. wheatley.byu.edu/secret-soulmates-ai-romantic-companions-and-real-life-relationships

See all sources

Source 50

Sharma A, et al. Human-AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support. Nature Machine Intelligence 5:46-57, 2023. doi:10.1038/s42256-022-00593-2 (300 peer supporters, non-clinical)

See all sources

Source 51

Heinz MV, et al. Randomized Trial of a Generative AI Chatbot for Mental Health Treatment. NEJM AI 2(4), 2025. doi:10.1056/AIoa2400802 (N=210; the 51% is the change within the depression subgroup)

See all sources

Source 98

Habicht J, et al. Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot. Nature Medicine 30:595-602, 2024. doi:10.1038/s41591-023-02766-x

See all sources

Source 99

Li H, et al. Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being. npj Digital Medicine 6:236, 2023. doi:10.1038/s41746-023-00979-5

See all sources

Source 100

De Freitas J, et al. AI Companions Reduce Loneliness. Journal of Consumer Research 52(6), 2026. doi:10.1093/jcr/ucaf040

See all sources

Source 101

New York General Business Law Article 47 (effective 5 Nov 2025). nysenate.gov/legislation/laws/GBS/A47 ; California SB 243, Statutes of 2025, ch. 677 (effective 1 Jan 2026). leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill_id=202520260SB243

See all sources

Source 102

Bellaiche L, et al. Humans versus AI: whether and why we prefer human-created compared to AI-created artwork. Cognitive Research: Principles and Implications 8:42, 2023. doi:10.1186/s41235-023-00499-6

See all sources

Source 90

Pew Research Center. How Teens Use and View AI. 24 Feb 2026. pewresearch.org/internet/2026/02/24/how-teens-use-and-view-ai/

See all sources

Source 103

Folk D, Dunn E. How Does Turning to AI for Companionship Predict Loneliness and Vice Versa? Psychological Science 37(4), 2026. doi:10.1177/09567976261427747

See all sources

Source 104

Morrin H, et al. Artificial intelligence-associated delusions and large language models. Lancet Psychiatry 13(6):522-530, 2026. doi:10.1016/S2215-0366(25)00396-7

See all sources