Therapists are using AI to take notes. Is it a useful tool or a breach of trust?

A growing number of mental health therapists are using AI tools to record sessions, take notes and do administrative tasks. Fiordaliso/Getty Images hide caption

For two years, Molly Quinn trusted her therapist with things she hadn't told anyone else.

So when her therapist mentioned trying an artificial intelligence tool to take notes, Quinn didn't immediately refuse. The 31-year-old librarian from Fayetteville, Ark., asked to research it first.

She wanted to understand where her words would go — whether they would stay local or be processed somewhere in the cloud.

Shots - Health News

With therapy hard to get, people lean on AI for mental health. What are the risks?

Replaying the session in her head

The session moved on that day, but halfway through, Quinn noticed something was different.

"She wasn't taking notes like she usually did," Quinn says. "The iPad was just propped up."

That's when Quinn realized the session was being recorded.

Quinn says she froze for a bit. But then she kept talking.

It wasn't until she walked out of her therapist's office that the weight of it landed.

"The more I thought about it, the more I just started getting more and more sick to my stomach," she says. "This person who I'm supposed to be able to trust with some very private and very intense emotions had just completely disregarded something I said I was not comfortable with. I felt completely violated."

She drove home replaying the session in her head, unsure what to do next.

Molly Quinn felt disturbed when she realized an AI tool was capturing the content of her talk therapy session. Quinn family hide caption

New tools from new companies

Across the U.S., a growing number of therapists are experimenting with artificial intelligence tools that record sessions, generate transcripts and draft clinical notes automatically. Software companies say these tools can save hours of administrative work each week.

One company, Berries, markets its platform as a way to lighten paperwork so therapists can focus more fully on their clients and have a better work-life balance in their own personal lives.

"Berries is designed to reduce administrative burden without interfering with the therapeutic experience itself," Tal Salman, the company's Co-CEO, told NPR. "It supports clinicians being more present with their clients."

When activated, the system records the conversation, transcribes it and generates a draft clinical note for the therapist to review. Therapists can edit, revise or discard the draft. They can also save it to a medical record.

Privacy rules

Salman says that audio is processed in real time and deleted immediately, and that transcripts are stored on servers in the United States that are compliant with HIPAA, the federal law that limits release of medical information. He adds that the company does not use therapy content to train its AI models.

"Therapy session content remains private and is not repurposed for training," Salman says. "The clinician remains fully responsible for patient care and the final documentation."

Other companies that are offering similar services to mental health therapists are SimplePractice and Blueprint. Companies generally charge fees of $19 to $99 per month, appealing to solo practitioners who are often overwhelmed by administrative tasks.

Shots - Health News

Therapy by chatbot? The promise and challenges in using AI for mental health

Research suggests patients may be open to artificial intelligence tools in therapy, but that comfort is limited. A national survey by YouGov found that Americans remain hesitant to use AI for mental health care. Only about 11% say they would be open to using it, and just 8% say they trust it. Nearly half of respondents said they are reluctant to use the technology. Many point to the lack of human understanding as a major concern, along with fears about inaccurate advice and privacy.

Those concerns extend beyond therapy itself.

A separate survey from the health research organization KFF found that about 77% of Americans are worried about how their health information would be stored and used by AI systems.

Researchers say that the gap between curiosity and trust becomes even more pronounced in mental health care, where conversations are deeply personal. And they note that even when patients are willing to try the technology, many still prefer the reassurance of a human therapist.

Kellie Owens, an assistant professor of medical ethics at NYU Grossman School of Medicine, says privacy protections like HIPAA compliance do not eliminate the possibility of breaches.

"Regardless of what protections we have in place, that doesn't mean data can't be breached," Owens says. "There are plenty of systems that are fully HIPAA compliant that still experience major data breaches."

She says the risks are especially sensitive in therapy, where patients share deeply personal information.

Meaningful consent?

Beyond the technical risks, Owens says, written consent forms alone may not be enough.

"We have a wide body of research showing that a consent form on its own does not mean a person is making an informed choice," she says. "People scroll through them, don't read them or feel pressured to agree."

Owens says recordings should always be discussed directly.

"Any time you are recording a conversation, that should require a verbal conversation that a recording is taking place," she says.

She says trust and psychological safety are foundational to effective mental health treatment.

"If patients feel that privacy has been compromised, that can do real damage to the therapeutic relationship," Owens says.

For Molly Quinn, those risks are not abstract.

Healthcare systems and major corporations have faced repeated data breaches in recent years, and Quinn worries that adding another layer of technology increases the chance that deeply personal conversations could someday be exposed.

"We're going to see breaches," she says. "Maybe not tomorrow, maybe not next week. But in a few years? I think we're going to see them. And I don't want my therapy session to be part of that."

An AI listener, a different experience

For some therapists, the concern isn't just about cybersecurity.

Marisa Cohen, a couples and sex therapist in New York, says introducing AI into therapy changes the experience, even if the technology fades into the background.

"Even the presence of AI changes the therapeutic experience," Cohen says. "Clients know or feel like something else is listening to them. That awareness can subtly alter their disclosure."

Therapy, she says, relies on the perception of absolute privacy.

"When you introduce something that's being stored electronically, it raises additional questions about trust and safety," Cohen says. "It's essentially a third party."