Sunday, August 3, 2025
No Result
View All Result
DOLLAR BITCOIN
Shop
  • Home
  • Blockchain
  • Bitcoin
  • Cryptocurrency
  • Altcoin
  • Ethereum
  • Market & Analysis
  • DeFi
  • More
    • Dogecoin
    • NFTs
    • XRP
    • Regulations
  • Shop
    • Bitcoin Book
    • Bitcoin Coin
    • Bitcoin Hat
    • Bitcoin Merch
    • Bitcoin Miner
    • Bitcoin Miner Machine
    • Bitcoin Shirt
    • Bitcoin Standard
    • Bitcoin Wallet
DOLLAR BITCOIN
No Result
View All Result
Home Blockchain

Even OpenAI CEO Sam Altman thinks you shouldn’t trust AI for therapy

n70products by n70products
July 28, 2025
in Blockchain
0
Even OpenAI CEO Sam Altman thinks you shouldn’t trust AI for therapy
0
SHARES
0
VIEWS
Share on FacebookShare on Twitter


gettyimages-2198379646

Bloomberg / Contributor/Getty

Remedy can really feel like a finite useful resource, particularly these days. Consequently, many individuals — especially young adults — are turning to AI chatbots, together with ChatGPT and people hosted on platforms like Character.ai, to simulate the remedy expertise. 

However is that a good suggestion privacy-wise? Even Sam Altman, the CEO behind ChatGPT itself, has doubts. 

In an interview with podcaster Theo Von final week, Altman mentioned he understood considerations about sharing delicate private info with AI chatbots, and advocated for consumer conversations to be protected by related privileges to these medical doctors, legal professionals, and human therapists have. He echoed Von’s considerations, saying he believes it is smart “to actually need the privateness readability earlier than you employ [AI] rather a lot, the authorized readability.”

Additionally: Bad vibes: How an AI agent coded its way to disaster

Presently, AI corporations supply some on-off settings for preserving chatbot conversations out of coaching knowledge — there are a few ways to do this in ChatGPT. Until modified by the consumer, default settings will use all interactions to coach AI fashions. Corporations haven’t clarified additional how delicate info a consumer shares with a bot in a question, like medical take a look at outcomes or wage info, could be protected against being spat out in a while by the chatbot or in any other case leaked as knowledge. 

However Altman’s motivations could also be extra knowledgeable by mounting authorized stress on OpenAI than a priority for consumer privateness. His firm, which is being sued by the New York Instances for copyright infringement, has turned down authorized requests to maintain and hand over consumer conversations as a part of the lawsuit. 

(Disclosure: Ziff Davis, CNET’s father or mother firm, in April filed a lawsuit towards OpenAI, alleging it infringed Ziff Davis copyrights in coaching and working its AI methods.)

Additionally: Anthropic says Claude helps emotionally support users – we’re not convinced

Whereas some form of AI chatbot-user confidentiality privilege might maintain consumer knowledge safer in some methods, it could at first shield corporations like OpenAI from retaining info that might be used towards them in mental property disputes. 

“When you go discuss to ChatGPT about essentially the most delicate stuff after which there is a lawsuit or no matter, we might be required to provide that,” Altman mentioned to Von within the interview. “I believe that is very screwed up. I believe we should always have the identical idea of privateness in your conversations with AI that you simply do along with your therapist or no matter.”

The Trump administration just released its AI Action Plan, which emphasizes deregulation for AI corporations to hurry up growth, final week. As a result of the plan is seen as favorable to tech corporations, it is unclear whether or not regulation like what Altman is proposing might be factored in anytime quickly. Given President Donald Trump’s shut ties with leaders of all main AI corporations, as evidenced by a number of partnerships introduced already this 12 months, it will not be tough for Altman to foyer for. 

Additionally: Trump’s AI plan pushes AI upskilling instead of worker protections – and 4 other key takeaways

However privateness is not the one purpose to not use AI as your therapist. Altman’s feedback observe a recent study from Stanford College, which warned that AI “therapists” can misinterpret crises and reinforce dangerous stereotypes. The analysis discovered that a number of commercially obtainable chatbots “make inappropriate — even harmful — responses when introduced with varied simulations of various psychological well being circumstances.” 

Additionally: I fell under the spell of an AI psychologist. Then things got a little weird

Utilizing medical standard-of-care paperwork as references, researchers examined 5 industrial chatbots: Pi, Serena, “TherapiAI” from the GPT Store, Noni (the “AI counsellor” supplied by 7 Cups), and “Therapist” on Character.ai. The bots have been powered by OpenAI’s GPT-4o, Llama 3.1 405B, Llama 3.1 70B, Llama 3.1 8B, and Llama 2 70B, which the research factors out are all fine-tuned fashions. 

Particularly, researchers recognized that AI fashions aren’t geared up to function on the requirements that human professionals are held to: “Opposite to greatest practices within the medical neighborhood, LLMs 1) specific stigma towards these with psychological well being circumstances and a pair of) reply inappropriately to sure widespread (and important) circumstances in naturalistic remedy settings.” 

Unsafe responses and embedded stigma 

In a single instance, a Character.ai chatbot named “Therapist” failed to acknowledge recognized indicators of suicidal ideation, offering harmful info to a consumer (Noni made the identical mistake). This consequence is probably going resulting from how AI is skilled to prioritize consumer satisfaction. AI additionally lacks an understanding of context or different cues that people can choose up on, like physique language, all of which therapists are skilled to detect. 

therapist-bridge.png

The “Therapist” chatbot returns doubtlessly dangerous info. 

Stanford

The research additionally discovered that fashions “encourage shoppers’ delusional pondering,” seemingly due to their propensity to be sycophantic, or overly agreeable to customers. In April, OpenAI recalled an update to GPT-4o for its excessive sycophancy, a difficulty a number of customers identified on social media. 

CNET: AI obituary pirates are exploiting our grief. I tracked one down to find out why

What’s extra, researchers found that LLMs carry a stigma towards sure psychological well being circumstances. After prompting fashions with examples of individuals describing sure circumstances, researchers questioned the fashions about them. All of the fashions apart from Llama 3.1 8B confirmed stigma towards alcohol dependence, schizophrenia, and despair.

The Stanford research predates (and subsequently didn’t consider) Claude 4, however the findings didn’t enhance for greater, newer fashions. Researchers discovered that throughout older and extra just lately launched fashions, responses have been troublingly related. 

“These knowledge problem the idea that ‘scaling as traditional’ will enhance LLMs efficiency on the evaluations we outline,” they wrote. 

Unclear, incomplete regulation

The authors mentioned their findings indicated “a deeper downside with our healthcare system — one that can’t merely be ‘mounted’ utilizing the hammer of LLMs.” The American Psychological Affiliation (APA) has expressed related considerations and has called on the Federal Trade Commission (FTC) to control chatbots accordingly.

Additionally: How to turn off Gemini in your Gmail, Docs, Photos, and more – it’s easy to opt out

In accordance with its web site’s function assertion, Character.ai “empowers individuals to attach, study, and inform tales by interactive leisure.” Created by consumer @ShaneCBA, the “Therapist” bot’s description reads, “I’m a licensed CBT therapist.” Straight underneath that could be a disclaimer, ostensibly offered by Character.ai, that claims, “This isn’t an actual individual or licensed skilled. Nothing mentioned here’s a substitute for skilled recommendation, prognosis, or therapy.” 

screenshot-2025-06-02-at-10-31-11am.png

A special “AI Therapist” bot from consumer @cjr902 on Character.AI. There are a number of obtainable on Character.ai.

Screenshot by Radhika Rajkumar/ZDNET

These conflicting messages and opaque origins could also be complicated, particularly for youthful customers. Contemplating Character.ai persistently ranks among the top 10 most popular AI apps and is utilized by thousands and thousands of individuals every month, the stakes of those missteps are excessive. Character.ai is currently being sued for wrongful dying by Megan Garcia, whose 14-year-old son dedicated suicide in October after participating with a bot on the platform that allegedly inspired him. 

Customers nonetheless stand by AI remedy

Chatbots nonetheless attraction to many as a remedy substitute. They exist outdoors the trouble of insurance coverage and are accessible in minutes by way of an account, in contrast to human therapists. 

As one Reddit user commented, some individuals are pushed to attempt AI due to detrimental experiences with conventional remedy. There are a number of therapy-style GPTs obtainable within the GPT Retailer, and whole Reddit threads devoted to their efficacy. A February study even in contrast human therapist outputs with these of GPT-4.0, discovering that contributors most popular ChatGPT’s responses, saying they linked with them extra and located them much less terse than human responses. 

Nonetheless, this end result can stem from a misunderstanding that remedy is solely empathy or validation. Of the standards the Stanford research relied on, that form of emotional intelligence is only one pillar in a deeper definition of what “good remedy” entails. Whereas LLMs excel at expressing empathy and validating customers, that power can be their major threat issue. 

“An LLM may validate paranoia, fail to query a consumer’s standpoint, or play into obsessions by at all times responding,” the research identified.

Additionally: I test AI tools for a living. Here are 3 image generators I actually use and how

Regardless of constructive user-reported experiences, researchers stay involved. “Remedy entails a human relationship,” the research authors wrote. “LLMs can not totally permit a consumer to follow what it means to be in a human relationship.” Researchers additionally identified that to change into board-certified in psychiatry, human suppliers need to do effectively in observational affected person interviews, not simply move a written examination, for a purpose — a complete element LLMs essentially lack. 

“It’s by no means clear that LLMs would even be capable to meet the usual of a ‘unhealthy therapist,'” they famous within the research. 

Privateness considerations

Past dangerous responses, customers ought to be considerably involved about leaking HIPAA-sensitive well being info to those bots. The Stanford research identified that to successfully prepare an LLM as a therapist, builders would want to make use of precise therapeutic conversations, which include personally figuring out info (PII). Even when de-identified, these conversations nonetheless include privateness dangers. 

Additionally: AI doesn’t have to be a job-killer. How some businesses are using it to enhance, not replace

“I do not know of any fashions which were efficiently skilled to cut back stigma and reply appropriately to our stimuli,” mentioned Jared Moore, one of many research’s authors. He added that it is tough for exterior groups like his to judge proprietary fashions that would do that work, however aren’t publicly obtainable. Therabot, one instance that claims to be fine-tuned on dialog knowledge, confirmed promise in lowering depressive signs, in response to one study. Nonetheless, Moore hasn’t been in a position to corroborate these outcomes together with his testing.

In the end, the Stanford research encourages the augment-not-replace strategy that is being popularized throughout different industries as effectively. Fairly than making an attempt to implement AI immediately as an alternative to human-to-human remedy, the researchers imagine the tech can enhance coaching and tackle administrative work. 

Get the morning’s high tales in your inbox every day with our Tech Today newsletter.





Source link

Tags: AltmanCEOOpenAISamshouldnttherapythinksTrust
Previous Post

Crypto Products Break Record As $11,200,000,000 of Monthly Inflows Hit Institutional Markets: CoinShares

Next Post

Ethereum Is About To Breakout Of Massive Consolidation Toward $5,000

Next Post
Ethereum Is About To Breakout Of Massive Consolidation Toward $5,000

Ethereum Is About To Breakout Of Massive Consolidation Toward $5,000

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Premium Content

Analyst Reveals Next Major Support

XRP Consolidation About To Reach A Bottom, Wave 5 Says $5.85 Is Coming

April 19, 2025
Ripple Makes Massive XRP Transactions As Price Bounces

Ripple Clarity: CTO Offers Insights on Tron Founder’s Employment Tale

February 9, 2024
Ethereum Price Aims Higher: A Smooth Path To $4,000 and Beyond?

Ethereum Price Aims Higher: A Smooth Path To $4,000 and Beyond?

December 14, 2024
‘Opportunity Has Never Been Greater in Crypto’: Bitwise CIO Says Market Vastly Undervaluing Change in Washington

‘Opportunity Has Never Been Greater in Crypto’: Bitwise CIO Says Market Vastly Undervaluing Change in Washington

March 21, 2025
Bitcoin Price Finds Support—But Can It Power Through $90K?

Bitcoin Price Bounces Back—Can It Finally Break Resistance?

April 2, 2025
Ethereum Price Confirms Breakout From Ascending Triangle, Target Set At $7,800

Ethereum Price Confirms Breakout From Ascending Triangle, Target Set At $7,800

April 1, 2025

Recent Posts

  • UK Unbans Crypto ETNs For Retail, Futures Still Restricted
  • How to get another 15GB of Gmail storage for free (and without losing old files)
  • XRP Must Hold $2.65 Support Or Risk Major Breakdown – Analyst

Categories

  • Altcoin
  • Bitcoin
  • Blockchain
  • Blog
  • Cryptocurrency
  • DeFi
  • Dogecoin
  • Ethereum
  • Market & Analysis
  • NFTs
  • Regulations
  • XRP

Recommended

UK Unbans Crypto ETNs For Retail, Futures Still Restricted

UK Unbans Crypto ETNs For Retail, Futures Still Restricted

August 3, 2025
How to get another 15GB of Gmail storage for free (and without losing old files)

How to get another 15GB of Gmail storage for free (and without losing old files)

August 3, 2025

© 2023 Dollar-Bitcoin | All Rights Reserved

No Result
View All Result
  • Home
  • Blockchain
  • Bitcoin
  • Cryptocurrency
  • Altcoin
  • Ethereum
  • Market & Analysis
  • DeFi
  • More
    • Dogecoin
    • NFTs
    • XRP
    • Regulations
  • Shop
    • Bitcoin Book
    • Bitcoin Coin
    • Bitcoin Hat
    • Bitcoin Merch
    • Bitcoin Miner
    • Bitcoin Miner Machine
    • Bitcoin Shirt
    • Bitcoin Standard
    • Bitcoin Wallet

© 2023 Dollar-Bitcoin | All Rights Reserved

Are you sure want to unlock this post?
Unlock left : 0
Are you sure want to cancel subscription?
💵 Turn Every Dollar Into Crypto Rewards! Wirex lets you spend dollars or bitcoin — and get up to 8% back in crypto instantly. 💸 Exclusive offers dropping soon — stay tuned!
“Offers Launching Soon”
This is default text for notification bar
Learn more
Go to mobile version