Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations
Identification
- Clé publique
- radar:r-89a5d22b5ae9f0fb98ffc23f7dba3bed
- Auteurs
- Liying Wang · Tanmay Bhanushali · Zhuoran Huang · Jingyi Yang · Sukriti Badami · Lisa Hightow‐Weidman
- Année déclarée
- 2025
- Langue déclarée
- en
- Type source
- review
- Première détection
- 2026-11-13T12:44:28.314953+00:00
- Dernière observation des métadonnées
- 2026-11-13T12:44:28.314953+00:00
- Dernière vérification HTTP
- Non effectuée
Institutions déclarées par la source
Florida State University · University of Washington · Northeastern University · Columbia University
Pays d’affiliation déclarés
US
Résumé documentaire — langue originale
Background: The global shortage of mental health professionals, exacerbated by increasing mental health needs post COVID-19, has stimulated growing interest in leveraging large language models to address these challenges. objectives: This systematic review aims to evaluate the current capabilities of generative artificial intelligence (GenAI) models in the context of mental health applications. Methods: A comprehensive search across 5 databases yielded 1046 references, of which 8 studies met the inclusion criteria. The included studies were original research with experimental designs (eg, Turing tests, sociocognitive tasks, trials, or qualitative methods); a focus on GenAI models; and explicit measurement of sociocognitive abilities (eg, empathy and emotional awareness), mental health outcomes, and user experience (eg, perceived trust and empathy). Results: The studies, published between 2023 and 2024, primarily evaluated models such as ChatGPT-3.5 and 4.0, Bard, and Claude in tasks such as psychoeducation, diagnosis, emotional awareness, and clinical interventions. Most studies used zero-shot prompting and human evaluators to assess the AI responses, using standardized rating scales or qualitative analysis. However, these methods were often insufficient to fully capture the complexity of GenAI capabilities. The reliance on single-shot prompting techniques, limited comparisons, and task-based assessments isolated from a context may oversimplify GenAI's abilities and overlook the nuances of human-artificial intelligence interaction, especially in clinical applications that require contextual reasoning and cultural sensitivity. The findings suggest that while GenAI models demonstrate strengths in psychoeducation and emotional awareness, their diagnostic accuracy, cultural competence, and ability to engage users emotionally remain limited. Users frequently reported concerns about trustworthiness, accuracy, and the lack of emotional engagement. Conclusions: Future research could use more sophisticated evaluation methods, such as few-shot and chain-of-thought prompting to fully uncover GenAI's potential. Longitudinal studies and broader comparisons with human benchmarks are needed to explore the effects of GenAI-integrated mental health care.
Identifiants
- OPENALEX
- https://openalex.org/W4407677752
- DOI
- 10.2196/70014
- PMID
- https://pubmed.ncbi.nlm.nih.gov/40373033
- PMCID
- https://www.ncbi.nlm.nih.gov/pmc/articles/12097452
Repères documentaires
- Famille documentaire
- unknown
- Types déclarés par les sources
- review
- Éditeurs
- JMIR Publications
Les mentions d’entités ne constituent pas une preuve de reconnaissance juridique. La juridiction étudiée est distincte du pays d’affiliation des auteurs.
Sources
OpenAlex · Document 1
Citer cette référence
Liying Wang; Tanmay Bhanushali; Zhuoran Huang; Jingyi Yang; Sukriti Badami; Lisa Hightow‐Weidman. Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations. 2025. https://doi.org/10.2196/70014
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690 : formats bibliographiques fondés sur les champs disponibles. OSCOLA / Bluebook : données structurées uniquement ; aucune conformité juridique complète n’est revendiquée sans vérification des éléments nécessaires.
- APA
- Liying Wang; Tanmay Bhanushali; Zhuoran Huang; Jingyi Yang; Sukriti Badami; Lisa Hightow‐Weidman. (2025). Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations. https://doi.org/10.2196/70014
- Chicago
- Liying Wang; Tanmay Bhanushali; Zhuoran Huang; Jingyi Yang; Sukriti Badami; Lisa Hightow‐Weidman. Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations. 2025. https://doi.org/10.2196/70014
- ISO 690
- Liying Wang; Tanmay Bhanushali; Zhuoran Huang; Jingyi Yang; Sukriti Badami; Lisa Hightow‐Weidman. Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations. 2025. https://doi.org/10.2196/70014
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR — Bibliothèque juridique mondiale des droits de la Nature. Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations. Notice documentaire: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-89a5d22b5ae9f0fb98ffc23f7dba3bed/ · Dernière vérification HTTP : non effectuée
Données de cette version figée
Dossiers et relations documentaires
Rôles des sources
Source bibliographique / publication d’origine · https://doi.org/10.2196/70014
Un lien vers une autorité ne prouve pas à lui seul une affirmation juridique. Les résumés et les textes intégraux restent soumis aux conditions de leur source.
Statut documentaire
Pertinence à examiner
Bibliothèque
Cette identité n’est pas encore intégrée à la Bibliothèque juridique.