Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment
Identification
- Public canonical key
- radar:r-8e869496bf406a2847f27d81a7d1e8cd
- Authors
- Iván Chérrez-Ojeda · Torsten Zuberbier · Gabriela Rodas‐Valero · Jorge Sánchez · Michael Rudenko · Stephanie Dramburg · Pascal M. Demoly · Davide Paolo Caimmi · Rene Maximiliano Gómez · German Dario Ramon · Ghada E. Fouda · Kim R. Quimby · Herberto José Chong‑Neto · Oscar Manuel Calderón LLosa · José Ignacio Larco · Olga Patricia Monge-Ortega · Marco Faytong-Haro · Oliver Pfaar · Jean J. Bousquet · Karla Robles-Velasco · :unav
- Reported year
- 2025
- Reported language
- en
- Source type
- other
- First detected
- 2026-11-13T12:39:02.115074+00:00
- Last metadata observation
- 2026-11-13T12:39:02.115074+00:00
- Last HTTP verification
- Not checked
Documentary abstract — original language
Background: Chat Generative Pre-Trained Transformer 4 (ChatGPT-4) represents an advancing large language model (LLM) with potential applications in medical education and patient care. While Allergen Immunotherapy (AIT) can change the course of allergic diseases, it can also bring uncertainty to patients, who turn to readily available resources such as ChatGPT-4 to address these doubts. This study aimed to use validated tools to evaluate the information provided by ChatGPT-4 regarding AIT in terms of quality, reliability, and readability. Methods: In accordance with EAACI clinical guidelines about AIT, 24 questions were selected and introduced in ChatGPT-4. Independent reviewers evaluated ChatGPT-4 responses using three validated tools: the DISCERN instrument (quality), JAMA Benchmark criteria (reliability), and Flesch-Kincaid Readability Tests (readability). Descriptive statistics summarized findings across categories. Results: ChatGPT-4 responses were generally rated as "fair quality" on DISCERN, with strengths in classification/formulations and special populations. Notably, the tool provided good-quality responses on the preventive effects of AIT in children and premedication to reduce adverse reactions. However, JAMA Benchmark scores consistently indicated "insufficient information" (median = 0-1), primarily due to absent authorship, attribution, disclosure, and currency. Readability analyses revealed a college graduate-level requirement, with most responses classified as "very difficult" to understand. Overall, ChatGPT-4 demonstrated fair quality, insufficient reliability, and difficult readability for patients. Conclusions: ChatGPT-4 provides generally well-structured responses on AIT but lacks reliability and readability for clinical or patient-directed use. Until specialized, reference-based models are developed, healthcare professionals should supervise its use, particularly in sensitive areas such as dosing and safety.
Identifiers
- OPENALEX
- https://openalex.org/W7130834393
- DOI
- 10.24406/publica-7576
Documentary context
- Documentary family
- unknown
- Source-reported types
- other
Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.
Sources
OpenAlex · Record 1
Cite this reference
Iván Chérrez-Ojeda; Torsten Zuberbier; Gabriela Rodas‐Valero; Jorge Sánchez; Michael Rudenko; Stephanie Dramburg; Pascal M. Demoly; Davide Paolo Caimmi; Rene Maximiliano Gómez; German Dario Ramon; Ghada E. Fouda; Kim R. Quimby; Herberto José Chong‑Neto; Oscar Manuel Calderón LLosa; José Ignacio Larco; Olga Patricia Monge-Ortega; Marco Faytong-Haro; Oliver Pfaar; Jean J. Bousquet; Karla Robles-Velasco; :unav. Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. 2025. https://doi.org/10.24406/publica-7576
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.
- APA
- Iván Chérrez-Ojeda; Torsten Zuberbier; Gabriela Rodas‐Valero; Jorge Sánchez; Michael Rudenko; Stephanie Dramburg; Pascal M. Demoly; Davide Paolo Caimmi; Rene Maximiliano Gómez; German Dario Ramon; Ghada E. Fouda; Kim R. Quimby; Herberto José Chong‑Neto; Oscar Manuel Calderón LLosa; José Ignacio Larco; Olga Patricia Monge-Ortega; Marco Faytong-Haro; Oliver Pfaar; Jean J. Bousquet; Karla Robles-Velasco; :unav. (2025). Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. https://doi.org/10.24406/publica-7576
- Chicago
- Iván Chérrez-Ojeda; Torsten Zuberbier; Gabriela Rodas‐Valero; Jorge Sánchez; Michael Rudenko; Stephanie Dramburg; Pascal M. Demoly; Davide Paolo Caimmi; Rene Maximiliano Gómez; German Dario Ramon; Ghada E. Fouda; Kim R. Quimby; Herberto José Chong‑Neto; Oscar Manuel Calderón LLosa; José Ignacio Larco; Olga Patricia Monge-Ortega; Marco Faytong-Haro; Oliver Pfaar; Jean J. Bousquet; Karla Robles-Velasco; :unav. Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. 2025. https://doi.org/10.24406/publica-7576
- ISO 690
- Iván Chérrez-Ojeda; Torsten Zuberbier; Gabriela Rodas‐Valero; Jorge Sánchez; Michael Rudenko; Stephanie Dramburg; Pascal M. Demoly; Davide Paolo Caimmi; Rene Maximiliano Gómez; German Dario Ramon; Ghada E. Fouda; Kim R. Quimby; Herberto José Chong‑Neto; Oscar Manuel Calderón LLosa; José Ignacio Larco; Olga Patricia Monge-Ortega; Marco Faytong-Haro; Oliver Pfaar; Jean J. Bousquet; Karla Robles-Velasco; :unav. Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. 2025. https://doi.org/10.24406/publica-7576
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR Global Rights of Nature Legal Library. Evaluation of the Quality and Reliability of ChatGPT-4's Responses on Allergen Immunotherapy Using Validated Instruments for Health Information Quality Assessment. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-8e869496bf406a2847f27d81a7d1e8cd/ · Last HTTP verification: not performed
Research dossiers and documentary relations
Source roles
Bibliographic / original publication source · https://doi.org/10.24406/publica-7576
An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.
Documentary status
Relevance pending
Library
This identity is not yet included in the Legal Library.