Evidence
![](https://psychiatryai.com/wp-content/uploads/2023/04/psychiatryai_com.webp)
Otolaryngol Head Neck Surg. 2024 Jul 24. doi: 10.1002/ohn.897. Online ahead of print.
ABSTRACT
OBJECTIVE: To investigate the consistency of Chatbot Generative Pretrained Transformer (ChatGPT)-4 in the analysis of clinical pictures of common laryngological conditions.
STUDY DESIGN: Prospective uncontrolled study.
SETTING: Multicenter study.
METHODS: Patient history and clinical videolaryngostroboscopic images were presented to ChatGPT-4 for differential diagnoses, management, and treatment(s). ChatGPT-4 responses were assessed by 3 blinded laryngologists with the artificial intelligence performance instrument (AIPI). The complexity of cases and the consistency between practitioners and ChatGPT-4 for interpreting clinical images were evaluated with a 5-point Likert Scale. The intraclass correlation coefficient (ICC) was used to measure the strength of interrater agreement.
RESULTS: Forty patients with a mean complexity score of 2.60 ± 1.15. were included. The mean consistency score for ChatGPT-4 image interpretation was 2.46 ± 1.42. ChatGPT-4 perfectly analyzed the clinical images in 6 cases (15%; 5/5), while the consistency between GPT-4 and judges was high in 5 cases (12.5%; 4/5). Judges reported an ICC of 0.965 for the consistency score (P = .001). ChatGPT-4 erroneously documented vocal fold irregularity (mass or lesion), glottic insufficiency, and vocal cord paralysis in 21 (52.5%), 2 (0.05%), and 5 (12.5%) cases, respectively. ChatGPT-4 and practitioners indicated 153 and 63 additional examinations, respectively (P = .001). The ChatGPT-4 primary diagnosis was correct in 20.0% to 25.0% of cases. The clinical image consistency score was significantly associated with the AIPI score (rs = 0.830; P = .001).
CONCLUSION: The ChatGPT-4 is more efficient in primary diagnosis, rather than in the image analysis, selecting the most adequate additional examinations and treatments.
PMID:39045737 | DOI:10.1002/ohn.897
![Google](https://www.google.com/images/branding/googlelogo/2x/googlelogo_light_color_92x30dp.png)
![Google Keep](https://www.gstatic.com/images/branding/product/1x/keep_48dp.png)
![Share on Linkedin](https://psychiatryai.com/wp-content/uploads/2023/10/linkedin-logo-png-2048-1.png)
Estimated reading time: 4 minute(s)
Latest: Psychiatryai.com #RAISR4D Evidence
![](/wp-content/uploads/2024/04/bd462cc11bcf0bd0d0d6f1d0f8b7cd04-modified-1.png)
Cool Evidence: Engaging Young People and Students in Real-World Evidence
![](/wp-content/uploads/2024/04/bd462cc11bcf0bd0d0d6f1d0f8b7cd04-modified-1.png)
Real-Time Evidence Search [Psychiatry]
![](/wp-content/uploads/2024/04/pubmed.png)
AI Research
![](/wp-content/uploads/2024/05/Il5nR_nf_400x400-modified-1.png)
ChatGPT-4 Consistency in Interpreting Laryngeal Clinical Images of Common Lesions and Disorders
![](https://psychiatryai.com/wp-content/uploads/2023/04/psychiatryai_com.webp)
🌐 90 Days
Evidence Blueprint
ChatGPT-4 Consistency in Interpreting Laryngeal Clinical Images of Common Lesions and Disorders
![](https://psychiatryai.com/wp-content/uploads/2023/04/psychiatryai_com.webp)
☊ AI-Driven Related Evidence Nodes
(recent articles with at least 5 words in title)
More Evidence
![](https://psychiatryai.com/wp-content/uploads/2023/04/psychiatryai_com.webp)