Evidence
Front Artif Intell. 2024 Sep 9;7:1452469. doi: 10.3389/frai.2024.1452469. eCollection 2024.
ABSTRACT
BACKGROUND: Efficient triage of patient communications is crucial for timely medical attention and improved care. This study evaluates ChatGPT’s accuracy in categorizing nephrology patient inbox messages, assessing its potential in outpatient settings.
METHODS: One hundred and fifty simulated patient inbox messages were created based on cases typically encountered in everyday practice at a nephrology outpatient clinic. These messages were triaged as non-urgent, urgent, and emergent by two nephrologists. The messages were then submitted to ChatGPT-4 for independent triage into the same categories. The inquiry process was performed twice with a two-week period in between. ChatGPT responses were graded as correct (agreement with physicians), overestimation (higher priority), or underestimation (lower priority).
RESULTS: In the first trial, ChatGPT correctly triaged 140 (93%) messages, overestimated the priority of 4 messages (3%), and underestimated the priority of 6 messages (4%). In the second trial, it correctly triaged 140 (93%) messages, overestimated the priority of 9 (6%), and underestimated the priority of 1 (1%). The accuracy did not depend on the urgency level of the message (p = 0.19). The internal agreement of ChatGPT responses was 92% with an intra-rater Kappa score of 0.88.
CONCLUSION: ChatGPT-4 demonstrated high accuracy in triaging nephrology patient messages, highlighting the potential for AI-driven triage systems to enhance operational efficiency and improve patient care in outpatient clinics.
PMID:39315245 | PMC:PMC11417033 | DOI:10.3389/frai.2024.1452469
Estimated reading time: 4 minute(s)
Latest: Psychiatryai.com #RAISR4D Evidence
Cool Evidence: Engaging Young People and Students in Real-World Evidence ☀️
Real-Time Evidence Search [Psychiatry]
AI Research
Large language model triaging of simulated nephrology patient inbox messages
🌐 90 Days
Evidence Blueprint
Large language model triaging of simulated nephrology patient inbox messages
☊ AI-Driven Related Evidence Nodes
(recent articles with at least 5 words in title)
More Evidence