Thinking Allowed

medical / technology / education / art / flub

ChatGPT performs well in the USMLE (nearly passes with no training)

2023-01-13 00:02:21

This pre-print paper suggests ChatGPT could change how assessments might be done.


“We evaluated the performance of a large language model called ChatGPT on the United States Medical Licensing Exam (USMLE), which consists of three exams: Step 1, Step 2CK, and Step 3. ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforcement. Additionally, ChatGPT demonstrated a high level of concordance and insight in its explanations. These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making.“


Source: medrxiv.org

chatgpt step usmle exams language large training three



About

Welcome to my blog. I'm a physician, educationalist, entrepreneur, digital innovator, and medical affairs professional. Coder and founder OutcomesEngine.com. This is also the home of The Crap Artist (Official) blog posts. Dr Dean Jenkins FRCP.

Note. This is a personal blog for sharing and reflecting on my own learning. Any discussion on health matters is as accurate and comprehensive as possible but only general - it is not a substitute for the individual advice you may recieve from your own doctor. Other doctors reading this blog should use their own clinical judgement when interpreting the information and deciding how best to apply it to the care of patients.

Feed

  1. RSS feed

Archives

  1. not available yet (will import my old blog at some point)

Elsewhere

  1. About me
  2. Crap Artist Blog