Abstract
Introduction
This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5.
Methods
Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories.
Results
ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; p<0.001), indicating improvements in medical knowledge assessment.
Discussion
The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.
Received Date
April 13, 2023
Accepted Date
August 10, 2023
Online Available Date
September 11, 2023
Recommended Citation
Teebagy, Sean; Colwell, Lauren; Wood, Emma; Yaghy, Antonio; and Faustina, Misha
(2024)
"Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5,"
Journal of Academic Ophthalmology: Vol. 15:
Iss.
2, Article 7.
DOI: 10.1055/s-0043-1774399
Available at:
https://www.aupojournal.org/jao/vol15/iss2/7
