Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Analyzing the Performance of ChatGPT in Cardiology and Vascular Pathologies

Walid Hariri

TL;DR

The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively.

Abstract

The article aims to analyze the performance of ChatGPT, a large language model developed by OpenAI, in the context of cardiology and vascular pathologies. The study evaluated the accuracy of ChatGPT in answering challenging multiple-choice questions (QCM) using a dataset of 190 questions from the Siamois-QCM platform. The goal was to assess ChatGPT potential as a valuable tool in medical education compared to two well-ranked students of medicine. The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively. These results showcase how ChatGPT has the potential to be highly effective in the fields of cardiology and vascular pathologies by providing accurate answers to relevant questions.

Analyzing the Performance of ChatGPT in Cardiology and Vascular Pathologies

TL;DR

The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively.

Abstract

The article aims to analyze the performance of ChatGPT, a large language model developed by OpenAI, in the context of cardiology and vascular pathologies. The study evaluated the accuracy of ChatGPT in answering challenging multiple-choice questions (QCM) using a dataset of 190 questions from the Siamois-QCM platform. The goal was to assess ChatGPT potential as a valuable tool in medical education compared to two well-ranked students of medicine. The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively. These results showcase how ChatGPT has the potential to be highly effective in the fields of cardiology and vascular pathologies by providing accurate answers to relevant questions.
Paper Structure (5 sections, 5 figures, 1 table)

This paper contains 5 sections, 5 figures, 1 table.

Table of Contents

  1. Introduction
  2. Dataset
  3. Methodology
  4. Results
  5. Conclusion

Figures (5)

  • Figure 1: The seven lessons related to cardiology and vascular pathologies material.
  • Figure 2: The number of questions per lesson from Siamois-QCM platform.
  • Figure 3: Test results of the two students and ChatGPT per lesson.
  • Figure 4: Example of a correct answer from ChatGPT on Siamois-QCM platform.
  • Figure 5: Example of a wrong answer from ChatGPT on Siamois-QCM platform.