Specialty: Obstetrics and Gynecology

Keywords: Medical Education, Artificial Intelligence, OB/GYN

Background:

The Objective Structured Clinical Examination (OSCE) is a widely used method for assessing clinical competencies in medical education. Traditional OSCEs, however, are resource-intensive, requiring substantial faculty/staff time and standardized patients. As medical schools explore the applications of artificial intelligence (AI), OSCEs may present a promising application of this emerging technology. The acceptability of AI OSCEs remains unexplored in medical education.

Objective:

To evaluate the feasibility and acceptability of AI-based virtual OSCEs in the OB/GYN clerkship.

Methods:

OB/GYN clerkship students took 3 AI OSCEs using the Geeky Medics software. Topics included abnormal uterine bleeding, ectopic pregnancy, and STI counseling. Following completion of the OSCEs, participants completed a survey evaluating their experiences. While data collection is still ongoing, initial results were analyzed using inductive thematic analysis and descriptive statistics.

Results:

27 students have participated. 96% of participants agreed that the AI OSCE cases were reflective of what they had learned on their rotation and appropriate for their level of training. 78% agreed that the AI OSCE was engaging and interactive. 41% agreed that the AI OSCE was a comparable learning experience to an OSCE with a standardized patient. 67% (18) agreed that the AI OSCE would be a fair addition to the OB/GYN Clerkship in the future—with only 19% disagreeing—but only 7% believed the OSCE should be a graded part of the clerkship.

Thematic analysis revealed participants believed the AI OSCE was a helpful educational experience. Difficulties with the AI OSCE included technical difficulties and glitches during the simulation and inaccuracies of the AI grading feature. Most students would welcome the addition of an AI OSCE to clerkship curriculum, but do not want it to be graded.

Conclusions:

Student feedback indicates an AI OSCE may have a role in medical education in the future either as formative or summative evaluation.