%0 Journal Article
%T ChatGPT: An Evaluation of AI-Generated Responses to Commonly Asked Pregnancy Questions
%A Christopher Wan
%A Angelo Cadiente
%A Keren Khromchenko
%A Natalie Friedricks
%A Rima A. Rana
%A Jonathan D. Baum
%J Open Journal of Obstetrics and Gynecology
%P 1528-1546
%@ 2160-8806
%D 2023
%I Scientific Research Publishing
%R 10.4236/ojog.2023.139129
%X Background: A recent assessment of ChatGPT on a variety of obstetric and gynecologic
topics was very encouraging. However, its ability to respond to commonly asked
pregnancy questions is unknown. Reference verification needs to be examined as
well. Purpose: To evaluate ChatGPT as a source of information for
commonly asked pregnancy questions and to verify the references it provides. Methods: Qualitative analysis of ChatGPT was performed. We queried ChatGPT
Version 3.5 on 12 commonly asked pregnancy questions and asked for its
references. Query responses were graded as ¡°acceptable¡±
or ¡°not acceptable¡± based on correctness and completeness in comparison to
American College of Obstetricians and Gynecologists (ACOG) publications,
PubMed-indexed evidence, and clinical experience. References were classified as
¡°verified¡±, ¡°broken¡±, ¡°irrelevant¡±, ¡°non-existent¡± or ¡°no references¡±. Review
and grading of responses and references were performed by the co-authors
individually and then as a group to formulate a consensus. Results: In
our assessment, a grade of acceptable was given to 50% of responses (6 out of
12 questions). A grade of not acceptable was
%K AI (Artificial Intelligence)
%K ChatGPT
%K Pregnancy
%U http://www.scirp.org/journal/PaperInformation.aspx?PaperID=127693