Artificial Intelligence (AI) is transforming medicine, offering new ways too process information and deliver insights. In breast cancer care, AI’s potential to improve patient outcomes and surgical results is a key area of research. Recent studies have explored the accuracy of AI models like ChatGPT in answering questions about breast reconstruction.While previous research has focused on ChatGPT’s reliability for patient inquiries, its utility as a decision-support tool for surgeons is still under investigation.
This study assessed the reliability of recent open AI models, specifically ChatGPT versions 4.0 and 01, in answering standardized in-service plastic surgery exam questions related to breast reconstruction. For questions presented in both text and image formats, ChatGPT 4.0‘s accuracy was evaluated with and without visual input,as it is the only model capable of processing images. The study included five questions, with one question available in both text and image-based formats. Responses were compared against a standardized answer key. Four physicians reviewed the AI model’s responses across multiple chat sessions, analyzing performance on open-ended versus multiple-choice questions.
ChatGPT version 4.0 achieved an average accuracy of 75% on open-ended questions, which improved to 85% for multiple-choice questions. ChatGPT 01, which includes reasoning capabilities, also scored 75% on open-ended questions but reached 85% accuracy on multiple-choice questions. ChatGPT 4.0 demonstrated 100% accuracy on text and image-based open-ended questions. Though, its performance did not significantly change when images were included in the multiple-choice format.
The two AI models exhibited different strengths depending on the question format. Some models performed better with structured prompts,while others excelled with open-ended questions accompanied by images. AI shows promise as a valuable tool in this field.
What are your thoughts on AI’s role in medical decision-making? share your insights in the comments below or subscribe for more groundbreaking research!
