Editor-in-Chief Hatice Kübra Elçioğlu Vice Editors Levent Kabasakal Esra Tatar Online ISSN 2630-6344 Publisher Marmara University Frequency Bimonthly (Six issues / year) Abbreviation J.Res.Pharm. Former Name Marmara Pharmaceutical Journal
Journal of Research in Pharmacy 2024 , Vol 28 , Issue 3
ChatGPT's Success in the Board-Certified Pharmacotherapy Specialist (BCPS) Exam
Yaser Mohammed AL-WORAFI1,Wen Han CHOOI3,Ching Siang TAN4,Pei Lin LUA5,Muhammad Junaid FARRUKH6,Hanis Hanum ZULKIFLY7,Long Chiau MING8
1College of Medical Sciences, Azal University for Human Development, Sana’a, Yemen
2College of Pharmacy, University of Science and Technology of Fujairah, Fujairah, United Arab Emirates
3Faculty of Medicine, Quest International University, Ipoh, Malaysia
4School of Pharmacy, KPJ Healthcare University, Nilai, Malaysia
5Faculty of Pharmacy, Universiti Sultan Zainal Abidin, Terengganu, Malaysia
6Faculty of Pharmaceutical Science, UCSI University, Kuala Lumpur, Malaysia
7Faculty of Pharmacy, Universiti Teknologi MARA, Cawangan Selangor, Kampus Puncak Alam, 42300 Bandar Puncak Alam, Selangor,, Malaysia
8School of Medical and Life Sciences, Sunway University, Sunway City 47500, Selangor, Malaysia
DOI : 10.29228/jrp.729 The advent of artificial intelligence (AI) and natural language processing technologies has ushered in a new era of innovative educational tools and resources. ChatGPT, a prominent AI-powered language model, has demonstrated remarkable potential in various fields. In this study, we aim to explore the ability of ChatGPT to answer Pharmacotherapy Specialist (BCPS) exam questions and provide justifications for its answers. We conducted a comprehensive content analysis to scrutinize the applicability and competence of ChatGPT in addressing BCPS exam inquiries while substantiating the correctness of its responses. Our findings reveal that ChatGPT was able to answer 94 out of 128 questions (73.43%) correctly and justify 80.16% of the correct answers appropriately and 76.18% of the noncorrect answers in all questions. Conclusion: The ChatGPT’s ability to answer the Pharmacotherapy Specialist (BCPS) exam and justify the answers was good. ChatGPT could help pharmacists in their preparation for this exam with caution. ChatGPT is still in the early phase of use by educators and students worldwide, and its ability to answer exams will be better in the near future. Attending training workshops about ChatGPT and AI is very important and highly recommended. Practice ChatGPT in medical and health sciences education is very important and highly recommended to explore the potential uses, benefits and risks and suggest recommendations for best practices. Keywords : Artificial Intelligence (AI); ChatGPT; Pharmacotherapy Specialist (BCPS) exam; Educational Tool; Natural Language Processing
Marmara University