ChatGPT almost clears medical exam USMLE ! Is this the future of healthcare education?

ChatGPT: A recent study published in the open-access journal PLOS Digital Health has found that ChatGPT, a machine learning platform developed by OpenAI, can score at or around the approximately 60% threshold for the United States Medical Licensing Exam (USMLE). The study was conducted by Tiffany Kung, Victor Tseng, and their colleagues at Ansible Health, a healthcare startup that provides technology-enhanced treatments for pulmonary diseases.

What is ChatGPT?

ChatGPT is a new artificial intelligence system known as a large language model. It is a deep learning algorithm that can process large amounts of text, recognise, summarise, translate, predict, and generate text and other content based on knowledge obtained from massive datasets. Unlike most chatbots, it cannot search the internet. The machine learning platform uses word relationships predicted by its internal process to generate text.

Also Read: IND vs AUS: ‘ICC should step in!’ Aussie legend Ian Healey slams watering the Nagpur pitch, labels it ‘pathetic’

What is the USMLE?

The USMLE is a highly standardised and regulated series of three examinations - Steps 1, 2CK, and 3. One needs to pass these examinations to obtain medical licensure in the US. As part of the study, the team of researchers tested ChatGPT's performance on the USMLE.

The study found that ChatGPT scored between 52.4% and 75% across the three USMLE exams. Each year, the passing threshold is approximately 60%. Furthermore, the responses provided by ChatGPT for the exam were found to make coherent, internal sense and contained frequent insights.

Notably, ChatGPT was found to demonstrate 94.6% concordance across all its responses, indicating consistency. The software also produced at least one significant insight, which was new, non-obvious, and clinically valid, for 88.9% of its responses.

Another software, called PubMedGPT, which has been trained exclusively on biomedical domain literature, scored 50.8% on an older dataset of USMLE-style questions. Therefore, ChatGPT exceeded the performance of its counterpart model.

Also Read: Jakub Jankto: Father of a three-year-old star Czech footballer comes out as gay publicly | Watch Video

Potential Applications

According to the authors, ChatGPT is the first software to achieve the benchmark of scoring approximately 60% in the USMLE, marking a notable milestone in AI maturation. They also believe that large language models such as ChatGPT may potentially assist human learning in a medical education setting, and can be used during clinical decision-making.

In conclusion, the study found that ChatGPT can almost pass the USMLE, indicating its potential to be used in the medical field.

Keep watching our YouTube Channel ‘DNP INDIA’. Also, please subscribe and follow us on FACEBOOK, INSTAGRAM, and TWITTER