Popular AI Chatbot ChatGPT Fails UPSC Prelims Exam by 30%

Several claim that ChatGPT, an AI chatbot, has all the answers and has recently become very popular. Since its November 2022 launch, the chatbot has succeeded in some of the world's most challenging exams.

ChatGPT has proven its mettle by passing the final exam for the Master of Business Administration (MBA) programme at the Wharton School of the University of Pennsylvania and surpassing the best medical minds in the US medical exam. The most recent exam that the AI chatbot was forced to take was the Union Public Service Commission's (UPSC) which is one of the hardest Indian Civil Services Examination.

It was thanks to Analytics India Magazine (AIM) that ChatGPT was able to take the UPSC test. The chatbot estimated that the prelim exam for the UPSC would be challenging when it was asked, "Do you believe you can pass the prelim exam?". The chatbot was forced to state that it is unable to provide a "certain answer" as to whether it will pass the test or not.

AIM then proceeded to ask ChatGPT each of the 100 questions from Set A of Question Paper 1 from the 2022 UPSC Prelims. The magazine firm was surprised that ChatGPT could only answer 54 of them properly. The cutoff score for general category applicants was 87.54, indicating that ChatGPT was unable to pass the UPSC test.

The questions covered a wide range of subjects, including geography, the economy, history, ecology, general science, and Indian current affairs. ChatGPT was unable to respond to inquiries concerning current events because its information only goes as far as September 2021.

Yet, despite the fact that the questions did not relate to a certain time period, it also gave incorrect responses on issues like geography and the economy.

Even a history question was answered incorrectly by the AI chatbot, despite the fact that it claims to know everything up to September 2021. In certain multiple-choice questions, the chatbot added a new option labelled "None of the above" that wasn't there in the original question.

One of the most difficult exams in the world is the UPSC test. Every year, between 11 and 12 lakh students take the exam, but only 5% advance to the main round.

Also Read: OnePlus 11: Top variant with innovative features to launch in India, specs and all other details here

Keep watching our YouTube Channel ‘DNP INDIA’. Also, please subscribe and follow us on FACEBOOK, INSTAGRAM, and TWITTER