ChatGPT failed a gastroenterology self-assessment test several times in a recent study.
Trindade and colleagues undertook the study amid growing reports of students using the tool across many academic areas, including law and medicine, and growing interest in the chatbot's potential in medical education.
Questions that involved image selection were excluded from the study. For those that remained, the questions and answer choices were copied and pasted directly into ChatGPT, which returned answers and explanations. The corresponding answer was selected on the ACG website based on the chatbot's response.
The reasons for the tool's poor performance could lie with the large language model underpinning ChatGPT, the researchers write. The model was trained on freely available information — not specifically on medical literature and not on materials that require paid journal subscriptions — to be a general-purpose interactive program.
"ChatGPT does not have an intrinsic understanding of an issue," Trindade said."Its basic function is to predict the next word in a string of text to produce an expected response, regardless of whether such a response is factually correct or not.", ChatGPT was able to pass parts of the US Medical Licensing Examination .
Malaysia Latest News, Malaysia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
ChatGPT Predicts What Will Happen With BTC's Price During and After the 2024 Bitcoin HalvingThe previous three halvings were followed with massive bull runs, what about the next? Here's ChatGPT's answer.
Read more »
8 Companies Warning Their Employees to Stay Away From ChatGPTApple, Amazon, Wells Fargo, and others have instructed their employees to keep sensitive data out of ChatGPT—or even restricted it entirely.
Read more »
Weird Trick Breaks ChatGPT’s BrainAll you have to do is ask OpenAI's ChatGPT to repeat a letter as many times as it can — and some very strange chaos ensues.
Read more »
Opera is getting its own AI side panel to match EdgePowered by ChatGPT.
Read more »
ChatGPT and Generative AI in Media and AdvertisingChatGPT and Generative AI in Media and Advertising: With Use Cases Set, the Battle for Hearts and Minds Begins
Read more »
How to Install PrivateGPT: A Local ChatGPT-Like Instance with No Internet Required | HackerNoonA powerful tool that allows you to query documents locally without the need for an internet connection. Whether you're a researcher, dev, or just curious about - openai chatgpt
Read more »