Change in medicine: ChatGPT successfully passed the neurology exam

Change in medicine: ChatGPT successfully passed the neurology exam

user avatar

by Liza Tanasova

3 years ago


OpenAI's LLM 4.0 passed the Clinical Neurology exam, answering 85% of questions correctly from the American Board of Psychiatry and Neurology. The study authors believe that with some improvements, LLMs could find widespread use in clinical neurology.

The results of the experiment, conducted by a team of researchers from Heidelberg University Hospital and the German Cancer Research Center, were published on December 7. The test, which took place on May 31, involved two LLM models - ChatGPT 3.5 and the more recent ChatGPT 4.0. For the experiment, the researchers used a neuroscience question bank from the American Board of Psychiatry and Neurology, as well as a small group of questions from the European Board.

While the older version of ChatGPT scored 66.8% correct, answering 1,306 out of 1,956 questions correctly, the newer model, ChatGPT 4.0, scored 85% with 1,662 correct answers. It is worth noting that ChatGPT 4.0 outperformed regular users in questions related to behavior, cognition and psychology, and passed the neuroscience exam, as 70% correct answers are considered a passing grade in educational institutions. However, both models showed lower performance in tasks requiring “higher order thinking.”

The researchers who conducted the experiment believe that these results support the promise of using LLMs in clinical neurology, with some modifications. However, they also note that there are still some limitations. The implementation of LLMs in clinical neurology as a documentation and decision support system requires caution, as they are still not mature enough to solve cognitive problems.

Tier I

Sector: #18291

Sealed Hiding Place Room

Resource Cache

Resource Cache

Tier I

Requires 25% Tier Progress to Claim
Meme Cache

Meme Cache

Tier I

Requires 50% Tier Progress to Claim
Equipment Cache

Equipment Cache

Tier I

Requires 75% Tier Progress to Claim

After collecting, hiding places will be stored in your inventory and can be opened with Keys.

Other news

Circle Expands Executive Roles Amid Regulatory Challenges

Circle has announced the expansion of roles for two senior executives as it navigates a complex regulatory landscape for its stablecoin business.

user avatarZainab Kamara

Bitcoin Approaches Critical Technical Levels Amid Nvidia's Earnings

Bitcoin is nearing an important technical moment that could determine its market direction as Nvidia prepares for earnings.

user avatarSon Min-ho

Kenya's Central Bank and CMA Require Licensing for Virtual Asset Services

Kenya's central bank and capital markets regulator require businesses providing virtual asset services to apply for licenses under the VASP framework.

user avatarAyman Ben Youssef

SBI Holdings to Explore Tokenized Cambodian Government Bonds

SBI Holdings plans to test tokenized Cambodian government bonds on the Canton Network in collaboration with the National Bank of Cambodia.

user avatarTando Nkube

BNY Partners with Figment to Offer Staking Services for Institutions

BNY's digital asset custody business partners with Figment to provide staking services for institutional clients, aiming to simplify operations and address challenges in earning protocol rewards.

user avatarKofi Adjeman

Invesco Galaxy Bitcoin ETF Partners with BNY Mellon for Custody Services

Invesco Galaxy Bitcoin ETF has entered into a custody agreement with The Bank of New York Mellon to support its Bitcoin holdings while maintaining its relationship with Coinbase.

user avatarNguyen Van Long

Important disclaimer: The information presented on the Dapp.Expert portal is intended solely for informational purposes and does not constitute an investment recommendation or a guide to action in the field of cryptocurrencies. The Dapp.Expert team is not responsible for any potential losses or missed profits associated with the use of materials published on the site. Before making investment decisions in cryptocurrencies, we recommend consulting a qualified financial advisor.