Change in medicine: ChatGPT successfully passed the neurology exam

Change in medicine: ChatGPT successfully passed the neurology exam

user avatar

by Liza Tanasova

3 years ago


OpenAI's LLM 4.0 passed the Clinical Neurology exam, answering 85% of questions correctly from the American Board of Psychiatry and Neurology. The study authors believe that with some improvements, LLMs could find widespread use in clinical neurology.

The results of the experiment, conducted by a team of researchers from Heidelberg University Hospital and the German Cancer Research Center, were published on December 7. The test, which took place on May 31, involved two LLM models - ChatGPT 3.5 and the more recent ChatGPT 4.0. For the experiment, the researchers used a neuroscience question bank from the American Board of Psychiatry and Neurology, as well as a small group of questions from the European Board.

While the older version of ChatGPT scored 66.8% correct, answering 1,306 out of 1,956 questions correctly, the newer model, ChatGPT 4.0, scored 85% with 1,662 correct answers. It is worth noting that ChatGPT 4.0 outperformed regular users in questions related to behavior, cognition and psychology, and passed the neuroscience exam, as 70% correct answers are considered a passing grade in educational institutions. However, both models showed lower performance in tasks requiring “higher order thinking.”

The researchers who conducted the experiment believe that these results support the promise of using LLMs in clinical neurology, with some modifications. However, they also note that there are still some limitations. The implementation of LLMs in clinical neurology as a documentation and decision support system requires caution, as they are still not mature enough to solve cognitive problems.

Tier I

Sector: #18291

Sealed Hiding Place Room

Resource Cache

Resource Cache

Tier I

Requires 25% Tier Progress to Claim
Meme Cache

Meme Cache

Tier I

Requires 50% Tier Progress to Claim
Equipment Cache

Equipment Cache

Tier I

Requires 75% Tier Progress to Claim

After collecting, hiding places will be stored in your inventory and can be opened with Keys.

Other news

Bitcoin Miners Proposed as Flexible Buyers for Scotland's Wind Power

A new proposal suggests that Bitcoin miners could help utilize excess wind power in Scotland that is often curtailed due to grid limitations.

user avatarDavid Robinson

Meridian FX APAC Initiative Explores Payment Settlement Innovations

The Meridian FX APAC initiative tested payment-versus-payment settlement mechanisms to enhance efficiency in cross-border transactions.

user avatarAndrew Smith

Central Banks Complete Cross-Border FX Settlement Experiment

The Bank of England, Monetary Authority of Singapore, and Bank of Thailand have successfully conducted a trial to connect traditional payment systems with tokenized frameworks.

user avatarJacob Williams

Kazakhstan Plans to Issue Tokenized Government Bonds by 2027

Kazakhstan plans to transition from tokenized central bank notes to the issuance of government bonds using blockchain technology, targeting a sovereign debt issuance in early 2027.

user avatarZainab Kamara

Investors Skeptical of MegaETH's AI Marketplace Plans

Investors express skepticism about MegaETH's transition to an AI marketplace, questioning its impact on the existing Ethereum scaling network.

user avatarSon Min-ho

Kava Lend Suffers Major Exploit, 55 Million KAVA Tokens Lost

An exploit at Kava Lend has drained approximately 55 million KAVA tokens due to a vulnerability in the DeFi protocol.

user avatarAyman Ben Youssef

Important disclaimer: The information presented on the Dapp.Expert portal is intended solely for informational purposes and does not constitute an investment recommendation or a guide to action in the field of cryptocurrencies. The Dapp.Expert team is not responsible for any potential losses or missed profits associated with the use of materials published on the site. Before making investment decisions in cryptocurrencies, we recommend consulting a qualified financial advisor.