Vitalik Buterin, co-founder of Ethereum, expresses serious concerns about the use of artificial intelligence to manage financial and organizational systems, highlighting significant risks.
Dangers of Autonomous AI Management
Buterin emphasizes that AI systems can be fooled. If such tools are tasked with managing funds, bad actors could manipulate them, leading to misallocation of resources.
Data Drift Vulnerability in ChatGPT
The discussion about risks intensified following the discovery by Eito Miyamura, the CEO of EdisonWatch, who revealed a vulnerability in the latest ChatGPT update, which allowed the chatbot to seamlessly connect with applications like Gmail and Google Calendar, where attackers could embed commands through calendars to steal personal data.
Proposal for AI Oversight
Buterin believes that instead of allowing AI to govern, a system of 'info finance' should be established, where independent reviewers and human juries oversee competing AI models. This would allow for quick identification of flaws and ensure developer honesty.
Buterin notes that despite the allure of automating governance, without proper oversight and safeguards in place, AI governance could lead to catastrophic outcomes.
