Apple faced criticism after releasing Apple Intelligence despite engineers’ warnings about significant model flaws.
Engineers' warnings about faults
Apple engineers discovered significant flaws in Apple Intelligence models before their release. A study published last October highlighted these models' reasoning deficiencies. The GSM8K problem set, comprising thousands of math problems, was used for testing.
AI models' struggles
The tests revealed that AI models struggle to solve problems when not directly copying solutions. Slight alterations in problem statements caused significant inaccuracies, reaching 65%. Even advanced models exhibited these shortcomings.
Market reaction and Apple
Following criticism and complaints about Apple Intelligence's misleading news, Apple paused the program to address issues. Among false reports were claims about Rafael Nadal and other news items.
Apple faced serious criticism, underscoring the importance of thorough product testing before market release.
