Google's AI Overviews struggles with basic spelling tasks
Original: Why Google’s AI can’t spell Google (or anything else)
Why This Matters
Highlights persistent limitations in AI language models affecting major search platforms
Google's AI Overview feature shows significant spelling errors, claiming there are two Ps in 'Google' and one R in 'poop'. The issues stem from how large language models process text as tokens rather than letters, making character counting a persistent challenge for AI systems.
Google's AI Overview feature continues to display fundamental spelling errors despite the company's AI-forward search overhaul. The system incorrectly states there are two Ps in 'Google' and claims there is 'exactly 1 r in the word poop'. It also identifies two Ds in 'journalism' while spelling it as 'j-o-u-r-n-a-d-i-s-m'. Google acknowledged that 'counting within words has been a known challenge for LLMs' and stated they are working to fix the issue. These problems mirror previous AI Overview failures that cited satirical content and gave bizarre advice. The spelling difficulties persist because LLMs process text as numerical tokens rather than reading letters sequentially like humans, making character counting fundamentally challenging for transformer-based AI models.