Artificial intelligence is changing the way people search for information online. In recent blogs, we’ve explored the rise of AI bot traffic and the growing debate around SEO vs GEO (Generative Engine Optimisation). One thing is clear: search is evolving rapidly.
Whether it’s AI Overviews, ChatGPT, Gemini, or Perplexity, users are increasingly receiving direct answers instead of traditional lists of search results. It’s faster, more convenient and, in many cases, incredibly useful.
However, as AI-powered search becomes more prominent, concerns around accuracy, transparency, and accountability are growing. Recent developments have highlighted some very real AI risks facing businesses, publishers, and consumers alike.
And they raise an important question: what happens when AI gets it wrong?
A LANDMARK RULING FOR AI SEARCH
A German court recently ruled that Google could be held liable for false claims generated by its AI Overviews feature after two Munich-based publishers were incorrectly linked to scams and questionable business practices.
The significant part of the ruling wasn’t simply that the information was wrong. It was that the claims made by Google’s AI could not be supported by the sources cited alongside the answer.
In effect, the court treated the AI-generated response as Google’s own statement rather than a collection of search results.
While the ruling may yet face appeals, it highlights one of the growing dangers of AI: information can be presented confidently, even when there is little evidence to support it.
For businesses, that should be a concern.
THE SCALE OF MISINFORMATION
No technology is perfect.
The problem isn’t that AI occasionally makes mistakes. The problem is the scale at which those mistakes can occur.
Research from AI company Oumi found that Google’s AI Overviews currently achieve around 91% accuracy. That sounds reassuring until you consider the volume of searches Google processes every day.
At Google’s scale, even a relatively small error rate can translate into millions of inaccurate answers being generated every hour.
The same research also found that many AI-generated responses could not be fully traced back to the sources cited alongside them. In other words, the AI may have reached the correct answer, but there was no clear evidence showing how it got there.
This is one of the most significant AI risks currently facing users.
Historically, search engines have provided links that allow users to verify information for themselves. AI search is increasingly removing that step, asking users to trust the answer rather than examine the evidence.
WHY PUBLISHERS ARE PUSHING BACK
For years, publishers have created the content that powers the internet. Search engines would direct users to those websites, creating a system that rewarded original content through traffic.
AI search changes that relationship.
Today, AI systems can summarise articles, reports, and research directly within search results, often reducing the need for users to visit the original source.
As a result, many publishers are questioning whether the arrangement remains sustainable.
Some organisations are already blocking AI crawlers from accessing their content, while others are pursuing legal challenges or licensing agreements with AI providers.
Their concern isn’t simply about traffic.
It’s about maintaining a viable ecosystem where quality information continues to be produced.
After all, if publishers stop creating valuable content because there is no commercial incentive to do so, where will future AI systems get their information from?
WHAT DOES THIS MEAN FOR BUSINESSES?
Many organisations still see AI search as an SEO issue.
And as a search engine optimisation agency, we can say with great confidence that it is.
But even more than that, it’s also reputation issue.
Customers are already using AI tools to research suppliers, compare products, and evaluate service providers. In many cases, the AI-generated answer may be the first thing a prospective customer sees about a business.
If that information is inaccurate, outdated or misleading, the consequences can be significant.
The dangers of AI aren’t limited to dramatic examples of misinformation. They can include:
- Incorrect business information being displayed to customers.
- Outdated product or service details.
- Misrepresentation of expertise or qualifications.
- False associations with negative reviews or fraudulent activity.
- Inaccurate summaries of complex products or services.
When AI-generated information influences purchasing decisions, accuracy becomes more than a technical issue. It becomes a commercial one.
THE GROWING IMPORTANCE OF DIGITAL AUTHORITY
The rise of AI search reinforces something marketers and SEO professionals have been saying for years.
Authority matters.
Trust matters.
Accurate information matters.
Businesses should be actively monitoring how they appear within AI-generated search results and ensuring that their websites provide clear, accurate and up-to-date information.
This includes:
- Maintaining strong website content.
- Demonstrating expertise within your industry.
- Keeping company information current.
- Building authority through thought leadership and content marketing.
- Monitoring online mentions and brand reputation.
The fundamentals of good SEO haven’t disappeared. If anything, they’ve become more important as AI systems increasingly determine what information users see first.
THE FUTURE OF AI SEARCH NEEDS ACCOUNTABILITY
The German ruling is unlikely to be the last legal challenge involving AI-generated content.
As AI becomes more deeply integrated into search, consumers, regulators, and businesses will increasingly expect technology companies to take responsibility for the information their systems generate.
Because the biggest AI risks aren’t the funny screenshots that circulate on social media.
They’re the moments when incorrect information damages reputations, influences decisions, or impacts livelihoods.
The dangers of AI are not a reason to reject the technology. AI search undoubtedly offers significant benefits and will continue to transform how we access information.
But innovation without accountability creates problems.
As businesses become more dependent on AI-powered search, accuracy, transparency, and trust will be just as important as speed and convenience.
And that may prove to be one of the defining challenges of the AI era.