Potentially impacting all AI search engines and chatbots known to poorly paraphrase source links, a German court has ruled that Google is liable for false statements in AI Overviews.
The preliminary ruling came in a case flagged by The Decoder, where two publishers found that Google’s AI Overviews incorrectly linked them to scams and other sketchy business practices. After smearing publishers by making affirmative statements like “Yes, [it] is known for dubious business practices and is often perceived as a scam,” Google failed to correct the misleading output, even after the publishers sent a cease-and-desist letter earlier this year.
Google tried the usual arguments to shield itself from liability for false statements in AI Overviews, such as arguing that most users understand that AI outputs aren’t always accurate and must be verified.
But the court found that, unlike traditional search engines that merely present lists of links to third-party statements, Google’s tool made “independent, new, and substantive statements” based on its own misinterpretation of links on the Internet.
That’s a problem, the court said, because while publishers may have been able to sue to stop third parties from publishing defamatory statements appearing in Google search results, only Google can correct the underlying algorithm and outputs displayed in AI Overviews. And because, at least initially, the company did not, it therefore “must be held accountable,” the court ruled. Beyond that, Google’s argument was deemed particularly weak, since the AI overview in this case “contains statements that do not appear in the search results at all.”
The court’s order—requiring a temporary injunction barring Google from spreading the false claims in any further AI Overviews—may have global implications, as the court seems to be the first to hold an AI firm liable for AI speech.
In the past, AI firms have hoped that disclaimers warning about misinformation would protect them from lawsuits over untrustworthy outputs. Last year, one chatbot maker even argued that AI speech is its own category of “pure speech” and the First Amendment should protect it.
According to a Google translation of the German court ruling, however, the false outputs were “primarily an expression of the defendant’s commercial activity,” and the AI tool’s “opinions” and false statements were capable of impacting public opinion.
