Judge rules against Google in web scraping case, cites DMCA limits

Image credit: Search Engine Journal

A federal judge in California on July 20 dismissed Google‘s claims against SerpApi, ruling that anti-bot measures protecting revenue do not fall under Digital Millennium Copyright Act protections.

The decision by Chief Judge Yvonne Gonzalez Rogers establishes a precedent that could redefine the boundaries of web scraping and automated access to public web content, impacting the future of the open web and artificial intelligence agents.

Google had accused SerpApi of illegally circumventing its SearchGuard anti-bot system, arguing this violated the DMCA. SerpApi scrapes Google’s search results and resells them, increasingly to AI companies, according to court documents.

However, Judge Rogers ruled that Google’s SearchGuard system primarily serves to protect the company’s advertising revenue, not copyrighted material.

DMCA anti-circumvention provisions specifically apply to technologies designed to protect copyrighted works, the court determined.

This ruling suggests that anti-bot walls guarding commercial interests, rather than intellectual property, do not automatically grant DMCA protection, a finding that could affect numerous websites employing similar systems.

The case highlights a broader ongoing debate regarding the terms under which automated visitors, including AI agents, can access publicly available web content.

The outcome challenges Google’s control over its search results and supports the principle of an open web, where public information is more freely accessible for automated processing.

Representatives for Google and SerpApi did not immediately respond to requests for comment following the decision.

The ruling could have implications for other technology companies, including Amazon and Perplexity, as the legal framework for web scraping continues to evolve.

Source: Search Engine Journal