Google Dismisses LLMs.txt for AI, Promotes WebMCP Protocol

Image credit: Search Engine Journal

Google senior analyst John Mueller stated Tuesday that a proposed LLMs.txt file remains speculative and is not currently used or required by artificial intelligence platforms for search visibility.

Mueller emphasized that Google is instead advocating for its Web Model Context Protocol (WebMCP) as a solution for facilitating interaction between AI agents and websites.

Concerns about conflicting guidance emerged after Google Search Central indicated LLMs.txt was unnecessary for generative AI search, while Chrome Lighthouse documentation described it as an “emerging convention.”

Mueller clarified that the Chrome Lighthouse wording was poorly written, suggesting only a possibility rather than a certainty or a beneficial implementation, according to his statements.

He noted the redundancy of an LLMs.txt file, explaining that if a large language model were used to generate such a file, it would already possess the capability to understand the website directly.

WebMCP, a Google-backed proposal, is designed to enable AI agents to discover and utilize website functionalities beyond merely comprehending site structure.

The protocol is currently supported in Chrome and aims to allow AI agents to perform complex tasks, such as comparing products, adding items to shopping carts, and filling out forms on websites.

Mueller indicated that the most critical optimization for AI agents involves ensuring they are not blocked from accessing a site, as these agents can already interact with HTML-based user interfaces.

Google continues to develop and promote WebMCP as a standard for enabling richer, more functional interactions between AI and the web.

Source: Search Engine Journal