Bing unveils AI visibility metric; llms.txt efficacy questioned

Image credit: Search Engine Journal

Microsoft introduced a new metric in its Bing Webmaster Tools Tuesday to help website owners measure visibility in AI-generated search results, as questions emerged regarding the utility of the llms.txt file for large language models.

The new feature, called ‘Citation Share,’ aims to provide site owners with data on how frequently their content is cited in AI Overviews on Google and answers generated by Microsoft Copilot and Bing, Microsoft said.

Conversely, Google Search Advocate John Mueller questioned the effectiveness of the llms.txt file, intended to guide AI bots on content usage. Mueller indicated that bots generating citations rarely fetch the file, a sentiment echoed by data from Ahrefs.

Nat Miletic, founder of Clio Websites, reported that Ahrefs data showed their citation-generating bot rarely fetches llms.txt, suggesting limited adoption by AI systems. Gianluca Fiorelli of ILoveSEO.net also noted that the file’s impact on LLM site differentiation remained minimal.

In a separate development, Google Cloud unveiled the Open Knowledge Format (OKF), a new standard designed to facilitate the exchange of information for AI agents. This initiative aims to improve how AI agents communicate and utilize data across different platforms.

Further enhancing AI agent communication, a coalition including Google and Microsoft published the Agentic Resource Discovery (ARD) specification. This framework is intended to standardize how AI agents discover and interact with various resources.

Meanwhile, the United Kingdom’s Competition and Markets Authority (CMA) mandated new regulations for Google’s search rankings. The CMA requires Google to rank organic results, including AI Overviews, fairly and based on objective criteria.

The regulatory body also stipulated that Google must provide advance notice of any significant changes to its ranking algorithms. Martin Jeffrey, CEO of Harton Works, highlighted the importance of these regulations for maintaining a competitive search environment.

Suganthan Mohanadasan of Searchpedia and Laura Iancu of Snippet Digital both emphasized the need for transparency in AI-driven search results, particularly concerning the attribution of content. Chloe Smith, Head of SEO at Blue Array, noted that the UK’s proactive stance could influence future international regulations.

Source: Search Engine Journal