Google Clarifies Robots.txt Blocks Don’t Guarantee Index Exclusion
John Mueller explained why URLs blocked by robots.txt can still be indexed, offering solutions for e-commerce sites to m...
Joyce de Castro
June 17, 2026
Author Archive
Joyce is a core team member at Rabbit Rank and the lead author covering SEO news, algorithm updates, industry trends, and actionable ranking strategies.
John Mueller explained why URLs blocked by robots.txt can still be indexed, offering solutions for e-commerce sites to m...
Joyce de Castro
June 17, 2026
Google updates its Generative AI SEO guidance, stating that using LLMs.txt files is acceptable for other services, thoug...
Joyce de Castro
June 17, 2026
Google clarifies it ignores llms.txt and other AI-specific content formats for generative AI in Search, urging focus on...
Joyce de Castro
June 17, 2026
Small merchants can enable agentic commerce through existing platforms like Shopify, BigCommerce, and Stripe without cod...
Joyce de Castro
June 16, 2026
Google Search Console impressions can rise while organic traffic falls due to new content, SERP changes, irrelevant rank...
Joyce de Castro
June 16, 2026
The June 2026 Réacteur edition is live, featuring expert articles on Salesforce B2C Commerce SEO, e-commerce product pag...
Joyce de Castro
June 16, 2026
Ahrefs data reveals 97% of llms.txt files receive no requests, with AI retrieval bots making up only 1% of traffic, chal...
Joyce de Castro
June 16, 2026
Peec AI’s new study reveals that AI prompt intent, not exact keywords, is the primary driver of brand visibility, offeri...
Joyce de Castro
June 15, 2026
Businesses are using competitor reviews on Google Business Profile to identify client opportunities, enhance local SEO,...
Joyce de Castro
June 15, 2026
John Mueller of Google advised on international site folder structure, emphasizing analytics benefits over traditional S...
Joyce de Castro
June 15, 2026
Three new reports on consumer sentiment, AI attitudes, and search behavior highlight the need to reshape Q4 2026 marketi...
Joyce de Castro
June 15, 2026
GWI data shows daily AI Overview users click through to cited sources 3.5x more often, seeking deeper content. Marketers...
Joyce de Castro
June 13, 2026
The U.S. government ordered Anthropic to suspend access to Fable 5 and Mythos 5 AI models due to national security. Anth...
Joyce de Castro
June 13, 2026
MonsterInsights website compromised, sending phishing emails to users. The WordPress plugin warns against third-party do...
Joyce de Castro
June 13, 2026
Google releases new guidelines for Tennessee small businesses to comply with SB 2262, a law protecting against search en...
Joyce de Castro
June 13, 2026
Yoast SEO 27.8 delivers major performance enhancements for large websites, cutting sitemap and admin page loading times...
Joyce de Castro
June 12, 2026
YouTube expands its in-app video sharing and messaging feature to the U.S., U.K., Brazil, and Singapore, reviving a popu...
Joyce de Castro
June 12, 2026
A new white paper by Maxime Doki-Thonon and Sylvain Peyronnet explores how SEO and GEO can influence LLMs and dominate s...
Joyce de Castro
June 11, 2026
Anthropic’s call to pause frontier AI development sparks debate. Discover what this means for SEO professionals, search...
Joyce de Castro
June 11, 2026
Generative AI is transforming web professions. Discover the new skills needed for digital jobs and how schools are adapt...
Joyce de Castro
June 11, 2026
Google’s ‘Tailor Your Feed’ lets users customize their Discover feed with natural language, promoting niche sites and sm...
Joyce de Castro
June 11, 2026
New SE Ranking data reveals Claude as the fastest-growing AI traffic source, with a 386% increase in referrals from Janu...
Joyce de Castro
June 10, 2026
Anthropic’s Claude Fable 5, its new flagship AI model, offers ‘next level’ capabilities in coding, knowledge work, and v...
Joyce de Castro
June 10, 2026
Startups can build effective growth marketing teams on a budget by leveraging AI to prioritize strategy over execution,...
Joyce de Castro
June 9, 2026
Large Language Models struggle with true reasoning and strategic tasks, leading to a ‘convergence problem’ where AI outp...
Joyce de Castro
June 9, 2026
John Mueller advises creating an LLMs.txt file when requested by AI platforms for client acquisition, clarifying its rol...
Joyce de Castro
June 9, 2026
Google updated its official SEO guidance, cautioning against third-party tools’ claims and integrating advice for optimi...
Joyce de Castro
June 8, 2026
Google’s Gemini Deep Research Max introduces blended-retrieval AI agents accessing private user data, transforming AI se...
Joyce de Castro
June 6, 2026
Google updates SEO guidance, encouraging FTC complaints against fraudulent services and cautioning businesses against th...
Joyce de Castro
June 6, 2026
Google Analytics now integrates Google Business Profile data, bringing local metrics like calls and directions into repo...
Joyce de Castro
June 5, 2026
Analysis of Google’s May core update reveals a shift towards pages matching user intent, market, and result type, impact...
Joyce de Castro
June 5, 2026
Google introduces Search profiles for eligible creators, allowing them to consolidate content, customize their presence,...
Joyce de Castro
June 4, 2026
New content alignment tools offer precision but not necessarily accuracy. Relying on these scores can be dangerous for S...
Joyce de Castro
June 4, 2026
The UK’s CMA requires Google to let publishers opt out of AI search features and model training, enhancing control and a...
Joyce de Castro
June 4, 2026
Content creators are leveraging audience feedback, SEO tools, and AI platforms to generate fresh blog post ideas and mai...
Joyce de Castro
June 4, 2026
Google’s recent change to SERP geo-targeting (&gl=fr) makes ranking data unreliable for many SEO tools. Monitorank & Ran...
Joyce de Castro
June 4, 2026
Google Search Console introduces new Generative AI reporting, showing content impressions in AI Overviews and offering p...
Joyce de Castro
June 4, 2026
Explore entity optimization techniques beyond schema markup to enhance your brand’s online identity for search engines a...
Joyce de Castro
June 4, 2026
The SEO Garden Party returns June 18, 2026, offering free online webinars on SEO, AI, and automation. Additional session...
Joyce de Castro
June 4, 2026
AI’s impact on marketing and SEO jobs reveals increased demand for senior roles and a decline in entry-level positions,...
Joyce de Castro
June 3, 2026
DuckDuckGo sees significant user growth in the US after Google’s AI Overviews rollout, driven by users seeking choice an...
Joyce de Castro
June 3, 2026
Google’s May 2026 core update is complete, lasting nearly 12 days with significant volatility observed by SEO practition...
Joyce de Castro
June 2, 2026
A new study reveals 35% of French people changed search habits in under a year, with generative AI and social media driv...
Joyce de Castro
June 2, 2026
A new framework for Google Ads conversion tracking promises to fix misaligned Smart Bidding and improve ROI by different...
Joyce de Castro
June 2, 2026
Google CEO Sundar Pichai discussed AI Search evolution, user satisfaction metrics, and ‘Google Zero’ concerns, acknowled...
Joyce de Castro
June 1, 2026
Google’s new AI guide debunks 5 SEO myths for AI Overview citations but hints at their potential for AI agent actions. U...
Joyce de Castro
June 1, 2026
Microsoft AI CEO predicts full white-collar automation by Aug 2027. NVIDIA CEO advises trades. Experts debate human purp...
Joyce de Castro
May 31, 2026
Google expands Preferred Sources to AI Overviews and AI Mode. Gmail content boosts brand visibility in AI Mode. CEO Pich...
Joyce de Castro
May 29, 2026
Discover when to use Google Performance Max campaigns versus separate campaigns for PPC advertising. This analysis cover...
Joyce de Castro
May 28, 2026
Enterprise SEO recommendations frequently fail due to internal organizational resistance rather than technical inaccurac...
Joyce de Castro
May 27, 2026
Google’s content quality standards remain firm amidst AI advancements, rewarding E-E-A-T and human accountability. Learn...
Joyce de Castro
May 27, 2026
AI search engines increasingly cite Reddit content over brand-owned material. A webinar will address how multi-location...
Joyce de Castro
May 27, 2026
Google’s AI Mode is expanding globally at an unprecedented pace, reaching over one billion monthly users, thanks to its...
Joyce de Castro
May 25, 2026
Reddit CEO Steve Huffman asserts Reddit’s data is crucial for AI, detailing licensing deals with Google/OpenAI and lawsu...
Joyce de Castro
May 25, 2026
AI search hasn’t changed Digital PR’s core, but AI Overviews and new platforms demand refined audience targeting, origin...
Joyce de Castro
May 25, 2026
Figma integrates AI agents via its MCP server, enabling direct read/write access for frictionless design and coding work...
Joyce de Castro
May 25, 2026
Google introduced Universal Cart, an AI-powered smart shopping cart that monitors prices, checks compatibility, and enab...
Joyce de Castro
May 22, 2026
Google launched a core update and unveiled major AI-powered Search changes at I/O, including a redesigned search box and...
Joyce de Castro
May 22, 2026
Google’s John Mueller clarified llms.txt is not an SEO ranking factor, despite its inclusion in new Chrome Lighthouse ‘A...
Joyce de Castro
May 22, 2026
Google has begun rolling out its May 2026 core update, the second core update of the year. The rollout may take two week...
Joyce de Castro
May 22, 2026
Google’s May 2026 Core Update is here, the second of the year, aiming to enhance search relevance. Website owners are ad...
Joyce de Castro
May 22, 2026
A Minddex study reveals YouTube’s visibility in LLM responses isn’t driven by views or subscribers, but by semantic cont...
Joyce de Castro
May 21, 2026
Discover the 7 key highlights of WordPress 7.0, including a modern admin, visual revisions, new blocks, responsive contr...
Joyce de Castro
May 21, 2026
Google I/O 2026 reveals a massive AI-driven overhaul for Search, featuring Gemini 3.5 Flash, autonomous agents, and pers...
Joyce de Castro
May 20, 2026
Google launches Universal Cart at I/O 2026, an AI-powered shopping experience across its platforms, expanding its Univer...
Joyce de Castro
May 19, 2026
Content creators are shifting strategies to produce unique, valuable ‘non-commodity’ content for success in Google’s AI-...
Joyce de Castro
May 19, 2026
Screaming Frog SEO Spider 24.0 introduces AI control via MCP server, automatic crawl comparison, enhanced email notifica...
Joyce de Castro
May 19, 2026
Google introduced the Universal Commerce Protocol (UCP), an open standard for AI agents to interact with merchant websit...
Joyce de Castro
May 19, 2026
Google’s Indexing API is being swamped by bloggers, prompting stricter access controls and concerns for legitimate users...
Joyce de Castro
May 19, 2026
Discover the R.E.M. Framework for audience targeting in the signal-loss era. Learn to be Relevant, Everywhere, and Memor...
Joyce de Castro
May 18, 2026
Réacteur’s May 2026 edition is live, featuring expert articles on search marketing, AI in content and engineering, Webfl...
Joyce de Castro
May 18, 2026
Google introduces Google-Agent, a new AI browsing tool that ignores robots.txt and uses cryptographic identity. Learn ho...
Joyce de Castro
May 17, 2026
Google’s new guide clarifies AI Search optimization, stating AEO/GEO are SEO. It debunks myths like llms.txt and chunkin...
Joyce de Castro
May 15, 2026
Google Analytics now tracks AI assistant traffic, FAQ rich results are deprecated, and publishers like Condé Nast are st...
Joyce de Castro
May 15, 2026
Brands often misdiagnose AI visibility issues. Learn about the three distinct layers—retrieval, relationship, and contex...
Joyce de Castro
May 15, 2026
Google Analytics (GA4) now includes an ‘AI Assistant’ default channel group, automating traffic tracking from chatbots l...
Joyce de Castro
May 14, 2026
Microsoft Bing details the evolution of its search index, distinguishing between human and AI-focused indexing, prioriti...
Joyce de Castro
May 14, 2026
New methods and KPIs are essential for marketers to accurately measure AI search influence and connect it to revenue out...
Joyce de Castro
May 14, 2026
Yoast AI Content Planner, available for Premium users, now generates structured content drafts and post ideas directly i...
Joyce de Castro
May 14, 2026
Google proposes changes to its ‘site reputation abuse’ SEO policy for EU news publishers to avoid a massive fine from th...
Joyce de Castro
May 14, 2026
Optimizing local pages for AI-powered search is crucial for brands seeking to improve visibility in traditional results...
Joyce de Castro
May 13, 2026
Google quietly updated Google Ads reporting for AI queries, showing interpreted user intent instead of exact terms, rais...
Joyce de Castro
May 13, 2026
Google Research introduces ALDRIFT, a new AI framework enabling generative models to produce functionally coherent and r...
Joyce de Castro
May 13, 2026
Adobe’s Q2 2026 report reveals AI-referred traffic now converts 42% better for US retailers, a dramatic reversal in 12 m...
Joyce de Castro
May 13, 2026
IndHack won the GEO GreenRed competition, demonstrating how AI models select sources and effective strategies for Genera...
Joyce de Castro
May 13, 2026
Condé Nast CEO Roger Lynch urges teams to plan for zero search traffic, highlighting shifts in search results and the co...
Joyce de Castro
May 13, 2026
Google officially deprecated FAQ rich results, with full removal by August 2026, impacting SEO strategies and content vi...
Joyce de Castro
May 10, 2026
A global survey and Yoast experts indicate SEO is evolving, not dying, by 2026, with AI expanding its scope while core p...
Joyce de Castro
May 10, 2026
Brands often neglect post-conversion SEO, missing opportunities to boost user retention and experience through valuable...
Joyce de Castro
May 10, 2026
Agentic AI is transforming SEO, moving from traditional rankings to optimizing for AI system trust and understanding for...
Joyce de Castro
May 10, 2026
Yoast’s April 2026 SEO update highlights Google’s AI agent signals, core updates, and the shift to AI-first search, dema...
Joyce de Castro
May 9, 2026
Google reports 19% growth in Search revenue for Q1 2026, with CEO Sundar Pichai crediting AI for record query levels and...
Joyce de Castro
May 9, 2026
Google’s ‘Preferred Sources’ feature is now global, letting users prioritize news sites in search results. Publishers se...
Joyce de Castro
May 8, 2026
Industry experts identified seven common mistakes in AI website design, leading to generic aesthetics and problematic us...
Joyce de Castro
May 8, 2026
Current methods for measuring AI traffic ROI are flawed due to fundamental differences between search engines and LLMs i...
Joyce de Castro
May 8, 2026
A new keyword research strategy for local SEO aims to build trust signals, improving local business visibility in AI sea...
Joyce de Castro
May 8, 2026
SEO experts are evolving into AI Search Experts, using three strategies to control AI answer accuracy and ensure brand r...
Joyce de Castro
May 8, 2026
WordPress is losing market share while Astro, a static site generator, sees rapid growth. Experts discuss the shift from...
Joyce de Castro
May 7, 2026
Google introduces five updates to AI Search, including subscription labels, inline links, and hover previews, to increas...
Joyce de Castro
May 7, 2026
Microsoft announced four new AI-powered features for Bing Webmaster Tools at SEO Week, including Citation Share, intent/...
Joyce de Castro
May 6, 2026
Minecraft.fr’s Clément Reynaud reported a 50% drop in Google clicks due to AI, despite stable impressions, highlighting...
Joyce de Castro
May 6, 2026