Search & Digital Marketing · via Search Engine Journal

Cloudflare’s AI Crawler Rules Can Block Googlebot

Jul 02, 2026 · curated by Catalyst Web Trendz

Cloudflare now lets all sites manage AI crawlers as Search, Agent, or Training, with Sept. 15 defaults that can block Googlebot for sites blocking training.

This is a curated summary. The full story was reported by Search Engine Journal.

Read the full story at Search Engine Journal

Put this to work

What it means for your brand.

Stories like this are exactly the terrain we work in every day. If this trend touches your growth plans, these are the services to look at:

Related headlines.

Search Engine Journal3h ago

How SEO Teams Stopped Guessing Which AI Search Strategies Paid Off

Navigate the complexities of AI search and discover why traditional testing methods do not apply to language models.

Read on our site

Search Engine Journal4h ago

OpenAI GPT-Live Brings Search Into ChatGPT Voice

OpenAI has begun rolling out GPT-Live, new voice models for ChatGPT that can run a web search and show visual answers while you talk.

Read on our site

Search Engine Land5h ago

Want to present at SMX Next? Now’s the time to submit a pitch!

SMX Next returns online Nov. 18 , focusing on navigating today’s complex search landscape and mastering the tactics that will define success in 2027 and beyond. Search…

Read on our site

All of today's digest