Search & Digital Marketing · via Search Engine Journal

OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot

3h ago · curated by Catalyst Web Trendz

New data shows ChatGPT's page-fetching bot is reaching sites that have disallowed it, and OpenAI's own documentation explains why the file may not stop it.

This is a curated summary. The full story was reported by Search Engine Journal.

Read the full story at Search Engine Journal

Put this to work

What it means for your brand.

Stories like this are exactly the terrain we work in every day. If this trend touches your growth plans, these are the services to look at:

Related headlines.

Search Engine Journal3h ago

What A Claude Watermark Can & Can’t Tell You About Authorship

Anthropic plans to watermark Claude text. This article explains what a watermark can confirm and why not finding one doesn't mean the text isn't AI-generated.

Read on our site

Search Engine Land4h ago

Gemini 3.7 Flash rolling out in Google Search

Google is bringing Gemini 3.7 Flash, its latest AI model, to Google Search. It is rolling out today globally in AI Mode for Google AI Pro & Ultra susbcribers in English.…

Read on our site

Search Engine Journal5h ago

YouTube Measures Creator Video on Branded Search Lift, But The Attribution Gap Still Exists

Google's creator playbook proves creator campaigns lift branded search, but omits attribution windows, baselines, and controls.

Read on our site

All of today's digest