geo4 min read
Technical Crawler Access for GEO
Generative systems cannot cite what they cannot fetch. Crawler access is table stakes—but allowing a bot is not the same as earning mentions.
By Aditya KumarRead blog ↗
Tag
crawlers
Evidence-led resources connected to crawlers across GEO, AEO, and AI search measurement.
3 published resources
research5 min read
AI Crawler Access Baseline — mentionpop.com (July 2026)
We tested n=4 AI crawlers against live robots.txt and public crawler-control files. All were allowed with HTTP 200—technical access only, not indexing or recommendation proof.
By Aditya KumarRead research ↗
case study4 min read
Case Study: MentionPop Cloudflare AI Crawler Access Rollout
A first-party infrastructure change that unlocked AI crawler fetch access on mentionpop.com—with honest limits on what that proves.
By Aditya KumarRead case study ↗