// source-grounded crawler reference

AI Crawler Monetization Monitor

A vendor-documented reference for identifying AI crawler families and comparing their published robots.txt, llms.txt, and content-licensing posture.

Loading entries… Last verified:

How to read this monitor

Loading methodology…

Operator documentation describes stated policy, not independently measured behavior. User-triggered fetchers are called out separately when their rules differ from automatic crawlers.

Operator / agents Documented purpose robots.txt posture llms.txt posture Payment / licensing posture Source
Loading verified crawler data…