Home/ Rule

// rule — $2,497

Complete AI pay-per-crawl implementation.

Cloudflare configuration. RSL templates. llms.txt files. Pricing calculator. Licensing contracts. Enforcement strategy. Monitoring checklist. Everything a publisher needs to monetize AI crawler traffic. Deployed in 6 hours.

Get Rule — $2,497 See What's Inside

The Problem

73,000 crawls for every 1 referral.

Anthropic's ClaudeBot scrapes your archives while sending nothing back. OpenAI's GPTBot indexes your technical docs. Google's Gemini crawlers train on your research reports. ByteDance's Bytespider ignores your robots.txt entirely.

They train billion-dollar models on your content. You earn zero.

The standard response: block everything. 75% of publishers now block CCBot. 69% block ClaudeBot. 62% block GPTBot.

23:14:07  GPTBot/1.0      /docs/api-reference     200  0.3s
23:14:07  GPTBot/1.0      /docs/authentication    200  0.2s
23:14:08  ClaudeBot/1.0   /research/q4-report     200  0.4s
23:14:08  Bytespider/1.0  /archive/2024           200  0.1s
23:14:09  GPTBot/1.0      /docs/webhooks          200  0.3s
23:14:09  ClaudeBot/1.0   /research/methodology   200  0.2s
...
Revenue from 14,000 daily AI crawls:  $0.00

Blocking stops the scraping. It does not generate revenue.

Meanwhile, publishers with infrastructure collect: News Corp secured $250M from OpenAI. Reddit extracts $60M annually from Google. The Financial Times formed a direct partnership with Anthropic.

The difference is not legal teams or traffic volume. It is implementation. They built systems that enforce payment for access. You are running a website. They are running a licensing operation.

Without Rule vs. With Rule

Implementation transforms the economics.

Without Implementation

AI crawlers scrape freely, 24/7

No pricing terms published

robots.txt is binary: allow or block

Zero revenue from AI training access

No enforcement mechanism

No compliance tracking

Block-everything leaves money on the table

With Rule Deployed

Cloudflare enforces per-crawl pricing at CDN layer

RSL file publishes machine-readable licensing terms

llms.txt communicates terms in natural language

$500-$5,000+/month from existing crawler traffic

Non-compliant crawlers blocked automatically

Dashboard monitors compliance rates per bot

Revenue from every crawl, not just pageviews

What You Get

Six modules. Complete coverage.

Module 01

Cloudflare Pay-Per-Crawl Configuration

Step-by-step dashboard setup: crawler detection rules, pricing tier configuration, payment integration, grace period settings, and monitoring dashboard. 60 minutes to deploy. Covers free through Enterprise plans.

Module 02

RSL File Templates

Three pricing model templates ready for deployment. Template A: Per-crawl pricing (standard Cloudflare marketplace). Template B: Flat-rate annual (direct deal supplement). Template C: Hybrid model (base fee + usage overage). Copy, customize variables, deploy.

Module 03

llms.txt Templates

Content-type-specific specification files: News/Media, B2B/Trade Publication, Technical Documentation. Each template communicates your licensing terms in the format AI systems parse and respect.

Module 04

Pricing Calculator + Formulas

Input your content type, uniqueness score, archive depth, and crawler volume. Output: suggested per-crawl rate, monthly revenue estimate, annual projection. The formulas are included. Run your own models.

Module 05

Licensing Contracts

Three contract structures with full clause breakdowns. Per-Crawl Licensing Agreement (Cloudflare Marketplace). Flat-Rate Annual Agreement (Direct Deal). Attribution-Heavy Agreement (Traffic + Revenue Share). Modify for your publication.

Module 06

robots.txt + Enforcement Strategy

Three ready-to-deploy configurations: Block All (pre-monetization), License via Cloudflare (pay-per-crawl active), Hybrid (some direct deals + marketplace). Plus: first-week monitoring checklist, enforcement escalation procedures, compliance tracking templates.

Rule

$2,497

One-time payment. Complete kit.

✓ Cloudflare configuration guide
✓ 3 RSL file templates
✓ 3 llms.txt templates
✓ Pricing calculator + formulas
✓ 3 licensing contracts
✓ robots.txt configurations
✓ Enforcement strategy
✓ Monitoring checklist

Get Rule

Deploys in 6 hours. Works on any Cloudflare plan.

Benchmark Data

What publishers report after implementation.

Case Study: B2B Trade Publication

8M monthly pageviews · 14,000 daily AI crawler requests · Cloudflare Pay-Per-Crawl + RSL

$1,200 Monthly average after 9 months

38% Compliance rate (OpenAI and Anthropic pay; Bytespider blocked)

6 hrs Setup time to first revenue

Compliance Rates by Crawler (January 2026)

Company	Crawler	Cloudflare Compliance
OpenAI	GPTBot	85%+
Anthropic	ClaudeBot	90%+
Google	Google-Extended	Direct deals
ByteDance	Bytespider	<5% — block

Average publisher results: 35-45% compliance rate, $500-$5,000/month revenue (varies by traffic volume and pricing tier).

What This Is Not

Implementation, not legal advice.

You do not need a licensing lawyer to configure Cloudflare's Pay-Per-Crawl dashboard. You do not need a $250M legal budget to deploy an RSL file. You do not need a dedicated partnerships team to monitor crawler compliance.

You need checklists. Templates. Benchmarks.

Six modules. Every template tested against the protocols that OpenAI, Anthropic, and Google read. Deploys in a single afternoon.

Post-Purchase: Two Follow-Up Lessons

Week 1 Common Setup Mistakes — the four ways publishers break AI crawler monetization

Week 2 Enforcement Strategies — what to do when AI companies ignore your terms

// rule

Your content feeds AI.
This is how you collect.

Every hour without implementation is revenue from AI crawlers you do not capture. The infrastructure exists. The compliance rates are published. The only missing piece is your configuration.