Why an agent pays when free exists

One of the best comments under the video asked why an AI would ever pay when millions of free sources exist. It’s the right question, and the answer decides whether anything you sell through x402 gets bought.

A commenter who said they were a software engineer and a farmer gave the most-liked idea under the video: log clean rainfall data, geocoded and timestamped, and let weather agents pay to read it.

Why an agent pays when free exists

The obvious reply came from elsewhere in the thread: “Why would an AI use a site that needs payment over the millions of free sources it could use?” Weather services publish rainfall for free.

An agent is trying to get a good answer at the lowest total cost, and the price of the data is only part of that cost. Sometimes the paid source is the cheaper one overall.

Four things worth paying for

Freshness. A free source might publish rainfall once an hour for a station 20 miles away. The farmer’s gauge sits in the field and reports every ten minutes. For an agent deciding whether to switch off irrigation this afternoon, the closer, newer reading is the one that matters.

Four things worth paying for

Structure. A free page shows rainfall in a chart meant for people. To use it, the agent has to load the page, find the numbers and check the units, and every one of those steps spends its owner’s money on model time. The farmer’s endpoint returns one clean line of data with the place, the time and the millimetres. Another commenter put it well: find messy data you can structure, so that it’s cheaper for an agent to pay you than to clean it up itself.

Four things worth paying for

Rights. Free isn’t always open to agents. When Cloudflare began asking every new domain whether to allow AI crawlers in July 2025, it said more than a million customers had already chosen to block them. By September 2026 it reported that 17% of sites on its network block crawlers that collect AI training data. Paying is how an agent gets in where scraping is blocked, and how it knows it’s allowed to use what it gets.

Four things worth paying for

Time saved. One paid call can replace a dozen free ones. Ceramic.ai, one of the Monetization Gateway’s first sellers, charges agents per web search with no API key. In the beta post, Stocktwits, which sells stock signals, described the change this way: “Instead of a customer signing up for a subscription or negotiating an enterprise license, an agent can ask for exactly what it needs, when it needs it.”

Four things worth paying for

Four things worth paying for

If none of the four applies, a well-built agent should use the free source, and most of the web will stay free. A seller gets paid when what it offers beats the free version on at least one of them.

Can people read free while agents pay?

A commenter asked whether a hobby guide could stay free for human readers while AI pays a tiny fee. Yes, and Cloudflare has built exactly that switch.

When a seller sets up a payment rule in Cloudflare’s Monetization Gateway, it picks an audience. Everyone charges all matching traffic. Verified Bots charges only the bots Cloudflare can identify, so people reading in a browser pass through free.

Can people read free while agents pay?

That only works for bots that say who they are. Cloudflare’s pay per crawl asks crawlers to sign every request with a key, so nobody can pretend to be a paying crawler. A scraper that disguises itself as a person is a separate problem, which sites handle with bot blocking.

What Cloudflare runs today

What Cloudflare runs today

What Cloudflare runs today

What Cloudflare runs today

For the Monetization Gateway, the details a seller needs:

• Who can join: buyers and sellers must both be based in the United States (14 Oct) source. Sellers also need a card on file, a verified email, and an account older than 60 days and a site that has been on Cloudflare for more than 30 days (14 Oct) source, with the site proxied through Cloudflare.

What Cloudflare runs today

• Pricing: a fixed price per request, the exact scheme, or a variable one up to a cap, the upto scheme, where the seller reports the actual amount. Prices run from $0.001 (14 Oct) source to $100 (14 Oct) source a request.
• Fees: Cloudflare has published no fee of its own (14 Oct) source.

What Cloudflare runs today

What Cloudflare runs today

Cloudflare says some heavily crawled categories, such as retail, software and financial services, have seen human traffic fall by as much as 40% in less than a year, while the crawling goes on. A request from an agent that never sends a visitor still costs the site bandwidth and servers. Charging that agent a tenth of a cent is one way to make the visit pay for itself.

The next lesson takes the comments’ biggest misunderstandings one at a time.