RSL 1 0 and the new pay to scrape standard for AI

B
Baseinsider Team
Author
Articles
Dec 02, 2025
1 min read
148 views
RSL 1 0 and the new pay to scrape standard for AI
Really Simple Licensing 1 0 extends robots txt so publishers can declare how AI companies may use their content, aiming to force paid licensing for training and AI search results.

RSL 1 0 and the new pay to scrape standard for AI

This story covers a new web standard called Really Simple Licensing, or RSL 1 0. It builds on the familiar robots txt file but adds machine readable rules about licensing, compensation, and restrictions for AI crawlers that copy text and images for training or AI search features.

Why RSL matters

  • Publishers can signal what uses, like model training or AI answers, require a paid license.
  • Major infrastructure providers such as content delivery networks can enforce these rules at the edge.
  • Sites can stay visible in classic search while blocking specific AI features that reuse their work without payment.

Read the original article on The Verge.

Related Articles

How the Internet Broke Everyone’s Bullshit Detectors

How the Internet Broke Everyone’s Bullshit Detectors

As AI-generated media and restricted satellite imagery spread online, traditional ways to verify digital content are faltering. The rise of fast-moving synthetic information—often indistinguishable from real events—means audiences must rely more on careful checks and skepticism. Until more robust tools emerge, the best defense is to pause and question before sharing.

Apr 11, 2026 3 min read