RSL 1 0 and the new pay to scrape standard for AI
This story covers a new web standard called Really Simple Licensing, or RSL 1 0. It builds on the familiar robots txt file but adds machine readable rules about licensing, compensation, and restrictions for AI crawlers that copy text and images for training or AI search features.
Why RSL matters
- Publishers can signal what uses, like model training or AI answers, require a paid license.
- Major infrastructure providers such as content delivery networks can enforce these rules at the edge.
- Sites can stay visible in classic search while blocking specific AI features that reuse their work without payment.
Read the original article on The Verge.