Cloudflare has introduced AI Labyrinth, a tool designed to counter web-crawling bots that scrape websites for AI training data without permission.

Unlike traditional robots.txt files, which some AI companies ignore, AI Labyrinth uses AI-generated decoy pages to mislead and slow down these bots.

Described as a “next-generation honeypot,” the tool traps AI crawlers in loops of fabricated content, helping Cloudflare detect malicious bot activity while keeping decoy pages invisible to human users.

Website admins can activate AI Labyrinth in the Bot Management section of their Cloudflare dashboard.

The company plans to enhance the tool by developing interconnected networks of fake URLs to strengthen its effectiveness against evolving bot strategies.

Recent Cloudflare developments