# Websites Fumble in Blocking AI Scrapers, Miss the Real Threat 🤖

**URL:** <https://onehack.st/t/websites-fumble-in-blocking-ai-scrapers-miss-the-real-threat/287910>\
**Category:** News & Articles\
**Tags:** hacking\
**Created:** [July 29, 2024, 11:46pm UTC](https://onehack.st/t/websites-fumble-in-blocking-ai-scrapers-miss-the-real-threat/287910 "2024-07-29T23:46:55Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![TheJoker](https://onehack.st/user_avatar/onehack.st/thejoker/32/22660_2.png) [@TheJoker](https://onehack.st/u/TheJoker)\
**Post date:** [July 29, 2024, 11:46pm UTC](https://onehack.st/t/websites-fumble-in-blocking-ai-scrapers-miss-the-real-threat/287910/1 "2024-07-29T23:46:55Z")

</div>

**Summary:**

1. **Blocking Blunders** : Many websites are failing to block the correct AI scrapers, mistakenly targeting outdated bots and leaving new, active scrapers unblocked.
2. **Rapid Changes** : The ever-evolving landscape of web crawlers makes it difficult for website owners to keep their robots.txt files updated, with new bots from companies like Anthropic, Apple, and Meta regularly appearing.
3. **Expert Insight** : Dark Visitors, a site tracking web crawlers, highlights the growing complexity and popularity of tools designed to help website owners manage and block AI scraping effectively.

[Read more on 404 Media](https://404media.co)