eldermartins

joined 1 year ago
 

Developers are using "tarpits" to combat AI scrapers that ignore robots.txt. Tools like Nepenthes and Iocaine trap crawlers in infinite loops, wasting their resources.

https://arstechnica.com/tech-policy/2025/01/ai-haters-build-tarpits-to-trap-and-trick-ai-scrapers-that-ignore-robots-txt/

#AI #Privacy