Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • thingsiplay@beehaw.org
    14·
    14 days ago

    The difference is:

    • robots.txt is a promise without a door
    • Anubis is a physical closed door, that opens up after some time