• morgenpost@feddit.org
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 days ago

    The bot behind this initiative has been appearing in server logs for years, but there are still no meaningful results. After all, how useful is an index (“9.15 Billion URLs crawled”) if there is no search engine? I finally just blocked the bot.

    • toothbrush@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 days ago

      Yeah, I hope someone makes an engine based on this, that seems like a really important step that is currently missing completely.