Hi, I'm building a personal website and I don't want it to be used to train AI. In my robots.txt
file I blocked:
- ChatGPT-User
- GPTBot
- Google-Extended
- FacebookBot
What bots should I also add? Are there any other ways to block AI bots?
IMPORTANT: I don't want to block search engine crawlers, only bots that are used to train AI.
I was about to ask the same question. It's one thing to think of the potential impacts of AI technology, but to be "against AI" in the most general sense is, to me, a weird concept, especially considering AI is so many things.