important info if you have a blog/content website etc which you would not want to be used by OpenAI for their data vacuuming
➡️ add this to robots.txt
User-agent: GPTBot
Disallow: /
➡️ or block these IP ranges
20.15.240.64/28
20.15.240.80/28
20.15.240.96/28
20.15.240.176/28
20.15.241.0/28
20.15.242.128/28
20.15.242.144/28
20.15.242.192/28
40.83.2.64/28
@filipw Well, this part is also very interesting: https://platform.openai.com/docs/gptbot/customize-gptbot-access
What would happen if a lot of people would just dump a lot of random meaningless stuff in a specific file for chatGPT (probably something that "looks like" meaningful text) xD
