Sites scramble to block #ChatGPT Web Crawler
https://arstechnica.com/information-technology/2023/08/openai-details-how-to-keep-chatgpt-from-gobbling-up-website-data/
@lupyuen will the gptbot actually"listen" to the robots.tx though? Hmm. I guess can't hurt to do it.
@tootbrute @lupyuen "professional courtesy" 😁
CleverLibre Social is an inclusive social instance for open discussion, learning, and community. All cultures welcome. Hate speech and harassment strictly forbidden.
@lupyuen will the gptbot actually"listen" to the robots.tx though? Hmm. I guess can't hurt to do it.