Not sure if I totally trust that it will be effective but I did add a robots.txt file and robots meta tag to my website to tryyyyy to block bots crawling my website to feed AI models.
The blog I based my changes on: https://neil-clarke.com/block-the-bots-that-feed-ai-models-by-scraping-your-website/
The changes I made: https://github.com/travissouthard/travissouthard.github.io/pull/27
#robotstxt #robotsdottxt #webdev #noai #ai
@travissouthard the meta tag approach needs to be accepted and standardised!
we've got an open letter to that effect: https://noml.info/
bonifartius 𒂼𒄄
@iron_bug hoping it doesn't get abused like for mail :) @Mojeek @travissouthard
@iron_bug some of those blacklists hold IP ranges hostage without any sane way of getting removed.
i run some rspamd installations and spam almost universally is removed by greylisting (temporarily declining a mail). the blacklists do almost nothing now in my experience.
@Mojeek @travissouthard
