The robots.txt issue this guy highlights are the least of his worries. He doesn't seem to realize that what he is describing as having built is embarrassingly bad.
CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.