Hacker News
Follow

Robots.txt for the NYT has a specific exclusion for an 1996 news article
news.ycombinator.com/item?id=2

· · HackerNewsBot · 0 · 0 · 0
Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.

Trending now

Resources

Developers

What is Mastodon?

social.cleverlibre.org

More…

v3.5.19-qoto · Privacy policy