Robots.txt for the NYT has a specific exclusion for an 1996 news article

by
from Hacker News on (#5FX68)
Comments
External Content
Source RSS or Atom Feed
Feed Location https://news.ycombinator.com/rss
Feed Title Hacker News
Feed Link https://news.ycombinator.com/
Reply 0 comments