Hacker News (front page)
· Communities
Sites that block AI training crawlers mostly ignore the answer time bots
Article URL: https://sitedex.dev/insights/robots-txt-2023-war-memorial Comments URL: https://news.ycombinator.com/item?id=48819517 Points: 10 # Comments: 0