Claim of the moment: Perplexity AI ignores robot.txt files and crawls websites even when the site owner says no. rknight.me/blog/perplexity-ai-is-lying-…
Perplexity AI claims it sends a user agent and respects robots.txt but it absolutely does not
We'll recommend top publications based on the topics you select.