Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Just the other day Perplexity CEO Aravind Srinivas was dunking on Google and OpenAI, and putting themselves on a superior moral position because they give citations while closed-book LLMs memorize the web information with large models and don't give credit.

Funny they got caught not following robots.txt and hiding their identity.

https://x.com/tsarnick/status/1801714601404547267



Nobody follows robots.txt, because every site's robots.txt forbids anybody that isn't google from looking at it.

Also, "hiding their identity" is what every single browser does since Mosaic changed its name.


Including extra, legacy agents isn't hiding because they include their distinct identifiers too.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: