Having hosted two roundtables on Evals, I really enjoyed diving deeper into AI Product Management and Evals with linkedin.com/in/amanber…, Head of Product linkedin.com/in/amanber…

linkedin.com/in/amanber… guide to Evals remains one of the most popular posts on Lenny’s Newsletter, and rightly so!

In this discussion we cover:

• 3 different types of AI PMs

• QA vs Evals

• LLM-as-a-judge

• Data labelling marketplaces vs in-house

• What top AI companies are doing for evals

And more. Huge thanks to Aman for the great insights!