"AI evals force you into the shoes of your user."

I love this clip from Aman Khan (Director at Arize) on why evaluations are the top AI skill to build in 2025.

In my new interview, Aman breaks down:

- How to write evals like a pro

- 5 AI product principles he swears by

- How to start practicing evals now

Some quotes from Aman:

"All PMs will be AI PMs. You'll either build on top of LLM APIs, use models in your backend, or use AI tools to solve problems in your daily work."

"The waterfall process of writing a PRD and handing it to designers and engineers is dead. Your dev cycle needs to be much shorter."

"Imagine showing up to a meeting with a prototype instead of a PRD. That's the shift PMs will need to make to communicate better in this new AI world."

📌 Watch now: youtu.be/u8lEDw7pOkE

Also available on:

Spotify: creators.spotify.com/po…

Apple: podcasts.apple.com/us/p…

Newsletter: