Evals as Product Guidance

DoorDash built an offline simulator that generates multi-turn support conversations, then an eval framework grades them against quality criteria. The flywheel: simulation generates eval cases, eval fa…

Ankur Goyal (Braintrust CEO) lays out a concrete eval-driven product process: treat evals as the modern PRD, build a feedback loop that turns real production data into new evals continuously, and run …