Model Evaluation Should Be a First-Class Engineering Discipline

Ask an ML engineer what they work on and you will hear about models, training runs, and serving infrastructure. Almost nobody says evaluation. Yet for nearly two years I led the design of an evaluation framework for the perception system…