The evaluation set comes first
Before anything is built we assemble real cases with the right answer written down beside them, produced by the person who currently does the work. It’s slow. It’s also the easiest part to want to skip. Without it, "it seems better" is the only verdict available, and that verdict is worthless three months later when the model underneath has changed. The set outlasts the build. It’s how you check the system after handover.