af0a2dcb

By: Kaapo Seppänen <seppanenkaapo@gmail.com>

load the builtin SM in paired performance benchmarks

The SM JSON model now stores rational and optional hypercharges, which the
baseline binary cannot parse from the candidate's shared model files. The
GL15 and GL1 cards import sm-default so each revision loads its own
embedded model; results must still agree between revisions.
GitHub
Time to Start Worker time Duration Time to finish Idle
Config 4s 1s 1s 6s 4s
Eval 6s 36s 36s 42s 0s
Build 41s 0s 0s 41s 0s
Test 42s 11m36s 2m10s 2m53s 0s
Deploy - - - - 0s
Suite 4s 12m13s - - 5s