UAB
Home/Trust/Fixtures
Fixtures
Golden fixture library

Adapter expectations are tracked.

Each adapter should keep at least one known-good raw snapshot and one expected parsed output. Current generated snapshots are listed until explicit golden fixtures are added.
Adapters · 11
API · /api/fixtures
AdapterParserSnapshot hashRaw snapshotExpected outputStatus
arena0.6.02d1617e1d03105e5ccbc03880476246e13fc98dd07f31af80fe11dba0fed73abworkers/data/latest/arena.jsonworkers/data/latest/arena.jsonmanifested golden candidate
livebench0.5.0b8dd06726275e41433d31647c3cc3aa461f053072c112e84faecc4b7627fcdbbworkers/data/latest/livebench.jsonworkers/data/latest/livebench.jsonmanifested golden candidate
artificial-analysis0.5.0647c39936b801edf4575dc126dcb9296907d6e9841c82ab2d760a07eb8187616workers/data/latest/artificial-analysis.jsonworkers/data/latest/artificial-analysis.jsonmanifested golden candidate
bridgebench0.3.0e88bdde9953c1db7dc3703cb374374f9e117a8ce1421f1f70a195f8cea3766a6workers/data/latest/bridgebench.jsonworkers/data/latest/bridgebench.jsonmanifested golden candidate
vals-ai0.2.07832d50554658edba8e81fdbcde0aec9caee597a004047e3b66f398373a47ecbworkers/data/latest/vals-ai.jsonworkers/data/latest/vals-ai.jsonmanifested golden candidate
terminal-bench0.3.0440708058ffa16a128c7b6483e2dfc6c8762c48ee2136b4a72a66fa54426a649workers/data/latest/terminal-bench.jsonworkers/data/latest/terminal-bench.jsonmanifested golden candidate
llmbase0.2.0e3ab53b2f1030676f3dcb3876293f14a6e0300640d5c01a581366be538c8de9fworkers/data/latest/llmbase.jsonworkers/data/latest/llmbase.jsonmanifested golden candidate
scale-labs0.2.0c605e092f74a1a3f9bf8ff6047e7915821e9128a882efa1ff9ccb40983a8e70eworkers/data/latest/scale-labs.jsonworkers/data/latest/scale-labs.jsonmanifested golden candidate
opencompass0.2.0801864a2daa42afe8a6c87c26fb901fc37dae70c272836655b3f7f118a9af93bworkers/data/latest/opencompass.jsonworkers/data/latest/opencompass.jsonmanifested golden candidate
mteb0.2.023f77e243092b2dc66631c59ae87b05da193d0ed6b92036a4c2401dfd51e1b12workers/data/latest/mteb.jsonworkers/data/latest/mteb.jsonmanifested golden candidate
provider-officialunrecorded9604bb00156d076e50019e92b4839563dd1984dca66c28572795fea407f0d812workers/data/latest/manual-verified.jsonworkers/data/latest/manual-verified.jsonneeds review before promoting latest snapshot to golden