typed-decision-bench
kyr0/typed-decision-bench
Large typed decision model evaluation benchmark and novel calibration standard (`calibration.json`) for any typed decision inference system, covering 275 distinct use-cases and 27,598 individual decisions for Jev-like open typed decision models.
- Stars
- 0
- Forks
- 0
Why it is listed
typed-decision-bench is an evaluation and calibration suite for systems implementing the System One typed-decision API, including Jev-compatible requests. Its README describes large held-out suites; published results were not reproduced here.