All projects

sysone-bench

instax-dutta/sysone-bench

First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs

Python
Stars
6
Forks
3

Why it is listed

An independent benchmark comparing Laya, the TypeSafe Jev API and constrained Qwen decisions on a sealed shared set of typed questions. Listed for comparison methodology, not endorsement of reported scores.

Related projects

  • system-one-playground

    Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.

    Shared topics: benchmark, calibration, evaluation, laya

  • jevoss

    Evaluation tools for Jev-compatible decision models, covering accuracy, calibration, hidden instructions, padding and consistency.

    Shared topics: benchmark, calibration, decision-model, evaluation

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    Shared topics: benchmark, calibration, laya