jev-snips-benchmark
will-rice/jev-snips-benchmark
Applying Jev to Snips Natural Language Understanding Benchmark
Python
- Stars
- 1
- Forks
- 1
Why it is listed
No inclusion rationale available yet
View cited sourcewill-rice/jev-snips-benchmark
Applying Jev to Snips Natural Language Understanding Benchmark
No inclusion rationale available yet
View cited sourceA learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.
Shared topics: benchmark, evaluation
Three measured experiments on RAG hallucination: quote-checking, TypeSafe's Jev, and IBM's STAIR. 850+ graded questions, raw responses included.
Shared topics: benchmark, evaluation
Reproducible riichi mahjong benchmark for Jev, GPT, Mortal, and hybrid agents using MJAI and RiichiEnv.
Shared topics: benchmark, evaluation