jev-calibration
themsquared/jev-calibration
Is TypeSafe AI's Jev calibrated? Reliability diagram, ECE and saturation split on 240 hand-labelled agent tool calls.
- Stars
- 0
- Forks
- 0
Why it is listed
No inclusion rationale available yet
View cited sourcethemsquared/jev-calibration
Is TypeSafe AI's Jev calibrated? Reliability diagram, ECE and saturation split on 240 hand-labelled agent tool calls.
No inclusion rationale available yet
View cited sourceLearn decision models by building with them. TypeSafe Jev and Microsoft Decision-1 route support tickets in under a second for about $0.02 per 1,000 calls; Claude handles the hard cases. Interactive site, benchmark, calibration tests and docs.
Shared topics: ai-agents, benchmark, calibration
Independent, evidence-based map of when TypeSafe's Jev actually holds up vs. breaks down — real API-call receipts, not a leaderboard. 中文為主的雙語 repo。
Shared topics: ai-agents, benchmark, calibration
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
Shared topics: benchmark, calibration