Projects tagged with “llm-evaluation”
Browse Jev GitHub projects tagged with llm-evaluation. Filter, sort and explore their source repositories.
- Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
4nt0ineB/typed-decision-bench · Python
00benchmarkcalibrationenglishfrenchlayallm-evaluationmassive-dataset - 2953typedecideOpen-source implementation of the typed-decision pattern popularised by TypeSafe's Jev: read a decision out of a small language model's logits, in the browser. Library, benchmarks and paper. Not affiliated with TypeSafe.
ardada2468/typedecide · Python
00browser-mlconstrained-decodingfine-tuningllm-evaluationllm-inferencelogit-readoutlora - 3013typryxTyped answers with a probability for agent stacks: a choice, a score or a yes/no from a versioned template. Only the fields a template names leave the box, and every answer is on the record. An optional add-on to the TAIPANBOX stack, over HTTP and MCP.
TAIPANBOX/typryx · Go
00agent-governanceai-agentsai-securitygollm-evaluationmcpprobabilitytyped-decisions - Score TypeSafe's Jev on water-supply triage reports: a zero-dependency Python benchmark that answers urgency, scope, cause, priority and escalation questions and checks them against your team's expected policy.
hariprasad2512/water-supply-prioritizer · Python
00benchmarkllm-evaluationpythonwater-supply - TypeSafe Jev decisions for OpenClaw: calibrated Noul/Choice/Score judgments via a dependency-free CLI wrapper. MIT.
westaicommerce/westai-openclaw-jev · Python
00ai-decisionsllm-evaluationopenclawpython
51–55 of 55