Projects tagged with “llm-as-a-judge”
Browse Jev GitHub projects tagged with llm-as-a-judge. Filter, sort and explore their source repositories.
- Evidence over eloquence. Unofficial Claude Code plugin that checks "done" claims and small judgement calls with TypeSafe Jev, and keeps receipts.
ismaildasci/claude-referee · TypeScript
123ai-agentsclaude-codeclaude-code-hooksclaude-code-plugindeveloper-toolsllm-as-a-judge - 1312jev-judgeYAML-based evaluation runner for recorded LLM outputs, with TypeSafe Jev API integration, offline mock mode, and CI reports.
00200200/jev-judge · Python
10ai-agentsci-cdevaluationllm-as-a-judgeragtesting - 1358jev-relevancySearch evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
rickcrawford/jev-relevancy · Python
10bm25duckdbescihybrid-searchinformation-retrievalllm-as-a-judgendcg - Use Jev instead of an LLM for RAG decisions: relevance grading, query routing, hallucination checks and LLM-as-a-judge evals. Faster, cheaper, measured first.
davidzna/better-cheaper-llm · Python
00cost-optimizationgroundednessguardrailshallucination-detectionllmllm-as-a-judgellm-evaluation - 1895jevGrade an AI agent's job with TypeSafe's Jev: did it do the work as the task laid it out? Facts first, Jev on your own key, a receipt, and optional on-chain records.
taifoon-io/jev · TypeScript
00agent-evaluationagentic-commerceai-agentsbaseerc-8183graderllm-as-a-judge - 2123jev-eval-harnessLLM-as-a-judge evaluation harness: a confidence-gated cascade (fast typed judge → Claude) that scores LLM outputs and gates CI on a regression diff. TypeScript, real recorded transcripts, real benchmark numbers.
laszloblum/jev-eval-harness · TypeScript
00anthropicciclaudeeval-harnessevaluationllmllm-as-a-judge - 2248jev-llm-judgeCan a decision model replace an LLM as an eval judge? Same rubrics, scored by Jev and by an LLM, side by side.
nadheesh/jev-llm-judge · Python
00agent-evaluationevaluationllm-as-a-judgellm-evaluationpython - 2358jev-ragcheckRAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.
gabazureus/jev-ragcheck · Python
00benchmarkfaithfulnesshallucination-detectionllm-as-a-judgellm-evaluationportuguesepython - 2501jev-watchdogEvent-driven trajectory watchdog for coding agents: per-event LLM judgments (Jev, Claude, GPT) accumulated into quarantine decisions
glebmish/jev-watchdog · Python
00ai-agentsai-safetyclaude-codeclaude-code-hooksguardrailsllm-as-a-judgepython - 2637laya-guardrailsGuardrails de input, tool call y output para agentes de IA con un modelo System One tipo Jev (laya-pt-es-typed) autoalojado en una NVIDIA L4: 5 ms por check frente a 140 ms de un LLM-as-a-judge.
javimp2003/laya-guardrails · Python
00ai-safetyfastapiguardrailslayallm-agentsllm-as-a-judgenvidia-l4
1–10 of 10