Projects tagged with “inference”
Browse Jev GitHub projects tagged with inference. Filter, sort and explore their source repositories.
- 12laya-mlxNative MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
mizorewww/laya-mlx · Python
7,104576apple-silicondecision-modelinferencelayalocal-aimachine-learningmlxmodernbert - 154jevfireJEV-inspired parallel decisions for CUDA LLMs. One context, many decisions. vLLM API, game-agent examples, and reproducible benchmarks.
kikoncuo/jevfire · JavaScript
779javascriptcudagame-aiinference - 251levJolt implementation of Laya non-autoregressive System 1 decision engine
jlt-commons/lev · Clojure
312bertblaschez-schemeclojureffiinferencejolt - 269fastjevSDK-first, independently maintained SemIf fork for fast, self-hosted semantic decisions.
chengyongru/fastjev · Python
271inferencellmpythonsdksemantic-decisions - 459typed-lmSingle-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.
neurono-ml/typed-lm · Rust
100actix-webcandleclassificationhuggingfaceinferencellmlora - 649jevtppJev-like decisions. Strong C++ types.
wiatrM/jevtpp · C++
51c++cpp20ggmlinferencelayamachine-learningobservability - 955jev-bridgeJev-style /v1/systemone API in front of any OpenAI-compatible LLM server (one-token logprob scoring, MIT)
TOSUKUi/jev-bridge · Python
21classificationinferencellmlogprobsopenai-compatiblesglang - 1438jevlinZig SDK for TypeSafe AI's Jev decision API. Typed classification, scoring and yes/no probabilities with bounded buffers, retries and deadlines.
copyleftdev/jevlin · Zig
11api-clientclassificationdecision-apifault-injectioninferencesdk - 1525s1-coreS1-Core — a zero-dependency Python harness for System 1 decision models (Jev & friends): choice/score/noul specs, fail-closed calibration gates, wave-parallel fan-out, replayable audit ledger.
acbcore-labs/s1-core · Python
10auditabilitycalibrationconformal-predictiondecision-modelinferencellm-harnessmachine-learning - Modular typed decisions (Jev-type) endpoint for vLLM: /v1/decisions with /v1/systemone compatibility, pluggable readout backends
Timiku/v1-decisions-vllm · Python
10classificationinferenceinference-apillmtyped-decisionsvllmpython
1–10 of 10