Jev in practicewhat to ask, what to keep in code
Stop asking an LLM
for a yes/no.
Send Jev a state and typed questions. It returns decisions and probabilities instead of prose. Your code decides what happens next.
Every number on this page is Jev’s own; the plan text is from a language model and labelled as such.
01The shape of one request

02One live question
Change the sentence. Watch the number.

One live Jev question. The task is fixed; edit the observation and Jev re-answers task_done — a noul, P(yes) — in ~300 ms.
Jev reads literally — sarcasm and hollow "done!" are your code’s job: add a second question or demand details in the state
The question we send
{
"state": {
"task": "Book a table for two at 7pm tonight.",
"observation": "Reservation confirmed — 2 guests, 7:00 PM, Table 12."
},
"questions": {
"task_done": {
"type": "noul",
"instructions": {
"what": "Does `observation` confirm that the goal in `task` was achieved?",
"not_for": "Partial progress, a different time or party size, or a promise to book later."
},
"criteria": {
"true": "The observation confirms the task exactly as stated.",
"false": "It does not confirm the task as stated."
}
}
}
}0 = no · 1 = yes · 0.5 is “can’t tell”, not “medium”
Run it yourself: key at console.typesafe.ai/keys · $0.042 per 1M input tokens, output free · this question: … tokens ≈ $… · plain fetch, no SDK needed
No reliability curve published yet — every number on this page is live, not cherry-picked
03Three ways to ask
noul
Does observation confirm the goal in task?
“Reservation confirmed — 2 guests, 7:00 PM, Table 12.”
choice
“7:00 PM shows unavailable; 7:30 PM selectable”
other is the exit, so a wrong list never forces a wrong answer.score
- 0 nothing done
- 1 started
- 2 one subgoal confirmed
- 3 all but final
- 4 fully confirmed
This playground demonstrates text decisions. Jev also offers experimental image input and Box localization. Read the image and Box guide →
04Learn from real projects
Start with your first request
- Sign up, get an API key and make your first request
- Is the judgment reliable? Labels, baselines and held-out validation
- Jev and an LLM judge: what one ranking experiment can tell us
- Read Graphify: hierarchical selection and failure fallbacks
- Read Tetris: model scores, code weights and experiment limits
- Read Vision: from image captions to actions and error fallbacks
- Read the OpenCode orchestrator: thresholds, child agents and handoffs
- Jev 1.14: images, Box and long context
- Route support tickets in n8n, with a human fallback
The 16 Jev design patterns
Sixteen ways to use a model that only answers with probabilities, read out of ten codebases.
- ViewfinderState minimalism · Frame only what is being judged
- MenuCandidate enumeration · Order only what is on the menu
- Question bankRules as questions · One rule, one question
- GhostwriterDecide/generate split · Jev decides, the ghostwriter writes
- QuestionnaireFlat fan-out · One thing per question, all at once
- PrefetchSpeculative heads · Ask every branch, read the one you take
- Blind reviewCross-check · The reviewer never sees the answer
- FunnelCascade · Cheap first, expensive last
- Traffic lightTiered thresholds · Red stops, amber looks, green goes
- Grey zoneNo-judgment band · 0.5 is not medium, it is unknown
- ThermostatHysteresis · On at 20°, off at 22°
- ScorecardComposite scoring · The model scores, code adds up
- InspectionContract validation · A missing part is not a zero
- Fail open, fail closedFailure-mode knob · Decide now which way the door fails
- Flight recorderJournal & replay · Record the probability, not the action
- Check-upMeasured calibration · Questions get check-ups too
Most-starred Jev-related projects
- siyuanPrivacy-first self-hosted knowledge workspace with native Jev decision model.
- OpenVikingSelf-evolving context database for AI agents, with a Jev rerank client.
- oh-my-claudecodeMulti-agent orchestration for Claude Code with opt-in Jev judgment hooks.
- agentscopeMulti-agent platform with native TypeSafe Jev classification routing.
- simCollaborative workspace to build, deploy, and monitor AI agents and workflows.
- dubOpen-source link attribution platform for short links and conversion tracking.
- jev-ultrafastBrowser agent where Jev picks each action and element; LLM only types text.
- jcodeRust coding agent harness for running many parallel agents with low RAM
- deepevalOpen-source LLM evaluation framework, Pytest-style, with JevEval metric.
- json-renderGenerative UI framework constraining AI output to your component catalog.
- QuantDingerSelf-hosted AI trading OS with optional Jev PASS/REJECT order gate.
- kevTrainable Jev-like decision models on Qwen, running locally.