jevbooks

← All projects

verdict

jonesmelton/verdict

Typed OCaml Eio client for TypeSafe AI's Jev evaluation API

Evaluation & Benchmarking98%Runner-up: Infra / SDKs / IntegrationsMany questions, one request

What it is

An unofficial OCaml 5.2+ client SDK for the TypeSafe AI system-one evaluation API. It lets OCaml programs send a state plus typed questions and read back calibrated answers, with TLS, retries and bounded requests handled by the library.

How it uses Jev

Callers build typed questions (Question.noul, Question.choice) with instructions, pack them into a Request with a state, and call Client.evaluate. Jev returns per-question answers; Response.find retrieves a Probability for noul or a choice plus Confidence for choice questions.

Primitives:choicenoul

Technique worth stealing

Question handles carry their answer type, so an answer cannot be read as the wrong kind of answer.

Try it

opam pin add verdict . then run the examples in examples/ with TYPESAFE_API_KEY set.

View on GitHub

judged by Jevjev-1.13.0

Evidence

Each line is one question put to Jev about the README. ≥ 0.60 reads as yes, ≤ 0.40 as no; in between Jev is not making a call.

  • Jev-centricyes0.86
  • Shows a System One patternno0.12
  • Handles uncertaintyno0.04
  • Measuredno0.04
  • Runnableyes0.97
  • Worth recommendingno0.30
  • Model replicano0.03
  • Problem scopescore on a 0–2 scale1.04
  • About Jevyes0.98

Signals by Jev jev-1.13.0, card written by DeepSeek V4.1 Flash from the README on 20 Sept 2026.