jevbooks

← All projects

jev-align

sutro-sh/jev-align · Homepage

Build calibrated AI Functions from human feedback using Jev and GEPA.

Data Labeling & Curation73%Runner-up: Evaluation & Benchmarking

What it is

jev-align is an experimental CLI from Sutro for building AI Functions with TypeSafe's Jev. It finds uncertain examples, asks you to label them, and uses GEPA to improve the function.

How it uses Jev

Jev evaluates dataset rows and measures uncertainty. It selects ambiguous rows plus a random audit sample for labeling. Accumulated labels and optional rationales are used to run GEPA, which proposes an improved definition.

Primitives:choicescore

Technique worth stealing

Use uncertainty sampling to select ambiguous rows for human labeling, then optimize with GEPA.

Try it

uv tool install jev-align; export TYPESAFE_API_KEY and OPENAI_API_KEY; run jeva

View on GitHub

judged by Jevjev-1.13.0

Evidence

Each line is one question put to Jev about the README. ≥ 0.60 reads as yes, ≤ 0.40 as no; in between Jev is not making a call.

  • Jev-centricyes0.88
  • Shows a System One patternyes0.70
  • Handles uncertaintyyes0.79
  • Measuredno0.06
  • Runnableyes0.96
  • Worth recommendingunclear0.48
  • Model replicano0.05
  • Problem scopescore on a 0–2 scale1.19
  • About Jevyes0.98

Signals by Jev jev-1.13.0, card written by DeepSeek V4.1 Flash from the README on 20 Sept 2026.