jevbooks

← All techniques

Question health measured

题目体检

What it is

Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?

Not this

Anecdotal claims of accuracy.

questions.json · sent for every README

The question, as Jev sees it

This is the literal question jevbooks puts to Jev about every README. Copy the shape, not the wording.

{
  "measured-calibration": {
    "type": "noul",
    "instructions": {
      "what": "Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?",
      "not_for": "Anecdotal claims of accuracy."
    },
    "criteria": {
      "true": "The text explicitly describes this. One sentence is enough; other content does not cancel it.",
      "false": "The text does not describe this."
    }
  }
}

Build this with Jev →