jevbooks

← 全部技巧

题目体检

Question health measured

这是什么

Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?

这些不算

Anecdotal claims of accuracy.

questions.json · 每份 README 都发这道题

这道题在 Jev 眼里长这样

jevbooks 就是拿这道题去问 Jev 每一份 README 的。抄结构,别抄字面。题目原文是英文——这就是发给 Jev 的字面内容;state 可以是中文。

{
  "measured-calibration": {
    "type": "noul",
    "instructions": {
      "what": "Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?",
      "not_for": "Anecdotal claims of accuracy."
    },
    "criteria": {
      "true": "The text explicitly describes this. One sentence is enough; other content does not cancel it.",
      "false": "The text does not describe this."
    }
  }
}

用 Jev 做一个 →