这是什么
Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?
这些不算
Anecdotal claims of accuracy.
这道题在 Jev 眼里长这样
jevbooks 就是拿这道题去问 Jev 每一份 README 的。抄结构,别抄字面。题目原文是英文——这就是发给 Jev 的字面内容;state 可以是中文。
{
"measured-calibration": {
"type": "noul",
"instructions": {
"what": "Does the text describe measuring the questions themselves: fire rate, Brier score, precision on historical samples, or an A/B against another model?",
"not_for": "Anecdotal claims of accuracy."
},
"criteria": {
"true": "The text explicitly describes this. One sentence is enough; other content does not cancel it.",
"false": "The text does not describe this."
}
}
}