ren worker folder adding orig, mv new one into root
This commit is contained in:
@@ -1,6 +1,6 @@
|
||||
---
|
||||
name: write-atomic-rubric
|
||||
description: Convert a task's finished holistic rubric into the atomic rubric package — tests/atomic-rubric.yaml (criteria with id, category, severity, dimensions, guideline, elaboration) plus tests/grader-context.md (task context, business context, and ground truth, extracted verbatim). Covers Maximum Viable Atomicity, positive guideline phrasing with bold inline answer keys, conditional criteria, dodged-bullet escalation pairs, Crux designation from the holistic rubric's heavy penalties (at most two per task), the schema rules (2-24 criteria; kebab-case ids; no numeric penalty language; no severity on extra_credit), and staging and validation. Use after the holistic rubric is final.
|
||||
description: Convert a task's finished holistic rubric into the atomic rubric package — tests/atomic-rubric.yaml (criteria with id, category, severity, dimensions, guideline, elaboration) plus tests/grader-context.md (task context, business context, and ground truth, extracted verbatim). Covers Maximum Viable Atomicity, positive guideline phrasing with bold inline answer keys, conditional criteria, dodged-bullet escalation pairs, Crux designation from the holistic rubric's heavy penalties (at most two per task), the schema rules (kebab-case ids; no numeric penalty language; no severity on extra_credit), and staging and validation. Use after the holistic rubric is final.
|
||||
---
|
||||
|
||||
# Writing the Atomic Rubric
|
||||
@@ -115,10 +115,12 @@ Each criterion carries:
|
||||
citation, and code quotation, with markdown formatting (backticks, bold, fences)
|
||||
intact. Never invent facts, paths, or requirements the source does not carry.
|
||||
|
||||
The file carries between 2 and 24 criteria; most tasks land in the teens. Every
|
||||
scoring-relevant rule of the source lands in exactly one criterion's guideline or
|
||||
elaboration. Content that is context rather than a requirement belongs in
|
||||
`grader-context.md`, not in a criterion.
|
||||
The criteria count follows the source. Every scoring-relevant rule of the source
|
||||
lands in exactly one criterion's guideline or elaboration, and a rule is never dropped
|
||||
or folded away to reach a target count. Parallel facets of one requirement that the
|
||||
same evidence decides may share a criterion; distinct requirements get their own.
|
||||
Content that is context rather than a requirement belongs in `grader-context.md`, not
|
||||
in a criterion.
|
||||
|
||||
## Crux designation
|
||||
|
||||
@@ -181,7 +183,7 @@ the holistic rubric).
|
||||
|
||||
Reviewers working in a repo checkout also run
|
||||
`npx tsx scripts/validate-rubrics-cli.ts --slug <task-slug>`, which enforces the same
|
||||
schema, the criteria count, the Crux cap, and the numeric-penalty ban. That script is part
|
||||
schema, the Crux cap, and the numeric-penalty ban. That script is part
|
||||
of the review pipeline and does not ship in the toolkit.
|
||||
|
||||
## Related
|
||||
|
||||
Reference in New Issue
Block a user