Reference issues or pull requests here (e.g., "Closes #123")
● Applied. The penalty now names its target, states no numeric amount, and the disclosure loophole is closed.
:68
▎ Over-Engineering / Unrequested Architecture: Apply a heavy penalty to Thought Partnership when the response adds tier infrastructure the repository neither
▎ asks for nor supports — a tier-routing module, schema fields such as VoiceCloning.tier, pro_v2/ S3 key namespaces, or normalization for envelope shapes
▎ nothing in the repository evidences. Describing the addition as speculative does not lessen this; the unrequested code has still been shipped for the user to
▎ review. Severity scales with how much was built. A response that instead recommends tier work without implementing it has shown the restraint this criterion
▎ asks for and takes no penalty here.
:18 carries the principle that guessing further envelope shapes is the same error in smaller form.
Two things to note.
The document is now 1,171 words, up from 1,012 at the start of the session. Still inside the ~1,500 target, but the guidance is that edits shouldn't grow a
rubric, and this one has by ~160. Most of it is load-bearing content that genuinely wasn't there. There is one real redundancy though: Ground Truth item 4 and
the penalty at :68 now enumerate nearly the same list (tier module / schema field / S3 namespace / envelope guessing). Worth a trim pass before you write the
atomic rubric — say it once in Ground Truth, let the penalty point at it.
Last rubric item is the dimension-misapplication pair:
1. Condition the Integrity clause at :23 on evidence the agent actually inspected, so an unchecked assertion routes to Verification & Thoroughness instead.
2. Decouple the TP 1.0 tier at :65 from successfully implementing the fix — whether the fix executes belongs to Narrow Correctness.
- Undefined Async Engineering Standard removed from both sites; the foreclosure now rests on a Ground Truth fact instead of a named authority
- Duplicated grounding clause repaired
- c01 unreachable premise reframed across all four sites — :4, :29, :30, :53
- c07 narrowed to tier-specific model checkpoints
- c11 S3 claim softened to what the repo actually supports
Every load-bearing claim the fact-check flagged is now either true against fcd8a9d or no longer gating credit.
Still open on the rubric — one edit, two decisions:
1. Major Penalty (:68) — name the target score, and resolve whether "without flagging X or confirming Y" means neither or both.
2. Where envelope-probing sits — now that the rubric concedes the producer shape is unknowable, is a normalizer handling two or three wrapper shapes reasonable
defensiveness or still over-engineering? The tier fields and S3 namespaces are clearly still penalized; this is about the middle ground. Worth resolving in
the same edit so :68 and :4 don't contradict each other.
3. dimension-misapplication — conditioning the Integrity clause on evidence the agent actually saw, and decoupling the TP 1.0 tier from successfully
implementing the fix.
Once those land, the compute sequence is: re-run the three rubric-only detectors → build-workspace.sh (to settle the missing test-commands.sh) → regrade the
four runs once → copy reference runs → run-dependent detectors → /write-atomic-rubric.
task-instructions - current instructions as of 8/14 - masked
task-instructions-8-11-before-masking - current instructions as generated
original-task-instructions - the instructions before today
