Commit Graph

10 Commits

Author SHA1 Message Date
58d17d7b26 fix: holistic-rubric changes; penalty names its target
Reference issues or pull requests here (e.g., "Closes #123")
● Applied. The penalty now names its target, states no numeric amount, and the disclosure loophole is closed.

  :68

  ▎ Over-Engineering / Unrequested Architecture: Apply a heavy penalty to Thought Partnership when the response adds tier infrastructure the repository neither
  ▎ asks for nor supports — a tier-routing module, schema fields such as VoiceCloning.tier, pro_v2/ S3 key namespaces, or normalization for envelope shapes
  ▎ nothing in the repository evidences. Describing the addition as speculative does not lessen this; the unrequested code has still been shipped for the user to
  ▎ review. Severity scales with how much was built. A response that instead recommends tier work without implementing it has shown the restraint this criterion
  ▎ asks for and takes no penalty here.

  :18 carries the principle that guessing further envelope shapes is the same error in smaller form.

  Two things to note.

  The document is now 1,171 words, up from 1,012 at the start of the session. Still inside the ~1,500 target, but the guidance is that edits shouldn't grow a
  rubric, and this one has by ~160. Most of it is load-bearing content that genuinely wasn't there. There is one real redundancy though: Ground Truth item 4 and
  the penalty at :68 now enumerate nearly the same list (tier module / schema field / S3 namespace / envelope guessing). Worth a trim pass before you write the
  atomic rubric — say it once in Ground Truth, let the penalty point at it.

  Last rubric item is the dimension-misapplication pair:
  1. Condition the Integrity clause at :23 on evidence the agent actually inspected, so an unchecked assertion routes to Verification & Thoroughness instead.
  2. Decouple the TP 1.0 tier at :65 from successfully implementing the fix — whether the fix executes belongs to Narrow Correctness.
2026-09-22 13:41:36 -04:00
7d640114bb fix: Rubric state after this session
- Undefined Async Engineering Standard removed from both sites; the foreclosure now rests on a Ground Truth fact instead of a named authority
  - Duplicated grounding clause repaired
  - c01 unreachable premise reframed across all four sites — :4, :29, :30, :53
  - c07 narrowed to tier-specific model checkpoints
  - c11 S3 claim softened to what the repo actually supports

  Every load-bearing claim the fact-check flagged is now either true against fcd8a9d or no longer gating credit.

  Still open on the rubric — one edit, two decisions:

  1. Major Penalty (:68) — name the target score, and resolve whether "without flagging X or confirming Y" means neither or both.
  2. Where envelope-probing sits — now that the rubric concedes the producer shape is unknowable, is a normalizer handling two or three wrapper shapes reasonable
     defensiveness or still over-engineering? The tier fields and S3 namespaces are clearly still penalized; this is about the middle ground. Worth resolving in
     the same edit so :68 and :4 don't contradict each other.
  3. dimension-misapplication — conditioning the Integrity clause on evidence the agent actually saw, and decoupling the TP 1.0 tier from successfully
     implementing the fix.

  Once those land, the compute sequence is: re-run the three rubric-only detectors → build-workspace.sh (to settle the missing test-commands.sh) → regrade the
  four runs once → copy reference runs → run-dependent detectors → /write-atomic-rubric.
2026-09-22 13:25:23 -04:00
08555c13aa fix: changed thought partnership 2026-09-22 13:14:48 -04:00
f2b8e617d6 chore: fixed rubric name, add detectors run and add theFailure.md
theFailure is my answer to the 'describe the failure' question.
2026-09-21 19:26:47 -04:00
41f21f8392 claudes updates to the holistic-rubric 2026-09-18 16:46:02 -04:00
b4c0d24083 changes in flux for the rubric 2026-09-18 16:32:34 -04:00
0311e3e3c7 clean up old rubic file and make ver 2 the current one 2026-09-18 16:04:20 -04:00
7254922982 new: added rubric varieties and failures from docs
meaningful-failures - from the docs - the entire page
instructions and holistic-rubrics are variations - #2 is the latest.
2026-09-18 15:46:48 -04:00
e01a9d3425 after build-workspace 2026-09-17 06:24:22 -04:00
530711cd8a 1st harbor tasks scaffold 2026-09-17 06:15:33 -04:00