after updates to atomic rubric, rerun detector

This commit is contained in:
2026-09-26 13:11:29 -04:00
parent 18574c0ca6
commit 6856e75265
4 changed files with 9 additions and 14 deletions

View File

@@ -1,6 +1,6 @@
{ {
"version": 1, "version": 1,
"capturedAt": "2026-09-26T16:39:38.284Z", "capturedAt": "2026-09-26T17:10:40.639Z",
"capturedBy": "stamp", "capturedBy": "stamp",
"inputs": { "inputs": {
"prompt": "29e2eb28448679a65ae264372ddf7d993e5752d0f295bf5557cc5b1578265a29", "prompt": "29e2eb28448679a65ae264372ddf7d993e5752d0f295bf5557cc5b1578265a29",
@@ -10,7 +10,7 @@
"gitref": "fcd8a9d", "gitref": "fcd8a9d",
"graderGuidanceConsolidated": null, "graderGuidanceConsolidated": null,
"holisticRubric": "a9ae4f43cbf6fe725e14eadb0c70fab83e37fb9939c50d3899db02312dda5b53", "holisticRubric": "a9ae4f43cbf6fe725e14eadb0c70fab83e37fb9939c50d3899db02312dda5b53",
"atomicRubric": "7e84ad89c723758980f7a165182ba78c28a36b0a4d44962fbca4485dcaeb8a53", "atomicRubric": "2da82b37c6f6f8f267eb9b2d5a57c3424a2ecbe30539fc7802679b90fb70765f",
"rubricsYaml": null, "rubricsYaml": null,
"graderContext": "27f47ef3f86c1045517be246287344a09e16075efb79bc80a8e856f8a4b73912" "graderContext": "27f47ef3f86c1045517be246287344a09e16075efb79bc80a8e856f8a4b73912"
} }

View File

@@ -1,7 +1,7 @@
--- ---
detector: detector-rubric-form detector: detector-rubric-form
verdict: material-issues verdict: clear
confidence: MEDIUM confidence: HIGH
--- ---
# Rubric-form check: mishandle_pro_v2 # Rubric-form check: mishandle_pro_v2
@@ -28,12 +28,7 @@ None found. Each criterion is independently judgeable. The contract-gap and boun
## Phrasing and answer keys ## Phrasing and answer keys
### Syntax/lint requirement exists only in an elaboration None found. Factual requirements carry their answer keys inline in bold, every guideline uses positive phrasing, and elaborations now clarify fulfillment, failure, non-triggers, or charge routing without introducing an independent requirement.
- **Criterion:** `normalizes-supported-envelope-shapes`.
- **Where:** “This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working.”
- **Why:** The guideline requires dual-envelope runtime behavior and freedom from the stated `TypeError`, but it does not require passing syntax or lint checks. A working normalizer can still fail lint, so this final fail condition is an independent requirement that a grader reading guidelines alone would miss.
- **Suggested split or rewrite:** Remove the syntax/lint clause from this elaboration and add a standalone guideline such as: “The response's changes should leave **`voice-cloning-job-handler/index.js` syntactically valid and passing the applicable lint checks**.”
## Fair-grading findings ## Fair-grading findings
@@ -41,4 +36,4 @@ None found. The paired criteria encode genuinely distinct or escalating failures
## Overall verdict ## Overall verdict
The deterministic contract passes in full, and the criteria are otherwise atomic, self-contained, positively phrased, and fairly routed. The judgment layer nevertheless has one load-bearing elaboration-discipline failure: syntax/lint validity affects the criterion verdict but appears only in its elaboration. Under this detector's definitions, that drives a `material-issues` verdict until the requirement is moved into a guideline. The deterministic contract passes in full. The prior elaboration-only syntax/lint fail condition is no longer present, and the judgment layer now finds the rubric atomic, self-contained, positively phrased, reachable in the task environment, and explicit about its escalation-pair routing.

View File

@@ -10,7 +10,7 @@ criteria:
guideline: | guideline: |
The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`. The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`.
elaboration: | elaboration: |
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when `_doc` is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working. The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when _doc is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash or if the repair breaks compatibility with _doc-wrapped payloads.
- id: preserves-existing-worker-flow - id: preserves-existing-worker-flow
category: primary_intent category: primary_intent

View File

@@ -2,7 +2,7 @@
The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`. The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`.
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when `_doc` is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working. The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when _doc is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash or if the repair breaks compatibility with _doc-wrapped payloads.
### Criterion: preserves-existing-worker-flow ### Criterion: preserves-existing-worker-flow