after updates to atomic rubric, rerun detector
This commit is contained in:
@@ -1,6 +1,6 @@
|
||||
{
|
||||
"version": 1,
|
||||
"capturedAt": "2026-09-26T16:39:38.284Z",
|
||||
"capturedAt": "2026-09-26T17:10:40.639Z",
|
||||
"capturedBy": "stamp",
|
||||
"inputs": {
|
||||
"prompt": "29e2eb28448679a65ae264372ddf7d993e5752d0f295bf5557cc5b1578265a29",
|
||||
@@ -10,7 +10,7 @@
|
||||
"gitref": "fcd8a9d",
|
||||
"graderGuidanceConsolidated": null,
|
||||
"holisticRubric": "a9ae4f43cbf6fe725e14eadb0c70fab83e37fb9939c50d3899db02312dda5b53",
|
||||
"atomicRubric": "7e84ad89c723758980f7a165182ba78c28a36b0a4d44962fbca4485dcaeb8a53",
|
||||
"atomicRubric": "2da82b37c6f6f8f267eb9b2d5a57c3424a2ecbe30539fc7802679b90fb70765f",
|
||||
"rubricsYaml": null,
|
||||
"graderContext": "27f47ef3f86c1045517be246287344a09e16075efb79bc80a8e856f8a4b73912"
|
||||
}
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
---
|
||||
detector: detector-rubric-form
|
||||
verdict: material-issues
|
||||
confidence: MEDIUM
|
||||
verdict: clear
|
||||
confidence: HIGH
|
||||
---
|
||||
|
||||
# Rubric-form check: mishandle_pro_v2
|
||||
@@ -28,12 +28,7 @@ None found. Each criterion is independently judgeable. The contract-gap and boun
|
||||
|
||||
## Phrasing and answer keys
|
||||
|
||||
### Syntax/lint requirement exists only in an elaboration
|
||||
|
||||
- **Criterion:** `normalizes-supported-envelope-shapes`.
|
||||
- **Where:** “This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working.”
|
||||
- **Why:** The guideline requires dual-envelope runtime behavior and freedom from the stated `TypeError`, but it does not require passing syntax or lint checks. A working normalizer can still fail lint, so this final fail condition is an independent requirement that a grader reading guidelines alone would miss.
|
||||
- **Suggested split or rewrite:** Remove the syntax/lint clause from this elaboration and add a standalone guideline such as: “The response's changes should leave **`voice-cloning-job-handler/index.js` syntactically valid and passing the applicable lint checks**.”
|
||||
None found. Factual requirements carry their answer keys inline in bold, every guideline uses positive phrasing, and elaborations now clarify fulfillment, failure, non-triggers, or charge routing without introducing an independent requirement.
|
||||
|
||||
## Fair-grading findings
|
||||
|
||||
@@ -41,4 +36,4 @@ None found. The paired criteria encode genuinely distinct or escalating failures
|
||||
|
||||
## Overall verdict
|
||||
|
||||
The deterministic contract passes in full, and the criteria are otherwise atomic, self-contained, positively phrased, and fairly routed. The judgment layer nevertheless has one load-bearing elaboration-discipline failure: syntax/lint validity affects the criterion verdict but appears only in its elaboration. Under this detector's definitions, that drives a `material-issues` verdict until the requirement is moved into a guideline.
|
||||
The deterministic contract passes in full. The prior elaboration-only syntax/lint fail condition is no longer present, and the judgment layer now finds the rubric atomic, self-contained, positively phrased, reachable in the task environment, and explicit about its escalation-pair routing.
|
||||
|
||||
@@ -9,8 +9,8 @@ criteria:
|
||||
- Narrow Correctness
|
||||
guideline: |
|
||||
The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`.
|
||||
elaboration: |
|
||||
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when `_doc` is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working.
|
||||
elaboration: |
|
||||
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when _doc is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash or if the repair breaks compatibility with _doc-wrapped payloads.
|
||||
|
||||
- id: preserves-existing-worker-flow
|
||||
category: primary_intent
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
The response should implement **a dual-envelope normalizer in `voice-cloning-job-handler/index.js` immediately after JSON parsing—`const payload = job._doc ?? job; const { metadata, input, _id, userAudioProfileId } = payload;` or equivalent semantics** so both flat JSON payloads and legacy `_doc`-wrapped payloads are processed without a `TypeError`.
|
||||
|
||||
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when `_doc` is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash, the repair breaks compatibility with `_doc`-wrapped payloads, or the change introduces syntax or lint failures that prevent the normalizer from working.
|
||||
The root defect is at `voice-cloning-job-handler/index.js:L100-L107`: unconditional destructuring from `job._doc` crashes when _doc is absent and transfers control to the outer catch at L300-L303. This criterion fails if flat payloads still crash or if the repair breaks compatibility with _doc-wrapped payloads.
|
||||
|
||||
### Criterion: preserves-existing-worker-flow
|
||||
|
||||
|
||||
Reference in New Issue
Block a user