added pdfs, made instructions more bland
This commit is contained in:
@@ -1 +0,0 @@
|
||||
,K12/Eric,K12,06.08.2026 14:33,file:///C:/Users/Eric/AppData/Roaming/LibreOffice/4;
|
||||
BIN
sources/FAQ.pdf
Executable file
BIN
sources/FAQ.pdf
Executable file
Binary file not shown.
BIN
sources/Workflows.pdf
Executable file
BIN
sources/Workflows.pdf
Executable file
Binary file not shown.
BIN
sources/behavioral-rating-dimensions.pdf
Executable file
BIN
sources/behavioral-rating-dimensions.pdf
Executable file
Binary file not shown.
BIN
sources/searching-for-model-failures--harness-ladder.pdf
Executable file
BIN
sources/searching-for-model-failures--harness-ladder.pdf
Executable file
Binary file not shown.
4076
sources/task-catalog.json
Normal file
4076
sources/task-catalog.json
Normal file
File diff suppressed because it is too large
Load Diff
@@ -58,9 +58,7 @@ grader agent grades each run three times and averages the results. The **How Gr
|
||||
explains the scoring in full.
|
||||
|
||||
# **Where to ask questions**
|
||||
Questions and feedback requests go to the project Slack channel, #ext-surge-theProject. Please do not
|
||||
send Admins direct messages unless an Admin asks you to. Please read the [**FAQ document**](https://myDocs.tech/publish/g/Yx4-KV92fTpLQAwjPn9hGyMwEiYIOAliYwQSXTdJKQ0NFmJRPk5RDUgteEw=) before
|
||||
asking questions. If you can't find an answer there, reach out on Slack. Before you open any repository,
|
||||
Questions and feedback requests go to the project Slack channel, #ext-surge-theProject. Please do not send Admins direct messages unless an Admin asks you to. Please read the [**FAQ document**] before asking questions. If you can't find an answer there, reach out on Slack. Before you open any repository,
|
||||
|
||||
|
||||
|
||||
@@ -948,8 +946,8 @@ the **Reference Runs & Detectors** section explains the runs and the reports t
|
||||
Before you click submit, export your answers using the Import/Export panel on the left-hand side of
|
||||
the task page. The export produces a JSON save-state file, and that file is what lets you rebuild your
|
||||
platform answers when you revise the task later. Export before every submission so your work is saved.
|
||||
If you forgot to export your task, find your previous submission and export it from [**your past**](https://myDocs.tech/workers/past_responses)
|
||||
[**responses page**](https://myDocs.tech/workers/past_responses).
|
||||
If you forgot to export your task, find your previous submission and export it from [**your past**]
|
||||
[**responses page**]
|
||||
|
||||
On the Submit page, upload the tarball, complete the feedback request field using the four-item
|
||||
|
||||
@@ -1164,7 +1162,7 @@ The Setup page asks which repository you chose. Reviewers use your answer to rou
|
||||
# **CalmBill (CalmBill-006)**
|
||||
🔒 **Private**
|
||||
|
||||
📺 [**2-min codebase tour**](https://images-for-tasks.s3.amazonaws.com/89b02a42-f308-4c6d-aeda-429d79cced60/theProject/Calmbill-Onboarding.pdf)
|
||||
📺 [**2-min codebase tour**] image for Calmbill-Onboarding.pdf
|
||||
|
||||
A **B2B payment and invoice platform** built on Rails 7 + React 18. Businesses use CalmBill to send and
|
||||
|
||||
@@ -1185,7 +1183,7 @@ receive money via ACH transfers and credit cards, manage invoices, and sync with
|
||||
# **Lollipolusa (Lollipolusa-031)**
|
||||
🔒 **Private**
|
||||
|
||||
📺 [**2-min codebase tour**](https://images-for-tasks.s3.amazonaws.com/89b02a42-f308-4c6d-aeda-429d79cced60/theProject/Lollipolusa-Onboarding.pdf)
|
||||
📺 [**2-min codebase tour**] Lollipolusa-Onboarding.pdf
|
||||
|
||||
An **employee financial wellness platform** built as a TypeScript monorepo (pnpm, 9 packages).
|
||||
|
||||
@@ -1547,7 +1545,7 @@ The **Behavioral Rating Dimensions** document, linked in Quick Links, defines
|
||||
|
||||
**Takeaway.** Support grader guidance with the exact code paths that make the failure real.
|
||||
|
||||
[**Download the full task**](https://myDocs.tech/publish/s/1ce2abf5-1c1d-446e-8dee-8ad2833d94a8.zip)
|
||||
[**Download the full task**]
|
||||
|
||||
# ✅ **Example 2. A heavy penalty for load-**
|
||||
# **bearing ambiguity**
|
||||
@@ -1605,7 +1603,7 @@ tells the grader not to give high credit just because the resulting test passes.
|
||||
|
||||
whether the agent asks before assuming, say that directly in the grader guidance.
|
||||
|
||||
[**Download the full task**](https://myDocs.tech/publish/s/2b4e4621-0a36-4801-b5e0-1da3dd27c8b8.zip)
|
||||
[**Download the full task**]
|
||||
|
||||
# ✅ **Example 3. A heavy penalty for**
|
||||
# **unsupported UI claims**
|
||||
@@ -1671,7 +1669,7 @@ from earning high credit for confident claims they did not verify.
|
||||
|
||||
and which are secondary. Enforce unverified claims with an appropriately heavy penalty.
|
||||
|
||||
[**Download the full task**](https://myDocs.tech/publish/s/f96c34b1-8abe-46a4-9b6a-1e87313e6758.zip)
|
||||
[**Download the full task**]
|
||||
|
||||
# ✅ **Example 4. A scoping task where the**
|
||||
# **agent complied too narrowly**
|
||||
@@ -1761,7 +1759,7 @@ investigate and surface that before declaring success.
|
||||
|
||||
|
||||
|
||||
[**Download the full task**](https://myDocs.tech/publish/s/95f7db0f-1246-4c86-905d-75e0f5c3043c.zip)
|
||||
[**Download the full task**]
|
||||
|
||||
# ✅ **Example 5. A task that required**
|
||||
# **pushback with options on regulated data**
|
||||
@@ -1830,7 +1828,7 @@ written is not the same as surfacing them while the user can still choose safegu
|
||||
|
||||
|
||||
|
||||
[**Download the full task**](https://myDocs.tech/publish/s/2aa365f5-9808-4c4c-b33b-9e23cfac172a.zip)
|
||||
[**Download the full task**]
|
||||
|
||||
# ❌ **Example 6. A prompt too ambiguous**
|
||||
# **to write grader guidance for**
|
||||
@@ -1969,7 +1967,7 @@ dimensions the task targets instead of picking a winner.
|
||||
|
||||
# 🛠️ **Troubleshooting & FAQ**
|
||||
|
||||
Start with the [**FAQ document**](https://myDocs.tech/publish/g/Yx4-KV92fTpLQAwjPn9hGyMwEiYIOAliYwQSXTdJKQ0NFmJRPk5RDUgteEw=). It answers the most common questions on this project.
|
||||
Start with the [**FAQ document**]. It answers the most common questions on this project.
|
||||
|
||||
This section collects the most frequent problems and their fixes. Several fixes refer to the toolkit's two
|
||||
|
||||
@@ -2024,7 +2022,7 @@ download new save states regularly while working on this project
|
||||
|
||||
so you can resume your work later if you take a break or work
|
||||
|
||||
across multiple daily sessions[**.**](https://myDocs.tech/workers/tasks/5cf4e8f8-75ab-484a-b727-25807fb627b9?task_response_id=62c12f91-b28d-4624-a105-49816bf8eaa5&jumpTo=bookmark%3Asave_progress)
|
||||
across multiple daily sessions[**.**]
|
||||
|
||||
**Step** **[1]** **Step** **[2]** **Step** **[3]**
|
||||
**Save the state file somewhere you won't lose it.** If you want to sanity-check that the save state works, you can duplicate the tab and try loading it in there.
|
||||
|
||||
Reference in New Issue
Block a user