Clean a golden set before you trust it
Your goal
Find the 2 planted defects in dirty/eval/golden_cases.jsonl and flag every affected line in findings.jsonl.
- Stage 5
- 2 defects
- 16 KB of data
- FromGolden datasets and the metrics that matter
- Northvale Bank
Pro lab
This lab is in Pro.
The brief, the hints, and grading against the kit’s scorer are in Pro. Stage 1’s lab is free.
- Every stage and specialisation, in full
- Every lab and every role project
- Halden weeks 2–10, on your record
- Every drill, live in the playground
- All solutions, plus the server judge
- Lab Assistant and every Teach with AI
Defects to find
N09Near-duplicate cases in the golden set
24 lines to find
N10Conversations in both dev and test
54 lines to find
How it’s graded
Precision ≥ 0.95 and recall ≥ 0.95, for each defect.
The bar: the bar the Kelverne capstone sets for every defect.
Here the client data (the estate: a fictional client’s files, with documented problems planted in them) is already generated, with the kit’s seed: your code reads the files under dirty/. Run tests and Submit both grade your findings with the kit’s score.py, scoped as the task’s command scopes it; only Submit goes on your record. The written parts of the task aren’t graded here; they’re for your notes or your reviewer.
Run tests calls find() and grades what it returns. Submit does the same and saves the result.
⌘/Ctrl+Enter runs the tests, add Shift to submit. First run downloads 16 KB of data.