Catch every card number before a model sees it
Your goal
Find the planted defect in dirty/sf_cases.csv and flag every affected line in findings.jsonl.
- 1 defect
- 190 KB of data
- FromGuardrails the risk team can sign
- Northvale Bank
Pro lab
This lab is in Pro.
The brief, the hints, and grading against the kit’s scorer are in Pro. Stage 1’s lab is free.
- Every stage and specialisation, in full
- Every lab and every role project
- Halden weeks 2–10, on your record
- Every drill, live in the playground
- All solutions, plus the server judge
- Lab Assistant and every Teach with AI
Defects to find
N03Full card numbers in case descriptions
470 lines to find
How it’s graded
Precision ≥ 0.95 and recall ≥ 1.00, for each defect.
The bar: the lesson: aim for recall 1.0, because a card number that reaches a model is an incident.
Here the client data (the estate: a fictional client’s files, with documented problems planted in them) is already generated, with the kit’s seed: your code reads the files under dirty/. Run tests and Submit both grade your findings with the kit’s score.py, scoped as the task’s command scopes it; only Submit goes on your record. The written parts of the task aren’t graded here; they’re for your notes or your reviewer.
Run tests calls find() and grades what it returns. Submit does the same and saves the result.
⌘/Ctrl+Enter runs the tests, add Shift to submit. First run downloads 190 KB of data.