Track 07 · Data & governanceLesson 09 of 11
Registries for models, prompts and agents
A named owner and a record for everything you deploy.
- Lesson library · reference
- 30 min read
- 60 min hands-on
- Pro
What you'll be able to do
01- Explain the difference between artefact registries, discovery registries and the governance inventory, and why they must be linked rather than one stretched to do all three jobs.
- Design a registry entry that records owner, purpose, risk tier, pinned components (model, prompt, tools, configuration), eval evidence, approvals, deployment status and lifecycle dates.
- Implement an approval gate that refuses promotion without a passing eval for the exact release hash and enforces segregation of duties.
- Trace lineage from dataset to eval to approval to deployment for any production answer.
- Run a deprecation and ownership report that catches retiring model snapshots, broken rollback targets and orphaned agents.
- Defend the design to a model-risk reviewer, citing current guidance (SR 26-2, which replaced SR 11-7, and the RBI's 2026 draft) accurately.
Before you start
- Treat prompts like releases: owns prompt versioning mechanics, content hashes and label-based rollout.
- Regression tests and CI gates: produces the eval records approvals depend on.
- Acceptance criteria and sign-off: what "passing" means and who signs.
- Agent credentials, from issue to revoke: each registered agent has an identity whose lifecycle should match its entry.
- Governance built in, not bolted on: the vocabulary the registry turns into records.
The short version
A registry is the record of what is running, who owns it, what it is made of, what evidence justified shipping it, who approved it and when it must be reviewed or retired. For an LLM agent the "model" is one component among several: a release pins a model snapshot, prompt version, tool set and scopes, agent configuration and guardrail policy, and is identified by a content hash. Artefact registries (MLflow, Langfuse, cloud model registries) store the components. Discovery registries (AWS Agent Registry, Microsoft Agent 365, A2A catalogues) say what exists and how to call it. The governance inventory, run by the customer's model risk or AI governance team, links them: one entry per agent with a named owner, risk tier, eval and approval chain, and lifecycle dates. Your job is to make that entry accurate on day one and keep it accurate automatically after you leave.
- The release hash is the identity; the version number is for humans. Evals, approvals and traces bind to the hash.
- No passing eval for this exact release, no approval. Enforce it in code.
- The approver is never the builder or the owner.
- Rollback targets are part of the inventory. If their model snapshot retires, rollback fails when you need it.
- An agent with no active owner is an incident waiting for a date.
Pro lesson
The rest of this lesson is in Pro.
The mental model, worked example, field note, failure table, exercise and self-check, with the voice tutor.
- Every stage and specialisation, in full
- Every lab and every role project
- Halden weeks 2–10, on your record
- Every drill, live in the playground
- All solutions, plus the server judge
- Lab Assistant and every Teach with AI