course contents
Associate Foundations · 21% of the exam
output evaluation and validation
share
This is the largest exam domain, about a fifth of the exam. It covers what happens after Claude replies: checking a draft against its brief and its sources, spotting what is invented, contradictory or one-sided, confirming specific claims, deciding how much checking a draft needs, fitting it to its reader, and choosing its shape.
Every domain follows Wrenfield Housing, the course's own example rather than an exam scenario. Wrenfield is a regional, not-for-profit housing provider with about 300 staff. Its operations, communications and project teams use Claude on the organisation's Team plan. Its AI policy has two rules: tenants' personal data stays out of anything sent to Claude unless it is anonymised first, and a person checks anything that goes to tenants, the board or the regulator.
Domain 2 is where Wrenfield checks Claude's drafts before they go out. The quarterly board summary is read against its brief and its figures sheet (2.1). A draft tenant handbook Q&A cites a clause that does not exist, gives two notice periods and leaves out two ways to report a repair (2.2). A summary of the regulator's new guidance has its deadline checked in the original (2.3). A covering note to the regulator nearly goes out after one read-through (2.4). One backlog update is adapted for tenants, the board and the contractor (2.5). The spring forum notes become a quick answer, a table and a one-page document (2.6).
Start hereThe words used throughout this domain
- prompt
- The message you send Claude: the request, plus everything you give it to work with (1.1).
- hallucination
- Text that is factually incorrect or inconsistent with what Claude was given, often a precise detail such as a clause number (2.2).
- fact-checking
- Confirming each specific claim, such as a number, a date or a citation, against the authoritative original it comes from (2.3).
- human review
- A person reading an output before it is used or sent. Additional verification also checks its claims against a source (2.4).
- artifact
- A standalone document, deck or dashboard that Claude builds in a panel beside the chat, which you can edit, keep and share (2.6).
- web search
- Claude looking up a straightforward fact on the web in one or two searches. Research goes deeper, with many searches (1.4).