Associate Foundations · 21% of the exam

output evaluation and validation

This is the largest exam domain, about a fifth of the exam. It covers what happens after Claude replies: checking a draft against its brief and its sources, spotting what is invented, contradictory or one-sided, confirming specific claims, deciding how much checking a draft needs, fitting it to its reader, and choosing its shape.

Course example

Every domain follows Wrenfield Housing, the course's own example rather than an exam scenario. Wrenfield is a regional, not-for-profit housing provider with about 300 staff. Its operations, communications and project teams use Claude on the organisation's Team plan. Its AI policy has two rules: tenants' personal data stays out of anything sent to Claude unless it is anonymised first, and a person checks anything that goes to tenants, the board or the regulator.

Domain 2 is where Wrenfield checks Claude's drafts before they go out. The quarterly board summary is read against its brief and its figures sheet (2.1). A draft tenant handbook Q&A cites a clause that does not exist, gives two notice periods and leaves out two ways to report a repair (2.2). A summary of the regulator's new guidance has its deadline checked in the original (2.3). A covering note to the regulator nearly goes out after one read-through (2.4). One backlog update is adapted for tenants, the board and the contractor (2.5). The spring forum notes become a quick answer, a table and a one-page document (2.6).

brief and source, both waysevery claim to its originalchecking matched to the stakesone source, three readers
14 daysthe damp and mould wait in the first board summary. The figures sheet said 41; the draft read well, and only a check against the sheet caught it.

Start hereThe words used throughout this domain

prompt
The message you send Claude: the request, plus everything you give it to work with (1.1).
hallucination
Text that is factually incorrect or inconsistent with what Claude was given, often a precise detail such as a clause number (2.2).
fact-checking
Confirming each specific claim, such as a number, a date or a citation, against the authoritative original it comes from (2.3).
human review
A person reading an output before it is used or sent. Additional verification also checks its claims against a source (2.4).
artifact
A standalone document, deck or dashboard that Claude builds in a panel beside the chat, which you can edit, keep and share (2.6).
web search
Claude looking up a straightforward fact on the web in one or two searches. Research goes deeper, with many searches (1.4).

task statements

flashcards

0 / 18 known
Card 1 of 18