Task statement 6.4 · Governance, risk and responsible use
6.4 · Ethical Implications
In Wrenfield Housing, the course example, the communications team drafts a tenant FAQ for a new hardship fund with Claude. The ethical implications of AI use are its effects on the people an output reaches or describes, beyond whether its facts are right. A draft can pass every fact check and still shut some tenants out.
share
The tempting view is that ethics is covered once the facts are checked and the AI policy is followed. A fact check asks whether the output is true, and the policy says what you must do. Neither asks who the output treats unfairly, who should know AI helped, or who answers for it. A document can be accurate and allowed and still fail the readers who need it most. The opposite mistake is treating every use of Claude as an ethical risk, so checks on brainstorms crowd out the outputs that affect people.
KnowledgeWhat ethical use asks of an AI-assisted output
Ethical questions arise when an output affects people: the tenants who read it, the applicants it describes, or the colleagues who act on it. Claude can repeat the assumptions of the human writing it learned from, and the Anthropic study recapped in 2.2 found that its answers varied with demographic details, though careful prompting reduced this. A fluent draft hides those assumptions, so the person using Claude has to ask the questions the draft cannot ask itself. This rules out any answer that treats a correct draft as finished when it reaches or describes people.
Before such an output goes out, ask these questions in order:
- Fairness: who could this output leave out or treat worse? Look for bias, a pattern that favours some groups over others.
- Respect: does it describe people in plain, accurate words, without blame?
- Transparency: who needs to know that AI helped, and how will they be told?
- Accountability: which named person signs it and answers for it?
- Human judgement: which decisions stay with people, and are those people still thinking for themselves?
Interactive · what the hardship fund FAQ settles as each check is done
Step through the review of the hardship fund FAQ, from Claude's first draft to the signed version, and see what each check settles.
First draft: every fact is right, but no check is done. The FAQ offers only a web form in English, does not say AI helped, has no owner and never says who decides.
Fairness and respect checked: tenants can apply online, by phone or on paper, with help in another language, and nobody is blamed. AI's role, the owner and who decides are still open.
Transparency checked: a closing note says an AI tool helped and staff checked every answer. Nobody has signed it or said who decides.
Accountability and judgement checked: the communications lead signs, and the FAQ says a panel of three staff decides every application, never Claude.
KnowledgeTransparency, accountability and human judgement
Transparency means being open about AI's role. Anthropic's AI Fluency course calls this Transparency Diligence: being honest about AI's role in your work with everyone who needs to know. Who needs to know depends on what readers do with the output, so a tenant applying for money has more reason to know than a colleague reading meeting notes. In one case the choice is not yours. Take advice or a decision about an individual in a high-risk area such as housing: when it is based on an AI recommendation, Anthropic's Usage Policy says that person must be told AI was used. The current version and the one starting on 12 November 2026 both require it:
Required by the Usage Policy
The person must be clearly told that AI was used, and a qualified person reviews the output first, as 2.4 showed.
Your choice: none; the policy sets it.
Transparency Diligence
Say that AI helped where readers rely on the output or would expect to know; one line is enough.
Your choice: agreed once per kind of output.
Accountability means a named person answers for the output once it is used, like the reviewer in 2.4 who verifies and vouches for what they share. "Claude wrote it" is never the answer to a complaint, because Claude cannot explain the choice, apologise or put it right. Name the person before the work starts, because an output several people touched can end up owned by no one.
Over-reliance is accepting AI output without applying your own judgement, usually because it is fluent and has been right before. It creeps in slowly, so a reviewer who found nothing wrong in ten drafts reads the eleventh less closely. Anthropic's AI Fluency course says that even the most advanced AI systems benefit from human judgement and oversight. The firmest line is around decisions about individual people, such as who gets money, a home or a job: Claude may draft the criteria (4.1), but people judge each case.
SkillWorked example: the hardship fund FAQ
Wrenfield is opening a Winter Hardship Fund: grants of up to £250 towards heating and food, open to applications from 1 December to 31 January, each decided by a panel of three staff. The team gave Claude the fund's rules and no tenant data (policy rule 1) and asked for a twelve-question FAQ. Every fact was right, but the review found two problems:
# before (draft, Q4 and Q7) Q4. How do I apply? Fill in the online form on our website by 31 January. Q7. Who is it for? Tenants who have fallen behind through poor budgeting. → assumes every tenant reads English online; blames the reader # after Q4. Apply online, by phone on the income team's line, or on a paper form from any estate office. Call us for help in another language. Q7. Tenants who are finding it hard to pay for heating or food this winter. Q12. Who decides? A panel of three Wrenfield staff decides every application. Note: We used an AI tool to help write this FAQ. Our staff checked every answer. → signed by the communications lead before it goes out
The cause was an assumption, not a factual error. Claude wrote for the most common reader, someone online and fluent in English, so the draft closed the fund to households without internet access or with little English. A fact check would never find this, because nothing in the draft was false. The team added other ways to apply, rewrote Q7 to describe a situation rather than blame a reader, and added Q12 so tenants know that people decide. The FAQ is general information, not advice to one tenant, so the AI note was the team's choice under Transparency Diligence. The communications lead signed the FAQ, as policy rule 2 requires, and the panel decides every application without Claude.
- A draft can be accurate and allowed and still unfair, because it can assume a typical reader and miss everyone else.
- Be open about AI's role with everyone who needs to know; for high-risk advice or decisions about one person, the Usage Policy requires it.
- Over-reliance is the quiet risk: a named person answers for each output, and decisions about people stay with people.