AI bias is not about a machine secretly deciding to be unfair. Unequal outcomes can emerge from the data, labels, measurements, goals and design choices around a system. This challenge uses evidence and a small simulation to investigate how that happens and what people can do about it.
Scan to open this challenge on any device
Bias can enter through data, labels, goals, measurement or deployment. A system can also make errors that are not evidence of unfairness by themselves.
You do not need a real AI model to see the problem. A small decision exercise can show how incomplete examples create misleading conclusions.
Real cases are more useful than invented horror stories. Focus on what happened, the suspected cause, who was affected and what changed afterwards.
Use a teacher-provided case or one you already know. Write four headings: system, unequal result, possible cause, response. If you cannot verify a detail, mark it as uncertain.
Use an approved research tool with: “Find one well-documented case where an automated or machine-learning system produced measurably different outcomes across groups. Give me a credible original study, regulator, court, government or company source. Summarise the system, evidence, likely cause and response without exaggerating what the evidence proves.” Open the source and verify at least two details.
A system can treat everyone with the same rule and still produce unequal outcomes. In other situations, changing rules for different groups can create new questions. Fairness involves values as well as maths.
Your finished audit should avoid blaming “the AI” as if it has intentions. Focus on data, measurement, design choices, deployment and impact.
Create a compact audit: issue, evidence, cause, impact and safeguards.
Brief a product team on one documented bias problem and what they should change.
Explain how bias can enter a system without claiming the AI deliberately chose to discriminate.
The goal is not to conclude that every AI system is biased. It is to know what evidence and safeguards to look for.
How did your definition of AI bias change during the challenge?
What evidence would you want before trusting a claim that an AI system is “fair”?
Who should be involved when organisations test whether an AI system works fairly for different people?
AI systems can affect access, visibility, opportunity and services. Learners need the ability to investigate unequal outcomes carefully, distinguish evidence from assumptions and propose safeguards that make systems more accountable.
Fairness Audit: 1 page with 5 labelled sections and around 50–70 words, 30–35 mins. Ethics Briefing: 3–4 slides, maximum 25–30 words per slide, 30–40 mins. Case Explainer: 60–90 seconds final runtime, 30–40 mins.
Next in the series: Should AI Have Rules? — convert what you have learned about risk, fairness and accountability into a usable ethical framework.
Prioritise original studies, regulators, government sources, court documents or transparent company documentation for real bias cases. An approved AI research tool may help locate sources but should not be treated as the source itself.
AI systems can affect access, visibility, opportunity and services. Learners need the ability to investigate unequal outcomes carefully, distinguish evidence from assumptions and propose safeguards that make systems more accountable.
Fairness Audit: 1 page with 5 labelled sections and around 50–70 words, 30–35 mins. Ethics Briefing: 3–4 slides, maximum 25–30 words per slide, 30–40 mins. Case Explainer: 60–90 seconds final runtime, 30–40 mins.
Next in the series: Should AI Have Rules? — convert what you have learned about risk, fairness and accountability into a usable ethical framework.
Prioritise original studies, regulators, government sources, court documents or transparent company documentation for real bias cases. An approved AI research tool may help locate sources but should not be treated as the source itself.
Prioritise original studies, regulators, government sources, court documents or transparent company documentation for real bias cases. An approved AI research tool may help locate sources but should not be treated as the source itself.