Bias and Fairness in AI: Whose Values Are Built In?

  AI bias is not about a machine secretly deciding to be unfair. Unequal outcomes can emerge from the data, labels, measurements, goals and design choices around a system. This challenge uses evidence and a small simulation to investigate how that happens and what people can do about it.  

Share this challenge
Assign in
Classroom
Microsoft
Teams

Scan to open this challenge on any device

Loading...

Bias and Fairness in AI: Whose Values Are Built In?

Your Mission
Investigate how unfair patterns can enter an AI system — then design safeguards that make fairness testable.
You will define bias carefully, run a small data simulation, investigate a documented case and create an AI Fairness Audit grounded in evidence rather than headlines.
The Shape of This Challenge
Discover
✏️ ️ Notice & question
Explore
️ Investigate & test
Create
✏️ Make & explain
Reflect
️ Think & apply

Discover

Start by separating ordinary error from patterns that could create unequal impact.
Step 1

Bias: Pattern, Preference or Unfair Outcome?

✏️ Paper first · 6–8 mins
We are learning to define AI bias carefully rather than treating every mistake as bias.

Bias can enter through data, labels, goals, measurement or deployment. A system can also make errors that are not evidence of unfairness by themselves.

Your Task
  1. Write your own definition of AI bias in one sentence.
  2. Under it, write one example of an ordinary mistake and one example that could create an unfair pattern across groups.
  3. Underline the part of your definition that involves patterns or unequal impact.
  4. Keep the definition — you will revise it later.
I can distinguish a general AI mistake from a potentially biased or unfair pattern.
→ This gives you the definition section of your final fairness audit.
Ethical ReasoningCritical ThinkingAI Literacy
Step 2

Run a Tiny Biased Dataset Test

️ Hands-on simulation · 10–12 mins
We are learning to see how unbalanced examples can distort a model or rule.

You do not need a real AI model to see the problem. A small decision exercise can show how incomplete examples create misleading conclusions.

Mini Simulation
  1. Imagine a club is choosing activities using feedback from 10 pupils — but 8 responses came from one year group and only 2 from everyone else.
  2. List two conclusions the organisers might draw from that data.
  3. Now add five responses from underrepresented pupils with different preferences.
  4. Explain how the recommendation could change and why the first result looked convincing even though the sample was weak.
I can explain how unrepresentative data can create a misleading recommendation.
→ This gives you a simple mechanism for explaining data bias.
Data AwarenessProblem SolvingReasoning

Explore

Use a simulation and a documented case to understand how data, design and definitions of fairness matter.
Step 3

Investigate a Documented Bias Case

Choose your route · 10–15 mins
We are learning to use credible evidence to understand a real case of AI or algorithmic bias.

Real cases are more useful than invented horror stories. Focus on what happened, the suspected cause, who was affected and what changed afterwards.

⚡ Quick Track

Use a teacher-provided case or one you already know. Write four headings: system, unequal result, possible cause, response. If you cannot verify a detail, mark it as uncertain.

Dig Deeper

Use an approved research tool with: “Find one well-documented case where an automated or machine-learning system produced measurably different outcomes across groups. Give me a credible original study, regulator, court, government or company source. Summarise the system, evidence, likely cause and response without exaggerating what the evidence proves.” Open the source and verify at least two details.

I can summarise a documented bias case without overstating what the evidence proves.
→ This becomes the real evidence in your final fairness audit.
ResearchVerificationEthical Reasoning
Step 4

Fairness Is Not One Simple Rule

️ Fairness dilemma · 10–12 mins
We are learning to understand that different definitions of fairness can conflict.

A system can treat everyone with the same rule and still produce unequal outcomes. In other situations, changing rules for different groups can create new questions. Fairness involves values as well as maths.

Debate the Trade-Off
  1. Imagine a school support tool flags pupils who may need extra help.
  2. Option A uses exactly the same threshold for everyone.
  3. Option B adjusts the threshold if evidence shows the tool misses one group more often.
  4. Write one argument for each option, then name the evidence you would want before choosing.
I can explain why a fairness decision can involve competing values and evidence.
→ This gives your final audit a more thoughtful fairness test.
CommunicationEthical ReasoningDecision Making

Create

Turn the evidence into a fairness audit with practical safeguards.
Step 5

Create an AI Fairness Audit

✏️ Plan · Create · 30–40 mins
We are learning to analyse a system for unequal outcomes, causes and possible safeguards.

Your finished audit should avoid blaming “the AI” as if it has intentions. Focus on data, measurement, design choices, deployment and impact.

Fairness Audit Checklist
  1. Define the fairness issue clearly.
  2. Use one documented case or evidence-backed example.
  3. Explain at least one plausible route by which bias entered the system.
  4. Identify who could be affected.
  5. Recommend at least two safeguards: better data/testing, human review, transparency, monitoring or a different design choice.
Fairness Audit
1 page · 5 labelled sections · 50–70 words
⏱ 30–35 mins

Create a compact audit: issue, evidence, cause, impact and safeguards.

Ethics Briefing
3–4 slides · max 25–30 words per slide
⏱ 30–40 mins

Brief a product team on one documented bias problem and what they should change.

Case Explainer
60–90 seconds final runtime
⏱ 30–40 mins

Explain how bias can enter a system without claiming the AI deliberately chose to discriminate.

I can create a balanced fairness audit using evidence, causes, impacts and realistic safeguards.
→ This is your finished mission output.
Content CreationEthical ReasoningCommunication
Step 6

Reflect, Apply, Look Forward

️ Reflect · 5–8 mins
We are learning to ask better fairness questions about AI systems.

The goal is not to conclude that every AI system is biased. It is to know what evidence and safeguards to look for.

Reflect

How did your definition of AI bias change during the challenge?

Apply

What evidence would you want before trusting a claim that an AI system is “fair”?

Look Forward

Who should be involved when organisations test whether an AI system works fairly for different people?

I can name one strong question I could use to investigate fairness in a real AI system.
→ Next, you will turn these concerns into practical rules for responsible AI.
ReflectionDigital CitizenshipEthical Reasoning
Dex
Dex AI Study Partner
* Click to generate
Hi! I'm Dex, your AI Study Partner. Ask me a question, attach a screenshot, test your skills with Quiz, or click Mastery for feedback!
Attachment Screenshot attached
🔒 Built with Google Gemini as a Study Partner trained strictly on this challenge content. No personal data is stored or shared.

TOOLKIT

Prioritise original studies, regulators, government sources, court documents or transparent company documentation for real bias cases. An approved AI research tool may help locate sources but should not be treated as the source itself.

Educator / Parent Notes

Age, Stage and Prior Learning: S1–S3, Developing. The challenge addresses discrimination and unequal outcomes; establish respectful discussion norms and avoid inviting pupils to disclose personal experiences.
Before You Start: Choose or approve suitable documented cases. Be careful with claims: unequal outcomes can have multiple causes, and a single anecdote is not enough to establish systemic bias.
How to Open This: Ask: “If an AI system makes one mistake, is that bias?” Use the disagreement to establish the need for patterns, evidence and impact.
Scheduling: The Step 2 simulation works well as a whole-class activity. Step 3 research may need extra time if learners are new to source verification. Pause before Step 5 if needed.
If a Pupil Gets Stuck: Use the chain data/design choice → system behaviour → unequal impact → safeguard. If learners get stuck on a sensitive real case, return to the neutral survey simulation.
For Fast Finishers: Ask learners to find two possible fairness measures that could point in different directions, then explain why deciding between them is partly an ethical question.
Marking Guidance: Look for careful definitions, evidence quality, plausible causes rather than unsupported certainty, recognition of fairness trade-offs and safeguards connected to the identified risk.

More like this

Multiple Sessions
60–90 minutes
60–90 minutes