Design an Ethical AI Product: From Principles to Practice

  This is the series capstone. You have explored how AI learns, where it appears, how it makes decisions, how unfair outcomes can emerge and what responsible rules might look like. Now you will use all of that thinking to design an AI product where ethics changes the product itself.  

Share this challenge
Assign in
Classroom
Microsoft
Teams

Scan to open this challenge on any device

Loading...

Design an Ethical AI Product: From Principles to Practice

Your Mission
Design an AI product that is useful and ethical by design — then defend the choices you made.
You will start with a real user problem, set ethical boundaries, borrow one real trust pattern, red-team the risks and pitch a product with safeguards built into its features and decision process.
The Shape of This Challenge
Discover
✏️ ️ Notice & question
Explore
️ Investigate & test
Create
✏️ Make & explain
Reflect
️ Think & apply

Discover

Start with people and purpose. AI is not automatically the best solution just because it is available.
Step 1

Choose a Problem Worth Solving

✏️ Paper first · 8–10 mins
We are learning to define a real user problem before choosing an AI solution.

Ethical product design starts with people and purpose, not with adding AI because it sounds impressive.

Problem Brief
  1. Choose one real problem in learning, work, community life, accessibility, wellbeing or sustainability.
  2. Name the main user or group affected.
  3. Write: They need a better way to… because…
  4. Decide whether AI is genuinely useful here. If a simpler tool would work better, say so.
I can define a real user problem and justify whether AI is an appropriate part of the solution.
→ This becomes the purpose statement for your product.
Problem SolvingUser AwarenessCritical Thinking
Step 2

Draw the Ethical Boundaries

️ Product rules · 8–10 mins
We are learning to decide what an ethical AI product should and should not be allowed to do.

Every useful product has boundaries. Your earlier series work on data, decisions, bias and rules should now become design requirements.

Set the Boundaries
  1. Write three things your product must do to help the user.
  2. Write three things it must never do.
  3. Choose at least four design principles from: fairness, privacy, transparency, human control, safety, accessibility, accountability.
  4. Turn each chosen principle into one specific product requirement.
I can translate ethical principles into concrete product requirements and boundaries.
→ These requirements will guide every design choice you make next.
Ethical ReasoningDesign ThinkingCommunication

Explore

Turn ethics into concrete product requirements, research one useful design pattern and attack your own idea before someone else does.
Step 3

Research One Product Pattern

Choose your route · 8–12 mins
We are learning to learn from how a real digital or AI product handles trust and user control.

You are not looking for a perfect company. You are looking for one useful design pattern you can adapt or improve.

⚡ Quick Track

Choose a digital product you know. Identify one feature that gives users control, explanation, privacy choice, feedback or a way to correct the system. Write why that feature matters.

Dig Deeper

Use an approved research tool with: “Find one real AI-enabled product with a documented feature for transparency, privacy, user control, human review, accessibility or safety. Give me the company documentation or another credible primary source and explain the feature without claiming the whole product is ethically perfect.” Open the source and verify the feature.

I can identify one real trust or safety design pattern and explain why it helps users.
→ This gives you a concrete design pattern to adapt.
ResearchVerificationProduct Thinking
Step 4

Red-Team the Product Before You Build It

️ Risk workshop · 12–15 mins
We are learning to predict how a product could fail and design safeguards before launch.

A responsible team looks for failure modes early — including cases where the product works technically but creates an unfair, unsafe or confusing experience.

Risk → Safeguard
  1. List one risk in each area: data/privacy, fairness, wrong or misleading output, over-reliance.
  2. For each risk, add one safeguard built into the product.
  3. Choose one decision the AI should not make alone.
  4. Add a human review, correction or appeal route for that decision.
I can connect at least four product risks to specific design safeguards.
→ This becomes the ethics-by-design section of your final product.
Risk AssessmentProblem SolvingEthical Reasoning

Create

Bring the whole series together in an ethical AI product pitch.
Step 5

Pitch an Ethical AI Product

✏️ Sketch · Create · 35–50 mins
We are learning to combine user need, product design and ethical safeguards into one convincing concept.

Your final product must show that ethics changes the design itself — not just appear as a disclaimer at the end.

Your Product Must Show
  1. Product name, target user and problem.
  2. What the AI actually does — and why AI is appropriate.
  3. At least four ethical design requirements.
  4. At least four risks matched to safeguards.
  5. One human-review or user-correction mechanism.
  6. One real design pattern or source that influenced your thinking.
Product One-Pager
1 page · labelled concept + 70–100 words
⏱ 35–40 mins

Create a visual product concept with user problem, AI role, ethical features and risk controls.

Product Pitch
4 slides · max 25–30 words per slide
⏱ 40–50 mins

Pitch the problem, product, ethical design and why someone should trust it.

Founder Pitch
75–90 seconds final runtime
⏱ 40–50 mins

Pitch the product as if you are seeking approval to pilot it, including the safeguards you built in.

I can present an AI product where ethical principles visibly shape features, limits and safeguards.
→ This is your final series mission output.
EntrepreneurshipContent CreationDesign ThinkingLeadership
Step 6

Series Reflection: What Will You Build Differently?

️ Reflect · 8–10 mins
We are learning to connect learning across the whole series to future choices about AI.

You have moved from understanding how AI learns to designing something that should work responsibly for real people.

Reflect

Which earlier challenge changed your final product the most: learning, daily life, decisions, bias or rules?

Apply

If you were actually launching this product tomorrow, what would you test with real users before trusting it?

Look Forward

What responsibility should people who design or deploy AI always keep, even as systems become more capable?

I can explain how at least two ideas from the series changed a concrete product decision.
→ You have completed the Artificial Intelligence and Ethics series.
ReflectionLeadershipDigital CitizenshipSelf-Awareness
Dex
Dex AI Study Partner
* Click to generate
Hi! I'm Dex, your AI Study Partner. Ask me a question, attach a screenshot, test your skills with Quiz, or click Mastery for feedback!
Attachment Screenshot attached
🔒 Built with Google Gemini as a Study Partner trained strictly on this challenge content. No personal data is stored or shared.

TOOLKIT

Use an approved research tool plus credible product/company documentation for Step 3. Use Digitize Skills Hub/App Guides for prototyping, presentation design, video, visual communication or user research.

Educator / Parent Notes

Age, Stage and Prior Learning: S1–S3, Advanced/capstone. Best used after the other Artificial Intelligence and Ethics challenges, though scaffolds allow it to stand alone.
Before You Start: Make previous series work available if possible. Emphasise that learners are designing a concept, not building a real AI system or collecting real personal data.
How to Open This: Ask: “What is one app or AI tool that would be better if the people who made it had thought harder about the user before the technology?” Then shift to the capstone brief.
Scheduling: Allow 20–30 minutes for Steps 1–4 and a longer 35–50 minute Step 5 production block. This can comfortably become a two-session challenge or a mini-project.
If a Pupil Gets Stuck: Offer a small set of user problems rather than product ideas. Keep asking: Who is the user? What do they need? What should the AI never do? Which safeguard changes the actual design?
For Fast Finishers: Ask learners to prototype one critical interaction — for example the explanation, correction, consent or human-review screen — and test it with a peer.
Marking Guidance: Look for a genuine user problem, justified use of AI, at least four ethical requirements, at least four risk/safeguard pairs, meaningful human control and visible evidence that prior series learning changed the design.

More like this

Multiple Sessions
60–90 minutes
60–90 minutes