AI as Colleague, Not Replacement: When Automation Goes Wrong

  AI adoption is not a simple choice between keeping humans or replacing them. Organisations have to decide which tasks AI should perform, where human judgement adds value and what happens when the system is uncertain or wrong. You will compare real cases and design a task-level human-AI collaboration model with clear escalation and accountability. […]

Digitize Futures AI Literacy ProgrammesThe Future of Work in the AI Age Robot Hand
Share this challenge
Assign in
Classroom
Microsoft
Teams

Scan to open this challenge on any device

Loading...

AI as Colleague, Not Replacement: When Automation Goes Wrong

Your Mission
Design AI as a colleague rather than assuming every automatable task should be handed over.
You will diagnose automation failures, compare real cases, map task ownership and create a clear human escalation workflow.
The Shape of This Challenge
Discover
✏️ ️ Notice & question
Explore
️ Investigate & test
Create
✏️ Make & communicate
Reflect
️ Think & apply

Discover

Start with the ways automation can fail even when the software technically works.
Step 1

Automation Has Failure Modes

️ Scenario diagnosis · 8–10 mins
We are learning to identify what can go wrong when organisations automate a task without designing the human role properly.

A system can save time while reducing quality, trust, accountability or resilience. The important question is which task should be automated and where human judgement remains necessary.

Your Task
  1. Choose four failure modes: wrong answer, poor judgement, no escalation, hidden bias, customer frustration, deskilling, over-reliance, unclear accountability.
  2. Match each to a workplace scenario.
  3. Choose the failure that would be most serious in a high-stakes role and explain why.
I can identify several ways automation can fail beyond simple technical error.
→ This gives you a diagnostic framework for real case studies.
Problem SolvingCritical ThinkingAI Literacy
Step 2

Augment, Automate or Keep Human-Led?

✏️ Task triage · 8–10 mins
We are learning to decide what level of AI involvement fits different workplace tasks.

The strongest design is often mixed: AI handles speed, search or drafting while humans keep responsibility for judgement, relationships and exceptions.

Your Task
  1. Choose one job and list six tasks.
  2. Label each AI-led, AI-assisted or human-led.
  3. For every AI-led or assisted task, add a checking/escalation rule.
  4. Identify one task where unclear accountability would create unacceptable risk.
I can design a task-level division of work between AI and humans.
→ This becomes the comparison framework for the case-study investigation.
Problem SolvingEthical ReasoningAI Literacy

Explore

Compare real adoption cases and turn ‘human oversight’ into concrete rules.
Step 3

Compare a Failure and a Better Collaboration

Choose your route · 12–18 mins
We are learning to compare real AI adoption cases and identify why outcomes differed.

Avoid the simple conclusion that ‘AI failed’ or ‘AI worked’. Look at task selection, quality measures, human oversight, escalation and incentives.

Your Task
  1. Choose one documented case where automation produced problems.
  2. Complete one research route.
  3. Compare it with a case where AI appears to augment human work more effectively.
  4. Identify the three design choices that mattered most.
⚡ Quick Track

Use two credible reports/articles covering one failure and one stronger collaboration case. Record the task, claimed benefit, human role and observed outcome.

Dig Deeper

Trace one case over time using company statements plus independent reporting. Compare the original promise with later evidence and identify what changed.

I can compare real cases and explain what made human-AI collaboration stronger or weaker.
→ This supplies evidence for your final workplace collaboration design.
ResearchProblem SolvingCritical Thinking
Step 4

Design the Escalation Rule

️ Workflow design · 10–12 mins
We are learning to create a human-checking and escalation process for an AI-assisted task.

Human oversight is only useful if people know when and how to intervene.

Your Task
  1. Choose one AI-assisted task.
  2. Define three triggers that require human review.
  3. Name who has final responsibility.
  4. Add one quality measure that would reveal if the system is getting worse over time.
I can create a practical escalation and accountability rule for AI-assisted work.
→ This turns general ‘human in the loop’ language into an actual workflow.
Problem SolvingLeadershipEthical Reasoning

Create & Share

Create a collaboration profile showing where AI helps and where humans stay responsible.
Step 5

Create a Human-AI Collaboration Profile

✏️ Design · Create · 25–35 mins
We are learning to design a realistic AI collaboration model for a real job.

The final profile should show where AI adds value, where humans remain responsible and how errors reach a person who can act.

Your Task
  1. Choose one real job.
  2. Map at least six tasks across AI-led, AI-assisted and human-led.
  3. Include three escalation triggers and one quality measure.
  4. Use evidence from at least one real adoption case.
  5. Choose one output below.
Human-AI Collaboration Map
1 page · 6+ tasks + workflow
⏱ 25–30 mins

Show who/what does each task, where checking occurs and who owns the final decision.

AI Adoption Brief
1 page · 300–350 words
⏱ 25–30 mins

Recommend a balanced automation approach for one job using case-study evidence.

When Automation Goes Wrong
4 slides · maximum 30 words per slide
⏱ 30–35 mins

Compare failure/success patterns and present your improved collaboration design.

I can create a task-level collaboration design with clear human accountability.
→ This is your finished mission output.
Problem SolvingCommunicationEthical Reasoning
Step 6

Reflect, Apply, Look Forward

️ Think or discuss · 5–8 mins
We are learning to reflect on what good human-AI collaboration requires from workers and organisations.

The next challenge looks at roles that exist because organisations need people to build, govern, train or integrate AI systems.

Your Task
  1. Answer the prompts.
  2. Name one job where AI assistance could improve quality rather than simply reduce headcount.
  3. Write one oversight skill workers may need more of.
Reflect

Which failure mode was easiest for organisations to underestimate?

Apply

Where would you personally want a human to remain clearly accountable?

Look Forward

What new workplace skill becomes important when AI handles more first-draft work?

I can explain why effective AI adoption is an organisational design problem as well as a technology problem.
→ You are ready to investigate the new roles emerging around AI adoption.
ReflectionProblem SolvingLeadership
Dex
Dex AI Study Partner
* Click to generate
Hi! I'm Dex, your AI Study Partner. Ask me a question, attach a screenshot, test your skills with Quiz, or click Mastery for feedback!
Attachment Screenshot attached
🔒 Built with Google Gemini as a Study Partner trained strictly on this challenge content. No personal data is stored or shared.

TOOLKIT

Choose Your Tools

Use current sources where possible. AI and labour-market evidence changes quickly, so record publication dates and distinguish forecasts from observed data.

Case studies

Use documented company or profession examples. Distinguish company claims, independent reporting and later outcomes.

Task map

Separate tasks into AI-led, human-led and shared/checked. Add consequences if judgement is assigned to the wrong side.

Create

Use a collaboration map, management briefing or short case-study explainer.

Educator / Parent Notes

Age, Stage and Prior Learning: Designed for S4–S6 and adults. Use documented cases and avoid reducing the discussion to either 'AI is bad' or 'AI is inevitable'.
Before You Start: Select case studies with enough evidence to discuss outcomes, not just company launch announcements.
How to Open This: Ask: “If AI gets 95% of customer questions right, what should happen with the other 5%?” Use this to surface escalation and accountability.
Scheduling: Steps 1–4 need 40–50 minutes. Step 5 needs 25–35 minutes.
If a Pupil Gets Stuck: Provide two short case-study summaries and one job task list. Let the learner design escalation for three tasks.
For Fast Finishers: Ask learners to add measurable service-quality indicators or model how deskilling could occur over several years.
Marking Guidance: Look for task-level design, evidence from real cases, explicit escalation rules, clear accountability and attention to quality rather than headcount alone.

More like this

Multiple Sessions
60–90 minutes
60–90 minutes