Practical guide

Running an AI fire drill

How to run an AI fire drill in your school, with thanks to Mike Richardson (OneIT Services and Solutions), Abid Patel and Gary Henderson for the idea.

Home › Running an AI fire drill

On NEN’s technical webinar, George Martin (SWGfL) said we don’t just expect people to self-organise in the event of a fire. We practise, so everyone knows what to do. We should do the same for AI.

What it is

You get the people who’d have to deal with a problem around a table, you give them a made-up problem and you talk through what you’d do. Nothing gets switched off and nobody’s being tested. Write down anything you weren’t sure about, then sort it out.

Why it’s important

Mike Richardson told us on the webinar about a possible data breach at a large MIS provider. Some of the schools Mike supports were worried about their passwords, so Mike suggested they run a fire drill and look at their policies. The first question that came back was “what policy?”

Heather Toomey (ICO) is a biker. Heather’s bike goes faster than Heather’s car, but it’s got better brakes. If you’re going to go faster with AI, you need good brakes too. Heather also asked what failing looks like, because turning everything off isn’t realistic, and shared a case of an airline that was held to a refund policy its chatbot made up. You’re accountable for what the tool says.

I hosted a NetSupport webinar on cyber security in 2024 with my good friend Gary Henderson and Abid Patel. Abid asked why we constantly have fire drills, and said we should prepare for a cyber attack just as we do for a fire alarm. Gary’s advice was to not aim for the gold standard, just aim to be more secure than you were yesterday. I’ve completely magpied that, and it works for all of this.

How to run one

Get your senior leader for AI, your DPO, your DSL, your IT lead and whoever looks after communications in a room, along with a teacher who’ll tell you how it would really play out. Pick a scenario from the list below. Use made-up details only, so no real names and nothing from a real pupil. Talk it through using the questions, then agree three things you’re going to change, who’s doing them and by when. 45 minutes should do it.

The questions to ask

  1. Who hears about this first, and do they know who to tell?
  2. Who’s in charge, and who covers if they’re away?
  3. What stops, what carries on, and who decides?
  4. Is it a data breach, a safeguarding concern or both? If it’s a breach we have to report, do we know about the ICO’s 72 hours?
  5. What do we tell staff, parents and pupils, and who tells them?
  6. Where do we write it down, and what will we do differently next time?

Six scenarios to try

  1. A teacher has pasted a class list with support notes into their personal AI account to help write reports. They’re worried and they’ve come to tell you. What do you do?
  2. A supplier of one of your approved AI tools has emailed to say they’ve had a security incident and your data might be affected, but they haven’t got many details yet. What happens next?
  3. An update has added an AI feature to a platform you’ve used for years. Nobody decided to turn it on, but staff have found it and they’re using it. Heather calls this version creep. What do you do?
  4. A letter has been drafted using AI about a school trip, but somehow it’s got the wrong date on it and a promise to refund money if someone didn’t go on the trip which was never agreed. Whoops! How do you solve the problem?
  5. An AI-made image of a pupil or a colleague is going round on phones. Your DSL leads on this under your safeguarding procedures. Who sees what, and who doesn’t?
  6. Someone left at Easter and they can still log in to a tool with pupil data in it. There’s more on this in when staff leave and tools retire. How do you sort it?

Mike also suggested asking tools like Copilot what they’d advise in a scenario, which can help you find the questions you didn’t know to ask. Treat it with a pinch of salt and check its work, like every child in your classroom. For cyber incidents, have a look at the NCSC’s free Exercise in a Box.

Afterwards

  • Change your incident plan and tell people you’ve changed it.
  • Put what you’ve learned into your training, including for your non-teaching colleagues.
  • Put the next one in the diary. One a term would be good if you can.

In practice

Decision to make
Which scenario you’ll run first, and when.
Who owns this?
Your senior leader for AI, with the DPO, the DSL and the IT lead.
Evidence to retain
Your notes from each drill, the actions and who owns them, and what you changed in your plan.

Guidance it speaks to

He isn’t just an advocate of tech for tech’s sake. It always has to fit the pedagogy, and that makes him a respected source of knowledge that schools can trust.

Al Kingsley MBE · Multi-academy trust chair and author

Working on your AI policy?

Support with writing or refining it, and with training your staff, is exactly the work I do. And if the template or the screening tool has helped in your school or trust, I’d love to hear about it.