Firefighters running a live burn evolution at a training facility while an instructor reviews performance data on a tablet.

AI Governance and Policy

Establish the rules before widespread adoption. Define acceptable uses, sensitive information, human responsibility, records requirements, procurement expectations, and what must happen when AI is wrong.

Full guide planned · 22 min read

The short version

An AI policy should not begin by banning or approving a list of products — products change too quickly. Good governance establishes principles: how AI may be used, what information may be entered, which decisions require human review, who is accountable, and how much risk the organisation is willing to accept. A workable frame is three tiers. Low risk is AI assisting administrative or creative work with output routinely reviewed. Moderate risk is AI influencing analysis, recommendations or organisational decisions, requiring documented human validation. High risk is anything that could affect safety, clinical care, dispatch, personnel rights or significant money. The higher the consequence of being wrong, the stronger the governance. And do not write a policy that assumes AI output is either always trustworthy or always dangerous — neither is true, and both produce rules people quietly ignore.

Start here

If you read one thing on this subject, read this.

Official resourceNIST

Generative AI Profile (NIST AI 600-1)

The generative-AI companion to the AI Risk Management Framework, covering risks specific to systems that produce text and images.

Official resourceNIST

AI RMF Playbook

Suggested actions for putting the AI Risk Management Framework into practice.

Why it matters

The closest thing to a starting draft for a department AI policy.

Go deeper

Official resourceNIST

AI Risk Management Framework

The federal framework for identifying and managing the risks of an AI system.

Why it matters

A defensible basis for an AI policy, rather than writing one from scratch under pressure.

Questions to ask your vendor

  1. What model is being used?
  2. Can the vendor change models without telling us?
  3. What department data is retained?
  4. Is our information used for model training?
  5. Where is information processed?
  6. What subcontractors or model providers are involved?
  7. How does the vendor evaluate accuracy?
  8. How does the vendor evaluate bias?
  9. What logs are retained?
  10. Can we audit significant decisions?
  11. How are incidents reported?
  12. Can we disable AI features without losing the underlying product?

This is a reading list, not a guide

Everything above was published by someone else, and is here because it is the clearest treatment of the subject we could find and verify. The Hub’s own guide to this topic is still being written. If you know a better source than the ones listed, that is worth telling us before it is.

Send a note