AI Risk Management Framework
NIST's framework for assessing whether an AI system is trustworthy enough for the job you want it to do.

Artificial intelligence is useful for some tasks and unreliable for others. Learn where current tools can save time, identify patterns, summarise information and assist people — and where confident output should not be trusted.
Artificial intelligence is not one technology. The term covers systems that classify information, find patterns, generate text or images, make predictions, summarise documents and recognise speech. The useful question is not whether the fire service should use AI. It is whether this specific system is reliable enough for this specific task. A practical way to sort it: lower-risk uses are drafting routine communications, summarising non-sensitive documents, organising information and producing first drafts for human review. Moderate-risk uses — data analysis, trend detection, documentation assistance, planning support — need verification and human review. Higher-risk uses touch clinical decisions, dispatch, personnel decisions, safety-critical fireground recommendations and anything affecting individual rights, and need substantially greater controls. The more consequential the decision, the stronger the evidence, testing, transparency and oversight should be. Generative AI can produce fluent, confident output that is wrong. Confidence of presentation is not evidence of accuracy.
If you read one thing on this subject, read this.
NIST's framework for assessing whether an AI system is trustworthy enough for the job you want it to do.
The risks specific to generative systems, and what to do about them.
Why it matters
This is the kind of AI most departments will meet first, in a product they already own.
NIST's collected AI guidance, standards work and terminology.
Why it matters
A single place to check a claim about AI against something other than a sales deck.
Why assurance means more than accuracy: data quality, algorithm performance, trustworthiness, security and explainability.
Why it matters
Useful when a vendor answers “is it accurate?” and considers the subject closed.
Related guide on the Hub.
Everything above was published by someone else, and is here because it is the clearest treatment of the subject we could find and verify. The Hub’s own guide to this topic is still being written. If you know a better source than the ones listed, that is worth telling us before it is.
Send a note