RAI Evaluation in Healthcare

AI Risk Assessment and Mitigation Tool

A framework for healthcare providers to assess AI-based screening tools before procurement, during deployment, and after go-live.

  • Evaluate whether an AI tool is suitable for your clinical setting
  • Identify potential risks before deployment
  • Assess vendor claims and documentation
  • Conduct mitigation activities to reduce risks
  • Maintain clinical oversight and accountability throughout use

How it works

Work through three stages, then see a clear risk summary.

1

Appraisal

Check whether this AI tool is a good fit for your setting

2

Pre-deployment

Spot risks and plan mitigations before you go live

3

Integration

Confirm the tool works as intended in everyday practice

4

AI risk summary

See an overall picture of risk across your assessment once all stages are complete

How to use the tool

Start an assessment for the Clinical AI solution you are evaluating. Create as many assessments as you need—one per solution—and invite your team to help.

  1. 1

    Start an assessment

    Create an assessment for that Clinical AI solution. Invite clinical, IT, or admin colleagues when you need their input.

  2. 2

    Answer with the guidance open

    Record each decision or score yourself. Use the on-screen guidance. Ask the vendor or check their documentation when you need evidence. In Appraisal, choose Go, Conditional go, or No go. In Pre-deployment and Integration, score 0 (low), 1 (moderate), or 2 (high).

  3. 3

    Review summaries as you go

    After you finish a stage, you can view its stage summary and review risk for that stage. After you complete Appraisal, Pre-deployment, and Integration, you can view the AI risk summary for the full picture and act on the cues that matter to your practice.

Create account Sign in

Guidance only—your clinical context, regulations, and professional judgment still lead.

Reading your AI risk summary

The AI risk summary shows where risk concentrates by stage and by domain—not a single pass or fail. It includes Appraisal decisions. You can also view each stage summary after you complete that stage.

You see averages for Pre-deployment and Integration, how many answers scored 0, 1, or 2, the same breakdown by domain, and a cue next to each average.

What the cues mean

  • Low · 0.00 – 0.50 Acceptable to deploy
  • Moderate · 0.51 – 1.50 Deploy only with mitigation
  • High · 1.51 – 2.00 Review before you proceed

Appraisal uses Go / Conditional go / No go. The numeric bands above apply mainly to Pre-deployment and Integration.